Magic Tree House: #3 Mummies in the Morning by Mary Pope Osborne
From Random House Books for Young Readers:
Jack and Annie don’t need another mummy. But that’s what they get when the Magic Tree House whisks them back to ancient Egypt. There they meet a long-dead queen who needs their help. Will Jack and Annie be able to solve the puzzle, or will they end up as mummies themselves?