Remember that "X" marks the spot.
Magician's spells might have a different effect when used there.
And Magician can turn the stone into a larger stone.
Get the stone and put it on top of the "X". Then have Magician cast a spell on it twice to make a ladder.