The first thing is to make sure that you don't walk right to it. You'll need to find a sneakier way up to the top of the tree.
Again, remember that Magician can make plants grow.