Have you found the sythe room yet?
Use an elevater to get to the room with the sythe.
The guards throw you out, if they can see you.
Go outside, and cast the INVISIBILITY spell on the tower.