Did you go out on the balcony in the first tower that you were in?
Well, you should have.
The door to the balcony in that tower was locked.
But at least the key was on the inside of the other tower.