Have you taken the quick way back to the abbey?
Then you might have seen the passage leading to the dungeon.