Those guards are stopping you.
Ever heard of creating a distraction?
You'll need to create an emergency, but don't stand around.
Fires could be good distractions.