The guards don't notice me when they come, but as I leave they catch me

Hint 1 of 3:

Be very careful not to touch any guards.