Look for a shield.
At the beginning of the game you learned this information from the Stained Glass Window in the Museum.
The Sergeant at Arms' shield featured a blue sword on a yellow background.
The Scribe's shield had flames at the bottom.