One word: Yes.
Scattered around are alcoves which contain items which are useful, and occasionally necessary.
Have you seen any odd-colored stones?
Have you tried clicking on them?
These are secret buttons. Some of them open doors, others open secret passages, and still others are linked to puzzles. You should experiment even if a button doesn't seem to do anything immediately.