One word: Yes.
Scattered around are alcoves which contain items which are useful, and occasionally necessary.
Have you seen any odd-colored stones?
Have you tried clicking on them?