Yes, they did. There's no way to prevent this.
The octospiders must carry around the jewels to all of the gates.
Perhaps they dropped the one you need.
Look carefully around the room.