Yes, they did. There's no way to prevent this.
The octospiders must carry around the jewels to all of the gates.
Perhaps they dropped the one you need.