You'll need to open the gate in the moat.
The lever next to the bananas will open it. The only trouble is that those bananas are blocking the lever.