The entrance to that island is rather hidden.
It's behind the waterfall.
Did you walk up to the hill behind the waterfall?