How do I get onto the island just south of the castle

Hint 1 of 2:

One if by land, two if by sea, three if by...

Hint 2 of 2:

Condor?  Jump up to let the bird near the cave grab you.