Something you've done has triggered their arrival on the beach.
You no longer need to return to the Isle to do anything other than talk to the Arch Druid to find out about the Realm of the Dead.