If you go to the Realm of the Dead, you will be taking the hard path. See the Druids on the Isle of the Mist to help you enter this Realm.
You will need to use a spell to get back in. One of its ingredients can only be found in the Realm of the Dead.
Sometimes, wishes can come true.
You can create your own entrance into the castle.