How did you get Lucky into the castle?
If you took the way where both Lucky and Chi went in together, you ...
... might want to play the other plot branch through.