You can't walk past them.
So you'd need to float over them.
Get the broom in the witch houses (close to the back entrance of the castle). That's where the kissing fat lady is too.