If you've read some of the literature, you'll know that only one weapon will kill someone as powerful as Jack.
You need Captain Nichol's sword. See the previous question for more help.
Just keep swinging at Jack.
He'll be gone forever after you've "killed" him twice.