He will only let you have the crowbar once he has a reason to.
You need to give him something that will make the crowbar useless.