Make sure he can't find you.
Climb onto the roof right after you have talked him into opening the door.
Now, if you want to get in, you should try to make him move away from the door.
Did you examine the barrels on the rooftop yet?
Try launching one of them.
It seems like you caught his attention.