The prisoner is yours for life and he will follow you around forever.
Well, not forever, just for a little while.
He will start pulling on a door, leave him there and kill the drunk guard. Grab his key and free the prisoner in the cell on top of your old one.