What do I do in the giant's living quarters?

You could bring the food with you. Then he'll eat it and kick you back out.
But that doesn't get you anywhere.