Initially, it's OK to strike out on your own.
Put him off the first time he offers.
When you come back to the bar later, talk to him some more.
He wants to be a broker for anything you find in your mining wanderings.
It might be good to have a friend.
You're going to want to turn in gems you may find for money later on; Hunter can help with that.