How can I get light for the caves?

The simple answer is to buy it.

There's a torch in the prospector's shop if you can afford it.

But there's no real hurry to getting in the mine.

In fact, you can wait until you find light.

The lantern from underneath the aquarium will help you.

But it's also very complex.  You'll have to find an easier-to-use lantern.