You should have bought something from the shop keeper that will help.
More specifically, you should have the shovel.
What do you have a shovel for?
"X" marks the spot.
Just use your shovel on the "X."