Don't get too close, or you'll get Jello'ed.
Just wait behind the rock, they will leave in a little while.