You've entered the nightmare of Mark Twain.
Pilot the skiff by U)sing the boat's control in the desired direction.
Then Pass your turn, and the skiff moves that direction.