The yellow wisp might be attracted by something of roughly the same color.
Fire might work here.
All you need is something that will burn and something to light it.
The pirate's wooden leg will burn nicely.
Light it with the matches to attract the yellow wisp.