Here's what I would do, if you have any long wooden sticks like chopsticks or wooden skewers.

Light the candle with the matches, then get the end of the wooden stick burning enough so you have a small flame, then light the bud with that. It should burn down after a few seconds, but I always have some sand to put it out in. Just relight the wooden stick every time you hit instead of wasting all those matches.