It is possible you could inhale some butane if its an inefficient lighter, but that really is nothing to worry about.

The only thing you have to worry about is if you started doing it intentionally to get high off, like sniffing the gas...Dont do that.

NB: Apparantly you can check if a light is leaking by looking at the shadow of the flame it produces, or by the whether the flame is produced cleanly.