Either:

1. you misdiagnosed sex.
2. your plant is a hermie.
3. they aren;t 'really' budding.

Pics help a bunch