If you get just a sack or 2, then you can pull them off.
But a buttload of ballsax, and it's a given that you WILL miss enough to get significant seeding.
The seeds off the BB will be a feminized BB x mango cross. But since the pollen donor was a full blown herm, they will likely behave the same under your conditions.