Though it seems illogical, this is not an uncommon trend in nature. The human eye has a blind spot among other fallacies in nature. The reason all the seeds are female is because the male banana is composed of only female chromosomes of the same plant so if you polinate it with its own genes you will get the same plant.

Its like identical twins inbreeding.