Male balls usually form in clusters like grapes.
If you are talking about a small sac right against the branch joints on the plants,that is not male balls.
As you said hard to make a firm judgement without pics,but it sounds like you are in the clear.