I'd like to preface this post by saying I don't grow in cabs, but the concepts of airflow should stay consistent. With that out of the way, hopefully my advice will help until someone more experienced in your grow environment can help.

In order to lower the temperature of your cabinet, you need to draw in colder air from outside the cabinet (it wouldn't be practical to install an air conditioner). Since you have passive intakes (without fans) and exhaust fans, you're already drawing in outside air to some extent. Those passive intakes are only going to be as effective as your exhaust capabilities. The most effective way to cool a cabinet is to change the air as quickly as possible.

So here's where the math comes in. Calculate the volume of your grow space and compare it with the combined power of your exhaust fans (in cubic feet per minute). With growrooms, to my understanding you are aiming for the air to be completely replaced at least once every three minutes. Of course, more is better, as it only serves to bring in fresh, CO2 rich air. With a grow cabinet and the limited space it provides, you may want to replace the air in your cabinet quicker. If you're unsatisfied with the current ventilation, make sure you have fans on all your exhaust holes. It's much more efficient to exhaust air than it is to push air into your grow space. Once you have all your exhaust holes hooked up with fans, start mounting intake fans, making sure the power of the intake is lower than your exhaust.

Cannabis growing was explained to me as needing three elements equally to succeed: water, air, and light. It's really easy I find to lean towards putting most of your budget into lights or into nutrients, and forget about air. The more I try to supercharge one aspect of my growroom, the more I find the situation forces me to spend more money to balance it out. When I upgraded lights, the temps got away from me and I was forced to add in ventilation, etc.

Good luck.

Good luck.