Fans speed controller is what you need. You should be able to get that sound down to very reasonable. You can build a muffler out of a simple cardboard box. Do a search for DIY duct muffler and you'll be set.