The fan and adapter unit is so large that it blocks almost all air flow inside of the case. Temperatures dropped about 5 C with the side panel off.
So, I decided to duct the fan so it could suck cool air directly from the outside.
Having the fan sucking cool air from the outside seems to counteract the negative effects of static pressure caused by the adapter.
The duct I got was from
www.plycon.com It is slightly too small in diamter, so you could probably get some pvc piping or dryer duct if you wanted to. The advantage of the duct I got was that it had a flange on it, so the outside looks very nice.
If you have a dremel, it is a bit of work to cut the hole, but the results are significant. Also, make sure to get a fan grill and screw it on the case so nothing falls in the duct.
Also, if you are going to be taking your HS off and on a lot, cut a square hole in the motherboard support plate in your case so you can get at the screws on the underside without taking out your board. After you take off your HS about 5 times, you'll realize how helpful it is.
Right now, my idle temps are around 38-42. Certainly not the greatest, but very nice for quiet enough to sleep by!