There are a lot of reasons for "why not".
On an AMD box, I am not so familiar with the IMC but a lot of IMC's HATE more than 2 sticks of RAM and will usually end up running slower. If the IMC has no qualms with 4 sticks, you gain more capacity but usually you have slightly slower overall speed. Not by enough to actually notice, but you end up breaking even, sacraficing quality for quantity basically.
I'd stick with 2 sticks for now at 8GB (2x4GB). It's generally more stable, faster, creates less heat, and requires less electricity... and the situations where you need 8GB of RAM are extremely few and far between. In short,
it's not worth it.