A rig that fails Prime after six hours is far from unstable, in my experience (especially if you're referring to the Blend-test). Perhaps you'd have to play games for weeks or months before experiencing your first OC-related crash. I figure your problem could be related to the following:
1. The modules aren't of similar quality, so that the worst stick limits the others. Not even two identical components will perform equally. Is one set brand new while the other is old and has been through months of burning-in? In that case I'd try a burn-in wizard (like in SiSoft Sandra) for a few hours and Primetest again.
2. Using four sticks instead of two, obviously doubles the number of banks and chips. The memory controller might need more time (an extra clock) in order to address the correct bank (usually known as Command Rate 1T or 2T). This function isn't accessible in every BIOS (for some very weird reason), but if it is, try setting it to 2T.
Note that Command Rate could as well be called "CPU Interface" (disabled = 2T) or "CPC". Not familiar with your mobo, so I'd check the manual if you can't find it in the BIOS.