W/C for 4 x 295GTX [Archive] - Overclockers Forums

RZA

11-07-09, 01:08 AM

Hello folks,

I'm trying to build a dedicated folding (plus a little gaming) rig. As of now I'm planning to buy Asus mobo with 7xPCI-E and plug 4 x 295GTX in there. As this beast will sit in my bedroom, water cooling sounds like a great idea. However, there is a problem: most water blocks I could find for 295GTX have nozzles at the side, which makes installing 4 of them right next to each other impossible. Are you guys aware of any water block that would allow me to make this happen? On a more general note, what would be your recommendations when building this kind of a rig?

Thanks!

P.S. This will be built from scratch, so I can buy whatever components are needed (case, WC system etc). Budget for this whole endeavor is around $4K, but the hardware itself will eat up a good chunk, so I'd rather not go for ultra-pricey options in WC.

Daddyjaxx

11-07-09, 07:59 AM

First thing, 4k for this project is not nearly enough. You're talking 1800 in GPU's alone and another 400 for the motherboard. A case to hold this kind of gear would be 300.00 or more. That's 2500 without a CPU, memory, PSU(s) (you'd probably need a couple), drives and we haven't even talked watercooling yet that would run 1500 or more, etc.

You are pretty limited to full coverage waterblocks for 295's due to the dual GPU's. You do realize you could SLI two of the four and the other two are just independant cards...right? Connecting them all together is easy for a block like this:

http://www.performance-pcs.com/catalog/index.php?main_page=product_info&cPath=240_582&products_id=25949

When you remove the stock cooler you replace he double slot PCI with a single. You use a normal barb on the top of the first card and bottom of the last and connect the rest with something like this:

http://www.performance-pcs.com/catalog/index.php?main_page=product_info&cPath=342&products_id=24980

You need at least two good 3x120 rads or more, one for each two GPU's and if you want to cool the CPU, that would be another plus the block. About the only case that can handle all of this (Special motherboard, rads, two PSU's) is a Mountain Mods and you're talking 550. For what you are looking to do, you have to go pricey with watercooling. You're trying to cool 1000w and that won't happen cheaply.

RZA

11-07-09, 06:12 PM

Thanks, this is really helpful.

First thing, 4k for this project is not nearly enough. You're talking 1800 in GPU's alone and another 400 for the motherboard. A case to hold this kind of gear would be 300.00 or more. That's 2500 without a CPU, memory, PSU(s) (you'd probably need a couple), drives and we haven't even talked watercooling yet that would run 1500 or more, etc.
Yeah, I come to realize that the budget will have to creep up somewhat. I was considering trying to get away with one monster PSU (seen some 1.5kW models) and therefore a cheaper case. Other than that, your estimate seems spot on.

You are pretty limited to full coverage waterblocks for 295's due to the dual GPU's. You do realize you could SLI two of the four and the other two are just independant cards...right?
As this will primarily be a folding rig, SLI doesn't matter too much. Whenever I decide to play a game or two, I will be quite happy with what just the two of the four 295GTX's can do for me :)
Connecting them all together is easy for a block like this:

http://www.performance-pcs.com/catalog/index.php?main_page=product_info&cPath=240_582&products_id=25949

When you remove the stock cooler you replace he double slot PCI with a single. You use a normal barb on the top of the first card and bottom of the last and connect the rest with something like this:

http://www.performance-pcs.com/catalog/index.php?main_page=product_info&cPath=342&products_id=24980
So basically all four cards will be hard-connected to each other by these little tubes? That's an interesting idea, but I'm concerned about the exact dimensions - what if the connector ends up being 0.2" too long and won't fit between the cards?

You need at least two good 3x120 rads or more, one for each two GPU's and if you want to cool the CPU, that would be another plus the block. About the only case that can handle all of this (Special motherboard, rads, two PSU's) is a Mountain Mods and you're talking 550.
I was actually considering using one monster rad for everything, and just let it (and the pump) sit separately from the case. This would let the case be smaller (and cheaper). Wouldn't that also be quieter and more cooling-efficient?

P.S. Just for the record, I found a waterblock with tubes sticking out parallel to the card itself, which means no problem installing 4 in a row:

http://www.performance-pcs.com/catalog/index.php?main_page=product_info&cPath=576&products_id=26140

Boulard83

11-07-09, 06:24 PM

Your speaking of a rig with 4x GTX295 and OFTEN using the word "CHEAP" ........ there is something WRONG here.

Daddyjaxx

11-07-09, 06:29 PM

One rad won't come even close to cooling 4 295 GTX's. You are talking eight 275 GTX's here.

Those connectors work perfectly. You connect one, pull it to the next card and connect it to that one.

The perfect setup would be three individual loops IMO. One for each two cards and one for the CPU. Folding on 4 of these cards will generate a lot of heat.

Ben333

11-07-09, 06:40 PM

You'll need to get rid of some major heat man, I don't think a single rad designed for PC water cooling can cut it. I've seen one though designed for 9x 120MM fans, something like that might do it, I'd go with two pumps too if you'd like to do one loop. I think three 2x120 heatercores / radiators (or one of those large 9x120s or a car radiator or something) and a pair of good pumps would work, I would definitely put the cooling gear in an external box if that works out for you though, should make choosing a case a lot easier. You can definitely save some money on cooling and still have a good setup if you want to.

RZA

11-07-09, 06:53 PM

Boulard83, well "cheap" is a relative term. Nothing is "cheap" in this rig; however, I also don't want the components to be unnecessarily expensive. If the price is justified - fine, I'll shell out an extra buck; but if there's a more cost-efficient solution - why not consider it?

Ben333, that's what I was thinking - something serious, like a car radiator, and one or two high-power pumps. Might end up being a better solution. Three loops/rads are fine too (although more complicated), but I'm a bit concerned that if I stuff all this into a case (even if it's a large case), I will end up running a ton of noisy fans on all sides of the case, which kinda defeats the purpose.

CompuTamer

11-07-09, 07:07 PM

I think three 2x120 heatercores / radiators (or one of those large 9x120s or a car radiator or something) and a pair of good pumps would work.

We even sure that car radiator could handle that much heat? lol

If you run the water over all four cards, the fourth card is going to be running pretty warm... i really think that 2 loops would be best... you are cooling 8 GPUs here... i'm not sure of the TDP of them, but it's probably a lot...

RZA

11-07-09, 07:08 PM

On a side note - if you guys have better ideas of a setup for this kind of rig, I would be happy to hear them. So far, the requirements are as follows:

1) One system only (no farms);
2) Maximum possible performance for folding;
3) Usable as a desktop/gaming rig (I rarely have much time to play, but want to have that option);
4) As quiet as possible (it will be located either in my bedroom or in the closet right next to it, so something that sounds like an Airbus won't work);
5) Preferably, the main unit (case) not too large (although this is up for change if it turns out external rads are not an option for some reason).

Initial budget was $4K with air cooling; now that I am considering WC, this will probably have to be $5K or so. However, I don't want any ridiculously pricey solutions like Tesla (which in fact doesn't even perform much better than a gaming GPU).

Let me know what you think. I do realize I might be speaking total nonsense - I was out of the o/c world for about 3 years now, so I'm obviously out of sync. Any comments appreciated.

Spawn-Inc

11-07-09, 07:32 PM

sounds like you need to build a custom rad/pump/res case like i did.

here is the build. (http://www.ocforums.com/showthread.php?t=611339)

it keeps the main case clean and silent (if you have the external farther away then i do and closed off more)

i would do 1 big loop and get the XSPC dual or even triple top with 3x mcp355's.

Conumdrum

11-07-09, 08:27 PM

Let me chime in for a sec. To watercool FOUR GTX 295's you have to go full cover blocks to make them fit side by side. Thats ohh $150 each. You can use one rad, as long as it's a MONSTA Feser and the required fans. All you need is a DDC3.2 and a good XSPC restop. While folding you'll probably be at 200 watts or so on each GPU, so 800 watts at a 15C delta should be fine.

That should be enough cooling for the GPU's. At about $1000 (+100 maybe) total to cool the GPU's.

Then a decent CPU loop of the same pump, good 120x3 rad/fans and pump. Hose clamps etc of course for both loops. The CPU loop can easily be done under $300 or so.

The OP needs to uderstand this rig while folding will make a TON of heat. The room this is in will need supplimantary cooling, like an AC unit in the window.

My sig rig, with the house AC set at 80F, thermostat in another part of the house. My PC room was at 80F. I primed my chip and GPU at the same time to stress test (no overclocks and just ONE GPU at the time), my room was 89F an hour later. Standard secondary bedroom size.

No matter watercooling or air cooling, you WILL need extra room cooling to make it livable. You also need to undersatnd that watercooling is still connected to the ambient air temps. You got poor ambients? You got poor temps.

Your best bet is a Big portable AC unit in a small room, with cables running out of the room so you have some hearing left. Save your money, don't go watercooling, because you need to spend it on the AC unit and your cooling electricity bill with that massive folding rig running 24/7.

Ben333

11-07-09, 09:17 PM

If you run the water over all four cards, the fourth card is going to be running pretty warm... i really think that 2 loops would be best... you are cooling 8 GPUs here... i'm not sure of the TDP of them, but it's probably a lot...

In a closed loop there is only a diference of 1C or less between one spot and another, the 4th card should be as cool as the others. I personally would run one giant loop with something like a car radiator or one of those 9x120s to cool all four cards and the CPU, I'd use a pair of MCP 600 / 655s too, maybe an Eheim would work better for a large loop too. If things don't work out with that setup, you can always buy another radiator and pump to either work into the big loop or put the CPU on its own loop.

@ Conumdrum, I know the cards' GPUs are rated at those wattages, but in the end I don't think thats the real amount of heat coming out of them. Whether they are watercooled or not, that heat will still be going into the room so I'd say its worth it. If it ends up heating the room up a noticeable amount which I agree it will then the RZA might have to look into a window AC or some other solution. Depending on the climate, maybe having the large radiator outside, or build a box to keep it in the window.

deed

11-07-09, 09:34 PM

The OP needs to uderstand this rig while folding will make a TON of heat. The room this is in will need supplimantary cooling, like an AC unit in the window.
.

What about having the exaust air going outside?

||Console||

11-07-09, 09:40 PM

I say for sure go water , Get 2 big truck rads Put them outside No noise except for the fan in your PSU + your HHDs

Flurp

11-07-09, 09:50 PM

honestly if you are going with the blocks you posted earlier, I'd look into having it on 1 big loop but instead of running the cards in series run them in parallel just split before the cards and join back after... but that's just another idea in your melting pot :)

jmdixon85

11-07-09, 10:04 PM

Looking foward to pics of this project. I would like to get back into folding but can't afford the extra ££ it puts on my electric bill :(

RZA

11-07-09, 11:27 PM

OMG that's something I didn't think of :eek: Extra $150/month right there... Ouch.

Still, I want to try to build this baby.

Spawn, I would probably try to stuff everything except the rad into the case, so that the exterior is as neat as possible when the case is closed. Don't want wiring/tubing/etc all over the place. (At least not in my bedroom :) If I had a basement, I would totally go your route.)

Conumdrum, question for you: why do I need a separate loop for my CPU? Given the amount of heat those 8 GPUs generate, adding CPU into that loop should be a joke, no?

As to the climate - it is actually freaking COLD here all year round, as for my tastes. My room runs at 65F days and 55F nights most of the year. So I actually have a heater in my room - could use some extra heat from this baby :santa:

Ben333, I think you're spot on - regardless of the cooling system, all the heat ends up in my room. WC is much much quieter, so I'd rather pay $1000 for being able to sleep from time to time :)

deed, this might actually be an awesome idea. I have a window in my closet - I can put the rad right next to it and have the fans blow outside.

Console, well putting stuff outside is quite complicated (I rent a room, so have limited permissions), and also might get me in trouble if this thing gets a lot of sunshine. The last thing I want is for it to heat up to 150F and fry my PC.

Flurp, the idea is interesting, but in Swarm's thread (http://www.ocforums.com/showthread.php?t=611339) people suggest it doesn't typically work out well, unless perfectly executed. This will be my first WC, so perfect execution is unlikely to happen :)

Question: does the tubing length matter substantially? I assume it does as it adds flow resistance, but to what extent? Will I be able to have the case in my room and the rad in my closet? It's like 10' apart.

jmdixon85

11-07-09, 11:35 PM

Just noticed you msg to deed, Would it not be better having the fans sucking air in from the outside instead of blowing warm air out??

As far as I'm aware tubing lengths don't impact on cooling a great deal. Ofcoase you will need good pumps for that setup.

RZA

11-07-09, 11:39 PM

I think an argument can be made for both ways. I can try both :) As long as tubing allows me to place it that far from the PC itself.

Spawn-Inc

11-08-09, 12:35 AM

i would grab a pair of mcp655's for silence and performance. as you saw in my thread i have a good deal of tubing (almost 20 feet) so you should be fine with all the stuff you want plus 10 feet of tubing to the closet. though if you plan to keep the door closed that won't work to well.

RZA

11-08-09, 01:17 AM

I have about an inch of space under the door, so this won't be a problem.

Ugh. This is going to be a challenge... 12 straight hours of research, and I'm not even close to a clear vision of how to make this happen.

Will keep updating this thread with more questions, details on choices made, and (hopefully) the build process.

Flurp

11-08-09, 01:46 AM

Flurp, the idea is interesting, but in Swarm's thread (http://www.ocforums.com/showthread.php?t=611339) people suggest it doesn't typically work out well, unless perfectly executed. This will be my first WC, so perfect execution is unlikely to happen :)

Well you won't have a problem so long as:
1.) you have the same length's of tubing from the split to each block
2.) each card has the same block
3.) you have the same length's of tubing from the card to where they join back

So I think it is something you should look into, at the same time I do not recommend putting rads or multiple different blocks in a parallel loop.

here is a crude example of what I am saying you should do though :)

Click Me :) (http://i269.photobucket.com/albums/jj59/kelcha05/crude-examplebmp.jpg)

RZA

11-08-09, 01:51 AM

Yeah, I got the idea. Will research more to see which of the two setups is the way to go.

Flurp

11-08-09, 01:56 AM

By the way, the reason most parallel setups don't work is because naturally the water will take the route of least resistance, so if you have a tube split in 2, 1 with a very restrictive loop and the other with a free flow loop, the one with the restrictive loop is not going to get as much flow as the other and therefore won't work as needed, that being said if all 4 loops have the same resistance/flow then the water is going to go in them equally, so while parallel loops are NOT for every circumstance there are plenty of circumstances where they can help alot, especially with the blocks you picked out :)

RZA

11-08-09, 02:19 AM

Okay, okay, I got the idea :)

From what I read so far, I think I'm pretty settled on the idea of having a 2-component system - case and rad(s) separate. This is cheaper and gives me more flexibility on "what goes where". Now, here's a question: is the placement of pumps important? That is, which of the two options is better, or are they equal?

1) Pump - GPU - CPU - pump - 10ft tubing - rad - 10ft tubing -back to pump
2) Pump - rad - pump - 10ft tubing - GPU - CPU - 10ft tubing - back to pump

In other words, does it matter whether pumps sit with rads or with case? I am thinking of keeping them with rads (so that the case, which is in bedroom, is even quieter), but not sure if it is a good idea. The reason I'm asking this now is cause that would influence the choice of a case.

One more: I read in some of the manuals that all the components of the WC system should be more or less on same level. Well the window I mentioned is about 4ft from floor - how does it impact my setup? Should I just get slightly more powerful pumps, or is it a no-go?

Thanks a lot for all your input BTW. I'm trying to educate myself through a lot of reading, but I totally realize that my knowledge is patchy and I might be asking stupid things.

Flurp

11-08-09, 02:40 AM

maybe It's just me but that water isn't gonna be the coolest when it hits the cpu... :\

jmdixon85

11-08-09, 02:48 AM

^Very true, 4 GPU's will be putting a lot of heat into the water before it gets to the CPU. I would rather have it CPU->GPU. The heat from the CPU won't heat the water up half as much as the GPU's will.

jmdixon85

11-08-09, 02:56 AM

Good question about that 4ft incline to the window. I'm thinking this:

Pump - CPU - GPU's - Tubing accross floor till window - Pump - 4ft Tubing upto raidiator - Back to pump.

Not sure how much difference this would make? Just seems logical to have the pump just before that 4ft incline.

Ben333

11-08-09, 08:50 AM

Just to clarify again, saying "by the time water gets to the (part) it will be too hot" is incorrect, the water is moving fast enough in a WC loop so that any one spot won't have a temperature difference of more than 1C from another spot. RZA, MCP 655s are damn quiet, you won't notice them if they're in your case. I always put my pump and res at the bottom of my loop to ease filling the system. This is pretty crude... but my WC method, heh...
http://ben.lostgeek.net/ben/~BasementWC/111_0624.JPG

Theres my s775 rig (I don't upgrade much) in my basement/work room. I can run that setup fanless when I want to with an overclocked Pentium D 820, and have ran an E7200 on that setup fanless at 4 GHz - high temps but fanless. While that doesn't look great right now, it has my main ideas for an easy WC - the pump and res are low, the res is large and easy to fill and the tubing is a bit longer for easy access to the motherboard. Also, as I said in post #12, you could build a nice box to keep the radiator(s) in your window, something that blows air out the window beside the radiator, then a box around the fans and radiator so it draws in outside air through the rad and blows it back out without cooling your room. For the pump, I'd recommend an Eheim, Iwaki or the pair of MCP 655s. I think now some mspaint drawings will be required to think about the placement of things, heh.

Flurp

11-08-09, 09:03 AM

Also while Ben333 is correct about the temp should equal out after the system is running for a small amount of time, it should be noted that this is only the case with a high flow rate loop... a restrictive loop will be different ;)

Ben333

11-08-09, 09:22 AM

It has been tested. With two good pumps, he will still have good flow. His cards might not read out to the exact same temperature as each other but I doubt the 4th will be the hottest.

Daddyjaxx

11-08-09, 02:57 PM

The water is moving so fast through the blocks, it doesn't heat up very much at all.

dark bishop

11-08-09, 03:13 PM

Radiator (http://www.performance-pcs.com/catalog/index.php?main_page=product_info&cPath=457_200&products_id=25229)
GPU block (http://www.performance-pcs.com/catalog/index.php?main_page=product_info&cPath=240_577&products_id=26019)
sli fittings (http://www.performance-pcs.com/catalog/index.php?main_page=product_info&cPath=346_342&products_id=24980)
pump (http://www.performance-pcs.com/catalog/index.php?main_page=product_info&cPath=201&products_id=3112)

my recommendation as far as gpu loop goes.

RZA

11-08-09, 03:27 PM

Wow, that rad looks good - might be better than the monsta I was going to go for.

Is there a good roundup of 295gtx GPU blocks somewhere? Google produces individual reviews which are kinda hard to compare.

OK, I'm trying to think ahead, and here's the question: how do I know which part of the system is the bottleneck in terms of cooling performance? That is, how do I decide whether I need to build in an extra pump or an extra rad? Should I build in some kind of flow monitoring device from the very start?

And one more important thing: I see that those Danger Den blocks are sold with single slot PCI bracket. Does that mean that I will be able to install these babies right next to each other without skipping a slot? If yes, maybe I can cram 7 of these into that ASUS mobo? I know this is insanity, but hell, that's the whole point of this exercise. :)

RZA

11-08-09, 03:44 PM

Here's what I got so far:

http://www.braindancer.net/cart1.png

Does it look good? This is based on the assumption above that I can fit 7 graphics cards into that mobo, and it is going to work. If this is not true, I will of course remove 3 water blocks.

Now, question about the case. As far as I see now, my requirements to the case are pretty modest:

1) SSI CEB compliant;
2) Holds 2 PSUs (with 7 cards there is no way I can get away with just one);
3) Has enough space for 2 pumps;
4) Doesn't have a lot of holes (I don't need ventilation anyway, so I'd rather have it quiet).

With this set of inputs, I think I can get away with something fairly cheap, say $150. Buying something more pricey won't get me anything. Or am I missing something?

Spawn-Inc

11-08-09, 04:09 PM

i know this (http://www.petrastechshop.com/swkofuwaforn.html) (<click) isn't the block you need, but look at how they do a parallel setup. that's what you need to do but you can use those DD sli fittings.

that will ensure you have proper flow AND have less tubing then the bits power block you looked at. which btw i think was for the dual pcb version.

which one are you getting btw? single or double pcb?

Here's what I got so far:

http://www.braindancer.net/cart1.png

Does it look good? This is based on the assumption above that I can fit 7 graphics cards into that mobo, and it is going to work. If this is not true, I will of course remove 3 water blocks.

Now, question about the case. As far as I see now, my requirements to the case are pretty modest:

1) SSI CEB compliant;
2) Holds 2 PSUs (with 7 cards there is no way I can get away with just one);
3) Has enough space for 2 pumps;
4) Doesn't have a lot of holes (I don't need ventilation anyway, so I'd rather have it quiet).

With this set of inputs, I think I can get away with something fairly cheap, say $150. Buying something more pricey won't get me anything. Or am I missing something?

fixed your link, so your going with 7 GTX295's now????

instead of that rad, i would go with this one. Nova 1080 (http://www.performance-pcs.com/catalog/index.php?main_page=product_info&products_id=21622:e4e186114f9dd0aacb9357bf8398db9b )
the reason being the nova uses flat tubes instead of round tubes. it will provide better heat transfer and thus outperform the other one.

i would also get a different cpu block, heatkiller or Swiftech GTZ or XT.

Conumdrum

11-08-09, 04:22 PM

Aha, yes, your seeing the adding of a CPU to the GPU loop isn't that much. Here is the issue. The water temps difference btween the ambient air temps is called the Delta T temps. Just a term we use. The GPU's don't need a good DT, they don't need to be cooled as well, they are happy with running at 70C or even 80C. This means you need less rad to cool the GPUs.

On the other hand, pumping the high DT water to the CPU will keep your CPU uncomfortably hot, especially if you overclock the CPU. The CPU needs a LOW DT to perform well. Unless your ALWAYS in chilly air temps.

Your in SF? I'm sure you have 80F days in the summer. This is something you have to plan for. The ambient temps in the summer.

Having a single loop means you'll need more raddage than having the CPU and GPU seperate.

Look at this chart. Scroll down to Thermal Testing. Follow the orange fan line, high speed Ultra Kaze at 2000 RPM. 800 watts of cooling at a 9C DT. Add a i7 at 200 watts under folding load, take the line to 1000 watts, your CPU will probably be close to thermal shutdown.

Thats why you should have two loops. Of course a Feser Monsta would do better somewhat, not sure how much.

Conumdrum

11-08-09, 04:24 PM

That CPU block you chose is very old and isn't going to help CPU temps. It's a very old design, made back in the ealry Quad core days, for under 100 watt CPU's. DD has a TDX out now, but it's also surpassed by more than a dozen blocks now.

Daddyjaxx

11-08-09, 04:28 PM

You've upped it to 7 295's? That's 1500w right there. Am I the only one that thinks that 1500w is a tad much for one rad add the CPU and you're easily over 1700w. Even at 9x120, that's each 120mm cooling 200w. I suppose it's possible if that rad is good.

60 feet of tubing? WTH? Those two pumps aren't going to push 60 feet. They might push 60 at .25 gallon per minute.

I'm waiting to see this setup. :) 5 grand in CPU's and watercooling for them. Can you through a 275 for me? That's peanuts.

RZA

11-08-09, 05:01 PM

Hehe :) Well I do realize all this is easier talked about than done, and sounds like a pipe dream. This exercise is not only planning, but also feasibility study - at some point I may have to scale back or call it altogether. But I am fairly serious about this idea - I'm not just BSing and wasting your time. I do want to make it happen.

Conumdrum, point about two loops well taken. I'm pushing hard to minimize the number of boxes - if possible, I'd rather have one huge rad than two smaller ones. But you might be right, especially with 7 graphics cards the CPU might get fried.

How about I get 2 massive rads (say 2 NOVAs), and make one loop for 5 GPUs, other loop for 2 GPUs and CPU? This second loop should be fairly piece of cake for such a rad?

As to the CPU block, thanks for the tips - I didn't research that at all, just picked something at the same website to have a sense of total cost. Will look into what is real good before actually buying.

Finally, you say "look at this chart" but I don't see anything - there might be a broken link or something.

Daddyjaxx, 2 things. First, I don't expect to use up all that tubing - added some extra, in case I mess up, or cut too short and need to replace, or whatever. Secondly, someone else in this thread (Spawn I believe) said that tubing length doesn't matter too much. If it does - can I just get more powerful pumps, or this is something completely impossible?

My closet window is about 20-25ft apart from the spot where I was thinking to place the case. However, if this is a major complication, I might put the case itself into the closet as well (distance will reduce to like 5ft) and use cable extenders for monitor/keyboard/mouse.

As to "upped to 7" - I'm toying with this idea, but I can't really understand whether this will actually work. 2 things that bother me are the physical density of installation (will I be able to stuff all that in and connect the tubing etc?) and motherboard/OS limits (will it end up choking on 14 GPUs?)

Conumdrum

11-08-09, 05:46 PM

Opps, sorry, forgot the chart.
http://martin.skinneelabs.com/HWlabs480GTX-Review.html

This is a TOP rad with high speed fans. Not sure about the Mora and it's heat ability, it's supposedly pretty good. I'll venture it will do 1500 watts with High speed 38mm thick Deltas. You'll be able to hear the fans, if at the window from 20' easy. Screamers.

Have you checked if you can even fold with that many GPUs at once? And one big point........... Your room AC outlet won't be able to handle the wattage methinks. Can a wall outlet handle 1800-2000 watts at 120 VAC? You'll TWO big PSUs to run this, so a very special case is needed to hold two PSUs.

Daddyjaxx

11-08-09, 07:51 PM

RZA

11-08-09, 08:13 PM

Well this I can easily test by plugging a heater and a tea pot (or iron) into same outlet.

http://foldingforum.org/viewtopic.php?f=38&t=7902&start=270#p115136

Apparently, this setup (at least the initial 4-GPU version) is possible with just one PSU and one fairly modest 3x120 rad... That guy was even able to overclock the GPUs a bit...

Conumdrum

11-08-09, 09:36 PM

I think most household outlets can only handle 15a @ 120, which is 1800 w. Some may be able to handle 20a at 2400w. Stoves and dryers use more, but look at those plugs and outlets. I think if you try to pull 1800w, the circuit breaker will kick or the fuse will blow.

Our clothes dryer as most electric dryers in the US are 220 VAC, a huge plug. I haven't ever dealt with an AC stove, but I'm sure they are 220 VAC.

I mentioned the AC load because it's something to consider. If you plan to run 7 295 and an i7, your looking at beyond basic home use, at the cusp of a minor server farm. It gets really expensive for cooling, AC feed installation, UPS spike systems, and electricity costs.

Methinks you can start with a Monster system for folding that anyone would be proud of. A i7 920 at 4.2, and 2 GTX 295. Add in watercooling for ohh$800 or so and plan for removing the heat from that room, even good room window fans. It wont kill your budget and you can build on it from there.

Ohh I'm getting this for my window, gonna make a sliding bracket etc for vertical installation. Even tho it's early Nov and 70F in Vegas, my room is still 81F at 730 PM. And I'm not even gaming.
http://www.nothingbuthardware.com/506946.html

RZA

11-08-09, 11:08 PM

http://forums.nvidia.com/index.php?showtopic=101930&view=findpost&p=569624

This guy has 4x295GTX in one WC loop, and he says that the last card is running 8C warmer than the first.

(Just updating this thread with my findings, so that anyone else considering this could make use)

RZA

11-08-09, 11:22 PM

You might be right, maybe I'm getting ahead of myself. I do want to build an insane rig, but that doesn't mean I have to come off as a fool. :)

What I'm thinking now is building all this with just two GTX's, as you said; however, I will lay foundation for expansion - that is, get a PSU, case and rad that can handle more. For these 2 I will use the "slim" waterblocks to see if it physically fits.

Will keep thinking about it... Thanks a lot for bearing with me :) You guys must be damn tired of "enthusiasts" that pop every other day with ridiculous ideas.

Spawn-Inc

11-08-09, 11:33 PM

hey i love hearing them and better yet seeing them if they can pull it off. man something sexy about 7 GTX 295's....

koolance has a liquid cooled psu that would be good accept for the liquid part.

1700watts if you use a 220 socket.

http://www.koolance.com/water-cooling/product_info.php?product_id=665

Conumdrum

11-09-09, 12:02 AM

It happens all the time. We try our best to hold our tounge. It takes a bit to get it across. There is crazy bencher pics and reviews that are run as long as the review takes, then we go back to reality. We know what they do, it's easy when you get stuff free. Peeps like you think it's common, no it's not. Your learning and fast.

So, now we are at a reality setting, you need to look hard at your heatload of an i7 and two 295s. Like I mentioned before, if you plan to push the i7 to 4.2 (usually possible under water) and have two 295s, you need to look hard at the watercooling needs. Here is a BIG sticky. Please spend more than a cursory glance at it. Bookmark the links and spend some time. For your 295 and the i7, figure out the heatload, google is your friend, then use Skinnee and Martin to learn what rads give you good temps. In conjunction with that what noise level do you want. Then look at many posts and reviews on what pumps/blocks/hose size/fittings/resiviours you like. We can say buy this n that, but what did you learn?

Once it's at your doorstep your on your own. Mistakes and poor selection of parts can be expensive. Ruined GPUs at how much each? I ruined a 280 GTX at $369 due to stoopidity. Poor waterblock mounting, shorted it out. Bought another...........

http://www.tomshardware.com/forum/253958-29-watercooling-guide

Daddyjaxx

11-09-09, 10:21 AM

Ruined GPUs at how much each? I ruined a 280 GTX at $369 due to stoopidity. Poor waterblock mounting, shorted it out. Bought another...........

Say it ain't so.... :)

RZA

11-09-09, 01:57 PM

I don't actually plan on heavily overclocking the CPU - I will push it a bit, but it's definitely not a priority. I got your point about a separate loop for CPU; however, I was thinking about letting it stay aircooled for the time being and just making one 2-GPU loop.

As to heat loads etc, the idea I have in mind is to get cooling gear that is (at least possibly) capable of cooling the whole monster setup. To put in simply, I build a system, test it out, then just add cards/waterblocks without rebuilding the rest (or with minimal modification, like adding an extra rad). So at the initial stage, when it will just cool the two cards, there should be a huge overcapacity in terms of cooling.

Thanks for the sticky, I'm already crunching through it.

I dug deeper into the BIOS problem (possible limitation of number of GPUs), and it seems that everything north of 8 is uncharted territory. Even an Nvidia employee was unable to say if this can possibly work. So the strategy I have in mind right now is as follows:

1) (as said) Builds the system with just 2 295's, set up WC, have all the glitches ironed out.
2) Try to install the 2 cards right next to each other (1-slot mode) and see if it poses any problems.
3) Add 2 more cards, WC them, test everything. Add cooling/power capacity as appropriate.
4) Install 4 cards right next to each other, so that there are 3 slots available.
5) Buy one more card; plug it in without WCing it. If I can't make it work - just return it. If I can - WC it.
6) Add 2 more cards.

This will probably take a month or two, given that I can only work on this during weekends. But this way I'm not stuck with useless hardware at any stage of the plan. Also, investments are more spread in time, which is a good thing.

TheGreySpectre

11-12-09, 05:34 PM

What kind of case are you planning on putting this all in? Off the top of my head the only case I can think of that supports that many radiators is the extended addtion mountain mods case.

Or are you planning on having most of the radiators external to the case.

RZA

11-12-09, 07:16 PM

As said above, my current plan is to keep all the rads separate, so that the case would not have to be huge. In my situation, it is a "closet vs bedroom" decision, and right now I'm planning to put the rads next to my closet window, and have the tubing go down to the case.

Mountain Mods look cool, but I really don't have that much space, and I would rather have the fans in the closet, not right by my ears.

RZA

11-15-09, 05:31 AM

OK. Here's where I stand so far:

http://www.braindancer.net/cart2.png

(plus Silverstone Strider 1500W PSU - didn't fit into the picture).

This is assuming "phase 1" setup with two gtx295. One WC loop on the GPUs; CPU aircooled for the time being. When I make all this work, I will order 2 more GPUs and add another WC loop for CPU. (Possibly a small in-case one, to minimize the amount of boxes and tubing outside.) I cut down on tubing, as I decided to put the case itself into the closet as well and use DVI/USB extenders into my room.

Couple things still unclear:

1) I assume I need a reservoir. Does it matter which one? As far as I understand, in-bay ones won't work as the rad will be much higher than the case, and I want to keep the reservoir higher than everything else (is that correct?)

2) So far I failed to find a case that would fit SSI-CEB mobo and two PSUs. So I'm sticking with this one (kinda liked the spacious layout), unless you guys have better ideas.

3) Are the tube/barb diameters properly matched? I tried my best, but I'm still struggling with internal vs. external diameter when it comes to fittings. (for tubing it is pretty clear.)

4) Did I miss anything? (apart from the clamps, which I already added after I took the screenshot.)

Thanks a lot for any input. I am pretty much ready to place an order, so would appreciate any last-minute comments.

Conumdrum

11-15-09, 10:37 AM

Thats a decent setup. Yes, get a res. The res can be anywhere as long as it's before the pump and water can run into the pump when poured into the res.

Your barb size is fine. 1/2 OD to fit 1/2 ID hose. G1/4 threads to screw the barb into the rad etc.

What is primochill utopia? For the liquid?

RZA

11-15-09, 10:51 AM

Yeah, it's an additive:

Liquid Utopia is designed for PRO users wanting minimal additive in their cooling loop of De-ionized Water or Distilled Water. It offers a full line of protection against algae and corrosion when adding to your new or existing cooling loops. The proprietary blend of ingredients used in PrimoChill's Liquid Utopia are specially formulated to provide a broad-spectrum antimicrobial agent, capable of eliminating and maintaining the microbiological growth found in closed loop water cooling systems.

Liquid Utopia also boasts "PLT" (preventive layer technology), which used on a clean install will help protect your system well into the future. Liquid Utopia has also been formulated to protect ferrous and non-ferrous metals from corrosion, which is especially important in today's higher performance mixed metals water cooling systems.
To be quite honest I didn't do research on additive, so this is up for replacement if you or anyone can recommend anything better.

The res can be anywhere as long as it's before the pump and water can run into the pump when poured into the res.

Awesome, then I will get a 2x5.25" and keep it in the case after bleeding the loop.

Spawn-Inc

11-15-09, 11:25 AM

i tried to find it on ppc's but i couldn't find it to save my life but get a few Bitspower True Silver (http://www.sidewindercomputers.com/bitrsi1cofif.html) compression fittings for your rad and blocks.

it will be your biocide to stop bacteria and such.

then all you need is distilled water and not that primochill stuff.

you forgot some sli fittings, are you going to run parallel or series?

DD sli fitting (http://www.performance-pcs.com/catalog/index.php?main_page=product_info&cPath=342&products_id=24980)

if parallel get 2, if series get 1.

i know you said the mm cases are to big, but did you see this one?
http://www.mountainmods.com/computer-cases-pinnacle-c-21_99.html

RZA

11-15-09, 11:29 AM

Series. SLI fittings are actually in there, as an addon to waterblocks.

Conumdrum

11-15-09, 11:35 AM

Go to Petras and buy a teeny bottle of PHN-Nuke. 4 drops per loop, bottle will last forever. Is a pure biocide developed just for distilled water loops. In fact I think your only an hour or so away from them, they are awesome people, I met Petra once, dedicated and smart. If you order it, go USPS regular mail for cheapest shipping for tiny stuff.

Please look at the EK 150 mm cidrical reses or the Swiftech Micro res V2. Bay reses can be a pain to fill/bleed, especailly if just one slot thick.

This bay res is nice. Use 1/2 of it till you get the second loop going. Different pump, this is the bomb with the DDC3.2 pump. The pumps mounts right on the bottom of the res, very nice.
http://www.sidewindercomputers.com/dubayreforla.html

Great cylinder res.
http://www.sidewindercomputers.com/ekwaekres150.html

Swiftech V2 res.
http://www.sidewindercomputers.com/swmcmire2re.html

Grosjambon

11-15-09, 12:50 PM

89$ for the FAN +_+ U should go for Yateloon they are like 3,35$ each at jabtech u could safe some cash :) at least 60$

RZA

11-15-09, 12:56 PM

They are actually $7 and are 60CFM as opposed to 91CFM for Koolance. I wanted something powerful, so that I could either downvolt them for silence or use full speed for some serious cooling. Mind you, I don't really know how well is this setup going to cool 2x295 (and eventually 4x295). So I wanted to build in a bit of safety in most components.

RZA

11-15-09, 01:01 PM

...good catch though, jab-tech is nice. If only they had those Scythe 104CFM fans in stock, I would be all over.

Grosjambon

11-15-09, 06:34 PM

here is the link of the high one
http://www.jab-tech.com/YATE-LOON-120mm-Case-Fan-D12SH-12-High-Speed-pr-3771.html

The one u are talking about are medium these one are high speed (2200 RPM) 88CFM

RZA

11-15-09, 06:38 PM

Well this is a 120mm model, and I need 140mm for that rad.

I wonder how would NOVA perform with 18 of these babies. Crazy stuff.

Grosjambon

11-15-09, 08:01 PM

O-O i didint know sry +_+ though u was buying like 2 120.3 or 120.4 +_=

RZA

11-15-09, 08:04 PM

I decided to go for 140.3 - it should perform better than 120.3 yet not be as ridiculously long as 120.4.

CualvezAsteria

11-15-09, 08:19 PM

Posting in epic thread.

Please post pics for us to drool over!

Have you considered just making a couple separate rigs? Might be more cost effective and simpler.

Spawn-Inc

11-15-09, 08:31 PM

Well this is a 120mm model, and I need 140mm for that rad.

I wonder how would NOVA perform with 18 of these babies. Crazy stuff.

lol i have 18 of them on my 3 mcr320's. (more cooling thread)

medium is all they seem to have for yates.

RZA

11-15-09, 09:05 PM

Posting in epic thread.

Please post pics for us to drool over!

Have you considered just making a couple separate rigs? Might be more cost effective and simpler.

I really want to have just one rig. First, it takes less space; second, one of the points of this exercise is to build a super-powerful rig :) Two non-stellar rigs is just meh. :)

RZA

11-15-09, 09:38 PM

...I'm having second thoughts about the case. It doesn't seem too spacious with mobo and GPUs installed - in fact, there is hardly any space for WC stuff. :(

RZA

11-15-09, 11:23 PM

...ordered all the hardware except the case and WC stuff. There we go.

Leaning towards U2-UFO as the case of choice. Might even be able to keep everything inside for the time being. Not sure I like it, but there is definitely enough space, it's SSI compliant, and holds 2 PSUs.

Haggenator

11-16-09, 12:20 AM

Have you ever considered this case?

http://www.dangerden.com/store/dd-double-wide-tower-21-black-series-edition.html

And if you want anything custom, they can do it. Like another spot for a PSU.
Just a suggestion . . . looking forward to seeing this thing.

RZA

11-16-09, 12:34 AM

Well that case is both insanely huge and expensive :) I am looking for something more moderate, yet capable of housing 2 PSU's and the water cooling stuff. (2 pumps and a res basically.)

Will check out other Dangerden's cases though.

Haggenator

11-16-09, 12:49 AM

Maybe you should make a very simple custom case. Are you going to be using this as your personal computer or just for folding at home?

RZA

11-16-09, 01:06 AM

Folding + occasional gaming.

Don't really have the skill, time and energy required to build a custom case :) I'd rather pick up a decent off-the-shelf solution. Sadly, not many of them fit my requirements :( Who'd a thunk that "2-psu SSI-compliant full tower" will be that much of a problem.

RZA

11-16-09, 04:05 AM

All orders complete. Went with U2-UFO.

I'm poor now :shrug:

Ah, whatever :) Should be awesome. Can't wait to start building.

Thanks for all your help, I wouldn't get anywhere without you guys :)

Off to work week... Stay tuned for first pics in a week or two (depending on shipping and my own availability).

RZA

11-19-09, 12:11 PM

Performance-PCs.com
Order Number: ******
Date Ordered: Sunday 15 November, 2009
Your order has been updated to the following status:
New status: Processing

WTF... It's Thursday, and it just got the "Processing" status?..

xrodney

11-19-09, 02:12 PM

Perhaps by Processing they mean they don't have one in stock and waiting for delivery ?
Different shop same status. *translated to english*
---Lian Li PC-343B Modular Cube - Black---
Order Number: *****
Order Date : 2.11.2009
Status: Processing
Expected date of arrival : 25.11.2009
---
I will probably have all watercooling stuff here before case itself.

Also did your payment already processed ?
You should probably request query about your order status to find out where problem is.

RZA

11-19-09, 02:14 PM

I think that's what they were doing all this time. I paid by Paypal, so I have no idea what took them so long.

hokiealumnus

11-19-09, 02:22 PM

I'd give them a call. They're pretty responsive at P-PCs. If there is something on their end still holding it up, it can't hurt to request expedited shipping on their dime. Worst they can say is "no".

RZA

11-19-09, 04:10 PM

Performance-PCs.com
Order Number: ******
Date Ordered: Sunday 15 November, 2009
Your order has been updated to the following status:
New status: Shipped

Yay!

RZA

11-19-09, 04:32 PM

Scheduled Delivery: 30-November-2009

:cry:

xrodney

11-19-09, 05:06 PM

Scheduled Delivery: 30-November-2009
Seems you will get case same day i do, talked with shop i ordered mine and they told me it should arrive on 27th and if they send it same day (friday) i will get it on 30th (monday).
10 more days, but i really cant wait to get my hands on it.:eh?:

e6600

11-19-09, 05:49 PM

RZA

11-20-09, 12:00 AM

http://www.braindancer.net/hardware1.jpg

Just a teaser update, so that you guys know I'm serious :)

Steven-1979

11-20-09, 12:04 AM

*jeaaaaaaaaalous

hokiealumnus

11-20-09, 12:20 AM

*jeaaaaaaaaalous
+1. That's beautiful. Can I borrow just one of those cards for forum wars in February? :p

RZA

11-20-09, 02:01 AM

We'll see :)

Too bad the PSU and the case didn't arrive, so I can't really start building.

Haggenator

11-20-09, 02:58 AM

This thing is going to be a beast. Cant wait to see it. And that case. Was always interested in Mountain Mods Cases. What PSU did you go with?

RZA

11-20-09, 03:23 AM

1500W Silverstone Strider. Don't think it will handle all four graphics cards, but at least this PSU is no slouch.

RZA

11-23-09, 11:59 PM

OK, the power supply is not going to arrive until Nov 30 (duh), but I couldn't resist starting to test things a little :) My girlfriend has kindly provided a 400W PSU, which is enough to set up some bare bones operation. By "bare bones" I mean no 295 cards of course :) Used an old 8600 I had lying around.

A couple pics:

The "test bed"
http://pic.braindancer.net/setup.jpg

Windows 7 setting up...
http://pic.braindancer.net/win7.jpg

...and here we go!
http://pic.braindancer.net/smp2.png

...well, kind of. 100% CPU load does bog down the PSU, so folding cores crash every now and then. Overclocking is not even an option.

Waiting for the real PSU to give this baby some real torture...

Boulard83

11-24-09, 12:29 AM

GREAT !!!!

TaCoSwInDeZ

11-24-09, 12:56 AM

*Subscribed* - this is insane, who needs folding farms when you can have two of these machines to replace a few less powerful ones.

RZA

11-27-09, 08:10 PM

UPD: initial testing showed that at least one of the RAM sticks is defective ;( Sent back to Newegg.

Ah well. I hope that by next weekend I will at least have the case and WC stuff shipped, so that I could put a loop together and do some leak testing.

This is a long journey... :)

Spawn-Inc

11-27-09, 09:21 PM

This is a long journey... :)

but a fun one! remember to stop and smell the roses along the way... :)

note: not sure what roses would be in wc... blocks?

Conumdrum

11-27-09, 10:40 PM

Oh? A rose colored watercooling rig that smells like roses. Maybe more wife/girlfriends would accept the crazy things we do.

"Look honey! I'm at 4.3 Ghz at only 57C load temps!"

"Thats nice dear, it smells pretty, buy some more stuff".

If I could garuentee a 30% success rate, I could sell gallons of WC rose water at $30 a pint eh?

Spawn-Inc

11-27-09, 11:14 PM

RZA

11-28-09, 03:25 AM

LOL :) I'll let you know if this rig, once built, has any effect on my GF. :-D

BeHappy

11-28-09, 10:13 AM

She had a piece of my heart when she loaned you a 400w psu... My g/f can't spell psu...:p

rustyfender

12-03-09, 12:56 PM

y dont you put in 2 gtx 295 co-op hydro's from evga thats the same as haveing 4 295's and much eazier to do the w/c on

Boulard83

12-03-09, 01:05 PM

2 gtx295 coop = 4 gtx295 reference ?????

You missed something or i dont understand what you said ...

torin3

12-03-09, 01:14 PM

Yep, rustyfender, 1 GTX 295 Co-op = 1 dual PCB GTX 295.

The Co-op 295s just merged the 2 printed circuit boards of the earlier 295s into a single board. And in my PMs to RZA, he confirmed he was getting the Co-op 295s anyway.

rustyfender

12-03-09, 01:19 PM

ah ok lol

torin3

12-03-09, 01:22 PM

No worries, we all learn things here. It is part of what makes this place so great! :thup:

rustyfender

12-03-09, 06:31 PM

amen to that

RZA

12-06-09, 02:15 AM

Update: some WC stuff has arrived.

http://pic.braindancer.net/wc.jpg

http://pic.braindancer.net/gpu-wb.jpg

http://pic.braindancer.net/cpu-wb.jpg

http://pic.braindancer.net/pump.jpg

http://pic.braindancer.net/res1.jpg

http://pic.braindancer.net/res2.jpg

Here's something I don't get: the reservoir has THREE holes in each compartment. The two threaded ones are intake and outtake, but what is the third one for, on the top? All in all, it looks like the res is not sealed, and if i turn it upside down, the water will just spill. What am I getting wrong?

P.S. The RAM is on its way, the monstrous case has arrived (it is not assembled yet, hence no pics), so chances are next weekend I will start building this baby. :)

BobbyBubblehead

12-06-09, 02:24 AM

its a fill port so you dont have to magic the coolant in there I suspect :)

RZA

12-06-09, 02:25 AM

OK so what do I do with it once I fill the system? It didn't ship with any plugs.

BobbyBubblehead

12-06-09, 02:34 AM

well that sounds like a technical wrong turn :-/

maybe its the kind of res that has specific pumps that bolt to it then.

is there fill ports on the under side of how its shown in the pics?

dont think youll be plugin them with D5`s anyhow #Laughs#

I feel you may need a different res.

RZA

12-06-09, 02:36 AM

...bummer. Apparently this res is for two 355's... :\

BobbyBubblehead

12-06-09, 02:40 AM

well something to do why you wait for other parts #Chuckles#

time to pick again :)

RZA

12-06-09, 02:42 AM

Just did...

Apparently I will sell a bunch of things after this is done :) The rad is also not the one I need :D

Spawn-Inc

12-06-09, 10:22 AM

who did you order this from? it's the wrong res for those pumps. or rather wrong pumps.

Ben333

12-06-09, 10:36 AM

Think about yourself first, return the wrong parts for what you paid - more than you'll get reselling them. Too bad you grabbed the 355 res but we all make mistakes. Look for a non pump specific one like the swiftech micro res. Which radiator is wrong? What loop config did you decide on?

Your rig will be pretty heavy with all that copper :)

hokiealumnus

12-06-09, 11:35 AM

I'd return the pumps and get two MCP355s. They're just as solid as the 655s are and would even be slightly better (more head pressure) for the GPU loop.

RZA

12-06-09, 12:34 PM

I got the res and the rad from sidewinder - they have 15% restocking fee, that's why I'm thinking about just selling this stuff.

The rad I got is NW labs 420, which is 3x140, while I need 3x120 to fit into the case. My current plan is to build two "basic" loops inside the case, test the waters (no pun intended), and then possibly upgrade the rad to some out-of-case monster when I add two more GPUs.

I added Swiftech's 3x120 and two microreses, they are supposed to ship before weekend. Will get rid of the "wrong" stuff when I build the loops and make sure I'm not making any more mistakes.

RZA

12-19-09, 01:39 AM

Finally, I got something to show you :) Here goes a progress report - pictures with comments.

Nice to finally see all the serious crunching hardware.
http://pic.braindancer.net/assembly/dscf9463.jpg

Power supply is simply massive.
http://pic.braindancer.net/assembly/dscf9464.jpg

Nifty thing provided by ASUS: a little board with Power/Reset buttons and diagnostic codes. Ideal for benching, when you don't have case power/reset buttons hooked up.
http://pic.braindancer.net/assembly/dscf9466.jpg

Here we go, starting to assemble the monstrous MountainMods U2-UFO case.
http://pic.braindancer.net/assembly/dscf9468.jpg

http://pic.braindancer.net/assembly/dscf9469.jpg

http://pic.braindancer.net/assembly/dscf9471.jpg

This tank definitely needs wheels.
http://pic.braindancer.net/assembly/dscf9472.jpg

Installing mobo.
http://pic.braindancer.net/assembly/dscf9475.jpg

Water cooling, take 2: same res, new pumps (355).
http://pic.braindancer.net/assembly/dscf9477.jpg

RZA

12-19-09, 01:46 AM

Same rad. (Swiftech 2x120)
http://pic.braindancer.net/assembly/dscf9478.jpg

Proper waterblock. (Watercool Heatkiller 3)
http://pic.braindancer.net/assembly/dscf9479.jpg

Leak testing, take 1: FAIL. Turns out, the screw holes in this res are too shallow, and/or the rubber loop around the impeller too thin. Had to pick up thick rubber loops from Ace Hardware and reassemble the whole thing.
http://pic.braindancer.net/assembly/dscf9480.jpg

Meanwhile, the rest of the hardware went into the case.
http://pic.braindancer.net/assembly/dscf9481.jpg

Leak test, take 2, now with GPU loop. SUCCESS! No leaks. Surprising, given my total lack of experience.
http://pic.braindancer.net/assembly/dscf9484.jpg

Bleeding the system.
http://pic.braindancer.net/assembly/dscf9485.jpg

There we go... CPU loop installed. It is probably completely insane, but I installed it without draining :) Basically brought it from bathroom and put into place.
http://pic.braindancer.net/assembly/dscf9489.jpg

http://pic.braindancer.net/assembly/dscf9490.jpg

http://pic.braindancer.net/assembly/dscf9491.jpg

More to come :)

P.S. Bad news is that one of the graphics cards is faulty, fails RAM tests. Since it is more than a month since I purchased it, will have to RMA through PNY... Ugh.

Spawn-Inc

12-19-09, 05:08 PM

i hope you leak checked again after it went into your case?

love all the copper!

Boulard83

12-19-09, 05:11 PM

Nice start ! I love the case.

hokiealumnus

12-19-09, 06:57 PM

Looks great so far. Sorry to hear about your card. Hopefully PNY is quick about RMAs!

RZA

12-22-09, 09:47 PM

CRAP. When I was away, the reservoir cracked along the side, all the water leaked out. The fact that nothing got fried is a miracle.

Considering arming the replacement res with layers of duct tape. ;(

sweefu

12-22-09, 10:16 PM

Hey mate,
just wanted to say it all looks great, will be keeping an eye on this thread.
Good luck with the rest of the build.
Cheers.

RZA

12-22-09, 10:19 PM

Thanks... If only I didn't get lemons for pretty much every other component. RAM, graphics, now this freaking res...

Conumdrum

12-22-09, 10:27 PM

The res you got has been discussed a lot on Xtreme Forums. Might want to find the massive thread for issues and possible things that can cause this.

RZA

01-14-10, 12:42 AM

...well, I got the res replaced. (Kudos to Sidewinder for being super-helpful - they sent me a new one even before I sent the broken one back).

Well, guess what? The pump (MCP355) died. It basically melted, filling my bedroom with a horrible stench. What is most funny is that the GPU can survive being fairly idle (office work) without water circulation; folding kills it of course.

Luckily I had an extra MCP655 and the micro-res sitting around (remember those wrong purchases?), so I rebuilt the GPU loop with these two.

But then the EUE's on the single remaining graphics card became more frequent. They happened once in a while all the time, but now two GPU clients would kill it rather fast. I ran an extended memtestG80, and guess what? This card is also defective. Screw you PNY, I'm never buying your stuff again.

So I'm stuck with just 1 GPU client working. However, I managed to get the bigadv units going; with CPU running at 4GHz, I'm getting about 60K per unit, which takes me 50 hours. Neat.

Two more 295's are on their way; these are EVGA, hoping for the best. This order didn't go without a hitch either - apparently UPS lost this shipment, so the store is now sending me another pair...

...This would be a (fairly) optimistic update (I mean, I'm still alive, right?), but guess what just happened: the second MCP355 died...

As of this moment I had to replace:

1 kit of RAM;
2 graphics cards;
1 res;
2 pumps.

This. Is. Not. Fun.

dyckah

01-14-10, 12:48 AM

wow, you have got some of the worst luck i have ever heard!
sorry to hear about that man, but absolutely crazy build you have happening here!

rustyfender

01-14-10, 03:07 AM

god #@$% man nothing is goin right for you at all oh well you know about murpheys lwe its either one big problem at the end or alot of small ones along the way

in your case however its been alot of big things going wrong all the way with some doubleing back and re-going wrong thrown in

hokiealumnus

01-14-10, 07:47 AM

Holy hell man, I'm sorry you're having such troubles! You'll get it straight eventually. EVGA cards rock, you shouldn't have any problem out of them. If you do, their service is awesome. It will get straight...apparently it will just take entirely too long.

RZA

01-15-10, 05:24 PM

Update: my graphics cards shipment was lost by UPS, and the seller has no stock to replace them. Refund.

Also, my mouse died.

:bang head

Boulard83

01-15-10, 05:31 PM

Damn your really the "luckiest" guy on earth ...

I hope 2010 gone give you something good someday !

BobbyBubblehead

01-15-10, 05:44 PM

last time I saw this kind of look it turned out the house was on an ancient burial site :shock:

79700
To the best layed plans of erm mice `n men

DarkWhite

01-15-10, 05:52 PM

It's as if Jesus himself doesn't want this project completed http://smiley.onegreatguy.net/crucified.gif best of luck with your other components

GIXXERGUY6

01-15-10, 08:09 PM

"

"Thats nice dear, it smells pretty, buy some more stuff".

I wish my wife said that more often..

RZA

07-02-10, 12:10 PM

...OK, so I'm not completely dead after all. After numerous setbacks, most of which I didn't report here cause it was not even funny, I decided to rebuild the system based on EVGA Classified SR-2 and two Xeons X5650. This weekend, all the parts finally arrived, and I took first crack at the (re)assembly. Here's a brief photo report:

http://pic.braindancer.net/sr2/1.jpg
First look at the mobo. The box itself is HUGE - see how it compares to Asus P6T7 Supercomputer, which itself is not tiny at all. I'm in awe.

http://pic.braindancer.net/sr2/2.jpg
Mobo on a tray. I had to buy a new tray from MoundainMods that could hold this beast, as well as a new back panel ($150 worth of metal). I don't even want to think how much I spent on this rig...

http://pic.braindancer.net/sr2/3.jpg
...but it does look cool. :)

http://pic.braindancer.net/sr2/4.jpg
Since I am planning to run 3 instances of VMware for bigadv folding, and each of them eats at least 5Gb RAM, I needed to beef it up. 6x4Gb G.Skill RipJaws fit quite nicely. (Plus, the ramsinks are red!)

http://pic.braindancer.net/sr2/5.jpg
Another comparison. This board is a real Goliath.

http://pic.braindancer.net/sr2/6.jpg
Stock backplates needed to be replaced, because the thread on the waterblocks' mounts is wider than standard.

http://pic.braindancer.net/sr2/7.jpg
To fit this monster into my U2-UFO case, I needed to do some customization. MoundainMods told me upfront that the stock 5.25" bay mounts will not work. So I asked them to produce custom ones, with the second set of holes chopped off. I reckoned this will be more than enough, since I was shaving off at least 3 inches. They did what I asked them to (kudos to MM for being cooperative on customizations! This is not the first time I request custom jobs, and they are always awesome). However, even this was not enough! So as you see on the picture, I had to chop off even more from the lowest slot.

http://pic.braindancer.net/sr2/8.jpg
Waterblocks mounted.

http://pic.braindancer.net/sr2/9.jpg

http://pic.braindancer.net/sr2/10.jpg
CPU loop complete. Specs:

CPU > CPU > Rad > Pump > Res > Pump

Waterblocks: Watercool Heatkiller 3
Rad: Swiftech 2x120
Pumps: MCP655 + MCP355
Res: XSPC dual res top for MCP355

http://pic.braindancer.net/sr2/11.jpg
Bleeding the loop, pumps powered from GF's power supply :) By the way, I need to say THANKS to her since she was around during the whole build, helping wherever I would ask, and extremely supportive when I got frustrated due to various setbacks. Yeah, call me a lucky ba$tard!

http://pic.braindancer.net/sr2/12.jpg
Finally, let's add some GPU power!

P.S. As of now, I only had a few hours of playtime with the rig, so didn't get too far in terms of OC. 3.8GHz seems fairly stable, but 4GHz I can't even boot. Don't yet know if this is the ceiling for my Xeon CPUs, or I am not doing it right... SR-2's overclock settings are numerous and confusing.

Stay tuned!