• Welcome to Overclockers Forums! Join us to reply in threads, receive reduced ads, and to customize your site experience!

Need help optimizing 3930k and 2x7970

Overclockers is supported by our readers. When you click a link to make a purchase, we may earn a commission. Learn More.
R

Rolston

Registered
‍
Joined
Apr 9, 2013
I started folding in March with an i7-3930k and a single 7970 GHz Edition. I was getting ~95k PPD after setting up the new beta core 0x17. I decided to add another 7970 assuming I would get another 45k PPD out of it, but I have gotten anywhere from 66k-127k http://folding.extremeoverclocking.com/user_summary.php?s=&u=633356. I overclocked my CPU using standard mobo profiles (Asus Rampage IV Extreme) to get 4.4GHz. I overclocked my video cards using AMD Catalyst/Overdrive to get them to 1200MHz. I haven't done anything with voltages just used pre-made profiles or increased clock speed using manufacturer provided software. My video cards are Sapphire Vapor-X 6GB 7970 GHz Edition http://www.newegg.com/Product/Product.aspx?Item=N82E16814202005. The video cards require 2x8-pin power connectors each and the mobo has a separate 6-pin power connector for 3-way crossfire/SLI. I wound up using the 6-pin connector in addition to the 2x8-pin connectors which seemed to make things more stable.

I am currently folding for Reddit, but I have signed up to help Overclockers for the Chimp Challenge.

Folding setup:

CPU:10
next-unit-percentage 100

GPU
13.3 beta 2 drivers
opencl-infex: -1
cuda-index: -1
client-type: beta
extra-core-args: -gpu-vendor=ati


Additional system info:
CPU: i7-3930k OC @4.4GHz
Cooler: Corsair H100
Mobo: Asus Rampage IV Extreme
Memory: Corsair Vengeance 16GB (4x4GB) DDR3-1866 Memory
PSU: Corsair AX1200i
Storage: Samsung 830 series 256GB 2.5" SSD
Storage: Seagate Barracuda 6TB (4x3TB RAID 10) 3.5" 7200RPM
Video card: 2x Sapphire Radeon HD 7970 GHz Edition 6GB OC @1200MHz
Case: Cooler Master Cosmos II
Sound: Asus Xonar Essence STX 24-bit 192KHz Sound card
Optical: Lite-On iHas124-04 DVD/CD Writer
OS: Windonws 7 Ultimate (64-bit)
 
Welcome to the forum, Rolston!

I didn't mean to imply that you HAD to race with us, or you wouldn't get help with your system. Sure, I'd LOVE to have you race with us, of course. But you'll get help anyway.

First, you ALWAYS have a large drop off in points, when you add another GPU. GPU's have VERY fast RISC type processors, and LOTS of them, but they must use the PC bus in order to fetch the work, and then return it.

I want you to stop the folding client - pause for twenty seconds, and then restart it. Go into Advanced Control and click on the "Log" button. Copy the FIRST lines of the new log file, until it shows at least 2% is done on the work unit, and paste it into your reply, here.

I need to read through it.
 
I understand that I don't have to fold for you, but it seems like a fair trade. My biggest concern is that my PPD is so erratic from day-to-day. I haven't done anything on my computer but fold at 100% for the last few days and my PPD is all over the place.

I quit folding as you suggested, cleared my logs, then restarted folding. GPU0 restarted at 0% which seems unlikely but I didn't note the percentage before quitting so I cannot be certain. Here's
https://imgur.com/WAkj4PA
a screen shot of my Folding@home control panel. The logs for ~7% are below. Note that Slot 00 records "NaN" which I believe stands for not a number. The TPF is 2n14s for GPU0, and 2m15s for GPU1.

17:03:14:WU01:FS01:0x17:Completed 471762 out of 2500000 steps (18%)
17:03:26:WU02:FS02:0xa4:Completed 45000 out of 500000 steps (9%)
17:05:08:WU02:FS02:0xa4:Completed 50000 out of 500000 steps (10%)
17:05:48:WU01:FS01:0x17:Completed 500000 out of 2500000 steps (20%)
17:06:50:WU02:FS02:0xa4:Completed 55000 out of 500000 steps (11%)
17:07:45:WU00:FS00:0x17:Completed 50000 out of 2500000 steps (2%)
17:08:33:WU02:FS02:0xa4:Completed 60000 out of 500000 steps (12%)
17:10:15:WU02:FS02:0xa4:Completed 65000 out of 500000 steps (13%)
17:10:19:WU01:FS01:0x17:Completed 550000 out of 2500000 steps (22%)
17:11:57:WU02:FS02:0xa4:Completed 70000 out of 500000 steps (14%)
17:13:39:WU02:FS02:0xa4:Completed 75000 out of 500000 steps (15%)
17:14:55:WU01:FS01:0x17:Completed 600000 out of 2500000 steps (24%)
17:15:21:WU02:FS02:0xa4:Completed 80000 out of 500000 steps (16%)
17:17:03:WU02:FS02:0xa4:Completed 85000 out of 500000 steps (17%)
17:18:05:WU00:FS00:0x17:NaNs found .. trying to pinpoint the NaN step via binary search... (this might take a while)
17:18:05:WU00:FS00:0x17:Trying to isolate NaN....searching [0,96792]
17:18:45:WU02:FS02:0xa4:Completed 90000 out of 500000 steps (18%)
 
Here are the logs broken up by slot#.

17:07:45:WU00:FS00:0x17:Completed 50000 out of 2500000 steps (2%)
17:18:05:WU00:FS00:0x17:NaNs found .. trying to pinpoint the NaN step via binary search... (this might take a while)
17:18:05:WU00:FS00:0x17:Trying to isolate NaN....searching [0,96792]

17:03:14:WU01:FS01:0x17:Completed 471762 out of 2500000 steps (18%)
17:05:48:WU01:FS01:0x17:Completed 500000 out of 2500000 steps (20%)
17:10:19:WU01:FS01:0x17:Completed 550000 out of 2500000 steps (22%)
17:14:55:WU01:FS01:0x17:Completed 600000 out of 2500000 steps (24%)
17:19:34:WU01:FS01:0x17:Completed 650000 out of 2500000 steps (26%)

17:03:26:WU02:FS02:0xa4:Completed 45000 out of 500000 steps (9%)
17:05:08:WU02:FS02:0xa4:Completed 50000 out of 500000 steps (10%)
17:06:50:WU02:FS02:0xa4:Completed 55000 out of 500000 steps (11%)
17:08:33:WU02:FS02:0xa4:Completed 60000 out of 500000 steps (12%)
17:10:15:WU02:FS02:0xa4:Completed 65000 out of 500000 steps (13%)
17:11:57:WU02:FS02:0xa4:Completed 70000 out of 500000 steps (14%)
17:13:39:WU02:FS02:0xa4:Completed 75000 out of 500000 steps (15%)
17:15:21:WU02:FS02:0xa4:Completed 80000 out of 500000 steps (16%)
17:17:03:WU02:FS02:0xa4:Completed 85000 out of 500000 steps (17%)
17:18:45:WU02:FS02:0xa4:Completed 90000 out of 500000 steps (18%)
17:20:26:WU02:FS02:0xa4:Completed 95000 out of 500000 steps (19%)
 
What I hoped to read was something like this:
Code: 
*********************** Log Started 2013-04-09T00:19:47Z ***********************
00:19:47:************************* Folding@home Client *************************
00:19:47:      Website: [url]http://folding.stanford.edu/[/url]
00:19:47:    Copyright: (c) 2009-2013 Stanford University
00:19:47:       Author: Joseph Coffland <[email protected]>
00:19:47:         Args: --open-web-control
00:19:47:       Config: C:/Users/adak/AppData/Roaming/FAHClient/config.xml
00:19:47:******************************** Build ********************************
00:19:47:      Version: 7.3.6
00:19:47:         Date: Feb 18 2013
00:19:47:         Time: 15:25:17
00:19:47:      SVN Rev: 3923
00:19:47:       Branch: fah/trunk/client
00:19:47:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
00:19:47:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
00:19:47:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
00:19:47:     Platform: win32 XP
00:19:47:         Bits: 32
00:19:47:         Mode: Release
00:19:47:******************************* System ********************************
00:19:47:          CPU: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz
00:19:47:       CPU ID: GenuineIntel Family 6 Model 26 Stepping 4
00:19:47:         CPUs: 8
00:19:47:       Memory: 11.99GiB
00:19:47:  Free Memory: 10.42GiB
00:19:47:      Threads: WINDOWS_THREADS
00:19:47:  Has Battery: false
00:19:47:   On Battery: false
00:19:47:   UTC offset: -7
00:19:47:          PID: 3212
00:19:47:          CWD: C:/Users/adak/AppData/Roaming/FAHClient
00:19:47:           OS: Windows 7 Professional
00:19:47:      OS Arch: AMD64
00:19:47:         GPUs: 2
00:19:47:        GPU 0: UNSUPPORTED: RV530 [Radeon X1600]
00:19:47:        GPU 1: UNSUPPORTED: RV530 [Radeon X1600] (Secondary)
00:19:47:         CUDA: Not detected
00:19:47:Win32 Service: false
00:19:47:***********************************************************************
00:19:47:<config>
00:19:47:  <!-- Folding Slot Configuration -->
00:19:47:  <power v='full'/>
00:19:47:
00:19:47:  <!-- Network -->
00:19:47:  <proxy v=':8080'/>
00:19:47:
00:19:47:  <!-- User Information -->
00:19:47:  <passkey v='********************************'/>
00:19:47:  <team v='32'/>
00:19:47:  <user v='Pit_Crew'/>
00:19:47:
00:19:47:  <!-- Folding Slots -->
00:19:47:  <slot id='0' type='CPU'>
00:19:47:    <cpus v='-1'/>
00:19:47:    <max-packet-size v='big'/>
00:19:47:  </slot>
00:19:47:</config>
00:19:47:Trying to access database...
00:19:47:Successfully acquired database lock
00:19:47:Enabled folding slot 00: READY cpu:8
00:19:47:WU01:FS00:Starting
00:19:47:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/adak/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 703 -lifeline 3212 -checkpoint 15 -np 8
00:19:47:WU01:FS00:Started FahCore on PID 1532
00:19:47:WU01:FS00:Core PID:2088
00:19:47:WU01:FS00:FahCore 0xa4 started
00:19:47:WU01:FS00:0xa4:
00:19:47:WU01:FS00:0xa4:*------------------------------*
00:19:47:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
00:19:47:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
00:19:47:WU01:FS00:0xa4:
00:19:47:WU01:FS00:0xa4:Preparing to commence simulation
00:19:47:WU01:FS00:0xa4:- Looking at optimizations...
00:19:47:WU01:FS00:0xa4:- Files status OK
00:19:47:WU01:FS00:0xa4:- Expanded 2079299 -> 5386224 (decompressed 259.0 percent)
00:19:47:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=2079299 data_size=5386224, decompressed_data_size=5386224 diff=0
00:19:47:WU01:FS00:0xa4:- Digital signature verified
00:19:47:WU01:FS00:0xa4:
00:19:47:WU01:FS00:0xa4:Project: 7809 (Run 1, Clone 162, Gen 32)
00:19:47:WU01:FS00:0xa4:
00:19:47:WU01:FS00:0xa4:Assembly optimizations on if available.
00:19:47:WU01:FS00:0xa4:Entering M.D.
00:19:51:12:127.0.0.1:New Web connection
00:19:53:WU01:FS00:0xa4:Using Gromacs checkpoints
00:19:53:WU01:FS00:0xa4:Mapping NT from 8 to 8 
00:19:54:WU01:FS00:0xa4:Resuming from checkpoint
00:19:54:WU01:FS00:0xa4:Verified 01/wudata_01.log
00:19:54:WU01:FS00:0xa4:Verified 01/wudata_01.trr
00:19:54:WU01:FS00:0xa4:Verified 01/wudata_01.xtc
00:19:54:WU01:FS00:0xa4:Verified 01/wudata_01.edr
00:19:54:WU01:FS00:0xa4:Completed 322110 out of 1500000 steps  (21%)
00:22:34:WARNING:Exception: 19:127.0.0.1: Send error: 10053: An established connection was aborted by the software in your host machine.
00:22:36:WARNING:Exception: 44:127.0.0.1: Send error: 10053: An established connection was aborted by the software in your host machine.
00:25:02:WU01:FS00:0xa4:Completed 330000 out of 1500000 steps  (22%)
00:34:59:WU01:FS00:0xa4:Completed 345000 out of 1500000 steps  (23%)

But your log file was very interesting. It shouldn't be seeing any NaN's (Not A Number), and then have to try and hunt them down via a binary search!

See if you can find in your log file, (should be the very first 100 lines or so), something that looks like the above.

I'll check out what's going on with the NaN's - because that's just wrong. May be a bad work unit, and or project. Speaking of which, the GPU side of FAH has projects that fold quickly, and others that are dogs as far as their ppd. You will NOT be able to somehow "make them equal" - that can't be done at the present time, and won't be likely unless your folding system matches the one they use for benchmarking for points.

Back after bit.
 
Code: 
17:03:14:WU01:FS01:0x17:Completed 471762 out of 2500000 steps (18%)
17:03:26:WU02:FS02:0xa4:Completed 45000 out of 500000 steps (9%)
17:05:08:WU02:FS02:0xa4:Completed 50000 out of 500000 steps (10%)
17:05:48:WU01:FS01:0x17:Completed 500000 out of 2500000 steps (20%)
17:06:50:WU02:FS02:0xa4:Completed 55000 out of 500000 steps (11%)
17:07:45:WU00:FS00:0x17:Completed 50000 out of 2500000 steps (2%)
17:08:33:WU02:FS02:0xa4:Completed 60000 out of 500000 steps (12%)
17:10:15:WU02:FS02:0xa4:Completed 65000 out of 500000 steps (13%)
17:10:19:WU01:FS01:0x17:Completed 550000 out of 2500000 steps (22%)
17:11:57:WU02:FS02:0xa4:Completed 70000 out of 500000 steps (14%)
17:13:39:WU02:FS02:0xa4:Completed 75000 out of 500000 steps (15%)
17:14:55:WU01:FS01:0x17:Completed 600000 out of 2500000 steps (24%)
17:15:21:WU02:FS02:0xa4:Completed 80000 out of 500000 steps (16%)
17:17:03:WU02:FS02:0xa4:Completed 85000 out of 500000 steps (17%)
17:18:05:WU00:FS00:0x17:NaNs found .. trying to pinpoint the NaN step via binary search... (this might take a while) 
17:18:05:WU00:FS00:0x17:Trying to isolate NaN....searching [0,96792]
17:18:45:WU02:FS02:0xa4:Completed 90000 out of 500000 steps (18%)
17:19:34:WU01:FS01:0x17:Completed 650000 out of 2500000 steps (26%)
17:20:26:WU02:FS02:0xa4:Completed 95000 out of 500000 steps (19%)
17:22:08:WU02:FS02:0xa4:Completed 100000 out of 500000 steps (20%)
17:22:20:WU00:FS00:0x17:Trying to isolate NaN....searching [48397,96792]
17:23:50:WU02:FS02:0xa4:Completed 105000 out of 500000 steps (21%)
17:24:07:WU01:FS01:0x17:Completed 700000 out of 2500000 steps (28%)
17:24:27:WU00:FS00:0x17:Trying to isolate NaN....searching [72595,96792]
17:25:31:WU00:FS00:0x17:Trying to isolate NaN....searching [84694,96792]
17:25:33:WU02:FS02:0xa4:Completed 110000 out of 500000 steps (22%)
17:26:03:WU00:FS00:0x17:Trying to isolate NaN....searching [90744,96792]
17:26:18:WU00:FS00:0x17:Trying to isolate NaN....searching [93769,96792]
17:26:26:WU00:FS00:0x17:Trying to isolate NaN....searching [95281,96792]
17:26:30:WU00:FS00:0x17:Trying to isolate NaN....searching [96037,96792]
17:26:32:WU00:FS00:0x17:Trying to isolate NaN....searching [96415,96792]
17:26:33:WU00:FS00:0x17:Trying to isolate NaN....searching [96604,96792]
17:26:34:WU00:FS00:0x17:Trying to isolate NaN....searching [96699,96792]
17:26:34:WU00:FS00:0x17:Trying to isolate NaN....searching [96746,96792]
17:26:34:WU00:FS00:0x17:Trying to isolate NaN....searching [96770,96792]
17:26:34:WU00:FS00:0x17:Trying to isolate NaN....searching [96782,96792]
17:26:35:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
17:26:35:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:7662 run:2 clone:8 gen:74 core:0x17 unit:0x0000006cff3d4835513912942411ac0f
17:26:35:WU00:FS00:Uploading 3.21KiB to 171.67.108.149
17:26:35:WU00:FS00:Connecting to 171.67.108.149:8080
17:26:35:WU00:FS00:Upload complete
17:26:35:WU00:FS00:Server responded WORK_ACK (400)
17:26:35:WU00:FS00:Cleaning up
17:26:35:WU03:FS00:Connecting to assign-GPU.stanford.edu:80
17:26:36:WU03:FS00:News: Welcome to Folding@Home
17:26:36:WU03:FS00:Assigned to work server 171.67.108.149
17:26:36:WU03:FS00:Requesting new work unit for slot 00: READY gpu:0:Tahiti XT [Radeon HD 7970] from 171.67.108.149
17:26:36:WU03:FS00:Connecting to 171.67.108.149:8080
17:26:36:WU03:FS00ownloading 1.63MiB
17:26:40:WU03:FS00ownload complete
17:26:40:WU03:FS00:Received Unit: id:03 stateOWNLOAD error:NO_ERROR project:7662 run:2 clone:5 gen:86 core:0x17 unit:0x00000082ff3d48355139128ae115ddb8
17:26:40:WU03:FS00:Starting
17:26:40:WU03:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Nick/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/beta/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 8260 -checkpoint 15 -gpu 0 -gpu-vendor ati -gpu-vendor=ati
17:26:40:WU03:FS00:Started FahCore on PID 8344
17:26:40:WU03:FS00:Core PID:8120
17:26:40:WU03:FS00:FahCore 0x17 started
17:26:41:WU03:FS00:0x17:*********************** Log Started 2013-04-09T17:26:40Z ***********************
17:26:41:WU03:FS00:0x17:Project: 7662 (Run 2, Clone 5, Gen 86)
17:26:41:WU03:FS00:0x17:Unit: 0x00000082ff3d48355139128ae115ddb8
17:26:41:WU03:FS00:0x17:CPU: 0x00000000000000000000000000000000
17:26:41:WU03:FS00:0x17:Machine: 0
17:26:41:WU03:FS00:0x17:Reading tar file state.xml
17:26:41:WU03:FS00:0x17:Reading tar file system.xml
17:26:41:WU03:FS00:0x17:Reading tar file integrator.xml
17:26:41:WU03:FS00:0x17:Reading tar file core.xml
17:26:41:WU03:FS00:0x17igital signatures verified
17:26:55:WU03:FS00:0x17:Completed 0 out of 2500000 steps (0%)
17:27:16:WU02:FS02:0xa4:Completed 115000 out of 500000 steps (23%)
17:28:38:WU01:FS01:0x17:Completed 750000 out of 2500000 steps (30%)
17:28:58:WU02:FS02:0xa4:Completed 120000 out of 500000 steps (24%)
17:30:41:WU02:FS02:0xa4:Completed 125000 out of 500000 steps (25%)
17:32:23:WU02:FS02:0xa4:Completed 130000 out of 500000 steps (26%)
17:33:23:WU01:FS01:0x17:Completed 800000 out of 2500000 steps (32%)
17:34:06:WU02:FS02:0xa4:Completed 135000 out of 500000 steps (27%)
17:35:48:WU02:FS02:0xa4:Completed 140000 out of 500000 steps (28%)
17:37:31:WU02:FS02:0xa4:Completed 145000 out of 500000 steps (29%)
17:38:53:WU01:FS01:0x17:Completed 850000 out of 2500000 steps (34%)
17:39:14:WU02:FS02:0xa4:Completed 150000 out of 500000 steps (30%)
17:40:56:WU02:FS02:0xa4:Completed 155000 out of 500000 steps (31%)
17:42:39:WU02:FS02:0xa4:Completed 160000 out of 500000 steps (32%)
17:44:22:WU02:FS02:0xa4:Completed 165000 out of 500000 steps (33%)
17:44:23:WU01:FS01:0x17:Completed 900000 out of 2500000 steps (36%)
17:46:05:WU02:FS02:0xa4:Completed 170000 out of 500000 steps (34%)
17:47:48:WU02:FS02:0xa4:Completed 175000 out of 500000 steps (35%)
17:49:31:WU02:FS02:0xa4:Completed 180000 out of 500000 steps (36%)
17:49:59:WU01:FS01:0x17:Completed 950000 out of 2500000 steps (38%)
17:51:13:WU02:FS02:0xa4:Completed 185000 out of 500000 steps (37%)
 
Also, I want you to run GPU-Z utility (free program, available at all major program depot's), and post up the speed that each card is running at, while the system is folding.

What I'm mainly interested in is the cards reported speed on the bus (x16, x8 or whatever), and the percent of the GPU's being reported as used: 99% or what?


These NaN's are crap - from a crappy work unit or system setting.

Code: 
17:26:03:WU00:FS00:0x17:Trying to isolate NaN....searching [90744,96792]
17:26:18:WU00:FS00:0x17:Trying to isolate NaN....searching [93769,96792]
17:26:26:WU00:FS00:0x17:Trying to isolate NaN....searching [95281,96792]
17:26:30:WU00:FS00:0x17:Trying to isolate NaN....searching [96037,96792]
17:26:32:WU00:FS00:0x17:Trying to isolate NaN....searching [96415,96792]
17:26:33:WU00:FS00:0x17:Trying to isolate NaN....searching [96604,96792]
17:26:34:WU00:FS00:0x17:Trying to isolate NaN....searching [96699,96792]
17:26:34:WU00:FS00:0x17:Trying to isolate NaN....searching [96746,96792]
17:26:34:WU00:FS00:0x17:Trying to isolate NaN....searching [96770,96792]
17:26:34:WU00:FS00:0x17:Trying to isolate NaN....searching [96782,96792]
17:26:35:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
17:26:35:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:7662 run:2 clone:8 gen:74 core:0x17 unit:0x0000006cff3d4835513912942411ac0f
17:26:35:WU00:FS00:Uploading 3.21KiB to 171.67.108.149
17:26:35:WU00:FS00:Connecting to 171.67.108.149:8080

But you haven't posted your system settings - look again at what I posted above. Starts like this:
Code: 
*********************** Log Started 2013-04-09T00:19:47Z ***********************
00:19:47:************************* Folding@home Client *************************
00:19:47:      Website: http://folding.stanford.edu/
00:19:47:    Copyright: (c) 2009-2013 Stanford University
00:19:47:       Author: Joseph Coffland <[email protected]>
00:19:47:         Args: --open-web-control
00:19:47:       Config: C:/Users/adak/AppData/Roaming/FAHClient/config.xml
00:19:47:******************************** Build ********************************
00:19:47:      Version: 7.3.6
00:19:47:         Date: Feb 18 2013
00:19:47:         Time: 15:25:17
00:19:47:      SVN Rev: 3923
00:19:47:       Branch: fah/trunk/client
00:19:47:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
00:19:47:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
00:19:47:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
00:19:47:     Platform: win32 XP
00:19:47:         Bits: 32
00:19:47:         Mode: Release
00:19:47:******************************* System ********************************
00:19:47:          CPU: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz

and continues on down. I need it until it starts posting up the finished "frames" or "steps" %2, etc.
 
So I took a screen shot before quitting and GPU0 was at 13.16%. When I restarted it dropped to 0%. I also want to know about CPU vs SMP.

Before quitting:
40.48%
39.98%
13.16%

Current:
38.7%
37.3%
0.3%


Code: 
*********************** Log Started 2013-04-09T17:57:10Z ***********************
17:57:10:************************* Folding@home Client *************************
17:57:10:      Website: http://folding.stanford.edu/
17:57:10:    Copyright: (c) 2009-2013 Stanford University
17:57:10:       Author: Joseph Coffland <[email protected]>
17:57:10:         Args: --open-web-control
17:57:10:       Config: C:/Users/Nick/AppData/Roaming/FAHClient/config.xml
17:57:10:******************************** Build ********************************
17:57:10:      Version: 7.3.6
17:57:10:         Date: Feb 18 2013
17:57:10:         Time: 15:25:17
17:57:10:      SVN Rev: 3923
17:57:10:       Branch: fah/trunk/client
17:57:10:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
17:57:10:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
17:57:10:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
17:57:10:     Platform: win32 XP
17:57:10:         Bits: 32
17:57:10:         Mode: Release
17:57:10:******************************* System ********************************
17:57:10:          CPU: Intel(R) Core(TM) i7-3930K CPU @ 3.20GHz
17:57:10:       CPU ID: GenuineIntel Family 6 Model 45 Stepping 7
17:57:10:         CPUs: 12
17:57:10:       Memory: 15.94GiB
17:57:10:  Free Memory: 8.51GiB
17:57:10:      Threads: WINDOWS_THREADS
17:57:10:  Has Battery: false
17:57:10:   On Battery: false
17:57:10:   UTC offset: -4
17:57:10:          PID: 8972
17:57:10:          CWD: C:/Users/Nick/AppData/Roaming/FAHClient
17:57:10:           OS: Windows 7 Ultimate
17:57:10:      OS Arch: AMD64
17:57:10:         GPUs: 2
17:57:10:        GPU 0: ATI:5 Tahiti XT [Radeon HD 7970]
17:57:10:        GPU 1: ATI:5 Tahiti XT [Radeon HD 7970]
17:57:10:         CUDA: Not detected
17:57:10:Win32 Service: false
17:57:10:***********************************************************************
17:57:10:<config>
17:57:10:  <!-- Folding Slot Configuration -->
17:57:10:  <power v='full'/>
17:57:10:
17:57:10:  <!-- Network -->
17:57:10:  <proxy v=':8080'/>
17:57:10:
17:57:10:  <!-- User Information -->
17:57:10:  <passkey v='********************************'/>
17:57:10:  <team v='50959'/>
17:57:10:  <user v='Rolston'/>
17:57:10:
17:57:10:  <!-- Folding Slots -->
17:57:10:  <slot id='0' type='GPU'>
17:57:10:    <client-type v='beta'/>
17:57:10:    <extra-core-args v='-gpu-vendor=ati'/>
17:57:10:  </slot>
17:57:10:  <slot id='2' type='CPU'>
17:57:10:    <cpus v='10'/>
17:57:10:    <next-unit-percentage v='100'/>
17:57:10:  </slot>
17:57:10:  <slot id='1' type='GPU'>
17:57:10:    <client-type v='beta'/>
17:57:10:    <extra-core-args v='-gpu-vendor=ati'/>
17:57:10:  </slot>
17:57:10:</config>
17:57:10:Trying to access database...
17:57:10:Successfully acquired database lock
17:57:10:Enabled folding slot 00: READY gpu:0:Tahiti XT [Radeon HD 7970]
17:57:10:Enabled folding slot 02: READY cpu:10
17:57:10:Enabled folding slot 01: READY gpu:1:Tahiti XT [Radeon HD 7970]
17:57:10:WU03:FS00:Starting
17:57:10:WU03:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Nick/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/beta/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 8972 -checkpoint 15 -gpu 0 -gpu-vendor ati -gpu-vendor=ati
17:57:10:WU03:FS00:Started FahCore on PID 8508
17:57:10:WU03:FS00:Core PID:8616
17:57:10:WU03:FS00:FahCore 0x17 started
17:57:10:WU02:FS02:Starting
17:57:10:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Nick/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 703 -lifeline 8972 -checkpoint 15 -np 10
17:57:10:WU02:FS02:Started FahCore on PID 8876
17:57:10:WU02:FS02:Core PID:2880
17:57:10:WU02:FS02:FahCore 0xa4 started
17:57:10:WU01:FS01:Starting
17:57:10:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Nick/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/beta/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 703 -lifeline 8972 -checkpoint 15 -gpu 1 -gpu-vendor ati -gpu-vendor=ati
17:57:10:WU01:FS01:Started FahCore on PID 9112
17:57:10:WU01:FS01:Core PID:8236
17:57:10:WU01:FS01:FahCore 0x17 started
17:57:10:WU03:FS00:0x17:*********************** Log Started 2013-04-09T17:57:10Z ***********************
17:57:10:WU03:FS00:0x17:Project: 7662 (Run 2, Clone 5, Gen 86)
17:57:10:WU03:FS00:0x17:Unit: 0x00000082ff3d48355139128ae115ddb8
17:57:10:WU03:FS00:0x17:CPU: 0x00000000000000000000000000000000
17:57:10:WU03:FS00:0x17:Machine: 0
17:57:10:WU03:FS00:0x17:Digital signatures verified
17:57:10:WU02:FS02:0xa4:
17:57:10:WU02:FS02:0xa4:*------------------------------*
17:57:10:WU02:FS02:0xa4:Folding@Home Gromacs GB Core
17:57:10:WU02:FS02:0xa4:Version 2.27 (Dec. 15, 2010)
17:57:10:WU02:FS02:0xa4:
17:57:10:WU02:FS02:0xa4:Preparing to commence simulation
17:57:10:WU02:FS02:0xa4:- Looking at optimizations...
17:57:10:WU02:FS02:0xa4:- Files status OK
17:57:10:WU02:FS02:0xa4:- Expanded 1084030 -> 3056276 (decompressed 281.9 percent)
17:57:10:WU02:FS02:0xa4:Called DecompressByteArray: compressed_data_size=1084030 data_size=3056276, decompressed_data_size=3056276 diff=0
17:57:10:WU02:FS02:0xa4:- Digital signature verified
17:57:10:WU02:FS02:0xa4:
17:57:10:WU02:FS02:0xa4:Project: 8083 (Run 70, Clone 41, Gen 74)
17:57:10:WU02:FS02:0xa4:
17:57:10:WU02:FS02:0xa4:Assembly optimizations on if available.
17:57:10:WU02:FS02:0xa4:Entering M.D.
17:57:11:WU01:FS01:0x17:*********************** Log Started 2013-04-09T17:57:10Z ***********************
17:57:11:WU01:FS01:0x17:Project: 7662 (Run 2, Clone 6, Gen 93)
17:57:11:WU01:FS01:0x17:Unit: 0x00000081ff3d48355139128ef185c9cb
17:57:11:WU01:FS01:0x17:CPU: 0x00000000000000000000000000000000
17:57:11:WU01:FS01:0x17:Machine: 1
17:57:11:WU01:FS01:0x17:Digital signatures verified
17:57:14:5:127.0.0.1:New Web connection
17:57:16:WU02:FS02:0xa4:Using Gromacs checkpoints
17:57:16:WU02:FS02:0xa4:Mapping NT from 10 to 10 
17:57:16:WU02:FS02:0xa4:Resuming from checkpoint
17:57:16:WU02:FS02:0xa4:Verified 02/wudata_01.log
17:57:16:WU02:FS02:0xa4:Verified 02/wudata_01.trr
17:57:16:WU02:FS02:0xa4:Verified 02/wudata_01.xtc
17:57:16:WU02:FS02:0xa4:Verified 02/wudata_01.edr
17:57:16:WU02:FS02:0xa4:Completed 176020 out of 500000 steps  (35%)
17:57:20:WU03:FS00:0x17:Completed 0 out of 2500000 steps (0%)
17:57:21:WU01:FS01:0x17:Completed 934127 out of 2500000 steps (37%)

Here is the GPU-Z readings. I was having issues with GPU-Z running on 2 GPUs, but these readings look good. I apologize for the back and forth posts, but I am remotely logging into my home PC and the resolution is crap. So I am posting then editing on my local machine. Please note I set the fan speeds high myself.
 
Last edited:
Rolston said:
So I took a screen shot before quitting and GPU0 was at 13.16%. When I restarted it dropped to 0%. I also want to know about CPU vs SMP.
Click to expand...


SMP stands for "Symmetric Multi-Processing". That just means that one process is going to start other processes which will run in parallel, on different cores or threads.


Don't even bother with these %N done figures. Stop the cores via the interface, and yes, you will lose a little work - usually, it's not much. Rarely, the wu will be stopped at the same time that the data is being written - and when that happens it MIGHT cause a complete mangling of the data, and the work unit will start all over again. Doesn't happen very often.

Code: 
*********************** Log Started 2013-04-09T17:57:10Z ***********************
17:57:10:************************* Folding@home Client *************************
17:57:10:      Website: http://folding.stanford.edu/
17:57:10:    Copyright: (c) 2009-2013 Stanford University
17:57:10:       Author: Joseph Coffland <[email protected]>
17:57:10:         Args: --open-web-control
17:57:10:       Config: C:/Users/Nick/AppData/Roaming/FAHClient/config.xml
17:57:10:******************************** Build ********************************
17:57:10:      Version: 7.3.6
17:57:10:         Date: Feb 18 2013
17:57:10:         Time: 15:25:17
17:57:10:      SVN Rev: 3923
17:57:10:       Branch: fah/trunk/client
17:57:10:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
17:57:10:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
17:57:10:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
17:57:10:     Platform: win32 XP
17:57:10:         Bits: 32
17:57:10:         Mode: Release
17:57:10:******************************* System ********************************
17:57:10:          CPU: Intel(R) Core(TM) i7-3930K CPU @ 3.20GHz
17:57:10:       CPU ID: GenuineIntel Family 6 Model 45 Stepping 7
17:57:10:         CPUs: 12
17:57:10:       Memory: 15.94GiB
17:57:10:  Free Memory: 8.51GiB
17:57:10:      Threads: WINDOWS_THREADS
17:57:10:  Has Battery: false
17:57:10:   On Battery: false
17:57:10:   UTC offset: -4
17:57:10:          PID: 8972
17:57:10:          CWD: C:/Users/Nick/AppData/Roaming/FAHClient
17:57:10:           OS: Windows 7 Ultimate
17:57:10:      OS Arch: AMD64
17:57:10:         GPUs: 2
17:57:10:        GPU 0: ATI:5 Tahiti XT [Radeon HD 7970]
17:57:10:        GPU 1: ATI:5 Tahiti XT [Radeon HD 7970]
17:57:10:         CUDA: Not detected
17:57:10:Win32 Service: false
17:57:10:***********************************************************************
17:57:10:<config>
17:57:10:  <!-- Folding Slot Configuration -->
17:57:10:  <power v='full'/>
17:57:10:
17:57:10:  <!-- Network -->
17:57:10:  <proxy v=':8080'/>
17:57:10:
17:57:10:  <!-- User Information -->
17:57:10:  <passkey v='********************************'/>
17:57:10:  <team v='50959'/>
17:57:10:  <user v='Rolston'/>
17:57:10:
17:57:10:  <!-- Folding Slots -->
17:57:10:  <slot id='0' type='GPU'>
17:57:10:    <client-type v='beta'/>
17:57:10:    <extra-core-args v='-gpu-vendor=ati'/>
17:57:10:  </slot>
17:57:10:  <slot id='2' type='CPU'>
17:57:10:    <cpus v='10'/>
17:57:10:    <next-unit-percentage v='100'/>
17:57:10:  </slot>
17:57:10:  <slot id='1' type='GPU'>
17:57:10:    <client-type v='beta'/>
17:57:10:    <extra-core-args v='-gpu-vendor=ati'/>
17:57:10:  </slot>
17:57:10:</config>
17:57:10:Trying to access database...
17:57:10:Successfully acquired database lock
17:57:10:Enabled folding slot 00: READY gpu:0:Tahiti XT [Radeon HD 7970]
17:57:10:Enabled folding slot 02: READY cpu:10
17:57:10:Enabled folding slot 01: READY gpu:1:Tahiti XT [Radeon HD 7970]
17:57:10:WU03:FS00:Starting
17:57:10:WU03:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Nick/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/beta/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 8972 -checkpoint 15 -gpu 0 -gpu-vendor ati -gpu-vendor=ati
17:57:10:WU03:FS00:Started FahCore on PID 8508
17:57:10:WU03:FS00:Core PID:8616
17:57:10:WU03:FS00:FahCore 0x17 started
17:57:10:WU02:FS02:Starting
17:57:10:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Nick/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 703 -lifeline 8972 -checkpoint 15 -np 10
17:57:10:WU02:FS02:Started FahCore on PID 8876
17:57:10:WU02:FS02:Core PID:2880
17:57:10:WU02:FS02:FahCore 0xa4 started
17:57:10:WU01:FS01:Starting
17:57:10:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Nick/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/beta/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 703 -lifeline 8972 -checkpoint 15 -gpu 1 -gpu-vendor ati -gpu-vendor=ati
17:57:10:WU01:FS01:Started FahCore on PID 9112
17:57:10:WU01:FS01:Core PID:8236
17:57:10:WU01:FS01:FahCore 0x17 started
17:57:10:WU03:FS00:0x17:*********************** Log Started 2013-04-09T17:57:10Z ***********************
17:57:10:WU03:FS00:0x17:Project: 7662 (Run 2, Clone 5, Gen 86)
17:57:10:WU03:FS00:0x17:Unit: 0x00000082ff3d48355139128ae115ddb8
17:57:10:WU03:FS00:0x17:CPU: 0x00000000000000000000000000000000
17:57:10:WU03:FS00:0x17:Machine: 0
17:57:10:WU03:FS00:0x17:Digital signatures verified
17:57:10:WU02:FS02:0xa4:
17:57:10:WU02:FS02:0xa4:*------------------------------*
17:57:10:WU02:FS02:0xa4:Folding@Home Gromacs GB Core
17:57:10:WU02:FS02:0xa4:Version 2.27 (Dec. 15, 2010)
17:57:10:WU02:FS02:0xa4:
17:57:10:WU02:FS02:0xa4:Preparing to commence simulation
17:57:10:WU02:FS02:0xa4:- Looking at optimizations...
17:57:10:WU02:FS02:0xa4:- Files status OK
17:57:10:WU02:FS02:0xa4:- Expanded 1084030 -> 3056276 (decompressed 281.9 percent)
17:57:10:WU02:FS02:0xa4:Called DecompressByteArray: compressed_data_size=1084030 data_size=3056276, decompressed_data_size=3056276 diff=0
17:57:10:WU02:FS02:0xa4:- Digital signature verified
17:57:10:WU02:FS02:0xa4:
17:57:10:WU02:FS02:0xa4:Project: 8083 (Run 70, Clone 41, Gen 74)
17:57:10:WU02:FS02:0xa4:
17:57:10:WU02:FS02:0xa4:Assembly optimizations on if available.
17:57:10:WU02:FS02:0xa4:Entering M.D.
17:57:11:WU01:FS01:0x17:*********************** Log Started 2013-04-09T17:57:10Z ***********************
17:57:11:WU01:FS01:0x17:Project: 7662 (Run 2, Clone 6, Gen 93)
17:57:11:WU01:FS01:0x17:Unit: 0x00000081ff3d48355139128ef185c9cb
17:57:11:WU01:FS01:0x17:CPU: 0x00000000000000000000000000000000
17:57:11:WU01:FS01:0x17:Machine: 1
17:57:11:WU01:FS01:0x17:Digital signatures verified
17:57:14:5:127.0.0.1:New Web connection
17:57:16:WU02:FS02:0xa4:Using Gromacs checkpoints
17:57:16:WU02:FS02:0xa4:Mapping NT from 10 to 10 
17:57:16:WU02:FS02:0xa4:Resuming from checkpoint
17:57:16:WU02:FS02:0xa4:Verified 02/wudata_01.log
17:57:16:WU02:FS02:0xa4:Verified 02/wudata_01.trr
17:57:16:WU02:FS02:0xa4:Verified 02/wudata_01.xtc
17:57:16:WU02:FS02:0xa4:Verified 02/wudata_01.edr
17:57:16:WU02:FS02:0xa4:Completed 176020 out of 500000 steps  (35%)
17:57:20:WU03:FS00:0x17:Completed 0 out of 2500000 steps (0%)
17:57:21:WU01:FS01:0x17:Completed 934127 out of 2500000 steps (37%)

Your slots look set up correctly. I prefer the cpu to be the highest number.

Now post up the % of usage while folding, given by GPU-Z, and the speed of the bus.
 
Last edited:
Here is the GPU-Z readings. I was having issues with GPU-Z running on 2 GPUs, but these readings look good. I apologize for the back and forth posts, but I am remotely logging into my home PC and the resolution is crap. So I am posting then editing on my local machine. Please note I set the fan speeds high myself.
 
That looks good, but I would have preferred to see the cards set up to fold FIRST at default speeds - after they're shown to work well in that system and set up, THEN overclock them.

Can you lower at least one of them, and let's see if the Nan's (which are a common product of overclocked rigs that went a bit too far, when folding), will stop.

Bus speeds are good, and gpu utilization is good, as well. the NaN's are crap however. Can't fold with them popping up their ugly heads.

You're doing fine, actually.
 
Boooo! I lowered both cards to 1100MHz which is the default. I will let them run for the rest of the day and capture the logs again.

Thanks for the help.
 
Booo! :rofl:

I hear ya! This IS Overclockers.com, but those NaN's -- they are as welcome as a wolverine in the hen house.
 
Here are all of the logs since we left at 17:57:21. The last NaN occurs at 19:02:57. All NaNs occur on slot 00.

Code: 
17:58:39:WU02:FS02:0xa4:Completed 180000 out of 500000 steps  (36%)
17:59:02:WU01:FS01:0x17:Completed 950000 out of 2500000 steps (38%)
18:00:21:WU02:FS02:0xa4:Completed 185000 out of 500000 steps  (37%)
18:01:55:WU03:FS00:0x17:Completed 50000 out of 2500000 steps (2%)
18:02:03:WU02:FS02:0xa4:Completed 190000 out of 500000 steps  (38%)
18:03:35:WU01:FS01:0x17:Completed 1000000 out of 2500000 steps (40%)
18:03:47:WU02:FS02:0xa4:Completed 195000 out of 500000 steps  (39%)
18:05:29:WU02:FS02:0xa4:Completed 200000 out of 500000 steps  (40%)
18:07:11:WU02:FS02:0xa4:Completed 205000 out of 500000 steps  (41%)
18:08:09:WU01:FS01:0x17:Completed 1050000 out of 2500000 steps (42%)
18:08:53:WU02:FS02:0xa4:Completed 210000 out of 500000 steps  (42%)
18:10:35:WU02:FS02:0xa4:Completed 215000 out of 500000 steps  (43%)
18:11:04:WU03:FS00:0x17:NaNs found .. trying to pinpoint the NaN step via binary search... (this might take a while) 
18:11:04:WU03:FS00:0x17:Trying to isolate NaN....searching [0,100000]
18:12:18:WU02:FS02:0xa4:Completed 220000 out of 500000 steps  (44%)
18:12:47:WU01:FS01:0x17:Completed 1100000 out of 2500000 steps (44%)
18:14:01:WU02:FS02:0xa4:Completed 225000 out of 500000 steps  (45%)
18:15:30:WU03:FS00:0x17:Trying to isolate NaN....searching [50001,100000]
18:15:45:WU02:FS02:0xa4:Completed 230000 out of 500000 steps  (46%)
18:17:18:WU01:FS01:0x17:Completed 1150000 out of 2500000 steps (46%)
18:17:28:WU02:FS02:0xa4:Completed 235000 out of 500000 steps  (47%)
18:19:11:WU02:FS02:0xa4:Completed 240000 out of 500000 steps  (48%)
18:20:54:WU02:FS02:0xa4:Completed 245000 out of 500000 steps  (49%)
18:21:49:WU01:FS01:0x17:Completed 1200000 out of 2500000 steps (48%)
18:22:37:WU02:FS02:0xa4:Completed 250000 out of 500000 steps  (50%)
18:24:19:WU02:FS02:0xa4:Completed 255000 out of 500000 steps  (51%)
18:26:01:WU02:FS02:0xa4:Completed 260000 out of 500000 steps  (52%)
18:26:20:WU01:FS01:0x17:Completed 1250000 out of 2500000 steps (50%)
18:27:45:WU02:FS02:0xa4:Completed 265000 out of 500000 steps  (53%)
18:29:27:WU02:FS02:0xa4:Completed 270000 out of 500000 steps  (54%)
18:30:55:WU01:FS01:0x17:Completed 1300000 out of 2500000 steps (52%)
18:31:09:WU02:FS02:0xa4:Completed 275000 out of 500000 steps  (55%)
18:32:52:WU02:FS02:0xa4:Completed 280000 out of 500000 steps  (56%)
18:34:33:WU02:FS02:0xa4:Completed 285000 out of 500000 steps  (57%)
18:35:33:WU01:FS01:0x17:Completed 1350000 out of 2500000 steps (54%)
18:36:15:WU02:FS02:0xa4:Completed 290000 out of 500000 steps  (58%)
18:37:56:WU02:FS02:0xa4:Completed 295000 out of 500000 steps  (59%)
18:39:38:WU02:FS02:0xa4:Completed 300000 out of 500000 steps  (60%)
18:40:19:WU01:FS01:0x17:Completed 1400000 out of 2500000 steps (56%)
18:41:19:WU02:FS02:0xa4:Completed 305000 out of 500000 steps  (61%)
18:43:01:WU02:FS02:0xa4:Completed 310000 out of 500000 steps  (62%)
18:44:43:WU02:FS02:0xa4:Completed 315000 out of 500000 steps  (63%)
18:45:11:WU01:FS01:0x17:Completed 1450000 out of 2500000 steps (58%)
18:46:25:WU02:FS02:0xa4:Completed 320000 out of 500000 steps  (64%)
18:48:07:WU02:FS02:0xa4:Completed 325000 out of 500000 steps  (65%)
18:49:49:WU02:FS02:0xa4:Completed 330000 out of 500000 steps  (66%)
18:49:57:WU01:FS01:0x17:Completed 1500000 out of 2500000 steps (60%)
18:51:32:WU02:FS02:0xa4:Completed 335000 out of 500000 steps  (67%)
18:53:14:WU02:FS02:0xa4:Completed 340000 out of 500000 steps  (68%)
18:54:42:WU01:FS01:0x17:Completed 1550000 out of 2500000 steps (62%)
18:54:56:WU02:FS02:0xa4:Completed 345000 out of 500000 steps  (69%)
18:56:38:WU02:FS02:0xa4:Completed 350000 out of 500000 steps  (70%)
18:58:20:WU02:FS02:0xa4:Completed 355000 out of 500000 steps  (71%)
18:59:34:WU01:FS01:0x17:Completed 1600000 out of 2500000 steps (64%)
19:00:02:WU02:FS02:0xa4:Completed 360000 out of 500000 steps  (72%)
19:00:16:WU03:FS00:0x17:Found a NaN.... decreasing stepSize
19:00:16:WU03:FS00:0x17:Trying to isolate NaN....searching [50001,74999]
19:01:28:WU03:FS00:0x17:Trying to isolate NaN....searching [62501,74999]
19:01:44:WU02:FS02:0xa4:Completed 365000 out of 500000 steps  (73%)
19:02:04:WU03:FS00:0x17:Trying to isolate NaN....searching [68751,74999]
19:02:22:WU03:FS00:0x17:Trying to isolate NaN....searching [71876,74999]
19:02:31:WU03:FS00:0x17:Trying to isolate NaN....searching [73438,74999]
19:02:35:WU03:FS00:0x17:Trying to isolate NaN....searching [74219,74999]
19:02:38:WU03:FS00:0x17:Trying to isolate NaN....searching [74610,74999]
19:02:39:WU03:FS00:0x17:Trying to isolate NaN....searching [74805,74999]
19:02:39:WU03:FS00:0x17:Trying to isolate NaN....searching [74903,74999]
19:02:40:WU03:FS00:0x17:Trying to isolate NaN....searching [74952,74999]
19:02:40:WU03:FS00:0x17:Trying to isolate NaN....searching [74976,74999]
19:02:40:WU03:FS00:0x17:Trying to isolate NaN....searching [74988,74999]
19:02:40:WU03:FS00:0x17:Trying to isolate NaN....searching [74994,74999]
19:02:40:WU03:FS00:0x17:Trying to isolate NaN....searching [74997,74999]
19:02:40:WU03:FS00:0x17:Trying to isolate NaN....searching [74999,74999]
19:02:40:WU03:FS00:0x17:NaNs roughly pinpointed to step 74999, sending checkpoints back to Work Server
19:02:49:WU03:FS00:0x17:ERROR:exception: NaNs detected in positions.0 0
19:02:49:WU03:FS00:0x17:Saving result file logfile_01.txt
19:02:49:WU03:FS00:0x17:Saving result file NaN_state_21391_0
19:02:50:WU03:FS00:0x17:Saving result file NaN_state_21391_1
19:02:51:WU03:FS00:0x17:Saving result file NaN_state_21391_2
19:02:51:WU03:FS00:0x17:Saving result file NaN_state_21391_3
19:02:52:WU03:FS00:0x17:Saving result file NaN_state_21391_4
19:02:53:WU03:FS00:0x17:Saving result file NaN_state_21391_5
19:02:54:WU03:FS00:0x17:Saving result file NaN_state_21391_6
19:02:55:WU03:FS00:0x17:Saving result file NaN_stream_21391_0
19:02:55:WU03:FS00:0x17:Saving result file NaN_stream_21391_1
19:02:55:WU03:FS00:0x17:Saving result file NaN_stream_21391_2
19:02:56:WU03:FS00:0x17:Saving result file NaN_stream_21391_3
19:02:57:WU03:FS00:0x17:Saving result file NaN_stream_21391_4
19:02:57:WU03:FS00:0x17:Saving result file NaN_stream_21391_5
19:02:57:WU03:FS00:0x17:Saving result file NaN_stream_21391_6
19:02:58:WU03:FS00:0x17:Saving result file log.txt
19:02:58:WU03:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
19:02:58:WARNING:WU03:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
19:02:58:WU03:FS00:Sending unit results: id:03 state:SEND error:FAULTY project:7662 run:2 clone:5 gen:86 core:0x17 unit:0x00000082ff3d48355139128ae115ddb8
19:02:58:WU03:FS00:Uploading 13.56MiB to 171.67.108.149
19:02:58:WU03:FS00:Connecting to 171.67.108.149:8080
19:02:59:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
19:02:59:WU00:FS00:News: Welcome to Folding@Home
19:02:59:WU00:FS00:Assigned to work server 171.67.108.149
19:02:59:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:Tahiti XT [Radeon HD 7970] from 171.67.108.149
19:02:59:WU00:FS00:Connecting to 171.67.108.149:8080
19:03:00:WU00:FS00:Downloading 1.63MiB
19:03:03:WU00:FS00:Download complete
19:03:03:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:7662 run:21 clone:8 gen:81 core:0x17 unit:0x00000085ff3d483551391fa3a78d62c8
19:03:03:WU00:FS00:Starting
19:03:03:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Nick/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/beta/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 703 -lifeline 8972 -checkpoint 15 -gpu 0 -gpu-vendor ati -gpu-vendor=ati
19:03:03:WU00:FS00:Started FahCore on PID 3400
19:03:03:WU00:FS00:Core PID:1348
19:03:03:WU00:FS00:FahCore 0x17 started
19:03:03:WU00:FS00:0x17:*********************** Log Started 2013-04-09T19:03:03Z ***********************
19:03:03:WU00:FS00:0x17:Project: 7662 (Run 21, Clone 8, Gen 81)
19:03:03:WU00:FS00:0x17:Unit: 0x00000085ff3d483551391fa3a78d62c8
19:03:03:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
19:03:03:WU00:FS00:0x17:Machine: 0
19:03:03:WU00:FS00:0x17:Reading tar file state.xml
19:03:04:WU00:FS00:0x17:Reading tar file system.xml
19:03:04:WU03:FS00:Upload 5.07%
19:03:04:WU00:FS00:0x17:Reading tar file integrator.xml
19:03:04:WU00:FS00:0x17:Reading tar file core.xml
19:03:04:WU00:FS00:0x17:Digital signatures verified
19:03:10:WU03:FS00:Upload 10.60%
19:03:16:WU03:FS00:Upload 15.67%
19:03:18:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
19:03:22:WU03:FS00:Upload 21.21%
19:03:28:WU03:FS00:Upload 26.28%
19:03:29:WU02:FS02:0xa4:Completed 370000 out of 500000 steps  (74%)
19:03:34:WU03:FS00:Upload 31.35%
19:03:40:WU03:FS00:Upload 36.88%
19:03:46:WU03:FS00:Upload 41.95%
19:03:52:WU03:FS00:Upload 47.49%
19:03:58:WU03:FS00:Upload 52.56%
19:04:04:WU03:FS00:Upload 57.63%
19:04:10:WU03:FS00:Upload 63.16%
19:04:16:WU03:FS00:Upload 68.23%
19:04:22:WU03:FS00:Upload 73.76%
19:04:27:WU01:FS01:0x17:Completed 1650000 out of 2500000 steps (66%)
19:04:28:WU03:FS00:Upload 78.83%
19:04:34:WU03:FS00:Upload 83.91%
19:04:40:WU03:FS00:Upload 88.98%
19:04:46:WU03:FS00:Upload 94.51%
19:04:52:WU03:FS00:Upload 99.58%
19:04:53:WU03:FS00:Upload complete
19:04:53:WU03:FS00:Server responded WORK_ACK (400)
19:04:53:WU03:FS00:Cleaning up
19:05:11:WU02:FS02:0xa4:Completed 375000 out of 500000 steps  (75%)
19:06:55:WU02:FS02:0xa4:Completed 380000 out of 500000 steps  (76%)
19:08:13:WU00:FS00:0x17:Completed 50000 out of 2500000 steps (2%)
19:08:39:WU02:FS02:0xa4:Completed 385000 out of 500000 steps  (77%)
19:09:20:WU01:FS01:0x17:Completed 1700000 out of 2500000 steps (68%)
19:10:26:WU02:FS02:0xa4:Completed 390000 out of 500000 steps  (78%)
19:12:12:WU02:FS02:0xa4:Completed 395000 out of 500000 steps  (79%)
19:13:02:WU00:FS00:0x17:Completed 100000 out of 2500000 steps (4%)
19:13:58:WU02:FS02:0xa4:Completed 400000 out of 500000 steps  (80%)
19:14:21:WU01:FS01:0x17:Completed 1750000 out of 2500000 steps (70%)
19:15:43:WU02:FS02:0xa4:Completed 405000 out of 500000 steps  (81%)
19:17:30:WU02:FS02:0xa4:Completed 410000 out of 500000 steps  (82%)
19:17:52:WU00:FS00:0x17:Completed 150000 out of 2500000 steps (6%)
19:19:14:WU01:FS01:0x17:Completed 1800000 out of 2500000 steps (72%)
19:19:17:WU02:FS02:0xa4:Completed 415000 out of 500000 steps  (83%)
19:21:03:WU02:FS02:0xa4:Completed 420000 out of 500000 steps  (84%)
19:22:48:WU00:FS00:0x17:Completed 200000 out of 2500000 steps (8%)
19:22:48:WU02:FS02:0xa4:Completed 425000 out of 500000 steps  (85%)
19:24:07:WU01:FS01:0x17:Completed 1850000 out of 2500000 steps (74%)
19:24:34:WU02:FS02:0xa4:Completed 430000 out of 500000 steps  (86%)
19:26:19:WU02:FS02:0xa4:Completed 435000 out of 500000 steps  (87%)
19:27:38:WU00:FS00:0x17:Completed 250000 out of 2500000 steps (10%)
19:28:06:WU02:FS02:0xa4:Completed 440000 out of 500000 steps  (88%)
19:29:07:WU01:FS01:0x17:Completed 1900000 out of 2500000 steps (76%)
19:29:53:WU02:FS02:0xa4:Completed 445000 out of 500000 steps  (89%)
19:31:38:WU02:FS02:0xa4:Completed 450000 out of 500000 steps  (90%)
19:32:27:WU00:FS00:0x17:Completed 300000 out of 2500000 steps (12%)
19:33:25:WU02:FS02:0xa4:Completed 455000 out of 500000 steps  (91%)
19:34:00:WU01:FS01:0x17:Completed 1950000 out of 2500000 steps (78%)
19:35:12:WU02:FS02:0xa4:Completed 460000 out of 500000 steps  (92%)
19:36:57:WU02:FS02:0xa4:Completed 465000 out of 500000 steps  (93%)
19:37:24:WU00:FS00:0x17:Completed 350000 out of 2500000 steps (14%)
19:38:44:WU02:FS02:0xa4:Completed 470000 out of 500000 steps  (94%)
19:38:55:WU01:FS01:0x17:Completed 2000000 out of 2500000 steps (80%)
19:40:29:WU02:FS02:0xa4:Completed 475000 out of 500000 steps  (95%)
19:42:14:WU00:FS00:0x17:Completed 400000 out of 2500000 steps (16%)
19:42:15:WU02:FS02:0xa4:Completed 480000 out of 500000 steps  (96%)
19:43:56:WU01:FS01:0x17:Completed 2050000 out of 2500000 steps (82%)
19:44:03:WU02:FS02:0xa4:Completed 485000 out of 500000 steps  (97%)
19:45:49:WU02:FS02:0xa4:Completed 490000 out of 500000 steps  (98%)
19:47:04:WU00:FS00:0x17:Completed 450000 out of 2500000 steps (18%)
19:47:36:WU02:FS02:0xa4:Completed 495000 out of 500000 steps  (99%)
19:47:37:WU03:FS02:Connecting to assign3.stanford.edu:8080
19:47:37:WU03:FS02:News: Welcome to Folding@Home
19:47:37:WU03:FS02:Assigned to work server 171.64.65.99
19:47:37:WU03:FS02:Requesting new work unit for slot 02: RUNNING cpu:10 from 171.64.65.99
19:47:37:WU03:FS02:Connecting to 171.64.65.99:8080
19:47:39:WU03:FS02:Downloading 1.98MiB
19:47:43:WU03:FS02:Download complete
19:47:43:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:7809 run:6 clone:255 gen:39 core:0xa4 unit:0x000000370a3b1e874e3112a4080a988c
19:48:50:WU01:FS01:0x17:Completed 2100000 out of 2500000 steps (84%)
19:49:23:WU02:FS02:0xa4:Completed 500000 out of 500000 steps  (100%)
19:49:23:WU02:FS02:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
19:49:33:WU02:FS02:0xa4:
19:49:33:WU02:FS02:0xa4:Finished Work Unit:
19:49:33:WU02:FS02:0xa4:- Reading up to 1352292 from "02/wudata_01.trr": Read 1352292
19:49:33:WU02:FS02:0xa4:trr file hash check passed.
19:49:33:WU02:FS02:0xa4:- Reading up to 1507352 from "02/wudata_01.xtc": Read 1507352
19:49:33:WU02:FS02:0xa4:xtc file hash check passed.
19:49:33:WU02:FS02:0xa4:edr file hash check passed.
19:49:33:WU02:FS02:0xa4:logfile size: 28260
19:49:33:WU02:FS02:0xa4:Leaving Run
19:49:36:WU02:FS02:0xa4:- Writing 2896728 bytes of core data to disk...
19:49:36:WU02:FS02:0xa4:Done: 2896216 -> 2808154 (compressed to 96.9 percent)
19:49:36:WU02:FS02:0xa4:  ... Done.
19:49:36:WU02:FS02:0xa4:- Shutting down core
19:49:36:WU02:FS02:0xa4:
19:49:36:WU02:FS02:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
19:49:37:WU02:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
19:49:37:WU02:FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:8083 run:70 clone:41 gen:74 core:0xa4 unit:0x0000004e6652edb3512a32307bbf5dd6
19:49:37:WU02:FS02:Uploading 2.68MiB to 171.67.108.35
19:49:37:WU02:FS02:Connecting to 171.67.108.35:8080
19:49:37:WU03:FS02:Starting
19:49:37:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Nick/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 03 -suffix 01 -version 703 -lifeline 8972 -checkpoint 15 -np 10
19:49:37:WU03:FS02:Started FahCore on PID 8316
19:49:37:WU03:FS02:Core PID:8360
19:49:37:WU03:FS02:FahCore 0xa4 started
19:49:37:WU03:FS02:0xa4:
19:49:37:WU03:FS02:0xa4:*------------------------------*
19:49:37:WU03:FS02:0xa4:Folding@Home Gromacs GB Core
19:49:37:WU03:FS02:0xa4:Version 2.27 (Dec. 15, 2010)
19:49:37:WU03:FS02:0xa4:
19:49:37:WU03:FS02:0xa4:Preparing to commence simulation
19:49:37:WU03:FS02:0xa4:- Looking at optimizations...
19:49:37:WU03:FS02:0xa4:- Created dyn
19:49:37:WU03:FS02:0xa4:- Files status OK
19:49:37:WU03:FS02:0xa4:- Expanded 2079207 -> 5386224 (decompressed 259.0 percent)
19:49:37:WU03:FS02:0xa4:Called DecompressByteArray: compressed_data_size=2079207 data_size=5386224, decompressed_data_size=5386224 diff=0
19:49:37:WU03:FS02:0xa4:- Digital signature verified
19:49:37:WU03:FS02:0xa4:
19:49:37:WU03:FS02:0xa4:Project: 7809 (Run 6, Clone 255, Gen 39)
19:49:37:WU03:FS02:0xa4:
19:49:37:WU03:FS02:0xa4:Assembly optimizations on if available.
19:49:37:WU03:FS02:0xa4:Entering M.D.
19:49:43:WU02:FS02:Upload 28.00%
19:49:43:WU03:FS02:0xa4:Mapping NT from 10 to 10 
19:49:43:WU03:FS02:0xa4:Completed 0 out of 1500000 steps  (0%)
19:49:49:WU02:FS02:Upload 56.00%
19:49:55:WU02:FS02:Upload 84.00%
19:49:59:WU02:FS02:Upload complete
19:49:59:WU02:FS02:Server responded WORK_ACK (400)
19:49:59:WU02:FS02:Final credit estimate, 4889.00 points
19:49:59:WU02:FS02:Cleaning up
19:52:00:WU00:FS00:0x17:Completed 500000 out of 2500000 steps (20%)
19:53:43:WU01:FS01:0x17:Completed 2150000 out of 2500000 steps (86%)
19:55:29:WU03:FS02:0xa4:Completed 15000 out of 1500000 steps  (1%)
19:56:51:WU00:FS00:0x17:Completed 550000 out of 2500000 steps (22%)
19:58:41:WU01:FS01:0x17:Completed 2200000 out of 2500000 steps (88%)
20:01:15:WU03:FS02:0xa4:Completed 30000 out of 1500000 steps  (2%)
20:01:41:WU00:FS00:0x17:Completed 600000 out of 2500000 steps (24%)
20:03:33:WU01:FS01:0x17:Completed 2250000 out of 2500000 steps (90%)
20:06:37:WU00:FS00:0x17:Completed 650000 out of 2500000 steps (26%)
20:07:00:WU03:FS02:0xa4:Completed 45000 out of 1500000 steps  (3%)
20:08:26:WU01:FS01:0x17:Completed 2300000 out of 2500000 steps (92%)
20:11:27:WU00:FS00:0x17:Completed 700000 out of 2500000 steps (28%)
20:12:48:WU03:FS02:0xa4:Completed 60000 out of 1500000 steps  (4%)
20:13:26:WU01:FS01:0x17:Completed 2350000 out of 2500000 steps (94%)
20:16:14:WU00:FS00:0x17:Completed 750000 out of 2500000 steps (30%)
20:18:14:WU01:FS01:0x17:Completed 2400000 out of 2500000 steps (96%)
20:18:39:WU03:FS02:0xa4:Completed 75000 out of 1500000 steps  (5%)
20:21:05:WU00:FS00:0x17:Completed 800000 out of 2500000 steps (32%)
20:23:00:WU01:FS01:0x17:Completed 2450000 out of 2500000 steps (98%)
20:23:01:WU02:FS01:Connecting to assign-GPU.stanford.edu:80
20:23:01:WU02:FS01:News: Welcome to Folding@Home
20:23:01:WU02:FS01:Assigned to work server 171.67.108.149
20:23:01:WU02:FS01:Requesting new work unit for slot 01: RUNNING gpu:1:Tahiti XT [Radeon HD 7970] from 171.67.108.149
20:23:01:WU02:FS01:Connecting to 171.67.108.149:8080
20:23:02:WU02:FS01:Downloading 1.63MiB
20:23:06:WU02:FS01:Download complete
20:23:06:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:7662 run:30 clone:2 gen:69 core:0x17 unit:0x0000006cff3d4835513925c7ef341a09
20:24:28:WU03:FS02:0xa4:Completed 90000 out of 1500000 steps  (6%)
20:25:55:WU00:FS00:0x17:Completed 850000 out of 2500000 steps (34%)
20:28:47:WU01:FS01:0x17:Saving result file logfile_01.txt
20:28:47:WU01:FS01:0x17:Saving result file checkpointState.xml
20:28:47:WU01:FS01:0x17:Saving result file checkpt.crc
20:28:47:WU01:FS01:0x17:Saving result file log.txt
20:28:47:WU01:FS01:0x17:Saving result file positions.xtc
20:28:49:WU01:FS01:0x17:Folding@home Core Shutdown: FINISHED_UNIT
20:28:49:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
20:28:49:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:7662 run:2 clone:6 gen:93 core:0x17 unit:0x00000081ff3d48355139128ef185c9cb
20:28:49:WU01:FS01:Uploading 6.11MiB to 171.67.108.149
20:28:49:WU01:FS01:Connecting to 171.67.108.149:8080
20:28:50:WU02:FS01:Starting
20:28:50:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Nick/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/beta/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 703 -lifeline 8972 -checkpoint 15 -gpu 1 -gpu-vendor ati -gpu-vendor=ati
20:28:50:WU02:FS01:Started FahCore on PID 4272
20:28:50:WU02:FS01:Core PID:7280
20:28:50:WU02:FS01:FahCore 0x17 started
20:28:50:WU02:FS01:0x17:*********************** Log Started 2013-04-09T20:28:50Z ***********************
20:28:50:WU02:FS01:0x17:Project: 7662 (Run 30, Clone 2, Gen 69)
20:28:50:WU02:FS01:0x17:Unit: 0x0000006cff3d4835513925c7ef341a09
20:28:50:WU02:FS01:0x17:CPU: 0x00000000000000000000000000000000
20:28:50:WU02:FS01:0x17:Machine: 1
20:28:50:WU02:FS01:0x17:Reading tar file state.xml
20:28:50:WU02:FS01:0x17:Reading tar file system.xml
20:28:51:WU02:FS01:0x17:Reading tar file integrator.xml
20:28:51:WU02:FS01:0x17:Reading tar file core.xml
20:28:51:WU02:FS01:0x17:Digital signatures verified
20:28:55:WU01:FS01:Upload 10.23%
20:29:01:WU01:FS01:Upload 22.51%
20:29:05:WU02:FS01:0x17:Completed 0 out of 2500000 steps (0%)
20:29:07:WU01:FS01:Upload 33.77%
20:29:13:WU01:FS01:Upload 46.05%
20:29:19:WU01:FS01:Upload 57.30%
20:29:25:WU01:FS01:Upload 69.58%
20:29:31:WU01:FS01:Upload 81.86%
20:29:37:WU01:FS01:Upload 94.14%
20:29:46:WU01:FS01:Upload complete
20:29:46:WU01:FS01:Server responded WORK_ACK (400)
20:29:46:WU01:FS01:Final credit estimate, 7690.00 points
20:29:46:WU01:FS01:Cleaning up
20:30:20:WU03:FS02:0xa4:Completed 105000 out of 1500000 steps  (7%)
20:30:55:WU00:FS00:0x17:Completed 900000 out of 2500000 steps (36%)
20:34:58:WU02:FS01:0x17:Completed 50000 out of 2500000 steps (2%)
20:36:02:WU00:FS00:0x17:Completed 950000 out of 2500000 steps (38%)
20:36:11:WU03:FS02:0xa4:Completed 120000 out of 1500000 steps  (8%)
20:40:45:WU02:FS01:0x17:Completed 100000 out of 2500000 steps (4%)
20:41:01:WU00:FS00:0x17:Completed 1000000 out of 2500000 steps (40%)
20:42:07:WU03:FS02:0xa4:Completed 135000 out of 1500000 steps  (9%)
20:46:01:WU00:FS00:0x17:Completed 1050000 out of 2500000 steps (42%)
20:46:39:WU02:FS01:0x17:Completed 150000 out of 2500000 steps (6%)
20:48:02:WU03:FS02:0xa4:Completed 150000 out of 1500000 steps  (10%)
20:51:04:WU00:FS00:0x17:Completed 1100000 out of 2500000 steps (44%)
20:52:04:WU02:FS01:0x17:Completed 200000 out of 2500000 steps (8%)
20:53:56:WU03:FS02:0xa4:Completed 165000 out of 1500000 steps  (11%)
20:55:48:WU00:FS00:0x17:Completed 1150000 out of 2500000 steps (46%)
20:56:49:WU02:FS01:0x17:Completed 250000 out of 2500000 steps (10%)
20:59:47:WU03:FS02:0xa4:Completed 180000 out of 1500000 steps  (12%)
21:00:32:WU00:FS00:0x17:Completed 1200000 out of 2500000 steps (48%)
21:01:41:WU02:FS01:0x17:Completed 300000 out of 2500000 steps (12%)
21:05:24:WU00:FS00:0x17:Completed 1250000 out of 2500000 steps (50%)
21:05:38:WU03:FS02:0xa4:Completed 195000 out of 1500000 steps  (13%)
21:06:28:WU02:FS01:0x17:Completed 350000 out of 2500000 steps (14%)
21:10:09:WU00:FS00:0x17:Completed 1300000 out of 2500000 steps (52%)
21:11:13:WU02:FS01:0x17:Completed 400000 out of 2500000 steps (16%)
21:11:30:WU03:FS02:0xa4:Completed 210000 out of 1500000 steps  (14%)
21:14:55:WU00:FS00:0x17:Completed 1350000 out of 2500000 steps (54%)
21:16:08:WU02:FS01:0x17:Completed 450000 out of 2500000 steps (18%)
21:17:22:WU03:FS02:0xa4:Completed 225000 out of 1500000 steps  (15%)
21:19:50:WU00:FS00:0x17:Completed 1400000 out of 2500000 steps (56%)
21:20:57:WU02:FS01:0x17:Completed 500000 out of 2500000 steps (20%)
21:23:11:WU03:FS02:0xa4:Completed 240000 out of 1500000 steps  (16%)
21:24:40:WU00:FS00:0x17:Completed 1450000 out of 2500000 steps (58%)
21:25:45:WU02:FS01:0x17:Completed 550000 out of 2500000 steps (22%)
21:28:58:WU03:FS02:0xa4:Completed 255000 out of 1500000 steps  (17%)
21:29:28:WU00:FS00:0x17:Completed 1500000 out of 2500000 steps (60%)
21:30:39:WU02:FS01:0x17:Completed 600000 out of 2500000 steps (24%)
21:34:23:WU00:FS00:0x17:Completed 1550000 out of 2500000 steps (62%)
21:34:45:WU03:FS02:0xa4:Completed 270000 out of 1500000 steps  (18%)
21:35:27:WU02:FS01:0x17:Completed 650000 out of 2500000 steps (26%)
21:39:12:WU00:FS00:0x17:Completed 1600000 out of 2500000 steps (64%)
21:40:15:WU02:FS01:0x17:Completed 700000 out of 2500000 steps (28%)
21:40:34:WU03:FS02:0xa4:Completed 285000 out of 1500000 steps  (19%)
21:44:01:WU00:FS00:0x17:Completed 1650000 out of 2500000 steps (66%)
21:45:09:WU02:FS01:0x17:Completed 750000 out of 2500000 steps (30%)
21:46:23:WU03:FS02:0xa4:Completed 300000 out of 1500000 steps  (20%)
21:48:55:WU00:FS00:0x17:Completed 1700000 out of 2500000 steps (68%)
21:49:57:WU02:FS01:0x17:Completed 800000 out of 2500000 steps (32%)
21:52:09:WU03:FS02:0xa4:Completed 315000 out of 1500000 steps  (21%)
21:53:44:WU00:FS00:0x17:Completed 1750000 out of 2500000 steps (70%)
21:54:46:WU02:FS01:0x17:Completed 850000 out of 2500000 steps (34%)
21:57:54:WU03:FS02:0xa4:Completed 330000 out of 1500000 steps  (22%)
21:58:33:WU00:FS00:0x17:Completed 1800000 out of 2500000 steps (72%)
21:59:40:WU02:FS01:0x17:Completed 900000 out of 2500000 steps (36%)
22:03:27:WU00:FS00:0x17:Completed 1850000 out of 2500000 steps (74%)
22:03:40:WU03:FS02:0xa4:Completed 345000 out of 1500000 steps  (23%)
22:04:28:WU02:FS01:0x17:Completed 950000 out of 2500000 steps (38%)
22:08:16:WU00:FS00:0x17:Completed 1900000 out of 2500000 steps (76%)
22:09:18:WU02:FS01:0x17:Completed 1000000 out of 2500000 steps (40%)
22:09:23:WU03:FS02:0xa4:Completed 360000 out of 1500000 steps  (24%)
22:13:05:WU00:FS00:0x17:Completed 1950000 out of 2500000 steps (78%)
22:14:14:WU02:FS01:0x17:Completed 1050000 out of 2500000 steps (42%)
22:15:09:WU03:FS02:0xa4:Completed 375000 out of 1500000 steps  (25%)
22:17:54:WU00:FS00:0x17:Completed 2000000 out of 2500000 steps (80%)
22:19:04:WU02:FS01:0x17:Completed 1100000 out of 2500000 steps (44%)
22:20:53:WU03:FS02:0xa4:Completed 390000 out of 1500000 steps  (26%)
22:22:49:WU00:FS00:0x17:Completed 2050000 out of 2500000 steps (82%)
22:23:53:WU02:FS01:0x17:Completed 1150000 out of 2500000 steps (46%)
22:26:37:WU03:FS02:0xa4:Completed 405000 out of 1500000 steps  (27%)
22:27:38:WU00:FS00:0x17:Completed 2100000 out of 2500000 steps (84%)
22:28:43:WU02:FS01:0x17:Completed 1200000 out of 2500000 steps (48%)
22:32:23:WU03:FS02:0xa4:Completed 420000 out of 1500000 steps  (28%)
22:32:28:WU00:FS00:0x17:Completed 2150000 out of 2500000 steps (86%)
22:33:39:WU02:FS01:0x17:Completed 1250000 out of 2500000 steps (50%)
22:37:22:WU00:FS00:0x17:Completed 2200000 out of 2500000 steps (88%)
22:38:10:WU03:FS02:0xa4:Completed 435000 out of 1500000 steps  (29%)
22:38:28:WU02:FS01:0x17:Completed 1300000 out of 2500000 steps (52%)
22:42:11:WU00:FS00:0x17:Completed 2250000 out of 2500000 steps (90%)
22:43:16:WU02:FS01:0x17:Completed 1350000 out of 2500000 steps (54%)
22:43:53:WU03:FS02:0xa4:Completed 450000 out of 1500000 steps  (30%)
22:46:59:WU00:FS00:0x17:Completed 2300000 out of 2500000 steps (92%)
22:48:11:WU02:FS01:0x17:Completed 1400000 out of 2500000 steps (56%)
22:49:36:WU03:FS02:0xa4:Completed 465000 out of 1500000 steps  (31%)
22:51:53:WU00:FS00:0x17:Completed 2350000 out of 2500000 steps (94%)
22:53:00:WU02:FS01:0x17:Completed 1450000 out of 2500000 steps (58%)
22:55:19:WU03:FS02:0xa4:Completed 480000 out of 1500000 steps  (32%)
22:56:42:WU00:FS00:0x17:Completed 2400000 out of 2500000 steps (96%)
22:57:49:WU02:FS01:0x17:Completed 1500000 out of 2500000 steps (60%)
23:01:00:WU03:FS02:0xa4:Completed 495000 out of 1500000 steps  (33%)
23:01:31:WU00:FS00:0x17:Completed 2450000 out of 2500000 steps (98%)
23:01:31:WU01:FS00:Connecting to assign-GPU.stanford.edu:80
23:01:31:WU01:FS00:News: Welcome to Folding@Home
23:01:31:WU01:FS00:Assigned to work server 171.67.108.149
23:01:31:WU01:FS00:Requesting new work unit for slot 00: RUNNING gpu:0:Tahiti XT [Radeon HD 7970] from 171.67.108.149
23:01:31:WU01:FS00:Connecting to 171.67.108.149:8080
23:01:32:WU01:FS00:Downloading 1.62MiB
23:01:36:WU01:FS00:Download complete
23:01:36:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:7662 run:23 clone:31 gen:13 core:0x17 unit:0x00000018ff3d4835513921584b0859e1
23:02:43:WU02:FS01:0x17:Completed 1550000 out of 2500000 steps (62%)
23:06:27:WU00:FS00:0x17:Saving result file logfile_01.txt
23:06:27:WU00:FS00:0x17:Saving result file checkpointState.xml
23:06:28:WU00:FS00:0x17:Saving result file checkpt.crc
23:06:28:WU00:FS00:0x17:Saving result file log.txt
23:06:28:WU00:FS00:0x17:Saving result file positions.xtc
23:06:30:WU00:FS00:0x17:Folding@home Core Shutdown: FINISHED_UNIT
23:06:30:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
23:06:30:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:7662 run:21 clone:8 gen:81 core:0x17 unit:0x00000085ff3d483551391fa3a78d62c8
23:06:30:WU00:FS00:Uploading 5.88MiB to 171.67.108.149
23:06:30:WU00:FS00:Connecting to 171.67.108.149:8080
23:06:30:WU01:FS00:Starting
23:06:30:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Nick/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/beta/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 703 -lifeline 8972 -checkpoint 15 -gpu 0 -gpu-vendor ati -gpu-vendor=ati
23:06:30:WU01:FS00:Started FahCore on PID 8680
23:06:30:WU01:FS00:Core PID:7524
23:06:30:WU01:FS00:FahCore 0x17 started
23:06:30:WU01:FS00:0x17:*********************** Log Started 2013-04-09T23:06:30Z ***********************
23:06:30:WU01:FS00:0x17:Project: 7662 (Run 23, Clone 31, Gen 13)
23:06:30:WU01:FS00:0x17:Unit: 0x00000018ff3d4835513921584b0859e1
23:06:30:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:06:30:WU01:FS00:0x17:Machine: 0
23:06:30:WU01:FS00:0x17:Reading tar file state.xml
23:06:31:WU01:FS00:0x17:Reading tar file system.xml
23:06:31:WU01:FS00:0x17:Reading tar file integrator.xml
23:06:31:WU01:FS00:0x17:Reading tar file core.xml
23:06:31:WU01:FS00:0x17:Digital signatures verified
23:06:36:WU00:FS00:Upload 12.75%
23:06:42:WU00:FS00:Upload 25.50%
23:06:45:WU01:FS00:0x17:Completed 0 out of 2500000 steps (0%)
23:06:46:WU03:FS02:0xa4:Completed 510000 out of 1500000 steps  (34%)
23:06:48:WU00:FS00:Upload 39.32%
23:06:54:WU00:FS00:Upload 52.07%
23:07:00:WU00:FS00:Upload 64.82%
23:07:06:WU00:FS00:Upload 77.57%
23:07:12:WU00:FS00:Upload 90.32%
23:07:21:WU00:FS00:Upload complete
23:07:21:WU00:FS00:Server responded WORK_ACK (400)
23:07:21:WU00:FS00:Final credit estimate, 7888.00 points
23:07:21:WU00:FS00:Cleaning up
23:07:32:WU02:FS01:0x17:Completed 1600000 out of 2500000 steps (64%)
23:11:36:WU01:FS00:0x17:Completed 50000 out of 2500000 steps (2%)
23:12:21:WU02:FS01:0x17:Completed 1650000 out of 2500000 steps (66%)
23:12:28:WU03:FS02:0xa4:Completed 525000 out of 1500000 steps  (35%)
23:16:23:WU01:FS00:0x17:Completed 100000 out of 2500000 steps (4%)
23:17:17:WU02:FS01:0x17:Completed 1700000 out of 2500000 steps (68%)
23:18:14:WU03:FS02:0xa4:Completed 540000 out of 1500000 steps  (36%)
23:21:10:WU01:FS00:0x17:Completed 150000 out of 2500000 steps (6%)
23:22:06:WU02:FS01:0x17:Completed 1750000 out of 2500000 steps (70%)
23:23:59:WU03:FS02:0xa4:Completed 555000 out of 1500000 steps  (37%)
23:26:04:WU01:FS00:0x17:Completed 200000 out of 2500000 steps (8%)
23:26:56:WU02:FS01:0x17:Completed 1800000 out of 2500000 steps (72%)
23:29:44:WU03:FS02:0xa4:Completed 570000 out of 1500000 steps  (38%)
23:30:51:WU01:FS00:0x17:Completed 250000 out of 2500000 steps (10%)
23:31:51:WU02:FS01:0x17:Completed 1850000 out of 2500000 steps (74%)
23:35:25:WU03:FS02:0xa4:Completed 585000 out of 1500000 steps  (39%)
23:35:38:WU01:FS00:0x17:Completed 300000 out of 2500000 steps (12%)
23:36:41:WU02:FS01:0x17:Completed 1900000 out of 2500000 steps (76%)
23:40:29:WU01:FS00:0x17:Completed 350000 out of 2500000 steps (14%)
23:41:10:WU03:FS02:0xa4:Completed 600000 out of 1500000 steps  (40%)
23:41:29:WU02:FS01:0x17:Completed 1950000 out of 2500000 steps (78%)
 
Question I have is "What is the success rate of the 00 slot card?".

1) the card is defective
2) the install for it is incorrect
3) the project has bad wu's

Obviously #3 should be checked out first, and is more likely.

Copy and paste the log (yes, the entire log file), into a text editor, and have it find all the instances of NaN's.

Make a list of the wu's that the card was working on when it got the NaN. Let's see what that looks like. And verify that slot 1 has no Nan's, throughout the log.

Finally, check if the slot 1 card has been folding on the same project, and generation of wu. If so, and it has no Nan's, then it appears either:

1) the slot is different and the card should be re-installed
2) the card is different and may have a subtle error in it.

To determine that, swap the cards into each other's slots. And check your folding log then (give it several hours or even a few days to be sure).

Finally, uninstall the FAHClient, and then re-install it. Possibly something went wrong with that, that doesn't show up in the log or config.xml file.

My GPU folding teammates may have additional and/or better ideas, but after the "final" step above, I'd take it to the Stanford FAH forum, and see what they can come up with.

It's theoretically possible (but entirely unlikely in a large enough sample of wu's), that your slot 0 card just by chance, received all the bad wu's between the two cards. Like getting heads several times in a row, on a coin toss. As the number of tosses gets ever bigger, the likelihood begins to shrink to 0%.
 
Adak, I noticed that one of the cards is in a slot running at x8. Would that effect anything?
 
It shouldn't. That's a function of the mobo - some have only the first slot x16, and all the rest are x8 (commonly).

Should have plenty of bandwidth on the bus for the cards, at either x16 or x8.

That's theory, and not something proven true in this particular mobo. Slow I could see, if the card just folded slow - but when you see repeated NaN's in there - that's something else, I believe.
 
Your wishes have the opposite effect. I keep getting FahCore 0x16 on my GPUs. Currently my estimated PPD is 79k. I've heard there aren't enough 0x17 WUs to go around. Just figured I ought to check with you guys to make sure you're getting my best PPD possible.

If there's anything I can do to fix this please let me know. The difference between 0x16 and 0x17 is 6200 and 47000 respectively.
 
You must log in or register to reply here.

Similar threads

O
Newbie - Need Motherboard Breadboarding help!
Replies
11
Views
776
Ben333
Ben333
D
RAID 0 - is it worth it?
Replies
14
Views
935
mackerel
mackerel
A
ASUS Rampage V code 00 - please help
Replies
8
Views
2K
animalmom
A
JrClocker
Planning New AMD Threadripper Build
2
Replies
36
Views
3K
JrClocker
JrClocker
C
New Build Feedback
Replies
3
Views
582
EarthDog
EarthDog
Back