• Welcome to Overclockers Forums! Join us to reply in threads, receive reduced ads, and to customize your site experience!

Weirdness on folding machine....

Overclockers is supported by our readers. When you click a link to make a purchase, we may earn a commission. Learn More.

torin3

Member
Joined
Dec 25, 2004
On one of my machines, I've got a card that occasionally stalls out. When that happens, I VNC in, close the client, Kill the core thread that is stalled, then restart the client. Well 2 evenings ago, that happened, but it crashed and rebooted when I killed the core thread. (Happens about 1 out of 20 times) Anyway, got it started back up without too much problem. But a few minutes later, I noticed that HFM was no longer reporting their status. And when I tried to VNC in, it accepted the password, but would never refresh the machine.

I went out to the garage where the machine is, and it was up and running with all 4 clients. I opened a web browser, and it came up normally. So I let it run.

Anyway, this morning when I checked on it, it had about 8 WUs waiting to send. It was downloading new ones and running them when the old ones were done, but it couldn't send them back. I restarted the computer and it sent them all normally. Here is the sending log.

Code:
*********************** Log Started 2015-09-06T13:53:07Z ***********************
13:53:07:************************* [email protected] Client *************************
13:53:07:      Website: http://folding.stanford.edu/
13:53:07:    Copyright: (c) 2009-2014 Stanford University
13:53:07:       Author: Joseph Coffland <[email protected]>
13:53:07:         Args: --open-web-control
13:53:07:       Config: C:/Users/torin/AppData/Roaming/FAHClient/config.xml
13:53:07:******************************** Build ********************************
13:53:07:      Version: 7.4.4
13:53:07:         Date: Mar 4 2014
13:53:07:         Time: 20:26:54
13:53:07:      SVN Rev: 4130
13:53:07:       Branch: fah/trunk/client
13:53:07:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
13:53:07:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
13:53:07:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
13:53:07:     Platform: win32 XP
13:53:07:         Bits: 32
13:53:07:         Mode: Release
13:53:07:******************************* System ********************************
13:53:07:          CPU: Intel(R) Pentium(R) CPU G3250 @ 3.20GHz
13:53:07:       CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
13:53:07:         CPUs: 2
13:53:07:       Memory: 7.95GiB
13:53:07:  Free Memory: 6.88GiB
13:53:07:      Threads: WINDOWS_THREADS
13:53:07:   OS Version: 6.1
13:53:07:  Has Battery: false
13:53:07:   On Battery: false
13:53:07:   UTC Offset: -4
13:53:07:          PID: 3328
13:53:07:          CWD: C:/Users/torin/AppData/Roaming/FAHClient
13:53:07:           OS: Windows 7 Professional
13:53:07:      OS Arch: AMD64
13:53:07:         GPUs: 4
13:53:07:        GPU 0: ATI:5 Tahiti XT [Radeon HD 7970]
13:53:07:        GPU 1: ATI:5 Tahiti XT [Radeon HD 7970]
13:53:07:        GPU 2: ATI:5 Tahiti XT [Radeon HD 7970]
13:53:07:        GPU 3: ATI:5 Tahiti XT [Radeon HD 7970]
13:53:07:         CUDA: Not detected
13:53:07:Win32 Service: false
13:53:07:***********************************************************************
13:53:07:<config>
13:53:07:  <!-- HTTP Server -->
13:53:07:  <allow v='127.0.0.1,192.168.0.0/24'/>
13:53:07:
13:53:07:  <!-- Network -->
13:53:07:  <proxy v=':8080'/>
13:53:07:
13:53:07:  <!-- Remote Command Server -->
13:53:07:  <command-allow-no-pass v='127.0.0.1,192.168.0.0/24'/>
13:53:07:  <password v='****'/>
13:53:07:
13:53:07:  <!-- Slot Control -->
13:53:07:  <power v='full'/>
13:53:07:
13:53:07:  <!-- User Information -->
13:53:07:  <passkey v='********************************'/>
13:53:07:  <team v='32'/>
13:53:07:  <user v='Torin3'/>
13:53:07:
13:53:07:  <!-- Folding Slots -->
13:53:07:  <slot id='1' type='GPU'/>
13:53:07:  <slot id='2' type='GPU'/>
13:53:07:  <slot id='3' type='GPU'/>
13:53:07:  <slot id='4' type='GPU'/>
13:53:07:</config>
13:53:07:Trying to access database...
13:53:07:Successfully acquired database lock
13:53:07:Enabled folding slot 01: READY gpu:0:Tahiti XT [Radeon HD 7970]
13:53:07:Enabled folding slot 02: READY gpu:1:Tahiti XT [Radeon HD 7970]
13:53:07:Enabled folding slot 03: READY gpu:2:Tahiti XT [Radeon HD 7970]
13:53:07:Enabled folding slot 04: READY gpu:3:Tahiti XT [Radeon HD 7970]
13:53:07:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
13:53:07:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
13:53:07:WU07:FS03:Connecting to 171.64.65.98:8080
13:53:07:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
13:53:08:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
13:53:08:WU09:FS01:Connecting to 171.64.65.98:8080
13:53:08:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
13:53:08:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
13:53:08:WU08:FS02:Connecting to 140.163.4.233:8080
13:53:08:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
13:53:08:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
13:53:08:WU02:FS04:Connecting to 140.163.4.233:8080
13:53:08:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
13:53:08:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:10468 run:0 clone:137 gen:216 core:0x17 unit:0x00000158538b3db9538cae08fee7025f
13:53:08:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
13:53:08:WU03:FS01:Connecting to 171.64.65.98:8080
13:53:09:WU00:FS03:Uploading 13.14MiB to 140.163.4.233
13:53:09:WU00:FS03:Connecting to 140.163.4.233:8080
13:53:14:WU02:FS04:Upload 2.41%
13:53:14:WU08:FS02:Upload 8.10%
13:53:14:WU07:FS03:Upload 1.96%
13:53:15:WU09:FS01:Upload 2.08%
13:53:16:WU03:FS01:Upload 3.27%
13:53:16:WU00:FS03:Upload 3.33%
13:53:20:WU08:FS02:Upload 16.20%
13:53:20:WU02:FS04:Upload 5.78%
13:53:20:WU07:FS03:Upload 5.22%
13:53:21:WU09:FS01:Upload 4.17%
13:53:22:WU00:FS03:Upload 6.18%
13:53:22:WU03:FS01:Upload 5.89%
13:53:26:WU07:FS03:Upload 7.17%
13:53:26:WU08:FS02:Upload 24.31%
13:53:26:WU02:FS04:Upload 9.63%
13:53:27:WU09:FS01:Upload 5.42%
13:53:28:WU00:FS03:Upload 9.04%
13:53:30:WU03:FS01:Upload 9.16%
13:53:32:WU02:FS04:Upload 12.52%
13:53:32:WU08:FS02:Upload 30.61%
13:53:33:WU07:FS03:Upload 11.09%
13:53:34:WU00:FS03:Upload 12.84%
13:53:34:WU09:FS01:Upload 7.50%
13:53:37:WU03:FS01:Upload 12.43%
13:53:38:WU08:FS02:Upload 37.81%
13:53:38:WU02:FS04:Upload 16.85%
13:53:40:WU07:FS03:Upload 14.35%
13:53:40:WU09:FS01:Upload 9.17%
13:53:40:WU00:FS03:Upload 16.65%
13:53:43:WU03:FS01:Upload 15.70%
13:53:44:WU08:FS02:Upload 46.81%
13:53:44:WU02:FS04:Upload 20.22%
13:53:46:WU00:FS03:Upload 19.98%
13:53:47:WU07:FS03:Upload 17.61%
13:53:47:WU09:FS01:Upload 11.25%
13:53:50:WU02:FS04:Upload 25.04%
13:53:50:WU03:FS01:Upload 18.31%
13:53:51:WU08:FS02:Upload 57.61%
13:53:52:WU00:FS03:Upload 24.74%
13:53:53:WU07:FS03:Upload 20.22%
13:53:54:WU09:FS01:Upload 12.92%
13:53:56:WU02:FS04:Upload 29.37%
13:53:57:WU03:FS01:Upload 20.93%
13:53:57:WU08:FS02:Upload 64.81%
13:53:58:WU00:FS03:Upload 28.06%
13:53:59:WU07:FS03:Upload 23.48%
13:54:01:WU09:FS01:Upload 14.58%
13:54:02:WU02:FS04:Upload 34.67%
13:54:03:WU03:FS01:Upload 23.54%
13:54:03:WU08:FS02:Upload 73.82%
13:54:04:WU00:FS03:Upload 31.39%
13:54:05:WU07:FS03:Upload 26.74%
13:54:07:WU09:FS01:Upload 16.67%
13:54:08:WU02:FS04:Upload 39.01%
13:54:09:WU08:FS02:Upload 79.22%
13:54:10:WU03:FS01:Upload 26.16%
13:54:11:WU00:FS03:Upload 33.30%
13:54:11:WU07:FS03:Upload 30.00%
13:54:14:WU09:FS01:Upload 18.33%
13:54:14:WU02:FS04:Upload 44.30%
13:54:15:WU08:FS02:Upload 85.52%
13:54:17:WU00:FS03:Upload 37.58%
13:54:17:WU07:FS03:Upload 32.61%
13:54:18:WU03:FS01:Upload 29.43%
13:54:20:WU02:FS04:Upload 49.12%
13:54:21:WU08:FS02:Upload 95.42%
13:54:21:WU09:FS01:Upload 20.42%
13:54:23:WU00:FS03:Upload 42.34%
13:54:23:WU07:FS03:Upload 35.22%
13:54:24:WU03:FS01:Upload 30.74%
13:54:26:WU02:FS04:Upload 53.93%
13:54:28:WU09:FS01:Upload 22.08%
13:54:29:WU07:FS03:Upload 37.83%
13:54:29:WU00:FS03:Upload 45.66%
13:54:29:WU08:FS02:Upload complete
13:54:29:WU08:FS02:Server responded WORK_ACK (400)
13:54:29:WU08:FS02:Final credit estimate, 19014.00 points
13:54:30:WU08:FS02:Cleaning up
13:54:30:WU03:FS01:Upload 32.70%
13:54:30:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
13:54:30:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
13:54:30:WU01:FS02:Connecting to 171.64.65.98:8080
13:54:32:WU02:FS04:Upload 59.23%
13:54:35:WU00:FS03:Upload 50.42%
13:54:35:WU07:FS03:Upload 39.78%
13:54:35:WU09:FS01:Upload 24.17%
13:54:36:WU03:FS01:Upload 35.97%
13:54:36:WU01:FS02:Upload 2.09%
13:54:38:WU02:FS04:Upload 63.08%
13:54:41:WU00:FS03:Upload 53.75%
13:54:41:WU07:FS03:Upload 43.04%
13:54:41:WU09:FS01:Upload 26.25%
13:54:42:WU01:FS02:Upload 3.75%
13:54:42:WU03:FS01:Upload 39.24%
13:54:44:WU02:FS04:Upload 66.45%
13:54:47:WU00:FS03:Upload 55.65%
13:54:47:WU09:FS01:Upload 27.92%
13:54:48:WU07:FS03:Upload 46.30%
13:54:48:WU01:FS02:Upload 5.84%
13:54:49:WU03:FS01:Upload 42.51%
13:54:50:WU02:FS04:Upload 70.79%
13:54:54:WU09:FS01:Upload 30.00%
13:54:54:WU07:FS03:Upload 48.91%
13:54:54:WU00:FS03:Upload 58.98%
13:54:55:WU01:FS02:Upload 7.09%
13:54:55:WU03:FS01:Upload 45.78%
13:54:56:WU02:FS04:Upload 75.60%
13:55:00:WU09:FS01:Upload 31.67%
13:55:00:WU00:FS03:Upload 62.31%
13:55:01:WU03:FS01:Upload 48.40%
13:55:01:WU07:FS03:Upload 52.17%
13:55:02:WU01:FS02:Upload 8.76%
13:55:02:WU02:FS04:Upload 78.97%
13:55:06:WU00:FS03:Upload 66.12%
13:55:07:WU09:FS01:Upload 33.33%
13:55:07:WU07:FS03:Upload 55.43%
13:55:07:WU03:FS01:Upload 51.67%
13:55:08:WU02:FS04:Upload 82.83%
13:55:09:WU01:FS02:Upload 10.84%
13:55:13:WU07:FS03:Upload 58.04%
13:55:13:WU09:FS01:Upload 35.00%
13:55:13:WU03:FS01:Upload 54.28%
13:55:14:WU02:FS04:Upload 87.64%
13:55:15:WU01:FS02:Upload 12.93%
13:55:17:WU00:FS03:Upload 68.50%
13:55:19:WU03:FS01:Upload 56.90%
13:55:20:WU07:FS03:Upload 61.96%
13:55:20:WU09:FS01:Upload 37.08%
13:55:21:WU02:FS04:Upload 91.98%
13:55:21:WU01:FS02:Upload 14.60%
13:55:23:WU00:FS03:Upload 70.88%
13:55:25:WU03:FS01:Upload 59.51%
13:55:26:WU07:FS03:Upload 64.56%
13:55:27:WU02:FS04:Upload 95.83%
13:55:28:WU01:FS02:Upload 16.27%
13:55:28:WU09:FS01:Upload 38.75%
13:55:29:WU00:FS03:Upload 73.73%
13:55:31:WU03:FS01:Upload 62.78%
13:55:32:WU07:FS03:Upload 67.83%
13:55:33:WU02:FS04:Upload 99.20%
13:55:34:WU09:FS01:Upload 40.00%
13:55:35:WU00:FS03:Upload 76.58%
13:55:35:WU01:FS02:Upload 17.94%
13:55:37:WU03:FS01:Upload 66.05%
13:55:39:WU07:FS03:Upload 71.09%
13:55:41:WU00:FS03:Upload 79.44%
13:55:41:WU01:FS02:Upload 20.02%
13:55:41:WU09:FS01:Upload 42.08%
13:55:43:WU03:FS01:Upload 69.32%
13:55:44:WU02:FS04:Upload complete
13:55:44:WU02:FS04:Server responded WORK_ACK (400)
13:55:44:WU02:FS04:Final credit estimate, 30384.00 points
13:55:44:WU02:FS04:Cleaning up
13:55:44:WU05:FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:9704 run:0 clone:7 gen:385 core:0x21 unit:0x000001c5ab404162551ce8cc21e57cf1
13:55:44:WU05:FS01:Uploading 14.98MiB to 171.64.65.98
13:55:44:WU05:FS01:Connecting to 171.64.65.98:8080
13:55:45:WU07:FS03:Upload 74.35%
13:55:47:WU00:FS03:Upload 82.77%
13:55:47:WU09:FS01:Upload 43.75%
13:55:48:WU01:FS02:Upload 21.69%
13:55:50:WU03:FS01:Upload 72.59%
13:55:50:WU05:FS01:Upload 1.67%
13:55:52:WU07:FS03:Upload 77.61%
13:55:53:WU00:FS03:Upload 85.62%
13:55:54:WU09:FS01:Upload 45.42%
13:55:54:WU01:FS02:Upload 23.77%
13:55:57:WU03:FS01:Upload 75.86%
13:55:57:WU05:FS01:Upload 3.76%
13:55:58:WU07:FS03:Upload 80.22%
13:55:59:WU00:FS03:Upload 88.95%
13:56:01:WU01:FS02:Upload 25.44%
13:56:01:WU09:FS01:Upload 47.08%
13:56:03:WU05:FS01:Upload 5.84%
13:56:04:WU03:FS01:Upload 79.13%
13:56:04:WU07:FS03:Upload 83.48%
13:56:05:WU00:FS03:Upload 91.81%
13:56:07:WU01:FS02:Upload 27.11%
13:56:07:WU09:FS01:Upload 48.33%
13:56:09:WU05:FS01:Upload 7.93%
13:56:10:WU03:FS01:Upload 81.75%
13:56:11:WU00:FS03:Upload 94.66%
13:56:13:WU01:FS02:Upload 29.20%
13:56:15:WU09:FS01:Upload 50.00%
13:56:16:WU07:FS03:Upload 85.43%
13:56:16:WU03:FS01:Upload 84.37%
13:56:17:WU00:FS03:Upload 99.42%
13:56:18:WU05:FS01:Upload 10.02%
13:56:20:WU01:FS02:Upload 31.28%
13:56:22:WU07:FS03:Upload 88.04%
13:56:22:WU09:FS01:Upload 52.08%
13:56:23:WU03:FS01:Upload 86.98%
13:56:25:WU05:FS01:Upload 12.10%
13:56:26:WU01:FS02:Upload 33.37%
13:56:27:WU00:FS03:Upload complete
13:56:27:WU00:FS03:Server responded WORK_ACK (400)
13:56:27:WU00:FS03:Final credit estimate, 58500.00 points
13:56:27:WU00:FS03:Cleaning up
13:56:27:WU04:FS04:Starting
13:56:27:WU04:FS04:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 04 -suffix 01 -version 704 -lifeline 3328 -checkpoint 15 -gpu 3 -gpu-vendor ati
13:56:28:WU04:FS04:Started FahCore on PID 1708
13:56:28:WU07:FS03:Upload 91.30%
13:56:28:WU09:FS01:Upload 53.33%
13:56:29:WU04:FS04:Core PID:2592
13:56:29:WU04:FS04:FahCore 0x17 started
13:56:29:WU03:FS01:Upload 88.94%
13:56:29:WU12:FS02:Starting
13:56:29:WU12:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 12 -suffix 01 -version 704 -lifeline 3328 -checkpoint 15 -gpu 1 -gpu-vendor ati
13:56:29:WU12:FS02:Started FahCore on PID 2004
13:56:30:WU12:FS02:Core PID:3404
13:56:30:WU12:FS02:FahCore 0x21 started
13:56:30:WU06:FS02:Sending unit results: id:06 state:SEND error:NO_ERROR project:10466 run:0 clone:204 gen:258 core:0x17 unit:0x000001c9538b3db953822ec8a1b6f38b
13:56:30:WU04:FS04:0x17:*********************** Log Started 2015-09-06T13:56:30Z ***********************
13:56:30:WU04:FS04:0x17:Project: 10467 (Run 0, Clone 201, Gen 188)
13:56:30:WU04:FS04:0x17:Unit: 0x00000145538b3db9538bbeda698c08eb
13:56:30:WU04:FS04:0x17:CPU: 0x00000000000000000000000000000000
13:56:30:WU04:FS04:0x17:Machine: 4
13:56:30:WU04:FS04:0x17:Digital signatures verified
13:56:30:WU04:FS04:0x17:[email protected] GPU core17
13:56:30:WU04:FS04:0x17:Version 0.0.52
13:56:30:WU06:FS02:Uploading 6.89MiB to 140.163.4.233
13:56:30:WU06:FS02:Connecting to 140.163.4.233:8080
13:56:30:WU12:FS02:0x21:*********************** Log Started 2015-09-06T13:56:30Z ***********************
13:56:30:WU12:FS02:0x21:Project: 9704 (Run 13, Clone 16, Gen 28)
13:56:30:WU12:FS02:0x21:Unit: 0x00000026ab404162553ebdb88e7bbcd2
13:56:30:WU12:FS02:0x21:CPU: 0x00000000000000000000000000000000
13:56:30:WU12:FS02:0x21:Machine: 2
13:56:30:WU12:FS02:0x21:Digital signatures verified
13:56:30:WU12:FS02:0x21:[email protected] GPU Core21 [email protected] Core
13:56:30:WU12:FS02:0x21:Version 0.0.11
13:56:31:WU04:FS04:0x17:  Found a checkpoint file
13:56:31:WU05:FS01:Upload 14.19%
13:56:32:WU01:FS02:Upload 35.04%
13:56:34:WU09:FS01:Upload 55.00%
13:56:35:WU07:FS03:Upload 94.56%
13:56:35:WU12:FS02:0x21:  Found a checkpoint file
13:56:35:WU03:FS01:Upload 91.56%
13:56:36:WU06:FS02:Upload 6.35%
13:56:38:WU05:FS01:Upload 15.86%
13:56:39:WU01:FS02:Upload 37.12%
13:56:40:WU09:FS01:Upload 56.67%
13:56:41:WU07:FS03:Upload 97.17%
13:56:42:WU03:FS01:Upload 94.18%
13:56:42:WU06:FS02:Upload 13.60%
13:56:45:WU05:FS01:Upload 18.36%
13:56:45:WU01:FS02:Upload 38.79%
13:56:46:WU09:FS01:Upload 58.33%
13:56:47:WU07:FS03:Upload 100.00%
13:56:48:WU06:FS02:Upload 19.04%
13:56:48:WU03:FS01:Upload 96.79%
13:56:51:WU01:FS02:Upload 40.46%
13:56:53:WU05:FS01:Upload 20.45%
13:56:53:WU09:FS01:Upload 60.00%
13:56:54:WU06:FS02:Upload 26.29%
13:56:54:WU03:FS01:Upload 99.41%
13:56:57:WU01:FS02:Upload 42.13%
13:56:59:WU09:FS01:Upload 61.67%
13:57:00:WU06:FS02:Upload 33.54%
13:57:00:WU05:FS01:Upload 22.12%
13:57:02:WU07:FS03:Upload complete
13:57:02:WU07:FS03:Server responded WORK_ACK (400)
13:57:02:WU07:FS03:Final credit estimate, 13851.00 points
13:57:02:WU07:FS03:Cleaning up
13:57:02:WU10:FS03:Starting
13:57:02:WU10:FS03:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 10 -suffix 01 -version 704 -lifeline 3328 -checkpoint 15 -gpu 2 -gpu-vendor ati
13:57:02:WU10:FS03:Started FahCore on PID 896
13:57:02:WU10:FS03:Core PID:2956
13:57:02:WU10:FS03:FahCore 0x21 started
13:57:02:WU11:FS01:Starting
13:57:02:WU11:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 11 -suffix 01 -version 704 -lifeline 3328 -checkpoint 15 -gpu 0 -gpu-vendor ati
13:57:02:WU11:FS01:Started FahCore on PID 2124
13:57:02:WU11:FS01:Core PID:1504
13:57:02:WU11:FS01:FahCore 0x21 started
13:57:03:WU11:FS01:0x21:*********************** Log Started 2015-09-06T13:57:02Z ***********************
13:57:03:WU11:FS01:0x21:Project: 9704 (Run 27, Clone 13, Gen 22)
13:57:03:WU11:FS01:0x21:Unit: 0x0000002bab404162553ebff877153c5c
13:57:03:WU11:FS01:0x21:CPU: 0x00000000000000000000000000000000
13:57:03:WU11:FS01:0x21:Machine: 1
13:57:03:WU11:FS01:0x21:Digital signatures verified
13:57:03:WU11:FS01:0x21:[email protected] GPU Core21 [email protected] Core
13:57:03:WU11:FS01:0x21:Version 0.0.11
13:57:03:WU10:FS03:0x21:*********************** Log Started 2015-09-06T13:57:03Z ***********************
13:57:03:WU10:FS03:0x21:Project: 9712 (Run 2, Clone 12, Gen 35)
13:57:03:WU10:FS03:0x21:Unit: 0x00000047ab40416255b9a67e56d95f47
13:57:03:WU10:FS03:0x21:CPU: 0x00000000000000000000000000000000
13:57:03:WU10:FS03:0x21:Machine: 3
13:57:03:WU10:FS03:0x21:Digital signatures verified
13:57:03:WU10:FS03:0x21:[email protected] GPU Core21 [email protected] Core
13:57:03:WU10:FS03:0x21:Version 0.0.11
13:57:03:WU01:FS02:Upload 43.80%
13:57:04:WU11:FS01:0x21:  Found a checkpoint file
13:57:05:WU10:FS03:0x21:  Found a checkpoint file
13:57:06:WU05:FS01:Upload 23.79%
13:57:06:WU06:FS02:Upload 38.98%
13:57:07:WU09:FS01:Upload 63.75%
13:57:09:WU01:FS02:Upload 45.05%
13:57:12:WU06:FS02:Upload 43.52%
13:57:13:WU05:FS01:Upload 25.88%
13:57:14:WU09:FS01:Upload 65.00%
13:57:15:WU01:FS02:Upload 46.71%
13:57:16:WU03:FS01:Upload complete
13:57:16:WU03:FS01:Server responded WORK_ACK (400)
13:57:16:WU03:FS01:Final credit estimate, 17264.00 points
13:57:16:WU03:FS01:Cleaning up
13:57:18:WU06:FS02:Upload 51.67%
13:57:20:WU05:FS01:Upload 27.96%
13:57:20:WU09:FS01:Upload 66.25%
13:57:22:WU01:FS02:Upload 48.80%
13:57:24:WU06:FS02:Upload 60.74%
13:57:26:WU05:FS01:Upload 30.05%
13:57:27:WU09:FS01:Upload 68.33%
13:57:29:WU01:FS02:Upload 50.89%
13:57:33:WU09:FS01:Upload 69.58%
13:57:33:WU05:FS01:Upload 32.55%
13:57:35:WU01:FS02:Upload 52.14%
13:57:36:WU06:FS02:Upload 65.27%
13:57:39:WU05:FS01:Upload 34.22%
13:57:40:WU09:FS01:Upload 71.25%
13:57:41:WU01:FS02:Upload 54.22%
13:57:42:WU06:FS02:Upload 70.71%
13:57:45:WU05:FS01:Upload 35.48%
13:57:46:WU09:FS01:Upload 72.92%
13:57:48:WU06:FS02:Upload 77.06%
13:57:49:WU01:FS02:Upload 55.89%
13:57:51:WU05:FS01:Upload 37.56%
13:57:53:WU09:FS01:Upload 75.00%
13:57:54:WU06:FS02:Upload 82.50%
13:57:55:WU01:FS02:Upload 57.14%
13:57:58:WU05:FS01:Upload 39.65%
13:57:59:WU09:FS01:Upload 76.67%
13:58:00:WU06:FS02:Upload 88.84%
13:58:02:WU01:FS02:Upload 58.81%
13:58:05:WU05:FS01:Upload 41.74%
13:58:05:WU09:FS01:Upload 77.92%
13:58:06:WU06:FS02:Upload 98.82%
13:58:08:WU01:FS02:Upload 60.48%
13:58:11:WU09:FS01:Upload 79.17%
13:58:11:WU05:FS01:Upload 43.40%
13:58:12:WU06:FS02:Upload complete
13:58:12:WU06:FS02:Server responded WORK_ACK (400)
13:58:12:WU06:FS02:Final credit estimate, 30987.00 points
13:58:12:WU06:FS02:Cleaning up
13:58:15:WU01:FS02:Upload 61.73%
13:58:17:WU05:FS01:Upload 45.07%
13:58:18:WU09:FS01:Upload 81.25%
13:58:21:WU01:FS02:Upload 62.98%
13:58:23:WU05:FS01:Upload 46.33%
13:58:24:WU09:FS01:Upload 83.33%
13:58:28:WU01:FS02:Upload 64.65%
13:58:30:WU05:FS01:Upload 48.00%
13:58:31:WU09:FS01:Upload 85.00%
13:58:34:WU01:FS02:Upload 66.32%
13:58:37:WU05:FS01:Upload 50.50%
13:58:37:WU09:FS01:Upload 86.25%
13:58:41:WU01:FS02:Upload 68.40%
13:58:43:WU05:FS01:Upload 52.17%
13:58:43:WU09:FS01:Upload 88.33%
13:58:47:WU01:FS02:Upload 70.49%
13:58:49:WU05:FS01:Upload 53.84%
13:58:50:WU09:FS01:Upload 90.42%
13:58:53:WU01:FS02:Upload 72.16%
13:58:55:WU05:FS01:Upload 55.51%
13:58:57:WU09:FS01:Upload 91.67%
13:58:59:WU04:FS04:0x17:Completed 4875000 out of 5000000 steps (97%)
13:59:00:WU01:FS02:Upload 73.41%
13:59:00:WU04:FS04:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
13:59:02:WU05:FS01:Upload 57.18%
13:59:04:WU09:FS01:Upload 93.75%
13:59:07:WU01:FS02:Upload 75.08%
13:59:08:WU05:FS01:Upload 58.85%
13:59:10:WU09:FS01:Upload 95.42%
13:59:14:WU01:FS02:Upload 76.75%
13:59:15:WU10:FS03:0x21:Completed 880000 out of 1280000 steps (68%)
13:59:15:WU10:FS03:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
13:59:15:WU05:FS01:Upload 60.52%
13:59:17:WU09:FS01:Upload 97.50%
13:59:21:WU05:FS01:Upload 61.77%
13:59:21:WU01:FS02:Upload 78.41%
13:59:23:WU09:FS01:Upload 99.58%
13:59:27:WU05:FS01:Upload 63.86%
13:59:28:WU01:FS02:Upload 80.08%
13:59:35:WU01:FS02:Upload 82.17%
13:59:37:WU05:FS01:Upload 65.94%
13:59:41:WU01:FS02:Upload 83.84%
13:59:43:WU05:FS01:Upload 67.19%
13:59:49:WU05:FS01:Upload 69.28%
13:59:51:WU01:FS02:Upload 85.50%
13:59:56:WU05:FS01:Upload 70.95%
13:59:57:WU01:FS02:Upload 87.17%
13:59:57:WU09:FS01:Upload complete
13:59:57:WU09:FS01:Server responded WORK_ACK (400)
13:59:57:WU09:FS01:Final credit estimate, 20191.00 points
13:59:57:WU09:FS01:Cleaning up
14:00:03:WU05:FS01:Upload 73.04%
14:00:03:WU01:FS02:Upload 89.26%
14:00:09:WU05:FS01:Upload 74.71%
14:00:09:WU01:FS02:Upload 90.51%
14:00:15:WU05:FS01:Upload 76.79%
14:00:16:WU01:FS02:Upload 91.76%
14:00:22:WU01:FS02:Upload 93.01%
14:00:22:WU05:FS01:Upload 78.88%
14:00:25:WU12:FS02:0x21:Completed 80000 out of 640000 steps (12%)
14:00:25:WU12:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
14:00:29:WU01:FS02:Upload 95.10%
14:00:29:WU05:FS01:Upload 80.97%
14:00:35:WU05:FS01:Upload 82.64%
14:00:36:WU01:FS02:Upload 96.35%
14:00:42:WU05:FS01:Upload 83.89%
14:00:43:WU01:FS02:Upload 98.02%
14:00:49:WU01:FS02:Upload 100.00%
14:00:49:WU11:FS01:0x21:Completed 160000 out of 640000 steps (25%)
14:00:49:WU11:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
14:00:49:WU05:FS01:Upload 85.56%
14:00:55:WU05:FS01:Upload 86.81%
14:01:02:WU05:FS01:Upload 88.48%
14:01:02:WU10:FS03:0x21:Completed 883200 out of 1280000 steps (69%)
14:01:08:WU05:FS01:Upload 90.15%
14:01:14:WU05:FS01:Upload 91.40%
14:01:20:WU01:FS02:Upload complete
14:01:20:WU01:FS02:Server responded WORK_ACK (400)
14:01:20:WU01:FS02:Final credit estimate, 24444.00 points
14:01:20:WU05:FS01:Upload 93.07%
14:01:20:WU01:FS02:Cleaning up
14:01:26:WU05:FS01:Upload 94.32%
14:01:32:WU05:FS01:Upload 95.99%
14:01:38:WU05:FS01:Upload 98.08%
14:01:44:WU05:FS01:Upload 99.75%
14:02:16:WU05:FS01:Upload complete
14:02:17:WU05:FS01:Server responded WORK_ACK (400)
14:02:17:WU05:FS01:Final credit estimate, 31821.00 points
14:02:17:WU05:FS01:Cleaning up
14:02:28:WU12:FS02:0x21:Completed 83200 out of 640000 steps (13%)
14:03:06:WU04:FS04:0x17:Completed 4900000 out of 5000000 steps (98%)
14:03:45:WU10:FS03:0x21:Completed 896000 out of 1280000 steps (70%)
14:04:28:WU11:FS01:0x21:Completed 166400 out of 640000 steps (26%)

Anyway, it looks like it is currently uploading, but I still can't VNC to it, or get HFM to monitor it. But I can see it on the network and interact with it.

Any idea what might be wrong and how to fix it.

Edit, here is the log that had the failed uploads:

Code:
*********************** Log Started 2015-09-05T23:17:25Z ***********************
23:17:25:************************* [email protected] Client *************************
23:17:25:      Website: http://folding.stanford.edu/
23:17:25:    Copyright: (c) 2009-2014 Stanford University
23:17:25:       Author: Joseph Coffland <[email protected]>
23:17:25:         Args: --open-web-control
23:17:25:       Config: C:/Users/torin/AppData/Roaming/FAHClient/config.xml
23:17:25:******************************** Build ********************************
23:17:25:      Version: 7.4.4
23:17:25:         Date: Mar 4 2014
23:17:25:         Time: 20:26:54
23:17:25:      SVN Rev: 4130
23:17:25:       Branch: fah/trunk/client
23:17:25:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
23:17:25:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
23:17:25:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
23:17:25:     Platform: win32 XP
23:17:25:         Bits: 32
23:17:25:         Mode: Release
23:17:25:******************************* System ********************************
23:17:25:          CPU: Intel(R) Pentium(R) CPU G3250 @ 3.20GHz
23:17:25:       CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
23:17:25:         CPUs: 2
23:17:25:       Memory: 7.95GiB
23:17:25:  Free Memory: 6.90GiB
23:17:25:      Threads: WINDOWS_THREADS
23:17:25:   OS Version: 6.1
23:17:25:  Has Battery: false
23:17:25:   On Battery: false
23:17:25:   UTC Offset: -4
23:17:25:          PID: 3616
23:17:25:          CWD: C:/Users/torin/AppData/Roaming/FAHClient
23:17:25:           OS: Windows 7 Professional
23:17:25:      OS Arch: AMD64
23:17:25:         GPUs: 4
23:17:25:        GPU 0: ATI:5 Tahiti XT [Radeon HD 7970]
23:17:25:        GPU 1: ATI:5 Tahiti XT [Radeon HD 7970]
23:17:25:        GPU 2: ATI:5 Tahiti XT [Radeon HD 7970]
23:17:25:        GPU 3: ATI:5 Tahiti XT [Radeon HD 7970]
23:17:25:         CUDA: Not detected
23:17:25:Win32 Service: false
23:17:25:***********************************************************************
23:17:26:<config>
23:17:26:  <!-- HTTP Server -->
23:17:26:  <allow v='127.0.0.1,192.168.0.0/24'/>
23:17:26:
23:17:26:  <!-- Network -->
23:17:26:  <proxy v=':8080'/>
23:17:26:
23:17:26:  <!-- Remote Command Server -->
23:17:26:  <command-allow-no-pass v='127.0.0.1,192.168.0.0/24'/>
23:17:26:  <password v='****'/>
23:17:26:
23:17:26:  <!-- Slot Control -->
23:17:26:  <power v='full'/>
23:17:26:
23:17:26:  <!-- User Information -->
23:17:26:  <passkey v='********************************'/>
23:17:26:  <team v='32'/>
23:17:26:  <user v='Torin3'/>
23:17:26:
23:17:26:  <!-- Folding Slots -->
23:17:26:  <slot id='1' type='GPU'/>
23:17:26:  <slot id='2' type='GPU'/>
23:17:26:  <slot id='3' type='GPU'/>
23:17:26:  <slot id='4' type='GPU'/>
23:17:26:</config>
23:17:26:Trying to access database...
23:17:26:Successfully acquired database lock
23:17:26:Enabled folding slot 01: READY gpu:0:Tahiti XT [Radeon HD 7970]
23:17:26:Enabled folding slot 02: READY gpu:1:Tahiti XT [Radeon HD 7970]
23:17:26:Enabled folding slot 03: READY gpu:2:Tahiti XT [Radeon HD 7970]
23:17:26:Enabled folding slot 04: READY gpu:3:Tahiti XT [Radeon HD 7970]
23:17:26:WU02:FS04:Starting
23:17:26:WU02:FS04:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 3616 -checkpoint 15 -gpu 3 -gpu-vendor ati
23:17:27:WU02:FS04:Started FahCore on PID 3804
23:17:29:WU02:FS04:Core PID:3984
23:17:29:WU02:FS04:FahCore 0x17 started
23:17:30:WU06:FS02:Sending unit results: id:06 state:SEND error:NO_ERROR project:9712 run:1 clone:29 gen:68 core:0x21 unit:0x0000008eab40416255b9a667d5b32662
23:17:30:WU06:FS02:Uploading 9.52MiB to 171.64.65.98
23:17:30:WU06:FS02:Connecting to 171.64.65.98:8080
23:17:30:WU05:FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:9704 run:64 clone:3 gen:9 core:0x21 unit:0x0000000dab404162553ec5ab6dbee110
23:17:30:WU05:FS01:Uploading 14.98MiB to 171.64.65.98
23:17:30:WU05:FS01:Connecting to 171.64.65.98:8080
23:17:30:WU01:FS03:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:55 clone:10 gen:10 core:0x21 unit:0x0000000eab404162553ec4564ea3728b
23:17:30:WU01:FS03:Uploading 14.98MiB to 171.64.65.98
23:17:30:WU08:FS02:Starting
23:17:30:WU01:FS03:Connecting to 171.64.65.98:8080
23:17:30:WU08:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 08 -suffix 01 -version 704 -lifeline 3616 -checkpoint 15 -gpu 1 -gpu-vendor ati
23:17:30:WU08:FS02:Started FahCore on PID 4000
23:17:30:WU08:FS02:Core PID:4012
23:17:30:WU08:FS02:FahCore 0x17 started
23:17:30:WU09:FS01:Starting
23:17:30:WU09:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 09 -suffix 01 -version 704 -lifeline 3616 -checkpoint 15 -gpu 0 -gpu-vendor ati
23:17:30:WU09:FS01:Started FahCore on PID 4024
23:17:30:WU02:FS04:0x17:*********************** Log Started 2015-09-05T23:17:30Z ***********************
23:17:30:WU02:FS04:0x17:Project: 10467 (Run 0, Clone 24, Gen 203)
23:17:30:WU02:FS04:0x17:Unit: 0x00000152538b3db95388cebbdadf69a0
23:17:30:WU02:FS04:0x17:CPU: 0x00000000000000000000000000000000
23:17:30:WU02:FS04:0x17:Machine: 4
23:17:30:WU02:FS04:0x17:Digital signatures verified
23:17:30:WU02:FS04:0x17:[email protected] GPU core17
23:17:30:WU02:FS04:0x17:Version 0.0.52
23:17:31:WU09:FS01:Core PID:4044
23:17:31:WU09:FS01:FahCore 0x21 started
23:17:31:WU08:FS02:0x17:*********************** Log Started 2015-09-05T23:17:30Z ***********************
23:17:31:WU08:FS02:0x17:Project: 10466 (Run 0, Clone 130, Gen 304)
23:17:31:WU08:FS02:0x17:Unit: 0x000001ea538b3db953822dd19ee321bb
23:17:31:WU08:FS02:0x17:CPU: 0x00000000000000000000000000000000
23:17:31:WU08:FS02:0x17:Machine: 2
23:17:31:WU08:FS02:0x17:Digital signatures verified
23:17:31:WU08:FS02:0x17:[email protected] GPU core17
23:17:31:WU08:FS02:0x17:Version 0.0.52
23:17:31:WU07:FS03:Starting
23:17:31:WU07:FS03:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 07 -suffix 01 -version 704 -lifeline 3616 -checkpoint 15 -gpu 2 -gpu-vendor ati
23:17:31:WU07:FS03:Started FahCore on PID 4056
23:17:31:WU07:FS03:Core PID:4068
23:17:31:WU07:FS03:FahCore 0x21 started
23:17:31:WU09:FS01:0x21:*********************** Log Started 2015-09-05T23:17:31Z ***********************
23:17:31:WU09:FS01:0x21:Project: 9704 (Run 21, Clone 8, Gen 20)
23:17:31:WU09:FS01:0x21:Unit: 0x0000001dab404162553ebeff138ed196
23:17:31:WU09:FS01:0x21:CPU: 0x00000000000000000000000000000000
23:17:31:WU09:FS01:0x21:Machine: 1
23:17:31:WU09:FS01:0x21:Digital signatures verified
23:17:31:WU09:FS01:0x21:[email protected] GPU Core21 [email protected] Core
23:17:31:WU09:FS01:0x21:Version 0.0.11
23:17:32:WU08:FS02:0x17:  Found a checkpoint file
23:17:32:WU02:FS04:0x17:  Found a checkpoint file
23:17:32:WU07:FS03:0x21:*********************** Log Started 2015-09-05T23:17:31Z ***********************
23:17:32:WU07:FS03:0x21:Project: 9712 (Run 58, Clone 30, Gen 22)
23:17:32:WU07:FS03:0x21:Unit: 0x00000060ab40416255b9af1c5e0c6130
23:17:32:WU07:FS03:0x21:CPU: 0x00000000000000000000000000000000
23:17:32:WU07:FS03:0x21:Machine: 3
23:17:32:WU07:FS03:0x21:Digital signatures verified
23:17:32:WU07:FS03:0x21:[email protected] GPU Core21 [email protected] Core
23:17:32:WU07:FS03:0x21:Version 0.0.11
23:17:36:WU01:FS03:Upload 2.09%
23:17:36:WU05:FS01:Upload 2.09%
23:17:37:WU06:FS02:Upload 3.94%
23:17:42:WU05:FS01:Upload 4.17%
23:17:42:WU01:FS03:Upload 4.59%
23:17:43:WU09:FS01:0x21:  Found a checkpoint file
23:17:43:WU07:FS03:0x21:  Found a checkpoint file
23:17:43:WU06:FS02:Upload 7.22%
23:17:48:WU05:FS01:Upload 6.67%
23:17:48:WU01:FS03:Upload 7.09%
23:17:50:WU06:FS02:Upload 11.16%
23:17:54:WU01:FS03:Upload 9.18%
23:17:54:WU05:FS01:Upload 8.76%
23:17:57:WU06:FS02:Upload 14.45%
23:18:00:WU01:FS03:Upload 11.27%
23:18:01:WU05:FS01:Upload 11.26%
23:18:03:WU06:FS02:Upload 17.73%
23:18:07:WU05:FS01:Upload 12.93%
23:18:07:WU01:FS03:Upload 12.10%
23:18:09:WU06:FS02:Upload 21.01%
23:18:13:WU05:FS01:Upload 14.60%
23:18:14:WU01:FS03:Upload 13.77%
23:18:15:WU06:FS02:Upload 24.30%
23:18:19:WU05:FS01:Upload 17.10%
23:18:21:WU01:FS03:Upload 16.28%
23:18:22:WU06:FS02:Upload 27.58%
23:18:25:WU05:FS01:Upload 19.61%
23:18:28:WU06:FS02:Upload 31.52%
23:18:28:WU01:FS03:Upload 18.36%
23:18:31:WU05:FS01:Upload 21.69%
23:18:34:WU01:FS03:Upload 20.45%
23:18:34:WU06:FS02:Upload 34.80%
23:18:37:WU05:FS01:Upload 23.78%
23:18:40:WU01:FS03:Upload 22.53%
23:18:40:WU06:FS02:Upload 38.09%
23:18:42:WU08:FS02:0x17:Completed 2875000 out of 5000000 steps (57%)
23:18:42:WU08:FS02:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
23:18:43:WU05:FS01:Upload 25.86%
23:18:46:WU06:FS02:Upload 41.37%
23:18:46:WU01:FS03:Upload 24.62%
23:18:49:WU05:FS01:Upload 27.95%
23:18:52:WU06:FS02:Upload 44.65%
23:18:53:WU01:FS03:Upload 26.71%
23:18:55:WU05:FS01:Upload 30.03%
23:18:58:WU06:FS02:Upload 47.94%
23:19:00:WU01:FS03:Upload 28.79%
23:19:01:WU05:FS01:Upload 32.12%
23:19:04:WU06:FS02:Upload 51.22%
23:19:07:WU01:FS03:Upload 30.88%
23:19:07:WU05:FS01:Upload 34.21%
23:19:11:WU06:FS02:Upload 55.16%
23:19:13:WU05:FS01:Upload 35.87%
23:19:13:WU01:FS03:Upload 33.38%
23:19:17:WU06:FS02:Upload 58.44%
23:19:19:WU05:FS01:Upload 38.38%
23:19:19:WU01:FS03:Upload 35.47%
23:19:23:WU06:FS02:Upload 61.72%
23:19:25:WU01:FS03:Upload 37.14%
23:19:27:WU05:FS01:Upload 39.63%
23:19:29:WU06:FS02:Upload 65.66%
23:19:31:WU01:FS03:Upload 38.81%
23:19:33:WU05:FS01:Upload 41.30%
23:19:36:WU06:FS02:Upload 69.60%
23:19:38:WU01:FS03:Upload 40.06%
23:19:39:WU05:FS01:Upload 42.96%
23:19:42:WU06:FS02:Upload 72.89%
23:19:45:WU01:FS03:Upload 42.57%
23:19:45:WU05:FS01:Upload 45.47%
23:19:46:WU07:FS03:0x21:Completed 960000 out of 1280000 steps (75%)
23:19:46:WU07:FS03:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
23:19:48:WU06:FS02:Upload 75.51%
23:19:51:WU01:FS03:Upload 44.23%
23:19:51:WU05:FS01:Upload 47.55%
23:19:54:WU06:FS02:Upload 78.80%
23:19:57:WU01:FS03:Upload 46.32%
23:19:57:WU05:FS01:Upload 49.22%
23:20:00:WU06:FS02:Upload 82.74%
23:20:03:WU01:FS03:Upload 48.83%
23:20:03:WU05:FS01:Upload 51.31%
23:20:06:WU06:FS02:Upload 86.02%
23:20:09:WU01:FS03:Upload 51.33%
23:20:09:WU05:FS01:Upload 52.98%
23:20:12:WU06:FS02:Upload 89.96%
23:20:14:WU02:FS04:0x17:Completed 3000000 out of 5000000 steps (60%)
23:20:14:WU02:FS04:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
23:20:15:WU05:FS01:Upload 55.06%
23:20:15:WU01:FS03:Upload 53.83%
23:20:19:WU06:FS02:Upload 93.90%
23:20:22:WU05:FS01:Upload 57.98%
23:20:22:WU01:FS03:Upload 56.34%
23:20:25:WU06:FS02:Upload 97.84%
23:20:28:WU05:FS01:Upload 60.48%
23:20:28:WU01:FS03:Upload 58.42%
23:20:30:WU06:FS02:Upload complete
23:20:30:WU06:FS02:Server responded GOT_ALREADY (434)
23:20:30:WARNING:WU06:FS02:Server did not like results, dumping
23:20:30:WU06:FS02:Cleaning up
23:20:34:WU01:FS03:Upload 60.09%
23:20:35:WU05:FS01:Upload 62.99%
23:20:41:WU01:FS03:Upload 62.18%
23:20:42:WU05:FS01:Upload 65.07%
23:20:47:WU01:FS03:Upload 64.68%
23:20:48:WU05:FS01:Upload 67.16%
23:20:54:WU05:FS01:Upload 69.24%
23:20:54:WU01:FS03:Upload 66.35%
23:21:00:WU05:FS01:Upload 70.91%
23:21:01:WU01:FS03:Upload 68.44%
23:21:06:WU05:FS01:Upload 73.42%
23:21:07:WU01:FS03:Upload 70.53%
23:21:11:WU09:FS01:0x21:Completed 320000 out of 640000 steps (50%)
23:21:11:WU09:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
23:21:13:WU05:FS01:Upload 75.08%
23:21:13:WU01:FS03:Upload 73.03%
23:21:19:WU05:FS01:Upload 77.59%
23:21:19:WU01:FS03:Upload 75.53%
23:21:25:WU01:FS03:Upload 78.04%
23:21:25:WU05:FS01:Upload 79.67%
23:21:31:WU01:FS03:Upload 79.71%
23:21:32:WU05:FS01:Upload 81.76%
23:21:36:WU08:FS02:0x17:Completed 2900000 out of 5000000 steps (58%)
23:21:38:WU01:FS03:Upload 81.79%
23:21:39:WU05:FS01:Upload 84.26%
23:21:44:WU01:FS03:Upload 83.88%
23:21:47:WU05:FS01:Upload 86.35%
23:21:50:WU01:FS03:Upload 85.55%
23:21:53:WU05:FS01:Upload 88.43%
23:21:56:WU01:FS03:Upload 87.63%
23:21:59:WU05:FS01:Upload 90.94%
23:22:02:WU01:FS03:Upload 89.30%
23:22:05:WU05:FS01:Upload 93.02%
23:22:08:WU01:FS03:Upload 91.81%
23:22:11:WU05:FS01:Upload 94.69%
23:22:14:WU01:FS03:Upload 94.31%
23:22:17:WU05:FS01:Upload 96.78%
23:22:20:WU01:FS03:Upload 95.98%
23:22:23:WU05:FS01:Upload 98.86%
23:22:26:WU01:FS03:Upload 97.65%
23:22:33:WU01:FS03:Upload 98.90%
23:22:51:WARNING:WU01:FS03:Exception: Failed to send results to work server: 10001: Server responded: HTTP_INTERNAL_SERVER_ERROR
23:22:51:WU01:FS03:Trying to send results to collection server
23:22:51:WU01:FS03:Uploading 14.98MiB to 171.65.103.160
23:22:51:WU01:FS03:Connecting to 171.65.103.160:8080
23:22:57:WU05:FS01:Upload complete
23:22:57:WU05:FS01:Server responded WORK_ACK (400)
23:22:57:WU05:FS01:Final credit estimate, 29037.00 points
23:22:57:WU05:FS01:Cleaning up
23:22:57:WU01:FS03:Upload 2.50%
23:23:03:WU01:FS03:Upload 3.76%
23:23:05:WU07:FS03:0x21:Completed 972800 out of 1280000 steps (76%)
23:23:09:WU01:FS03:Upload 6.26%
23:23:15:WU01:FS03:Upload 8.35%
23:23:26:WU01:FS03:Upload 10.43%
23:23:32:WU01:FS03:Upload 12.10%
23:23:38:WU01:FS03:Upload 13.77%
23:23:44:WU01:FS03:Upload 15.44%
23:23:51:WU01:FS03:Upload 17.53%
23:23:57:WU01:FS03:Upload 19.20%
23:24:04:WU01:FS03:Upload 20.87%
23:24:11:WU01:FS03:Upload 22.95%
23:24:17:WU01:FS03:Upload 24.62%
23:24:23:WU01:FS03:Upload 26.71%
23:24:30:WU01:FS03:Upload 28.38%
23:24:36:WU01:FS03:Upload 30.46%
23:24:43:WU01:FS03:Upload 32.13%
23:24:49:WU09:FS01:0x21:Completed 326400 out of 640000 steps (51%)
23:24:50:WU01:FS03:Upload 33.80%
23:24:56:WU01:FS03:Upload 35.89%
23:25:02:WU01:FS03:Upload 37.98%
23:25:05:WU08:FS02:0x17:Completed 2950000 out of 5000000 steps (59%)
23:25:08:WU01:FS03:Upload 40.06%
23:25:15:WU01:FS03:Upload 41.73%
23:25:22:WU01:FS03:Upload 43.40%
23:25:28:WU01:FS03:Upload 45.07%
23:25:34:WU01:FS03:Upload 47.16%
23:25:40:WU01:FS03:Upload 49.66%
23:25:47:WU01:FS03:Upload 51.33%
23:25:49:WU07:FS03:0x21:Completed 985600 out of 1280000 steps (77%)
23:25:54:WU01:FS03:Upload 53.42%
23:26:01:WU01:FS03:Upload 54.67%
23:26:08:WU01:FS03:Upload 56.75%
23:26:15:WU01:FS03:Upload 58.84%
23:26:21:WU01:FS03:Upload 60.51%
23:26:27:WU01:FS03:Upload 63.43%
23:26:31:WU02:FS04:0x17:Completed 3050000 out of 5000000 steps (61%)
23:26:35:WU01:FS03:Upload 65.10%
23:26:42:WU01:FS03:Upload 66.77%
23:26:48:WU01:FS03:Upload 68.44%
23:26:55:WU01:FS03:Upload 70.53%
23:27:01:WU01:FS03:Upload 72.61%
23:27:07:WU01:FS03:Upload 75.12%
23:27:15:WU01:FS03:Upload 76.78%
23:27:21:WU01:FS03:Upload 79.29%
23:27:28:WU01:FS03:Upload 80.96%
23:27:35:WU01:FS03:Upload 82.21%
23:27:43:WU01:FS03:Upload 84.30%
23:27:50:WU01:FS03:Upload 85.97%
23:27:56:WU01:FS03:Upload 87.63%
23:27:58:WU09:FS01:0x21:Completed 332800 out of 640000 steps (52%)
23:28:02:WU01:FS03:Upload 90.14%
23:28:09:WU01:FS03:Upload 92.23%
23:28:15:WU01:FS03:Upload 93.89%
23:28:21:WU01:FS03:Upload 95.98%
23:28:27:WU01:FS03:Upload 97.65%
23:28:33:WU01:FS03:Upload complete
23:28:33:WU01:FS03:Server responded PLEASE_WAIT (464)
23:28:33:WARNING:WU01:FS03:Failed to send results, will try again later
23:28:33:WU01:FS03:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:55 clone:10 gen:10 core:0x21 unit:0x0000000eab404162553ec4564ea3728b
23:28:33:WU01:FS03:Uploading 14.98MiB to 171.64.65.98
23:28:33:WU01:FS03:Connecting to 171.64.65.98:8080
23:28:33:WU07:FS03:0x21:Completed 998400 out of 1280000 steps (78%)
23:28:33:WU08:FS02:0x17:Completed 3000000 out of 5000000 steps (60%)
23:28:40:WU01:FS03:Upload 1.67%
23:28:47:WU01:FS03:Upload 3.76%
23:28:54:WU01:FS03:Upload 5.84%
23:29:01:WU01:FS03:Upload 7.93%
23:29:07:WU01:FS03:Upload 10.02%
23:29:15:WU01:FS03:Upload 11.68%
23:29:22:WU01:FS03:Upload 13.77%
23:29:28:WU01:FS03:Upload 15.44%
23:29:34:WU01:FS03:Upload 17.11%
23:29:41:WU01:FS03:Upload 19.61%
23:29:47:WU01:FS03:Upload 21.70%
23:29:53:WU01:FS03:Upload 23.79%
23:29:59:WU01:FS03:Upload 25.87%
23:30:05:WU01:FS03:Upload 27.13%
23:30:11:WU01:FS03:Upload 28.79%
23:30:17:WU01:FS03:Upload 30.46%
23:30:23:WU01:FS03:Upload 32.55%
23:30:30:WU01:FS03:Upload 34.64%
23:30:36:WU01:FS03:Upload 36.72%
23:30:42:WU01:FS03:Upload 38.39%
23:30:48:WU01:FS03:Upload 40.48%
23:30:54:WU01:FS03:Upload 42.57%
23:31:00:WU01:FS03:Upload 44.23%
23:31:06:WU01:FS03:Upload 46.32%
23:31:07:WU09:FS01:0x21:Completed 339200 out of 640000 steps (53%)
23:31:14:WU01:FS03:Upload 48.41%
23:31:17:WU07:FS03:0x21:Completed 1011200 out of 1280000 steps (79%)
23:31:20:WU01:FS03:Upload 50.08%
23:31:26:WU01:FS03:Upload 51.75%
23:31:32:WU01:FS03:Upload 53.83%
23:31:38:WU01:FS03:Upload 55.50%
23:31:44:WU01:FS03:Upload 58.01%
23:31:50:WU01:FS03:Upload 60.09%
23:31:56:WU01:FS03:Upload 62.18%
23:32:03:WU01:FS03:Upload 64.27%
23:32:08:WU08:FS02:0x17:Completed 3050000 out of 5000000 steps (61%)
23:32:10:WU01:FS03:Upload 66.77%
23:32:16:WU01:FS03:Upload 68.02%
23:32:23:WU01:FS03:Upload 70.11%
23:32:29:WU01:FS03:Upload 72.19%
23:32:35:WU01:FS03:Upload 74.28%
23:32:40:WU02:FS04:0x17:Completed 3100000 out of 5000000 steps (62%)
23:32:41:WU01:FS03:Upload 75.53%
23:32:47:WU01:FS03:Upload 77.62%
23:32:53:WU01:FS03:Upload 79.29%
23:32:59:WU01:FS03:Upload 81.38%
23:33:05:WU01:FS03:Upload 83.04%
23:33:11:WU01:FS03:Upload 84.71%
23:33:17:WU01:FS03:Upload 86.80%
23:33:24:WU01:FS03:Upload 88.05%
23:33:30:WU01:FS03:Upload 89.72%
23:33:37:WU01:FS03:Upload 91.81%
23:33:43:WU01:FS03:Upload 93.89%
23:33:49:WU01:FS03:Upload 95.15%
23:33:55:WU01:FS03:Upload 96.82%
23:34:01:WU07:FS03:0x21:Completed 1024000 out of 1280000 steps (80%)
23:34:02:WU01:FS03:Upload 98.90%
23:34:16:WU09:FS01:0x21:Completed 345600 out of 640000 steps (54%)
23:34:37:WU01:FS03:Upload complete
23:34:37:WU01:FS03:Server responded WORK_ACK (400)
23:34:37:WU01:FS03:Final credit estimate, 27914.00 points
23:34:37:WU01:FS03:Cleaning up
23:35:37:WU08:FS02:0x17:Completed 3100000 out of 5000000 steps (62%)
23:36:45:WU07:FS03:0x21:Completed 1036800 out of 1280000 steps (81%)
23:37:25:WU09:FS01:0x21:Completed 352000 out of 640000 steps (55%)
23:39:02:WU02:FS04:0x17:Completed 3150000 out of 5000000 steps (63%)
23:39:12:WU08:FS02:0x17:Completed 3150000 out of 5000000 steps (63%)
23:39:45:WU07:FS03:0x21:Completed 1049600 out of 1280000 steps (82%)
23:40:34:WU09:FS01:0x21:Completed 358400 out of 640000 steps (56%)
23:42:29:WU07:FS03:0x21:Completed 1062400 out of 1280000 steps (83%)
23:42:41:WU08:FS02:0x17:Completed 3200000 out of 5000000 steps (64%)
23:43:43:WU09:FS01:0x21:Completed 364800 out of 640000 steps (57%)
23:45:11:WU02:FS04:0x17:Completed 3200000 out of 5000000 steps (64%)
23:45:12:WU07:FS03:0x21:Completed 1075200 out of 1280000 steps (84%)
23:46:10:WU08:FS02:0x17:Completed 3250000 out of 5000000 steps (65%)
23:46:52:WU09:FS01:0x21:Completed 371200 out of 640000 steps (58%)
23:47:55:WU07:FS03:0x21:Completed 1088000 out of 1280000 steps (85%)
23:49:44:WU08:FS02:0x17:Completed 3300000 out of 5000000 steps (66%)
23:50:02:WU09:FS01:0x21:Completed 377600 out of 640000 steps (59%)
23:50:39:WU07:FS03:0x21:Completed 1100800 out of 1280000 steps (86%)
23:51:20:WU02:FS04:0x17:Completed 3250000 out of 5000000 steps (65%)
23:53:10:WU09:FS01:0x21:Completed 384000 out of 640000 steps (60%)
23:53:13:WU08:FS02:0x17:Completed 3350000 out of 5000000 steps (67%)
23:53:22:WU07:FS03:0x21:Completed 1113600 out of 1280000 steps (87%)
23:56:20:WU09:FS01:0x21:Completed 390400 out of 640000 steps (61%)
23:56:21:WU07:FS03:0x21:Completed 1126400 out of 1280000 steps (88%)
23:56:48:WU08:FS02:0x17:Completed 3400000 out of 5000000 steps (68%)
23:57:42:WU02:FS04:0x17:Completed 3300000 out of 5000000 steps (66%)
23:59:05:WU07:FS03:0x21:Completed 1139200 out of 1280000 steps (89%)
23:59:29:WU09:FS01:0x21:Completed 396800 out of 640000 steps (62%)
00:00:17:WU08:FS02:0x17:Completed 3450000 out of 5000000 steps (69%)
00:01:48:WU07:FS03:0x21:Completed 1152000 out of 1280000 steps (90%)
00:03:12:WU09:FS01:0x21:Completed 403200 out of 640000 steps (63%)
00:03:46:WU08:FS02:0x17:Completed 3500000 out of 5000000 steps (70%)
00:03:51:WU02:FS04:0x17:Completed 3350000 out of 5000000 steps (67%)
00:04:32:WU07:FS03:0x21:Completed 1164800 out of 1280000 steps (91%)
00:06:21:WU09:FS01:0x21:Completed 409600 out of 640000 steps (64%)
00:07:16:WU07:FS03:0x21:Completed 1177600 out of 1280000 steps (92%)
00:07:21:WU08:FS02:0x17:Completed 3550000 out of 5000000 steps (71%)
00:09:30:WU09:FS01:0x21:Completed 416000 out of 640000 steps (65%)
00:09:59:WU07:FS03:0x21:Completed 1190400 out of 1280000 steps (93%)
00:10:13:WU02:FS04:0x17:Completed 3400000 out of 5000000 steps (68%)
00:10:50:WU08:FS02:0x17:Completed 3600000 out of 5000000 steps (72%)
00:12:39:WU09:FS01:0x21:Completed 422400 out of 640000 steps (66%)
00:12:59:WU07:FS03:0x21:Completed 1203200 out of 1280000 steps (94%)
00:14:25:WU08:FS02:0x17:Completed 3650000 out of 5000000 steps (73%)
00:15:43:WU07:FS03:0x21:Completed 1216000 out of 1280000 steps (95%)
00:15:48:WU09:FS01:0x21:Completed 428800 out of 640000 steps (67%)
00:16:22:WU02:FS04:0x17:Completed 3450000 out of 5000000 steps (69%)
00:17:54:WU08:FS02:0x17:Completed 3700000 out of 5000000 steps (74%)
00:18:26:WU07:FS03:0x21:Completed 1228800 out of 1280000 steps (96%)
00:18:57:WU09:FS01:0x21:Completed 435200 out of 640000 steps (68%)
00:21:10:WU07:FS03:0x21:Completed 1241600 out of 1280000 steps (97%)
00:21:22:WU08:FS02:0x17:Completed 3750000 out of 5000000 steps (75%)
00:22:07:WU09:FS01:0x21:Completed 441600 out of 640000 steps (69%)
00:22:31:WU02:FS04:0x17:Completed 3500000 out of 5000000 steps (70%)
00:23:54:WU07:FS03:0x21:Completed 1254400 out of 1280000 steps (98%)
00:24:57:WU08:FS02:0x17:Completed 3800000 out of 5000000 steps (76%)
00:25:16:WU09:FS01:0x21:Completed 448000 out of 640000 steps (70%)
00:26:38:WU07:FS03:0x21:Completed 1267200 out of 1280000 steps (99%)
00:26:38:WU00:FS03:Connecting to 171.67.108.200:80
00:26:41:WU00:FS03:Assigned to work server 140.163.4.233
00:26:41:WU00:FS03:Requesting new work unit for slot 03: RUNNING gpu:2:Tahiti XT [Radeon HD 7970] from 140.163.4.233
00:26:41:WU00:FS03:Connecting to 140.163.4.233:8080
00:26:42:WU00:FS03:Downloading 4.33MiB
00:26:43:WU00:FS03:Download complete
00:26:43:WU00:FS03:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:10468 run:0 clone:137 gen:216 core:0x17 unit:0x00000158538b3db9538cae08fee7025f
00:28:25:WU09:FS01:0x21:Completed 454400 out of 640000 steps (71%)
00:28:26:WU08:FS02:0x17:Completed 3850000 out of 5000000 steps (77%)
00:28:52:WU02:FS04:0x17:Completed 3550000 out of 5000000 steps (71%)
00:29:21:WU07:FS03:0x21:Completed 1280000 out of 1280000 steps (100%)
00:29:37:WU07:FS03:0x21:Saving result file logfile_01.txt
00:29:37:WU07:FS03:0x21:Saving result file checkpointState.xml
00:29:39:WU07:FS03:0x21:Saving result file checkpt.crc
00:29:39:WU07:FS03:0x21:Saving result file log.txt
00:29:39:WU07:FS03:0x21:Saving result file positions.xtc
00:29:40:WU07:FS03:0x21:[email protected] Core Shutdown: FINISHED_UNIT
00:29:40:WU07:FS03:FahCore returned: FINISHED_UNIT (100 = 0x64)
00:29:40:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
00:29:40:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
00:29:40:WU07:FS03:Connecting to 171.64.65.98:8080
00:29:40:WU00:FS03:Starting
00:29:40:WU00:FS03:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 3616 -checkpoint 15 -gpu 2 -gpu-vendor ati
00:29:40:WU00:FS03:Started FahCore on PID 3920
00:29:40:WU00:FS03:Core PID:2716
00:29:40:WU00:FS03:FahCore 0x17 started
00:29:41:WU00:FS03:0x17:*********************** Log Started 2015-09-06T00:29:41Z ***********************
00:29:41:WU00:FS03:0x17:Project: 10468 (Run 0, Clone 137, Gen 216)
00:29:41:WU00:FS03:0x17:Unit: 0x00000158538b3db9538cae08fee7025f
00:29:41:WU00:FS03:0x17:CPU: 0x00000000000000000000000000000000
00:29:41:WU00:FS03:0x17:Machine: 3
00:29:41:WU00:FS03:0x17:Reading tar file state.xml
00:29:41:WU00:FS03:0x17:Reading tar file system.xml
00:29:42:WU00:FS03:0x17:Reading tar file integrator.xml
00:29:42:WU00:FS03:0x17:Reading tar file core.xml
00:29:42:WU00:FS03:0x17:Digital signatures verified
00:29:42:WU00:FS03:0x17:[email protected] GPU core17
00:29:42:WU00:FS03:0x17:Version 0.0.52
00:29:59:WU07:FS03:Upload 0.65%
00:29:59:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
00:29:59:WU07:FS03:Trying to send results to collection server
00:29:59:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
00:29:59:WU07:FS03:Connecting to 171.65.103.160:8080
00:31:37:WU09:FS01:0x21:Completed 460800 out of 640000 steps (72%)
00:31:44:WU00:FS03:0x17:Completed 0 out of 5000000 steps (0%)
00:31:44:WU00:FS03:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:32:03:WU08:FS02:0x17:Completed 3900000 out of 5000000 steps (78%)
00:34:46:WU09:FS01:0x21:Completed 467200 out of 640000 steps (73%)
00:35:04:WU02:FS04:0x17:Completed 3600000 out of 5000000 steps (72%)
00:35:19:WU07:FS03:Upload 0.65%
00:35:19:ERROR:WU07:FS03:Exception: Transfer failed
00:35:19:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
00:35:19:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
00:35:19:WU07:FS03:Connecting to 171.64.65.98:8080
00:35:32:WU08:FS02:0x17:Completed 3950000 out of 5000000 steps (79%)
00:37:51:WU00:FS03:0x17:Completed 50000 out of 5000000 steps (1%)
00:37:55:WU09:FS01:0x21:Completed 473600 out of 640000 steps (74%)
00:39:01:WU08:FS02:0x17:Completed 4000000 out of 5000000 steps (80%)
00:39:29:WU07:FS03:Upload 0.65%
00:39:29:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
00:39:29:WU07:FS03:Trying to send results to collection server
00:39:29:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
00:39:29:WU07:FS03:Connecting to 171.65.103.160:8080
00:40:26:WU07:FS03:Upload 0.65%
00:40:26:ERROR:WU07:FS03:Exception: Transfer failed
00:40:26:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
00:40:26:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
00:40:26:WU07:FS03:Connecting to 171.64.65.98:8080
00:40:48:WU07:FS03:Upload 0.65%
00:40:48:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
00:40:48:WU07:FS03:Trying to send results to collection server
00:40:49:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
00:40:49:WU07:FS03:Connecting to 171.65.103.160:8080
00:41:04:WU09:FS01:0x21:Completed 480000 out of 640000 steps (75%)
00:41:26:WU02:FS04:0x17:Completed 3650000 out of 5000000 steps (73%)
00:41:46:WU07:FS03:Upload 0.65%
00:41:46:ERROR:WU07:FS03:Exception: Transfer failed
00:42:03:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
00:42:03:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
00:42:03:WU07:FS03:Connecting to 171.64.65.98:8080
00:42:23:WU07:FS03:Upload 0.65%
00:42:23:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
00:42:23:WU07:FS03:Trying to send results to collection server
00:42:23:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
00:42:23:WU07:FS03:Connecting to 171.65.103.160:8080
00:42:36:WU08:FS02:0x17:Completed 4050000 out of 5000000 steps (81%)
00:43:49:WU00:FS03:0x17:Completed 100000 out of 5000000 steps (2%)
00:44:48:WU09:FS01:0x21:Completed 486400 out of 640000 steps (76%)
00:46:05:WU08:FS02:0x17:Completed 4100000 out of 5000000 steps (82%)
00:47:35:WU02:FS04:0x17:Completed 3700000 out of 5000000 steps (74%)
00:47:57:WU09:FS01:0x21:Completed 492800 out of 640000 steps (77%)
00:48:16:WU07:FS03:Upload 0.65%
00:48:16:ERROR:WU07:FS03:Exception: Transfer failed
00:48:16:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
00:48:16:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
00:48:16:WU07:FS03:Connecting to 171.64.65.98:8080
00:48:35:WU07:FS03:Upload 0.65%
00:48:35:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
00:48:35:WU07:FS03:Trying to send results to collection server
00:48:35:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
00:48:35:WU07:FS03:Connecting to 171.65.103.160:8080
00:49:40:WU08:FS02:0x17:Completed 4150000 out of 5000000 steps (83%)
00:49:57:WU00:FS03:0x17:Completed 150000 out of 5000000 steps (3%)
00:51:06:WU09:FS01:0x21:Completed 499200 out of 640000 steps (78%)
00:51:35:WU07:FS03:Upload 0.65%
00:51:35:ERROR:WU07:FS03:Exception: Transfer failed
00:52:30:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
00:52:30:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
00:52:30:WU07:FS03:Connecting to 171.64.65.98:8080
00:52:49:WU07:FS03:Upload 0.65%
00:52:49:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
00:52:49:WU07:FS03:Trying to send results to collection server
00:52:49:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
00:52:49:WU07:FS03:Connecting to 171.65.103.160:8080
00:53:09:WU08:FS02:0x17:Completed 4200000 out of 5000000 steps (84%)
00:53:12:WU07:FS03:Upload 0.65%
00:53:12:ERROR:WU07:FS03:Exception: Transfer failed
00:53:44:WU02:FS04:0x17:Completed 3750000 out of 5000000 steps (75%)
00:54:15:WU09:FS01:0x21:Completed 505600 out of 640000 steps (79%)
00:55:54:WU00:FS03:0x17:Completed 200000 out of 5000000 steps (4%)
00:56:38:WU08:FS02:0x17:Completed 4250000 out of 5000000 steps (85%)
00:57:24:WU09:FS01:0x21:Completed 512000 out of 640000 steps (80%)
00:59:21:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
00:59:21:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
00:59:21:WU07:FS03:Connecting to 171.64.65.98:8080
01:00:06:WU02:FS04:0x17:Completed 3800000 out of 5000000 steps (76%)
01:00:13:WU08:FS02:0x17:Completed 4300000 out of 5000000 steps (86%)
01:00:33:WU09:FS01:0x21:Completed 518400 out of 640000 steps (81%)
01:01:51:WU00:FS03:0x17:Completed 250000 out of 5000000 steps (5%)
01:01:58:WU07:FS03:Upload 0.65%
01:01:58:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
01:01:58:WU07:FS03:Trying to send results to collection server
01:01:58:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
01:01:58:WU07:FS03:Connecting to 171.65.103.160:8080
01:02:19:WU07:FS03:Upload 0.65%
01:02:19:ERROR:WU07:FS03:Exception: Transfer failed
01:03:42:WU08:FS02:0x17:Completed 4350000 out of 5000000 steps (87%)
01:03:42:WU09:FS01:0x21:Completed 524800 out of 640000 steps (82%)
01:06:15:WU02:FS04:0x17:Completed 3850000 out of 5000000 steps (77%)
01:06:51:WU09:FS01:0x21:Completed 531200 out of 640000 steps (83%)
01:07:16:WU08:FS02:0x17:Completed 4400000 out of 5000000 steps (88%)
01:08:00:WU00:FS03:0x17:Completed 300000 out of 5000000 steps (6%)
01:10:00:WU09:FS01:0x21:Completed 537600 out of 640000 steps (84%)
01:10:27:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
01:10:27:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
01:10:27:WU07:FS03:Connecting to 171.64.65.98:8080
01:10:45:WU08:FS02:0x17:Completed 4450000 out of 5000000 steps (89%)
01:10:46:WU07:FS03:Upload 0.65%
01:10:46:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
01:10:46:WU07:FS03:Trying to send results to collection server
01:10:46:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
01:10:46:WU07:FS03:Connecting to 171.65.103.160:8080
01:11:11:WU07:FS03:Upload 0.65%
01:11:11:ERROR:WU07:FS03:Exception: Transfer failed
01:12:36:WU02:FS04:0x17:Completed 3900000 out of 5000000 steps (78%)
01:13:08:WU09:FS01:0x21:Completed 544000 out of 640000 steps (85%)
01:13:57:WU00:FS03:0x17:Completed 350000 out of 5000000 steps (7%)
01:14:14:WU08:FS02:0x17:Completed 4500000 out of 5000000 steps (90%)
01:16:17:WU09:FS01:0x21:Completed 550400 out of 640000 steps (86%)
01:17:49:WU08:FS02:0x17:Completed 4550000 out of 5000000 steps (91%)
01:18:45:WU02:FS04:0x17:Completed 3950000 out of 5000000 steps (79%)
01:19:26:WU09:FS01:0x21:Completed 556800 out of 640000 steps (87%)
01:20:06:WU00:FS03:0x17:Completed 400000 out of 5000000 steps (8%)
01:21:18:WU08:FS02:0x17:Completed 4600000 out of 5000000 steps (92%)
01:23:09:WU09:FS01:0x21:Completed 563200 out of 640000 steps (88%)
01:24:53:WU08:FS02:0x17:Completed 4650000 out of 5000000 steps (93%)
01:24:54:WU02:FS04:0x17:Completed 4000000 out of 5000000 steps (80%)
01:26:03:WU00:FS03:0x17:Completed 450000 out of 5000000 steps (9%)
01:26:17:WU09:FS01:0x21:Completed 569600 out of 640000 steps (89%)
01:28:22:WU08:FS02:0x17:Completed 4700000 out of 5000000 steps (94%)
01:28:24:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
01:28:24:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
01:28:24:WU07:FS03:Connecting to 171.64.65.98:8080
01:28:43:WU07:FS03:Upload 0.65%
01:28:43:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
01:28:43:WU07:FS03:Trying to send results to collection server
01:28:43:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
01:28:43:WU07:FS03:Connecting to 171.65.103.160:8080
01:29:05:WU07:FS03:Upload 0.65%
01:29:05:ERROR:WU07:FS03:Exception: Transfer failed
01:29:26:WU09:FS01:0x21:Completed 576000 out of 640000 steps (90%)
01:31:15:WU02:FS04:0x17:Completed 4050000 out of 5000000 steps (81%)
01:31:51:WU08:FS02:0x17:Completed 4750000 out of 5000000 steps (95%)
01:32:00:WU00:FS03:0x17:Completed 500000 out of 5000000 steps (10%)
01:32:35:WU09:FS01:0x21:Completed 582400 out of 640000 steps (91%)
01:35:26:WU08:FS02:0x17:Completed 4800000 out of 5000000 steps (96%)
01:35:43:WU09:FS01:0x21:Completed 588800 out of 640000 steps (92%)
01:37:24:WU02:FS04:0x17:Completed 4100000 out of 5000000 steps (82%)
01:38:09:WU00:FS03:0x17:Completed 550000 out of 5000000 steps (11%)
01:38:52:WU09:FS01:0x21:Completed 595200 out of 640000 steps (93%)
01:38:54:WU08:FS02:0x17:Completed 4850000 out of 5000000 steps (97%)
01:42:02:WU09:FS01:0x21:Completed 601600 out of 640000 steps (94%)
01:42:30:WU08:FS02:0x17:Completed 4900000 out of 5000000 steps (98%)
01:43:46:WU02:FS04:0x17:Completed 4150000 out of 5000000 steps (83%)
01:44:07:WU00:FS03:0x17:Completed 600000 out of 5000000 steps (12%)
01:45:11:WU09:FS01:0x21:Completed 608000 out of 640000 steps (95%)
01:45:58:WU08:FS02:0x17:Completed 4950000 out of 5000000 steps (99%)
01:48:20:WU09:FS01:0x21:Completed 614400 out of 640000 steps (96%)
01:49:28:WU08:FS02:0x17:Completed 5000000 out of 5000000 steps (100%)
01:49:28:WU01:FS02:Connecting to 171.67.108.200:80
01:49:28:WU01:FS02:Assigned to work server 171.64.65.98
01:49:28:WU01:FS02:Requesting new work unit for slot 02: RUNNING gpu:1:Tahiti XT [Radeon HD 7970] from 171.64.65.98
01:49:28:WU01:FS02:Connecting to 171.64.65.98:8080
01:49:32:WU01:FS02:Downloading 15.72MiB
01:49:34:WU08:FS02:0x17:Saving result file logfile_01.txt
01:49:34:WU08:FS02:0x17:Saving result file checkpointState.xml
01:49:35:WU08:FS02:0x17:Saving result file checkpt.crc
01:49:35:WU08:FS02:0x17:Saving result file log.txt
01:49:35:WU08:FS02:0x17:Saving result file positions.xtc
01:49:36:WU08:FS02:0x17:[email protected] Core Shutdown: FINISHED_UNIT
01:49:36:WU08:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
01:49:36:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
01:49:36:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
01:49:36:WU08:FS02:Connecting to 140.163.4.233:8080
01:49:38:WU01:FS02:Download 31.00%
01:49:44:WU01:FS02:Download 50.08%
01:49:50:WU01:FS02:Download 69.56%
01:49:55:WU02:FS04:0x17:Completed 4200000 out of 5000000 steps (84%)
01:49:56:WU01:FS02:Download 79.50%
01:50:02:WU01:FS02:Download 84.27%
01:50:08:WU01:FS02:Download 95.00%
01:50:08:WU01:FS02:Download complete
01:50:08:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
01:50:08:WU01:FS02:Starting
01:50:08:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 3616 -checkpoint 15 -gpu 1 -gpu-vendor ati
01:50:08:WU01:FS02:Started FahCore on PID 992
01:50:08:WU01:FS02:Core PID:1140
01:50:08:WU01:FS02:FahCore 0x21 started
01:50:08:WU01:FS02:0x21:*********************** Log Started 2015-09-06T01:50:08Z ***********************
01:50:08:WU01:FS02:0x21:Project: 9704 (Run 68, Clone 3, Gen 5)
01:50:08:WU01:FS02:0x21:Unit: 0x0000000cab404162553ec641e8bb479d
01:50:08:WU01:FS02:0x21:CPU: 0x00000000000000000000000000000000
01:50:08:WU01:FS02:0x21:Machine: 2
01:50:08:WU01:FS02:0x21:Reading tar file core.xml
01:50:08:WU01:FS02:0x21:Reading tar file system.xml
01:50:11:WU01:FS02:0x21:Reading tar file integrator.xml
01:50:11:WU01:FS02:0x21:Reading tar file state.xml
01:50:13:WU01:FS02:0x21:Digital signatures verified
01:50:13:WU01:FS02:0x21:[email protected] GPU Core21 [email protected] Core
01:50:13:WU01:FS02:0x21:Version 0.0.11
01:50:16:WU00:FS03:0x17:Completed 650000 out of 5000000 steps (13%)
01:51:30:WU09:FS01:0x21:Completed 620800 out of 640000 steps (97%)
01:52:20:WU01:FS02:0x21:Completed 0 out of 640000 steps (0%)
01:52:20:WU01:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:54:39:WU09:FS01:0x21:Completed 627200 out of 640000 steps (98%)
01:55:56:WU01:FS02:0x21:Completed 6400 out of 640000 steps (1%)
01:56:06:WU02:FS04:0x17:Completed 4250000 out of 5000000 steps (85%)
01:56:14:WU00:FS03:0x17:Completed 700000 out of 5000000 steps (14%)
01:57:26:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
01:57:26:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
01:57:26:WU07:FS03:Connecting to 171.64.65.98:8080
01:57:48:WU09:FS01:0x21:Completed 633600 out of 640000 steps (99%)
01:57:49:WU03:FS01:Connecting to 171.67.108.200:80
01:58:10:WU08:FS02:Upload 0.90%
01:58:10:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
01:58:10:WU08:FS02:Trying to send results to collection server
01:58:10:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
01:58:10:WU08:FS02:Connecting to 140.163.4.241:8080
01:58:13:WU03:FS01:Assigned to work server 171.64.65.98
01:58:13:WU03:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:Tahiti XT [Radeon HD 7970] from 171.64.65.98
01:58:13:WU03:FS01:Connecting to 171.64.65.98:8080
01:58:23:WU03:FS01:Downloading 7.51MiB
01:58:29:WU03:FS01:Download 36.61%
01:58:35:WU03:FS01:Download 53.26%
01:58:42:WU03:FS01:Download 71.56%
01:58:48:WU03:FS01:Download 97.36%
01:58:48:WU03:FS01:Download complete
01:58:48:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
01:59:01:WU01:FS02:0x21:Completed 12800 out of 640000 steps (2%)
02:00:57:WU09:FS01:0x21:Completed 640000 out of 640000 steps (100%)
02:01:31:WU09:FS01:0x21:Saving result file logfile_01.txt
02:01:32:WU09:FS01:0x21:Saving result file checkpointState.xml
02:01:36:WU09:FS01:0x21:Saving result file checkpt.crc
02:01:36:WU09:FS01:0x21:Saving result file log.txt
02:01:36:WU09:FS01:0x21:Saving result file positions.xtc
02:01:37:WU09:FS01:0x21:[email protected] Core Shutdown: FINISHED_UNIT
02:01:37:WU09:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:01:37:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
02:01:37:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
02:01:37:WU09:FS01:Connecting to 171.64.65.98:8080
02:01:37:WU03:FS01:Starting
02:01:37:WU03:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 03 -suffix 01 -version 704 -lifeline 3616 -checkpoint 15 -gpu 0 -gpu-vendor ati
02:01:37:WU03:FS01:Started FahCore on PID 3264
02:01:37:WU03:FS01:Core PID:3172
02:01:37:WU03:FS01:FahCore 0x21 started
02:01:38:WU03:FS01:0x21:*********************** Log Started 2015-09-06T02:01:37Z ***********************
02:01:38:WU03:FS01:0x21:Project: 9712 (Run 25, Clone 36, Gen 25)
02:01:38:WU03:FS01:0x21:Unit: 0x0000005dab40416255b9aa1efb03f1ca
02:01:38:WU03:FS01:0x21:CPU: 0x00000000000000000000000000000000
02:01:38:WU03:FS01:0x21:Machine: 1
02:01:38:WU03:FS01:0x21:Reading tar file core.xml
02:01:38:WU03:FS01:0x21:Reading tar file integrator.xml
02:01:38:WU03:FS01:0x21:Reading tar file system.xml
02:01:39:WU03:FS01:0x21:Reading tar file state.xml
02:01:40:WU03:FS01:0x21:Digital signatures verified
02:01:40:WU03:FS01:0x21:[email protected] GPU Core21 [email protected] Core
02:01:40:WU03:FS01:0x21:Version 0.0.11
02:01:40:WU07:FS03:Upload 0.65%
02:01:40:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
02:01:40:WU07:FS03:Trying to send results to collection server
02:01:41:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
02:01:41:WU07:FS03:Connecting to 171.65.103.160:8080
02:01:56:WU09:FS01:Upload 0.42%
02:01:56:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
02:01:56:WU09:FS01:Trying to send results to collection server
02:01:56:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
02:01:56:WU09:FS01:Connecting to 171.65.103.160:8080
02:02:06:WU01:FS02:0x21:Completed 19200 out of 640000 steps (3%)
02:02:11:WU00:FS03:0x17:Completed 750000 out of 5000000 steps (15%)
02:02:29:WU03:FS01:0x21:Completed 0 out of 1280000 steps (0%)
02:02:29:WU03:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
02:02:32:WU02:FS04:0x17:Completed 4300000 out of 5000000 steps (86%)
02:03:08:WU09:FS01:Upload 0.42%
02:03:08:ERROR:WU09:FS01:Exception: Transfer failed
02:03:08:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
02:03:08:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
02:03:08:WU09:FS01:Connecting to 171.64.65.98:8080
02:03:28:WU08:FS02:Upload 0.90%
02:03:28:ERROR:WU08:FS02:Exception: Transfer failed
02:03:28:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
02:03:28:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
02:03:28:WU08:FS02:Connecting to 140.163.4.233:8080
02:03:30:WU09:FS01:Upload 0.42%
02:03:30:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
02:03:30:WU09:FS01:Trying to send results to collection server
02:03:30:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
02:03:30:WU09:FS01:Connecting to 171.65.103.160:8080
02:03:49:WU08:FS02:Upload 0.90%
02:03:50:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
02:03:50:WU08:FS02:Trying to send results to collection server
02:03:50:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
02:03:50:WU08:FS02:Connecting to 140.163.4.241:8080
02:03:52:WU09:FS01:Upload 0.42%
02:03:52:ERROR:WU09:FS01:Exception: Transfer failed
02:04:08:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
02:04:08:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
02:04:08:WU09:FS01:Connecting to 171.64.65.98:8080
02:05:15:WU01:FS02:0x21:Completed 25600 out of 640000 steps (4%)
02:05:36:WU03:FS01:0x21:Completed 12800 out of 1280000 steps (1%)
02:06:28:WU07:FS03:Upload 0.65%
02:06:28:ERROR:WU07:FS03:Exception: Transfer failed
02:07:01:WU09:FS01:Upload 0.42%
02:07:01:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
02:07:01:WU09:FS01:Trying to send results to collection server
02:07:01:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
02:07:01:WU09:FS01:Connecting to 171.65.103.160:8080
02:08:20:WU01:FS02:0x21:Completed 32000 out of 640000 steps (5%)
02:08:21:WU00:FS03:0x17:Completed 800000 out of 5000000 steps (16%)
02:08:28:WU03:FS01:0x21:Completed 25600 out of 1280000 steps (2%)
02:08:41:WU02:FS04:0x17:Completed 4350000 out of 5000000 steps (87%)
02:10:13:WU08:FS02:Upload 0.90%
02:10:13:ERROR:WU08:FS02:Exception: Transfer failed
02:10:13:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
02:10:13:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
02:10:13:WU08:FS02:Connecting to 140.163.4.233:8080
02:10:32:WU08:FS02:Upload 0.90%
02:10:32:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
02:10:32:WU08:FS02:Trying to send results to collection server
02:10:32:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
02:10:32:WU08:FS02:Connecting to 140.163.4.241:8080
02:10:49:WU09:FS01:Upload 0.42%
02:10:49:ERROR:WU09:FS01:Exception: Transfer failed
02:10:49:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
02:10:49:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
02:10:49:WU09:FS01:Connecting to 171.64.65.98:8080
02:11:08:WU09:FS01:Upload 0.42%
02:11:09:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
02:11:09:WU09:FS01:Trying to send results to collection server
02:11:09:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
02:11:09:WU09:FS01:Connecting to 171.65.103.160:8080
02:11:19:WU03:FS01:0x21:Completed 38400 out of 1280000 steps (3%)
02:11:25:WU01:FS02:0x21:Completed 38400 out of 640000 steps (6%)
02:11:28:WU09:FS01:Upload 0.42%
02:11:28:ERROR:WU09:FS01:Exception: Transfer failed
02:13:26:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
02:13:26:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
02:13:26:WU09:FS01:Connecting to 171.64.65.98:8080
02:14:11:WU03:FS01:0x21:Completed 51200 out of 1280000 steps (4%)
02:14:18:WU00:FS03:0x17:Completed 850000 out of 5000000 steps (17%)
02:14:30:WU01:FS02:0x21:Completed 44800 out of 640000 steps (7%)
02:14:58:WU02:FS04:0x17:Completed 4400000 out of 5000000 steps (88%)
02:16:02:WU09:FS01:Upload 0.42%
02:16:03:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
02:16:03:WU09:FS01:Trying to send results to collection server
02:16:03:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
02:16:03:WU09:FS01:Connecting to 171.65.103.160:8080
02:17:03:WU03:FS01:0x21:Completed 64000 out of 1280000 steps (5%)
02:17:34:WU01:FS02:0x21:Completed 51200 out of 640000 steps (8%)
02:18:35:WU08:FS02:Upload 0.90%
02:18:36:ERROR:WU08:FS02:Exception: Transfer failed
02:18:36:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
02:18:36:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
02:18:36:WU08:FS02:Connecting to 140.163.4.233:8080
02:18:55:WU08:FS02:Upload 0.90%
02:18:55:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
02:18:55:WU08:FS02:Trying to send results to collection server
02:18:55:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
02:18:55:WU08:FS02:Connecting to 140.163.4.241:8080
02:19:16:WU08:FS02:Upload 0.90%
02:19:16:ERROR:WU08:FS02:Exception: Transfer failed
02:19:55:WU03:FS01:0x21:Completed 76800 out of 1280000 steps (6%)
02:20:27:WU00:FS03:0x17:Completed 900000 out of 5000000 steps (18%)
02:20:39:WU01:FS02:0x21:Completed 57600 out of 640000 steps (9%)
02:21:03:WU02:FS04:0x17:Completed 4450000 out of 5000000 steps (89%)
02:21:13:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
02:21:13:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
02:21:13:WU08:FS02:Connecting to 140.163.4.233:8080
02:22:50:WU09:FS01:Upload 0.42%
02:22:50:ERROR:WU09:FS01:Exception: Transfer failed
02:22:50:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
02:22:50:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
02:22:50:WU09:FS01:Connecting to 171.64.65.98:8080
02:23:02:WU03:FS01:0x21:Completed 89600 out of 1280000 steps (7%)
02:23:44:WU01:FS02:0x21:Completed 64000 out of 640000 steps (10%)
02:25:53:WU03:FS01:0x21:Completed 102400 out of 1280000 steps (8%)
02:26:00:WU09:FS01:Upload 0.42%
02:26:00:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
02:26:00:WU09:FS01:Trying to send results to collection server
02:26:00:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
02:26:00:WU09:FS01:Connecting to 171.65.103.160:8080
02:26:19:WU08:FS02:Upload 0.90%
02:26:19:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
02:26:19:WU08:FS02:Trying to send results to collection server
02:26:19:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
02:26:19:WU08:FS02:Connecting to 140.163.4.241:8080
02:26:24:WU00:FS03:0x17:Completed 950000 out of 5000000 steps (19%)
02:26:38:WU08:FS02:Upload 0.90%
02:26:38:ERROR:WU08:FS02:Exception: Transfer failed
02:26:38:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
02:26:38:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
02:26:38:WU08:FS02:Connecting to 140.163.4.233:8080
02:26:49:WU01:FS02:0x21:Completed 70400 out of 640000 steps (11%)
02:27:08:WU02:FS04:0x17:Completed 4500000 out of 5000000 steps (90%)
02:28:45:WU03:FS01:0x21:Completed 115200 out of 1280000 steps (9%)
02:28:45:WU09:FS01:Upload 0.42%
02:28:45:ERROR:WU09:FS01:Exception: Transfer failed
02:29:42:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
02:29:42:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
02:29:42:WU09:FS01:Connecting to 171.64.65.98:8080
02:29:53:WU01:FS02:0x21:Completed 76800 out of 640000 steps (12%)
02:31:37:WU03:FS01:0x21:Completed 128000 out of 1280000 steps (10%)
02:32:21:WU00:FS03:0x17:Completed 1000000 out of 5000000 steps (20%)
02:32:52:WU09:FS01:Upload 0.42%
02:32:52:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
02:32:52:WU09:FS01:Trying to send results to collection server
02:32:52:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
02:32:52:WU09:FS01:Connecting to 171.65.103.160:8080
02:33:25:WU02:FS04:0x17:Completed 4550000 out of 5000000 steps (91%)
02:33:33:WU01:FS02:0x21:Completed 83200 out of 640000 steps (13%)
02:34:29:WU03:FS01:0x21:Completed 140800 out of 1280000 steps (11%)
02:34:44:WU08:FS02:Upload 0.90%
02:34:44:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
02:34:44:WU08:FS02:Trying to send results to collection server
02:34:45:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
02:34:45:WU08:FS02:Connecting to 140.163.4.241:8080
02:36:38:WU01:FS02:0x21:Completed 89600 out of 640000 steps (14%)
02:37:21:WU03:FS01:0x21:Completed 153600 out of 1280000 steps (12%)
02:38:30:WU00:FS03:0x17:Completed 1050000 out of 5000000 steps (21%)
02:38:49:WU09:FS01:Upload 0.42%
02:38:49:ERROR:WU09:FS01:Exception: Transfer failed
02:39:30:WU02:FS04:0x17:Completed 4600000 out of 5000000 steps (92%)
02:39:31:WU08:FS02:Upload 0.90%
02:39:31:ERROR:WU08:FS02:Exception: Transfer failed
02:39:31:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
02:39:31:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
02:39:31:WU08:FS02:Connecting to 140.163.4.233:8080
02:39:42:WU01:FS02:0x21:Completed 96000 out of 640000 steps (15%)
02:39:50:WU08:FS02:Upload 0.90%
02:39:50:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
02:39:50:WU08:FS02:Trying to send results to collection server
02:39:50:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
02:39:50:WU08:FS02:Connecting to 140.163.4.241:8080
02:40:29:WU03:FS01:0x21:Completed 166400 out of 1280000 steps (13%)
02:40:47:WU08:FS02:Upload 0.90%
02:40:47:ERROR:WU08:FS02:Exception: Transfer failed
02:40:47:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
02:40:47:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
02:40:47:WU09:FS01:Connecting to 171.64.65.98:8080
02:41:06:WU09:FS01:Upload 0.42%
02:41:07:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
02:41:07:WU09:FS01:Trying to send results to collection server
02:41:07:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
02:41:07:WU09:FS01:Connecting to 171.65.103.160:8080
02:41:50:WU09:FS01:Upload 0.42%
02:41:50:ERROR:WU09:FS01:Exception: Transfer failed
02:42:46:WU01:FS02:0x21:Completed 102400 out of 640000 steps (16%)
02:43:20:WU03:FS01:0x21:Completed 179200 out of 1280000 steps (14%)
02:44:25:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
02:44:25:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
02:44:25:WU07:FS03:Connecting to 171.64.65.98:8080
02:44:27:WU00:FS03:0x17:Completed 1100000 out of 5000000 steps (22%)
02:45:47:WU02:FS04:0x17:Completed 4650000 out of 5000000 steps (93%)
02:45:51:WU01:FS02:0x21:Completed 108800 out of 640000 steps (17%)
02:46:12:WU03:FS01:0x21:Completed 192000 out of 1280000 steps (15%)
02:47:01:WU07:FS03:Upload 0.65%
02:47:01:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
02:47:01:WU07:FS03:Trying to send results to collection server
02:47:01:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
02:47:01:WU07:FS03:Connecting to 171.65.103.160:8080
02:48:56:WU01:FS02:0x21:Completed 115200 out of 640000 steps (18%)
02:49:03:WU03:FS01:0x21:Completed 204800 out of 1280000 steps (16%)
02:49:07:WU07:FS03:Upload 0.65%
02:49:07:ERROR:WU07:FS03:Exception: Transfer failed
02:50:36:WU00:FS03:0x17:Completed 1150000 out of 5000000 steps (23%)
02:50:36:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
02:50:36:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
02:50:36:WU08:FS02:Connecting to 140.163.4.233:8080
02:50:55:WU08:FS02:Upload 0.90%
02:50:55:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
02:50:55:WU08:FS02:Trying to send results to collection server
02:50:55:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
02:50:55:WU08:FS02:Connecting to 140.163.4.241:8080
02:51:52:WU02:FS04:0x17:Completed 4700000 out of 5000000 steps (94%)
02:51:55:WU03:FS01:0x21:Completed 217600 out of 1280000 steps (17%)
02:52:00:WU01:FS02:0x21:Completed 121600 out of 640000 steps (19%)
02:54:28:WU08:FS02:Upload 0.90%
02:54:28:ERROR:WU08:FS02:Exception: Transfer failed
02:54:47:WU03:FS01:0x21:Completed 230400 out of 1280000 steps (18%)
02:55:05:WU01:FS02:0x21:Completed 128000 out of 640000 steps (20%)
02:56:33:WU00:FS03:0x17:Completed 1200000 out of 5000000 steps (24%)
02:57:55:WU03:FS01:0x21:Completed 243200 out of 1280000 steps (19%)
02:57:57:WU02:FS04:0x17:Completed 4750000 out of 5000000 steps (95%)
02:58:09:WU01:FS02:0x21:Completed 134400 out of 640000 steps (21%)
02:58:44:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
02:58:44:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
02:58:44:WU09:FS01:Connecting to 171.64.65.98:8080
02:59:03:WU09:FS01:Upload 0.42%
02:59:03:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
02:59:03:WU09:FS01:Trying to send results to collection server
02:59:03:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
02:59:03:WU09:FS01:Connecting to 171.65.103.160:8080
02:59:28:WU09:FS01:Upload 0.42%
02:59:28:ERROR:WU09:FS01:Exception: Transfer failed
03:00:47:WU03:FS01:0x21:Completed 256000 out of 1280000 steps (20%)
03:01:14:WU01:FS02:0x21:Completed 140800 out of 640000 steps (22%)
03:02:30:WU00:FS03:0x17:Completed 1250000 out of 5000000 steps (25%)
03:03:39:WU03:FS01:0x21:Completed 268800 out of 1280000 steps (21%)
03:04:14:WU02:FS04:0x17:Completed 4800000 out of 5000000 steps (96%)
03:04:18:WU01:FS02:0x21:Completed 147200 out of 640000 steps (23%)
03:06:31:WU03:FS01:0x21:Completed 281600 out of 1280000 steps (22%)
03:07:23:WU01:FS02:0x21:Completed 153600 out of 640000 steps (24%)
03:08:33:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
03:08:33:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
03:08:33:WU08:FS02:Connecting to 140.163.4.233:8080
03:08:39:WU00:FS03:0x17:Completed 1300000 out of 5000000 steps (26%)
03:09:22:WU03:FS01:0x21:Completed 294400 out of 1280000 steps (23%)
03:10:22:WU02:FS04:0x17:Completed 4850000 out of 5000000 steps (97%)
03:10:28:WU01:FS02:0x21:Completed 160000 out of 640000 steps (25%)
03:10:39:WU08:FS02:Upload 0.90%
03:10:39:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
03:10:39:WU08:FS02:Trying to send results to collection server
03:10:39:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
03:10:39:WU08:FS02:Connecting to 140.163.4.241:8080
03:11:37:WU08:FS02:Upload 0.90%
03:11:37:ERROR:WU08:FS02:Exception: Transfer failed
03:12:14:WU03:FS01:0x21:Completed 307200 out of 1280000 steps (24%)
03:14:07:WU01:FS02:0x21:Completed 166400 out of 640000 steps (26%)
03:14:37:WU00:FS03:0x17:Completed 1350000 out of 5000000 steps (27%)
03:15:06:WU03:FS01:0x21:Completed 320000 out of 1280000 steps (25%)
03:16:44:WU02:FS04:0x17:Completed 4900000 out of 5000000 steps (98%)
03:17:12:WU01:FS02:0x21:Completed 172800 out of 640000 steps (27%)
03:18:15:WU03:FS01:0x21:Completed 332800 out of 1280000 steps (26%)
03:20:17:WU01:FS02:0x21:Completed 179200 out of 640000 steps (28%)
03:20:46:WU00:FS03:0x17:Completed 1400000 out of 5000000 steps (28%)
03:21:06:WU03:FS01:0x21:Completed 345600 out of 1280000 steps (27%)
03:22:52:WU02:FS04:0x17:Completed 4950000 out of 5000000 steps (99%)
03:23:22:WU01:FS02:0x21:Completed 185600 out of 640000 steps (29%)
03:23:57:WU03:FS01:0x21:Completed 358400 out of 1280000 steps (28%)
03:26:26:WU01:FS02:0x21:Completed 192000 out of 640000 steps (30%)
03:26:43:WU00:FS03:0x17:Completed 1450000 out of 5000000 steps (29%)
03:26:49:WU03:FS01:0x21:Completed 371200 out of 1280000 steps (29%)
03:27:46:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
03:27:46:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
03:27:46:WU09:FS01:Connecting to 171.64.65.98:8080
03:28:13:WU09:FS01:Upload 0.42%
03:28:13:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
03:28:13:WU09:FS01:Trying to send results to collection server
03:28:13:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
03:28:13:WU09:FS01:Connecting to 171.65.103.160:8080
03:29:02:WU02:FS04:0x17:Completed 5000000 out of 5000000 steps (100%)
03:29:02:WU04:FS04:Connecting to 171.67.108.200:80
03:29:14:WU02:FS04:0x17:Saving result file logfile_01.txt
03:29:14:WU02:FS04:0x17:Saving result file checkpointState.xml
03:29:16:WU02:FS04:0x17:Saving result file checkpt.crc
03:29:16:WU02:FS04:0x17:Saving result file log.txt
03:29:16:WU02:FS04:0x17:Saving result file positions.xtc
03:29:18:WU02:FS04:0x17:[email protected] Core Shutdown: FINISHED_UNIT
03:29:18:WU02:FS04:FahCore returned: FINISHED_UNIT (100 = 0x64)
03:29:18:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
03:29:18:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
03:29:18:WU02:FS04:Connecting to 140.163.4.233:8080
03:29:24:WARNING:WU04:FS04:Failed to get assignment from '171.67.108.200:80': 10002: Received short response, expected 272 bytes, got 0
03:29:24:WU04:FS04:Connecting to 171.67.108.204:80
03:29:31:WU01:FS02:0x21:Completed 198400 out of 640000 steps (31%)
03:29:36:WU04:FS04:Assigned to work server 140.163.4.233
03:29:36:WU04:FS04:Requesting new work unit for slot 04: READY gpu:3:Tahiti XT [Radeon HD 7970] from 140.163.4.233
03:29:36:WU04:FS04:Connecting to 140.163.4.233:8080
03:29:38:WU04:FS04:Downloading 4.27MiB
03:29:40:WU02:FS04:Upload 0.48%
03:29:40:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
03:29:40:WU02:FS04:Trying to send results to collection server
03:29:40:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
03:29:40:WU02:FS04:Connecting to 140.163.4.241:8080
03:29:40:WU04:FS04:Download complete
03:29:41:WU04:FS04:Received Unit: id:04 state:DOWNLOAD error:NO_ERROR project:10467 run:0 clone:201 gen:188 core:0x17 unit:0x00000145538b3db9538bbeda698c08eb
03:29:41:WU04:FS04:Starting
03:29:41:WU04:FS04:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 04 -suffix 01 -version 704 -lifeline 3616 -checkpoint 15 -gpu 3 -gpu-vendor ati
03:29:41:WU04:FS04:Started FahCore on PID 848
03:29:41:WU04:FS04:Core PID:924
03:29:41:WU04:FS04:FahCore 0x17 started
03:29:41:WU04:FS04:0x17:*********************** Log Started 2015-09-06T03:29:41Z ***********************
03:29:41:WU04:FS04:0x17:Project: 10467 (Run 0, Clone 201, Gen 188)
03:29:41:WU04:FS04:0x17:Unit: 0x00000145538b3db9538bbeda698c08eb
03:29:41:WU04:FS04:0x17:CPU: 0x00000000000000000000000000000000
03:29:41:WU04:FS04:0x17:Machine: 4
03:29:41:WU04:FS04:0x17:Reading tar file state.xml
03:29:41:WU03:FS01:0x21:Completed 384000 out of 1280000 steps (30%)
03:29:42:WU04:FS04:0x17:Reading tar file system.xml
03:29:42:WU04:FS04:0x17:Reading tar file integrator.xml
03:29:42:WU04:FS04:0x17:Reading tar file core.xml
03:29:42:WU04:FS04:0x17:Digital signatures verified
03:29:42:WU04:FS04:0x17:[email protected] GPU core17
03:29:42:WU04:FS04:0x17:Version 0.0.52
03:29:59:WU02:FS04:Upload 0.48%
03:29:59:ERROR:WU02:FS04:Exception: Transfer failed
03:29:59:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
03:30:00:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
03:30:00:WU02:FS04:Connecting to 140.163.4.233:8080
03:31:42:WU04:FS04:0x17:Completed 0 out of 5000000 steps (0%)
03:31:42:WU04:FS04:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
03:32:34:WU03:FS01:0x21:Completed 396800 out of 1280000 steps (31%)
03:32:36:WU01:FS02:0x21:Completed 204800 out of 640000 steps (32%)
03:32:40:WU00:FS03:0x17:Completed 1500000 out of 5000000 steps (30%)
03:34:09:WU02:FS04:Upload 0.48%
03:34:09:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
03:34:09:WU02:FS04:Trying to send results to collection server
03:34:09:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
03:34:09:WU02:FS04:Connecting to 140.163.4.241:8080
03:34:31:WU02:FS04:Upload 0.48%
03:34:31:ERROR:WU02:FS04:Exception: Transfer failed
03:34:32:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
03:34:32:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
03:34:32:WU02:FS04:Connecting to 140.163.4.233:8080
03:34:50:WU02:FS04:Upload 0.48%
03:34:51:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
03:34:51:WU02:FS04:Trying to send results to collection server
03:34:51:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
03:34:51:WU02:FS04:Connecting to 140.163.4.241:8080
03:35:09:WU02:FS04:Upload 0.48%
03:35:09:ERROR:WU02:FS04:Exception: Transfer failed
03:35:41:WU01:FS02:0x21:Completed 211200 out of 640000 steps (33%)
03:35:42:WU03:FS01:0x21:Completed 409600 out of 1280000 steps (32%)
03:35:45:WU09:FS01:Upload 0.42%
03:35:45:ERROR:WU09:FS01:Exception: Transfer failed
03:36:09:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
03:36:09:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
03:36:09:WU02:FS04:Connecting to 140.163.4.233:8080
03:37:35:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
03:37:35:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
03:37:35:WU08:FS02:Connecting to 140.163.4.233:8080
03:37:54:WU08:FS02:Upload 0.90%
03:37:54:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
03:37:54:WU08:FS02:Trying to send results to collection server
03:37:54:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
03:37:54:WU08:FS02:Connecting to 140.163.4.241:8080
03:38:01:WU04:FS04:0x17:Completed 50000 out of 5000000 steps (1%)
03:38:13:WU08:FS02:Upload 0.90%
03:38:13:ERROR:WU08:FS02:Exception: Transfer failed
03:38:15:WU02:FS04:Upload 0.48%
03:38:15:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
03:38:15:WU02:FS04:Trying to send results to collection server
03:38:15:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
03:38:15:WU02:FS04:Connecting to 140.163.4.241:8080
03:38:34:WU02:FS04:Upload 0.48%
03:38:34:ERROR:WU02:FS04:Exception: Transfer failed
03:38:34:WU03:FS01:0x21:Completed 422400 out of 1280000 steps (33%)
03:38:46:WU01:FS02:0x21:Completed 217600 out of 640000 steps (34%)
03:38:46:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
03:38:46:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
03:38:46:WU02:FS04:Connecting to 140.163.4.233:8080
03:38:49:WU00:FS03:0x17:Completed 1550000 out of 5000000 steps (31%)
03:41:26:WU03:FS01:0x21:Completed 435200 out of 1280000 steps (34%)
03:41:50:WU01:FS02:0x21:Completed 224000 out of 640000 steps (35%)
03:42:55:WU02:FS04:Upload 0.48%
03:42:55:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
03:42:55:WU02:FS04:Trying to send results to collection server
03:42:55:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
03:42:55:WU02:FS04:Connecting to 140.163.4.241:8080
03:43:14:WU02:FS04:Upload 0.48%
03:43:14:ERROR:WU02:FS04:Exception: Transfer failed
03:43:14:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
03:43:14:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
03:43:14:WU02:FS04:Connecting to 140.163.4.233:8080
03:44:09:WU04:FS04:0x17:Completed 100000 out of 5000000 steps (2%)
03:44:18:WU03:FS01:0x21:Completed 448000 out of 1280000 steps (35%)
03:44:46:WU00:FS03:0x17:Completed 1600000 out of 5000000 steps (32%)
03:44:55:WU01:FS02:0x21:Completed 230400 out of 640000 steps (36%)
03:46:24:WU02:FS04:Upload 0.48%
03:46:24:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
03:46:24:WU02:FS04:Trying to send results to collection server
03:46:24:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
03:46:24:WU02:FS04:Connecting to 140.163.4.241:8080
03:47:10:WU03:FS01:0x21:Completed 460800 out of 1280000 steps (36%)
03:48:00:WU01:FS02:0x21:Completed 236800 out of 640000 steps (37%)
03:48:37:WU02:FS04:Upload 0.48%
03:48:37:ERROR:WU02:FS04:Exception: Transfer failed
03:50:02:WU03:FS01:0x21:Completed 473600 out of 1280000 steps (37%)
03:50:06:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
03:50:06:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
03:50:06:WU02:FS04:Connecting to 140.163.4.233:8080
03:50:25:WU02:FS04:Upload 0.48%
03:50:25:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
03:50:25:WU02:FS04:Trying to send results to collection server
03:50:25:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
03:50:25:WU02:FS04:Connecting to 140.163.4.241:8080
03:50:30:WU04:FS04:0x17:Completed 150000 out of 5000000 steps (3%)
03:50:44:WU02:FS04:Upload 0.48%
03:50:44:ERROR:WU02:FS04:Exception: Transfer failed
03:50:56:WU00:FS03:0x17:Completed 1650000 out of 5000000 steps (33%)
03:51:38:WU01:FS02:0x21:Completed 243200 out of 640000 steps (38%)
03:53:10:WU03:FS01:0x21:Completed 486400 out of 1280000 steps (38%)
03:54:43:WU01:FS02:0x21:Completed 249600 out of 640000 steps (39%)
03:56:01:WU03:FS01:0x21:Completed 499200 out of 1280000 steps (39%)
03:56:38:WU04:FS04:0x17:Completed 200000 out of 5000000 steps (4%)
03:56:53:WU00:FS03:0x17:Completed 1700000 out of 5000000 steps (34%)
03:57:48:WU01:FS02:0x21:Completed 256000 out of 640000 steps (40%)
03:58:53:WU03:FS01:0x21:Completed 512000 out of 1280000 steps (40%)
04:00:26:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
04:00:26:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
04:00:26:WU07:FS03:Connecting to 171.64.65.98:8080
04:00:52:WU01:FS02:0x21:Completed 262400 out of 640000 steps (41%)
04:01:11:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
04:01:11:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
04:01:11:WU02:FS04:Connecting to 140.163.4.233:8080
04:01:44:WU03:FS01:0x21:Completed 524800 out of 1280000 steps (41%)
04:02:47:WU04:FS04:0x17:Completed 250000 out of 5000000 steps (5%)
04:02:49:WU00:FS03:0x17:Completed 1750000 out of 5000000 steps (35%)
04:04:00:WU01:FS02:0x21:Completed 268800 out of 640000 steps (42%)
04:04:35:WU07:FS03:Upload 0.65%
04:04:36:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
04:04:36:WU07:FS03:Trying to send results to collection server
04:04:36:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
04:04:36:WU07:FS03:Connecting to 171.65.103.160:8080
04:04:42:WU03:FS01:0x21:Completed 537600 out of 1280000 steps (42%)
04:04:57:WU07:FS03:Upload 0.65%
04:04:57:ERROR:WU07:FS03:Exception: Transfer failed
04:06:04:WU02:FS04:Upload 0.48%
04:06:04:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
04:06:04:WU02:FS04:Trying to send results to collection server
04:06:04:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
04:06:04:WU02:FS04:Connecting to 140.163.4.241:8080
04:07:04:WU01:FS02:0x21:Completed 275200 out of 640000 steps (43%)
04:07:34:WU03:FS01:0x21:Completed 550400 out of 1280000 steps (43%)
04:08:59:WU00:FS03:0x17:Completed 1800000 out of 5000000 steps (36%)
04:09:08:WU04:FS04:0x17:Completed 300000 out of 5000000 steps (6%)
04:10:09:WU01:FS02:0x21:Completed 281600 out of 640000 steps (44%)
04:10:16:WU02:FS04:Upload 0.48%
04:10:17:ERROR:WU02:FS04:Exception: Transfer failed
04:10:42:WU03:FS01:0x21:Completed 563200 out of 1280000 steps (44%)
04:13:13:WU01:FS02:0x21:Completed 288000 out of 640000 steps (45%)
04:13:34:WU03:FS01:0x21:Completed 576000 out of 1280000 steps (45%)
04:14:45:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
04:14:45:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
04:14:45:WU09:FS01:Connecting to 171.64.65.98:8080
04:14:56:WU00:FS03:0x17:Completed 1850000 out of 5000000 steps (37%)
04:15:07:WU09:FS01:Upload 0.42%
04:15:07:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
04:15:07:WU09:FS01:Trying to send results to collection server
04:15:07:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
04:15:07:WU09:FS01:Connecting to 171.65.103.160:8080
04:15:17:WU04:FS04:0x17:Completed 350000 out of 5000000 steps (7%)
04:16:05:WU09:FS01:Upload 0.42%
04:16:05:ERROR:WU09:FS01:Exception: Transfer failed
04:16:17:WU01:FS02:0x21:Completed 294400 out of 640000 steps (46%)
04:16:26:WU03:FS01:0x21:Completed 588800 out of 1280000 steps (46%)
04:19:08:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
04:19:08:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
04:19:08:WU02:FS04:Connecting to 140.163.4.233:8080
04:19:18:WU03:FS01:0x21:Completed 601600 out of 1280000 steps (47%)
04:19:21:WU01:FS02:0x21:Completed 300800 out of 640000 steps (47%)
04:21:05:WU00:FS03:0x17:Completed 1900000 out of 5000000 steps (38%)
04:21:37:WU04:FS04:0x17:Completed 400000 out of 5000000 steps (8%)
04:22:10:WU03:FS01:0x21:Completed 614400 out of 1280000 steps (48%)
04:22:25:WU01:FS02:0x21:Completed 307200 out of 640000 steps (48%)
04:24:34:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
04:24:34:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
04:24:34:WU08:FS02:Connecting to 140.163.4.233:8080
04:24:56:WU08:FS02:Upload 0.90%
04:24:56:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
04:24:56:WU08:FS02:Trying to send results to collection server
04:24:56:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
04:24:56:WU08:FS02:Connecting to 140.163.4.241:8080
04:25:02:WU03:FS01:0x21:Completed 627200 out of 1280000 steps (49%)
04:25:15:WU08:FS02:Upload 0.90%
04:25:15:ERROR:WU08:FS02:Exception: Transfer failed
04:25:29:WU01:FS02:0x21:Completed 313600 out of 640000 steps (49%)
04:26:19:WU02:FS04:Upload 0.48%
04:26:19:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
04:26:19:WU02:FS04:Trying to send results to collection server
04:26:19:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
04:26:19:WU02:FS04:Connecting to 140.163.4.241:8080
04:26:38:WU02:FS04:Upload 0.48%
04:26:38:ERROR:WU02:FS04:Exception: Transfer failed
04:27:02:WU00:FS03:0x17:Completed 1950000 out of 5000000 steps (39%)
04:27:46:WU04:FS04:0x17:Completed 450000 out of 5000000 steps (9%)
04:27:54:WU03:FS01:0x21:Completed 640000 out of 1280000 steps (50%)
04:28:33:WU01:FS02:0x21:Completed 320000 out of 640000 steps (50%)
04:31:02:WU03:FS01:0x21:Completed 652800 out of 1280000 steps (51%)
04:32:12:WU01:FS02:0x21:Completed 326400 out of 640000 steps (51%)
04:32:59:WU00:FS03:0x17:Completed 2000000 out of 5000000 steps (40%)
04:33:54:WU03:FS01:0x21:Completed 665600 out of 1280000 steps (52%)
04:33:55:WU04:FS04:0x17:Completed 500000 out of 5000000 steps (10%)
04:35:16:WU01:FS02:0x21:Completed 332800 out of 640000 steps (52%)
04:36:46:WU03:FS01:0x21:Completed 678400 out of 1280000 steps (53%)
04:38:20:WU01:FS02:0x21:Completed 339200 out of 640000 steps (53%)
04:39:08:WU00:FS03:0x17:Completed 2050000 out of 5000000 steps (41%)
04:39:38:WU03:FS01:0x21:Completed 691200 out of 1280000 steps (54%)
04:40:15:WU04:FS04:0x17:Completed 550000 out of 5000000 steps (11%)
04:41:24:WU01:FS02:0x21:Completed 345600 out of 640000 steps (54%)
04:42:30:WU03:FS01:0x21:Completed 704000 out of 1280000 steps (55%)
04:44:28:WU01:FS02:0x21:Completed 352000 out of 640000 steps (55%)
04:45:05:WU00:FS03:0x17:Completed 2100000 out of 5000000 steps (42%)
04:45:21:WU03:FS01:0x21:Completed 716800 out of 1280000 steps (56%)
04:46:24:WU04:FS04:0x17:Completed 600000 out of 5000000 steps (12%)
04:47:33:WU01:FS02:0x21:Completed 358400 out of 640000 steps (56%)
04:48:10:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
04:48:10:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
04:48:10:WU02:FS04:Connecting to 140.163.4.233:8080
04:48:29:WU02:FS04:Upload 0.48%
04:48:29:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
04:48:29:WU02:FS04:Trying to send results to collection server
04:48:29:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
04:48:29:WU02:FS04:Connecting to 140.163.4.241:8080
04:48:29:WU03:FS01:0x21:Completed 729600 out of 1280000 steps (57%)
04:48:48:WU02:FS04:Upload 0.48%
04:48:48:ERROR:WU02:FS04:Exception: Transfer failed
04:50:37:WU01:FS02:0x21:Completed 364800 out of 640000 steps (57%)
04:51:15:WU00:FS03:0x17:Completed 2150000 out of 5000000 steps (43%)
04:51:21:WU03:FS01:0x21:Completed 742400 out of 1280000 steps (58%)
04:52:45:WU04:FS04:0x17:Completed 650000 out of 5000000 steps (13%)
04:53:41:WU01:FS02:0x21:Completed 371200 out of 640000 steps (58%)
04:54:13:WU03:FS01:0x21:Completed 755200 out of 1280000 steps (59%)
04:56:45:WU01:FS02:0x21:Completed 377600 out of 640000 steps (59%)
04:57:05:WU03:FS01:0x21:Completed 768000 out of 1280000 steps (60%)
04:57:11:WU00:FS03:0x17:Completed 2200000 out of 5000000 steps (44%)
04:58:53:WU04:FS04:0x17:Completed 700000 out of 5000000 steps (14%)
04:59:50:WU01:FS02:0x21:Completed 384000 out of 640000 steps (60%)
04:59:57:WU03:FS01:0x21:Completed 780800 out of 1280000 steps (61%)
05:02:37:WU03:FS01:0x21:Completed 793600 out of 1280000 steps (62%)
05:02:42:WU01:FS02:0x21:Completed 390400 out of 640000 steps (61%)
05:02:57:WU00:FS03:0x17:Completed 2250000 out of 5000000 steps (45%)
05:04:50:WU04:FS04:0x17:Completed 750000 out of 5000000 steps (15%)
05:05:44:WU03:FS01:0x21:Completed 806400 out of 1280000 steps (63%)
05:05:47:WU01:FS02:0x21:Completed 396800 out of 640000 steps (62%)
05:08:36:WU03:FS01:0x21:Completed 819200 out of 1280000 steps (64%)
05:09:07:WU00:FS03:0x17:Completed 2300000 out of 5000000 steps (46%)
05:09:25:WU01:FS02:0x21:Completed 403200 out of 640000 steps (63%)
05:11:11:WU04:FS04:0x17:Completed 800000 out of 5000000 steps (16%)
05:11:28:WU03:FS01:0x21:Completed 832000 out of 1280000 steps (65%)
05:12:29:WU01:FS02:0x21:Completed 409600 out of 640000 steps (64%)
05:14:20:WU03:FS01:0x21:Completed 844800 out of 1280000 steps (66%)
05:15:04:WU00:FS03:0x17:Completed 2350000 out of 5000000 steps (47%)
05:15:34:WU01:FS02:0x21:Completed 416000 out of 640000 steps (65%)
05:17:12:WU03:FS01:0x21:Completed 857600 out of 1280000 steps (67%)
05:17:20:WU04:FS04:0x17:Completed 850000 out of 5000000 steps (17%)
******************************* Date: 2015-09-06 *******************************
05:18:38:WU01:FS02:0x21:Completed 422400 out of 640000 steps (66%)
05:20:03:WU03:FS01:0x21:Completed 870400 out of 1280000 steps (68%)
05:21:13:WU00:FS03:0x17:Completed 2400000 out of 5000000 steps (48%)
05:21:42:WU01:FS02:0x21:Completed 428800 out of 640000 steps (67%)
05:23:11:WU03:FS01:0x21:Completed 883200 out of 1280000 steps (69%)
05:23:41:WU04:FS04:0x17:Completed 900000 out of 5000000 steps (18%)
05:24:47:WU01:FS02:0x21:Completed 435200 out of 640000 steps (68%)
05:26:02:WU03:FS01:0x21:Completed 896000 out of 1280000 steps (70%)
05:27:10:WU00:FS03:0x17:Completed 2450000 out of 5000000 steps (49%)
05:27:51:WU01:FS02:0x21:Completed 441600 out of 640000 steps (69%)
05:28:54:WU03:FS01:0x21:Completed 908800 out of 1280000 steps (71%)
05:29:50:WU04:FS04:0x17:Completed 950000 out of 5000000 steps (19%)
05:30:46:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
05:30:46:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
05:30:46:WU09:FS01:Connecting to 171.64.65.98:8080
05:30:55:WU01:FS02:0x21:Completed 448000 out of 640000 steps (70%)
05:31:05:WU09:FS01:Upload 0.42%
05:31:05:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
05:31:05:WU09:FS01:Trying to send results to collection server
05:31:05:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
05:31:05:WU09:FS01:Connecting to 171.65.103.160:8080
05:31:24:WU09:FS01:Upload 0.42%
05:31:25:ERROR:WU09:FS01:Exception: Transfer failed
05:31:46:WU03:FS01:0x21:Completed 921600 out of 1280000 steps (72%)
05:33:07:WU00:FS03:0x17:Completed 2500000 out of 5000000 steps (50%)
05:34:00:WU01:FS02:0x21:Completed 454400 out of 640000 steps (71%)
05:34:38:WU03:FS01:0x21:Completed 934400 out of 1280000 steps (73%)
05:35:09:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
05:35:09:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
05:35:09:WU02:FS04:Connecting to 140.163.4.233:8080
05:35:31:WU02:FS04:Upload 0.48%
05:35:31:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
05:35:31:WU02:FS04:Trying to send results to collection server
05:35:31:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
05:35:31:WU02:FS04:Connecting to 140.163.4.241:8080
05:35:50:WU02:FS04:Upload 0.48%
05:35:50:ERROR:WU02:FS04:Exception: Transfer failed
05:35:58:WU04:FS04:0x17:Completed 1000000 out of 5000000 steps (20%)
05:37:04:WU01:FS02:0x21:Completed 460800 out of 640000 steps (72%)
05:37:31:WU03:FS01:0x21:Completed 947200 out of 1280000 steps (74%)
05:39:17:WU00:FS03:0x17:Completed 2550000 out of 5000000 steps (51%)
05:40:08:WU01:FS02:0x21:Completed 467200 out of 640000 steps (73%)
05:40:23:WU03:FS01:0x21:Completed 960000 out of 1280000 steps (75%)
05:40:35:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
05:40:35:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
05:40:35:WU08:FS02:Connecting to 140.163.4.233:8080
05:42:19:WU04:FS04:0x17:Completed 1050000 out of 5000000 steps (21%)
05:43:07:WU08:FS02:Upload 0.90%
05:43:07:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
05:43:07:WU08:FS02:Trying to send results to collection server
05:43:07:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
05:43:07:WU08:FS02:Connecting to 140.163.4.241:8080
05:43:12:WU01:FS02:0x21:Completed 473600 out of 640000 steps (74%)
05:43:26:WU08:FS02:Upload 0.90%
05:43:26:ERROR:WU08:FS02:Exception: Transfer failed
05:43:30:WU03:FS01:0x21:Completed 972800 out of 1280000 steps (76%)
05:45:14:WU00:FS03:0x17:Completed 2600000 out of 5000000 steps (52%)
05:46:15:WU01:FS02:0x21:Completed 480000 out of 640000 steps (75%)
05:46:22:WU03:FS01:0x21:Completed 985600 out of 1280000 steps (77%)
05:48:28:WU04:FS04:0x17:Completed 1100000 out of 5000000 steps (22%)
05:49:15:WU03:FS01:0x21:Completed 998400 out of 1280000 steps (78%)
05:49:55:WU01:FS02:0x21:Completed 486400 out of 640000 steps (76%)
05:51:23:WU00:FS03:0x17:Completed 2650000 out of 5000000 steps (53%)
05:52:07:WU03:FS01:0x21:Completed 1011200 out of 1280000 steps (79%)
05:52:59:WU01:FS02:0x21:Completed 492800 out of 640000 steps (77%)
05:54:49:WU04:FS04:0x17:Completed 1150000 out of 5000000 steps (23%)
05:54:59:WU03:FS01:0x21:Completed 1024000 out of 1280000 steps (80%)
05:56:03:WU01:FS02:0x21:Completed 499200 out of 640000 steps (78%)
05:57:20:WU00:FS03:0x17:Completed 2700000 out of 5000000 steps (54%)
05:57:51:WU03:FS01:0x21:Completed 1036800 out of 1280000 steps (81%)
05:59:09:WU01:FS02:0x21:Completed 505600 out of 640000 steps (79%)
06:00:58:WU04:FS04:0x17:Completed 1200000 out of 5000000 steps (24%)
06:00:59:WU03:FS01:0x21:Completed 1049600 out of 1280000 steps (82%)
06:02:13:WU01:FS02:0x21:Completed 512000 out of 640000 steps (80%)
06:03:17:WU00:FS03:0x17:Completed 2750000 out of 5000000 steps (55%)
06:03:25:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
06:03:25:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
06:03:25:WU07:FS03:Connecting to 171.64.65.98:8080
06:03:52:WU03:FS01:0x21:Completed 1062400 out of 1280000 steps (83%)
06:04:22:WU07:FS03:Upload 0.65%
06:04:23:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
06:04:23:WU07:FS03:Trying to send results to collection server
06:04:23:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
06:04:23:WU07:FS03:Connecting to 171.65.103.160:8080
06:04:45:WU07:FS03:Upload 0.65%
06:04:45:ERROR:WU07:FS03:Exception: Transfer failed
06:05:18:WU01:FS02:0x21:Completed 518400 out of 640000 steps (81%)
06:06:44:WU03:FS01:0x21:Completed 1075200 out of 1280000 steps (84%)
06:07:06:WU04:FS04:0x17:Completed 1250000 out of 5000000 steps (25%)
06:08:22:WU01:FS02:0x21:Completed 524800 out of 640000 steps (82%)
06:09:27:WU00:FS03:0x17:Completed 2800000 out of 5000000 steps (56%)
06:09:36:WU03:FS01:0x21:Completed 1088000 out of 1280000 steps (85%)
06:11:26:WU01:FS02:0x21:Completed 531200 out of 640000 steps (83%)
06:12:28:WU03:FS01:0x21:Completed 1100800 out of 1280000 steps (86%)
06:13:27:WU04:FS04:0x17:Completed 1300000 out of 5000000 steps (26%)
06:14:31:WU01:FS02:0x21:Completed 537600 out of 640000 steps (84%)
06:15:21:WU03:FS01:0x21:Completed 1113600 out of 1280000 steps (87%)
06:15:24:WU00:FS03:0x17:Completed 2850000 out of 5000000 steps (57%)
06:17:36:WU01:FS02:0x21:Completed 544000 out of 640000 steps (85%)
06:18:29:WU03:FS01:0x21:Completed 1126400 out of 1280000 steps (88%)
06:19:36:WU04:FS04:0x17:Completed 1350000 out of 5000000 steps (27%)
06:20:41:WU01:FS02:0x21:Completed 550400 out of 640000 steps (86%)
06:21:21:WU03:FS01:0x21:Completed 1139200 out of 1280000 steps (89%)
06:21:33:WU00:FS03:0x17:Completed 2900000 out of 5000000 steps (58%)
06:23:46:WU01:FS02:0x21:Completed 556800 out of 640000 steps (87%)
06:24:13:WU03:FS01:0x21:Completed 1152000 out of 1280000 steps (90%)
06:25:57:WU04:FS04:0x17:Completed 1400000 out of 5000000 steps (28%)
06:27:05:WU03:FS01:0x21:Completed 1164800 out of 1280000 steps (91%)
06:27:25:WU01:FS02:0x21:Completed 563200 out of 640000 steps (88%)
06:27:31:WU00:FS03:0x17:Completed 2950000 out of 5000000 steps (59%)
06:29:58:WU03:FS01:0x21:Completed 1177600 out of 1280000 steps (92%)
06:30:30:WU01:FS02:0x21:Completed 569600 out of 640000 steps (89%)
06:32:06:WU04:FS04:0x17:Completed 1450000 out of 5000000 steps (29%)
06:32:49:WU03:FS01:0x21:Completed 1190400 out of 1280000 steps (93%)
06:33:28:WU00:FS03:0x17:Completed 3000000 out of 5000000 steps (60%)
06:33:34:WU01:FS02:0x21:Completed 576000 out of 640000 steps (90%)
06:35:57:WU03:FS01:0x21:Completed 1203200 out of 1280000 steps (94%)
06:36:39:WU01:FS02:0x21:Completed 582400 out of 640000 steps (91%)
06:38:14:WU04:FS04:0x17:Completed 1500000 out of 5000000 steps (30%)
06:38:49:WU03:FS01:0x21:Completed 1216000 out of 1280000 steps (95%)
06:39:38:WU00:FS03:0x17:Completed 3050000 out of 5000000 steps (61%)
06:39:44:WU01:FS02:0x21:Completed 588800 out of 640000 steps (92%)
06:41:41:WU03:FS01:0x21:Completed 1228800 out of 1280000 steps (96%)
06:42:49:WU01:FS02:0x21:Completed 595200 out of 640000 steps (93%)
06:44:32:WU03:FS01:0x21:Completed 1241600 out of 1280000 steps (97%)
06:44:35:WU04:FS04:0x17:Completed 1550000 out of 5000000 steps (31%)
06:45:35:WU00:FS03:0x17:Completed 3100000 out of 5000000 steps (62%)
06:45:54:WU01:FS02:0x21:Completed 601600 out of 640000 steps (94%)
06:47:24:WU03:FS01:0x21:Completed 1254400 out of 1280000 steps (98%)
06:48:58:WU01:FS02:0x21:Completed 608000 out of 640000 steps (95%)
06:50:16:WU03:FS01:0x21:Completed 1267200 out of 1280000 steps (99%)
06:50:16:WU05:FS01:Connecting to 171.67.108.200:80
06:50:18:WU05:FS01:Assigned to work server 171.64.65.98
06:50:18:WU05:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:Tahiti XT [Radeon HD 7970] from 171.64.65.98
06:50:18:WU05:FS01:Connecting to 171.64.65.98:8080
06:50:18:WU05:FS01:Downloading 15.70MiB
06:50:24:WU05:FS01:Download 40.61%
06:50:30:WU05:FS01:Download 57.73%
06:50:35:WU05:FS01:Download complete
06:50:35:WU05:FS01:Received Unit: id:05 state:DOWNLOAD error:NO_ERROR project:9704 run:0 clone:7 gen:385 core:0x21 unit:0x000001c5ab404162551ce8cc21e57cf1
06:50:44:WU04:FS04:0x17:Completed 1600000 out of 5000000 steps (32%)
06:51:10:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
06:51:10:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
06:51:10:WU02:FS04:Connecting to 140.163.4.233:8080
06:51:29:WU02:FS04:Upload 0.48%
06:51:29:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
06:51:29:WU02:FS04:Trying to send results to collection server
06:51:29:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
06:51:29:WU02:FS04:Connecting to 140.163.4.241:8080
06:51:44:WU00:FS03:0x17:Completed 3150000 out of 5000000 steps (63%)
06:51:48:WU02:FS04:Upload 0.48%
06:51:48:ERROR:WU02:FS04:Exception: Transfer failed
06:52:03:WU01:FS02:0x21:Completed 614400 out of 640000 steps (96%)
06:53:08:WU03:FS01:0x21:Completed 1280000 out of 1280000 steps (100%)
06:53:24:WU03:FS01:0x21:Saving result file logfile_01.txt
06:53:24:WU03:FS01:0x21:Saving result file checkpointState.xml
06:53:26:WU03:FS01:0x21:Saving result file checkpt.crc
06:53:26:WU03:FS01:0x21:Saving result file log.txt
06:53:26:WU03:FS01:0x21:Saving result file positions.xtc
06:53:26:WU03:FS01:0x21:[email protected] Core Shutdown: FINISHED_UNIT
06:53:27:WU03:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
06:53:27:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
06:53:27:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
06:53:27:WU03:FS01:Connecting to 171.64.65.98:8080
06:53:27:WU05:FS01:Starting
06:53:27:WU05:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 05 -suffix 01 -version 704 -lifeline 3616 -checkpoint 15 -gpu 0 -gpu-vendor ati
06:53:27:WU05:FS01:Started FahCore on PID 3196
06:53:27:WU05:FS01:Core PID:2728
06:53:27:WU05:FS01:FahCore 0x21 started
06:53:28:WU05:FS01:0x21:*********************** Log Started 2015-09-06T06:53:27Z ***********************
06:53:28:WU05:FS01:0x21:Project: 9704 (Run 0, Clone 7, Gen 385)
06:53:28:WU05:FS01:0x21:Unit: 0x000001c5ab404162551ce8cc21e57cf1
06:53:28:WU05:FS01:0x21:CPU: 0x00000000000000000000000000000000
06:53:28:WU05:FS01:0x21:Machine: 1
06:53:28:WU05:FS01:0x21:Reading tar file core.xml
06:53:28:WU05:FS01:0x21:Reading tar file system.xml
06:53:30:WU05:FS01:0x21:Reading tar file integrator.xml
06:53:30:WU05:FS01:0x21:Reading tar file state.xml
06:53:32:WU05:FS01:0x21:Digital signatures verified
06:53:32:WU05:FS01:0x21:[email protected] GPU Core21 [email protected] Core
06:53:32:WU05:FS01:0x21:Version 0.0.11
06:53:49:WU03:FS01:Upload 0.65%
06:53:49:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
06:53:49:WU03:FS01:Trying to send results to collection server
06:53:49:WU03:FS01:Uploading 9.56MiB to 171.65.103.160
06:53:49:WU03:FS01:Connecting to 171.65.103.160:8080
06:54:11:WU03:FS01:Upload 0.65%
06:54:11:ERROR:WU03:FS01:Exception: Transfer failed
06:54:12:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
06:54:12:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
06:54:12:WU03:FS01:Connecting to 171.64.65.98:8080
06:54:31:WU03:FS01:Upload 0.65%
06:54:31:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
06:54:31:WU03:FS01:Trying to send results to collection server
06:54:31:WU03:FS01:Uploading 9.56MiB to 171.65.103.160
06:54:31:WU03:FS01:Connecting to 171.65.103.160:8080
06:54:50:WU03:FS01:Upload 0.65%
06:54:50:ERROR:WU03:FS01:Exception: Transfer failed
06:55:12:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
06:55:12:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
06:55:12:WU03:FS01:Connecting to 171.64.65.98:8080
06:55:12:WU01:FS02:0x21:Completed 620800 out of 640000 steps (97%)
06:55:34:WU03:FS01:Upload 0.65%
06:55:34:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
06:55:34:WU03:FS01:Trying to send results to collection server
06:55:34:WU03:FS01:Uploading 9.56MiB to 171.65.103.160
06:55:34:WU03:FS01:Connecting to 171.65.103.160:8080
06:55:40:WU05:FS01:0x21:Completed 0 out of 640000 steps (0%)
06:55:40:WU05:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
06:55:53:WU03:FS01:Upload 0.65%
06:55:53:ERROR:WU03:FS01:Exception: Transfer failed
06:56:49:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
06:56:49:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
06:56:49:WU03:FS01:Connecting to 171.64.65.98:8080
06:57:07:WU04:FS04:0x17:Completed 1650000 out of 5000000 steps (33%)
06:57:47:WU00:FS03:0x17:Completed 3200000 out of 5000000 steps (64%)
06:58:16:WU01:FS02:0x21:Completed 627200 out of 640000 steps (98%)
06:59:18:WU05:FS01:0x21:Completed 6400 out of 640000 steps (1%)
06:59:25:WU03:FS01:Upload 0.65%
06:59:25:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
06:59:25:WU03:FS01:Trying to send results to collection server
06:59:25:WU03:FS01:Uploading 9.56MiB to 171.65.103.160
06:59:25:WU03:FS01:Connecting to 171.65.103.160:8080
06:59:44:WU03:FS01:Upload 0.65%
06:59:44:ERROR:WU03:FS01:Exception: Transfer failed
06:59:44:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
06:59:44:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
06:59:44:WU03:FS01:Connecting to 171.64.65.98:8080
07:01:21:WU01:FS02:0x21:Completed 633600 out of 640000 steps (99%)
07:01:22:WU06:FS02:Connecting to 171.67.108.200:80
07:01:22:WU06:FS02:Assigned to work server 171.64.65.98
07:01:22:WU06:FS02:Requesting new work unit for slot 02: RUNNING gpu:1:Tahiti XT [Radeon HD 7970] from 171.64.65.98
07:01:22:WU06:FS02:Connecting to 171.64.65.98:8080
07:01:51:WU03:FS01:Upload 0.65%
07:01:51:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
07:01:51:WU03:FS01:Trying to send results to collection server
07:01:51:WU03:FS01:Uploading 9.56MiB to 171.65.103.160
07:01:51:WU03:FS01:Connecting to 171.65.103.160:8080
07:02:25:WU05:FS01:0x21:Completed 12800 out of 640000 steps (2%)
07:02:30:ERROR:WU06:FS02:Exception: 10002: Received short response, expected 512 bytes, got 0
07:02:30:WU06:FS02:Connecting to 171.67.108.200:80
07:02:31:WU06:FS02:Assigned to work server 140.163.4.233
07:02:31:WU06:FS02:Requesting new work unit for slot 02: RUNNING gpu:1:Tahiti XT [Radeon HD 7970] from 140.163.4.233
07:02:31:WU06:FS02:Connecting to 140.163.4.233:8080
07:02:50:ERROR:WU06:FS02:Exception: 10002: Received short response, expected 512 bytes, got 0
07:03:15:WU04:FS04:0x17:Completed 1700000 out of 5000000 steps (34%)
07:03:30:WU06:FS02:Connecting to 171.67.108.200:80
07:03:30:WU06:FS02:Assigned to work server 140.163.4.233
07:03:31:WU06:FS02:Requesting new work unit for slot 02: RUNNING gpu:1:Tahiti XT [Radeon HD 7970] from 140.163.4.233
07:03:31:WU06:FS02:Connecting to 140.163.4.233:8080
07:03:32:WU06:FS02:Downloading 2.29MiB
07:03:32:WU06:FS02:Download complete
07:03:32:WU06:FS02:Received Unit: id:06 state:DOWNLOAD error:NO_ERROR project:10466 run:0 clone:204 gen:258 core:0x17 unit:0x000001c9538b3db953822ec8a1b6f38b
07:03:44:WU00:FS03:0x17:Completed 3250000 out of 5000000 steps (65%)
07:04:26:WU01:FS02:0x21:Completed 640000 out of 640000 steps (100%)
07:04:27:WU03:FS01:Upload 0.65%
07:04:27:ERROR:WU03:FS01:Exception: Transfer failed
07:04:27:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
07:04:27:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
07:04:27:WU03:FS01:Connecting to 171.64.65.98:8080
07:04:46:WU03:FS01:Upload 0.65%
07:04:46:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
07:04:46:WU03:FS01:Trying to send results to collection server
07:04:46:WU03:FS01:Uploading 9.56MiB to 171.65.103.160
07:04:46:WU03:FS01:Connecting to 171.65.103.160:8080
07:05:00:WU01:FS02:0x21:Saving result file logfile_01.txt
07:05:00:WU01:FS02:0x21:Saving result file checkpointState.xml
07:05:04:WU01:FS02:0x21:Saving result file checkpt.crc
07:05:04:WU01:FS02:0x21:Saving result file log.txt
07:05:04:WU01:FS02:0x21:Saving result file positions.xtc
07:05:05:WU01:FS02:0x21:[email protected] Core Shutdown: FINISHED_UNIT
07:05:05:WU03:FS01:Upload 0.65%
07:05:06:ERROR:WU03:FS01:Exception: Transfer failed
07:05:06:WU01:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
07:05:06:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
07:05:06:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
07:05:06:WU01:FS02:Connecting to 171.64.65.98:8080
07:05:06:WU06:FS02:Starting
07:05:06:WU06:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 06 -suffix 01 -version 704 -lifeline 3616 -checkpoint 15 -gpu 1 -gpu-vendor ati
07:05:06:WU06:FS02:Started FahCore on PID 324
07:05:06:WU06:FS02:Core PID:3740
07:05:06:WU06:FS02:FahCore 0x17 started
07:05:06:WU06:FS02:0x17:*********************** Log Started 2015-09-06T07:05:06Z ***********************
07:05:06:WU06:FS02:0x17:Project: 10466 (Run 0, Clone 204, Gen 258)
07:05:06:WU06:FS02:0x17:Unit: 0x000001c9538b3db953822ec8a1b6f38b
07:05:06:WU06:FS02:0x17:CPU: 0x00000000000000000000000000000000
07:05:06:WU06:FS02:0x17:Machine: 2
07:05:06:WU06:FS02:0x17:Reading tar file state.xml
07:05:07:WU06:FS02:0x17:Reading tar file system.xml
07:05:07:WU06:FS02:0x17:Reading tar file integrator.xml
07:05:07:WU06:FS02:0x17:Reading tar file core.xml
07:05:07:WU06:FS02:0x17:Digital signatures verified
07:05:07:WU06:FS02:0x17:[email protected] GPU core17
07:05:07:WU06:FS02:0x17:Version 0.0.52
07:05:25:WU01:FS02:Upload 0.42%
07:05:25:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
07:05:25:WU01:FS02:Trying to send results to collection server
07:05:25:WU01:FS02:Uploading 14.98MiB to 171.65.103.160
07:05:25:WU01:FS02:Connecting to 171.65.103.160:8080
07:05:33:WU05:FS01:0x21:Completed 19200 out of 640000 steps (3%)
07:05:48:WU06:FS02:0x17:Completed 0 out of 5000000 steps (0%)
07:05:48:WU06:FS02:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
07:08:35:WU01:FS02:Upload 0.42%
07:08:35:ERROR:WU01:FS02:Exception: Transfer failed
07:08:35:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
07:08:35:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
07:08:35:WU01:FS02:Connecting to 171.64.65.98:8080
07:08:41:WU05:FS01:0x21:Completed 25600 out of 640000 steps (4%)
07:08:54:WU01:FS02:Upload 0.42%
07:08:54:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
07:08:54:WU01:FS02:Trying to send results to collection server
07:08:54:WU01:FS02:Uploading 14.98MiB to 171.65.103.160
07:08:54:WU01:FS02:Connecting to 171.65.103.160:8080
07:09:22:WU06:FS02:0x17:Completed 50000 out of 5000000 steps (1%)
07:09:25:WU04:FS04:0x17:Completed 1750000 out of 5000000 steps (35%)
07:09:54:WU00:FS03:0x17:Completed 3300000 out of 5000000 steps (66%)
07:11:19:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
07:11:19:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
07:11:19:WU03:FS01:Connecting to 171.64.65.98:8080
07:11:38:WU03:FS01:Upload 0.65%
07:11:38:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
07:11:38:WU03:FS01:Trying to send results to collection server
07:11:38:WU03:FS01:Uploading 9.56MiB to 171.65.103.160
07:11:38:WU03:FS01:Connecting to 171.65.103.160:8080
07:11:49:WU05:FS01:0x21:Completed 32000 out of 640000 steps (5%)
07:12:04:WU01:FS02:Upload 0.42%
07:12:04:ERROR:WU01:FS02:Exception: Transfer failed
07:12:05:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
07:12:05:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
07:12:05:WU01:FS02:Connecting to 171.64.65.98:8080
07:12:35:WU03:FS01:Upload 0.65%
07:12:35:ERROR:WU03:FS01:Exception: Transfer failed
07:12:51:WU06:FS02:0x17:Completed 100000 out of 5000000 steps (2%)
07:14:57:WU05:FS01:0x21:Completed 38400 out of 640000 steps (6%)
07:15:46:WU04:FS04:0x17:Completed 1800000 out of 5000000 steps (36%)
07:15:51:WU00:FS03:0x17:Completed 3350000 out of 5000000 steps (67%)
07:16:26:WU06:FS02:0x17:Completed 150000 out of 5000000 steps (3%)
07:18:05:WU05:FS01:0x21:Completed 44800 out of 640000 steps (7%)
07:18:37:WU01:FS02:Upload 0.42%
07:18:37:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
07:18:37:WU01:FS02:Trying to send results to collection server
07:18:37:WU01:FS02:Uploading 14.98MiB to 171.65.103.160
07:18:37:WU01:FS02:Connecting to 171.65.103.160:8080
07:18:57:WU01:FS02:Upload 0.42%
07:18:57:ERROR:WU01:FS02:Exception: Transfer failed
07:18:57:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
07:18:57:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
07:18:57:WU01:FS02:Connecting to 171.64.65.98:8080
07:19:19:WU01:FS02:Upload 0.42%
07:19:19:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
07:19:19:WU01:FS02:Trying to send results to collection server
07:19:19:WU01:FS02:Uploading 14.98MiB to 171.65.103.160
07:19:19:WU01:FS02:Connecting to 171.65.103.160:8080
07:19:55:WU06:FS02:0x17:Completed 200000 out of 5000000 steps (4%)
07:21:12:WU05:FS01:0x21:Completed 51200 out of 640000 steps (8%)
07:21:55:WU04:FS04:0x17:Completed 1850000 out of 5000000 steps (37%)
07:22:01:WU00:FS03:0x17:Completed 3400000 out of 5000000 steps (68%)
07:22:24:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
07:22:24:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
07:22:24:WU03:FS01:Connecting to 171.64.65.98:8080
07:22:46:WU03:FS01:Upload 0.65%
07:22:47:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
07:22:47:WU03:FS01:Trying to send results to collection server
07:22:47:WU03:FS01:Uploading 9.56MiB to 171.65.103.160
07:22:47:WU03:FS01:Connecting to 171.65.103.160:8080
07:23:06:WU03:FS01:Upload 0.65%
07:23:06:ERROR:WU03:FS01:Exception: Transfer failed
07:23:24:WU06:FS02:0x17:Completed 250000 out of 5000000 steps (5%)
07:24:12:WU01:FS02:Upload 0.42%
07:24:12:ERROR:WU01:FS02:Exception: Transfer failed
07:24:12:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
07:24:12:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
07:24:12:WU01:FS02:Connecting to 171.64.65.98:8080
07:24:20:WU05:FS01:0x21:Completed 57600 out of 640000 steps (9%)
07:24:33:WARNING:WU01:FS02:WorkServer connection failed on port 8080 trying 80
07:24:33:WU01:FS02:Connecting to 171.64.65.98:80
07:26:59:WU06:FS02:0x17:Completed 300000 out of 5000000 steps (6%)
07:27:28:WU05:FS01:0x21:Completed 64000 out of 640000 steps (10%)
07:27:58:WU00:FS03:0x17:Completed 3450000 out of 5000000 steps (69%)
07:28:16:WU04:FS04:0x17:Completed 1900000 out of 5000000 steps (38%)
07:29:39:WU01:FS02:Upload 0.42%
07:29:40:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
07:29:40:WU01:FS02:Trying to send results to collection server
07:29:40:WU01:FS02:Uploading 14.98MiB to 171.65.103.160
07:29:40:WU01:FS02:Connecting to 171.65.103.160:8080
07:30:28:WU06:FS02:0x17:Completed 350000 out of 5000000 steps (7%)
07:30:35:WU05:FS01:0x21:Completed 70400 out of 640000 steps (11%)
07:30:37:WU01:FS02:Upload 0.42%
07:30:37:ERROR:WU01:FS02:Exception: Transfer failed
07:30:37:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
07:30:37:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
07:30:37:WU01:FS02:Connecting to 171.64.65.98:8080
07:30:56:WU01:FS02:Upload 0.42%
07:30:56:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
07:30:56:WU01:FS02:Trying to send results to collection server
07:30:56:WU01:FS02:Uploading 14.98MiB to 171.65.103.160
07:30:56:WU01:FS02:Connecting to 171.65.103.160:8080
07:31:15:WU01:FS02:Upload 0.42%
07:31:15:ERROR:WU01:FS02:Exception: Transfer failed
07:33:43:WU05:FS01:0x21:Completed 76800 out of 640000 steps (12%)
07:33:46:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
07:33:46:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
07:33:46:WU09:FS01:Connecting to 171.64.65.98:8080
07:33:55:WU00:FS03:0x17:Completed 3500000 out of 5000000 steps (70%)
07:34:03:WU06:FS02:0x17:Completed 400000 out of 5000000 steps (8%)
07:34:05:WU09:FS01:Upload 0.42%
07:34:05:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
07:34:05:WU09:FS01:Trying to send results to collection server
07:34:05:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
07:34:05:WU09:FS01:Connecting to 171.65.103.160:8080
07:34:24:WU09:FS01:Upload 0.42%
07:34:24:ERROR:WU09:FS01:Exception: Transfer failed
07:34:25:WU04:FS04:0x17:Completed 1950000 out of 5000000 steps (39%)
07:37:25:WU05:FS01:0x21:Completed 83200 out of 640000 steps (13%)
07:37:29:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
07:37:29:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
07:37:29:WU01:FS02:Connecting to 171.64.65.98:8080
07:37:32:WU06:FS02:0x17:Completed 450000 out of 5000000 steps (9%)
07:37:48:WU01:FS02:Upload 0.42%
07:37:48:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
07:37:48:WU01:FS02:Trying to send results to collection server
07:37:48:WU01:FS02:Uploading 14.98MiB to 171.65.103.160
07:37:48:WU01:FS02:Connecting to 171.65.103.160:8080
07:38:07:WU01:FS02:Upload 0.42%
07:38:07:ERROR:WU01:FS02:Exception: Transfer failed
07:40:05:WU00:FS03:0x17:Completed 3550000 out of 5000000 steps (71%)
07:40:21:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
07:40:21:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
07:40:21:WU03:FS01:Connecting to 171.64.65.98:8080
07:40:33:WU05:FS01:0x21:Completed 89600 out of 640000 steps (14%)
07:40:33:WU04:FS04:0x17:Completed 2000000 out of 5000000 steps (40%)
07:40:40:WU03:FS01:Upload 0.65%
07:40:40:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
07:40:40:WU03:FS01:Trying to send results to collection server
07:40:40:WU03:FS01:Uploading 9.56MiB to 171.65.103.160
07:40:40:WU03:FS01:Connecting to 171.65.103.160:8080
07:40:59:WU03:FS01:Upload 0.65%
07:40:59:ERROR:WU03:FS01:Exception: Transfer failed
07:41:01:WU06:FS02:0x17:Completed 500000 out of 5000000 steps (10%)
07:43:35:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
07:43:35:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
07:43:35:WU08:FS02:Connecting to 140.163.4.233:8080
07:43:41:WU05:FS01:0x21:Completed 96000 out of 640000 steps (15%)
07:44:36:WU06:FS02:0x17:Completed 550000 out of 5000000 steps (11%)
07:46:02:WU00:FS03:0x17:Completed 3600000 out of 5000000 steps (72%)
07:46:48:WU05:FS01:0x21:Completed 102400 out of 640000 steps (16%)
07:46:55:WU04:FS04:0x17:Completed 2050000 out of 5000000 steps (41%)
07:47:48:WU08:FS02:Upload 0.90%
07:47:48:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
07:47:48:WU08:FS02:Trying to send results to collection server
07:47:48:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
07:47:48:WU08:FS02:Connecting to 140.163.4.241:8080
07:48:05:WU06:FS02:0x17:Completed 600000 out of 5000000 steps (12%)
07:48:07:WU08:FS02:Upload 0.90%
07:48:07:ERROR:WU08:FS02:Exception: Transfer failed
07:48:34:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
07:48:34:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
07:48:34:WU01:FS02:Connecting to 171.64.65.98:8080
07:49:56:WU05:FS01:0x21:Completed 108800 out of 640000 steps (17%)
07:51:40:WU06:FS02:0x17:Completed 650000 out of 5000000 steps (13%)
07:52:11:WU00:FS03:0x17:Completed 3650000 out of 5000000 steps (73%)
07:53:03:WU04:FS04:0x17:Completed 2100000 out of 5000000 steps (42%)
07:53:04:WU05:FS01:0x21:Completed 115200 out of 640000 steps (18%)
07:53:44:WU01:FS02:Upload 0.42%
07:53:44:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
07:53:44:WU01:FS02:Trying to send results to collection server
07:53:44:WU01:FS02:Uploading 14.98MiB to 171.65.103.160
07:53:44:WU01:FS02:Connecting to 171.65.103.160:8080
07:54:03:WU01:FS02:Upload 0.42%
07:54:03:ERROR:WU01:FS02:Exception: Transfer failed
07:55:09:WU06:FS02:0x17:Completed 700000 out of 5000000 steps (14%)
07:56:12:WU05:FS01:0x21:Completed 121600 out of 640000 steps (19%)
07:58:08:WU00:FS03:0x17:Completed 3700000 out of 5000000 steps (74%)
07:58:37:WU06:FS02:0x17:Completed 750000 out of 5000000 steps (15%)
07:59:20:WU05:FS01:0x21:Completed 128000 out of 640000 steps (20%)
07:59:24:WU04:FS04:0x17:Completed 2150000 out of 5000000 steps (43%)
08:02:12:WU06:FS02:0x17:Completed 800000 out of 5000000 steps (16%)
08:02:28:WU05:FS01:0x21:Completed 134400 out of 640000 steps (21%)
08:04:05:WU00:FS03:0x17:Completed 3750000 out of 5000000 steps (75%)
08:05:33:WU04:FS04:0x17:Completed 2200000 out of 5000000 steps (44%)
08:05:36:WU05:FS01:0x21:Completed 140800 out of 640000 steps (22%)
08:05:41:WU06:FS02:0x17:Completed 850000 out of 5000000 steps (17%)
08:06:31:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
08:06:31:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
08:06:31:WU01:FS02:Connecting to 171.64.65.98:8080
08:08:43:WU05:FS01:0x21:Completed 147200 out of 640000 steps (23%)
08:09:16:WU06:FS02:0x17:Completed 900000 out of 5000000 steps (18%)
08:09:23:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
08:09:23:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
08:09:23:WU03:FS01:Connecting to 171.64.65.98:8080
08:10:15:WU00:FS03:0x17:Completed 3800000 out of 5000000 steps (76%)
08:10:25:WU01:FS02:Upload 0.42%
08:10:25:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
08:10:25:WU01:FS02:Trying to send results to collection server
08:10:25:WU01:FS02:Uploading 14.98MiB to 171.65.103.160
08:10:25:WU01:FS02:Connecting to 171.65.103.160:8080
08:11:29:WU03:FS01:Upload 0.65%
08:11:29:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
08:11:29:WU03:FS01:Trying to send results to collection server
08:11:29:WU03:FS01:Uploading 9.56MiB to 171.65.103.160
08:11:29:WU03:FS01:Connecting to 171.65.103.160:8080
08:11:35:WU01:FS02:Upload 0.42%
08:11:35:ERROR:WU01:FS02:Exception: Transfer failed
08:11:42:WU04:FS04:0x17:Completed 2250000 out of 5000000 steps (45%)
08:11:49:WU03:FS01:Upload 0.65%
08:11:49:ERROR:WU03:FS01:Exception: Transfer failed
08:11:51:WU05:FS01:0x21:Completed 153600 out of 640000 steps (24%)
08:12:45:WU06:FS02:0x17:Completed 950000 out of 5000000 steps (19%)
08:14:59:WU05:FS01:0x21:Completed 160000 out of 640000 steps (25%)
08:16:12:WU00:FS03:0x17:Completed 3850000 out of 5000000 steps (77%)
08:16:14:WU06:FS02:0x17:Completed 1000000 out of 5000000 steps (20%)
08:18:03:WU04:FS04:0x17:Completed 2300000 out of 5000000 steps (46%)
08:18:42:WU05:FS01:0x21:Completed 166400 out of 640000 steps (26%)
08:19:50:WU06:FS02:0x17:Completed 1050000 out of 5000000 steps (21%)
08:21:49:WU05:FS01:0x21:Completed 172800 out of 640000 steps (27%)
08:22:22:WU00:FS03:0x17:Completed 3900000 out of 5000000 steps (78%)
08:23:18:WU06:FS02:0x17:Completed 1100000 out of 5000000 steps (22%)
08:24:12:WU04:FS04:0x17:Completed 2350000 out of 5000000 steps (47%)
08:24:58:WU05:FS01:0x21:Completed 179200 out of 640000 steps (28%)
08:26:53:WU06:FS02:0x17:Completed 1150000 out of 5000000 steps (23%)
08:28:06:WU05:FS01:0x21:Completed 185600 out of 640000 steps (29%)
08:28:19:WU00:FS03:0x17:Completed 3950000 out of 5000000 steps (79%)
08:30:23:WU06:FS02:0x17:Completed 1200000 out of 5000000 steps (24%)
08:30:32:WU04:FS04:0x17:Completed 2400000 out of 5000000 steps (48%)
08:31:13:WU05:FS01:0x21:Completed 192000 out of 640000 steps (30%)
08:33:51:WU06:FS02:0x17:Completed 1250000 out of 5000000 steps (25%)
08:34:16:WU00:FS03:0x17:Completed 4000000 out of 5000000 steps (80%)
08:34:22:WU05:FS01:0x21:Completed 198400 out of 640000 steps (31%)
08:35:33:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
08:35:33:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
08:35:33:WU01:FS02:Connecting to 171.64.65.98:8080
08:36:41:WU04:FS04:0x17:Completed 2450000 out of 5000000 steps (49%)
08:37:26:WU06:FS02:0x17:Completed 1300000 out of 5000000 steps (26%)
08:37:30:WU05:FS01:0x21:Completed 204800 out of 640000 steps (32%)
08:38:46:WU01:FS02:Upload 0.42%
08:38:46:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
08:38:46:WU01:FS02:Trying to send results to collection server
08:38:46:WU01:FS02:Uploading 14.98MiB to 171.65.103.160
08:38:46:WU01:FS02:Connecting to 171.65.103.160:8080
08:40:26:WU00:FS03:0x17:Completed 4050000 out of 5000000 steps (81%)
08:40:38:WU05:FS01:0x21:Completed 211200 out of 640000 steps (33%)
08:40:55:WU06:FS02:0x17:Completed 1350000 out of 5000000 steps (27%)
08:42:50:WU04:FS04:0x17:Completed 2500000 out of 5000000 steps (50%)
08:43:46:WU05:FS01:0x21:Completed 217600 out of 640000 steps (34%)
08:43:53:WU01:FS02:Upload 0.42%
08:43:53:ERROR:WU01:FS02:Exception: Transfer failed
08:44:31:WU06:FS02:0x17:Completed 1400000 out of 5000000 steps (28%)
08:46:23:WU00:FS03:0x17:Completed 4100000 out of 5000000 steps (82%)
08:46:54:WU05:FS01:0x21:Completed 224000 out of 640000 steps (35%)
08:47:59:WU06:FS02:0x17:Completed 1450000 out of 5000000 steps (29%)
08:49:11:WU04:FS04:0x17:Completed 2550000 out of 5000000 steps (51%)
08:50:02:WU05:FS01:0x21:Completed 230400 out of 640000 steps (36%)
08:51:28:WU06:FS02:0x17:Completed 1500000 out of 5000000 steps (30%)
08:52:33:WU00:FS03:0x17:Completed 4150000 out of 5000000 steps (83%)
08:53:09:WU05:FS01:0x21:Completed 236800 out of 640000 steps (37%)
08:54:10:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
08:54:10:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
08:54:10:WU02:FS04:Connecting to 140.163.4.233:8080
08:55:04:WU06:FS02:0x17:Completed 1550000 out of 5000000 steps (31%)
08:55:20:WU04:FS04:0x17:Completed 2600000 out of 5000000 steps (52%)
08:56:22:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
08:56:22:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
08:56:22:WU03:FS01:Connecting to 171.64.65.98:8080
08:56:41:WU03:FS01:Upload 0.65%
08:56:41:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
08:56:41:WU03:FS01:Trying to send results to collection server
08:56:41:WU03:FS01:Uploading 9.56MiB to 171.65.103.160
08:56:41:WU03:FS01:Connecting to 171.65.103.160:8080
08:56:51:WU05:FS01:0x21:Completed 243200 out of 640000 steps (38%)
08:57:48:WU03:FS01:Upload 0.65%
08:57:48:ERROR:WU03:FS01:Exception: Transfer failed
08:58:30:WU00:FS03:0x17:Completed 4200000 out of 5000000 steps (84%)
08:58:33:WU06:FS02:0x17:Completed 1600000 out of 5000000 steps (32%)
08:59:25:WU02:FS04:Upload 0.48%
08:59:25:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
08:59:25:WU02:FS04:Trying to send results to collection server
08:59:26:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
08:59:26:WU02:FS04:Connecting to 140.163.4.241:8080
08:59:59:WU05:FS01:0x21:Completed 249600 out of 640000 steps (39%)
09:00:23:WU02:FS04:Upload 0.48%
09:00:23:ERROR:WU02:FS04:Exception: Transfer failed
09:01:41:WU04:FS04:0x17:Completed 2650000 out of 5000000 steps (53%)
09:02:08:WU06:FS02:0x17:Completed 1650000 out of 5000000 steps (33%)
09:03:07:WU05:FS01:0x21:Completed 256000 out of 640000 steps (40%)
09:04:27:WU00:FS03:0x17:Completed 4250000 out of 5000000 steps (85%)
09:05:37:WU06:FS02:0x17:Completed 1700000 out of 5000000 steps (34%)
09:06:15:WU05:FS01:0x21:Completed 262400 out of 640000 steps (41%)
09:07:50:WU04:FS04:0x17:Completed 2700000 out of 5000000 steps (54%)
09:09:06:WU06:FS02:0x17:Completed 1750000 out of 5000000 steps (35%)
09:09:24:WU05:FS01:0x21:Completed 268800 out of 640000 steps (42%)
09:10:36:WU00:FS03:0x17:Completed 4300000 out of 5000000 steps (86%)
09:12:31:WU05:FS01:0x21:Completed 275200 out of 640000 steps (43%)
09:12:41:WU06:FS02:0x17:Completed 1800000 out of 5000000 steps (36%)
09:13:59:WU04:FS04:0x17:Completed 2750000 out of 5000000 steps (55%)
09:15:39:WU05:FS01:0x21:Completed 281600 out of 640000 steps (44%)
09:16:10:WU06:FS02:0x17:Completed 1850000 out of 5000000 steps (37%)
09:16:34:WU00:FS03:0x17:Completed 4350000 out of 5000000 steps (87%)
09:18:46:WU05:FS01:0x21:Completed 288000 out of 640000 steps (45%)
09:19:45:WU06:FS02:0x17:Completed 1900000 out of 5000000 steps (38%)
09:20:19:WU04:FS04:0x17:Completed 2800000 out of 5000000 steps (56%)
09:21:54:WU05:FS01:0x21:Completed 294400 out of 640000 steps (46%)
09:22:25:WU07:FS03:Sending unit results: id:07 state:SEND error:NO_ERROR project:9712 run:58 clone:30 gen:22 core:0x21 unit:0x00000060ab40416255b9af1c5e0c6130
09:22:26:WU07:FS03:Uploading 9.58MiB to 171.64.65.98
09:22:26:WU07:FS03:Connecting to 171.64.65.98:8080
09:22:32:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
09:22:32:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
09:22:32:WU01:FS02:Connecting to 171.64.65.98:8080
09:22:43:WU00:FS03:0x17:Completed 4400000 out of 5000000 steps (88%)
09:22:45:WU07:FS03:Upload 0.65%
09:22:45:WARNING:WU07:FS03:Exception: Failed to send results to work server: Transfer failed
09:22:45:WU07:FS03:Trying to send results to collection server
09:22:45:WU07:FS03:Uploading 9.58MiB to 171.65.103.160
09:22:45:WU07:FS03:Connecting to 171.65.103.160:8080
09:22:51:WU01:FS02:Upload 0.42%
09:22:51:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
09:22:51:WU01:FS02:Trying to send results to collection server
09:22:51:WU01:FS02:Uploading 14.98MiB to 171.65.103.160
09:22:51:WU01:FS02:Connecting to 171.65.103.160:8080
09:23:07:WU07:FS03:Upload 0.65%
09:23:07:ERROR:WU07:FS03:Exception: Transfer failed
09:23:10:WU01:FS02:Upload 0.42%
09:23:10:ERROR:WU01:FS02:Exception: Transfer failed
09:23:14:WU06:FS02:0x17:Completed 1950000 out of 5000000 steps (39%)
09:25:02:WU05:FS01:0x21:Completed 300800 out of 640000 steps (47%)
09:26:28:WU04:FS04:0x17:Completed 2850000 out of 5000000 steps (57%)
09:26:43:WU06:FS02:0x17:Completed 2000000 out of 5000000 steps (40%)
09:28:10:WU05:FS01:0x21:Completed 307200 out of 640000 steps (48%)
09:28:40:WU00:FS03:0x17:Completed 4450000 out of 5000000 steps (89%)
09:30:18:WU06:FS02:0x17:Completed 2050000 out of 5000000 steps (41%)
09:31:18:WU05:FS01:0x21:Completed 313600 out of 640000 steps (49%)
09:32:49:WU04:FS04:0x17:Completed 2900000 out of 5000000 steps (58%)
09:33:47:WU06:FS02:0x17:Completed 2100000 out of 5000000 steps (42%)
09:34:26:WU05:FS01:0x21:Completed 320000 out of 640000 steps (50%)
09:34:37:WU00:FS03:0x17:Completed 4500000 out of 5000000 steps (90%)
09:37:30:WU06:FS02:0x17:Completed 2150000 out of 5000000 steps (43%)
09:38:09:WU05:FS01:0x21:Completed 326400 out of 640000 steps (51%)
09:39:02:WU04:FS04:0x17:Completed 2950000 out of 5000000 steps (59%)
09:40:47:WU00:FS03:0x17:Completed 4550000 out of 5000000 steps (91%)
09:40:59:WU06:FS02:0x17:Completed 2200000 out of 5000000 steps (44%)
09:41:17:WU05:FS01:0x21:Completed 332800 out of 640000 steps (52%)
09:44:25:WU05:FS01:0x21:Completed 339200 out of 640000 steps (53%)
09:44:28:WU06:FS02:0x17:Completed 2250000 out of 5000000 steps (45%)
09:45:11:WU04:FS04:0x17:Completed 3000000 out of 5000000 steps (60%)
09:46:44:WU00:FS03:0x17:Completed 4600000 out of 5000000 steps (92%)
09:47:33:WU05:FS01:0x21:Completed 345600 out of 640000 steps (54%)
09:48:03:WU06:FS02:0x17:Completed 2300000 out of 5000000 steps (46%)
09:50:41:WU05:FS01:0x21:Completed 352000 out of 640000 steps (55%)
09:51:32:WU04:FS04:0x17:Completed 3050000 out of 5000000 steps (61%)
09:51:32:WU06:FS02:0x17:Completed 2350000 out of 5000000 steps (47%)
09:52:53:WU00:FS03:0x17:Completed 4650000 out of 5000000 steps (93%)
09:53:48:WU05:FS01:0x21:Completed 358400 out of 640000 steps (56%)
09:55:08:WU06:FS02:0x17:Completed 2400000 out of 5000000 steps (48%)
09:56:56:WU05:FS01:0x21:Completed 364800 out of 640000 steps (57%)
09:57:41:WU04:FS04:0x17:Completed 3100000 out of 5000000 steps (62%)
09:58:37:WU06:FS02:0x17:Completed 2450000 out of 5000000 steps (49%)
09:58:50:WU00:FS03:0x17:Completed 4700000 out of 5000000 steps (94%)
10:00:05:WU05:FS01:0x21:Completed 371200 out of 640000 steps (58%)
10:02:06:WU06:FS02:0x17:Completed 2500000 out of 5000000 steps (50%)
10:03:12:WU05:FS01:0x21:Completed 377600 out of 640000 steps (59%)
10:04:02:WU04:FS04:0x17:Completed 3150000 out of 5000000 steps (63%)
10:04:47:WU00:FS03:0x17:Completed 4750000 out of 5000000 steps (95%)
10:05:41:WU06:FS02:0x17:Completed 2550000 out of 5000000 steps (51%)
10:06:20:WU05:FS01:0x21:Completed 384000 out of 640000 steps (60%)
10:09:10:WU06:FS02:0x17:Completed 2600000 out of 5000000 steps (52%)
10:09:28:WU05:FS01:0x21:Completed 390400 out of 640000 steps (61%)
10:10:11:WU04:FS04:0x17:Completed 3200000 out of 5000000 steps (64%)
10:10:57:WU00:FS03:0x17:Completed 4800000 out of 5000000 steps (96%)
10:12:23:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
10:12:23:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
10:12:23:WU03:FS01:Connecting to 171.64.65.98:8080
10:12:36:WU05:FS01:0x21:Completed 396800 out of 640000 steps (62%)
10:12:45:WU06:FS02:0x17:Completed 2650000 out of 5000000 steps (53%)
10:13:36:WU03:FS01:Upload 0.65%
10:13:36:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
10:13:36:WU03:FS01:Trying to send results to collection server
10:13:36:WU03:FS01:Uploading 9.56MiB to 171.65.103.160
10:13:36:WU03:FS01:Connecting to 171.65.103.160:8080
10:13:58:WU03:FS01:Upload 0.65%
10:13:58:ERROR:WU03:FS01:Exception: Transfer failed
10:16:14:WU06:FS02:0x17:Completed 2700000 out of 5000000 steps (54%)
10:16:18:WU05:FS01:0x21:Completed 403200 out of 640000 steps (63%)
10:16:20:WU04:FS04:0x17:Completed 3250000 out of 5000000 steps (65%)
10:16:54:WU00:FS03:0x17:Completed 4850000 out of 5000000 steps (97%)
10:19:26:WU05:FS01:0x21:Completed 409600 out of 640000 steps (64%)
10:19:43:WU06:FS02:0x17:Completed 2750000 out of 5000000 steps (55%)
10:22:34:WU05:FS01:0x21:Completed 416000 out of 640000 steps (65%)
10:22:41:WU04:FS04:0x17:Completed 3300000 out of 5000000 steps (66%)
10:23:03:WU00:FS03:0x17:Completed 4900000 out of 5000000 steps (98%)
10:23:18:WU06:FS02:0x17:Completed 2800000 out of 5000000 steps (56%)
10:25:42:WU05:FS01:0x21:Completed 422400 out of 640000 steps (66%)
10:26:47:WU06:FS02:0x17:Completed 2850000 out of 5000000 steps (57%)
10:28:50:WU04:FS04:0x17:Completed 3350000 out of 5000000 steps (67%)
10:28:50:WU05:FS01:0x21:Completed 428800 out of 640000 steps (67%)
10:29:00:WU00:FS03:0x17:Completed 4950000 out of 5000000 steps (99%)
10:30:22:WU06:FS02:0x17:Completed 2900000 out of 5000000 steps (58%)
10:31:58:WU05:FS01:0x21:Completed 435200 out of 640000 steps (68%)
10:33:51:WU06:FS02:0x17:Completed 2950000 out of 5000000 steps (59%)
10:34:57:WU00:FS03:0x17:Completed 5000000 out of 5000000 steps (100%)
10:34:58:WU10:FS03:Connecting to 171.67.108.200:80
10:35:00:WU10:FS03:Assigned to work server 171.64.65.98
10:35:00:WU10:FS03:Requesting new work unit for slot 03: RUNNING gpu:2:Tahiti XT [Radeon HD 7970] from 171.64.65.98
10:35:00:WU10:FS03:Connecting to 171.64.65.98:8080
10:35:03:WU10:FS03:Downloading 7.49MiB
10:35:05:WU05:FS01:0x21:Completed 441600 out of 640000 steps (69%)
10:35:09:WU10:FS03:Download 7.51%
10:35:10:WU00:FS03:0x17:Saving result file logfile_01.txt
10:35:10:WU00:FS03:0x17:Saving result file checkpointState.xml
10:35:11:WU04:FS04:0x17:Completed 3400000 out of 5000000 steps (68%)
10:35:12:WU00:FS03:0x17:Saving result file checkpt.crc
10:35:12:WU00:FS03:0x17:Saving result file log.txt
10:35:12:WU00:FS03:0x17:Saving result file positions.xtc
10:35:14:WU00:FS03:0x17:[email protected] Core Shutdown: FINISHED_UNIT
10:35:14:WU00:FS03:FahCore returned: FINISHED_UNIT (100 = 0x64)
10:35:14:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:10468 run:0 clone:137 gen:216 core:0x17 unit:0x00000158538b3db9538cae08fee7025f
10:35:14:WU00:FS03:Uploading 13.14MiB to 140.163.4.233
10:35:14:WU00:FS03:Connecting to 140.163.4.233:8080
10:35:15:WU10:FS03:Download 27.54%
10:35:21:WU10:FS03:Download 67.60%
10:35:27:WU10:FS03:Download 90.97%
10:35:28:WU10:FS03:Download complete
10:35:28:WU10:FS03:Received Unit: id:10 state:DOWNLOAD error:NO_ERROR project:9712 run:2 clone:12 gen:35 core:0x21 unit:0x00000047ab40416255b9a67e56d95f47
10:35:28:WU10:FS03:Starting
10:35:28:WU10:FS03:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 10 -suffix 01 -version 704 -lifeline 3616 -checkpoint 15 -gpu 2 -gpu-vendor ati
10:35:28:WU10:FS03:Started FahCore on PID 3524
10:35:28:WU10:FS03:Core PID:2724
10:35:28:WU10:FS03:FahCore 0x21 started
10:35:29:WU10:FS03:0x21:*********************** Log Started 2015-09-06T10:35:28Z ***********************
10:35:29:WU10:FS03:0x21:Project: 9712 (Run 2, Clone 12, Gen 35)
10:35:29:WU10:FS03:0x21:Unit: 0x00000047ab40416255b9a67e56d95f47
10:35:29:WU10:FS03:0x21:CPU: 0x00000000000000000000000000000000
10:35:29:WU10:FS03:0x21:Machine: 3
10:35:29:WU10:FS03:0x21:Reading tar file core.xml
10:35:29:WU10:FS03:0x21:Reading tar file integrator.xml
10:35:29:WU10:FS03:0x21:Reading tar file system.xml
10:35:30:WU10:FS03:0x21:Reading tar file state.xml
10:35:31:WU10:FS03:0x21:Digital signatures verified
10:35:31:WU10:FS03:0x21:[email protected] GPU Core21 [email protected] Core
10:35:31:WU10:FS03:0x21:Version 0.0.11
10:35:36:WU00:FS03:Upload 0.48%
10:35:36:WARNING:WU00:FS03:Exception: Failed to send results to work server: Transfer failed
10:35:36:WU00:FS03:Trying to send results to collection server
10:35:36:WU00:FS03:Uploading 13.14MiB to 140.163.4.241
10:35:36:WU00:FS03:Connecting to 140.163.4.241:8080
10:36:20:WU10:FS03:0x21:Completed 0 out of 1280000 steps (0%)
10:36:20:WU10:FS03:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
10:36:33:WU00:FS03:Upload 0.48%
10:36:33:ERROR:WU00:FS03:Exception: Transfer failed
10:36:33:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:10468 run:0 clone:137 gen:216 core:0x17 unit:0x00000158538b3db9538cae08fee7025f
10:36:33:WU00:FS03:Uploading 13.14MiB to 140.163.4.233
10:36:33:WU00:FS03:Connecting to 140.163.4.233:8080
10:36:52:WU00:FS03:Upload 0.48%
10:36:52:WARNING:WU00:FS03:Exception: Failed to send results to work server: Transfer failed
10:36:52:WU00:FS03:Trying to send results to collection server
10:36:52:WU00:FS03:Uploading 13.14MiB to 140.163.4.241
10:36:52:WU00:FS03:Connecting to 140.163.4.241:8080
10:37:11:WU00:FS03:Upload 0.48%
10:37:11:ERROR:WU00:FS03:Exception: Transfer failed
10:37:21:WU06:FS02:0x17:Completed 3000000 out of 5000000 steps (60%)
10:37:33:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:10468 run:0 clone:137 gen:216 core:0x17 unit:0x00000158538b3db9538cae08fee7025f
10:37:33:WU00:FS03:Uploading 13.14MiB to 140.163.4.233
10:37:33:WU00:FS03:Connecting to 140.163.4.233:8080
10:37:54:WARNING:WU00:FS03:WorkServer connection failed on port 8080 trying 80
10:37:54:WU00:FS03:Connecting to 140.163.4.233:80
10:37:56:WARNING:WU00:FS03:Exception: Failed to send results to work server: Failed to connect to 140.163.4.233:80: No connection could be made because the target machine actively refused it.
10:37:56:WU00:FS03:Trying to send results to collection server
10:37:56:WU00:FS03:Uploading 13.14MiB to 140.163.4.241
10:37:56:WU00:FS03:Connecting to 140.163.4.241:8080
10:38:14:WU05:FS01:0x21:Completed 448000 out of 640000 steps (70%)
10:38:14:WU00:FS03:Upload 0.48%
10:38:14:ERROR:WU00:FS03:Exception: Transfer failed
10:38:33:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
10:38:33:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
10:38:33:WU01:FS02:Connecting to 171.64.65.98:8080
10:39:10:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:10468 run:0 clone:137 gen:216 core:0x17 unit:0x00000158538b3db9538cae08fee7025f
10:39:10:WU00:FS03:Uploading 13.14MiB to 140.163.4.233
10:39:10:WU00:FS03:Connecting to 140.163.4.233:8080
10:39:16:WU10:FS03:0x21:Completed 12800 out of 1280000 steps (1%)
10:39:30:WU01:FS02:Upload 0.42%
10:39:30:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
10:39:30:WU01:FS02:Trying to send results to collection server
10:39:30:WU01:FS02:Uploading 14.98MiB to 171.65.103.160
10:39:30:WU01:FS02:Connecting to 171.65.103.160:8080
10:39:50:WU01:FS02:Upload 0.42%
10:39:50:ERROR:WU01:FS02:Exception: Transfer failed
10:40:56:WU06:FS02:0x17:Completed 3050000 out of 5000000 steps (61%)
10:41:20:WU04:FS04:0x17:Completed 3450000 out of 5000000 steps (69%)
10:41:22:WU05:FS01:0x21:Completed 454400 out of 640000 steps (71%)
10:41:59:WU10:FS03:0x21:Completed 25600 out of 1280000 steps (2%)
10:43:17:WU00:FS03:Upload 0.48%
10:43:17:WARNING:WU00:FS03:Exception: Failed to send results to work server: Transfer failed
10:43:17:WU00:FS03:Trying to send results to collection server
10:43:17:WU00:FS03:Uploading 13.14MiB to 140.163.4.241
10:43:17:WU00:FS03:Connecting to 140.163.4.241:8080
10:43:36:WU00:FS03:Upload 0.48%
10:43:36:ERROR:WU00:FS03:Exception: Transfer failed
10:43:36:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:10468 run:0 clone:137 gen:216 core:0x17 unit:0x00000158538b3db9538cae08fee7025f
10:43:36:WU00:FS03:Uploading 13.14MiB to 140.163.4.233
10:43:36:WU00:FS03:Connecting to 140.163.4.233:8080
10:43:55:WU00:FS03:Upload 0.48%
10:43:55:WARNING:WU00:FS03:Exception: Failed to send results to work server: Transfer failed
10:43:55:WU00:FS03:Trying to send results to collection server
10:43:55:WU00:FS03:Uploading 13.14MiB to 140.163.4.241
10:43:55:WU00:FS03:Connecting to 140.163.4.241:8080
10:44:25:WU06:FS02:0x17:Completed 3100000 out of 5000000 steps (62%)
10:44:30:WU05:FS01:0x21:Completed 460800 out of 640000 steps (72%)
10:44:41:WU10:FS03:0x21:Completed 38400 out of 1280000 steps (3%)
10:47:23:WU10:FS03:0x21:Completed 51200 out of 1280000 steps (4%)
10:47:29:WU04:FS04:0x17:Completed 3500000 out of 5000000 steps (70%)
10:47:37:WU00:FS03:Upload 0.48%
10:47:37:ERROR:WU00:FS03:Exception: Transfer failed
10:47:38:WU05:FS01:0x21:Completed 467200 out of 640000 steps (73%)
10:47:50:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:10468 run:0 clone:137 gen:216 core:0x17 unit:0x00000158538b3db9538cae08fee7025f
10:47:50:WU00:FS03:Uploading 13.14MiB to 140.163.4.233
10:47:50:WU00:FS03:Connecting to 140.163.4.233:8080
10:48:00:WU06:FS02:0x17:Completed 3150000 out of 5000000 steps (63%)
10:48:09:WU00:FS03:Upload 0.48%
10:48:09:WARNING:WU00:FS03:Exception: Failed to send results to work server: Transfer failed
10:48:09:WU00:FS03:Trying to send results to collection server
10:48:09:WU00:FS03:Uploading 13.14MiB to 140.163.4.241
10:48:09:WU00:FS03:Connecting to 140.163.4.241:8080
10:48:28:WU00:FS03:Upload 0.48%
10:48:28:ERROR:WU00:FS03:Exception: Transfer failed
10:50:05:WU10:FS03:0x21:Completed 64000 out of 1280000 steps (5%)
10:50:45:WU05:FS01:0x21:Completed 473600 out of 640000 steps (74%)
10:51:29:WU06:FS02:0x17:Completed 3200000 out of 5000000 steps (64%)
10:52:46:WU09:FS01:Sending unit results: id:09 state:SEND error:NO_ERROR project:9704 run:21 clone:8 gen:20 core:0x21 unit:0x0000001dab404162553ebeff138ed196
10:52:46:WU09:FS01:Uploading 15.00MiB to 171.64.65.98
10:52:46:WU09:FS01:Connecting to 171.64.65.98:8080
10:52:47:WU10:FS03:0x21:Completed 76800 out of 1280000 steps (6%)
10:53:05:WU09:FS01:Upload 0.42%
10:53:05:WARNING:WU09:FS01:Exception: Failed to send results to work server: Transfer failed
10:53:05:WU09:FS01:Trying to send results to collection server
10:53:05:WU09:FS01:Uploading 15.00MiB to 171.65.103.160
10:53:05:WU09:FS01:Connecting to 171.65.103.160:8080
10:53:50:WU04:FS04:0x17:Completed 3550000 out of 5000000 steps (71%)
10:53:53:WU05:FS01:0x21:Completed 480000 out of 640000 steps (75%)
10:54:41:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:10468 run:0 clone:137 gen:216 core:0x17 unit:0x00000158538b3db9538cae08fee7025f
10:54:41:WU00:FS03:Uploading 13.14MiB to 140.163.4.233
10:54:41:WU00:FS03:Connecting to 140.163.4.233:8080
10:54:58:WU06:FS02:0x17:Completed 3250000 out of 5000000 steps (65%)
10:55:00:WU00:FS03:Upload 0.48%
10:55:01:WARNING:WU00:FS03:Exception: Failed to send results to work server: Transfer failed
10:55:01:WU00:FS03:Trying to send results to collection server
10:55:01:WU00:FS03:Uploading 13.14MiB to 140.163.4.241
10:55:01:WU00:FS03:Connecting to 140.163.4.241:8080
10:55:20:WU00:FS03:Upload 0.48%
10:55:20:ERROR:WU00:FS03:Exception: Transfer failed
10:55:45:WU10:FS03:0x21:Completed 89600 out of 1280000 steps (7%)
10:57:15:WU09:FS01:Upload 0.42%
10:57:15:ERROR:WU09:FS01:Exception: Transfer failed
10:57:35:WU05:FS01:0x21:Completed 486400 out of 640000 steps (76%)
10:58:27:WU10:FS03:0x21:Completed 102400 out of 1280000 steps (8%)
10:58:33:WU06:FS02:0x17:Completed 3300000 out of 5000000 steps (66%)
10:59:59:WU04:FS04:0x17:Completed 3600000 out of 5000000 steps (72%)
11:00:43:WU05:FS01:0x21:Completed 492800 out of 640000 steps (77%)
11:01:09:WU10:FS03:0x21:Completed 115200 out of 1280000 steps (9%)
11:02:02:WU06:FS02:0x17:Completed 3350000 out of 5000000 steps (67%)
11:02:35:WU08:FS02:Sending unit results: id:08 state:SEND error:NO_ERROR project:10466 run:0 clone:130 gen:304 core:0x17 unit:0x000001ea538b3db953822dd19ee321bb
11:02:35:WU08:FS02:Uploading 6.94MiB to 140.163.4.233
11:02:35:WU08:FS02:Connecting to 140.163.4.233:8080
11:03:51:WU05:FS01:0x21:Completed 499200 out of 640000 steps (78%)
11:03:51:WU10:FS03:0x21:Completed 128000 out of 1280000 steps (10%)
11:05:09:WU08:FS02:Upload 0.90%
11:05:10:WARNING:WU08:FS02:Exception: Failed to send results to work server: Transfer failed
11:05:10:WU08:FS02:Trying to send results to collection server
11:05:10:WU08:FS02:Uploading 6.94MiB to 140.163.4.241
11:05:10:WU08:FS02:Connecting to 140.163.4.241:8080
11:05:29:WU08:FS02:Upload 0.90%
11:05:29:ERROR:WU08:FS02:Exception: Transfer failed
11:05:37:WU06:FS02:0x17:Completed 3400000 out of 5000000 steps (68%)
11:05:47:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:10468 run:0 clone:137 gen:216 core:0x17 unit:0x00000158538b3db9538cae08fee7025f
11:05:47:WU00:FS03:Uploading 13.14MiB to 140.163.4.233
11:05:47:WU00:FS03:Connecting to 140.163.4.233:8080
11:06:21:WU04:FS04:0x17:Completed 3650000 out of 5000000 steps (73%)
11:06:33:WU10:FS03:0x21:Completed 140800 out of 1280000 steps (11%)
11:06:44:WU00:FS03:Upload 0.48%
11:06:44:WARNING:WU00:FS03:Exception: Failed to send results to work server: Transfer failed
11:06:44:WU00:FS03:Trying to send results to collection server
11:06:44:WU00:FS03:Uploading 13.14MiB to 140.163.4.241
11:06:44:WU00:FS03:Connecting to 140.163.4.241:8080
11:06:57:WU05:FS01:0x21:Completed 505600 out of 640000 steps (79%)
11:07:03:WU00:FS03:Upload 0.48%
11:07:03:ERROR:WU00:FS03:Exception: Transfer failed
11:09:06:WU06:FS02:0x17:Completed 3450000 out of 5000000 steps (69%)
11:09:15:WU10:FS03:0x21:Completed 153600 out of 1280000 steps (12%)
11:10:05:WU05:FS01:0x21:Completed 512000 out of 640000 steps (80%)
11:12:12:WU10:FS03:0x21:Completed 166400 out of 1280000 steps (13%)
11:12:29:WU04:FS04:0x17:Completed 3700000 out of 5000000 steps (74%)
11:12:35:WU06:FS02:0x17:Completed 3500000 out of 5000000 steps (70%)
11:13:12:WU05:FS01:0x21:Completed 518400 out of 640000 steps (81%)
11:14:54:WU10:FS03:0x21:Completed 179200 out of 1280000 steps (14%)
11:16:10:WU06:FS02:0x17:Completed 3550000 out of 5000000 steps (71%)
11:16:20:WU05:FS01:0x21:Completed 524800 out of 640000 steps (82%)
11:17:36:WU10:FS03:0x21:Completed 192000 out of 1280000 steps (15%)
******************************* Date: 2015-09-06 *******************************
11:18:38:WU04:FS04:0x17:Completed 3750000 out of 5000000 steps (75%)
11:19:28:WU05:FS01:0x21:Completed 531200 out of 640000 steps (83%)
11:19:39:WU06:FS02:0x17:Completed 3600000 out of 5000000 steps (72%)
11:20:18:WU10:FS03:0x21:Completed 204800 out of 1280000 steps (16%)
11:22:35:WU05:FS01:0x21:Completed 537600 out of 640000 steps (84%)
11:23:00:WU10:FS03:0x21:Completed 217600 out of 1280000 steps (17%)
11:23:14:WU06:FS02:0x17:Completed 3650000 out of 5000000 steps (73%)
11:23:44:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:10468 run:0 clone:137 gen:216 core:0x17 unit:0x00000158538b3db9538cae08fee7025f
11:23:44:WU00:FS03:Uploading 13.14MiB to 140.163.4.233
11:23:44:WU00:FS03:Connecting to 140.163.4.233:8080
11:24:59:WU04:FS04:0x17:Completed 3800000 out of 5000000 steps (76%)
11:25:42:WU10:FS03:0x21:Completed 230400 out of 1280000 steps (18%)
11:25:43:WU05:FS01:0x21:Completed 544000 out of 640000 steps (85%)
11:26:20:WU00:FS03:Upload 0.48%
11:26:20:WARNING:WU00:FS03:Exception: Failed to send results to work server: Transfer failed
11:26:20:WU00:FS03:Trying to send results to collection server
11:26:20:WU00:FS03:Uploading 13.14MiB to 140.163.4.241
11:26:20:WU00:FS03:Connecting to 140.163.4.241:8080
11:26:42:WU00:FS03:Upload 0.48%
11:26:42:ERROR:WU00:FS03:Exception: Transfer failed
11:26:43:WU06:FS02:0x17:Completed 3700000 out of 5000000 steps (74%)
11:28:40:WU10:FS03:0x21:Completed 243200 out of 1280000 steps (19%)
11:28:50:WU05:FS01:0x21:Completed 550400 out of 640000 steps (86%)
11:30:12:WU06:FS02:0x17:Completed 3750000 out of 5000000 steps (75%)
11:31:08:WU04:FS04:0x17:Completed 3850000 out of 5000000 steps (77%)
11:31:22:WU10:FS03:0x21:Completed 256000 out of 1280000 steps (20%)
11:31:58:WU05:FS01:0x21:Completed 556800 out of 640000 steps (87%)
11:33:47:WU06:FS02:0x17:Completed 3800000 out of 5000000 steps (76%)
11:34:04:WU10:FS03:0x21:Completed 268800 out of 1280000 steps (21%)
11:35:40:WU05:FS01:0x21:Completed 563200 out of 640000 steps (88%)
11:36:46:WU10:FS03:0x21:Completed 281600 out of 1280000 steps (22%)
11:37:16:WU06:FS02:0x17:Completed 3850000 out of 5000000 steps (77%)
11:37:29:WU04:FS04:0x17:Completed 3900000 out of 5000000 steps (78%)
11:38:48:WU05:FS01:0x21:Completed 569600 out of 640000 steps (89%)
11:39:28:WU10:FS03:0x21:Completed 294400 out of 1280000 steps (23%)
11:40:52:WU06:FS02:0x17:Completed 3900000 out of 5000000 steps (78%)
11:41:56:WU05:FS01:0x21:Completed 576000 out of 640000 steps (90%)
11:42:10:WU10:FS03:0x21:Completed 307200 out of 1280000 steps (24%)
11:43:38:WU04:FS04:0x17:Completed 3950000 out of 5000000 steps (79%)
11:44:21:WU06:FS02:0x17:Completed 3950000 out of 5000000 steps (79%)
11:44:52:WU10:FS03:0x21:Completed 320000 out of 1280000 steps (25%)
11:45:04:WU05:FS01:0x21:Completed 582400 out of 640000 steps (91%)
11:47:49:WU06:FS02:0x17:Completed 4000000 out of 5000000 steps (80%)
11:47:50:WU10:FS03:0x21:Completed 332800 out of 1280000 steps (26%)
11:48:12:WU05:FS01:0x21:Completed 588800 out of 640000 steps (92%)
11:49:47:WU04:FS04:0x17:Completed 4000000 out of 5000000 steps (80%)
11:50:32:WU10:FS03:0x21:Completed 345600 out of 1280000 steps (27%)
11:51:19:WU05:FS01:0x21:Completed 595200 out of 640000 steps (93%)
11:51:25:WU06:FS02:0x17:Completed 4050000 out of 5000000 steps (81%)
11:52:46:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:10468 run:0 clone:137 gen:216 core:0x17 unit:0x00000158538b3db9538cae08fee7025f
11:52:46:WU00:FS03:Uploading 13.14MiB to 140.163.4.233
11:52:46:WU00:FS03:Connecting to 140.163.4.233:8080
11:53:05:WU00:FS03:Upload 0.48%
11:53:05:WARNING:WU00:FS03:Exception: Failed to send results to work server: Transfer failed
11:53:05:WU00:FS03:Trying to send results to collection server
11:53:05:WU00:FS03:Uploading 13.14MiB to 140.163.4.241
11:53:05:WU00:FS03:Connecting to 140.163.4.241:8080
11:53:14:WU10:FS03:0x21:Completed 358400 out of 1280000 steps (28%)
11:53:24:WU00:FS03:Upload 0.48%
11:53:24:ERROR:WU00:FS03:Exception: Transfer failed
11:54:27:WU05:FS01:0x21:Completed 601600 out of 640000 steps (94%)
11:54:54:WU06:FS02:0x17:Completed 4100000 out of 5000000 steps (82%)
11:55:56:WU10:FS03:0x21:Completed 371200 out of 1280000 steps (29%)
11:56:07:WU04:FS04:0x17:Completed 4050000 out of 5000000 steps (81%)
11:57:35:WU05:FS01:0x21:Completed 608000 out of 640000 steps (95%)
11:58:29:WU06:FS02:0x17:Completed 4150000 out of 5000000 steps (83%)
11:58:38:WU10:FS03:0x21:Completed 384000 out of 1280000 steps (30%)
12:00:43:WU05:FS01:0x21:Completed 614400 out of 640000 steps (96%)
12:01:20:WU10:FS03:0x21:Completed 396800 out of 1280000 steps (31%)
12:01:58:WU06:FS02:0x17:Completed 4200000 out of 5000000 steps (84%)
12:02:16:WU04:FS04:0x17:Completed 4100000 out of 5000000 steps (82%)
12:03:51:WU05:FS01:0x21:Completed 620800 out of 640000 steps (97%)
12:04:18:WU10:FS03:0x21:Completed 409600 out of 1280000 steps (32%)
12:05:27:WU06:FS02:0x17:Completed 4250000 out of 5000000 steps (85%)
12:07:01:WU05:FS01:0x21:Completed 627200 out of 640000 steps (98%)
12:07:03:WU10:FS03:0x21:Completed 422400 out of 1280000 steps (33%)
12:08:37:WU04:FS04:0x17:Completed 4150000 out of 5000000 steps (83%)
12:09:02:WU06:FS02:0x17:Completed 4300000 out of 5000000 steps (86%)
12:09:45:WU10:FS03:0x21:Completed 435200 out of 1280000 steps (34%)
12:10:09:WU05:FS01:0x21:Completed 633600 out of 640000 steps (99%)
12:10:10:WU11:FS01:Connecting to 171.67.108.200:80
12:10:11:WU11:FS01:Assigned to work server 171.64.65.98
12:10:11:WU11:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:Tahiti XT [Radeon HD 7970] from 171.64.65.98
12:10:11:WU11:FS01:Connecting to 171.64.65.98:8080
12:10:12:WU11:FS01:Downloading 15.70MiB
12:10:18:WU11:FS01:Download 24.28%
12:10:24:WU11:FS01:Download 54.54%
12:10:30:WU11:FS01:Download 78.43%
12:10:36:WU11:FS01:Download 97.14%
12:10:37:WU11:FS01:Download complete
12:10:37:WU11:FS01:Received Unit: id:11 state:DOWNLOAD error:NO_ERROR project:9704 run:27 clone:13 gen:22 core:0x21 unit:0x0000002bab404162553ebff877153c5c
12:12:27:WU10:FS03:0x21:Completed 448000 out of 1280000 steps (35%)
12:12:31:WU06:FS02:0x17:Completed 4350000 out of 5000000 steps (87%)
12:13:10:WU02:FS04:Sending unit results: id:02 state:SEND error:NO_ERROR project:10467 run:0 clone:24 gen:203 core:0x17 unit:0x00000152538b3db95388cebbdadf69a0
12:13:10:WU02:FS04:Uploading 12.98MiB to 140.163.4.233
12:13:10:WU02:FS04:Connecting to 140.163.4.233:8080
12:13:17:WU05:FS01:0x21:Completed 640000 out of 640000 steps (100%)
12:13:29:WU02:FS04:Upload 0.48%
12:13:29:WARNING:WU02:FS04:Exception: Failed to send results to work server: Transfer failed
12:13:29:WU02:FS04:Trying to send results to collection server
12:13:29:WU02:FS04:Uploading 12.98MiB to 140.163.4.241
12:13:29:WU02:FS04:Connecting to 140.163.4.241:8080
12:13:51:WU05:FS01:0x21:Saving result file logfile_01.txt
12:13:51:WU05:FS01:0x21:Saving result file checkpointState.xml
12:13:55:WU05:FS01:0x21:Saving result file checkpt.crc
12:13:55:WU05:FS01:0x21:Saving result file log.txt
12:13:55:WU05:FS01:0x21:Saving result file positions.xtc
12:13:56:WU05:FS01:0x21:[email protected] Core Shutdown: FINISHED_UNIT
12:13:57:WU05:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
12:13:57:WU05:FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:9704 run:0 clone:7 gen:385 core:0x21 unit:0x000001c5ab404162551ce8cc21e57cf1
12:13:57:WU05:FS01:Uploading 14.98MiB to 171.64.65.98
12:13:57:WU05:FS01:Connecting to 171.64.65.98:8080
12:13:57:WU11:FS01:Starting
12:13:57:WU11:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 11 -suffix 01 -version 704 -lifeline 3616 -checkpoint 15 -gpu 0 -gpu-vendor ati
12:13:57:WU11:FS01:Started FahCore on PID 1300
12:13:57:WU11:FS01:Core PID:1924
12:13:57:WU11:FS01:FahCore 0x21 started
12:13:57:WU11:FS01:0x21:*********************** Log Started 2015-09-06T12:13:57Z ***********************
12:13:57:WU11:FS01:0x21:Project: 9704 (Run 27, Clone 13, Gen 22)
12:13:57:WU11:FS01:0x21:Unit: 0x0000002bab404162553ebff877153c5c
12:13:57:WU11:FS01:0x21:CPU: 0x00000000000000000000000000000000
12:13:57:WU11:FS01:0x21:Machine: 1
12:13:57:WU11:FS01:0x21:Reading tar file core.xml
12:13:57:WU11:FS01:0x21:Reading tar file system.xml
12:14:00:WU11:FS01:0x21:Reading tar file integrator.xml
12:14:00:WU11:FS01:0x21:Reading tar file state.xml
12:14:02:WU11:FS01:0x21:Digital signatures verified
12:14:02:WU11:FS01:0x21:[email protected] GPU Core21 [email protected] Core
12:14:02:WU11:FS01:0x21:Version 0.0.11
12:14:49:WU04:FS04:0x17:Completed 4200000 out of 5000000 steps (84%)
12:15:14:WU10:FS03:0x21:Completed 460800 out of 1280000 steps (36%)
12:15:23:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9712 run:25 clone:36 gen:25 core:0x21 unit:0x0000005dab40416255b9aa1efb03f1ca
12:15:23:WU03:FS01:Uploading 9.56MiB to 171.64.65.98
12:15:23:WU03:FS01:Connecting to 171.64.65.98:8080
12:15:42:WU03:FS01:Upload 0.65%
12:15:42:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
12:15:42:WU03:FS01:Trying to send results to collection server
12:15:42:WU03:FS01:Uploading 9.56MiB to 171.65.103.160
12:15:42:WU03:FS01:Connecting to 171.65.103.160:8080
12:16:01:WU03:FS01:Upload 0.65%
12:16:01:ERROR:WU03:FS01:Exception: Transfer failed
12:16:09:WU06:FS02:0x17:Completed 4400000 out of 5000000 steps (88%)
12:16:10:WU11:FS01:0x21:Completed 0 out of 640000 steps (0%)
12:16:10:WU11:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
12:16:11:WU02:FS04:Upload 0.48%
12:16:12:ERROR:WU02:FS04:Exception: Transfer failed
12:17:57:WU10:FS03:0x21:Completed 473600 out of 1280000 steps (37%)
12:18:07:WU05:FS01:Upload 0.42%
12:18:07:WARNING:WU05:FS01:Exception: Failed to send results to work server: Transfer failed
12:18:07:WU05:FS01:Trying to send results to collection server
12:18:07:WU05:FS01:Uploading 14.98MiB to 171.65.103.160
12:18:07:WU05:FS01:Connecting to 171.65.103.160:8080
12:18:26:WU05:FS01:Upload 0.42%
12:18:26:ERROR:WU05:FS01:Exception: Transfer failed
12:18:26:WU05:FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:9704 run:0 clone:7 gen:385 core:0x21 unit:0x000001c5ab404162551ce8cc21e57cf1
12:18:26:WU05:FS01:Uploading 14.98MiB to 171.64.65.98
12:18:26:WU05:FS01:Connecting to 171.64.65.98:8080
12:18:54:WU05:FS01:Upload 0.42%
12:18:54:WARNING:WU05:FS01:Exception: Failed to send results to work server: Transfer failed
12:18:54:WU05:FS01:Trying to send results to collection server
12:18:54:WU05:FS01:Uploading 14.98MiB to 171.65.103.160
12:18:54:WU05:FS01:Connecting to 171.65.103.160:8080
12:19:38:WU06:FS02:0x17:Completed 4450000 out of 5000000 steps (89%)
12:19:48:WU11:FS01:0x21:Completed 6400 out of 640000 steps (1%)
12:20:54:WU10:FS03:0x21:Completed 486400 out of 1280000 steps (38%)
12:20:59:WU04:FS04:0x17:Completed 4250000 out of 5000000 steps (85%)
12:22:04:WU05:FS01:Upload 0.42%
12:22:04:ERROR:WU05:FS01:Exception: Transfer failed
12:22:04:WU05:FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:9704 run:0 clone:7 gen:385 core:0x21 unit:0x000001c5ab404162551ce8cc21e57cf1
12:22:04:WU05:FS01:Uploading 14.98MiB to 171.64.65.98
12:22:04:WU05:FS01:Connecting to 171.64.65.98:8080
12:22:57:WU11:FS01:0x21:Completed 12800 out of 640000 steps (2%)
12:23:07:WU06:FS02:0x17:Completed 4500000 out of 5000000 steps (90%)
12:23:36:WU10:FS03:0x21:Completed 499200 out of 1280000 steps (39%)
12:24:15:WU05:FS01:Upload 0.42%
12:24:15:WARNING:WU05:FS01:Exception: Failed to send results to work server: Transfer failed
12:24:15:WU05:FS01:Trying to send results to collection server
12:24:15:WU05:FS01:Uploading 14.98MiB to 171.65.103.160
12:24:15:WU05:FS01:Connecting to 171.65.103.160:8080
12:26:05:WU11:FS01:0x21:Completed 19200 out of 640000 steps (3%)
12:26:18:WU10:FS03:0x21:Completed 512000 out of 1280000 steps (40%)
12:26:42:WU06:FS02:0x17:Completed 4550000 out of 5000000 steps (91%)
12:26:51:WU05:FS01:Upload 0.42%
12:26:52:ERROR:WU05:FS01:Exception: Transfer failed
12:26:52:WU05:FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:9704 run:0 clone:7 gen:385 core:0x21 unit:0x000001c5ab404162551ce8cc21e57cf1
12:26:52:WU05:FS01:Uploading 14.98MiB to 171.64.65.98
12:26:52:WU05:FS01:Connecting to 171.64.65.98:8080
12:27:14:WU05:FS01:Upload 0.42%
12:27:14:WARNING:WU05:FS01:Exception: Failed to send results to work server: Transfer failed
12:27:14:WU05:FS01:Trying to send results to collection server
12:27:15:WU05:FS01:Uploading 14.98MiB to 171.65.103.160
12:27:15:WU05:FS01:Connecting to 171.65.103.160:8080
12:27:20:WU04:FS04:0x17:Completed 4300000 out of 5000000 steps (86%)
12:28:59:WU10:FS03:0x21:Completed 524800 out of 1280000 steps (41%)
12:29:13:WU11:FS01:0x21:Completed 25600 out of 640000 steps (4%)
12:29:57:WU05:FS01:Upload 0.42%
12:29:57:ERROR:WU05:FS01:Exception: Transfer failed
12:29:57:WU05:FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:9704 run:0 clone:7 gen:385 core:0x21 unit:0x000001c5ab404162551ce8cc21e57cf1
12:29:57:WU05:FS01:Uploading 14.98MiB to 171.64.65.98
12:29:57:WU05:FS01:Connecting to 171.64.65.98:8080
12:30:11:WU06:FS02:0x17:Completed 4600000 out of 5000000 steps (92%)
12:30:16:WU05:FS01:Upload 0.42%
12:30:16:WARNING:WU05:FS01:Exception: Failed to send results to work server: Transfer failed
12:30:16:WU05:FS01:Trying to send results to collection server
12:30:16:WU05:FS01:Uploading 14.98MiB to 171.65.103.160
12:30:16:WU05:FS01:Connecting to 171.65.103.160:8080
12:30:35:WU05:FS01:Upload 0.42%
12:30:35:ERROR:WU05:FS01:Exception: Transfer failed
12:31:41:WU10:FS03:0x21:Completed 537600 out of 1280000 steps (42%)
12:32:21:WU11:FS01:0x21:Completed 32000 out of 640000 steps (5%)
12:33:29:WU04:FS04:0x17:Completed 4350000 out of 5000000 steps (87%)
12:33:46:WU06:FS02:0x17:Completed 4650000 out of 5000000 steps (93%)
12:34:11:WU05:FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:9704 run:0 clone:7 gen:385 core:0x21 unit:0x000001c5ab404162551ce8cc21e57cf1
12:34:11:WU05:FS01:Uploading 14.98MiB to 171.64.65.98
12:34:11:WU05:FS01:Connecting to 171.64.65.98:8080
12:34:23:WU10:FS03:0x21:Completed 550400 out of 1280000 steps (43%)
12:34:30:WU05:FS01:Upload 0.42%
12:34:30:WARNING:WU05:FS01:Exception: Failed to send results to work server: Transfer failed
12:34:30:WU05:FS01:Trying to send results to collection server
12:34:30:WU05:FS01:Uploading 14.98MiB to 171.65.103.160
12:34:30:WU05:FS01:Connecting to 171.65.103.160:8080
12:35:29:WU11:FS01:0x21:Completed 38400 out of 640000 steps (6%)
12:37:19:WU06:FS02:0x17:Completed 4700000 out of 5000000 steps (94%)
12:37:21:WU10:FS03:0x21:Completed 563200 out of 1280000 steps (44%)
12:38:40:WU11:FS01:0x21:Completed 44800 out of 640000 steps (7%)
12:39:37:WU05:FS01:Upload 0.42%
12:39:37:ERROR:WU05:FS01:Exception: Transfer failed
12:39:45:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:10468 run:0 clone:137 gen:216 core:0x17 unit:0x00000158538b3db9538cae08fee7025f
12:39:45:WU00:FS03:Uploading 13.14MiB to 140.163.4.233
12:39:45:WU00:FS03:Connecting to 140.163.4.233:8080
12:39:50:WU04:FS04:0x17:Completed 4400000 out of 5000000 steps (88%)
12:40:03:WU10:FS03:0x21:Completed 576000 out of 1280000 steps (45%)
12:40:04:WU00:FS03:Upload 0.48%
12:40:04:WARNING:WU00:FS03:Exception: Failed to send results to work server: Transfer failed
12:40:04:WU00:FS03:Trying to send results to collection server
12:40:04:WU00:FS03:Uploading 13.14MiB to 140.163.4.241
12:40:04:WU00:FS03:Connecting to 140.163.4.241:8080
12:40:23:WU00:FS03:Upload 0.48%
12:40:23:ERROR:WU00:FS03:Exception: Transfer failed
12:40:48:WU06:FS02:0x17:Completed 4750000 out of 5000000 steps (95%)
12:41:02:WU05:FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:9704 run:0 clone:7 gen:385 core:0x21 unit:0x000001c5ab404162551ce8cc21e57cf1
12:41:02:WU05:FS01:Uploading 14.98MiB to 171.64.65.98
12:41:02:WU05:FS01:Connecting to 171.64.65.98:8080
12:41:33:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:68 clone:3 gen:5 core:0x21 unit:0x0000000cab404162553ec641e8bb479d
12:41:33:WU01:FS02:Uploading 14.98MiB to 171.64.65.98
12:41:33:WU01:FS02:Connecting to 171.64.65.98:8080
12:41:48:WU11:FS01:0x21:Completed 51200 out of 640000 steps (8%)
12:42:45:WU10:FS03:0x21:Completed 588800 out of 1280000 steps (46%)
12:43:42:WU01:FS02:Upload 0.42%
12:43:42:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
12:43:42:WU01:FS02:Trying to send results to collection server
12:43:42:WU01:FS02:Uploading 14.98MiB to 171.65.103.160
12:43:42:WU01:FS02:Connecting to 171.65.103.160:8080
12:44:01:WU01:FS02:Upload 0.42%
12:44:01:ERROR:WU01:FS02:Exception: Transfer failed
12:44:23:WU06:FS02:0x17:Completed 4800000 out of 5000000 steps (96%)
12:44:55:WU11:FS01:0x21:Completed 57600 out of 640000 steps (9%)
12:45:27:WU10:FS03:0x21:Completed 601600 out of 1280000 steps (47%)
12:45:58:WU04:FS04:0x17:Completed 4450000 out of 5000000 steps (89%)
12:46:09:WU05:FS01:Upload 0.42%
12:46:09:WARNING:WU05:FS01:Exception: Failed to send results to work server: Transfer failed
12:46:09:WU05:FS01:Trying to send results to collection server
12:46:09:WU05:FS01:Uploading 14.98MiB to 171.65.103.160
12:46:09:WU05:FS01:Connecting to 171.65.103.160:8080
12:46:28:WU05:FS01:Upload 0.42%
12:46:28:ERROR:WU05:FS01:Exception: Transfer failed
12:47:52:WU06:FS02:0x17:Completed 4850000 out of 5000000 steps (97%)
12:48:03:WU11:FS01:0x21:Completed 64000 out of 640000 steps (10%)
12:48:09:WU10:FS03:0x21:Completed 614400 out of 1280000 steps (48%)
12:50:51:WU10:FS03:0x21:Completed 627200 out of 1280000 steps (49%)
12:51:12:WU11:FS01:0x21:Completed 70400 out of 640000 steps (11%)
12:51:28:WU06:FS02:0x17:Completed 4900000 out of 5000000 steps (98%)
12:52:07:WU04:FS04:0x17:Completed 4500000 out of 5000000 steps (90%)
12:52:08:WU05:FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:9704 run:0 clone:7 gen:385 core:0x21 unit:0x000001c5ab404162551ce8cc21e57cf1
12:52:08:WU05:FS01:Uploading 14.98MiB to 171.64.65.98
12:52:08:WU05:FS01:Connecting to 171.64.65.98:8080
12:53:33:WU10:FS03:0x21:Completed 640000 out of 1280000 steps (50%)
12:54:19:WU11:FS01:0x21:Completed 76800 out of 640000 steps (12%)
12:54:44:WU05:FS01:Upload 0.42%
12:54:44:WARNING:WU05:FS01:Exception: Failed to send results to work server: Transfer failed
12:54:44:WU05:FS01:Trying to send results to collection server
12:54:44:WU05:FS01:Uploading 14.98MiB to 171.65.103.160
12:54:44:WU05:FS01:Connecting to 171.65.103.160:8080
12:54:57:WU06:FS02:0x17:Completed 4950000 out of 5000000 steps (99%)
12:55:03:WU05:FS01:Upload 0.42%
12:55:03:ERROR:WU05:FS01:Exception: Transfer failed
12:56:31:WU10:FS03:0x21:Completed 652800 out of 1280000 steps (51%)
12:58:01:WU11:FS01:0x21:Completed 83200 out of 640000 steps (13%)
12:58:26:WU06:FS02:0x17:Completed 5000000 out of 5000000 steps (100%)
12:58:28:WU12:FS02:Connecting to 171.67.108.200:80
12:58:28:WU04:FS04:0x17:Completed 4550000 out of 5000000 steps (91%)
12:58:29:WU12:FS02:Assigned to work server 171.64.65.98
12:58:29:WU12:FS02:Requesting new work unit for slot 02: RUNNING gpu:1:Tahiti XT [Radeon HD 7970] from 171.64.65.98
12:58:29:WU12:FS02:Connecting to 171.64.65.98:8080
12:58:31:WU12:FS02:Downloading 15.70MiB
12:58:32:WU06:FS02:0x17:Saving result file logfile_01.txt
12:58:32:WU06:FS02:0x17:Saving result file checkpointState.xml
12:58:33:WU06:FS02:0x17:Saving result file checkpt.crc
12:58:33:WU06:FS02:0x17:Saving result file log.txt
12:58:33:WU06:FS02:0x17:Saving result file positions.xtc
12:58:34:WU06:FS02:0x17:[email protected] Core Shutdown: FINISHED_UNIT
12:58:35:WU06:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
12:58:35:WU06:FS02:Sending unit results: id:06 state:SEND error:NO_ERROR project:10466 run:0 clone:204 gen:258 core:0x17 unit:0x000001c9538b3db953822ec8a1b6f38b
12:58:35:WU06:FS02:Uploading 6.89MiB to 140.163.4.233
12:58:35:WU06:FS02:Connecting to 140.163.4.233:8080
12:58:37:WU12:FS02:Download 36.62%
12:58:43:WU12:FS02:Download 51.75%
12:58:49:WU12:FS02:Download 75.23%
12:58:54:WU12:FS02:Download complete
12:58:54:WU12:FS02:Received Unit: id:12 state:DOWNLOAD error:NO_ERROR project:9704 run:13 clone:16 gen:28 core:0x21 unit:0x00000026ab404162553ebdb88e7bbcd2
12:58:54:WU12:FS02:Starting
12:58:54:WU12:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/torin/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 12 -suffix 01 -version 704 -lifeline 3616 -checkpoint 15 -gpu 1 -gpu-vendor ati
12:58:54:WU12:FS02:Started FahCore on PID 1408
12:58:54:WU12:FS02:Core PID:3096
12:58:54:WU12:FS02:FahCore 0x21 started
12:58:54:WU12:FS02:0x21:*********************** Log Started 2015-09-06T12:58:54Z ***********************
12:58:54:WU12:FS02:0x21:Project: 9704 (Run 13, Clone 16, Gen 28)
12:58:54:WU12:FS02:0x21:Unit: 0x00000026ab404162553ebdb88e7bbcd2
12:58:54:WU12:FS02:0x21:CPU: 0x00000000000000000000000000000000
12:58:54:WU12:FS02:0x21:Machine: 2
12:58:54:WU12:FS02:0x21:Reading tar file core.xml
12:58:54:WU12:FS02:0x21:Reading tar file system.xml
12:58:57:WU06:FS02:Upload 0.91%
12:58:57:WARNING:WU06:FS02:Exception: Failed to send results to work server: Transfer failed
12:58:57:WU06:FS02:Trying to send results to collection server
12:58:57:WU06:FS02:Uploading 6.89MiB to 140.163.4.241
12:58:57:WU06:FS02:Connecting to 140.163.4.241:8080
12:58:57:WU12:FS02:0x21:Reading tar file integrator.xml
12:58:57:WU12:FS02:0x21:Reading tar file state.xml
12:58:59:WU12:FS02:0x21:Digital signatures verified
12:58:59:WU12:FS02:0x21:[email protected] GPU Core21 [email protected] Core
12:58:59:WU12:FS02:0x21:Version 0.0.11
12:59:13:WU10:FS03:0x21:Completed 665600 out of 1280000 steps (52%)
12:59:19:WU06:FS02:Upload 0.91%
12:59:19:ERROR:WU06:FS02:Exception: Transfer failed
12:59:19:WU06:FS02:Sending unit results: id:06 state:SEND error:NO_ERROR project:10466 run:0 clone:204 gen:258 core:0x17 unit:0x000001c9538b3db953822ec8a1b6f38b
12:59:19:WU06:FS02:Uploading 6.89MiB to 140.163.4.233
12:59:19:WU06:FS02:Connecting to 140.163.4.233:8080
12:59:38:WU06:FS02:Upload 0.91%
12:59:38:WARNING:WU06:FS02:Exception: Failed to send results to work server: Transfer failed
12:59:38:WU06:FS02:Trying to send results to collection server
12:59:38:WU06:FS02:Uploading 6.89MiB to 140.163.4.241
12:59:38:WU06:FS02:Connecting to 140.163.4.241:8080
13:01:06:WU12:FS02:0x21:Completed 0 out of 640000 steps (0%)
13:01:06:WU12:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
13:01:10:WU11:FS01:0x21:Completed 89600 out of 640000 steps (14%)
13:01:44:WU06:FS02:Upload 0.91%
13:01:44:ERROR:WU06:FS02:Exception: Transfer failed
13:01:45:WU06:FS02:Sending unit results: id:06 state:SEND error:NO_ERROR project:10466 run:0 clone:204 gen:258 core:0x17 unit:0x000001c9538b3db953822ec8a1b6f38b
13:01:45:WU06:FS02:Uploading 6.89MiB to 140.163.4.233
13:01:45:WU06:FS02:Connecting to 140.163.4.233:8080
13:01:56:WU10:FS03:0x21:Completed 678400 out of 1280000 steps (53%)
13:02:04:WU06:FS02:Upload 0.91%
13:02:04:WARNING:WU06:FS02:Exception: Failed to send results to work server: Transfer failed
13:02:04:WU06:FS02:Trying to send results to collection server
13:02:04:WU06:FS02:Uploading 6.89MiB to 140.163.4.241
13:02:04:WU06:FS02:Connecting to 140.163.4.241:8080
13:02:23:WU06:FS02:Upload 0.91%
13:02:23:ERROR:WU06:FS02:Exception: Transfer failed
13:03:22:WU06:FS02:Sending unit results: id:06 state:SEND error:NO_ERROR project:10466 run:0 clone:204 gen:258 core:0x17 unit:0x000001c9538b3db953822ec8a1b6f38b
13:03:22:WU06:FS02:Uploading 6.89MiB to 140.163.4.233
13:03:22:WU06:FS02:Connecting to 140.163.4.233:8080
13:03:41:WU06:FS02:Upload 0.91%
13:03:41:WARNING:WU06:FS02:Exception: Failed to send results to work server: Transfer failed
13:03:41:WU06:FS02:Trying to send results to collection server
13:03:41:WU06:FS02:Uploading 6.89MiB to 140.163.4.241
13:03:41:WU06:FS02:Connecting to 140.163.4.241:8080
13:04:03:WU06:FS02:Upload 0.91%
13:04:03:ERROR:WU06:FS02:Exception: Transfer failed
13:04:17:WU11:FS01:0x21:Completed 96000 out of 640000 steps (15%)
13:04:37:WU12:FS02:0x21:Completed 6400 out of 640000 steps (1%)
13:04:38:WU10:FS03:0x21:Completed 691200 out of 1280000 steps (54%)
13:04:38:WU04:FS04:0x17:Completed 4600000 out of 5000000 steps (92%)
13:05:59:WU06:FS02:Sending unit results: id:06 state:SEND error:NO_ERROR project:10466 run:0 clone:204 gen:258 core:0x17 unit:0x000001c9538b3db953822ec8a1b6f38b
13:05:59:WU06:FS02:Uploading 6.89MiB to 140.163.4.233
13:05:59:WU06:FS02:Connecting to 140.163.4.233:8080
13:07:19:WU10:FS03:0x21:Completed 704000 out of 1280000 steps (55%)
13:07:25:WU11:FS01:0x21:Completed 102400 out of 640000 steps (16%)
13:07:39:WU12:FS02:0x21:Completed 12800 out of 640000 steps (2%)
13:08:06:WU06:FS02:Upload 0.91%
13:08:06:WARNING:WU06:FS02:Exception: Failed to send results to work server: Transfer failed
13:08:06:WU06:FS02:Trying to send results to collection server
13:08:06:WU06:FS02:Uploading 6.89MiB to 140.163.4.241
13:08:06:WU06:FS02:Connecting to 140.163.4.241:8080
13:08:25:WU06:FS02:Upload 0.91%
13:08:25:ERROR:WU06:FS02:Exception: Transfer failed
13:10:01:WU10:FS03:0x21:Completed 716800 out of 1280000 steps (56%)
13:10:05:WU05:FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:9704 run:0 clone:7 gen:385 core:0x21 unit:0x000001c5ab404162551ce8cc21e57cf1
13:10:05:WU05:FS01:Uploading 14.98MiB to 171.64.65.98
13:10:05:WU05:FS01:Connecting to 171.64.65.98:8080
13:10:13:WU06:FS02:Sending unit results: id:06 state:SEND error:NO_ERROR project:10466 run:0 clone:204 gen:258 core:0x17 unit:0x000001c9538b3db953822ec8a1b6f38b
13:10:13:WU06:FS02:Uploading 6.89MiB to 140.163.4.233
13:10:13:WU06:FS02:Connecting to 140.163.4.233:8080
13:10:24:WU05:FS01:Upload 0.42%
13:10:24:WARNING:WU05:FS01:Exception: Failed to send results to work server: Transfer failed
13:10:24:WU05:FS01:Trying to send results to collection server
13:10:24:WU05:FS01:Uploading 14.98MiB to 171.65.103.160
13:10:24:WU05:FS01:Connecting to 171.65.103.160:8080
13:10:33:WU11:FS01:0x21:Completed 108800 out of 640000 steps (17%)
13:10:40:WU12:FS02:0x21:Completed 19200 out of 640000 steps (3%)
13:10:43:WU05:FS01:Upload 0.42%
13:10:43:ERROR:WU05:FS01:Exception: Transfer failed
13:10:59:WU04:FS04:0x17:Completed 4650000 out of 5000000 steps (93%)
13:12:59:WU10:FS03:0x21:Completed 729600 out of 1280000 steps (57%)
13:13:41:WU11:FS01:0x21:Completed 115200 out of 640000 steps (18%)
13:13:41:WU12:FS02:0x21:Completed 25600 out of 640000 steps (4%)
13:14:23:WU06:FS02:Upload 0.91%
13:14:23:WARNING:WU06:FS02:Exception: Failed to send results to work server: Transfer failed
13:14:23:WU06:FS02:Trying to send results to collection server
13:14:23:WU06:FS02:Uploading 6.89MiB to 140.163.4.241
13:14:23:WU06:FS02:Connecting to 140.163.4.241:8080
13:14:42:WU06:FS02:Upload 0.91%
13:14:42:ERROR:WU06:FS02:Exception: Transfer failed
13:15:40:WU10:FS03:0x21:Completed 742400 out of 1280000 steps (58%)
13:16:42:WU12:FS02:0x21:Completed 32000 out of 640000 steps (5%)
13:16:48:WU11:FS01:0x21:Completed 121600 out of 640000 steps (19%)
13:17:05:WU06:FS02:Sending unit results: id:06 state:SEND error:NO_ERROR project:10466 run:0 clone:204 gen:258 core:0x17 unit:0x000001c9538b3db953822ec8a1b6f38b
13:17:05:WU06:FS02:Uploading 6.89MiB to 140.163.4.233
13:17:05:WU06:FS02:Connecting to 140.163.4.233:8080
13:17:07:WU04:FS04:0x17:Completed 4700000 out of 5000000 steps (94%)
13:18:22:WU10:FS03:0x21:Completed 755200 out of 1280000 steps (59%)
13:19:43:WU12:FS02:0x21:Completed 38400 out of 640000 steps (6%)
13:19:56:WU11:FS01:0x21:Completed 128000 out of 640000 steps (20%)
13:21:03:WU10:FS03:0x21:Completed 768000 out of 1280000 steps (60%)
13:22:11:WU06:FS02:Upload 0.91%
13:22:11:WARNING:WU06:FS02:Exception: Failed to send results to work server: Transfer failed
13:22:11:WU06:FS02:Trying to send results to collection server
13:22:11:WU06:FS02:Uploading 6.89MiB to 140.163.4.241
13:22:11:WU06:FS02:Connecting to 140.163.4.241:8080
13:22:44:WU12:FS02:0x21:Completed 44800 out of 640000 steps (7%)
13:23:03:WU11:FS01:0x21:Completed 134400 out of 640000 steps (21%)
13:23:15:WU04:FS04:0x17:Completed 4750000 out of 5000000 steps (95%)
13:23:45:WU10:FS03:0x21:Completed 780800 out of 1280000 steps (61%)
13:25:46:WU12:FS02:0x21:Completed 51200 out of 640000 steps (8%)
13:26:11:WU11:FS01:0x21:Completed 140800 out of 640000 steps (22%)
13:26:27:WU10:FS03:0x21:Completed 793600 out of 1280000 steps (62%)
13:28:46:WU12:FS02:0x21:Completed 57600 out of 640000 steps (9%)
13:28:48:WU06:FS02:Upload 0.91%
13:28:48:ERROR:WU06:FS02:Exception: Transfer failed
13:28:49:WU06:FS02:Sending unit results: id:06 state:SEND error:NO_ERROR project:10466 run:0 clone:204 gen:258 core:0x17 unit:0x000001c9538b3db953822ec8a1b6f38b
13:28:49:WU06:FS02:Uploading 6.89MiB to 140.163.4.233
13:28:49:WU06:FS02:Connecting to 140.163.4.233:8080
13:29:08:WU06:FS02:Upload 0.91%
13:29:08:WARNING:WU06:FS02:Exception: Failed to send results to work server: Transfer failed
13:29:08:WU06:FS02:Trying to send results to collection server
13:29:08:WU06:FS02:Uploading 6.89MiB to 140.163.4.241
13:29:08:WU06:FS02:Connecting to 140.163.4.241:8080
13:29:19:WU11:FS01:0x21:Completed 147200 out of 640000 steps (23%)
13:29:25:WU10:FS03:0x21:Completed 806400 out of 1280000 steps (63%)
13:29:36:WU04:FS04:0x17:Completed 4800000 out of 5000000 steps (96%)
13:31:47:WU12:FS02:0x21:Completed 64000 out of 640000 steps (10%)
13:32:07:WU10:FS03:0x21:Completed 819200 out of 1280000 steps (64%)
13:32:26:WU11:FS01:0x21:Completed 153600 out of 640000 steps (24%)
13:33:17:WU06:FS02:Upload 0.91%
13:33:17:ERROR:WU06:FS02:Exception: Transfer failed
13:34:48:WU12:FS02:0x21:Completed 70400 out of 640000 steps (11%)
13:34:48:WU10:FS03:0x21:Completed 832000 out of 1280000 steps (65%)
13:35:34:WU11:FS01:0x21:Completed 160000 out of 640000 steps (25%)
13:35:45:WU04:FS04:0x17:Completed 4850000 out of 5000000 steps (97%)
13:37:30:WU10:FS03:0x21:Completed 844800 out of 1280000 steps (66%)
13:37:49:WU12:FS02:0x21:Completed 76800 out of 640000 steps (12%)
13:39:07:WU05:FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:9704 run:0 clone:7 gen:385 core:0x21 unit:0x000001c5ab404162551ce8cc21e57cf1
13:39:07:WU05:FS01:Uploading 14.98MiB to 171.64.65.98
13:39:07:WU05:FS01:Connecting to 171.64.65.98:8080
13:39:16:WU11:FS01:0x21:Completed 166400 out of 640000 steps (26%)
13:40:12:WU10:FS03:0x21:Completed 857600 out of 1280000 steps (67%)
13:41:24:WU12:FS02:0x21:Completed 83200 out of 640000 steps (13%)
13:41:41:WU05:FS01:Upload 0.42%
13:41:41:WARNING:WU05:FS01:Exception: Failed to send results to work server: Transfer failed
13:41:41:WU05:FS01:Trying to send results to collection server
13:41:41:WU05:FS01:Uploading 14.98MiB to 171.65.103.160
13:41:41:WU05:FS01:Connecting to 171.65.103.160:8080
13:42:00:WU05:FS01:Upload 0.42%
13:42:00:ERROR:WU05:FS01:Exception: Transfer failed
13:42:06:WU04:FS04:0x17:Completed 4900000 out of 5000000 steps (98%)
13:42:24:WU11:FS01:0x21:Completed 172800 out of 640000 steps (27%)
13:42:54:WU10:FS03:0x21:Completed 870400 out of 1280000 steps (68%)
13:44:25:WU12:FS02:0x21:Completed 89600 out of 640000 steps (14%)
13:45:32:WU11:FS01:0x21:Completed 179200 out of 640000 steps (28%)
13:45:52:WU10:FS03:0x21:Completed 883200 out of 1280000 steps (69%)
13:46:45:WU06:FS02:Sending unit results: id:06 state:SEND error:NO_ERROR project:10466 run:0 clone:204 gen:258 core:0x17 unit:0x000001c9538b3db953822ec8a1b6f38b
13:46:45:WU06:FS02:Uploading 6.89MiB to 140.163.4.233
13:46:45:WU06:FS02:Connecting to 140.163.4.233:8080
13:47:25:WU12:FS02:0x21:Completed 96000 out of 640000 steps (15%)
13:47:43:WU06:FS02:Upload 0.91%
13:47:43:WARNING:WU06:FS02:Exception: Failed to send results to work server: Transfer failed
13:47:43:WU06:FS02:Trying to send results to collection server
13:47:43:WU06:FS02:Uploading 6.89MiB to 140.163.4.241
13:47:43:WU06:FS02:Connecting to 140.163.4.241:8080
13:48:14:WU04:FS04:0x17:Completed 4950000 out of 5000000 steps (99%)
13:48:33:WU10:FS03:0x21:Completed 896000 out of 1280000 steps (70%)
13:48:40:WU11:FS01:0x21:Completed 185600 out of 640000 steps (29%)
 
Last edited:

Nihilus

Member
Joined
Oct 24, 2009
Location
NC
Yikes, looks like a boggered up mess. The problem looks to start with wu06 at 22:20:30 where it said "server does not like results."
Everything seems to get back jammed after that. Not sure what type of work unit that was - perhaps a core 17 vs core 21 thing?
Still kinda new to the GPU folding, but does changing cause preference get you more consistent work units? Not sure if that would help, though.
 
OP
torin3

torin3

Member
Joined
Dec 25, 2004
Do you have hfm set to look for a hostname or ip address? I've had hfm drop a client until I realised that the machine was set to dhcp and the address had changed

How do you switch between hostname / IP? I don't see that option.

But I did check. The IP address has been the same throughout.

Edit: UltraVNC is behaving normally again.

Edit the second: And after restarting HFM, it is working again too. Still no idea what caused the problem.
 
Last edited:

Nathan_P

Member
Joined
Apr 28, 2012
Location
Jersey, Channel islands
Glad its fixed but to answer your question if you are monitoring a v6 client you can use the computer host name in the format \\hostname, for v7 clients I can only get it to work by adding the ip address e.g 192.168.1.200
 
OP
torin3

torin3

Member
Joined
Dec 25, 2004
Glad its fixed but to answer your question if you are monitoring a v6 client you can use the computer host name in the format \\hostname, for v7 clients I can only get it to work by adding the ip address e.g 192.168.1.200

All v7 clients here.