Task 11580391
| Name | ParityModified-1639959661-29733-3-0_0 |
| Workunit | 8802024 |
| Created | 15 Feb 2022, 11:32:04 UTC |
| Sent | 26 Feb 2022, 4:39:28 UTC |
| Report deadline | 6 Mar 2022, 4:39:28 UTC |
| Received | 5 Mar 2022, 4:51:43 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 17083 |
| Run time | 3 hours 3 min 40 sec |
| CPU time | 2 hours 55 min 28 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 3,197.72 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.30 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
12 | loss: 0.0311339 | val_loss: 0.0311647 | Time: 8935.75 ms
[2022-03-04 15:39:13 main:574] : INFO : Epoch 1413 | loss: 0.0311339 | val_loss: 0.0311641 | Time: 8937.67 ms
[2022-03-04 15:39:21 main:574] : INFO : Epoch 1414 | loss: 0.0311359 | val_loss: 0.0311608 | Time: 7581.24 ms
[2022-03-04 15:39:28 main:574] : INFO : Epoch 1415 | loss: 0.0311369 | val_loss: 0.0311604 | Time: 7891.35 ms
[2022-03-04 15:39:36 main:574] : INFO : Epoch 1416 | loss: 0.0311348 | val_loss: 0.0311619 | Time: 7975.18 ms
[2022-03-04 15:39:45 main:574] : INFO : Epoch 1417 | loss: 0.0311343 | val_loss: 0.0311637 | Time: 8423.77 ms
[2022-03-04 15:39:53 main:574] : INFO : Epoch 1418 | loss: 0.0311348 | val_loss: 0.0311629 | Time: 8165.91 ms
[2022-03-04 15:40:01 main:574] : INFO : Epoch 1419 | loss: 0.0311375 | val_loss: 0.031161 | Time: 7765.35 ms
[2022-03-04 15:40:09 main:574] : INFO : Epoch 1420 | loss: 0.0311366 | val_loss: 0.0311637 | Time: 8002.64 ms
[2022-03-04 15:40:18 main:574] : INFO : Epoch 1421 | loss: 0.031134 | val_loss: 0.031159 | Time: 8806.83 ms
[2022-03-04 15:40:27 main:574] : INFO : Epoch 1422 | loss: 0.0311343 | val_loss: 0.0311632 | Time: 9011.52 ms
[2022-03-04 15:40:36 main:574] : INFO : Epoch 1423 | loss: 0.0311367 | val_loss: 0.0311617 | Time: 9348.96 ms
[2022-03-04 15:40:44 main:574] : INFO : Epoch 1424 | loss: 0.031134 | val_loss: 0.0311588 | Time: 7854.07 ms
[2022-03-04 15:40:52 main:574] : INFO : Epoch 1425 | loss: 0.0311347 | val_loss: 0.0311688 | Time: 7775.44 ms
[2022-03-04 15:41:00 main:574] : INFO : Epoch 1426 | loss: 0.0311361 | val_loss: 0.0311685 | Time: 8000.21 ms
[2022-03-04 15:41:08 main:574] : INFO : Epoch 1427 | loss: 0.0311369 | val_loss: 0.0311631 | Time: 8765.78 ms
[2022-03-04 15:41:16 main:574] : INFO : Epoch 1428 | loss: 0.0311325 | val_loss: 0.0311588 | Time: 7853.23 ms
[2022-03-04 15:41:24 main:574] : INFO : Epoch 1429 | loss: 0.0311325 | val_loss: 0.0311622 | Time: 8005.62 ms
[2022-03-04 15:41:32 main:574] : INFO : Epoch 1430 | loss: 0.0311327 | val_loss: 0.0311615 | Time: 7639.26 ms
[2022-03-04 15:41:39 main:574] : INFO : Epoch 1431 | loss: 0.0311321 | val_loss: 0.0311621 | Time: 7298.24 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650)
[2022-03-04 16:20:03 main:435] : INFO : Set logging level to 1
[2022-03-04 16:20:03 main:441] : INFO : Running in BOINC Client mode
[2022-03-04 16:20:03 main:444] : INFO : Resolving all filenames
[2022-03-04 16:20:03 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-04 16:20:03 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-04 16:20:03 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-04 16:20:03 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-04 16:20:03 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-04 16:20:03 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-03-04 16:20:03 main:474] : INFO : Configuration:
[2022-03-04 16:20:03 main:475] : INFO : Model type: GRU
[2022-03-04 16:20:03 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-03-04 16:20:03 main:477] : INFO : Max Epochs: 2048
[2022-03-04 16:20:03 main:478] : INFO : Batch Size: 128
[2022-03-04 16:20:03 main:479] : INFO : Learning Rate: 0.01
[2022-03-04 16:20:03 main:480] : INFO : Patience: 10
[2022-03-04 16:20:03 main:481] : INFO : Hidden Width: 12
[2022-03-04 16:20:03 main:482] : INFO : # Recurrent Layers: 4
[2022-03-04 16:20:03 main:483] : INFO : # Backend Layers: 4
[2022-03-04 16:20:03 main:484] : INFO : # Threads: 1
[2022-03-04 16:20:03 main:486] : INFO : Preparing Dataset
[2022-03-04 16:20:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-04 16:20:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-04 16:20:05 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-03-04 16:20:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-04 16:20:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-04 16:20:05 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-03-04 16:20:05 main:494] : INFO : Creating Model
[2022-03-04 16:20:05 main:507] : INFO : Preparing config file
[2022-03-04 16:20:05 main:511] : INFO : Found checkpoint, attempting to load...
[2022-03-04 16:20:05 main:512] : INFO : Loading config
[2022-03-04 16:20:05 main:514] : INFO : Loading state
[2022-03-04 16:20:06 main:559] : INFO : Loading DataLoader into Memory
[2022-03-04 16:20:06 main:562] : INFO : Starting Training
[2022-03-04 16:20:10 main:574] : INFO : Epoch 1430 | loss: 0.0311714 | val_loss: 0.03117 | Time: 4653.93 ms
[2022-03-04 16:20:15 main:574] : INFO : Epoch 1431 | loss: 0.0311368 | val_loss: 0.0311672 | Time: 4340.61 ms
[2022-03-04 16:20:19 main:574] : INFO : Epoch 1432 | loss: 0.0311345 | val_loss: 0.0311647 | Time: 4538.53 ms
[2022-03-04 16:20:24 main:574] : INFO : Epoch 1433 | loss: 0.0311333 | val_loss: 0.0311639 | Time: 4823.2 ms
[2022-03-04 16:20:29 main:574] : INFO : Epoch 1434 | loss: 0.0311328 | val_loss: 0.0311634 | Time: 4845.92 ms
[2022-03-04 16:20:34 main:574] : INFO : Epoch 1435 | loss: 0.0311317 | val_loss: 0.0311638 | Time: 4634.55 ms
[2022-03-04 16:20:38 main:574] : INFO : Epoch 1436 | loss: 0.0311317 | val_loss: 0.0311641 | Time: 4825.58 ms
[2022-03-04 16:20:44 main:574] : INFO : Epoch 1437 | loss: 0.031134 | val_loss: 0.0311615 | Time: 5050.78 ms
[2022-03-04 16:20:49 main:574] : INFO : Epoch 1438 | loss: 0.0311317 | val_loss: 0.0311652 | Time: 5229.35 ms
[2022-03-04 16:20:54 main:574] : INFO : Epoch 1439 | loss: 0.0311318 | val_loss: 0.0311652 | Time: 5162.26 ms
[2022-03-04 16:21:00 main:574] : INFO : Epoch 1440 | loss: 0.0311339 | val_loss: 0.0311693 | Time: 5809.81 ms
[2022-03-04 16:21:08 main:574] : INFO : Epoch 1441 | loss: 0.0311348 | val_loss: 0.0311646 | Time: 7753.24 ms
[2022-03-04 16:21:15 main:574] : INFO : Epoch 1442 | loss: 0.0311324 | val_loss: 0.0311688 | Time: 7458.7 ms
[2022-03-04 16:21:23 main:574] : INFO : Epoch 1443 | loss: 0.0311307 | val_loss: 0.0311667 | Time: 8196.45 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650)
[2022-03-04 16:32:32 main:435] : INFO : Set logging level to 1
[2022-03-04 16:32:32 main:441] : INFO : Running in BOINC Client mode
[2022-03-04 16:32:32 main:444] : INFO : Resolving all filenames
[2022-03-04 16:32:32 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-04 16:32:32 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-04 16:32:32 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-04 16:32:32 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-04 16:32:32 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-04 16:32:32 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-03-04 16:32:32 main:474] : INFO : Configuration:
[2022-03-04 16:32:32 main:475] : INFO : Model type: GRU
[2022-03-04 16:32:32 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-03-04 16:32:32 main:477] : INFO : Max Epochs: 2048
[2022-03-04 16:32:32 main:478] : INFO : Batch Size: 128
[2022-03-04 16:32:32 main:479] : INFO : Learning Rate: 0.01
[2022-03-04 16:32:32 main:480] : INFO : Patience: 10
[2022-03-04 16:32:32 main:481] : INFO : Hidden Width: 12
[2022-03-04 16:32:32 main:482] : INFO : # Recurrent Layers: 4
[2022-03-04 16:32:32 main:483] : INFO : # Backend Layers: 4
[2022-03-04 16:32:32 main:484] : INFO : # Threads: 1
[2022-03-04 16:32:32 main:486] : INFO : Preparing Dataset
[2022-03-04 16:32:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-04 16:32:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-04 16:32:34 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-03-04 16:32:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-04 16:32:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-04 16:32:34 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-03-04 16:32:34 main:494] : INFO : Creating Model
[2022-03-04 16:32:34 main:507] : INFO : Preparing config file
[2022-03-04 16:32:34 main:511] : INFO : Found checkpoint, attempting to load...
[2022-03-04 16:32:34 main:512] : INFO : Loading config
[2022-03-04 16:32:34 main:514] : INFO : Loading state
[2022-03-04 16:32:35 main:559] : INFO : Loading DataLoader into Memory
[2022-03-04 16:32:35 main:562] : INFO : Starting Training
[2022-03-04 16:32:40 main:574] : INFO : Epoch 1430 | loss: 0.0311669 | val_loss: 0.0311676 | Time: 4855.24 ms
[2022-03-04 16:32:45 main:574] : INFO : Epoch 1431 | loss: 0.0311387 | val_loss: 0.0311643 | Time: 4695.66 ms
[2022-03-04 16:32:50 main:574] : INFO : Epoch 1432 | loss: 0.0311342 | val_loss: 0.0311676 | Time: 4637.36 ms
[2022-03-04 16:32:54 main:574] : INFO : Epoch 1433 | loss: 0.0311332 | val_loss: 0.0311655 | Time: 4932.15 ms
[2022-03-04 16:32:59 main:574] : INFO : Epoch 1434 | loss: 0.0311334 | val_loss: 0.0311674 | Time: 5016.15 ms
[2022-03-04 16:33:05 main:574] : INFO : Epoch 1435 | loss: 0.0311371 | val_loss: 0.031165 | Time: 5012.05 ms
[2022-03-04 16:33:10 main:574] : INFO : Epoch 1436 | loss: 0.0311364 | val_loss: 0.0311624 | Time: 5129.32 ms
[2022-03-04 16:33:15 main:574] : INFO : Epoch 1437 | loss: 0.0311356 | val_loss: 0.0311642 | Time: 5187.55 ms
[2022-03-04 16:33:20 main:574] : INFO : Epoch 1438 | loss: 0.0311368 | val_loss: 0.0311676 | Time: 5350.04 ms
[2022-03-04 16:33:26 main:574] : INFO : Epoch 1439 | loss: 0.0311347 | val_loss: 0.0311616 | Time: 5425.29 ms
[2022-03-04 16:33:31 main:574] : INFO : Epoch 1440 | loss: 0.0311328 | val_loss: 0.0311673 | Time: 5593.83 ms
[2022-03-04 16:33:39 main:574] : INFO : Epoch 1441 | loss: 0.031134 | val_loss: 0.0311624 | Time: 7919.33 ms
[2022-03-04 16:33:47 main:574] : INFO : Epoch 1442 | loss: 0.0311326 | val_loss: 0.0311647 | Time: 7797.93 ms
[2022-03-04 16:33:56 main:574] : INFO : Epoch 1443 | loss: 0.0311345 | val_loss: 0.0311603 | Time: 9152.35 ms
[2022-03-04 16:34:05 main:574] : INFO : Epoch 1444 | loss: 0.0311346 | val_loss: 0.031161 | Time: 9191.17 ms
[2022-03-04 16:34:14 main:574] : INFO : Epoch 1445 | loss: 0.0311327 | val_loss: 0.031162 | Time: 8613.77 ms
[2022-03-04 16:34:22 main:574] : INFO : Epoch 1446 | loss: 0.0311317 | val_loss: 0.0311616 | Time: 8140.37 ms
[2022-03-04 16:34:29 main:574] : INFO : Epoch 1447 | loss: 0.0311325 | val_loss: 0.0311683 | Time: 7381.07 ms
[2022-03-04 16:34:37 main:574] : INFO : Epoch 1448 | loss: 0.0311357 | val_loss: 0.0311654 | Time: 7300.95 ms
[2022-03-04 16:34:44 main:574] : INFO : Epoch 1449 | loss: 0.0311333 | val_loss: 0.0311645 | Time: 7219.91 ms
[2022-03-04 16:34:51 main:574] : INFO : Epoch 1450 | loss: 0.031132 | val_loss: 0.031162 | Time: 7203.69 ms
[2022-03-04 16:34:59 main:574] : INFO : Epoch 1451 | loss: 0.0311327 | val_loss: 0.0311688 | Time: 7426.12 ms
[2022-03-04 16:35:06 main:574] : INFO : Epoch 1452 | loss: 0.0311346 | val_loss: 0.0311609 | Time: 7184.53 ms
[2022-03-04 16:35:13 main:574] : INFO : Epoch 1453 | loss: 0.0311346 | val_loss: 0.031162 | Time: 7171.11 ms
[2022-03-04 16:35:20 main:574] : INFO : Epoch 1454 | loss: 0.0311355 | val_loss: 0.0311619 | Time: 7279.95 ms
[2022-03-04 16:35:28 main:574] : INFO : Epoch 1455 | loss: 0.0311376 | val_loss: 0.0311679 | Time: 7360.53 ms
[2022-03-04 16:35:35 main:574] : INFO : Epoch 1456 | loss: 0.031143 | val_loss: 0.031162 | Time: 7156.89 ms
[2022-03-04 16:35:42 main:574] : INFO : Epoch 1457 | loss: 0.0311419 | val_loss: 0.0311628 | Time: 7224.71 ms
[2022-03-04 16:35:49 main:574] : INFO : Epoch 1458 | loss: 0.0311412 | val_loss: 0.0311619 | Time: 7117.2 ms
[2022-03-04 16:35:56 main:574] : INFO : Epoch 1459 | loss: 0.0311391 | val_loss: 0.0311609 | Time: 7220.78 ms
[2022-03-04 16:36:04 main:574] : INFO : Epoch 1460 | loss: 0.0311383 | val_loss: 0.0311625 | Time: 7277.84 ms
[2022-03-04 16:36:11 main:574] : INFO : Epoch 1461 | loss: 0.0311365 | val_loss: 0.0311589 | Time: 7141.3 ms
[2022-03-04 16:36:18 main:574] : INFO : Epoch 1462 | loss: 0.031137 | val_loss: 0.0311631 | Time: 7069.32 ms
[2022-03-04 16:36:25 main:574] : INFO : Epoch 1463 | loss: 0.0311395 | val_loss: 0.0311652 | Time: 7256.04 ms
[2022-03-04 16:36:32 main:574] : INFO : Epoch 1464 | loss: 0.0311417 | val_loss: 0.0311635 | Time: 7342.06 ms
[2022-03-04 16:36:40 main:574] : INFO : Epoch 1465 | loss: 0.0311405 | val_loss: 0.0311649 | Time: 7494.24 ms
[2022-03-04 16:36:47 main:574] : INFO : Epoch 1466 | loss: 0.0311398 | val_loss: 0.0311639 | Time: 7461.29 ms
[2022-03-04 16:36:55 main:574] : INFO : Epoch 1467 | loss: 0.0311388 | val_loss: 0.0311702 | Time: 7375.61 ms
[2022-03-04 16:37:02 main:574] : INFO : Epoch 1468 | loss: 0.0311377 | val_loss: 0.0311655 | Time: 7602.62 ms
[2022-03-04 16:37:10 main:574] : INFO : Epoch 1469 | loss: 0.0311371 | val_loss: 0.0311666 | Time: 7599.96 ms
[2022-03-04 16:37:17 main:574] : INFO : Epoch 1470 | loss: 0.0311382 | val_loss: 0.0311652 | Time: 7383.13 ms
[2022-03-04 16:37:25 main:574] : INFO : Epoch 1471 | loss: 0.0311395 | val_loss: 0.0311682 | Time: 7499.81 ms
[2022-03-04 16:37:32 main:574] : INFO : Epoch 1472 | loss: 0.0311375 | val_loss: 0.0311672 | Time: 7471.18 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650)
[2022-03-04 17:49:24 main:435] : INFO : Set logging level to 1
[2022-03-04 17:49:24 main:441] : INFO : Running in BOINC Client mode
[2022-03-04 17:49:24 main:444] : INFO : Resolving all filenames
[2022-03-04 17:49:24 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-04 17:49:24 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-04 17:49:24 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-04 17:49:24 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-04 17:49:24 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-04 17:49:24 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-03-04 17:49:24 main:474] : INFO : Configuration:
[2022-03-04 17:49:24 main:475] : INFO : Model type: GRU
[2022-03-04 17:49:24 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-03-04 17:49:24 main:477] : INFO : Max Epochs: 2048
[2022-03-04 17:49:24 main:478] : INFO : Batch Size: 128
[2022-03-04 17:49:24 main:479] : INFO : Learning Rate: 0.01
[2022-03-04 17:49:24 main:480] : INFO : Patience: 10
[2022-03-04 17:49:24 main:481] : INFO : Hidden Width: 12
[2022-03-04 17:49:24 main:482] : INFO : # Recurrent Layers: 4
[2022-03-04 17:49:24 main:483] : INFO : # Backend Layers: 4
[2022-03-04 17:49:24 main:484] : INFO : # Threads: 1
[2022-03-04 17:49:24 main:486] : INFO : Preparing Dataset
[2022-03-04 17:49:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-04 17:49:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-04 17:49:25 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-03-04 17:49:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-04 17:49:26 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-04 17:49:26 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-03-04 17:49:26 main:494] : INFO : Creating Model
[2022-03-04 17:49:26 main:507] : INFO : Preparing config file
[2022-03-04 17:49:26 main:511] : INFO : Found checkpoint, attempting to load...
[2022-03-04 17:49:26 main:512] : INFO : Loading config
[2022-03-04 17:49:26 main:514] : INFO : Loading state
[2022-03-04 17:49:26 main:559] : INFO : Loading DataLoader into Memory
[2022-03-04 17:49:27 main:562] : INFO : Starting Training
[2022-03-04 17:49:31 main:574] : INFO : Epoch 1459 | loss: 0.0311735 | val_loss: 0.0311661 | Time: 4589.9 ms
[2022-03-04 17:49:36 main:574] : INFO : Epoch 1460 | loss: 0.0311419 | val_loss: 0.0311647 | Time: 4649.13 ms
[2022-03-04 17:49:40 main:574] : INFO : Epoch 1461 | loss: 0.0311407 | val_loss: 0.031162 | Time: 4567.48 ms
[2022-03-04 17:49:45 main:574] : INFO : Epoch 1462 | loss: 0.0311389 | val_loss: 0.0311629 | Time: 4596.16 ms
[2022-03-04 17:49:50 main:574] : INFO : Epoch 1463 | loss: 0.0311367 | val_loss: 0.0311626 | Time: 4755.95 ms
[2022-03-04 17:49:55 main:574] : INFO : Epoch 1464 | loss: 0.0311369 | val_loss: 0.0311626 | Time: 5056.58 ms
[2022-03-04 17:50:00 main:574] : INFO : Epoch 1465 | loss: 0.0311358 | val_loss: 0.0311607 | Time: 4979.73 ms
[2022-03-04 17:50:05 main:574] : INFO : Epoch 1466 | loss: 0.0311362 | val_loss: 0.0311648 | Time: 4913.45 ms
[2022-03-04 17:50:10 main:574] : INFO : Epoch 1467 | loss: 0.0311369 | val_loss: 0.0311641 | Time: 5225.09 ms
[2022-03-04 17:50:15 main:574] : INFO : Epoch 1468 | loss: 0.0311362 | val_loss: 0.0311615 | Time: 5050.59 ms
[2022-03-04 17:50:21 main:574] : INFO : Epoch 1469 | loss: 0.0311336 | val_loss: 0.0311661 | Time: 5553.6 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650)
[2022-03-04 17:57:29 main:435] : INFO : Set logging level to 1
[2022-03-04 17:57:29 main:441] : INFO : Running in BOINC Client mode
[2022-03-04 17:57:29 main:444] : INFO : Resolving all filenames
[2022-03-04 17:57:29 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-04 17:57:29 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-04 17:57:29 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-04 17:57:29 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-04 17:57:29 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-04 17:57:29 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-03-04 17:57:29 main:474] : INFO : Configuration:
[2022-03-04 17:57:29 main:475] : INFO : Model type: GRU
[2022-03-04 17:57:29 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-03-04 17:57:29 main:477] : INFO : Max Epochs: 2048
[2022-03-04 17:57:29 main:478] : INFO : Batch Size: 128
[2022-03-04 17:57:29 main:479] : INFO : Learning Rate: 0.01
[2022-03-04 17:57:29 main:480] : INFO : Patience: 10
[2022-03-04 17:57:29 main:481] : INFO : Hidden Width: 12
[2022-03-04 17:57:29 main:482] : INFO : # Recurrent Layers: 4
[2022-03-04 17:57:29 main:483] : INFO : # Backend Layers: 4
[2022-03-04 17:57:29 main:484] : INFO : # Threads: 1
[2022-03-04 17:57:29 main:486] : INFO : Preparing Dataset
[2022-03-04 17:57:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-04 17:57:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-04 17:57:31 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-03-04 17:57:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-04 17:57:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-04 17:57:31 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-03-04 17:57:31 main:494] : INFO : Creating Model
[2022-03-04 17:57:31 main:507] : INFO : Preparing config file
[2022-03-04 17:57:31 main:511] : INFO : Found checkpoint, attempting to load...
[2022-03-04 17:57:31 main:512] : INFO : Loading config
[2022-03-04 17:57:31 main:514] : INFO : Loading state
[2022-03-04 17:57:32 main:559] : INFO : Loading DataLoader into Memory
[2022-03-04 17:57:32 main:562] : INFO : Starting Training
[2022-03-04 17:57:36 main:574] : INFO : Epoch 1459 | loss: 0.0311709 | val_loss: 0.0311681 | Time: 4630.14 ms
[2022-03-04 17:57:41 main:574] : INFO : Epoch 1460 | loss: 0.0311434 | val_loss: 0.0311627 | Time: 4237.26 ms
[2022-03-04 17:57:45 main:574] : INFO : Epoch 1461 | loss: 0.0311393 | val_loss: 0.0311629 | Time: 4437.67 ms
[2022-03-04 17:57:49 main:574] : INFO : Epoch 1462 | loss: 0.0311382 | val_loss: 0.031163 | Time: 4513.79 ms
[2022-03-04 17:57:54 main:574] : INFO : Epoch 1463 | loss: 0.0311383 | val_loss: 0.0311638 | Time: 4373 ms
[2022-03-04 17:57:59 main:574] : INFO : Epoch 1464 | loss: 0.0311395 | val_loss: 0.0311665 | Time: 4728.5 ms
[2022-03-04 17:58:03 main:574] : INFO : Epoch 1465 | loss: 0.0311377 | val_loss: 0.0311633 | Time: 4798.12 ms
[2022-03-04 17:58:08 main:574] : INFO : Epoch 1466 | loss: 0.0311361 | val_loss: 0.0311612 | Time: 4849.44 ms
[2022-03-04 17:58:13 main:574] : INFO : Epoch 1467 | loss: 0.0311365 | val_loss: 0.0311617 | Time: 4807.03 ms
[2022-03-04 17:58:18 main:574] : INFO : Epoch 1468 | loss: 0.0311358 | val_loss: 0.0311625 | Time: 4878.42 ms
[2022-03-04 17:58:23 main:574] : INFO : Epoch 1469 | loss: 0.0311367 | val_loss: 0.0311677 | Time: 4946.82 ms
[2022-03-04 17:58:28 main:574] : INFO : Epoch 1470 | loss: 0.0311367 | val_loss: 0.03116 | Time: 5123.1 ms
[2022-03-04 17:58:35 main:574] : INFO : Epoch 1471 | loss: 0.0311364 | val_loss: 0.0311639 | Time: 7360.64 ms
[2022-03-04 17:58:43 main:574] : INFO : Epoch 1472 | loss: 0.0311379 | val_loss: 0.0311589 | Time: 7572.66 ms
[2022-03-04 17:58:51 main:574] : INFO : Epoch 1473 | loss: 0.0311365 | val_loss: 0.031159 | Time: 7862.4 ms
[2022-03-04 17:58:59 main:574] : INFO : Epoch 1474 | loss: 0.0311393 | val_loss: 0.0311601 | Time: 8562.93 ms
[2022-03-04 17:59:08 main:574] : INFO : Epoch 1475 | loss: 0.0311463 | val_loss: 0.0311637 | Time: 8851.33 ms
[2022-03-04 17:59:16 main:574] : INFO : Epoch 1476 | loss: 0.0311374 | val_loss: 0.0311608 | Time: 7635.39 ms
[2022-03-04 17:59:23 main:574] : INFO : Epoch 1477 | loss: 0.0311352 | val_loss: 0.0311595 | Time: 7171.11 ms
[2022-03-04 17:59:30 main:574] : INFO : Epoch 1478 | loss: 0.0311387 | val_loss: 0.0311591 | Time: 7251.23 ms
[2022-03-04 17:59:38 main:574] : INFO : Epoch 1479 | loss: 0.0311372 | val_loss: 0.0311579 | Time: 7380.38 ms
[2022-03-04 17:59:45 main:574] : INFO : Epoch 1480 | loss: 0.0311401 | val_loss: 0.0311639 | Time: 7237.75 ms
[2022-03-04 17:59:52 main:574] : INFO : Epoch 1481 | loss: 0.03114 | val_loss: 0.0311618 | Time: 7346.26 ms
[2022-03-04 17:59:59 main:574] : INFO : Epoch 1482 | loss: 0.031137 | val_loss: 0.0311597 | Time: 6964.69 ms
[2022-03-04 18:00:06 main:574] : INFO : Epoch 1483 | loss: 0.0311379 | val_loss: 0.0311596 | Time: 6952.64 ms
[2022-03-04 18:00:13 main:574] : INFO : Epoch 1484 | loss: 0.0311363 | val_loss: 0.0311606 | Time: 7245.63 ms
[2022-03-04 18:00:21 main:574] : INFO : Epoch 1485 | loss: 0.0311355 | val_loss: 0.0311616 | Time: 7070.28 ms
[2022-03-04 18:00:28 main:574] : INFO : Epoch 1486 | loss: 0.0311348 | val_loss: 0.0311586 | Time: 7209.44 ms
[2022-03-04 18:00:35 main:574] : INFO : Epoch 1487 | loss: 0.0311343 | val_loss: 0.0311574 | Time: 7068.5 ms
[2022-03-04 18:00:42 main:574] : INFO : Epoch 1488 | loss: 0.0311334 | val_loss: 0.03116 | Time: 7028.69 ms
[2022-03-04 18:00:49 main:574] : INFO : Epoch 1489 | loss: 0.0311326 | val_loss: 0.03116 | Time: 7087.04 ms
[2022-03-04 18:00:56 main:574] : INFO : Epoch 1490 | loss: 0.0311335 | val_loss: 0.0311586 | Time: 7205.34 ms
[2022-03-04 18:01:03 main:574] : INFO : Epoch 1491 | loss: 0.0311323 | val_loss: 0.0311686 | Time: 7075.58 ms
[2022-03-04 18:01:11 main:574] : INFO : Epoch 1492 | loss: 0.0311335 | val_loss: 0.0311599 | Time: 7348.79 ms
[2022-03-04 18:01:18 main:574] : INFO : Epoch 1493 | loss: 0.0311308 | val_loss: 0.0311611 | Time: 7177.15 ms
[2022-03-04 18:01:25 main:574] : INFO : Epoch 1494 | loss: 0.0311319 | val_loss: 0.0311646 | Time: 7148.05 ms
[2022-03-04 18:01:32 main:574] : INFO : Epoch 1495 | loss: 0.0311406 | val_loss: 0.0311663 | Time: 7142.82 ms
[2022-03-04 18:01:39 main:574] : INFO : Epoch 1496 | loss: 0.0311408 | val_loss: 0.0311671 | Time: 7327.97 ms
[2022-03-04 18:01:47 main:574] : INFO : Epoch 1497 | loss: 0.0311421 | val_loss: 0.0311586 | Time: 7177.06 ms
[2022-03-04 18:01:54 main:574] : INFO : Epoch 1498 | loss: 0.0311376 | val_loss: 0.0311607 | Time: 7095.94 ms
[2022-03-04 18:02:01 main:574] : INFO : Epoch 1499 | loss: 0.0311382 | val_loss: 0.0311602 | Time: 7005.13 ms
[2022-03-04 18:02:08 main:574] : INFO : Epoch 1500 | loss: 0.0311377 | val_loss: 0.0311613 | Time: 7093.74 ms
[2022-03-04 18:02:15 main:574] : INFO : Epoch 1501 | loss: 0.0311362 | val_loss: 0.0311608 | Time: 7269.54 ms
[2022-03-04 18:02:22 main:574] : INFO : Epoch 1502 | loss: 0.0311366 | val_loss: 0.0311635 | Time: 7100.37 ms
[2022-03-04 18:02:29 main:574] : INFO : Epoch 1503 | loss: 0.0311368 | val_loss: 0.0311662 | Time: 7346.71 ms
[2022-03-04 18:02:37 main:574] : INFO : Epoch 1504 | loss: 0.0311362 | val_loss: 0.0311719 | Time: 7111.92 ms
[2022-03-04 18:02:44 main:574] : INFO : Epoch 1505 | loss: 0.0311393 | val_loss: 0.0311666 | Time: 7072.96 ms
[2022-03-04 18:02:51 main:574] : INFO : Epoch 1506 | loss: 0.0311389 | val_loss: 0.0311638 | Time: 7301.3 ms
[2022-03-04 18:02:58 main:574] : INFO : Epoch 1507 | loss: 0.0311363 | val_loss: 0.0311667 | Time: 7197.74 ms
[2022-03-04 18:03:05 main:574] : INFO : Epoch 1508 | loss: 0.0311336 | val_loss: 0.0311719 | Time: 7108.82 ms
[2022-03-04 18:03:12 main:574] : INFO : Epoch 1509 | loss: 0.0311339 | val_loss: 0.0311614 | Time: 7150.37 ms
[2022-03-04 18:03:20 main:574] : INFO : Epoch 1510 | loss: 0.0311354 | val_loss: 0.0311708 | Time: 7208.71 ms
[2022-03-04 18:03:27 main:574] : INFO : Epoch 1511 | loss: 0.0311378 | val_loss: 0.0311641 | Time: 7154.46 ms
[2022-03-04 18:03:34 main:574] : INFO : Epoch 1512 | loss: 0.0311394 | val_loss: 0.0311597 | Time: 7076.55 ms
[2022-03-04 18:03:41 main:574] : INFO : Epoch 1513 | loss: 0.031153 | val_loss: 0.0311669 | Time: 7024.87 ms
[2022-03-04 18:03:48 main:574] : INFO : Epoch 1514 | loss: nan | val_loss: nan | Time: 7085.77 ms
[2022-03-04 18:03:55 main:574] : INFO : Epoch 1515 | loss: nan | val_loss: nan | Time: 7043.37 ms
[2022-03-04 18:04:02 main:574] : INFO : Epoch 1516 | loss: nan | val_loss: nan | Time: 7421.4 ms
[2022-03-04 18:04:10 main:574] : INFO : Epoch 1517 | loss: nan | val_loss: nan | Time: 7166.2 ms
[2022-03-04 18:04:17 main:574] : INFO : Epoch 1518 | loss: nan | val_loss: nan | Time: 6989.66 ms
[2022-03-04 18:04:24 main:574] : INFO : Epoch 1519 | loss: nan | val_loss: nan | Time: 7262.78 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650)
[2022-03-04 20:49:55 main:435] : INFO : Set logging level to 1
[2022-03-04 20:49:55 main:441] : INFO : Running in BOINC Client mode
[2022-03-04 20:49:55 main:444] : INFO : Resolving all filenames
[2022-03-04 20:49:55 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-04 20:49:55 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-04 20:49:55 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-04 20:49:55 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-04 20:49:55 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-04 20:49:55 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-03-04 20:49:55 main:474] : INFO : Configuration:
[2022-03-04 20:49:55 main:475] : INFO : Model type: GRU
[2022-03-04 20:49:55 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-03-04 20:49:55 main:477] : INFO : Max Epochs: 2048
[2022-03-04 20:49:55 main:478] : INFO : Batch Size: 128
[2022-03-04 20:49:55 main:479] : INFO : Learning Rate: 0.01
[2022-03-04 20:49:55 main:480] : INFO : Patience: 10
[2022-03-04 20:49:55 main:481] : INFO : Hidden Width: 12
[2022-03-04 20:49:55 main:482] : INFO : # Recurrent Layers: 4
[2022-03-04 20:49:55 main:483] : INFO : # Backend Layers: 4
[2022-03-04 20:49:55 main:484] : INFO : # Threads: 1
[2022-03-04 20:49:55 main:486] : INFO : Preparing Dataset
[2022-03-04 20:49:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-04 20:49:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-04 20:49:57 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-03-04 20:49:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-04 20:49:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-04 20:49:57 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-03-04 20:49:57 main:494] : INFO : Creating Model
[2022-03-04 20:49:57 main:507] : INFO : Preparing config file
[2022-03-04 20:49:57 main:511] : INFO : Found checkpoint, attempting to load...
[2022-03-04 20:49:57 main:512] : INFO : Loading config
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFAFA2C478C
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 03/04/22 20:49:57
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\4;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 0000000080d90000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000fcd60000 0000000000209000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.22000.469) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.22000.434 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.434
ModLoad: 00000000b3b10000 0000000000016000 C:\Program Files\AVAST Software\Avast\aswhook.dll (22.1.6921.0) (-nosymbols- Symbols Loaded)
Linked PDB Filename : D:\work\616216c47067779c\idp\build\avgast\RU_NTDLL-lH-Y2A!x64_vs142\bin\Release_Unicode_NTDLL_vs142\x64\aswhook.pdb
File Version : 22.1.6921.0
Company Name : AVAST Software
Product Name : Avast
Product Version : 22.1.6921.0
ModLoad: 00000000fc240000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.22000.434 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.434
ModLoad: 00000000fa280000 0000000000374000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.22000.434 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.434
ModLoad: 00000000fc450000 00000000001ac000 C:\WINDOWS\System32\USER32.dll (6.2.22000.282) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000fa250000 0000000000026000 C:\WINDOWS\System32\win32u.dll (6.2.22000.493) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.493
ModLoad: 00000000fac00000 0000000000029000 C:\WINDOWS\System32\GDI32.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000fa760000 0000000000112000 C:\WINDOWS\System32\gdi32full.dll (6.2.22000.469) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.22000.469 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.469
ModLoad: 00000000fa6c0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000b1fa0000 0000000000058000 C:\ProgramData\BOINC\slots\4\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000fa880000 0000000000111000 C:\WINDOWS\System32\ucrtbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000fc750000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000fac30000 00000000000a3000 C:\WINDOWS\System32\msvcrt.dll (7.0.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.22000.1
ModLoad: 00000000fbd20000 000000000009e000 C:\WINDOWS\System32\sechost.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000fae10000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000f7e10000 0000000000221000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000d52d0000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 00000000d52b0000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 00000000d4670000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 0000000036ea0000 000000000abe7000 C:\ProgramData\BOINC\slots\4\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a6110000 000000000020d000 C:\ProgramData\BOINC\slots\4\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000a50f0000 00000000002db000 C:\ProgramData\BOINC\slots\4\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c00f0000 0000000000040000 C:\ProgramData\BOINC\slots\4\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000012350000 0000000024b49000 C:\ProgramData\BOINC\slots\4\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b2470000 0000000000045000 C:\ProgramData\BOINC\slots\4\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000047e30000 00000000030a5000 C:\ProgramData\BOINC\slots\4\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 000000004aee0000 00000000034b2000 C:\ProgramData\BOINC\slots\4\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000e64c0000 0000000000010000 C:\ProgramData\BOINC\slots\4\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000073f0000 0000000003d5b000 C:\ProgramData\BOINC\slots\4\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000045f60000 0000000001eca000 C:\ProgramData\BOINC\slots\4\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000de870000 000000000919f000 C:\ProgramData\BOINC\slots\4\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000e7a10000 000000001b3a4000 C:\ProgramData\BOINC\slots\4\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000fc710000 0000000000031000 C:\WINDOWS\System32\IMM32.DLL (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000f93c0000 0000000000018000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.22000.71) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.22000.71 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.71
ModLoad: 00000000f37e0000 0000000000038000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : DXCore.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000fb8b0000 000000000046c000 C:\WINDOWS\System32\Setupapi.dll (6.2.22000.469) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000f9f70000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000f9f20000 000000000004c000 C:\WINDOWS\SYSTEM32\cfgmgr32.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000fab10000 0000000000067000 C:\WINDOWS\System32\WINTRUST.dll (6.2.22000.469) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.22000.469 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.469
ModLoad: 00000000fa9a0000 0000000000162000 C:\WINDOWS\System32\CRYPT32.dll (6.2.22000.348) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000f9b10000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000faf30000 00000000007ae000 C:\WINDOWS\System32\Shell32.dll (6.2.22000.469) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.22000.184 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.184
ModLoad: 00000000f83c0000 0000000000867000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.22000.469) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.22000.184 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.184
ModLoad: 00000000fbeb0000 0000000000378000 C:\WINDOWS\System32\combase.dll (6.2.22000.282) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000f8250000 0000000000166000 C:\WINDOWS\SYSTEM32\wintypes.dll (6.2.22000.41) (-exported- Symbols Loaded)
Linked PDB Filename : WinTypes.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000fc300000 00000000000ea000 C:\WINDOWS\System32\SHCORE.dll (6.2.22000.71) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000fc600000 000000000005d000 C:\WINDOWS\System32\shlwapi.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 0000000092340000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1179) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1179
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.110 driver
Product Version : 30.0.15.1179
ModLoad: 0000000010cb0000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nvdmi.inf_amd64_07d057a43ab2de16\nvcuda64.dll (30.0.15.1179) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1179
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.110 driver
Product Version : 30.0.15.1179
ModLoad: 00000000ec950000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000ec900000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000e5690000 0000000000149000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.22000.120) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.22000.120 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.120
ModLoad: 00000000f9b80000 000000000003d000 C:\WINDOWS\SYSTEM32\wldp.dll (6.2.22000.120) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000f9ad0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000ba300000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1179) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1179
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1179
ModLoad: 00000000fab80000 000000000007f000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.22000.376) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.22000.376 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.376
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3635, Write: 308, Other 733
- I/O Transfers Counters -
Read: 6747946, Write: 6051, Other 30008
- Paged Pool Usage -
QuotaPagedPoolUsage: 3454504, QuotaPeakPagedPoolUsage: 3454504
QuotaNonPagedPoolUsage: 41168, QuotaPeakNonPagedPoolUsage: 41168
- Virtual Memory Usage -
VirtualSize: -1306054656, PeakVirtualSize: -710524928
- Pagefile Usage -
PagefileUsage: -1306054656, PeakPagefileUsage: -1306054656
- Working Set Size -
WorkingSetSize: 1221234688, PeakWorkingSetSize: 1221234688, PageFaultCount: 423945
*** Dump of thread ID 33324 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 4687500.000000, User Time: 15937500.000000, Wait Time: 44887292.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFAFA2C478C
- Registers -
rax=0000000000000001 rbx=00000000810f4910 rcx=0000000000000000 rdx=00000000e3bc5d50 rsi=00000000e3bc6630 rdi=0000000019930520
r8=0000000000000000 r9=00000000dd053400 r10=00000000e3bc5d90 r11=00000000e3bc5d90 r12=00000000c2ca99e0 r13=00000000e3bc6840
r14=00000000ef86eeb0 r15=0000000000000000 rip=00000000fa2c478c rsp=00000000e3bc64d0 rbp=00000000e3bc67c0
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
e3bc65a0 8100a884 00000040 0000004f c2ca9b00 000002fa KERNELBASE!RaiseException+0x0
e3bc6600 80db1ca6 00002fa0 00000000 eec47208 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e3bc66b0 80db593b 00000000 00000020 00000000 00000030 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e3bc6800 80db1a78 00000000 00000000 e3bc6b30 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e3bc68d0 80db1cfc e3bc6b30 00000000 00000080 e3bc6e00 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e3bc6990 80dbc4dd e3bc6e00 e3bc6e00 e3bc6e00 e3bc6e00 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e3bc6c80 80dab2fe e3bc7298 e3bc6e00 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e3bdfa20 80fec6f8 8d9e8e10 00000000 00000000 8dba3980 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e3bdfa60 fc2554e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e3bdfa90 fcd6485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e3bdfb10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 33232 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 44887104.000000
- Registers -
rax=00000000000001de rbx=000000008bf9a000 rcx=000000000000007c rdx=000000008bf99c80 rsi=000000008bf97910 rdi=000000008bf9a000
r8=00000000e3efef20 r9=0000000000000000 r10=00000000e3eff066 r11=00000000e3efed20 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000fce07304 rsp=00000000e3eff798 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e3eff790 fcd76c2f 00000000 00000000 8bf97910 8bf9a000 ntdll!NtWaitForWorkViaWorkerFactory+0x0
e3effa80 fc2554e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0
e3effab0 fcd6485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e3effb30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 11440 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 44887104.000000
- Registers -
rax=00000000000001de rbx=000000008bf9b250 rcx=000000000000007c rdx=000000008bf9aed0 rsi=000000008bf97910 rdi=000000008bf9b250
r8=0000000000000008 r9=0000000000000040 r10=00000000000001c0 r11=0000000004000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000fce07304 rsp=00000000e3fff818 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e3fff810 fcd76c2f 00000000 00000000 8bf97910 8bf9b250 ntdll!NtWaitForWorkViaWorkerFactory+0x0
e3fffb00 fc2554e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0
e3fffb30 fcd6485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e3fffbb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 31584 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 44887104.000000
- Registers -
rax=00000000000001de rbx=000000008bf9b720 rcx=000000000000007c rdx=000000008bf9b3a0 rsi=000000008bf97910 rdi=000000008bf9b720
r8=00000000ec955004 r9=0000000000000000 r10=00000000ec9500f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000fce07304 rsp=00000000e40ffad8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e40ffad0 fcd76c2f 00000000 00000000 8bf97910 8bf9b720 ntdll!NtWaitForWorkViaWorkerFactory+0x0
e40ffdc0 fc2554e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0
e40ffdf0 fcd6485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e40ffe70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 32140 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 44887288.000000
- Registers -
rax=0000000000000034 rbx=00000000e42ffd90 rcx=0000000000000000 rdx=00000000e42ffd90 rsi=00000000e3d9c000 rdi=0000000000000000
r8=00000000e42ffcc8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000fce03dd4 rsp=00000000e42ffcc8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e42ffcc0 fcdbb5c3 00000000 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
e42ffcf0 fa2cb3a1 00000000 00000000 00000000 00000000 ntdll!RtlDelayExecution+0x0
e42ffd70 80dca07f 00000000 00000000 fff0bdc0 00000000 KERNELBASE!SleepEx+0x0
e42ffda0 fc2554e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e42ffdd0 fcd6485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e42ffe50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 29520 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 44887284.000000
- Registers -
rax=000000000000005b rbx=0000000000000007 rcx=0000000000000007 rdx=00000000e43ff8d0 rsi=0000000000000000 rdi=0000000000000007
r8=0000000000000001 r9=0000000000000000 r10=0000000000000000 r11=00000000e43ff840 r12=0000000000000064 r13=00000000e43ff8d0
r14=00000000e43ff5d0 r15=0000000000000000 rip=00000000fce042a4 rsp=00000000e43ff578 rbp=000000008dc1df20
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e43ff570 fa2cfb10 00000000 e43ff6d0 e43ff6d0 00000000 ntdll!NtWaitForMultipleObjects+0x0
e43ff860 fa2cfa0e 111ff1c8 8dba2080 00000007 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
e43ff8a0 10e8d554 8dc20980 00000000 8dc1b0a0 00000000 KERNELBASE!WaitForMultipleObjects+0x0
e43ffae0 10f358cd 00000000 8dc1df20 00000000 00000000 nvcuda64!+0x0
e43ffb90 10e8cf23 05548de0 045d21c4 8e1d5eb0 00000000 nvcuda64!cuProfilerStop+0x0
e43ffbc0 111c4594 8e1d5eb0 00000000 00000000 00000000 nvcuda64!+0x0
e43ffbf0 fc2554e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
e43ffc20 fcd6485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e43ffca0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)