Task 14627533
| Name | ParityModified-1647045512-13842-3-0_3 |
| Workunit | 11639771 |
| Created | 23 Apr 2022, 1:27:42 UTC |
| Sent | 23 Apr 2022, 1:28:21 UTC |
| Report deadline | 1 May 2022, 1:28:21 UTC |
| Received | 23 Apr 2022, 1:56:37 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 17116 |
| Run time | 3 min 6 sec |
| CPU time | 3 min |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 9,205.29 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.63 GB |
| Peak swap size | 3.66 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
2022-04-22 18:31:51 main:484] : INFO : # Threads: 1
[2022-04-22 18:31:51 main:486] : INFO : Preparing Dataset
[2022-04-22 18:31:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-22 18:31:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-22 18:31:53 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-22 18:31:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-22 18:31:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-22 18:31:53 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-22 18:31:53 main:494] : INFO : Creating Model
[2022-04-22 18:31:53 main:507] : INFO : Preparing config file
[2022-04-22 18:31:53 main:519] : INFO : Creating new config file
[2022-04-22 18:31:53 main:538] : INFO : This is a continuation WU, loading previous network
[2022-04-22 18:31:53 main:559] : INFO : Loading DataLoader into Memory
[2022-04-22 18:31:53 main:562] : INFO : Starting Training
[2022-04-22 18:31:55 main:574] : INFO : Epoch 1 | loss: 0.0313136 | val_loss: 0.0312602 | Time: 1818.19 ms
[2022-04-22 18:31:57 main:574] : INFO : Epoch 2 | loss: 0.0312566 | val_loss: 0.0312537 | Time: 1576.98 ms
[2022-04-22 18:31:58 main:574] : INFO : Epoch 3 | loss: 0.0312517 | val_loss: 0.031251 | Time: 1515.95 ms
[2022-04-22 18:32:00 main:574] : INFO : Epoch 4 | loss: 0.0312503 | val_loss: 0.0312504 | Time: 1523.63 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1080)
[2022-04-22 18:41:53 main:435] : INFO : Set logging level to 1
[2022-04-22 18:41:53 main:441] : INFO : Running in BOINC Client mode
[2022-04-22 18:41:53 main:444] : INFO : Resolving all filenames
[2022-04-22 18:41:53 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-22 18:41:53 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-22 18:41:53 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-22 18:41:53 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-22 18:41:53 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-04-22 18:41:53 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-22 18:41:53 main:474] : INFO : Configuration:
[2022-04-22 18:41:53 main:475] : INFO : Model type: GRU
[2022-04-22 18:41:53 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-22 18:41:53 main:477] : INFO : Max Epochs: 2048
[2022-04-22 18:41:53 main:478] : INFO : Batch Size: 128
[2022-04-22 18:41:53 main:479] : INFO : Learning Rate: 0.01
[2022-04-22 18:41:53 main:480] : INFO : Patience: 10
[2022-04-22 18:41:53 main:481] : INFO : Hidden Width: 12
[2022-04-22 18:41:53 main:482] : INFO : # Recurrent Layers: 4
[2022-04-22 18:41:53 main:483] : INFO : # Backend Layers: 4
[2022-04-22 18:41:53 main:484] : INFO : # Threads: 1
[2022-04-22 18:41:53 main:486] : INFO : Preparing Dataset
[2022-04-22 18:41:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-22 18:41:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-22 18:41:55 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-22 18:41:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-22 18:41:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-22 18:41:55 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-22 18:41:55 main:494] : INFO : Creating Model
[2022-04-22 18:41:55 main:507] : INFO : Preparing config file
[2022-04-22 18:41:55 main:519] : INFO : Creating new config file
[2022-04-22 18:41:55 main:538] : INFO : This is a continuation WU, loading previous network
[2022-04-22 18:41:55 main:559] : INFO : Loading DataLoader into Memory
[2022-04-22 18:41:55 main:562] : INFO : Starting Training
[2022-04-22 18:41:57 main:574] : INFO : Epoch 1 | loss: 0.0313097 | val_loss: 0.0312606 | Time: 1678.29 ms
[2022-04-22 18:41:59 main:574] : INFO : Epoch 2 | loss: 0.0312577 | val_loss: 0.0312539 | Time: 1521.84 ms
[2022-04-22 18:42:00 main:574] : INFO : Epoch 3 | loss: 0.0312531 | val_loss: 0.0312517 | Time: 1547.78 ms
[2022-04-22 18:42:02 main:574] : INFO : Epoch 4 | loss: 0.0312514 | val_loss: 0.031251 | Time: 1539.58 ms
[2022-04-22 18:42:03 main:574] : INFO : Epoch 5 | loss: 0.0312503 | val_loss: 0.0312507 | Time: 1529.75 ms
[2022-04-22 18:42:05 main:574] : INFO : Epoch 6 | loss: 0.0312511 | val_loss: 0.0312529 | Time: 1519.31 ms
[2022-04-22 18:42:06 main:574] : INFO : Epoch 7 | loss: 0.0312505 | val_loss: 0.0312504 | Time: 1530.32 ms
[2022-04-22 18:42:08 main:574] : INFO : Epoch 8 | loss: 0.0312505 | val_loss: 0.0312505 | Time: 1519.25 ms
[2022-04-22 18:42:09 main:574] : INFO : Epoch 9 | loss: 0.0312507 | val_loss: 0.031251 | Time: 1515.16 ms
[2022-04-22 18:42:11 main:574] : INFO : Epoch 10 | loss: 0.0312506 | val_loss: 0.0312508 | Time: 1537.85 ms
[2022-04-22 18:42:12 main:574] : INFO : Epoch 11 | loss: 0.0312504 | val_loss: 0.0312501 | Time: 1541.61 ms
[2022-04-22 18:42:14 main:574] : INFO : Epoch 12 | loss: 0.0312505 | val_loss: 0.0312506 | Time: 1515.45 ms
[2022-04-22 18:42:16 main:574] : INFO : Epoch 13 | loss: 0.0312505 | val_loss: 0.0312505 | Time: 1538.09 ms
[2022-04-22 18:42:17 main:574] : INFO : Epoch 14 | loss: 0.0312502 | val_loss: 0.0312501 | Time: 1558.73 ms
[2022-04-22 18:42:19 main:574] : INFO : Epoch 15 | loss: 0.0312509 | val_loss: 0.0312509 | Time: 1541.06 ms
[2022-04-22 18:42:20 main:574] : INFO : Epoch 16 | loss: 0.0312513 | val_loss: 0.0312501 | Time: 1539.48 ms
[2022-04-22 18:42:22 main:574] : INFO : Epoch 17 | loss: 0.0312505 | val_loss: 0.0312504 | Time: 1548.19 ms
[2022-04-22 18:42:23 main:574] : INFO : Epoch 18 | loss: 0.0312501 | val_loss: 0.03125 | Time: 1552.64 ms
[2022-04-22 18:42:25 main:574] : INFO : Epoch 19 | loss: 0.0312502 | val_loss: 0.0312503 | Time: 1532.28 ms
[2022-04-22 18:42:26 main:574] : INFO : Epoch 20 | loss: 0.0312503 | val_loss: 0.0312505 | Time: 1558.07 ms
[2022-04-22 18:42:28 main:574] : INFO : Epoch 21 | loss: 0.0312503 | val_loss: 0.0312501 | Time: 1568.52 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1080)
[2022-04-22 18:47:58 main:435] : INFO : Set logging level to 1
[2022-04-22 18:47:58 main:441] : INFO : Running in BOINC Client mode
[2022-04-22 18:47:58 main:444] : INFO : Resolving all filenames
[2022-04-22 18:47:58 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-22 18:47:58 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-22 18:47:58 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-22 18:47:58 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-22 18:47:58 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-04-22 18:47:58 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-22 18:47:58 main:474] : INFO : Configuration:
[2022-04-22 18:47:58 main:475] : INFO : Model type: GRU
[2022-04-22 18:47:58 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-22 18:47:58 main:477] : INFO : Max Epochs: 2048
[2022-04-22 18:47:58 main:478] : INFO : Batch Size: 128
[2022-04-22 18:47:58 main:479] : INFO : Learning Rate: 0.01
[2022-04-22 18:47:58 main:480] : INFO : Patience: 10
[2022-04-22 18:47:58 main:481] : INFO : Hidden Width: 12
[2022-04-22 18:47:58 main:482] : INFO : # Recurrent Layers: 4
[2022-04-22 18:47:58 main:483] : INFO : # Backend Layers: 4
[2022-04-22 18:47:58 main:484] : INFO : # Threads: 1
[2022-04-22 18:47:58 main:486] : INFO : Preparing Dataset
[2022-04-22 18:47:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-22 18:47:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-22 18:47:59 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-22 18:47:59 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-22 18:47:59 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-22 18:47:59 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-22 18:47:59 main:494] : INFO : Creating Model
[2022-04-22 18:47:59 main:507] : INFO : Preparing config file
[2022-04-22 18:47:59 main:519] : INFO : Creating new config file
[2022-04-22 18:47:59 main:538] : INFO : This is a continuation WU, loading previous network
[2022-04-22 18:48:00 main:559] : INFO : Loading DataLoader into Memory
[2022-04-22 18:48:00 main:562] : INFO : Starting Training
[2022-04-22 18:48:01 main:574] : INFO : Epoch 1 | loss: 0.0313085 | val_loss: 0.0312713 | Time: 1616.17 ms
[2022-04-22 18:48:03 main:574] : INFO : Epoch 2 | loss: 0.0312584 | val_loss: 0.0312539 | Time: 1549.4 ms
[2022-04-22 18:48:04 main:574] : INFO : Epoch 3 | loss: 0.031251 | val_loss: 0.0312512 | Time: 1545.1 ms
[2022-04-22 18:48:06 main:574] : INFO : Epoch 4 | loss: 0.0312507 | val_loss: 0.0312508 | Time: 1519.02 ms
[2022-04-22 18:48:08 main:574] : INFO : Epoch 5 | loss: 0.0312509 | val_loss: 0.0312512 | Time: 1525.65 ms
[2022-04-22 18:48:09 main:574] : INFO : Epoch 6 | loss: 0.0312509 | val_loss: 0.0312505 | Time: 1537.14 ms
[2022-04-22 18:48:11 main:574] : INFO : Epoch 7 | loss: 0.0312513 | val_loss: 0.0312518 | Time: 1518.58 ms
[2022-04-22 18:48:12 main:574] : INFO : Epoch 8 | loss: 0.0312506 | val_loss: 0.0312511 | Time: 1510.9 ms
[2022-04-22 18:48:14 main:574] : INFO : Epoch 9 | loss: 0.0312516 | val_loss: 0.0312508 | Time: 1449.07 ms
[2022-04-22 18:48:15 main:574] : INFO : Epoch 10 | loss: 0.0312515 | val_loss: 0.0312512 | Time: 1447.62 ms
[2022-04-22 18:48:16 main:574] : INFO : Epoch 11 | loss: 0.0312504 | val_loss: 0.0312501 | Time: 1473.64 ms
[2022-04-22 18:48:18 main:574] : INFO : Epoch 12 | loss: 0.0312511 | val_loss: 0.0312507 | Time: 1452.72 ms
[2022-04-22 18:48:19 main:574] : INFO : Epoch 13 | loss: 0.031253 | val_loss: 0.0312544 | Time: 1430.15 ms
[2022-04-22 18:48:21 main:574] : INFO : Epoch 14 | loss: 0.0312508 | val_loss: 0.031251 | Time: 1444.33 ms
[2022-04-22 18:48:22 main:574] : INFO : Epoch 15 | loss: 0.0312509 | val_loss: 0.0312504 | Time: 1461.68 ms
[2022-04-22 18:48:24 main:574] : INFO : Epoch 16 | loss: 0.0312508 | val_loss: 0.0312504 | Time: 1441.49 ms
[2022-04-22 18:48:25 main:574] : INFO : Epoch 17 | loss: 0.0312505 | val_loss: 0.0312501 | Time: 1452.89 ms
[2022-04-22 18:48:27 main:574] : INFO : Epoch 18 | loss: 0.0312504 | val_loss: 0.0312507 | Time: 1452.97 ms
[2022-04-22 18:48:28 main:574] : INFO : Epoch 19 | loss: 0.0312505 | val_loss: 0.0312511 | Time: 1463.56 ms
[2022-04-22 18:48:30 main:574] : INFO : Epoch 20 | loss: 0.0312511 | val_loss: 0.03125 | Time: 1465.85 ms
[2022-04-22 18:48:31 main:574] : INFO : Epoch 21 | loss: 0.0312505 | val_loss: 0.0312518 | Time: 1455.9 ms
[2022-04-22 18:48:32 main:574] : INFO : Epoch 22 | loss: 0.0312506 | val_loss: 0.0312503 | Time: 1447.94 ms
[2022-04-22 18:48:34 main:574] : INFO : Epoch 23 | loss: 0.03125 | val_loss: 0.0312501 | Time: 1439.93 ms
[2022-04-22 18:48:35 main:574] : INFO : Epoch 24 | loss: 0.0312502 | val_loss: 0.0312501 | Time: 1455.92 ms
[2022-04-22 18:48:37 main:574] : INFO : Epoch 25 | loss: 0.0312507 | val_loss: 0.03125 | Time: 1456.04 ms
[2022-04-22 18:48:38 main:574] : INFO : Epoch 26 | loss: 0.0312503 | val_loss: 0.0312501 | Time: 1478.28 ms
[2022-04-22 18:48:40 main:574] : INFO : Epoch 27 | loss: 0.0312505 | val_loss: 0.03125 | Time: 1456.82 ms
[2022-04-22 18:48:41 main:574] : INFO : Epoch 28 | loss: 0.0312512 | val_loss: 0.0312521 | Time: 1465.62 ms
[2022-04-22 18:48:43 main:574] : INFO : Epoch 29 | loss: 0.0312504 | val_loss: 0.0312502 | Time: 1454.49 ms
[2022-04-22 18:48:44 main:574] : INFO : Epoch 30 | loss: 0.0312503 | val_loss: 0.0312503 | Time: 1405.35 ms
[2022-04-22 18:48:46 main:574] : INFO : Epoch 31 | loss: 0.0312506 | val_loss: 0.03125 | Time: 1456.54 ms
[2022-04-22 18:48:47 main:574] : INFO : Epoch 32 | loss: 0.0312506 | val_loss: 0.03125 | Time: 1445.28 ms
[2022-04-22 18:48:48 main:574] : INFO : Epoch 33 | loss: 0.0312503 | val_loss: 0.0312511 | Time: 1450.69 ms
[2022-04-22 18:48:50 main:574] : INFO : Epoch 34 | loss: 0.0312508 | val_loss: 0.0312512 | Time: 1442.65 ms
[2022-04-22 18:48:51 main:574] : INFO : Epoch 35 | loss: 0.0312508 | val_loss: 0.0312524 | Time: 1452.64 ms
[2022-04-22 18:48:53 main:574] : INFO : Epoch 36 | loss: 0.0312505 | val_loss: 0.0312501 | Time: 1445.3 ms
[2022-04-22 18:48:54 main:574] : INFO : Epoch 37 | loss: 0.0312502 | val_loss: 0.03125 | Time: 1454.14 ms
[2022-04-22 18:48:56 main:574] : INFO : Epoch 38 | loss: 0.0312501 | val_loss: 0.03125 | Time: 1448.74 ms
[2022-04-22 18:48:57 main:574] : INFO : Epoch 39 | loss: 0.0312502 | val_loss: 0.0312502 | Time: 1445.36 ms
[2022-04-22 18:48:59 main:574] : INFO : Epoch 40 | loss: 0.0312501 | val_loss: 0.0312504 | Time: 1487.5 ms
[2022-04-22 18:49:00 main:574] : INFO : Epoch 41 | loss: 0.0312507 | val_loss: 0.0312516 | Time: 1483.72 ms
[2022-04-22 18:49:02 main:574] : INFO : Epoch 42 | loss: 0.0312502 | val_loss: 0.0312499 | Time: 1511.1 ms
[2022-04-22 18:49:03 main:574] : INFO : Epoch 43 | loss: 0.03125 | val_loss: 0.0312501 | Time: 1501.38 ms
[2022-04-22 18:49:05 main:574] : INFO : Epoch 44 | loss: 0.0312508 | val_loss: 0.0312513 | Time: 1510.39 ms
[2022-04-22 18:49:06 main:574] : INFO : Epoch 45 | loss: 0.0312504 | val_loss: 0.0312501 | Time: 1504.34 ms
[2022-04-22 18:49:08 main:574] : INFO : Epoch 46 | loss: 0.0312505 | val_loss: 0.0312504 | Time: 1505.75 ms
[2022-04-22 18:49:09 main:574] : INFO : Epoch 47 | loss: 0.031251 | val_loss: 0.0312501 | Time: 1514.93 ms
[2022-04-22 18:49:11 main:574] : INFO : Epoch 48 | loss: 0.03125 | val_loss: 0.0312504 | Time: 1527.66 ms
[2022-04-22 18:49:12 main:574] : INFO : Epoch 49 | loss: 0.0312499 | val_loss: 0.0312503 | Time: 1509.51 ms
[2022-04-22 18:49:14 main:574] : INFO : Epoch 50 | loss: 0.0312508 | val_loss: 0.0312555 | Time: 1507.39 ms
[2022-04-22 18:49:15 main:574] : INFO : Epoch 51 | loss: 0.0312514 | val_loss: 0.03125 | Time: 1505.22 ms
[2022-04-22 18:49:17 main:574] : INFO : Epoch 52 | loss: 0.0312502 | val_loss: 0.0312511 | Time: 1507.67 ms
[2022-04-22 18:49:18 main:574] : INFO : Epoch 53 | loss: 0.0312502 | val_loss: 0.03125 | Time: 1506.66 ms
[2022-04-22 18:49:20 main:574] : INFO : Epoch 54 | loss: 0.0312503 | val_loss: 0.0312505 | Time: 1515.95 ms
[2022-04-22 18:49:21 main:574] : INFO : Epoch 55 | loss: 0.0312509 | val_loss: 0.0312501 | Time: 1531.06 ms
[2022-04-22 18:49:23 main:574] : INFO : Epoch 56 | loss: 0.0312501 | val_loss: 0.0312502 | Time: 1502.49 ms
[2022-04-22 18:49:24 main:574] : INFO : Epoch 57 | loss: 0.0312498 | val_loss: 0.0312519 | Time: 1500.41 ms
[2022-04-22 18:49:26 main:574] : INFO : Epoch 58 | loss: 0.0312501 | val_loss: 0.0312508 | Time: 1521.91 ms
[2022-04-22 18:49:27 main:574] : INFO : Epoch 59 | loss: 0.0312501 | val_loss: 0.0312499 | Time: 1530.9 ms
[2022-04-22 18:49:29 main:574] : INFO : Epoch 60 | loss: 0.03125 | val_loss: 0.0312506 | Time: 1503.66 ms
[2022-04-22 18:49:30 main:574] : INFO : Epoch 61 | loss: 0.0312508 | val_loss: 0.0312502 | Time: 1504.66 ms
[2022-04-22 18:49:32 main:574] : INFO : Epoch 62 | loss: 0.0312508 | val_loss: 0.0312537 | Time: 1533.92 ms
[2022-04-22 18:49:33 main:574] : INFO : Epoch 63 | loss: 0.0312516 | val_loss: 0.0312522 | Time: 1523.71 ms
[2022-04-22 18:49:35 main:574] : INFO : Epoch 64 | loss: 0.0312515 | val_loss: 0.0312515 | Time: 1526.86 ms
[2022-04-22 18:49:37 main:574] : INFO : Epoch 65 | loss: 0.0312506 | val_loss: 0.0312502 | Time: 1558.94 ms
[2022-04-22 18:49:38 main:574] : INFO : Epoch 66 | loss: 0.0312504 | val_loss: 0.0312499 | Time: 1524.06 ms
[2022-04-22 18:49:40 main:574] : INFO : Epoch 67 | loss: 0.0312499 | val_loss: 0.0312509 | Time: 1547.27 ms
[2022-04-22 18:49:41 main:574] : INFO : Epoch 68 | loss: 0.03125 | val_loss: 0.03125 | Time: 1525.93 ms
[2022-04-22 18:49:43 main:574] : INFO : Epoch 69 | loss: 0.0312502 | val_loss: 0.0312505 | Time: 1535.73 ms
[2022-04-22 18:49:44 main:574] : INFO : Epoch 70 | loss: 0.0312502 | val_loss: 0.0312508 | Time: 1531.69 ms
[2022-04-22 18:49:46 main:574] : INFO : Epoch 71 | loss: 0.031251 | val_loss: 0.0312502 | Time: 1535.96 ms
[2022-04-22 18:49:47 main:574] : INFO : Epoch 72 | loss: 0.031251 | val_loss: 0.0312503 | Time: 1550.94 ms
[2022-04-22 18:49:49 main:574] : INFO : Epoch 73 | loss: 0.0312505 | val_loss: 0.0312523 | Time: 1554.41 ms
[2022-04-22 18:49:50 main:574] : INFO : Epoch 74 | loss: 0.0312506 | val_loss: 0.03125 | Time: 1547.86 ms
[2022-04-22 18:49:52 main:574] : INFO : Epoch 75 | loss: 0.0312498 | val_loss: 0.03125 | Time: 1543.91 ms
[2022-04-22 18:49:54 main:574] : INFO : Epoch 76 | loss: 0.0312504 | val_loss: 0.0312506 | Time: 1558.07 ms
[2022-04-22 18:49:55 main:574] : INFO : Epoch 77 | loss: 0.0312508 | val_loss: 0.0312499 | Time: 1550.73 ms
[2022-04-22 18:49:57 main:574] : INFO : Epoch 78 | loss: 0.0312501 | val_loss: 0.0312499 | Time: 1545.41 ms
[2022-04-22 18:49:58 main:574] : INFO : Epoch 79 | loss: 0.0312508 | val_loss: 0.0312499 | Time: 1544.59 ms
[2022-04-22 18:50:00 main:574] : INFO : Epoch 80 | loss: 0.0312501 | val_loss: 0.0312499 | Time: 1547.5 ms
[2022-04-22 18:50:01 main:574] : INFO : Epoch 81 | loss: 0.0312505 | val_loss: 0.0312511 | Time: 1553.22 ms
[2022-04-22 18:50:03 main:574] : INFO : Epoch 82 | loss: 0.031251 | val_loss: 0.03125 | Time: 1554.52 ms
[2022-04-22 18:50:04 main:574] : INFO : Epoch 83 | loss: 0.03125 | val_loss: 0.0312498 | Time: 1548.61 ms
[2022-04-22 18:50:06 main:574] : INFO : Epoch 84 | loss: 0.0312502 | val_loss: 0.0312505 | Time: 1557.95 ms
[2022-04-22 18:50:08 main:574] : INFO : Epoch 85 | loss: 0.03125 | val_loss: 0.0312499 | Time: 1563.24 ms
[2022-04-22 18:50:09 main:574] : INFO : Epoch 86 | loss: 0.0312501 | val_loss: 0.0312523 | Time: 1544.98 ms
[2022-04-22 18:50:11 main:574] : INFO : Epoch 87 | loss: 0.0312514 | val_loss: 0.0312503 | Time: 1557.76 ms
[2022-04-22 18:50:12 main:574] : INFO : Epoch 88 | loss: 0.0312504 | val_loss: 0.0312529 | Time: 1519.19 ms
[2022-04-22 18:50:14 main:574] : INFO : Epoch 89 | loss: 0.0312503 | val_loss: 0.0312504 | Time: 1488.28 ms
[2022-04-22 18:50:15 main:574] : INFO : Epoch 90 | loss: 0.0312504 | val_loss: 0.0312503 | Time: 1467.75 ms
[2022-04-22 18:50:17 main:574] : INFO : Epoch 91 | loss: 0.0312499 | val_loss: 0.0312509 | Time: 1449.03 ms
[2022-04-22 18:50:18 main:574] : INFO : Epoch 92 | loss: 0.0312502 | val_loss: 0.0312498 | Time: 1449.79 ms
[2022-04-22 18:50:19 main:574] : INFO : Epoch 93 | loss: 0.0312504 | val_loss: 0.0312508 | Time: 1445.94 ms
[2022-04-22 18:50:21 main:574] : INFO : Epoch 94 | loss: 0.0312502 | val_loss: 0.0312503 | Time: 1450.94 ms
[2022-04-22 18:50:22 main:574] : INFO : Epoch 95 | loss: 0.0312499 | val_loss: 0.0312499 | Time: 1442.35 ms
[2022-04-22 18:50:24 main:574] : INFO : Epoch 96 | loss: 0.0312508 | val_loss: 0.0312515 | Time: 1449.18 ms
[2022-04-22 18:50:25 main:574] : INFO : Epoch 97 | loss: 0.0312501 | val_loss: 0.03125 | Time: 1439.11 ms
[2022-04-22 18:50:27 main:574] : INFO : Epoch 98 | loss: 0.0312508 | val_loss: 0.0312508 | Time: 1463.7 ms
[2022-04-22 18:50:28 main:574] : INFO : Epoch 99 | loss: 0.0312499 | val_loss: 0.0312505 | Time: 1449.71 ms
[2022-04-22 18:50:30 main:574] : INFO : Epoch 100 | loss: 0.0312499 | val_loss: 0.0312498 | Time: 1435.71 ms
[2022-04-22 18:50:31 main:574] : INFO : Epoch 101 | loss: 0.03125 | val_loss: 0.0312499 | Time: 1443.63 ms
[2022-04-22 18:50:33 main:574] : INFO : Epoch 102 | loss: 0.0312501 | val_loss: 0.0312535 | Time: 1463.4 ms
[2022-04-22 18:50:34 main:574] : INFO : Epoch 103 | loss: 0.0312507 | val_loss: 0.0312507 | Time: 1437.01 ms
[2022-04-22 18:50:35 main:574] : INFO : Epoch 104 | loss: 0.0312498 | val_loss: 0.03125 | Time: 1455.79 ms
[2022-04-22 18:50:37 main:574] : INFO : Epoch 105 | loss: 0.0312504 | val_loss: 0.0312501 | Time: 1450.76 ms
[2022-04-22 18:50:38 main:574] : INFO : Epoch 106 | loss: 0.0312505 | val_loss: 0.0312506 | Time: 1441.6 ms
[2022-04-22 18:50:40 main:574] : INFO : Epoch 107 | loss: 0.0312502 | val_loss: 0.0312499 | Time: 1465.24 ms
[2022-04-22 18:50:41 main:574] : INFO : Epoch 108 | loss: 0.0312496 | val_loss: 0.03125 | Time: 1457.97 ms
[2022-04-22 18:50:43 main:574] : INFO : Epoch 109 | loss: 0.03125 | val_loss: 0.0312506 | Time: 1453.04 ms
[2022-04-22 18:50:44 main:574] : INFO : Epoch 110 | loss: 0.03125 | val_loss: 0.0312498 | Time: 1447.2 ms
[2022-04-22 18:50:46 main:574] : INFO : Epoch 111 | loss: 0.0312501 | val_loss: 0.0312498 | Time: 1461.3 ms
[2022-04-22 18:50:47 main:574] : INFO : Epoch 112 | loss: 0.03125 | val_loss: 0.0312498 | Time: 1451.41 ms
[2022-04-22 18:50:49 main:574] : INFO : Epoch 113 | loss: 0.0312504 | val_loss: 0.0312534 | Time: 1472.73 ms
[2022-04-22 18:50:50 main:574] : INFO : Epoch 114 | loss: 0.0312515 | val_loss: 0.0312502 | Time: 1454.82 ms
[2022-04-22 18:50:51 main:574] : INFO : Epoch 115 | loss: 0.0312507 | val_loss: 0.0312504 | Time: 1454.83 ms
[2022-04-22 18:50:53 main:574] : INFO : Epoch 116 | loss: 0.0312912 | val_loss: 0.0390805 | Time: 1446.84 ms
[2022-04-22 18:50:54 main:574] : INFO : Epoch 117 | loss: nan | val_loss: nan | Time: 1454.09 ms
[2022-04-22 18:50:56 main:574] : INFO : Epoch 118 | loss: nan | val_loss: nan | Time: 1448.32 ms
[2022-04-22 18:50:57 main:574] : INFO : Epoch 119 | loss: nan | val_loss: nan | Time: 1444.65 ms
[2022-04-22 18:50:59 main:574] : INFO : Epoch 120 | loss: nan | val_loss: nan | Time: 1450.79 ms
[2022-04-22 18:51:00 main:574] : INFO : Epoch 121 | loss: nan | val_loss: nan | Time: 1438.28 ms
[2022-04-22 18:51:02 main:574] : INFO : Epoch 122 | loss: nan | val_loss: nan | Time: 1465.14 ms
[2022-04-22 18:51:03 main:574] : INFO : Epoch 123 | loss: nan | val_loss: nan | Time: 1487.53 ms
[2022-04-22 18:51:05 main:574] : INFO : Epoch 124 | loss: nan | val_loss: nan | Time: 1505.33 ms
[2022-04-22 18:51:06 main:574] : INFO : Epoch 125 | loss: nan | val_loss: nan | Time: 1491.51 ms
[2022-04-22 18:51:08 main:574] : INFO : Epoch 126 | loss: nan | val_loss: nan | Time: 1523.52 ms
[2022-04-22 18:51:09 main:574] : INFO : Epoch 127 | loss: nan | val_loss: nan | Time: 1514.74 ms
[2022-04-22 18:51:11 main:574] : INFO : Epoch 128 | loss: nan | val_loss: nan | Time: 1504.64 ms
[2022-04-22 18:51:12 main:574] : INFO : Epoch 129 | loss: nan | val_loss: nan | Time: 1513.77 ms
[2022-04-22 18:51:14 main:574] : INFO : Epoch 130 | loss: nan | val_loss: nan | Time: 1509.97 ms
[2022-04-22 18:51:15 main:574] : INFO : Epoch 131 | loss: nan | val_loss: nan | Time: 1495.57 ms
[2022-04-22 18:51:17 main:574] : INFO : Epoch 132 | loss: nan | val_loss: nan | Time: 1520.69 ms
[2022-04-22 18:51:18 main:574] : INFO : Epoch 133 | loss: nan | val_loss: nan | Time: 1524.72 ms
[2022-04-22 18:51:20 main:574] : INFO : Epoch 134 | loss: nan | val_loss: nan | Time: 1543.17 ms
[2022-04-22 18:51:21 main:574] : INFO : Epoch 135 | loss: nan | val_loss: nan | Time: 1512.14 ms
[2022-04-22 18:51:23 main:574] : INFO : Epoch 136 | loss: nan | val_loss: nan | Time: 1510.41 ms
[2022-04-22 18:51:24 main:574] : INFO : Epoch 137 | loss: nan | val_loss: nan | Time: 1512.66 ms
[2022-04-22 18:51:26 main:574] : INFO : Epoch 138 | loss: nan | val_loss: nan | Time: 1530.88 ms
[2022-04-22 18:51:27 main:574] : INFO : Epoch 139 | loss: nan | val_loss: nan | Time: 1524.27 ms
[2022-04-22 18:51:29 main:574] : INFO : Epoch 140 | loss: nan | val_loss: nan | Time: 1508.36 ms
[2022-04-22 18:51:30 main:574] : INFO : Epoch 141 | loss: nan | val_loss: nan | Time: 1536.57 ms
[2022-04-22 18:51:32 main:574] : INFO : Epoch 142 | loss: nan | val_loss: nan | Time: 1532.86 ms
[2022-04-22 18:51:34 main:574] : INFO : Epoch 143 | loss: nan | val_loss: nan | Time: 1523.27 ms
[2022-04-22 18:51:35 main:574] : INFO : Epoch 144 | loss: nan | val_loss: nan | Time: 1540.04 ms
[2022-04-22 18:51:37 main:574] : INFO : Epoch 145 | loss: nan | val_loss: nan | Time: 1529.5 ms
[2022-04-22 18:51:38 main:574] : INFO : Epoch 146 | loss: nan | val_loss: nan | Time: 1524.16 ms
[2022-04-22 18:51:40 main:574] : INFO : Epoch 147 | loss: nan | val_loss: nan | Time: 1537.47 ms
[2022-04-22 18:51:41 main:574] : INFO : Epoch 148 | loss: nan | val_loss: nan | Time: 1558.27 ms
[2022-04-22 18:51:43 main:574] : INFO : Epoch 149 | loss: nan | val_loss: nan | Time: 1525.34 ms
[2022-04-22 18:51:44 main:574] : INFO : Epoch 150 | loss: nan | val_loss: nan | Time: 1524.79 ms
[2022-04-22 18:51:46 main:574] : INFO : Epoch 151 | loss: nan | val_loss: nan | Time: 1533.38 ms
[2022-04-22 18:51:47 main:574] : INFO : Epoch 152 | loss: nan | val_loss: nan | Time: 1547.25 ms
[2022-04-22 18:51:49 main:574] : INFO : Epoch 153 | loss: nan | val_loss: nan | Time: 1547.66 ms
[2022-04-22 18:51:50 main:574] : INFO : Epoch 154 | loss: nan | val_loss: nan | Time: 1538.1 ms
[2022-04-22 18:51:52 main:574] : INFO : Epoch 155 | loss: nan | val_loss: nan | Time: 1546.46 ms
[2022-04-22 18:51:54 main:574] : INFO : Epoch 156 | loss: nan | val_loss: nan | Time: 1539.36 ms
[2022-04-22 18:51:55 main:574] : INFO : Epoch 157 | loss: nan | val_loss: nan | Time: 1562.39 ms
[2022-04-22 18:51:57 main:574] : INFO : Epoch 158 | loss: nan | val_loss: nan | Time: 1559.34 ms
[2022-04-22 18:51:58 main:574] : INFO : Epoch 159 | loss: nan | val_loss: nan | Time: 1557.93 ms
[2022-04-22 18:52:00 main:574] : INFO : Epoch 160 | loss: nan | val_loss: nan | Time: 1536.09 ms
[2022-04-22 18:52:01 main:574] : INFO : Epoch 161 | loss: nan | val_loss: nan | Time: 1547.44 ms
[2022-04-22 18:52:03 main:574] : INFO : Epoch 162 | loss: nan | val_loss: nan | Time: 1544.66 ms
[2022-04-22 18:52:04 main:574] : INFO : Epoch 163 | loss: nan | val_loss: nan | Time: 1565.77 ms
[2022-04-22 18:52:06 main:574] : INFO : Epoch 164 | loss: nan | val_loss: nan | Time: 1547.99 ms
[2022-04-22 18:52:08 main:574] : INFO : Epoch 165 | loss: nan | val_loss: nan | Time: 1519.56 ms
[2022-04-22 18:52:09 main:574] : INFO : Epoch 166 | loss: nan | val_loss: nan | Time: 1546.43 ms
[2022-04-22 18:52:11 main:574] : INFO : Epoch 167 | loss: nan | val_loss: nan | Time: 1562.37 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1080)
[2022-04-22 18:55:11 main:435] : INFO : Set logging level to 1
[2022-04-22 18:55:11 main:441] : INFO : Running in BOINC Client mode
[2022-04-22 18:55:11 main:444] : INFO : Resolving all filenames
[2022-04-22 18:55:11 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-22 18:55:11 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-22 18:55:11 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-22 18:55:11 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-22 18:55:11 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-22 18:55:11 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-22 18:55:11 main:474] : INFO : Configuration:
[2022-04-22 18:55:11 main:475] : INFO : Model type: GRU
[2022-04-22 18:55:11 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-22 18:55:11 main:477] : INFO : Max Epochs: 2048
[2022-04-22 18:55:11 main:478] : INFO : Batch Size: 128
[2022-04-22 18:55:11 main:479] : INFO : Learning Rate: 0.01
[2022-04-22 18:55:11 main:480] : INFO : Patience: 10
[2022-04-22 18:55:11 main:481] : INFO : Hidden Width: 12
[2022-04-22 18:55:11 main:482] : INFO : # Recurrent Layers: 4
[2022-04-22 18:55:11 main:483] : INFO : # Backend Layers: 4
[2022-04-22 18:55:11 main:484] : INFO : # Threads: 1
[2022-04-22 18:55:11 main:486] : INFO : Preparing Dataset
[2022-04-22 18:55:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-22 18:55:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-22 18:55:13 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-22 18:55:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-22 18:55:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-22 18:55:13 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-22 18:55:13 main:494] : INFO : Creating Model
[2022-04-22 18:55:13 main:507] : INFO : Preparing config file
[2022-04-22 18:55:13 main:511] : INFO : Found checkpoint, attempting to load...
[2022-04-22 18:55:13 main:512] : INFO : Loading config
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFBC2D74F69
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/22/22 18:55:13
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\3;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000d97f0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c4fb0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000c3510000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000c2d40000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000c3f90000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c27d0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1645
ModLoad: 00000000ab0e0000 0000000000058000 C:\ProgramData\BOINC\slots\3\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c4b30000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1620
ModLoad: 00000000c2a60000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1620
ModLoad: 00000000c2ca0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000c2ba0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000a50c0000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.30135.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\4\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.29.30135.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30135.0
ModLoad: 000000002cc10000 000000000abe7000 C:\ProgramData\BOINC\slots\3\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c4560000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b25f0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 00000000c4610000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000c4a90000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000a5e10000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.30135.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\4\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.29.30135.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30135.0
ModLoad: 00000000a5df0000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.30135.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\4\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.29.30135.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30135.0
ModLoad: 00000000c3e60000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000009ba00000 000000000020d000 C:\ProgramData\BOINC\slots\3\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000411a0000 00000000002db000 C:\ProgramData\BOINC\slots\3\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ab010000 0000000000040000 C:\ProgramData\BOINC\slots\3\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000080c0000 0000000024b49000 C:\ProgramData\BOINC\slots\3\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000aaf80000 0000000000045000 C:\ProgramData\BOINC\slots\3\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000005010000 00000000030a5000 C:\ProgramData\BOINC\slots\3\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000001b50000 00000000034b2000 C:\ProgramData\BOINC\slots\3\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000bfed0000 0000000000010000 C:\ProgramData\BOINC\slots\3\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000d98a0000 0000000003d5b000 C:\ProgramData\BOINC\slots\3\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000dd600000 000000000919f000 C:\ProgramData\BOINC\slots\3\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000d79d0000 0000000001eca000 C:\ProgramData\BOINC\slots\3\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000e67a0000 000000001b3a4000 C:\ProgramData\BOINC\slots\3\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000c4530000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000c0610000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000c30a0000 000000000046a000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c2780000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1620
ModLoad: 00000000c2b70000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c2480000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1620
ModLoad: 00000000c2800000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000c2900000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c22c0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000c35d0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 00000000c0810000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c46b0000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 00000000c2140000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c3da0000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c41f0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000003fca0000 00000000002b9000 C:\WINDOWS\system32\nvcuda.dll (30.0.14.9649) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r496_39\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.14.9649
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.5.76 driver
Product Version : 30.0.14.9649
ModLoad: 00000000d6350000 0000000001679000 C:\WINDOWS\system32\DriverStore\FileRepository\nvmdi.inf_amd64_3bab16edc4978b17\nvcuda64.dll (30.0.14.9649) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r496_39\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.14.9649
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.5.76 driver
Product Version : 30.0.14.9649
ModLoad: 00000000b98d0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000b97b0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 00000000b7fc0000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000c20b0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000b4460000 0000000000761000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.14.9649) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r496_39\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.14.9649
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.14.9649
ModLoad: 00000000c2870000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3602, Write: 308, Other 986
- I/O Transfers Counters -
Read: 6598764, Write: 6051, Other 29166
- Paged Pool Usage -
QuotaPagedPoolUsage: 3438688, QuotaPeakPagedPoolUsage: 3438688
QuotaNonPagedPoolUsage: 37392, QuotaPeakNonPagedPoolUsage: 37456
- Virtual Memory Usage -
VirtualSize: -1367339008, PeakVirtualSize: -778219520
- Pagefile Usage -
PagefileUsage: -1367339008, PeakPagefileUsage: -1367339008
- Working Set Size -
WorkingSetSize: 1158443008, PeakWorkingSetSize: 1158447104, PageFaultCount: 395078
*** Dump of thread ID 12416 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 3750000.000000, User Time: 12343750.000000, Wait Time: 286328.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFBC2D74F69
- Registers -
rax=00000000327a8b93 rbx=00000000d9b54910 rcx=00000000e26e5e80 rdx=0000000000000001 rsi=00000000e26e67c0 rdi=0000000019930520
r8=00000000e26e5f18 r9=0000000000000000 r10=0000000000000000 r11=0000000090eadf00 r12=00000000f68854d0 r13=00000000e26e69d0
r14=0000000085d8c6a0 r15=0000000000000000 rip=00000000c2d74f69 rsp=00000000e26e6660 rbp=00000000e26e6950
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
e26e6730 d9a6a884 00000040 0000004f f6884900 000006de KERNELBASE!RaiseException+0x0
e26e6790 d9811ca6 00000001 00000000 8f1a62d0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e26e6840 d981593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e26e6990 d9811a78 00000000 00000000 e26e6cc0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e26e6a60 d9811cfc e26e6cc0 00000000 00000080 e26e6f90 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e26e6b20 d981c4dd e26e6f90 e26e6f90 e26e6f90 e26e6f90 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e26e6e10 d980b2fe e26e7428 e26e6f90 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e26ffbb0 d9a4c6f8 af8c6420 00000000 00000000 adf01360 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e26ffbf0 c3527034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e26ffc20 c5002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e26ffca0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 1504 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 286219.000000
- Registers -
rax=00000000000001d3 rbx=00000000adec5430 rcx=0000000000000074 rdx=00000000adec50b0 rsi=00000000adec31e0 rdi=00000000adec5430
r8=00000000000002a8 r9=0000000000000028 r10=0000000000000000 r11=00000000d987a2a8 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000c50507c4 rsp=00000000e27ff688 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e27ff680 c5002dc7 0001000a 00000001 00000001 adec5430 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
e27ff980 c3527034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
e27ff9b0 c5002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e27ffa30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 6616 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 286226.000000
- Registers -
rax=00000000000001d3 rbx=00000000adec5860 rcx=0000000000000074 rdx=00000000adec54e0 rsi=00000000adec31e0 rdi=00000000adec5860
r8=00000000e28ff4b8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000c50507c4 rsp=00000000e28ff4b8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e28ff4b0 c5002dc7 00000000 00000000 adec31e0 adec5860 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
e28ff7b0 c3527034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
e28ff7e0 c5002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e28ff860 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 20268 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 156250.000000, Wait Time: 286226.000000
- Registers -
rax=00000000000001d3 rbx=00000000adec6350 rcx=0000000000000074 rdx=00000000adec5fd0 rsi=00000000adec31e0 rdi=00000000adec6350
r8=0000000000000008 r9=0000000000000040 r10=0000000000000500 r11=0000000001000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000c50507c4 rsp=00000000e29ffb48 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e29ffb40 c5002dc7 00000000 00000000 adec31e0 adec6350 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
e29ffe40 c3527034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
e29ffe70 c5002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e29ffef0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 17212 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 286322.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000e2bffa20 rsi=0000000000000000 rdi=0000000000000064
r8=0000000000000004 r9=0000000000000000 r10=00000000ae151001 r11=00000000e2bfee70 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000c504d3f4 rsp=00000000e2bff9f8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e2bff9f0 c2d8962e e2bffab8 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
e2bffa90 d982a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
e2bffac0 c3527034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e2bffaf0 c5002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e2bffb70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 23032 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 286327.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000e2cff710 rsi=0000000000000000 rdi=000000000000000d
r8=0000000000000001 r9=0000000000000000 r10=00000000aeff3210 r11=00000000fa3f1077 r12=0000000000000064 r13=00000000e2cff710
r14=00000000e2cff410 r15=0000000000000000 rip=00000000c504d8c4 rsp=00000000e2cff3b8 rbp=00000000afaca9a0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e2cff3b0 c2d8cb10 00000000 e24a6000 c511a4d0 e24a6000 ntdll!ZwWaitForMultipleObjects+0x0
e2cff6a0 c2d8ca0e aded69d0 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
e2cff6e0 d6525be4 aface180 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
e2cff920 d65cd15d 00000000 afaca9a0 00000000 00000000 nvcuda64!+0x0
e2cff9d0 d65255b3 6ae5ac34 6a1c1dee b0152b90 00000000 nvcuda64!cuProfilerStop+0x0
e2cffa00 d6854264 b0152b90 00000000 00000000 00000000 nvcuda64!+0x0
e2cffa30 c3527034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
e2cffa60 c5002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e2cffae0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 16612 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 286256.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000088 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000088
r8=00000000e2dffe48 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=00000000afa8eea0 r13=0000000000000000
r14=0000000000000088 r15=0000000000000000 rip=00000000c504cdf4 rsp=00000000e2dffbc8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e2dffbc0 c2d61a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
e2dffc60 d67495ee b01526b0 00000000 00000000 00000088 KERNELBASE!WaitForSingleObjectEx+0x0
e2dffea0 d65255b3 00000000 b01526b0 d6350000 afab6c80 nvcuda64!cuProfilerStop+0x0
e2dffed0 d6854264 b01526b0 00000000 00000000 00000000 nvcuda64!+0x0
e2dfff00 c3527034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
e2dfff30 c5002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e2dfffb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)