Task 14631857
| Name | ParityModified-1647041171-23718-3-0_3 |
| Workunit | 11574509 |
| Created | 29 Apr 2022, 6:41:23 UTC |
| Sent | 29 Apr 2022, 6:42:42 UTC |
| Report deadline | 7 May 2022, 6:42:42 UTC |
| Received | 29 Apr 2022, 10:32:05 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 13970 |
| Run time | 1 hours 50 min 15 sec |
| CPU time | 1 hours 36 min 19 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 1,168.29 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.63 GB |
| Peak swap size | 3.57 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-04-29 03:37:53 main:435] : INFO : Set logging level to 1
[2022-04-29 03:37:54 main:441] : INFO : Running in BOINC Client mode
[2022-04-29 03:37:54 main:444] : INFO : Resolving all filenames
[2022-04-29 03:37:54 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-29 03:37:54 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 0)
[2022-04-29 03:37:54 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-29 03:37:55 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-29 03:37:55 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-04-29 03:37:55 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-29 03:37:55 main:474] : INFO : Configuration:
[2022-04-29 03:37:55 main:475] : INFO : Model type: GRU
[2022-04-29 03:37:55 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-29 03:37:55 main:477] : INFO : Max Epochs: 2048
[2022-04-29 03:37:55 main:478] : INFO : Batch Size: 128
[2022-04-29 03:37:56 main:479] : INFO : Learning Rate: 0.01
[2022-04-29 03:37:56 main:480] : INFO : Patience: 10
[2022-04-29 03:37:56 main:481] : INFO : Hidden Width: 12
[2022-04-29 03:37:56 main:482] : INFO : # Recurrent Layers: 4
[2022-04-29 03:37:56 main:483] : INFO : # Backend Layers: 4
[2022-04-29 03:37:56 main:484] : INFO : # Threads: 1
[2022-04-29 03:37:56 main:486] : INFO : Preparing Dataset
[2022-04-29 03:37:56 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-29 03:37:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-29 03:38:07 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-29 03:38:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-29 03:38:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-29 03:38:09 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-29 03:38:09 main:494] : INFO : Creating Model
[2022-04-29 03:38:10 main:507] : INFO : Preparing config file
[2022-04-29 03:38:10 main:519] : INFO : Creating new config file
[2022-04-29 03:38:11 main:538] : INFO : This is a continuation WU, loading previous network
[2022-04-29 03:38:24 main:559] : INFO : Loading DataLoader into Memory
[2022-04-29 03:38:25 main:562] : INFO : Starting Training
[2022-04-29 03:39:19 main:574] : INFO : Epoch 1 | loss: nan | val_loss: nan | Time: 54639.4 ms
[2022-04-29 03:40:04 main:574] : INFO : Epoch 2 | loss: nan | val_loss: nan | Time: 44478.3 ms
[2022-04-29 03:40:51 main:574] : INFO : Epoch 3 | loss: nan | val_loss: nan | Time: 44982.5 ms
[2022-04-29 03:41:37 main:574] : INFO : Epoch 4 | loss: nan | val_loss: nan | Time: 44958.3 ms
[2022-04-29 03:42:41 main:574] : INFO : Epoch 5 | loss: nan | val_loss: nan | Time: 62785.7 ms
[2022-04-29 03:43:30 main:574] : INFO : Epoch 6 | loss: nan | val_loss: nan | Time: 46185.8 ms
[2022-04-29 03:44:32 main:574] : INFO : Epoch 7 | loss: nan | val_loss: nan | Time: 60257.7 ms
[2022-04-29 03:45:59 main:574] : INFO : Epoch 8 | loss: nan | val_loss: nan | Time: 43948.7 ms
[2022-04-29 03:46:44 main:574] : INFO : Epoch 9 | loss: nan | val_loss: nan | Time: 44138.3 ms
[2022-04-29 03:47:29 main:574] : INFO : Epoch 10 | loss: nan | val_loss: nan | Time: 44246.1 ms
[2022-04-29 03:48:14 main:574] : INFO : Epoch 11 | loss: nan | val_loss: nan | Time: 44175.5 ms
[2022-04-29 03:48:59 main:574] : INFO : Epoch 12 | loss: nan | val_loss: nan | Time: 44177.8 ms
[2022-04-29 03:49:44 main:574] : INFO : Epoch 13 | loss: nan | val_loss: nan | Time: 44119.9 ms
[2022-04-29 03:50:29 main:574] : INFO : Epoch 14 | loss: nan | val_loss: nan | Time: 44272.9 ms
[2022-04-29 03:51:14 main:574] : INFO : Epoch 15 | loss: nan | val_loss: nan | Time: 44105.9 ms
[2022-04-29 03:51:59 main:574] : INFO : Epoch 16 | loss: nan | val_loss: nan | Time: 44168.9 ms
[2022-04-29 03:52:45 main:574] : INFO : Epoch 17 | loss: nan | val_loss: nan | Time: 44265.1 ms
[2022-04-29 03:53:30 main:574] : INFO : Epoch 18 | loss: nan | val_loss: nan | Time: 44202.8 ms
[2022-04-29 03:54:16 main:574] : INFO : Epoch 19 | loss: nan | val_loss: nan | Time: 45522.5 ms
[2022-04-29 03:55:01 main:574] : INFO : Epoch 20 | loss: nan | val_loss: nan | Time: 44193.3 ms
[2022-04-29 03:55:45 main:574] : INFO : Epoch 21 | loss: nan | val_loss: nan | Time: 44138.4 ms
[2022-04-29 03:56:29 main:574] : INFO : Epoch 22 | loss: nan | val_loss: nan | Time: 44189 ms
[2022-04-29 03:57:14 main:574] : INFO : Epoch 23 | loss: nan | val_loss: nan | Time: 44206 ms
[2022-04-29 03:57:59 main:574] : INFO : Epoch 24 | loss: nan | val_loss: nan | Time: 44232.4 ms
[2022-04-29 03:58:44 main:574] : INFO : Epoch 25 | loss: nan | val_loss: nan | Time: 44175.8 ms
[2022-04-29 03:59:29 main:574] : INFO : Epoch 26 | loss: nan | val_loss: nan | Time: 44242.5 ms
[2022-04-29 04:00:13 main:574] : INFO : Epoch 27 | loss: nan | val_loss: nan | Time: 44092.8 ms
[2022-04-29 04:00:58 main:574] : INFO : Epoch 28 | loss: nan | val_loss: nan | Time: 44129.6 ms
[2022-04-29 04:01:42 main:574] : INFO : Epoch 29 | loss: nan | val_loss: nan | Time: 44253.9 ms
[2022-04-29 04:02:26 main:574] : INFO : Epoch 30 | loss: nan | val_loss: nan | Time: 44214.6 ms
[2022-04-29 04:03:11 main:574] : INFO : Epoch 31 | loss: nan | val_loss: nan | Time: 44132 ms
[2022-04-29 04:03:55 main:574] : INFO : Epoch 32 | loss: nan | val_loss: nan | Time: 44203.9 ms
[2022-04-29 04:04:40 main:574] : INFO : Epoch 33 | loss: nan | val_loss: nan | Time: 44062.6 ms
[2022-04-29 04:05:25 main:574] : INFO : Epoch 34 | loss: nan | val_loss: nan | Time: 44133.5 ms
[2022-04-29 04:06:09 main:574] : INFO : Epoch 35 | loss: nan | val_loss: nan | Time: 44627.5 ms
[2022-04-29 04:06:54 main:574] : INFO : Epoch 36 | loss: nan | val_loss: nan | Time: 44312.9 ms
[2022-04-29 04:07:39 main:574] : INFO : Epoch 37 | loss: nan | val_loss: nan | Time: 44195.6 ms
[2022-04-29 04:08:24 main:574] : INFO : Epoch 38 | loss: nan | val_loss: nan | Time: 44190.7 ms
[2022-04-29 04:09:09 main:574] : INFO : Epoch 39 | loss: nan | val_loss: nan | Time: 44477.5 ms
[2022-04-29 04:09:56 main:574] : INFO : Epoch 40 | loss: nan | val_loss: nan | Time: 44304 ms
[2022-04-29 04:10:41 main:574] : INFO : Epoch 41 | loss: nan | val_loss: nan | Time: 44153 ms
[2022-04-29 04:11:25 main:574] : INFO : Epoch 42 | loss: nan | val_loss: nan | Time: 44155.3 ms
[2022-04-29 04:12:10 main:574] : INFO : Epoch 43 | loss: nan | val_loss: nan | Time: 44259.4 ms
[2022-04-29 04:12:55 main:574] : INFO : Epoch 44 | loss: nan | val_loss: nan | Time: 44510.9 ms
[2022-04-29 04:13:39 main:574] : INFO : Epoch 45 | loss: nan | val_loss: nan | Time: 44424.8 ms
[2022-04-29 04:14:24 main:574] : INFO : Epoch 46 | loss: nan | val_loss: nan | Time: 44360.9 ms
[2022-04-29 04:15:08 main:574] : INFO : Epoch 47 | loss: nan | val_loss: nan | Time: 44161.7 ms
[2022-04-29 04:15:53 main:574] : INFO : Epoch 48 | loss: nan | val_loss: nan | Time: 44205.2 ms
[2022-04-29 04:16:37 main:574] : INFO : Epoch 49 | loss: nan | val_loss: nan | Time: 44189.7 ms
[2022-04-29 04:17:21 main:574] : INFO : Epoch 50 | loss: nan | val_loss: nan | Time: 44266.2 ms
[2022-04-29 04:18:06 main:574] : INFO : Epoch 51 | loss: nan | val_loss: nan | Time: 44129.8 ms
[2022-04-29 04:18:50 main:574] : INFO : Epoch 52 | loss: nan | val_loss: nan | Time: 44249.7 ms
[2022-04-29 04:19:34 main:574] : INFO : Epoch 53 | loss: nan | val_loss: nan | Time: 44136.1 ms
[2022-04-29 04:20:19 main:574] : INFO : Epoch 54 | loss: nan | val_loss: nan | Time: 44242.6 ms
[2022-04-29 04:21:03 main:574] : INFO : Epoch 55 | loss: nan | val_loss: nan | Time: 44061.5 ms
[2022-04-29 04:21:48 main:574] : INFO : Epoch 56 | loss: nan | val_loss: nan | Time: 44201.3 ms
[2022-04-29 04:22:32 main:574] : INFO : Epoch 57 | loss: nan | val_loss: nan | Time: 44113.7 ms
[2022-04-29 04:23:16 main:574] : INFO : Epoch 58 | loss: nan | val_loss: nan | Time: 44167.3 ms
[2022-04-29 04:24:00 main:574] : INFO : Epoch 59 | loss: nan | val_loss: nan | Time: 44084.4 ms
[2022-04-29 04:24:45 main:574] : INFO : Epoch 60 | loss: nan | val_loss: nan | Time: 44060.9 ms
[2022-04-29 04:25:29 main:574] : INFO : Epoch 61 | loss: nan | val_loss: nan | Time: 44009.4 ms
[2022-04-29 04:26:13 main:574] : INFO : Epoch 62 | loss: nan | val_loss: nan | Time: 44202.7 ms
[2022-04-29 04:26:57 main:574] : INFO : Epoch 63 | loss: nan | val_loss: nan | Time: 44088.9 ms
[2022-04-29 04:27:42 main:574] : INFO : Epoch 64 | loss: nan | val_loss: nan | Time: 44108.7 ms
[2022-04-29 04:28:26 main:574] : INFO : Epoch 65 | loss: nan | val_loss: nan | Time: 44110.3 ms
[2022-04-29 04:29:11 main:574] : INFO : Epoch 66 | loss: nan | val_loss: nan | Time: 44213.7 ms
[2022-04-29 04:29:55 main:574] : INFO : Epoch 67 | loss: nan | val_loss: nan | Time: 44081.7 ms
[2022-04-29 04:30:39 main:574] : INFO : Epoch 68 | loss: nan | val_loss: nan | Time: 44236.4 ms
[2022-04-29 04:31:24 main:574] : INFO : Epoch 69 | loss: nan | val_loss: nan | Time: 44041.5 ms
[2022-04-29 04:32:09 main:574] : INFO : Epoch 70 | loss: nan | val_loss: nan | Time: 44206.5 ms
[2022-04-29 04:32:53 main:574] : INFO : Epoch 71 | loss: nan | val_loss: nan | Time: 44059.1 ms
[2022-04-29 04:33:37 main:574] : INFO : Epoch 72 | loss: nan | val_loss: nan | Time: 44176.8 ms
[2022-04-29 04:34:22 main:574] : INFO : Epoch 73 | loss: nan | val_loss: nan | Time: 44115.8 ms
[2022-04-29 04:35:06 main:574] : INFO : Epoch 74 | loss: nan | val_loss: nan | Time: 44188.9 ms
[2022-04-29 04:35:50 main:574] : INFO : Epoch 75 | loss: nan | val_loss: nan | Time: 44099.8 ms
[2022-04-29 04:36:35 main:574] : INFO : Epoch 76 | loss: nan | val_loss: nan | Time: 44125.2 ms
[2022-04-29 04:37:19 main:574] : INFO : Epoch 77 | loss: nan | val_loss: nan | Time: 44143 ms
[2022-04-29 04:38:03 main:574] : INFO : Epoch 78 | loss: nan | val_loss: nan | Time: 44187.8 ms
[2022-04-29 04:38:48 main:574] : INFO : Epoch 79 | loss: nan | val_loss: nan | Time: 44149.2 ms
[2022-04-29 04:39:32 main:574] : INFO : Epoch 80 | loss: nan | val_loss: nan | Time: 44133.2 ms
[2022-04-29 04:40:16 main:574] : INFO : Epoch 81 | loss: nan | val_loss: nan | Time: 44056.1 ms
[2022-04-29 04:41:01 main:574] : INFO : Epoch 82 | loss: nan | val_loss: nan | Time: 44152.7 ms
[2022-04-29 04:41:45 main:574] : INFO : Epoch 83 | loss: nan | val_loss: nan | Time: 44135.8 ms
[2022-04-29 04:42:29 main:574] : INFO : Epoch 84 | loss: nan | val_loss: nan | Time: 44159.1 ms
[2022-04-29 04:43:14 main:574] : INFO : Epoch 85 | loss: nan | val_loss: nan | Time: 44162.1 ms
[2022-04-29 04:43:58 main:574] : INFO : Epoch 86 | loss: nan | val_loss: nan | Time: 44208.6 ms
[2022-04-29 04:44:42 main:574] : INFO : Epoch 87 | loss: nan | val_loss: nan | Time: 44053.2 ms
[2022-04-29 04:45:27 main:574] : INFO : Epoch 88 | loss: nan | val_loss: nan | Time: 44158.6 ms
[2022-04-29 04:46:11 main:574] : INFO : Epoch 89 | loss: nan | val_loss: nan | Time: 44127.9 ms
[2022-04-29 04:46:55 main:574] : INFO : Epoch 90 | loss: nan | val_loss: nan | Time: 44199.1 ms
[2022-04-29 04:47:40 main:574] : INFO : Epoch 91 | loss: nan | val_loss: nan | Time: 44126.1 ms
[2022-04-29 04:48:24 main:574] : INFO : Epoch 92 | loss: nan | val_loss: nan | Time: 44167.5 ms
[2022-04-29 04:49:08 main:574] : INFO : Epoch 93 | loss: nan | val_loss: nan | Time: 44116.4 ms
[2022-04-29 04:49:52 main:574] : INFO : Epoch 94 | loss: nan | val_loss: nan | Time: 44105.6 ms
[2022-04-29 04:50:37 main:574] : INFO : Epoch 95 | loss: nan | val_loss: nan | Time: 44092.5 ms
[2022-04-29 04:51:21 main:574] : INFO : Epoch 96 | loss: nan | val_loss: nan | Time: 44185 ms
[2022-04-29 04:52:05 main:574] : INFO : Epoch 97 | loss: nan | val_loss: nan | Time: 44094.4 ms
[2022-04-29 04:52:50 main:574] : INFO : Epoch 98 | loss: nan | val_loss: nan | Time: 44112.1 ms
[2022-04-29 04:53:34 main:574] : INFO : Epoch 99 | loss: nan | val_loss: nan | Time: 44096.3 ms
[2022-04-29 04:54:18 main:574] : INFO : Epoch 100 | loss: nan | val_loss: nan | Time: 44167.8 ms
[2022-04-29 04:55:02 main:574] : INFO : Epoch 101 | loss: nan | val_loss: nan | Time: 44061 ms
[2022-04-29 04:55:47 main:574] : INFO : Epoch 102 | loss: nan | val_loss: nan | Time: 44154.4 ms
[2022-04-29 04:56:31 main:574] : INFO : Epoch 103 | loss: nan | val_loss: nan | Time: 44060.4 ms
[2022-04-29 04:57:15 main:574] : INFO : Epoch 104 | loss: nan | val_loss: nan | Time: 44189.8 ms
[2022-04-29 04:58:00 main:574] : INFO : Epoch 105 | loss: nan | val_loss: nan | Time: 44101.8 ms
[2022-04-29 04:58:44 main:574] : INFO : Epoch 106 | loss: nan | val_loss: nan | Time: 44187.9 ms
[2022-04-29 04:59:28 main:574] : INFO : Epoch 107 | loss: nan | val_loss: nan | Time: 44020.1 ms
[2022-04-29 05:00:12 main:574] : INFO : Epoch 108 | loss: nan | val_loss: nan | Time: 44124.7 ms
[2022-04-29 05:00:57 main:574] : INFO : Epoch 109 | loss: nan | val_loss: nan | Time: 44102.3 ms
[2022-04-29 05:01:41 main:574] : INFO : Epoch 110 | loss: nan | val_loss: nan | Time: 44170.4 ms
[2022-04-29 05:02:25 main:574] : INFO : Epoch 111 | loss: nan | val_loss: nan | Time: 44137.3 ms
[2022-04-29 05:03:10 main:574] : INFO : Epoch 112 | loss: nan | val_loss: nan | Time: 44145.8 ms
[2022-04-29 05:03:54 main:574] : INFO : Epoch 113 | loss: nan | val_loss: nan | Time: 44124.6 ms
[2022-04-29 05:04:38 main:574] : INFO : Epoch 114 | loss: nan | val_loss: nan | Time: 44117.8 ms
[2022-04-29 05:05:23 main:574] : INFO : Epoch 115 | loss: nan | val_loss: nan | Time: 44222.5 ms
[2022-04-29 05:06:07 main:574] : INFO : Epoch 116 | loss: nan | val_loss: nan | Time: 44135.6 ms
[2022-04-29 05:06:51 main:574] : INFO : Epoch 117 | loss: nan | val_loss: nan | Time: 44098.2 ms
[2022-04-29 05:07:36 main:574] : INFO : Epoch 118 | loss: nan | val_loss: nan | Time: 44142.6 ms
[2022-04-29 05:08:20 main:574] : INFO : Epoch 119 | loss: nan | val_loss: nan | Time: 44130.7 ms
[2022-04-29 05:09:04 main:574] : INFO : Epoch 120 | loss: nan | val_loss: nan | Time: 44230.9 ms
[2022-04-29 05:09:49 main:574] : INFO : Epoch 121 | loss: nan | val_loss: nan | Time: 44187 ms
[2022-04-29 05:10:33 main:574] : INFO : Epoch 122 | loss: nan | val_loss: nan | Time: 44099 ms
[2022-04-29 05:11:17 main:574] : INFO : Epoch 123 | loss: nan | val_loss: nan | Time: 44036.7 ms
[2022-04-29 05:12:01 main:574] : INFO : Epoch 124 | loss: nan | val_loss: nan | Time: 44153.2 ms
[2022-04-29 05:12:46 main:574] : INFO : Epoch 125 | loss: nan | val_loss: nan | Time: 44039.8 ms
[2022-04-29 05:13:30 main:574] : INFO : Epoch 126 | loss: nan | val_loss: nan | Time: 44161.1 ms
[2022-04-29 05:14:14 main:574] : INFO : Epoch 127 | loss: nan | val_loss: nan | Time: 44040.3 ms
[2022-04-29 05:14:58 main:574] : INFO : Epoch 128 | loss: nan | val_loss: nan | Time: 44084.4 ms
[2022-04-29 05:15:43 main:574] : INFO : Epoch 129 | loss: nan | val_loss: nan | Time: 44101 ms
[2022-04-29 05:16:27 main:574] : INFO : Epoch 130 | loss: nan | val_loss: nan | Time: 44136.8 ms
[2022-04-29 05:17:11 main:574] : INFO : Epoch 131 | loss: nan | val_loss: nan | Time: 44117.9 ms
[2022-04-29 05:17:56 main:574] : INFO : Epoch 132 | loss: nan | val_loss: nan | Time: 44191.5 ms
[2022-04-29 05:18:40 main:574] : INFO : Epoch 133 | loss: nan | val_loss: nan | Time: 44109.6 ms
[2022-04-29 05:19:24 main:574] : INFO : Epoch 134 | loss: nan | val_loss: nan | Time: 44084.3 ms
[2022-04-29 05:20:08 main:574] : INFO : Epoch 135 | loss: nan | val_loss: nan | Time: 44162.3 ms
[2022-04-29 05:20:53 main:574] : INFO : Epoch 136 | loss: nan | val_loss: nan | Time: 44141.6 ms
[2022-04-29 05:21:37 main:574] : INFO : Epoch 137 | loss: nan | val_loss: nan | Time: 44144.4 ms
[2022-04-29 05:22:21 main:574] : INFO : Epoch 138 | loss: nan | val_loss: nan | Time: 44157.8 ms
[2022-04-29 05:23:06 main:574] : INFO : Epoch 139 | loss: nan | val_loss: nan | Time: 44148.1 ms
[2022-04-29 05:23:50 main:574] : INFO : Epoch 140 | loss: nan | val_loss: nan | Time: 44120.5 ms
[2022-04-29 05:24:34 main:574] : INFO : Epoch 141 | loss: nan | val_loss: nan | Time: 44079.4 ms
[2022-04-29 05:25:19 main:574] : INFO : Epoch 142 | loss: nan | val_loss: nan | Time: 44165.8 ms
[2022-04-29 05:26:03 main:574] : INFO : Epoch 143 | loss: nan | val_loss: nan | Time: 44097.8 ms
[2022-04-29 05:26:47 main:574] : INFO : Epoch 144 | loss: nan | val_loss: nan | Time: 44079.6 ms
[2022-04-29 05:27:31 main:574] : INFO : Epoch 145 | loss: nan | val_loss: nan | Time: 44077.4 ms
[2022-04-29 05:28:16 main:574] : INFO : Epoch 146 | loss: nan | val_loss: nan | Time: 44141.2 ms
[2022-04-29 05:29:00 main:574] : INFO : Epoch 147 | loss: nan | val_loss: nan | Time: 44123.2 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-04-29 05:31:15 main:435] : INFO : Set logging level to 1
[2022-04-29 05:31:15 main:441] : INFO : Running in BOINC Client mode
[2022-04-29 05:31:15 main:444] : INFO : Resolving all filenames
[2022-04-29 05:31:15 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-29 05:31:15 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-29 05:31:15 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-29 05:31:15 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-29 05:31:16 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-29 05:31:16 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-29 05:31:16 main:474] : INFO : Configuration:
[2022-04-29 05:31:16 main:475] : INFO : Model type: GRU
[2022-04-29 05:31:16 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-29 05:31:16 main:477] : INFO : Max Epochs: 2048
[2022-04-29 05:31:16 main:478] : INFO : Batch Size: 128
[2022-04-29 05:31:16 main:479] : INFO : Learning Rate: 0.01
[2022-04-29 05:31:16 main:480] : INFO : Patience: 10
[2022-04-29 05:31:16 main:481] : INFO : Hidden Width: 12
[2022-04-29 05:31:16 main:482] : INFO : # Recurrent Layers: 4
[2022-04-29 05:31:16 main:483] : INFO : # Backend Layers: 4
[2022-04-29 05:31:16 main:484] : INFO : # Threads: 1
[2022-04-29 05:31:17 main:486] : INFO : Preparing Dataset
[2022-04-29 05:31:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-29 05:31:19 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-29 05:31:38 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-29 05:31:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-29 05:31:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-29 05:31:39 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-29 05:31:39 main:494] : INFO : Creating Model
[2022-04-29 05:31:39 main:507] : INFO : Preparing config file
[2022-04-29 05:31:39 main:511] : INFO : Found checkpoint, attempting to load...
[2022-04-29 05:31:39 main:512] : INFO : Loading config
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFCC23B4F69
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/29/22 05:31:39
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\5;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 0000000092710000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c4a50000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000c48e0000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000c2380000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000c3a80000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c22c0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1645
ModLoad: 00000000c2ab0000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1620
ModLoad: 00000000c27d0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1620
ModLoad: 00000000c2170000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000c2650000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000c3600000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c3720000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000c37c0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c2dd0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b41a0000 0000000000058000 C:\ProgramData\BOINC\slots\5\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000006c460000 000000000abe7000 C:\ProgramData\BOINC\slots\5\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ac080000 0000000000099000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.22.27821.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\3\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.22.27821.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio® 2017
Product Version : 14.22.27821.0
ModLoad: 00000000b1aa0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 00000000ad170000 0000000000016000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.22.27821.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\3\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.22.27821.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio® 2017
Product Version : 14.22.27821.0
ModLoad: 00000000b6800000 000000000000b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.22.27821.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\3\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.22.27821.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio® 2017
Product Version : 14.22.27821.0
ModLoad: 00000000976a0000 000000000020d000 C:\ProgramData\BOINC\slots\5\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000047910000 0000000024b49000 C:\ProgramData\BOINC\slots\5\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000092b00000 00000000002db000 C:\ProgramData\BOINC\slots\5\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b4a00000 0000000000040000 C:\ProgramData\BOINC\slots\5\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a3270000 0000000000045000 C:\ProgramData\BOINC\slots\5\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000007d1d0000 00000000030a5000 C:\ProgramData\BOINC\slots\5\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000290a0000 000000001b3a4000 C:\ProgramData\BOINC\slots\5\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000b67f0000 0000000000010000 C:\ProgramData\BOINC\slots\5\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 000000001ff00000 000000000919f000 C:\ProgramData\BOINC\slots\5\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 000000001c1a0000 0000000003d5b000 C:\ProgramData\BOINC\slots\5\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000001a2d0000 0000000001eca000 C:\ProgramData\BOINC\slots\5\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000044450000 00000000034b2000 C:\ProgramData\BOINC\slots\5\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000c2ce0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000c00b0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000c30b0000 000000000046a000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c2750000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1620
ModLoad: 00000000c27a0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c1ed0000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1620
ModLoad: 00000000c28e0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000c2950000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c1cf0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000c4060000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 00000000c02b0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c3d00000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 00000000c1b70000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c2d10000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c36b0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000912c0000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 0000000078610000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_31a2adf8c49e7799\nvcuda64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 00000000bc990000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000bc950000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 00000000ba4c0000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000c1ae0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000b7000000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1165
ModLoad: 00000000c22f0000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3603, Write: 307, Other 835
- I/O Transfers Counters -
Read: 6617348, Write: 6049, Other 28598
- Paged Pool Usage -
QuotaPagedPoolUsage: 3438752, QuotaPeakPagedPoolUsage: 3438752
QuotaNonPagedPoolUsage: 37256, QuotaPeakNonPagedPoolUsage: 37320
- Virtual Memory Usage -
VirtualSize: -1466101760, PeakVirtualSize: -872124416
- Pagefile Usage -
PagefileUsage: -1466101760, PeakPagefileUsage: -1466101760
- Working Set Size -
WorkingSetSize: 1157390336, PeakWorkingSetSize: 1157394432, PageFaultCount: 394278
*** Dump of thread ID 5172 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 23437500.000000, User Time: 67500000.000000, Wait Time: 53589608.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFCC23B4F69
- Registers -
rax=00000000c4a7b3c7 rbx=0000000092a74910 rcx=00000000165d0000 rdx=0000000000000000 rsi=00000000898e66a0 rdi=0000000019930520
r8=000000000000004e r9=0000000000000027 r10=00000000c4a7b86b r11=00000000033e0293 r12=0000000062697750 r13=00000000898e68b0
r14=000000006ff3dc00 r15=0000000000000000 rip=00000000c23b4f69 rsp=00000000898e6540 rbp=00000000898e6830
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
898e6610 9298a884 00000040 0000004f 62697a00 000005ae KERNELBASE!RaiseException+0x0
898e6670 92731ca6 00000001 00000002 71a235f0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
898e6720 9273593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
898e6870 92731a78 00000000 00000000 898e6ba0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
898e6940 92731cfc 898e6ba0 00000000 00000080 898e6e70 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
898e6a00 9273c4dd 898e6e70 898e6e70 898e6e70 898e6e70 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
898e6cf0 9272b2fe 898e7308 898e6e70 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
898ffa90 9296c6f8 18125400 00000000 00000000 167b5a70 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
898ffad0 c48f7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
898ffb00 c4aa2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
898ffb80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 7712 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53588036.000000
- Registers -
rax=00000000000001d3 rbx=00000000167bb070 rcx=0000000000000070 rdx=00000000167bacf0 rsi=00000000167b3110 rdi=00000000167bb070
r8=00000000bc995008 r9=00000000899ff000 r10=00000000bc9900f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000c4af07c4 rsp=00000000899ff558 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
899ff550 c4aa2dc7 00000000 00000000 167b3110 167bb070 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
899ff850 c48f7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
899ff880 c4aa2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
899ff900 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 8364 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53588036.000000
- Registers -
rax=00000000000001d3 rbx=00000000167bf970 rcx=0000000000000070 rdx=00000000167bf5f0 rsi=00000000167b3110 rdi=00000000167bf970
r8=0000000000000008 r9=0000000000000000 r10=0000000000000000 r11=0000000000000048 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000c4af07c4 rsp=0000000089aff708 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
89aff700 c4aa2dc7 00000000 00000000 167b3110 167bf970 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
89affa00 c48f7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
89affa30 c4aa2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
89affab0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 8672 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53587996.000000
- Registers -
rax=00000000000001d3 rbx=00000000167c19e0 rcx=0000000000000070 rdx=00000000167c1660 rsi=00000000167b3110 rdi=00000000167c19e0
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000c4af07c4 rsp=0000000089bff768 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
89bff760 c4aa2dc7 00000000 00000000 167b3110 00000000 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
89bffa60 c48f7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
89bffa90 c4aa2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
89bffb10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 8644 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53589604.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=0000000089dffc30 rsi=0000000000000000 rdi=0000000000000064
r8=0000000089dffc08 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000c4aed3f4 rsp=0000000089dffc08 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
89dffc00 c23c962e 89dffcc8 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
89dffca0 9274a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
89dffcd0 c48f7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
89dffd00 c4aa2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
89dffd80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 7196 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53589604.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=0000000089eff9e0 rsi=0000000000000000 rdi=000000000000000d
r8=0000000018597030 r9=0000000018361000 r10=0000000000000000 r11=0000000089eff950 r12=0000000000000064 r13=0000000089eff9e0
r14=0000000089eff6e0 r15=0000000000000000 rip=00000000c4aed8c4 rsp=0000000089eff688 rbp=00000000183610c0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
89eff680 c23ccb10 00000000 89723000 c4bba4d0 89723000 ntdll!ZwWaitForMultipleObjects+0x0
89eff970 c23cca0e 167c2410 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
89eff9b0 787ed554 183655c0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
89effbf0 788958cd 00000000 183610c0 00000000 00000000 nvcuda64!+0x0
89effca0 787ecf23 989cf51c 8d48b5b4 188c2d00 00000000 nvcuda64!cuProfilerStop+0x0
89effcd0 78b244c4 188c2d00 00000000 00000000 00000000 nvcuda64!+0x0
89effd00 c48f7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
89effd30 c4aa2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
89effdb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 8820 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53588404.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b4
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000182ee530 r13=0000000000000000
r14=00000000000002b4 r15=0000000000000000 rip=00000000c4aecdf4 rsp=0000000089fff928 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
89fff920 c23a1a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
89fff9c0 78a15d0e 188c2f10 00000000 00000000 000002b4 KERNELBASE!WaitForSingleObjectEx+0x0
89fffc00 787ecf23 00000000 188c2f10 78610000 18334c30 nvcuda64!cuProfilerStop+0x0
89fffc30 78b244c4 188c2f10 00000000 00000000 00000000 nvcuda64!+0x0
89fffc60 c48f7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
89fffc90 c4aa2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
89fffd10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)