Task 3324950
| Name | ParityModified-1608176617-24429-0_3 |
| Workunit | 1584976 |
| Created | 18 Dec 2020, 10:21:15 UTC |
| Sent | 18 Dec 2020, 11:36:37 UTC |
| Report deadline | 26 Dec 2020, 11:36:37 UTC |
| Received | 18 Dec 2020, 15:29:38 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 2309 |
| Run time | 23 min 38 sec |
| CPU time | 21 min 48 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 517.86 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.55 GB |
| Peak swap size | 3.45 GB |
| Peak disk usage | 1.53 GB |
Stderr output
<core_client_version>7.14.3</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -529697949 (0xe06d7363)</message>
<stderr_txt>
main:507] : INFO : Preparing config file
[2020-12-18 11:42:38 main:519] : INFO : Creating new config file
[2020-12-18 11:42:43 main:559] : INFO : Loading DataLoader into Memory
[2020-12-18 11:42:43 main:562] : INFO : Starting Training
[2020-12-18 11:42:55 main:574] : INFO : Epoch 1 | loss: 0.0589044 | val_loss: 0.0316806 | Time: 12059.7 ms
[2020-12-18 11:43:00 main:574] : INFO : Epoch 2 | loss: 0.0317593 | val_loss: 0.031537 | Time: 4499.04 ms
[2020-12-18 11:43:05 main:574] : INFO : Epoch 3 | loss: 0.0313476 | val_loss: 0.0312817 | Time: 4751.76 ms
[2020-12-18 11:43:10 main:574] : INFO : Epoch 4 | loss: 0.0312674 | val_loss: 0.0312546 | Time: 4966.62 ms
[2020-12-18 11:43:15 main:574] : INFO : Epoch 5 | loss: 0.0312557 | val_loss: 0.0312536 | Time: 5557.77 ms
[2020-12-18 11:43:21 main:574] : INFO : Epoch 6 | loss: 0.0312516 | val_loss: 0.031251 | Time: 5600.39 ms
[2020-12-18 11:43:27 main:574] : INFO : Epoch 7 | loss: 0.0312508 | val_loss: 0.0312517 | Time: 6190.27 ms
[2020-12-18 11:43:32 main:574] : INFO : Epoch 8 | loss: 0.0312509 | val_loss: 0.0312508 | Time: 5422.18 ms
[2020-12-18 11:43:39 main:574] : INFO : Epoch 9 | loss: 0.0312508 | val_loss: 0.0312513 | Time: 6113.13 ms
[2020-12-18 11:43:44 main:574] : INFO : Epoch 10 | loss: 0.031251 | val_loss: 0.0312507 | Time: 5519.13 ms
[2020-12-18 11:43:50 main:574] : INFO : Epoch 11 | loss: 0.0312511 | val_loss: 0.0312513 | Time: 5559.6 ms
[2020-12-18 11:43:55 main:574] : INFO : Epoch 12 | loss: 0.031251 | val_loss: 0.0312507 | Time: 5737.55 ms
[2020-12-18 11:44:01 main:574] : INFO : Epoch 13 | loss: 0.0312509 | val_loss: 0.0312506 | Time: 5448.93 ms
[2020-12-18 11:44:07 main:574] : INFO : Epoch 14 | loss: 0.0312503 | val_loss: 0.0312506 | Time: 6006.15 ms
[2020-12-18 11:44:12 main:574] : INFO : Epoch 15 | loss: 0.0312504 | val_loss: 0.0312505 | Time: 5611.38 ms
[2020-12-18 11:44:19 main:574] : INFO : Epoch 16 | loss: 0.0312506 | val_loss: 0.0312507 | Time: 6062.56 ms
[2020-12-18 11:44:24 main:574] : INFO : Epoch 17 | loss: 0.031251 | val_loss: 0.0312519 | Time: 5400.75 ms
[2020-12-18 11:44:30 main:574] : INFO : Epoch 18 | loss: 0.0312513 | val_loss: 0.0312529 | Time: 5667.12 ms
[2020-12-18 11:44:36 main:574] : INFO : Epoch 19 | loss: 0.0312525 | val_loss: 0.0312512 | Time: 5788.51 ms
[2020-12-18 11:44:41 main:574] : INFO : Epoch 20 | loss: 0.0312514 | val_loss: 0.0312515 | Time: 5545.32 ms
[2020-12-18 11:44:48 main:574] : INFO : Epoch 21 | loss: 0.0312513 | val_loss: 0.0312512 | Time: 6871.07 ms
[2020-12-18 11:44:54 main:574] : INFO : Epoch 22 | loss: 0.0312517 | val_loss: 0.0312504 | Time: 5520.83 ms
[2020-12-18 11:44:59 main:574] : INFO : Epoch 23 | loss: 0.0312517 | val_loss: 0.0312507 | Time: 5855.29 ms
[2020-12-18 11:45:05 main:574] : INFO : Epoch 24 | loss: 0.0312514 | val_loss: 0.0312518 | Time: 5600.86 ms
[2020-12-18 11:45:11 main:574] : INFO : Epoch 25 | loss: 0.0312511 | val_loss: 0.031251 | Time: 5574.65 ms
[2020-12-18 11:45:17 main:574] : INFO : Epoch 26 | loss: 0.0312513 | val_loss: 0.0312519 | Time: 6042.55 ms
[2020-12-18 11:45:23 main:574] : INFO : Epoch 27 | loss: 0.0312514 | val_loss: 0.0312509 | Time: 6076.2 ms
[2020-12-18 11:45:29 main:574] : INFO : Epoch 28 | loss: 0.0312506 | val_loss: 0.0312511 | Time: 6185 ms
[2020-12-18 11:45:34 main:574] : INFO : Epoch 29 | loss: 0.0312514 | val_loss: 0.0312515 | Time: 5449.22 ms
[2020-12-18 11:45:40 main:574] : INFO : Epoch 30 | loss: 0.0312511 | val_loss: 0.0312516 | Time: 5621.83 ms
[2020-12-18 11:45:46 main:574] : INFO : Epoch 31 | loss: 0.0312516 | val_loss: 0.0312506 | Time: 5993.4 ms
[2020-12-18 11:45:52 main:574] : INFO : Epoch 32 | loss: 0.0312511 | val_loss: 0.0312528 | Time: 5614.41 ms
[2020-12-18 11:45:58 main:574] : INFO : Epoch 33 | loss: 0.0312517 | val_loss: 0.0312501 | Time: 5927.54 ms
[2020-12-18 11:46:03 main:574] : INFO : Epoch 34 | loss: 0.031251 | val_loss: 0.0312508 | Time: 5403.4 ms
[2020-12-18 11:46:09 main:574] : INFO : Epoch 35 | loss: 0.0312517 | val_loss: 0.0312533 | Time: 6032.7 ms
[2020-12-18 11:46:15 main:574] : INFO : Epoch 36 | loss: 0.0312504 | val_loss: 0.0312505 | Time: 5508.56 ms
[2020-12-18 11:46:20 main:574] : INFO : Epoch 37 | loss: 0.0312503 | val_loss: 0.0312502 | Time: 5889.46 ms
[2020-12-18 11:46:27 main:574] : INFO : Epoch 38 | loss: 0.0312503 | val_loss: 0.0312505 | Time: 6092.2 ms
[2020-12-18 11:46:32 main:574] : INFO : Epoch 39 | loss: 0.0312503 | val_loss: 0.03125 | Time: 5488.92 ms
[2020-12-18 11:46:38 main:574] : INFO : Epoch 40 | loss: 0.03125 | val_loss: 0.0312509 | Time: 6220.54 ms
[2020-12-18 11:46:44 main:574] : INFO : Epoch 41 | loss: 0.031251 | val_loss: 0.0312519 | Time: 5736.09 ms
[2020-12-18 11:46:50 main:574] : INFO : Epoch 42 | loss: 0.0312521 | val_loss: 0.0312501 | Time: 5723.22 ms
[2020-12-18 11:46:56 main:574] : INFO : Epoch 43 | loss: 0.0312497 | val_loss: 0.0312496 | Time: 5710.44 ms
[2020-12-18 11:47:01 main:574] : INFO : Epoch 44 | loss: 0.0312494 | val_loss: 0.0312506 | Time: 5457.41 ms
[2020-12-18 11:47:07 main:574] : INFO : Epoch 45 | loss: 0.0312494 | val_loss: 0.0312481 | Time: 5827.57 ms
[2020-12-18 11:47:13 main:574] : INFO : Epoch 46 | loss: 0.031248 | val_loss: 0.0312485 | Time: 5648.73 ms
[2020-12-18 11:47:19 main:574] : INFO : Epoch 47 | loss: 0.0312484 | val_loss: 0.0312489 | Time: 6029.81 ms
[2020-12-18 11:47:24 main:574] : INFO : Epoch 48 | loss: 0.0312477 | val_loss: 0.0312469 | Time: 5496.48 ms
[2020-12-18 11:47:30 main:574] : INFO : Epoch 49 | loss: 0.0312471 | val_loss: 0.0312462 | Time: 5957.29 ms
[2020-12-18 11:47:36 main:574] : INFO : Epoch 50 | loss: 0.0312475 | val_loss: 0.0312446 | Time: 5952.94 ms
[2020-12-18 11:47:41 main:574] : INFO : Epoch 51 | loss: 0.0312433 | val_loss: 0.0312446 | Time: 5427.21 ms
[2020-12-18 11:47:47 main:574] : INFO : Epoch 52 | loss: 0.0312486 | val_loss: 0.0312473 | Time: 5960.85 ms
[2020-12-18 11:47:53 main:574] : INFO : Epoch 53 | loss: 0.0312484 | val_loss: 0.0312423 | Time: 5450.45 ms
[2020-12-18 11:47:59 main:574] : INFO : Epoch 54 | loss: 0.0312491 | val_loss: 0.0312508 | Time: 6112.68 ms
[2020-12-18 11:48:04 main:574] : INFO : Epoch 55 | loss: 0.0312435 | val_loss: 0.0312375 | Time: 5376.71 ms
[2020-12-18 11:48:10 main:574] : INFO : Epoch 56 | loss: 0.0312395 | val_loss: 0.0312362 | Time: 5490.67 ms
[2020-12-18 11:48:16 main:574] : INFO : Epoch 57 | loss: 0.031241 | val_loss: 0.0312313 | Time: 5689.63 ms
[2020-12-18 11:48:21 main:574] : INFO : Epoch 58 | loss: 0.031231 | val_loss: 0.0312265 | Time: 5368.22 ms
[2020-12-18 11:48:27 main:574] : INFO : Epoch 59 | loss: 0.0312417 | val_loss: 0.0312361 | Time: 5891.86 ms
[2020-12-18 11:48:32 main:574] : INFO : Epoch 60 | loss: 0.031232 | val_loss: 0.031224 | Time: 5488.03 ms
[2020-12-18 11:48:38 main:574] : INFO : Epoch 61 | loss: 0.0312262 | val_loss: 0.031223 | Time: 5756.25 ms
[2020-12-18 11:48:44 main:574] : INFO : Epoch 62 | loss: 0.0312151 | val_loss: 0.0312112 | Time: 5421.58 ms
[2020-12-18 11:48:49 main:574] : INFO : Epoch 63 | loss: 0.0312322 | val_loss: 0.0312609 | Time: 5765.09 ms
[2020-12-18 11:48:55 main:574] : INFO : Epoch 64 | loss: 0.0312236 | val_loss: 0.0312083 | Time: 5474.11 ms
[2020-12-18 11:49:00 main:574] : INFO : Epoch 65 | loss: 0.0312035 | val_loss: 0.0311946 | Time: 5603.47 ms
[2020-12-18 11:49:06 main:574] : INFO : Epoch 66 | loss: 0.0311964 | val_loss: 0.0311869 | Time: 5877.31 ms
[2020-12-18 11:49:12 main:574] : INFO : Epoch 67 | loss: 0.0311902 | val_loss: 0.0312067 | Time: 5501.18 ms
[2020-12-18 11:49:18 main:574] : INFO : Epoch 68 | loss: 0.0311944 | val_loss: 0.0311808 | Time: 6050.36 ms
[2020-12-18 11:49:24 main:574] : INFO : Epoch 69 | loss: 0.0311869 | val_loss: 0.0311829 | Time: 5766.91 ms
[2020-12-18 11:49:29 main:574] : INFO : Epoch 70 | loss: 0.0311821 | val_loss: 0.0311779 | Time: 5653.77 ms
[2020-12-18 11:49:35 main:574] : INFO : Epoch 71 | loss: 0.0311886 | val_loss: 0.0311887 | Time: 5461.42 ms
[2020-12-18 11:49:40 main:574] : INFO : Epoch 72 | loss: 0.0311892 | val_loss: 0.0311796 | Time: 5459.66 ms
[2020-12-18 11:49:46 main:574] : INFO : Epoch 73 | loss: 0.0311886 | val_loss: 0.0311845 | Time: 5703.41 ms
[2020-12-18 11:49:52 main:574] : INFO : Epoch 74 | loss: 0.0311775 | val_loss: 0.031176 | Time: 5683.19 ms
[2020-12-18 11:49:58 main:574] : INFO : Epoch 75 | loss: 0.0311794 | val_loss: 0.0311802 | Time: 6169.24 ms
[2020-12-18 11:50:03 main:574] : INFO : Epoch 76 | loss: 0.0311767 | val_loss: 0.031174 | Time: 5451.32 ms
[2020-12-18 11:50:09 main:574] : INFO : Epoch 77 | loss: 0.0311759 | val_loss: 0.0311866 | Time: 5865.53 ms
[2020-12-18 11:50:15 main:574] : INFO : Epoch 78 | loss: 0.0311825 | val_loss: 0.0311742 | Time: 5788.62 ms
[2020-12-18 11:50:20 main:574] : INFO : Epoch 79 | loss: 0.0311829 | val_loss: 0.0311791 | Time: 5432.19 ms
[2020-12-18 11:50:26 main:574] : INFO : Epoch 80 | loss: 0.0311845 | val_loss: 0.0311763 | Time: 5980.45 ms
[2020-12-18 11:50:32 main:574] : INFO : Epoch 81 | loss: 0.0311793 | val_loss: 0.031186 | Time: 5387.52 ms
[2020-12-18 11:50:38 main:574] : INFO : Epoch 82 | loss: 0.0311744 | val_loss: 0.0311749 | Time: 5968.11 ms
[2020-12-18 11:50:43 main:574] : INFO : Epoch 83 | loss: 0.0311758 | val_loss: 0.0311739 | Time: 5471.21 ms
[2020-12-18 11:50:49 main:574] : INFO : Epoch 84 | loss: 0.0311728 | val_loss: 0.0311777 | Time: 5876.04 ms
[2020-12-18 11:50:55 main:574] : INFO : Epoch 85 | loss: 0.0311729 | val_loss: 0.0311764 | Time: 5382.68 ms
[2020-12-18 11:51:01 main:574] : INFO : Epoch 86 | loss: 0.0311729 | val_loss: 0.0311901 | Time: 6309.68 ms
[2020-12-18 11:51:10 main:574] : INFO : Epoch 87 | loss: 0.0311738 | val_loss: 0.0311846 | Time: 8890.17 ms
[2020-12-18 11:51:16 main:574] : INFO : Epoch 88 | loss: 0.0311734 | val_loss: 0.031174 | Time: 6350.46 ms
[2020-12-18 11:51:22 main:574] : INFO : Epoch 89 | loss: 0.0311718 | val_loss: 0.0311789 | Time: 6326.76 ms
[2020-12-18 11:51:31 main:574] : INFO : Epoch 90 | loss: 0.0311726 | val_loss: 0.0311775 | Time: 8156.5 ms
[2020-12-18 11:51:37 main:574] : INFO : Epoch 91 | loss: 0.031176 | val_loss: 0.0311834 | Time: 6100.94 ms
[2020-12-18 11:51:42 main:574] : INFO : Epoch 92 | loss: 0.0311761 | val_loss: 0.0311848 | Time: 5622.5 ms
[2020-12-18 11:51:48 main:574] : INFO : Epoch 93 | loss: 0.031175 | val_loss: 0.0311739 | Time: 5765.15 ms
[2020-12-18 11:51:54 main:574] : INFO : Epoch 94 | loss: 0.0311705 | val_loss: 0.031174 | Time: 5816.83 ms
[2020-12-18 11:52:00 main:574] : INFO : Epoch 95 | loss: 0.0311792 | val_loss: 0.0311795 | Time: 5754.58 ms
[2020-12-18 11:52:05 main:574] : INFO : Epoch 96 | loss: 0.031175 | val_loss: 0.0311753 | Time: 5664.3 ms
[2020-12-18 11:52:11 main:574] : INFO : Epoch 97 | loss: 0.0311686 | val_loss: 0.0311739 | Time: 5790.85 ms
[2020-12-18 11:52:17 main:574] : INFO : Epoch 98 | loss: 0.0311724 | val_loss: 0.03118 | Time: 5984.12 ms
[2020-12-18 11:52:23 main:574] : INFO : Epoch 99 | loss: 0.0311695 | val_loss: 0.0311751 | Time: 5666.55 ms
[2020-12-18 11:52:29 main:574] : INFO : Epoch 100 | loss: 0.0311672 | val_loss: 0.0311794 | Time: 6261.77 ms
[2020-12-18 11:52:35 main:574] : INFO : Epoch 101 | loss: 0.0311708 | val_loss: 0.0311743 | Time: 6225.78 ms
[2020-12-18 11:52:41 main:574] : INFO : Epoch 102 | loss: 0.0311669 | val_loss: 0.031177 | Time: 5811.42 ms
[2020-12-18 11:52:47 main:574] : INFO : Epoch 103 | loss: 0.0311695 | val_loss: 0.0311777 | Time: 5978.66 ms
[2020-12-18 11:52:53 main:574] : INFO : Epoch 104 | loss: 0.0311689 | val_loss: 0.0311755 | Time: 5607.98 ms
[2020-12-18 11:52:59 main:574] : INFO : Epoch 105 | loss: 0.0311676 | val_loss: 0.0311759 | Time: 6207.67 ms
[2020-12-18 11:53:05 main:574] : INFO : Epoch 106 | loss: 0.0311653 | val_loss: 0.0311743 | Time: 5716.04 ms
[2020-12-18 11:53:11 main:574] : INFO : Epoch 107 | loss: 0.0311681 | val_loss: 0.0311855 | Time: 5834.62 ms
[2020-12-18 11:53:17 main:574] : INFO : Epoch 108 | loss: 0.0311663 | val_loss: 0.0311763 | Time: 6103.2 ms
[2020-12-18 11:53:23 main:574] : INFO : Epoch 109 | loss: 0.0311635 | val_loss: 0.0311772 | Time: 5925.34 ms
[2020-12-18 11:53:29 main:574] : INFO : Epoch 110 | loss: 0.0311667 | val_loss: 0.0311869 | Time: 5938 ms
[2020-12-18 11:53:35 main:574] : INFO : Epoch 111 | loss: 0.0311649 | val_loss: 0.0311723 | Time: 5994.3 ms
[2020-12-18 11:53:41 main:574] : INFO : Epoch 112 | loss: 0.0311635 | val_loss: 0.0311834 | Time: 6052.2 ms
[2020-12-18 11:53:47 main:574] : INFO : Epoch 113 | loss: 0.0311651 | val_loss: 0.0311717 | Time: 6883.34 ms
[2020-12-18 11:53:53 main:574] : INFO : Epoch 114 | loss: 0.0311645 | val_loss: 0.0311712 | Time: 5579.15 ms
[2020-12-18 11:53:59 main:574] : INFO : Epoch 115 | loss: 0.0311635 | val_loss: 0.0311756 | Time: 5872.81 ms
[2020-12-18 11:54:05 main:574] : INFO : Epoch 116 | loss: 0.031163 | val_loss: 0.0311681 | Time: 5598.45 ms
[2020-12-18 11:54:10 main:574] : INFO : Epoch 117 | loss: 0.0311634 | val_loss: 0.0311922 | Time: 5629.35 ms
[2020-12-18 11:54:16 main:574] : INFO : Epoch 118 | loss: 0.031167 | val_loss: 0.0311734 | Time: 6006.83 ms
[2020-12-18 11:54:22 main:574] : INFO : Epoch 119 | loss: 0.0311606 | val_loss: 0.0311713 | Time: 5626.6 ms
[2020-12-18 11:54:28 main:574] : INFO : Epoch 120 | loss: 0.0311596 | val_loss: 0.0311676 | Time: 5851.11 ms
[2020-12-18 11:54:33 main:574] : INFO : Epoch 121 | loss: 0.0311591 | val_loss: 0.0311714 | Time: 5593.58 ms
[2020-12-18 11:54:39 main:574] : INFO : Epoch 122 | loss: 0.0311591 | val_loss: 0.0311704 | Time: 5852.63 ms
[2020-12-18 11:54:45 main:574] : INFO : Epoch 123 | loss: 0.0311576 | val_loss: 0.031173 | Time: 5896.46 ms
[2020-12-18 11:54:51 main:574] : INFO : Epoch 124 | loss: 0.0311598 | val_loss: 0.0311691 | Time: 5669.77 ms
[2020-12-18 11:54:57 main:574] : INFO : Epoch 125 | loss: 0.0311594 | val_loss: 0.0311704 | Time: 5920.17 ms
[2020-12-18 11:55:02 main:574] : INFO : Epoch 126 | loss: 0.0311566 | val_loss: 0.0311831 | Time: 5593 ms
[2020-12-18 11:55:08 main:574] : INFO : Epoch 127 | loss: 0.0311581 | val_loss: 0.0311691 | Time: 5699.25 ms
[2020-12-18 11:55:13 main:574] : INFO : Epoch 128 | loss: 0.0311548 | val_loss: 0.0311676 | Time: 5439.79 ms
[2020-12-18 11:55:19 main:574] : INFO : Epoch 129 | loss: 0.0311565 | val_loss: 0.0311713 | Time: 5772.46 ms
[2020-12-18 11:55:25 main:574] : INFO : Epoch 130 | loss: 0.0311566 | val_loss: 0.0311739 | Time: 5887.74 ms
[2020-12-18 11:55:31 main:574] : INFO : Epoch 131 | loss: 0.0311606 | val_loss: 0.0311663 | Time: 5867.43 ms
[2020-12-18 11:55:37 main:574] : INFO : Epoch 132 | loss: 0.0311552 | val_loss: 0.0311724 | Time: 6347.38 ms
[2020-12-18 11:55:43 main:574] : INFO : Epoch 133 | loss: 0.0311552 | val_loss: 0.031172 | Time: 6023.42 ms
[2020-12-18 11:55:49 main:574] : INFO : Epoch 134 | loss: 0.0311556 | val_loss: 0.0311688 | Time: 6031.77 ms
[2020-12-18 11:55:55 main:574] : INFO : Epoch 135 | loss: 0.0311513 | val_loss: 0.0311689 | Time: 5976.35 ms
[2020-12-18 11:56:01 main:574] : INFO : Epoch 136 | loss: 0.0311531 | val_loss: 0.0311686 | Time: 5864.22 ms
[2020-12-18 11:56:08 main:574] : INFO : Epoch 137 | loss: 0.0311523 | val_loss: 0.0311762 | Time: 6359.22 ms
[2020-12-18 11:56:13 main:574] : INFO : Epoch 138 | loss: 0.0311554 | val_loss: 0.0311746 | Time: 5794.5 ms
[2020-12-18 11:56:20 main:574] : INFO : Epoch 139 | loss: 0.0311508 | val_loss: 0.031168 | Time: 6191.39 ms
[2020-12-18 11:56:26 main:574] : INFO : Epoch 140 | loss: 0.0311476 | val_loss: 0.0311685 | Time: 5941.37 ms
[2020-12-18 11:56:31 main:574] : INFO : Epoch 141 | loss: 0.0311518 | val_loss: 0.0311671 | Time: 5928.8 ms
[2020-12-18 11:56:38 main:574] : INFO : Epoch 142 | loss: 0.0311478 | val_loss: 0.031171 | Time: 6292.3 ms
[2020-12-18 11:56:44 main:574] : INFO : Epoch 143 | loss: 0.0311476 | val_loss: 0.0311664 | Time: 5870.86 ms
[2020-12-18 11:56:50 main:574] : INFO : Epoch 144 | loss: 0.0311503 | val_loss: 0.0311752 | Time: 5950.81 ms
[2020-12-18 11:56:56 main:574] : INFO : Epoch 145 | loss: 0.0311568 | val_loss: 0.0311666 | Time: 5986.1 ms
[2020-12-18 11:57:01 main:574] : INFO : Epoch 146 | loss: 0.0311501 | val_loss: 0.0311705 | Time: 5741.51 ms
[2020-12-18 11:57:08 main:574] : INFO : Epoch 147 | loss: 0.0311462 | val_loss: 0.0311677 | Time: 6291.66 ms
[2020-12-18 11:57:13 main:574] : INFO : Epoch 148 | loss: 0.0311521 | val_loss: 0.0311768 | Time: 5701.55 ms
[2020-12-18 11:57:19 main:574] : INFO : Epoch 149 | loss: 0.0311496 | val_loss: 0.0311901 | Time: 6116.59 ms
[2020-12-18 11:57:25 main:574] : INFO : Epoch 150 | loss: 0.031159 | val_loss: 0.0311757 | Time: 5904.65 ms
[2020-12-18 11:57:31 main:574] : INFO : Epoch 151 | loss: 0.0311494 | val_loss: 0.0311724 | Time: 5736.25 ms
[2020-12-18 11:57:37 main:574] : INFO : Epoch 152 | loss: 0.0311452 | val_loss: 0.0311723 | Time: 6252.39 ms
[2020-12-18 11:57:43 main:574] : INFO : Epoch 153 | loss: 0.0311437 | val_loss: 0.0311753 | Time: 5561.17 ms
[2020-12-18 11:57:49 main:574] : INFO : Epoch 154 | loss: 0.0311433 | val_loss: 0.0311664 | Time: 5890.96 ms
[2020-12-18 11:57:55 main:574] : INFO : Epoch 155 | loss: 0.0311415 | val_loss: 0.0311717 | Time: 5831.79 ms
[2020-12-18 11:58:01 main:574] : INFO : Epoch 156 | loss: 0.0311417 | val_loss: 0.0311746 | Time: 6097.01 ms
[2020-12-18 11:58:07 main:574] : INFO : Epoch 157 | loss: 0.0311463 | val_loss: 0.0311715 | Time: 6387.73 ms
[2020-12-18 11:58:13 main:574] : INFO : Epoch 158 | loss: 0.0311403 | val_loss: 0.0311699 | Time: 5790.25 ms
[2020-12-18 11:58:19 main:574] : INFO : Epoch 159 | loss: 0.031142 | val_loss: 0.0311763 | Time: 6273.88 ms
[2020-12-18 11:58:25 main:574] : INFO : Epoch 160 | loss: 0.031143 | val_loss: 0.0311698 | Time: 5867.19 ms
[2020-12-18 11:58:31 main:574] : INFO : Epoch 161 | loss: 0.0311428 | val_loss: 0.0311762 | Time: 6116.1 ms
[2020-12-18 11:58:37 main:574] : INFO : Epoch 162 | loss: 0.0311418 | val_loss: 0.0311703 | Time: 6283.41 ms
[2020-12-18 11:58:43 main:574] : INFO : Epoch 163 | loss: 0.0311382 | val_loss: 0.0311722 | Time: 5720.64 ms
[2020-12-18 11:58:49 main:574] : INFO : Epoch 164 | loss: 0.0311402 | val_loss: 0.0311885 | Time: 6117.63 ms
[2020-12-18 11:58:55 main:574] : INFO : Epoch 165 | loss: 0.0311448 | val_loss: 0.0311691 | Time: 5886.33 ms
[2020-12-18 11:59:01 main:574] : INFO : Epoch 166 | loss: 0.0311406 | val_loss: 0.0311729 | Time: 5791.5 ms
[2020-12-18 11:59:07 main:574] : INFO : Epoch 167 | loss: 0.0311363 | val_loss: 0.0311724 | Time: 6326.66 ms
[2020-12-18 11:59:13 main:574] : INFO : Epoch 168 | loss: 0.0311352 | val_loss: 0.03117 | Time: 5747.49 ms
[2020-12-18 11:59:19 main:574] : INFO : Epoch 169 | loss: 0.0311355 | val_loss: 0.0311745 | Time: 6185.59 ms
[2020-12-18 11:59:25 main:574] : INFO : Epoch 170 | loss: 0.0311374 | val_loss: 0.0311879 | Time: 5914.86 ms
[2020-12-18 11:59:31 main:574] : INFO : Epoch 171 | loss: 0.0311476 | val_loss: 0.0311733 | Time: 5799.95 ms
[2020-12-18 11:59:37 main:574] : INFO : Epoch 172 | loss: 0.0311432 | val_loss: 0.0311814 | Time: 6310.28 ms
[2020-12-18 11:59:43 main:574] : INFO : Epoch 173 | loss: 0.0311345 | val_loss: 0.0311702 | Time: 5783.84 ms
[2020-12-18 11:59:49 main:574] : INFO : Epoch 174 | loss: 0.0311339 | val_loss: 0.031172 | Time: 6176.27 ms
[2020-12-18 11:59:55 main:574] : INFO : Epoch 175 | loss: 0.0311332 | val_loss: 0.0311675 | Time: 5926.28 ms
[2020-12-18 12:00:02 main:574] : INFO : Epoch 176 | loss: 0.0311297 | val_loss: 0.0311726 | Time: 6322.56 ms
[2020-12-18 12:00:07 main:574] : INFO : Epoch 177 | loss: 0.0311299 | val_loss: 0.0311796 | Time: 5723.12 ms
[2020-12-18 12:00:13 main:574] : INFO : Epoch 178 | loss: 0.0311343 | val_loss: 0.0311686 | Time: 5389.58 ms
[2020-12-18 12:00:19 main:574] : INFO : Epoch 179 | loss: 0.0311344 | val_loss: 0.0311738 | Time: 6236.8 ms
[2020-12-18 12:00:25 main:574] : INFO : Epoch 180 | loss: 0.0311325 | val_loss: 0.0311689 | Time: 5897.67 ms
[2020-12-18 12:00:31 main:574] : INFO : Epoch 181 | loss: 0.0311282 | val_loss: 0.0311752 | Time: 5850.35 ms
[2020-12-18 12:00:37 main:574] : INFO : Epoch 182 | loss: 0.0311272 | val_loss: 0.031171 | Time: 6329.28 ms
[2020-12-18 12:00:43 main:574] : INFO : Epoch 183 | loss: 0.0311302 | val_loss: 0.0311756 | Time: 5670.06 ms
[2020-12-18 12:00:49 main:574] : INFO : Epoch 184 | loss: 0.0311291 | val_loss: 0.0311756 | Time: 6381.84 ms
[2020-12-18 12:00:55 main:574] : INFO : Epoch 185 | loss: 0.0311351 | val_loss: 0.0311799 | Time: 5925.65 ms
[2020-12-18 12:01:02 main:574] : INFO : Epoch 186 | loss: 0.03113 | val_loss: 0.0311702 | Time: 6556.63 ms
[2020-12-18 12:01:09 main:574] : INFO : Epoch 187 | loss: 0.0311255 | val_loss: 0.0311749 | Time: 7529.81 ms
[2020-12-18 12:01:15 main:574] : INFO : Epoch 188 | loss: 0.0311232 | val_loss: 0.0311689 | Time: 5928.31 ms
[2020-12-18 12:01:21 main:574] : INFO : Epoch 189 | loss: 0.0311264 | val_loss: 0.0311735 | Time: 5922.31 ms
[2020-12-18 12:01:28 main:574] : INFO : Epoch 190 | loss: 0.0311235 | val_loss: 0.0311717 | Time: 7490.84 ms
[2020-12-18 12:01:35 main:574] : INFO : Epoch 191 | loss: 0.0311227 | val_loss: 0.0311743 | Time: 6573.21 ms
[2020-12-18 12:01:41 main:574] : INFO : Epoch 192 | loss: 0.0311223 | val_loss: 0.0311727 | Time: 5758.51 ms
[2020-12-18 12:01:47 main:574] : INFO : Epoch 193 | loss: 0.0311244 | val_loss: 0.0311761 | Time: 6326.16 ms
[2020-12-18 12:01:53 main:574] : INFO : Epoch 194 | loss: 0.0311209 | val_loss: 0.0311771 | Time: 5766.31 ms
[2020-12-18 12:01:59 main:574] : INFO : Epoch 195 | loss: 0.0311238 | val_loss: 0.0311835 | Time: 6336.09 ms
[2020-12-18 12:02:05 main:574] : INFO : Epoch 196 | loss: 0.0311235 | val_loss: 0.0311761 | Time: 5907.49 ms
[2020-12-18 12:02:11 main:574] : INFO : Epoch 197 | loss: 0.0311215 | val_loss: 0.031176 | Time: 5780.7 ms
[2020-12-18 12:02:17 main:574] : INFO : Epoch 198 | loss: 0.0311205 | val_loss: 0.0311714 | Time: 6263.17 ms
[2020-12-18 12:02:23 main:574] : INFO : Epoch 199 | loss: 0.0311199 | val_loss: 0.0311712 | Time: 5321.94 ms
[2020-12-18 12:02:29 main:574] : INFO : Epoch 200 | loss: 0.03112 | val_loss: 0.0311649 | Time: 6358.51 ms
[2020-12-18 12:02:35 main:574] : INFO : Epoch 201 | loss: 0.0311215 | val_loss: 0.0311641 | Time: 5846.6 ms
[2020-12-18 12:02:41 main:574] : INFO : Epoch 202 | loss: 0.0311174 | val_loss: 0.0311787 | Time: 6027.2 ms
[2020-12-18 12:02:47 main:574] : INFO : Epoch 203 | loss: 0.0311177 | val_loss: 0.0311731 | Time: 6308.96 ms
[2020-12-18 12:02:53 main:574] : INFO : Epoch 204 | loss: 0.031119 | val_loss: 0.0311674 | Time: 5690.55 ms
[2020-12-18 12:02:59 main:574] : INFO : Epoch 205 | loss: 0.0311175 | val_loss: 0.0311707 | Time: 6305.42 ms
[2020-12-18 12:03:05 main:574] : INFO : Epoch 206 | loss: 0.0311157 | val_loss: 0.031184 | Time: 6208.52 ms
[2020-12-18 12:03:11 main:574] : INFO : Epoch 207 | loss: 0.0311196 | val_loss: 0.0311804 | Time: 5819.79 ms
[2020-12-18 12:03:18 main:574] : INFO : Epoch 208 | loss: 0.0311165 | val_loss: 0.0311755 | Time: 6410.21 ms
[2020-12-18 12:03:23 main:574] : INFO : Epoch 209 | loss: 0.0311185 | val_loss: 0.0311729 | Time: 5858.82 ms
[2020-12-18 12:03:30 main:574] : INFO : Epoch 210 | loss: 0.0311178 | val_loss: 0.0311822 | Time: 6099.53 ms
[2020-12-18 12:03:36 main:574] : INFO : Epoch 211 | loss: 0.0311173 | val_loss: 0.0311814 | Time: 6538.8 ms
[2020-12-18 12:03:42 main:574] : INFO : Epoch 212 | loss: 0.0311145 | val_loss: 0.0311772 | Time: 6023.25 ms
[2020-12-18 12:03:48 main:574] : INFO : Epoch 213 | loss: 0.0311154 | val_loss: 0.0311791 | Time: 6349.34 ms
[2020-12-18 12:03:54 main:574] : INFO : Epoch 214 | loss: 0.0311152 | val_loss: 0.0311812 | Time: 5738.94 ms
[2020-12-18 12:04:00 main:574] : INFO : Epoch 215 | loss: 0.0311111 | val_loss: 0.0311869 | Time: 5889.99 ms
[2020-12-18 12:04:06 main:574] : INFO : Epoch 216 | loss: 0.031113 | val_loss: 0.0311816 | Time: 6294.78 ms
[2020-12-18 12:04:12 main:574] : INFO : Epoch 217 | loss: 0.0311132 | val_loss: 0.0311812 | Time: 5926.24 ms
[2020-12-18 12:04:19 main:574] : INFO : Epoch 218 | loss: 0.0311144 | val_loss: 0.0311771 | Time: 6237.78 ms
[2020-12-18 12:04:24 main:574] : INFO : Epoch 219 | loss: 0.0311155 | val_loss: 0.0311928 | Time: 5682.92 ms
[2020-12-18 12:04:30 main:574] : INFO : Epoch 220 | loss: 0.0311129 | val_loss: 0.0311805 | Time: 6130.82 ms
[2020-12-18 12:04:37 main:574] : INFO : Epoch 221 | loss: 0.0311116 | val_loss: 0.031179 | Time: 6382.11 ms
[2020-12-18 12:04:43 main:574] : INFO : Epoch 222 | loss: 0.0311133 | val_loss: 0.0311723 | Time: 5893.68 ms
[2020-12-18 12:04:49 main:574] : INFO : Epoch 223 | loss: 0.0311112 | val_loss: 0.0311721 | Time: 5821.89 ms
[2020-12-18 12:04:54 main:574] : INFO : Epoch 224 | loss: 0.0311084 | val_loss: 0.0311829 | Time: 5715.45 ms
[2020-12-18 12:05:00 main:574] : INFO : Epoch 225 | loss: 0.031109 | val_loss: 0.0311953 | Time: 5841.59 ms
[2020-12-18 12:05:06 main:574] : INFO : Epoch 226 | loss: 0.0311109 | val_loss: 0.031185 | Time: 6363.59 ms
[2020-12-18 12:05:12 main:574] : INFO : Epoch 227 | loss: 0.031107 | val_loss: 0.0311843 | Time: 5883.1 ms
THCudaCheck FAIL file=..\..\aten\src\THC\THCCachingHostAllocator.cpp line=278 error=719 : unspecified launch failure
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF84805D759
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 12/18/20 12:05:18
Install Directory : C:\Program Files\BOINC\
Data Directory : D:\Program Files\BOINC\Data
Project Symstore :
LoadLibraryA( D:\Program Files\BOINC\Data\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( D:\Program Files\BOINC\Data\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Program Files\BOINC\Data\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Program Files\BOINC\Data\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: D:\Program Files\BOINC\Data\slots\3;D:\Program Files\BOINC\Data\projects\www.mlcathome.org_mlcathome
ModLoad: 000000001d8c0000 00000000003df000 D:\Program Files\BOINC\Data\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000004a550000 00000000001f6000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.662
ModLoad: 00000000491f0000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.662
ModLoad: 0000000048030000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.662
ModLoad: 0000000049ae0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000047c90000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 0000000048940000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.685 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.685
ModLoad: 0000000048400000 0000000000109000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.685 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.685
ModLoad: 0000000048510000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000048300000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000049c80000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000048fa0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000485b0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000004a3e0000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000025e10000 0000000000058000 D:\Program Files\BOINC\Data\slots\3\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000037380000 0000000000091000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 0000000035d00000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.488) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.488 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.488
ModLoad: 0000000037360000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 0000000037350000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 000000008f500000 000000000abe7000 D:\Program Files\BOINC\Data\slots\3\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ea320000 000000000020d000 D:\Program Files\BOINC\Data\slots\3\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000e9ce0000 00000000002db000 D:\Program Files\BOINC\Data\slots\3\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000043840000 0000000000040000 D:\Program Files\BOINC\Data\slots\3\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000006a9b0000 0000000024b49000 D:\Program Files\BOINC\Data\slots\3\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000224e0000 0000000000045000 D:\Program Files\BOINC\Data\slots\3\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000674f0000 00000000034b2000 D:\Program Files\BOINC\Data\slots\3\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000036210000 0000000000010000 D:\Program Files\BOINC\Data\slots\3\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000064440000 00000000030a5000 D:\Program Files\BOINC\Data\slots\3\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 000000005b2a0000 000000000919f000 D:\Program Files\BOINC\Data\slots\3\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 0000000053300000 0000000003d5b000 D:\Program Files\BOINC\Data\slots\3\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000009aa60000 0000000001eca000 D:\Program Files\BOINC\Data\slots\3\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000002ace0000 000000001b3a4000 D:\Program Files\BOINC\Data\slots\3\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 0000000048650000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000045be0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000489d0000 0000000000467000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000047d20000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000047ea0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 00000000479d0000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000047cc0000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 0000000047ed0000 000000000015d000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000047810000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000049380000 0000000000742000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000045de0000 0000000000795000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000049f40000 0000000000356000 C:\WINDOWS\System32\combase.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000047630000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000048680000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000048970000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 00000000de4e0000 000000000029d000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.6079) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_74\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.6079
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.66 driver
Product Version : 27.21.14.6079
ModLoad: 0000000040860000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000c2050000 00000000015c2000 C:\WINDOWS\system32\DriverStore\FileRepository\nvsmi.inf_amd64_f2ca840f25accdca\nvcuda64.dll (27.21.14.6079) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_74\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.6079
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.66 driver
Product Version : 27.21.14.6079
ModLoad: 0000000048820000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 00000000408b0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000475a0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000045720000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000038360000 00000000006f0000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.6079) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_74\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.6079
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.6079
ModLoad: 0000000048e70000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000032d00000 0000000000009000 D:\Program Files\BOINC\Data\slots\3\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000005a2d0000 0000000000fca000 D:\Program Files\BOINC\Data\slots\3\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 0000000047e20000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3828, Write: 1208, Other 5742
- I/O Transfers Counters -
Read: 6477358, Write: 468469, Other 84768
- Paged Pool Usage -
QuotaPagedPoolUsage: 3544000, QuotaPeakPagedPoolUsage: 3544048
QuotaNonPagedPoolUsage: 49496, QuotaPeakNonPagedPoolUsage: 49896
- Virtual Memory Usage -
VirtualSize: -589275136, PeakVirtualSize: -80687104
- Pagefile Usage -
PagefileUsage: -589275136, PeakPagefileUsage: -589217792
- Working Set Size -
WorkingSetSize: 1666150400, PeakWorkingSetSize: 1668059136, PageFaultCount: 576709
*** Dump of thread ID 59620 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 272812512.000000, User Time: 7689687552.000000, Wait Time: 14696757.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF84805D759
- Registers -
rax=0000000000000000 rbx=00000000999762f0 rcx=0000000000000000 rdx=0000000000000000 rsi=0000000057573f60 rdi=0000000019930520
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000006000 r13=0000000000000000
r14=0000000057574ca0 r15=0000000057574c20 rip=000000004805d759 rsp=0000000057573e00 rbp=0000000057574808
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
57573ed0 373661e0 e2a530e4 00000000 57574ca0 94aca014 KERNELBASE!RaiseException+0x0
57573f30 950c5272 e2a53084 00000000 000007cb 00000116 VCRUNTIME140!_CxxThrowException+0x0
57573f80 950c56d4 00000000 4a56786b 980ed290 6e215f68 torch_cpu!at::Tensor::zero_+0x0
575747e0 6d7d9ebe 57574a10 6e216850 6e216880 000002cf torch_cpu!_THError+0x0
57574820 6d7d5412 57574a10 57574970 61d54870 6e64a720 torch_cuda!__THCudaCheck+0x0
57574860 94d759ff 57574c00 57574a10 57574ee0 25e497b0 torch_cuda!at::native::set_storage_cuda_+0x0
57574bf0 94f1726f 6de4f630 94acea63 00000001 25e2ef8f torch_cpu!at::native::empty_cpu+0x0
57574c30 94ed0615 57570000 57574ca8 57574ea0 25e17ce6 torch_cpu!at::native::mkldnn_sigmoid_+0x0
57574c70 94ed204a 57570000 57574d00 61d39000 6cb16ae5 torch_cpu!at::native::mkldnn_sigmoid_+0x0
57574d00 94ed0615 00000000 94acea63 57574de0 57574ee0 torch_cpu!at::native::mkldnn_sigmoid_+0x0
57574d40 94fa1eb0 57570000 00000000 57574ec8 00000001 torch_cpu!at::native::mkldnn_sigmoid_+0x0
57574de0 94fb2eec 3fad0fa0 25e49c50 57574f40 25e13bd6 torch_cpu!at::bucketize_out+0x0
57574e30 6cedf160 57570000 00000000 57574f40 00000000 torch_cpu!at::empty+0x0
575751d0 6cee2de8 25e49c50 94ad0528 62c3d4a0 25e49c50 torch_cuda!at::native::cummin_helper_cuda+0x0
575753b0 6cee4379 575754c0 8fc62040 575758c0 8fc62058 torch_cuda!at::native::cummin_helper_cuda+0x0
575755f0 6cee3d64 57570000 575758c0 57575700 575758c0 torch_cuda!at::native::cat_out_cuda+0x0
575757f0 6d781dd2 57575848 00000001 57575848 575758c0 torch_cuda!at::native::cat_cuda+0x0
57575870 6d794179 00000001 575758b0 62c3c868 04000000 torch_cuda!at::native::set_storage_cuda_+0x0
575758b0 94fa1d7d 5bfebbb0 57575c20 57575bf0 00000000 torch_cuda!at::native::set_storage_cuda_+0x0
57575930 94f80d81 00000000 25e33994 57576100 8fc612a0 torch_cpu!at::bucketize_out+0x0
57575970 94d8b4a5 575759b0 62c3d0a0 57575a80 57575af0 torch_cpu!at::_cat+0x0
57575a40 950727bd 57575b10 00000101 57575a98 25e61ea8 torch_cpu!at::native::cat+0x0
57575ac0 94b329ae 8fc61fa0 8fc61fb0 8fc61fb8 57575a78 torch_cpu!at::zeros_out+0x0
57575b00 94fa1d7d 57575b40 57575bb0 00000000 4a565d21 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
57575b80 94fa75d1 57576120 99e20640 57576100 8fc612a0 torch_cpu!at::bucketize_out+0x0
57575bc0 94d97d4c 57575e50 00000000 57575e50 00000000 torch_cpu!at::cat+0x0
57575d80 9508c38d 57575dd8 00000001 57575dd8 57575e50 torch_cpu!at::native::stack+0x0
57575e00 94b329ae 57576100 8fc612a0 00000000 00000000 torch_cpu!at::zeros_out+0x0
57575e40 94fa1d7d 57575e80 57575ef0 00000000 97d41c8f torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
57575ec0 94ff02e1 57575ff0 25e33720 57576120 99e20640 torch_cpu!at::bucketize_out+0x0
57575f00 96383839 57575f80 62c3b010 62c3b010 57576010 torch_cpu!at::stack+0x0
575760d0 94b329ae 00000000 57576220 00000000 575761c0 torch_cpu!torch::autograd::GraphRoot::apply+0x0
57576110 94fa1d7d 57576150 575761c0 62c3e8f0 00000000 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
57576190 94ff02e1 57576300 94ac9cac 6079a1f0 8fc612a0 torch_cpu!at::bucketize_out+0x0
575761d0 1d8cff7e 57576298 600c4b70 600c4b70 575763e0 torch_cpu!at::stack+0x0
57576270 1d8d2ef8 1d8cfe30 575762b0 575762b0 57576300 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::addCallback+0x0
575762d0 1d8d3ea4 1b039ab0 4a565d21 57576470 612d0000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::getSlot+0x0
57576410 1d8cd3d2 609325c0 8fc6f010 57576470 4a5695f1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
57576440 1d8d4541 00000000 8fc761f0 60598dc0 4a5695f1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::operator=+0x0
575765f0 1d8d743a 575766c0 00000000 57577100 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
57576af0 1d8db950 57576bf0 57576bf0 00000000 2a155030 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
5758f890 1db1c6f8 62d2ba20 00000000 00000000 62d03bf0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
5758f8d0 49207034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
5758f900 4a59d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
5758f980 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 59256 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14696757.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=0000000057cff910 rsi=0000000000000000 rdi=0000000000000064
r8=0000000057cff8e8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000004a5ec634 rsp=0000000057cff8e8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
57cff8e0 4807d84e 57cff9a8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0
57cff980 1d8fa07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
57cff9b0 49207034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
57cff9e0 4a59d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
57cffa60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 62904 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14696756.000000
- Registers -
rax=000000000000005b rbx=000000000000000a rcx=000000000000000a rdx=0000000057dffaf0 rsi=0000000000000000 rdi=000000000000000a
r8=0000000057dff798 r9=0000000000000000 r10=0000000000000000 r11=0000000057dffa60 r12=0000000000000064 r13=0000000057dffaf0
r14=0000000057dff7f0 r15=0000000000000000 rip=000000004a5ecb04 rsp=0000000057dff798 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
57dff790 48080d40 00000000 57635000 4a6bb4d0 57635000 ntdll!NtWaitForMultipleObjects+0x0
57dffa80 48080c3e 612e01f0 004e0049 0000000a 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
57dffac0 c22066d4 62f96c90 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
57dffd00 c229e51d 00000000 62f918f0 00000000 00000000 nvcuda64!+0x0
57dffdb0 c22060a3 ab520e2f aa262168 63841590 00000000 nvcuda64!cuProfilerStop+0x0
57dffde0 c251d794 63841590 00000000 00000000 00000000 nvcuda64!+0x0
57dffe10 49207034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
57dffe40 4a59d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
57dffec0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 57480 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14609164.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000158 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000158
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000158 r15=0000000000000000 rip=000000004a5ec034 rsp=0000000057effb88 rbp=0000000062e95a40
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
57effb80 4804a34e 00000000 00000000 00000000 00000000 ntdll!NtWaitForSingleObject+0x0
57effc20 c241cd6e 63842430 48052cb5 00000000 00000158 KERNELBASE!WaitForSingleObjectEx+0x0
57effc90 c22060a3 62e95a40 6acbd240 63842430 00000000 nvcuda64!cuProfilerStop+0x0
57effcc0 c251d794 63842430 00000000 00000000 00000000 nvcuda64!+0x0
57effcf0 49207034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
57effd20 4a59d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
57effda0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 45404 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14696736.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000631362a8 rdx=0000000057fffa68 rsi=0000000057fff9d0 rdi=0000000000000000
r8=0000000000000001 r9=000000000000b15c r10=000000006313ae80 r11=00000000fcfb0977 r12=0000000057fffa68 r13=0000000000000000
r14=00000000631362a8 r15=000000006313ae80 rip=000000004a5ef9a4 rsp=0000000057fff9a8 rbp=0000000057fffa00
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
57fff9a0 4a5b54f5 00000102 c22d98fd 00000000 57fff9d0 ntdll!NtWaitForAlertByThreadId+0x0
57fffa10 4809b9d9 63138660 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
57fffa40 c2184a5c 63138660 63138660 63138660 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
57fffaa0 c22060a3 00000002 ab4eefa7 aa69b9ea 00000000 nvcuda64!+0x0
57fffad0 c251d794 63842670 00000000 00000000 00000000 nvcuda64!+0x0
57fffb00 49207034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
57fffb30 4a59d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
57fffbb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 44404 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 175156256.000000, User Time: 4932031488.000000, Wait Time: 14696738.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000592990b8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000592990b8
r8=00000000ffffffff r9=0000000000000000 r10=000000005bfdcb08 r11=00000000580fda10 r12=0000000000000000 r13=0000000000000000
r14=00000000580ff2a0 r15=0000000059299068 rip=000000004a5ef9a4 rsp=00000000580ff278 rbp=00000000580ff2d0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
580ff270 4a5b5281 600931d8 600931d8 580ff3b0 600931d8 ntdll!NtWaitForAlertByThreadId+0x0
580ff2f0 4809ba89 59299060 592990a8 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
580ff330 373bbc2d 55421030 55421030 55421030 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
580ff370 373928c8 60d1fca0 00000000 00000000 966e05b4 MSVCP140!__crtSetThreadpoolWait+0x0
580ff3a0 37392790 00000000 37392f97 00000000 60d1fca0 MSVCP140!std::_Winerror_message+0x0
580ff410 966e064b 60d1fc80 000001c0 59299060 59299060 MSVCP140!std::_Winerror_message+0x0
580ff450 966e25b1 8fe2e6e0 ffffffff 60d1fc80 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
580ff740 966e2471 99c06d10 580ff780 99c06d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
580ff790 966d9744 00080001 8fc3ded0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
580ff7c0 483214c2 8fc3ded0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
580ff7f0 49207034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
580ff820 4a59d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
580ff8a0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)