Task 7451531
| Name | ParityModified-1631732831-29940-1_0 |
| Workunit | 5121928 |
| Created | 19 Sep 2021, 5:32:28 UTC |
| Sent | 27 Sep 2021, 0:05:22 UTC |
| Report deadline | 4 Oct 2021, 0:05:22 UTC |
| Received | 27 Sep 2021, 10:26:06 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 6806 |
| Run time | 1 hours 54 min 3 sec |
| CPU time | 1 hours 50 min 35 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 6,709.54 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.10 GB |
| Peak swap size | 4.37 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-09-26 21:37:24 main:474] : INFO : Configuration:
[2021-09-26 21:37:24 main:475] : INFO : Model type: GRU
[2021-09-26 21:37:24 main:476] : INFO : Validation Loss Threshold: 0.0001
[2021-09-26 21:37:24 main:477] : INFO : Max Epochs: 2048
[2021-09-26 21:37:24 main:478] : INFO : Batch Size: 128
[2021-09-26 21:37:24 main:479] : INFO : Learning Rate: 0.01
[2021-09-26 21:37:24 main:480] : INFO : Patience: 10
[2021-09-26 21:37:24 main:481] : INFO : Hidden Width: 12
[2021-09-26 21:37:24 main:482] : INFO : # Recurrent Layers: 4
[2021-09-26 21:37:24 main:483] : INFO : # Backend Layers: 4
[2021-09-26 21:37:24 main:484] : INFO : # Threads: 1
[2021-09-26 21:37:24 main:486] : INFO : Preparing Dataset
[2021-09-26 21:37:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-26 21:37:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-26 21:37:26 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2021-09-26 21:37:26 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-26 21:37:26 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-26 21:37:26 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2021-09-26 21:37:26 main:494] : INFO : Creating Model
[2021-09-26 21:37:26 main:507] : INFO : Preparing config file
[2021-09-26 21:37:26 main:511] : INFO : Found checkpoint, attempting to load...
[2021-09-26 21:37:26 main:512] : INFO : Loading config
[2021-09-26 21:37:27 main:514] : INFO : Loading state
[2021-09-26 21:37:28 main:559] : INFO : Loading DataLoader into Memory
[2021-09-26 21:37:28 main:562] : INFO : Starting Training
[2021-09-26 21:37:34 main:574] : INFO : Epoch 702 | loss: 0.0311641 | val_loss: 0.0311661 | Time: 5459.92 ms
[2021-09-26 21:37:40 main:574] : INFO : Epoch 703 | loss: 0.0311375 | val_loss: 0.0311674 | Time: 5688.57 ms
[2021-09-26 21:37:47 main:574] : INFO : Epoch 704 | loss: 0.0311332 | val_loss: 0.0311659 | Time: 7042.34 ms
[2021-09-26 21:37:54 main:574] : INFO : Epoch 705 | loss: 0.0311365 | val_loss: 0.0311643 | Time: 7002.97 ms
[2021-09-26 21:38:01 main:574] : INFO : Epoch 706 | loss: 0.0311322 | val_loss: 0.0311618 | Time: 7178.32 ms
[2021-09-26 21:38:08 main:574] : INFO : Epoch 707 | loss: 0.0311339 | val_loss: 0.0311627 | Time: 7077.55 ms
[2021-09-26 21:38:15 main:574] : INFO : Epoch 708 | loss: 0.0311393 | val_loss: 0.031162 | Time: 7225.35 ms
[2021-09-26 21:38:22 main:574] : INFO : Epoch 709 | loss: 0.0311383 | val_loss: 0.0311627 | Time: 7114.78 ms
[2021-09-26 21:38:30 main:574] : INFO : Epoch 710 | loss: 0.0311362 | val_loss: 0.0311606 | Time: 8051.63 ms
[2021-09-26 21:38:38 main:574] : INFO : Epoch 711 | loss: 0.0311362 | val_loss: 0.0311629 | Time: 7814.48 ms
[2021-09-26 21:38:46 main:574] : INFO : Epoch 712 | loss: 0.0311335 | val_loss: 0.0311682 | Time: 7511.08 ms
[2021-09-26 21:38:53 main:574] : INFO : Epoch 713 | loss: 0.0311331 | val_loss: 0.0311631 | Time: 7665.25 ms
[2021-09-26 21:39:02 main:574] : INFO : Epoch 714 | loss: 0.0311318 | val_loss: 0.0311634 | Time: 7760.06 ms
[2021-09-26 21:39:09 main:574] : INFO : Epoch 715 | loss: 0.0311334 | val_loss: 0.0311714 | Time: 7631.72 ms
[2021-09-26 21:39:17 main:574] : INFO : Epoch 716 | loss: 0.0311322 | val_loss: 0.0311678 | Time: 7591.77 ms
[2021-09-26 21:39:24 main:574] : INFO : Epoch 717 | loss: 0.0311343 | val_loss: 0.0311646 | Time: 7686.1 ms
[2021-09-26 21:39:32 main:574] : INFO : Epoch 718 | loss: 0.0311344 | val_loss: 0.0311643 | Time: 7725.27 ms
[2021-09-26 21:39:40 main:574] : INFO : Epoch 719 | loss: 0.0311326 | val_loss: 0.0311602 | Time: 7737.19 ms
[2021-09-26 21:39:47 main:574] : INFO : Epoch 720 | loss: 0.031131 | val_loss: 0.0311638 | Time: 7507.51 ms
[2021-09-26 21:39:55 main:574] : INFO : Epoch 721 | loss: 0.031132 | val_loss: 0.0311643 | Time: 7562.9 ms
[2021-09-26 21:40:03 main:574] : INFO : Epoch 722 | loss: 0.0311312 | val_loss: 0.031165 | Time: 7650.6 ms
[2021-09-26 21:40:10 main:574] : INFO : Epoch 723 | loss: 0.0311302 | val_loss: 0.0311624 | Time: 7792.17 ms
[2021-09-26 21:40:18 main:574] : INFO : Epoch 724 | loss: 0.031134 | val_loss: 0.0311698 | Time: 7684.47 ms
[2021-09-26 21:40:26 main:574] : INFO : Epoch 725 | loss: 0.0311332 | val_loss: 0.0311609 | Time: 7849.76 ms
[2021-09-26 21:40:34 main:574] : INFO : Epoch 726 | loss: 0.0311286 | val_loss: 0.0311641 | Time: 7784.31 ms
[2021-09-26 21:40:41 main:574] : INFO : Epoch 727 | loss: 0.0311301 | val_loss: 0.031161 | Time: 7639.96 ms
[2021-09-26 21:40:49 main:574] : INFO : Epoch 728 | loss: 0.03113 | val_loss: 0.0311608 | Time: 7964.56 ms
[2021-09-26 21:40:57 main:574] : INFO : Epoch 729 | loss: 0.0311305 | val_loss: 0.0311607 | Time: 7785.6 ms
[2021-09-26 21:41:05 main:574] : INFO : Epoch 730 | loss: 0.0311328 | val_loss: 0.0311621 | Time: 7923.88 ms
[2021-09-26 21:41:13 main:574] : INFO : Epoch 731 | loss: 0.031139 | val_loss: 0.0311594 | Time: 7708.36 ms
[2021-09-26 21:41:21 main:574] : INFO : Epoch 732 | loss: 0.0311372 | val_loss: 0.0311603 | Time: 7653.26 ms
[2021-09-26 21:41:28 main:574] : INFO : Epoch 733 | loss: 0.0311357 | val_loss: 0.031159 | Time: 7924.78 ms
[2021-09-26 21:41:36 main:574] : INFO : Epoch 734 | loss: 0.0311341 | val_loss: 0.0311583 | Time: 7805.97 ms
[2021-09-26 21:41:44 main:574] : INFO : Epoch 735 | loss: 0.0311298 | val_loss: 0.0311567 | Time: 7793.95 ms
[2021-09-26 21:41:52 main:574] : INFO : Epoch 736 | loss: 0.0311302 | val_loss: 0.0311556 | Time: 7758.21 ms
[2021-09-26 21:42:00 main:574] : INFO : Epoch 737 | loss: 0.0311332 | val_loss: 0.0311563 | Time: 7824.7 ms
[2021-09-26 21:42:07 main:574] : INFO : Epoch 738 | loss: 0.0311284 | val_loss: 0.0311586 | Time: 7782.84 ms
[2021-09-26 21:42:15 main:574] : INFO : Epoch 739 | loss: 0.0311283 | val_loss: 0.0311548 | Time: 7916.56 ms
[2021-09-26 21:42:23 main:574] : INFO : Epoch 740 | loss: 0.0311263 | val_loss: 0.0311572 | Time: 7842.7 ms
[2021-09-26 21:42:31 main:574] : INFO : Epoch 741 | loss: 0.0311242 | val_loss: 0.0311556 | Time: 7842.92 ms
[2021-09-26 21:42:39 main:574] : INFO : Epoch 742 | loss: 0.0311239 | val_loss: 0.031155 | Time: 7939.18 ms
[2021-09-26 21:42:47 main:574] : INFO : Epoch 743 | loss: 0.031123 | val_loss: 0.031161 | Time: 7773.31 ms
[2021-09-26 21:42:55 main:574] : INFO : Epoch 744 | loss: 0.0311255 | val_loss: 0.0311723 | Time: 7730.13 ms
[2021-09-26 21:43:02 main:574] : INFO : Epoch 745 | loss: 0.0311237 | val_loss: 0.0311615 | Time: 7680.24 ms
[2021-09-26 21:43:10 main:574] : INFO : Epoch 746 | loss: 0.0311244 | val_loss: 0.0311607 | Time: 7692.43 ms
[2021-09-26 21:43:18 main:574] : INFO : Epoch 747 | loss: 0.0311215 | val_loss: 0.0311581 | Time: 8122.68 ms
[2021-09-26 21:43:26 main:574] : INFO : Epoch 748 | loss: 0.0311208 | val_loss: 0.031158 | Time: 7985.78 ms
[2021-09-26 21:43:34 main:574] : INFO : Epoch 749 | loss: 0.0311206 | val_loss: 0.0311546 | Time: 7700.87 ms
[2021-09-26 21:43:42 main:574] : INFO : Epoch 750 | loss: 0.031121 | val_loss: 0.0311554 | Time: 7717.05 ms
[2021-09-26 21:43:49 main:574] : INFO : Epoch 751 | loss: 0.0311228 | val_loss: 0.0311572 | Time: 7724.78 ms
[2021-09-26 21:43:57 main:574] : INFO : Epoch 752 | loss: 0.0311217 | val_loss: 0.031155 | Time: 7844.51 ms
[2021-09-26 21:44:05 main:574] : INFO : Epoch 753 | loss: 0.0311217 | val_loss: 0.0311547 | Time: 8157.44 ms
[2021-09-26 21:44:13 main:574] : INFO : Epoch 754 | loss: 0.0311226 | val_loss: 0.0311545 | Time: 7583.97 ms
[2021-09-26 21:44:21 main:574] : INFO : Epoch 755 | loss: 0.0311226 | val_loss: 0.0311616 | Time: 7751.09 ms
[2021-09-26 21:44:28 main:574] : INFO : Epoch 756 | loss: 0.0311212 | val_loss: 0.0311595 | Time: 7796.42 ms
[2021-09-26 21:44:36 main:574] : INFO : Epoch 757 | loss: 0.0311208 | val_loss: 0.0311589 | Time: 7482.61 ms
[2021-09-26 21:44:43 main:574] : INFO : Epoch 758 | loss: 0.0311313 | val_loss: 0.0311578 | Time: 7490.01 ms
[2021-09-26 21:44:51 main:574] : INFO : Epoch 759 | loss: 0.0311307 | val_loss: 0.0311568 | Time: 7669.15 ms
[2021-09-26 21:44:59 main:574] : INFO : Epoch 760 | loss: 0.0311278 | val_loss: 0.0311563 | Time: 7628.16 ms
[2021-09-26 21:45:06 main:574] : INFO : Epoch 761 | loss: 0.0311254 | val_loss: 0.0311551 | Time: 7726.32 ms
[2021-09-26 21:45:14 main:574] : INFO : Epoch 762 | loss: 0.0311243 | val_loss: 0.0311569 | Time: 7490.75 ms
[2021-09-26 21:45:22 main:574] : INFO : Epoch 763 | loss: 0.0311302 | val_loss: 0.0311571 | Time: 7541.08 ms
[2021-09-26 21:45:29 main:574] : INFO : Epoch 764 | loss: 0.0311274 | val_loss: 0.0311625 | Time: 7431.72 ms
[2021-09-26 21:45:37 main:574] : INFO : Epoch 765 | loss: 0.0311263 | val_loss: 0.0311792 | Time: 7546.21 ms
[2021-09-26 21:45:44 main:574] : INFO : Epoch 766 | loss: nan | val_loss: nan | Time: 7573.18 ms
[2021-09-26 21:45:52 main:574] : INFO : Epoch 767 | loss: nan | val_loss: nan | Time: 7530.77 ms
[2021-09-26 21:45:59 main:574] : INFO : Epoch 768 | loss: nan | val_loss: nan | Time: 7520.6 ms
[2021-09-26 21:46:07 main:574] : INFO : Epoch 769 | loss: nan | val_loss: nan | Time: 7689.24 ms
[2021-09-26 21:46:15 main:574] : INFO : Epoch 770 | loss: nan | val_loss: nan | Time: 7755.11 ms
[2021-09-26 21:46:22 main:574] : INFO : Epoch 771 | loss: nan | val_loss: nan | Time: 7782.62 ms
[2021-09-26 21:46:30 main:574] : INFO : Epoch 772 | loss: nan | val_loss: nan | Time: 7575.52 ms
[2021-09-26 21:46:38 main:574] : INFO : Epoch 773 | loss: nan | val_loss: nan | Time: 7619 ms
[2021-09-26 21:46:45 main:574] : INFO : Epoch 774 | loss: nan | val_loss: nan | Time: 7515.42 ms
[2021-09-26 21:46:53 main:574] : INFO : Epoch 775 | loss: nan | val_loss: nan | Time: 7385.08 ms
[2021-09-26 21:47:00 main:574] : INFO : Epoch 776 | loss: nan | val_loss: nan | Time: 7504.05 ms
[2021-09-26 21:47:07 main:574] : INFO : Epoch 777 | loss: nan | val_loss: nan | Time: 7361.5 ms
[2021-09-26 21:47:15 main:574] : INFO : Epoch 778 | loss: nan | val_loss: nan | Time: 7576.53 ms
[2021-09-26 21:47:22 main:574] : INFO : Epoch 779 | loss: nan | val_loss: nan | Time: 7351.28 ms
[2021-09-26 21:47:30 main:574] : INFO : Epoch 780 | loss: nan | val_loss: nan | Time: 7686.83 ms
[2021-09-26 21:47:38 main:574] : INFO : Epoch 781 | loss: nan | val_loss: nan | Time: 7531.39 ms
[2021-09-26 21:47:45 main:574] : INFO : Epoch 782 | loss: nan | val_loss: nan | Time: 7465.85 ms
[2021-09-26 21:47:52 main:574] : INFO : Epoch 783 | loss: nan | val_loss: nan | Time: 7405.25 ms
[2021-09-26 21:48:00 main:574] : INFO : Epoch 784 | loss: nan | val_loss: nan | Time: 7437.64 ms
[2021-09-26 21:48:08 main:574] : INFO : Epoch 785 | loss: nan | val_loss: nan | Time: 7616.15 ms
[2021-09-26 21:48:15 main:574] : INFO : Epoch 786 | loss: nan | val_loss: nan | Time: 7524.13 ms
[2021-09-26 21:48:23 main:574] : INFO : Epoch 787 | loss: nan | val_loss: nan | Time: 7508.5 ms
[2021-09-26 21:48:30 main:574] : INFO : Epoch 788 | loss: nan | val_loss: nan | Time: 7485.54 ms
[2021-09-26 21:48:38 main:574] : INFO : Epoch 789 | loss: nan | val_loss: nan | Time: 7513.38 ms
[2021-09-26 21:48:45 main:574] : INFO : Epoch 790 | loss: nan | val_loss: nan | Time: 7325.81 ms
[2021-09-26 21:48:53 main:574] : INFO : Epoch 791 | loss: nan | val_loss: nan | Time: 7762.44 ms
[2021-09-26 21:49:00 main:574] : INFO : Epoch 792 | loss: nan | val_loss: nan | Time: 7708.71 ms
[2021-09-26 21:49:08 main:574] : INFO : Epoch 793 | loss: nan | val_loss: nan | Time: 7694.68 ms
[2021-09-26 21:49:16 main:574] : INFO : Epoch 794 | loss: nan | val_loss: nan | Time: 7732.59 ms
[2021-09-26 21:49:23 main:574] : INFO : Epoch 795 | loss: nan | val_loss: nan | Time: 7478.63 ms
[2021-09-26 21:49:31 main:574] : INFO : Epoch 796 | loss: nan | val_loss: nan | Time: 7519.23 ms
[2021-09-26 21:49:38 main:574] : INFO : Epoch 797 | loss: nan | val_loss: nan | Time: 7557.78 ms
[2021-09-26 21:49:46 main:574] : INFO : Epoch 798 | loss: nan | val_loss: nan | Time: 7602.73 ms
[2021-09-26 21:49:54 main:574] : INFO : Epoch 799 | loss: nan | val_loss: nan | Time: 7566.2 ms
[2021-09-26 21:50:01 main:574] : INFO : Epoch 800 | loss: nan | val_loss: nan | Time: 7484.29 ms
[2021-09-26 21:50:09 main:574] : INFO : Epoch 801 | loss: nan | val_loss: nan | Time: 7496.28 ms
[2021-09-26 21:50:16 main:574] : INFO : Epoch 802 | loss: nan | val_loss: nan | Time: 7494.86 ms
[2021-09-26 21:50:24 main:574] : INFO : Epoch 803 | loss: nan | val_loss: nan | Time: 7753.58 ms
[2021-09-26 21:50:31 main:574] : INFO : Epoch 804 | loss: nan | val_loss: nan | Time: 7376.62 ms
[2021-09-26 21:50:39 main:574] : INFO : Epoch 805 | loss: nan | val_loss: nan | Time: 7564.97 ms
[2021-09-26 21:50:46 main:574] : INFO : Epoch 806 | loss: nan | val_loss: nan | Time: 7620.5 ms
[2021-09-26 21:50:54 main:574] : INFO : Epoch 807 | loss: nan | val_loss: nan | Time: 7505.39 ms
[2021-09-26 21:51:02 main:574] : INFO : Epoch 808 | loss: nan | val_loss: nan | Time: 7672.54 ms
[2021-09-26 21:51:09 main:574] : INFO : Epoch 809 | loss: nan | val_loss: nan | Time: 7527.26 ms
[2021-09-26 21:51:17 main:574] : INFO : Epoch 810 | loss: nan | val_loss: nan | Time: 7472.85 ms
[2021-09-26 21:51:24 main:574] : INFO : Epoch 811 | loss: nan | val_loss: nan | Time: 7514.83 ms
[2021-09-26 21:51:32 main:574] : INFO : Epoch 812 | loss: nan | val_loss: nan | Time: 7375.11 ms
[2021-09-26 21:51:39 main:574] : INFO : Epoch 813 | loss: nan | val_loss: nan | Time: 7223.61 ms
[2021-09-26 21:51:46 main:574] : INFO : Epoch 814 | loss: nan | val_loss: nan | Time: 7454.45 ms
[2021-09-26 21:51:54 main:574] : INFO : Epoch 815 | loss: nan | val_loss: nan | Time: 7866.09 ms
[2021-09-26 21:52:02 main:574] : INFO : Epoch 816 | loss: nan | val_loss: nan | Time: 7730.36 ms
[2021-09-26 21:52:09 main:574] : INFO : Epoch 817 | loss: nan | val_loss: nan | Time: 7563.22 ms
[2021-09-26 21:52:17 main:574] : INFO : Epoch 818 | loss: nan | val_loss: nan | Time: 7650.55 ms
[2021-09-26 21:52:25 main:574] : INFO : Epoch 819 | loss: nan | val_loss: nan | Time: 7395.64 ms
[2021-09-26 21:52:32 main:574] : INFO : Epoch 820 | loss: nan | val_loss: nan | Time: 7510.17 ms
[2021-09-26 21:52:40 main:574] : INFO : Epoch 821 | loss: nan | val_loss: nan | Time: 7726.04 ms
[2021-09-26 21:52:47 main:574] : INFO : Epoch 822 | loss: nan | val_loss: nan | Time: 7730.83 ms
[2021-09-26 21:52:55 main:574] : INFO : Epoch 823 | loss: nan | val_loss: nan | Time: 7478.58 ms
[2021-09-26 21:53:02 main:574] : INFO : Epoch 824 | loss: nan | val_loss: nan | Time: 7359.57 ms
[2021-09-26 21:53:10 main:574] : INFO : Epoch 825 | loss: nan | val_loss: nan | Time: 7383.5 ms
[2021-09-26 21:53:17 main:574] : INFO : Epoch 826 | loss: nan | val_loss: nan | Time: 7398.85 ms
[2021-09-26 21:53:25 main:574] : INFO : Epoch 827 | loss: nan | val_loss: nan | Time: 7712.77 ms
[2021-09-26 21:53:33 main:574] : INFO : Epoch 828 | loss: nan | val_loss: nan | Time: 7698.88 ms
[2021-09-26 21:53:40 main:574] : INFO : Epoch 829 | loss: nan | val_loss: nan | Time: 7722.28 ms
[2021-09-26 21:53:48 main:574] : INFO : Epoch 830 | loss: nan | val_loss: nan | Time: 7821.99 ms
[2021-09-26 21:53:56 main:574] : INFO : Epoch 831 | loss: nan | val_loss: nan | Time: 7573.04 ms
[2021-09-26 21:54:04 main:574] : INFO : Epoch 832 | loss: nan | val_loss: nan | Time: 7902.26 ms
[2021-09-26 21:54:11 main:574] : INFO : Epoch 833 | loss: nan | val_loss: nan | Time: 7653.32 ms
[2021-09-26 21:54:19 main:574] : INFO : Epoch 834 | loss: nan | val_loss: nan | Time: 7741.72 ms
[2021-09-26 21:54:27 main:574] : INFO : Epoch 835 | loss: nan | val_loss: nan | Time: 7591.34 ms
[2021-09-26 21:54:34 main:574] : INFO : Epoch 836 | loss: nan | val_loss: nan | Time: 7659.91 ms
[2021-09-26 21:54:42 main:574] : INFO : Epoch 837 | loss: nan | val_loss: nan | Time: 7738.19 ms
[2021-09-26 21:54:50 main:574] : INFO : Epoch 838 | loss: nan | val_loss: nan | Time: 7712.15 ms
[2021-09-26 21:54:58 main:574] : INFO : Epoch 839 | loss: nan | val_loss: nan | Time: 7771.8 ms
[2021-09-26 21:55:05 main:574] : INFO : Epoch 840 | loss: nan | val_loss: nan | Time: 7476.36 ms
[2021-09-26 21:55:13 main:574] : INFO : Epoch 841 | loss: nan | val_loss: nan | Time: 7725.08 ms
[2021-09-26 21:55:20 main:574] : INFO : Epoch 842 | loss: nan | val_loss: nan | Time: 7646.93 ms
[2021-09-26 21:55:28 main:574] : INFO : Epoch 843 | loss: nan | val_loss: nan | Time: 7676.26 ms
[2021-09-26 21:55:36 main:574] : INFO : Epoch 844 | loss: nan | val_loss: nan | Time: 7607.22 ms
[2021-09-26 21:55:43 main:574] : INFO : Epoch 845 | loss: nan | val_loss: nan | Time: 7639.74 ms
[2021-09-26 21:55:51 main:574] : INFO : Epoch 846 | loss: nan | val_loss: nan | Time: 7557.77 ms
[2021-09-26 21:55:59 main:574] : INFO : Epoch 847 | loss: nan | val_loss: nan | Time: 7615.34 ms
[2021-09-26 21:56:06 main:574] : INFO : Epoch 848 | loss: nan | val_loss: nan | Time: 7671.15 ms
[2021-09-26 21:56:14 main:574] : INFO : Epoch 849 | loss: nan | val_loss: nan | Time: 7496.93 ms
[2021-09-26 21:56:21 main:574] : INFO : Epoch 850 | loss: nan | val_loss: nan | Time: 7552.85 ms
[2021-09-26 21:56:29 main:574] : INFO : Epoch 851 | loss: nan | val_loss: nan | Time: 7723.35 ms
[2021-09-26 21:56:37 main:574] : INFO : Epoch 852 | loss: nan | val_loss: nan | Time: 7766.99 ms
[2021-09-26 21:56:44 main:574] : INFO : Epoch 853 | loss: nan | val_loss: nan | Time: 7611.38 ms
[2021-09-26 21:56:52 main:574] : INFO : Epoch 854 | loss: nan | val_loss: nan | Time: 7686.54 ms
[2021-09-26 21:57:00 main:574] : INFO : Epoch 855 | loss: nan | val_loss: nan | Time: 7506.32 ms
[2021-09-26 21:57:07 main:574] : INFO : Epoch 856 | loss: nan | val_loss: nan | Time: 7570.65 ms
[2021-09-26 21:57:15 main:574] : INFO : Epoch 857 | loss: nan | val_loss: nan | Time: 7582.58 ms
[2021-09-26 21:57:22 main:574] : INFO : Epoch 858 | loss: nan | val_loss: nan | Time: 7603.92 ms
[2021-09-26 21:57:30 main:574] : INFO : Epoch 859 | loss: nan | val_loss: nan | Time: 7503.43 ms
[2021-09-26 21:57:38 main:574] : INFO : Epoch 860 | loss: nan | val_loss: nan | Time: 7750.99 ms
[2021-09-26 21:57:45 main:574] : INFO : Epoch 861 | loss: nan | val_loss: nan | Time: 7485.56 ms
[2021-09-26 21:57:53 main:574] : INFO : Epoch 862 | loss: nan | val_loss: nan | Time: 7572.35 ms
[2021-09-26 21:58:00 main:574] : INFO : Epoch 863 | loss: nan | val_loss: nan | Time: 7688.36 ms
[2021-09-26 21:58:08 main:574] : INFO : Epoch 864 | loss: nan | val_loss: nan | Time: 7588.3 ms
[2021-09-26 21:58:16 main:574] : INFO : Epoch 865 | loss: nan | val_loss: nan | Time: 7657.39 ms
[2021-09-26 21:58:24 main:574] : INFO : Epoch 866 | loss: nan | val_loss: nan | Time: 7784.07 ms
[2021-09-26 21:58:31 main:574] : INFO : Epoch 867 | loss: nan | val_loss: nan | Time: 7576.65 ms
[2021-09-26 21:58:39 main:574] : INFO : Epoch 868 | loss: nan | val_loss: nan | Time: 7566.77 ms
[2021-09-26 21:58:46 main:574] : INFO : Epoch 869 | loss: nan | val_loss: nan | Time: 7545.47 ms
[2021-09-26 21:58:54 main:574] : INFO : Epoch 870 | loss: nan | val_loss: nan | Time: 7635.05 ms
[2021-09-26 21:59:01 main:574] : INFO : Epoch 871 | loss: nan | val_loss: nan | Time: 7537.2 ms
[2021-09-26 21:59:09 main:574] : INFO : Epoch 872 | loss: nan | val_loss: nan | Time: 7691.28 ms
[2021-09-26 21:59:17 main:574] : INFO : Epoch 873 | loss: nan | val_loss: nan | Time: 7719.3 ms
[2021-09-26 21:59:25 main:574] : INFO : Epoch 874 | loss: nan | val_loss: nan | Time: 7747.52 ms
[2021-09-26 21:59:32 main:574] : INFO : Epoch 875 | loss: nan | val_loss: nan | Time: 7813.64 ms
[2021-09-26 21:59:40 main:574] : INFO : Epoch 876 | loss: nan | val_loss: nan | Time: 7725.19 ms
[2021-09-26 21:59:48 main:574] : INFO : Epoch 877 | loss: nan | val_loss: nan | Time: 7781.76 ms
[2021-09-26 21:59:56 main:574] : INFO : Epoch 878 | loss: nan | val_loss: nan | Time: 7549.45 ms
[2021-09-26 22:00:03 main:574] : INFO : Epoch 879 | loss: nan | val_loss: nan | Time: 7579.1 ms
[2021-09-26 22:00:10 main:574] : INFO : Epoch 880 | loss: nan | val_loss: nan | Time: 7316.42 ms
[2021-09-26 22:00:18 main:574] : INFO : Epoch 881 | loss: nan | val_loss: nan | Time: 7556.8 ms
[2021-09-26 22:00:26 main:574] : INFO : Epoch 882 | loss: nan | val_loss: nan | Time: 7634.53 ms
[2021-09-26 22:00:33 main:574] : INFO : Epoch 883 | loss: nan | val_loss: nan | Time: 7589.79 ms
[2021-09-26 22:00:41 main:574] : INFO : Epoch 884 | loss: nan | val_loss: nan | Time: 7524.45 ms
[2021-09-26 22:00:48 main:574] : INFO : Epoch 885 | loss: nan | val_loss: nan | Time: 7551.16 ms
[2021-09-26 22:00:56 main:574] : INFO : Epoch 886 | loss: nan | val_loss: nan | Time: 7660.68 ms
[2021-09-26 22:01:03 main:574] : INFO : Epoch 887 | loss: nan | val_loss: nan | Time: 7488.46 ms
[2021-09-26 22:01:11 main:574] : INFO : Epoch 888 | loss: nan | val_loss: nan | Time: 7362.11 ms
[2021-09-26 22:01:19 main:574] : INFO : Epoch 889 | loss: nan | val_loss: nan | Time: 7780.12 ms
[2021-09-26 22:01:26 main:574] : INFO : Epoch 890 | loss: nan | val_loss: nan | Time: 7601.79 ms
[2021-09-26 22:01:34 main:574] : INFO : Epoch 891 | loss: nan | val_loss: nan | Time: 7769.26 ms
[2021-09-26 22:01:42 main:574] : INFO : Epoch 892 | loss: nan | val_loss: nan | Time: 7629.96 ms
[2021-09-26 22:01:49 main:574] : INFO : Epoch 893 | loss: nan | val_loss: nan | Time: 7518.62 ms
[2021-09-26 22:01:57 main:574] : INFO : Epoch 894 | loss: nan | val_loss: nan | Time: 7721.31 ms
[2021-09-26 22:02:04 main:574] : INFO : Epoch 895 | loss: nan | val_loss: nan | Time: 7458.89 ms
[2021-09-26 22:02:12 main:574] : INFO : Epoch 896 | loss: nan | val_loss: nan | Time: 7552.75 ms
[2021-09-26 22:02:20 main:574] : INFO : Epoch 897 | loss: nan | val_loss: nan | Time: 7557.42 ms
[2021-09-26 22:02:27 main:574] : INFO : Epoch 898 | loss: nan | val_loss: nan | Time: 7642.58 ms
[2021-09-26 22:02:35 main:574] : INFO : Epoch 899 | loss: nan | val_loss: nan | Time: 7495.35 ms
[2021-09-26 22:02:42 main:574] : INFO : Epoch 900 | loss: nan | val_loss: nan | Time: 7519.94 ms
[2021-09-26 22:02:50 main:574] : INFO : Epoch 901 | loss: nan | val_loss: nan | Time: 7493.68 ms
[2021-09-26 22:02:57 main:574] : INFO : Epoch 902 | loss: nan | val_loss: nan | Time: 7523.21 ms
[2021-09-26 22:03:05 main:574] : INFO : Epoch 903 | loss: nan | val_loss: nan | Time: 7572.8 ms
[2021-09-26 22:03:12 main:574] : INFO : Epoch 904 | loss: nan | val_loss: nan | Time: 7675.07 ms
[2021-09-26 22:03:20 main:574] : INFO : Epoch 905 | loss: nan | val_loss: nan | Time: 7552.11 ms
[2021-09-26 22:03:28 main:574] : INFO : Epoch 906 | loss: nan | val_loss: nan | Time: 7746.23 ms
[2021-09-26 22:03:35 main:574] : INFO : Epoch 907 | loss: nan | val_loss: nan | Time: 7602.18 ms
[2021-09-26 22:03:43 main:574] : INFO : Epoch 908 | loss: nan | val_loss: nan | Time: 7737.11 ms
[2021-09-26 22:03:51 main:574] : INFO : Epoch 909 | loss: nan | val_loss: nan | Time: 7519.09 ms
[2021-09-26 22:03:58 main:574] : INFO : Epoch 910 | loss: nan | val_loss: nan | Time: 7574.81 ms
[2021-09-26 22:04:07 main:574] : INFO : Epoch 911 | loss: nan | val_loss: nan | Time: 9027.59 ms
[2021-09-26 22:04:15 main:574] : INFO : Epoch 912 | loss: nan | val_loss: nan | Time: 7928.24 ms
[2021-09-26 22:04:22 main:574] : INFO : Epoch 913 | loss: nan | val_loss: nan | Time: 7253.55 ms
[2021-09-26 22:04:30 main:574] : INFO : Epoch 914 | loss: nan | val_loss: nan | Time: 7221.36 ms
[2021-09-26 22:04:37 main:574] : INFO : Epoch 915 | loss: nan | val_loss: nan | Time: 6878.82 ms
[2021-09-26 22:04:43 main:574] : INFO : Epoch 916 | loss: nan | val_loss: nan | Time: 6672.25 ms
[2021-09-26 22:04:50 main:574] : INFO : Epoch 917 | loss: nan | val_loss: nan | Time: 6886.2 ms
[2021-09-26 22:04:57 main:574] : INFO : Epoch 918 | loss: nan | val_loss: nan | Time: 6752.41 ms
[2021-09-26 22:05:04 main:574] : INFO : Epoch 919 | loss: nan | val_loss: nan | Time: 6666.4 ms
[2021-09-26 22:05:11 main:574] : INFO : Epoch 920 | loss: nan | val_loss: nan | Time: 6922.55 ms
[2021-09-26 22:05:17 main:574] : INFO : Epoch 921 | loss: nan | val_loss: nan | Time: 6850.59 ms
[2021-09-26 22:05:24 main:574] : INFO : Epoch 922 | loss: nan | val_loss: nan | Time: 6708.42 ms
[2021-09-26 22:05:31 main:574] : INFO : Epoch 923 | loss: nan | val_loss: nan | Time: 6580.31 ms
[2021-09-26 22:05:38 main:574] : INFO : Epoch 924 | loss: nan | val_loss: nan | Time: 6836.49 ms
[2021-09-26 22:05:44 main:574] : INFO : Epoch 925 | loss: nan | val_loss: nan | Time: 6762.88 ms
[2021-09-26 22:05:51 main:574] : INFO : Epoch 926 | loss: nan | val_loss: nan | Time: 6634.5 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce RTX 2070)
[2021-09-27 01:07:26 main:435] : INFO : Set logging level to 1
[2021-09-27 01:07:26 main:441] : INFO : Running in BOINC Client mode
[2021-09-27 01:07:26 main:444] : INFO : Resolving all filenames
[2021-09-27 01:07:26 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-09-27 01:07:26 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631732831-29940-1_0_r778835190_1 (exists = 1)
[2021-09-27 01:07:26 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631732831-29940-1_0_r778835190_0 (exists = 0)
[2021-09-27 01:07:26 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631732831-29940-1 (exists = 1)
[2021-09-27 01:07:26 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-09-27 01:07:26 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-09-27 01:07:26 main:474] : INFO : Configuration:
[2021-09-27 01:07:26 main:475] : INFO : Model type: GRU
[2021-09-27 01:07:26 main:476] : INFO : Validation Loss Threshold: 0.0001
[2021-09-27 01:07:26 main:477] : INFO : Max Epochs: 2048
[2021-09-27 01:07:26 main:478] : INFO : Batch Size: 128
[2021-09-27 01:07:26 main:479] : INFO : Learning Rate: 0.01
[2021-09-27 01:07:26 main:480] : INFO : Patience: 10
[2021-09-27 01:07:26 main:481] : INFO : Hidden Width: 12
[2021-09-27 01:07:26 main:482] : INFO : # Recurrent Layers: 4
[2021-09-27 01:07:26 main:483] : INFO : # Backend Layers: 4
[2021-09-27 01:07:26 main:484] : INFO : # Threads: 1
[2021-09-27 01:07:26 main:486] : INFO : Preparing Dataset
[2021-09-27 01:07:26 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-27 01:07:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-27 01:07:30 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2021-09-27 01:07:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-27 01:07:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-27 01:07:30 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2021-09-27 01:07:30 main:494] : INFO : Creating Model
[2021-09-27 01:07:30 main:507] : INFO : Preparing config file
[2021-09-27 01:07:30 main:511] : INFO : Found checkpoint, attempting to load...
[2021-09-27 01:07:30 main:512] : INFO : Loading config
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFD36F64F99
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 09/27/21 01:07:30
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\4;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 0000000084230000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000039810000 00000000001f5000 C:\Windows\SYSTEM32\ntdll.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
ModLoad: 00000000e7df0000 0000000000015000 C:\Program Files\Avast Software\Avast\aswhook.dll (21.7.6523.0) (-nosymbols- Symbols Loaded)
Linked PDB Filename : D:\work\616216c47067779c\idp\build\avgast\RU_NTDLL-lH-Y2A!x64_vs142\bin\Release_Unicode_NTDLL_vs142\x64\aswhook.pdb
File Version : 21.7.6523.0
Company Name : AVAST Software
Product Name : Avast
Product Version : 21.7.6523.0
ModLoad: 0000000038900000 00000000000be000 C:\Windows\System32\KERNEL32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 0000000036f30000 00000000002c9000 C:\Windows\System32\KERNELBASE.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000380d0000 00000000001a1000 C:\Windows\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000037250000 0000000000022000 C:\Windows\System32\win32u.dll (6.2.19041.1237) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1237 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1237
ModLoad: 0000000038700000 000000000002b000 C:\Windows\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 0000000037750000 000000000010b000 C:\Windows\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1110
ModLoad: 0000000037380000 000000000009d000 C:\Windows\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000037280000 0000000000100000 C:\Windows\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000037860000 00000000000ac000 C:\Windows\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000038860000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000037ef0000 000000000009b000 C:\Windows\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000389c0000 000000000012a000 C:\Windows\System32\RPCRT4.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000fbc30000 0000000000058000 C:\ProgramData\BOINC\slots\4\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000095b0000 000000000008d000 C:\Windows\SYSTEM32\MSVCP140.dll (14.28.29910.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.28.29910.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29910.0
ModLoad: 00000000355a0000 00000000001e4000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 000000009aec0000 000000000abe7000 C:\ProgramData\BOINC\slots\4\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000009640000 000000000001a000 C:\Windows\SYSTEM32\VCRUNTIME140.dll (14.28.29910.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.28.29910.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29910.0
ModLoad: 0000000035060000 0000000024b49000 C:\ProgramData\BOINC\slots\4\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000009480000 000000000000c000 C:\Windows\SYSTEM32\VCRUNTIME140_1.dll (14.28.29910.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.28.29910.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29910.0
ModLoad: 00000000b34f0000 000000000020d000 C:\ProgramData\BOINC\slots\4\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000b3210000 00000000002db000 C:\ProgramData\BOINC\slots\4\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ee1d0000 0000000000045000 C:\ProgramData\BOINC\slots\4\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000089500000 00000000030a5000 C:\ProgramData\BOINC\slots\4\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000017fd0000 0000000000010000 C:\ProgramData\BOINC\slots\4\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000080360000 000000000919f000 C:\ProgramData\BOINC\slots\4\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000167f0000 00000000034b2000 C:\ProgramData\BOINC\slots\4\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000ed620000 0000000000040000 C:\ProgramData\BOINC\slots\4\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000012a90000 0000000003d5b000 C:\ProgramData\BOINC\slots\4\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000010bc0000 0000000001eca000 C:\ProgramData\BOINC\slots\4\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000019cb0000 000000001b3a4000 C:\ProgramData\BOINC\slots\4\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 0000000037910000 0000000000030000 C:\Windows\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000357b0000 0000000000012000 C:\Windows\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000038280000 0000000000472000 C:\Windows\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000037200000 000000000004e000 C:\Windows\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 0000000037420000 0000000000027000 C:\Windows\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000036cd0000 0000000000034000 C:\Windows\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000376f0000 0000000000060000 C:\Windows\System32\WINTRUST.dll (6.2.19041.1237) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1237 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1237
ModLoad: 0000000037500000 0000000000156000 C:\Windows\System32\CRYPT32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000036b10000 0000000000012000 C:\Windows\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000038cc0000 000000000073f000 C:\Windows\System32\Shell32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 0000000034d40000 0000000000790000 C:\Windows\SYSTEM32\windows.storage.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000039460000 0000000000355000 C:\Windows\System32\combase.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 0000000036980000 000000000002c000 C:\Windows\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000037f90000 00000000000ae000 C:\Windows\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000039400000 0000000000055000 C:\Windows\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b27d0000 000000000029d000 C:\Windows\system32\nvcuda.dll (27.21.14.6242) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_00\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.6242
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.162 driver
Product Version : 27.21.14.6242
ModLoad: 0000000030320000 000000000000a000 C:\Windows\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000099900000 00000000015b8000 C:\Windows\system32\DriverStore\FileRepository\nvtf.inf_amd64_7475a0a6a7a1600b\nvcuda64.dll (27.21.14.6242) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_00\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.6242
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.162 driver
Product Version : 27.21.14.6242
ModLoad: 0000000037960000 000000000006b000 C:\Windows\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1081 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1081
ModLoad: 000000002eeb0000 0000000000031000 C:\Windows\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 00000000368f0000 000000000000c000 C:\Windows\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000345b0000 000000000009e000 C:\Windows\system32\uxtheme.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000002bc20000 00000000006f2000 C:\Windows\SYSTEM32\nvapi64.dll (27.21.14.6242) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_00\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.6242
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.6242
ModLoad: 0000000037b30000 000000000012a000 C:\Windows\System32\OLE32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 0000000037660000 0000000000083000 C:\Windows\System32\bcryptPrimitives.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3625, Write: 306, Other 898
- I/O Transfers Counters -
Read: 6514489, Write: 7295, Other 33678
- Paged Pool Usage -
QuotaPagedPoolUsage: 3451440, QuotaPeakPagedPoolUsage: 3451440
QuotaNonPagedPoolUsage: 41144, QuotaPeakNonPagedPoolUsage: 41272
- Virtual Memory Usage -
VirtualSize: -1239773184, PeakVirtualSize: -637538304
- Pagefile Usage -
PagefileUsage: -1239773184, PeakPagefileUsage: -1239773184
- Working Set Size -
WorkingSetSize: 1230012416, PeakWorkingSetSize: 1230016512, PageFaultCount: 430419
*** Dump of thread ID 21396 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 10625000.000000, User Time: 28125000.000000, Wait Time: 29005052.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFD36F64F99
- Registers -
rax=00000000a0a58b93 rbx=0000000084594910 rcx=0000000048bb5d10 rdx=0000000000000001 rsi=0000000048bb6650 rdi=0000000019930520
r8=0000000048bb5da8 r9=0000000000000000 r10=0000000000000000 r11=000000000b44e600 r12=0000000060875880 r13=0000000048bb6860
r14=000000000a4dce30 r15=0000000000000000 rip=0000000036f64f99 rsp=0000000048bb64f0 rbp=0000000048bb67e0
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
48bb65c0 844aa884 00000040 0000004f 60876600 00000233 KERNELBASE!RaiseException+0x0
48bb6620 84251ca6 00000001 21e40000 58302bc8 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
48bb66d0 8425593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
48bb6820 84251a78 00000000 00000000 48bb6b50 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
48bb68f0 84251cfc 48bb6b50 00000000 00000080 48bb6e20 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
48bb69b0 8425c4dd 48bb6e20 48bb6e20 48bb6e20 48bb6e20 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
48bb6ca0 8424b2fe 48bb72b8 48bb6e20 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
48bcfa40 8448c6f8 23800210 00000000 00000000 2352c600 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
48bcfa80 38917034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
48bcfab0 39862651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
48bcfb30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 21152 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 29004780.000000
- Registers -
rax=00000000000001d3 rbx=0000000021e45b60 rcx=0000000000000074 rdx=0000000021e457e0 rsi=0000000021e43610 rdi=0000000021e45b60
r8=0000000000000008 r9=0000000000000008 r10=0000000000000000 r11=0000000048effa70 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000398b07c4 rsp=0000000048effb98 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
48effb90 39862dc7 00000000 00000000 21e43610 21e45b60 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
48effe90 38917034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
48effec0 39862651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
48efff40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 21140 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 468750.000000, User Time: 0.000000, Wait Time: 29004728.000000
- Registers -
rax=00000000000001d3 rbx=0000000021e45f90 rcx=0000000000000074 rdx=0000000021e45c10 rsi=0000000021e43610 rdi=0000000021e45f90
r8=00000000000002a8 r9=000000000000004e r10=0000000000000000 r11=00000000350182a8 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000398b07c4 rsp=0000000048fff888 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
48fff880 39862dc7 00000000 00000000 21e43610 00000000 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
48fffb80 38917034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
48fffbb0 39862651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
48fffc30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12392 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 29004780.000000
- Registers -
rax=00000000000001d3 rbx=0000000021e490b0 rcx=0000000000000074 rdx=0000000021e48d30 rsi=0000000021e43610 rdi=0000000021e490b0
r8=00000000000002a8 r9=000000000000007a r10=0000000000000000 r11=0000000012a6a2a8 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000398b07c4 rsp=00000000490ffb68 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
490ffb60 39862dc7 00000000 00000000 21e43610 21e490b0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
490ffe60 38917034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
490ffe90 39862651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
490fff10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 19632 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 29005050.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000492ffa00 rsi=0000000000000000 rdi=0000000000000064
r8=00000000492ff9d8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000398ad3f4 rsp=00000000492ff9d8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
492ff9d0 36f7967e 492ffa98 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
492ffa70 8426a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
492ffaa0 38917034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
492ffad0 39862651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
492ffb50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 2320 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 29005050.000000
- Registers -
rax=000000000000005b rbx=0000000000000007 rcx=0000000000000007 rdx=00000000493ff430 rsi=0000000000000000 rdi=0000000000000007
r8=0000000023acfcb0 r9=0000000023a15000 r10=0000000000000000 r11=00000000493ff630 r12=0000000000000064 r13=00000000493ff430
r14=00000000493ff130 r15=0000000000000000 rip=00000000398ad8c4 rsp=00000000493ff0d8 rbp=0000000023a150a0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
493ff0d0 36f7cb70 493ff490 3982dc6b 00000000 493ff1f0 ntdll!ZwWaitForMultipleObjects+0x0
493ff3c0 36f7ca6e 21e52690 00700070 00000007 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
493ff400 99ab6844 23a17f80 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
493ff640 99b4e83d 00000000 23a150a0 00000000 00000000 nvcuda64!+0x0
493ff6f0 99ab6213 3a8cefb8 38995881 23fcb4a0 00000000 nvcuda64!cuProfilerStop+0x0
493ff720 99dcdf64 23fcb4a0 00000000 00000000 00000000 nvcuda64!+0x0
493ff750 38917034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
493ff780 39862651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
493ff800 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 9072 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 29005032.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000023ad2eb8 rdx=00000000494ffaf8 rsi=00000000494ffa60 rdi=0000000000000000
r8=0000000000000001 r9=0000000000002370 r10=0000000023c94c80 r11=00000000db5f41bf r12=00000000494ffaf8 r13=0000000000000000
r14=0000000023ad2eb8 r15=0000000023c94c80 rip=00000000398b0764 rsp=00000000494ffa38 rbp=00000000494ffa90
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
494ffa30 39874295 00000102 00000102 00000000 494ffa60 ntdll!NtWaitForAlertByThreadId+0x0
494ffaa0 36f9ce39 23c92460 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
494ffad0 99a34d1c 23c92460 398607b0 23c92460 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
494ffb30 99ab6213 00000001 3a60bafa 00000000 00000000 nvcuda64!+0x0
494ffb60 99dcdf64 23fcb3b0 00000000 00000000 00000000 nvcuda64!+0x0
494ffb90 38917034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
494ffbc0 39862651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
494ffc40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)