Task 4663054
| Name | ParityMachine-1617250194-29400-1_0 |
| Workunit | 2671248 |
| Created | 7 Apr 2021, 23:52:04 UTC |
| Sent | 13 Apr 2021, 5:05:50 UTC |
| Report deadline | 20 Apr 2021, 5:05:50 UTC |
| Received | 16 Apr 2021, 12:11:18 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 157 |
| Run time | 1 hours 11 min 4 sec |
| CPU time | 56 min 35 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 4,474.06 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.64 GB |
| Peak swap size | 3.63 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
04-16 04:55:01 main:574] : INFO : Epoch 868 | loss: nan | val_loss: nan | Time: 3652.88 ms
[2021-04-16 04:55:05 main:574] : INFO : Epoch 869 | loss: nan | val_loss: nan | Time: 3755.17 ms
[2021-04-16 04:55:09 main:574] : INFO : Epoch 870 | loss: nan | val_loss: nan | Time: 3526.99 ms
[2021-04-16 04:55:13 main:574] : INFO : Epoch 871 | loss: nan | val_loss: nan | Time: 3781.96 ms
[2021-04-16 04:55:16 main:574] : INFO : Epoch 872 | loss: nan | val_loss: nan | Time: 3739.89 ms
[2021-04-16 04:55:20 main:574] : INFO : Epoch 873 | loss: nan | val_loss: nan | Time: 3610.3 ms
[2021-04-16 04:55:24 main:574] : INFO : Epoch 874 | loss: nan | val_loss: nan | Time: 3686.45 ms
[2021-04-16 04:55:27 main:574] : INFO : Epoch 875 | loss: nan | val_loss: nan | Time: 3455.51 ms
[2021-04-16 04:55:31 main:574] : INFO : Epoch 876 | loss: nan | val_loss: nan | Time: 3600.8 ms
[2021-04-16 04:55:35 main:574] : INFO : Epoch 877 | loss: nan | val_loss: nan | Time: 3795.02 ms
[2021-04-16 04:55:39 main:574] : INFO : Epoch 878 | loss: nan | val_loss: nan | Time: 3464.85 ms
[2021-04-16 04:55:43 main:574] : INFO : Epoch 879 | loss: nan | val_loss: nan | Time: 3914.53 ms
[2021-04-16 04:55:47 main:574] : INFO : Epoch 880 | loss: nan | val_loss: nan | Time: 3878.96 ms
[2021-04-16 04:55:50 main:574] : INFO : Epoch 881 | loss: nan | val_loss: nan | Time: 3555.76 ms
[2021-04-16 04:55:54 main:574] : INFO : Epoch 882 | loss: nan | val_loss: nan | Time: 3683.43 ms
[2021-04-16 04:55:57 main:574] : INFO : Epoch 883 | loss: nan | val_loss: nan | Time: 3349.12 ms
[2021-04-16 04:56:01 main:574] : INFO : Epoch 884 | loss: nan | val_loss: nan | Time: 3707.98 ms
[2021-04-16 04:56:05 main:574] : INFO : Epoch 885 | loss: nan | val_loss: nan | Time: 3696.14 ms
[2021-04-16 04:56:09 main:574] : INFO : Epoch 886 | loss: nan | val_loss: nan | Time: 3563.83 ms
[2021-04-16 04:56:13 main:574] : INFO : Epoch 887 | loss: nan | val_loss: nan | Time: 3791.91 ms
[2021-04-16 04:56:16 main:574] : INFO : Epoch 888 | loss: nan | val_loss: nan | Time: 3721.92 ms
[2021-04-16 04:56:20 main:574] : INFO : Epoch 889 | loss: nan | val_loss: nan | Time: 3408.46 ms
[2021-04-16 04:56:24 main:574] : INFO : Epoch 890 | loss: nan | val_loss: nan | Time: 3722.48 ms
[2021-04-16 04:56:27 main:574] : INFO : Epoch 891 | loss: nan | val_loss: nan | Time: 3421.47 ms
[2021-04-16 04:56:31 main:574] : INFO : Epoch 892 | loss: nan | val_loss: nan | Time: 3577.15 ms
[2021-04-16 04:56:35 main:574] : INFO : Epoch 893 | loss: nan | val_loss: nan | Time: 3619.72 ms
[2021-04-16 04:56:38 main:574] : INFO : Epoch 894 | loss: nan | val_loss: nan | Time: 3440.26 ms
[2021-04-16 04:56:42 main:574] : INFO : Epoch 895 | loss: nan | val_loss: nan | Time: 3746.98 ms
[2021-04-16 04:56:46 main:574] : INFO : Epoch 896 | loss: nan | val_loss: nan | Time: 3773.58 ms
[2021-04-16 04:56:50 main:574] : INFO : Epoch 897 | loss: nan | val_loss: nan | Time: 3490.8 ms
[2021-04-16 04:56:53 main:574] : INFO : Epoch 898 | loss: nan | val_loss: nan | Time: 3750.47 ms
[2021-04-16 04:56:57 main:574] : INFO : Epoch 899 | loss: nan | val_loss: nan | Time: 3552.5 ms
[2021-04-16 04:57:01 main:574] : INFO : Epoch 900 | loss: nan | val_loss: nan | Time: 3576.37 ms
[2021-04-16 04:57:05 main:574] : INFO : Epoch 901 | loss: nan | val_loss: nan | Time: 3683.43 ms
[2021-04-16 04:57:08 main:574] : INFO : Epoch 902 | loss: nan | val_loss: nan | Time: 3384.38 ms
[2021-04-16 04:57:12 main:574] : INFO : Epoch 903 | loss: nan | val_loss: nan | Time: 3466.69 ms
[2021-04-16 04:57:15 main:574] : INFO : Epoch 904 | loss: nan | val_loss: nan | Time: 3756.08 ms
[2021-04-16 04:57:19 main:574] : INFO : Epoch 905 | loss: nan | val_loss: nan | Time: 3570.67 ms
[2021-04-16 04:57:23 main:574] : INFO : Epoch 906 | loss: nan | val_loss: nan | Time: 3677.33 ms
[2021-04-16 04:57:27 main:574] : INFO : Epoch 907 | loss: nan | val_loss: nan | Time: 3627.2 ms
[2021-04-16 04:57:30 main:574] : INFO : Epoch 908 | loss: nan | val_loss: nan | Time: 3464.61 ms
[2021-04-16 04:57:34 main:574] : INFO : Epoch 909 | loss: nan | val_loss: nan | Time: 3715.48 ms
[2021-04-16 04:57:38 main:574] : INFO : Epoch 910 | loss: nan | val_loss: nan | Time: 3766.57 ms
[2021-04-16 04:57:41 main:574] : INFO : Epoch 911 | loss: nan | val_loss: nan | Time: 3522.45 ms
[2021-04-16 04:57:45 main:574] : INFO : Epoch 912 | loss: nan | val_loss: nan | Time: 3673.72 ms
[2021-04-16 04:57:49 main:574] : INFO : Epoch 913 | loss: nan | val_loss: nan | Time: 3708.93 ms
[2021-04-16 04:57:52 main:574] : INFO : Epoch 914 | loss: nan | val_loss: nan | Time: 3480.19 ms
[2021-04-16 04:57:56 main:574] : INFO : Epoch 915 | loss: nan | val_loss: nan | Time: 3759.16 ms
[2021-04-16 04:58:00 main:574] : INFO : Epoch 916 | loss: nan | val_loss: nan | Time: 3365.35 ms
[2021-04-16 04:58:04 main:574] : INFO : Epoch 917 | loss: nan | val_loss: nan | Time: 3738.56 ms
[2021-04-16 04:58:07 main:574] : INFO : Epoch 918 | loss: nan | val_loss: nan | Time: 3698.29 ms
[2021-04-16 04:58:11 main:574] : INFO : Epoch 919 | loss: nan | val_loss: nan | Time: 3499.27 ms
[2021-04-16 04:58:15 main:574] : INFO : Epoch 920 | loss: nan | val_loss: nan | Time: 3786.07 ms
[2021-04-16 04:58:19 main:574] : INFO : Epoch 921 | loss: nan | val_loss: nan | Time: 3701.37 ms
[2021-04-16 04:58:22 main:574] : INFO : Epoch 922 | loss: nan | val_loss: nan | Time: 3472.53 ms
[2021-04-16 04:58:26 main:574] : INFO : Epoch 923 | loss: nan | val_loss: nan | Time: 3737.86 ms
[2021-04-16 04:58:30 main:574] : INFO : Epoch 924 | loss: nan | val_loss: nan | Time: 3434.1 ms
[2021-04-16 04:58:33 main:574] : INFO : Epoch 925 | loss: nan | val_loss: nan | Time: 3656.01 ms
[2021-04-16 04:58:37 main:574] : INFO : Epoch 926 | loss: nan | val_loss: nan | Time: 3719.29 ms
[2021-04-16 04:58:41 main:574] : INFO : Epoch 927 | loss: nan | val_loss: nan | Time: 3471.21 ms
[2021-04-16 04:58:44 main:574] : INFO : Epoch 928 | loss: nan | val_loss: nan | Time: 3673.74 ms
[2021-04-16 04:58:48 main:574] : INFO : Epoch 929 | loss: nan | val_loss: nan | Time: 3607.19 ms
[2021-04-16 04:58:52 main:574] : INFO : Epoch 930 | loss: nan | val_loss: nan | Time: 3471.51 ms
[2021-04-16 04:58:55 main:574] : INFO : Epoch 931 | loss: nan | val_loss: nan | Time: 3631.04 ms
[2021-04-16 04:58:59 main:574] : INFO : Epoch 932 | loss: nan | val_loss: nan | Time: 3828.19 ms
[2021-04-16 04:59:03 main:574] : INFO : Epoch 933 | loss: nan | val_loss: nan | Time: 3693.48 ms
[2021-04-16 04:59:07 main:574] : INFO : Epoch 934 | loss: nan | val_loss: nan | Time: 3636.49 ms
[2021-04-16 04:59:10 main:574] : INFO : Epoch 935 | loss: nan | val_loss: nan | Time: 3423.72 ms
[2021-04-16 04:59:14 main:574] : INFO : Epoch 936 | loss: nan | val_loss: nan | Time: 3796.75 ms
[2021-04-16 04:59:18 main:574] : INFO : Epoch 937 | loss: nan | val_loss: nan | Time: 3684.76 ms
[2021-04-16 04:59:22 main:574] : INFO : Epoch 938 | loss: nan | val_loss: nan | Time: 3447.11 ms
[2021-04-16 04:59:26 main:574] : INFO : Epoch 939 | loss: nan | val_loss: nan | Time: 3802.49 ms
[2021-04-16 04:59:29 main:574] : INFO : Epoch 940 | loss: nan | val_loss: nan | Time: 3703.51 ms
[2021-04-16 04:59:33 main:574] : INFO : Epoch 941 | loss: nan | val_loss: nan | Time: 3521.22 ms
[2021-04-16 04:59:37 main:574] : INFO : Epoch 942 | loss: nan | val_loss: nan | Time: 3831.29 ms
[2021-04-16 04:59:40 main:574] : INFO : Epoch 943 | loss: nan | val_loss: nan | Time: 3358.48 ms
[2021-04-16 04:59:44 main:574] : INFO : Epoch 944 | loss: nan | val_loss: nan | Time: 3808.65 ms
[2021-04-16 04:59:48 main:574] : INFO : Epoch 945 | loss: nan | val_loss: nan | Time: 3790.05 ms
[2021-04-16 04:59:52 main:574] : INFO : Epoch 946 | loss: nan | val_loss: nan | Time: 3501.43 ms
[2021-04-16 04:59:55 main:574] : INFO : Epoch 947 | loss: nan | val_loss: nan | Time: 3733.53 ms
[2021-04-16 04:59:59 main:574] : INFO : Epoch 948 | loss: nan | val_loss: nan | Time: 3615.75 ms
[2021-04-16 05:00:03 main:574] : INFO : Epoch 949 | loss: nan | val_loss: nan | Time: 3445 ms
[2021-04-16 05:00:07 main:574] : INFO : Epoch 950 | loss: nan | val_loss: nan | Time: 3792.96 ms
[2021-04-16 05:00:10 main:574] : INFO : Epoch 951 | loss: nan | val_loss: nan | Time: 3385.75 ms
[2021-04-16 05:00:14 main:574] : INFO : Epoch 952 | loss: nan | val_loss: nan | Time: 3669.74 ms
[2021-04-16 05:00:18 main:574] : INFO : Epoch 953 | loss: nan | val_loss: nan | Time: 3699.93 ms
[2021-04-16 05:00:21 main:574] : INFO : Epoch 954 | loss: nan | val_loss: nan | Time: 3513.07 ms
[2021-04-16 05:00:25 main:574] : INFO : Epoch 955 | loss: nan | val_loss: nan | Time: 3727.02 ms
[2021-04-16 05:00:29 main:574] : INFO : Epoch 956 | loss: nan | val_loss: nan | Time: 3750.17 ms
[2021-04-16 05:00:32 main:574] : INFO : Epoch 957 | loss: nan | val_loss: nan | Time: 3456.49 ms
[2021-04-16 05:00:36 main:574] : INFO : Epoch 958 | loss: nan | val_loss: nan | Time: 3715.82 ms
[2021-04-16 05:00:40 main:574] : INFO : Epoch 959 | loss: nan | val_loss: nan | Time: 3520.87 ms
[2021-04-16 05:00:44 main:574] : INFO : Epoch 960 | loss: nan | val_loss: nan | Time: 3618.05 ms
[2021-04-16 05:00:47 main:574] : INFO : Epoch 961 | loss: nan | val_loss: nan | Time: 3732.96 ms
[2021-04-16 05:00:51 main:574] : INFO : Epoch 962 | loss: nan | val_loss: nan | Time: 3426.29 ms
[2021-04-16 05:00:55 main:574] : INFO : Epoch 963 | loss: nan | val_loss: nan | Time: 3639.96 ms
[2021-04-16 05:00:58 main:574] : INFO : Epoch 964 | loss: nan | val_loss: nan | Time: 3768.74 ms
[2021-04-16 05:01:02 main:574] : INFO : Epoch 965 | loss: nan | val_loss: nan | Time: 3560.5 ms
[2021-04-16 05:01:06 main:574] : INFO : Epoch 966 | loss: nan | val_loss: nan | Time: 3664.49 ms
[2021-04-16 05:01:10 main:574] : INFO : Epoch 967 | loss: nan | val_loss: nan | Time: 3588.32 ms
[2021-04-16 05:01:13 main:574] : INFO : Epoch 968 | loss: nan | val_loss: nan | Time: 3596.08 ms
[2021-04-16 05:01:17 main:574] : INFO : Epoch 969 | loss: nan | val_loss: nan | Time: 3682.56 ms
[2021-04-16 05:01:21 main:574] : INFO : Epoch 970 | loss: nan | val_loss: nan | Time: 3503.59 ms
[2021-04-16 05:01:25 main:574] : INFO : Epoch 971 | loss: nan | val_loss: nan | Time: 3970.25 ms
[2021-04-16 05:01:29 main:574] : INFO : Epoch 972 | loss: nan | val_loss: nan | Time: 3734.91 ms
[2021-04-16 05:01:32 main:574] : INFO : Epoch 973 | loss: nan | val_loss: nan | Time: 3582.43 ms
[2021-04-16 05:01:36 main:574] : INFO : Epoch 974 | loss: nan | val_loss: nan | Time: 3736.63 ms
[2021-04-16 05:01:40 main:574] : INFO : Epoch 975 | loss: nan | val_loss: nan | Time: 3574.35 ms
[2021-04-16 05:01:43 main:574] : INFO : Epoch 976 | loss: nan | val_loss: nan | Time: 3599.41 ms
[2021-04-16 05:01:47 main:574] : INFO : Epoch 977 | loss: nan | val_loss: nan | Time: 3661.35 ms
[2021-04-16 05:01:51 main:574] : INFO : Epoch 978 | loss: nan | val_loss: nan | Time: 3386.48 ms
[2021-04-16 05:01:54 main:574] : INFO : Epoch 979 | loss: nan | val_loss: nan | Time: 3743.68 ms
[2021-04-16 05:01:58 main:574] : INFO : Epoch 980 | loss: nan | val_loss: nan | Time: 3710.55 ms
[2021-04-16 05:02:02 main:574] : INFO : Epoch 981 | loss: nan | val_loss: nan | Time: 3422.97 ms
[2021-04-16 05:02:06 main:574] : INFO : Epoch 982 | loss: nan | val_loss: nan | Time: 3728.66 ms
[2021-04-16 05:02:10 main:574] : INFO : Epoch 983 | loss: nan | val_loss: nan | Time: 3704.27 ms
[2021-04-16 05:02:13 main:574] : INFO : Epoch 984 | loss: nan | val_loss: nan | Time: 3526.67 ms
[2021-04-16 05:02:17 main:574] : INFO : Epoch 985 | loss: nan | val_loss: nan | Time: 3650.88 ms
[2021-04-16 05:02:21 main:574] : INFO : Epoch 986 | loss: nan | val_loss: nan | Time: 3828.68 ms
[2021-04-16 05:02:25 main:574] : INFO : Epoch 987 | loss: nan | val_loss: nan | Time: 3658.4 ms
[2021-04-16 05:02:28 main:574] : INFO : Epoch 988 | loss: nan | val_loss: nan | Time: 3730.87 ms
[2021-04-16 05:02:32 main:574] : INFO : Epoch 989 | loss: nan | val_loss: nan | Time: 3441.27 ms
[2021-04-16 05:02:36 main:574] : INFO : Epoch 990 | loss: nan | val_loss: nan | Time: 3887.45 ms
[2021-04-16 05:02:40 main:574] : INFO : Epoch 991 | loss: nan | val_loss: nan | Time: 4146.79 ms
[2021-04-16 05:02:44 main:574] : INFO : Epoch 992 | loss: nan | val_loss: nan | Time: 3591.78 ms
[2021-04-16 05:02:48 main:574] : INFO : Epoch 993 | loss: nan | val_loss: nan | Time: 3675.43 ms
[2021-04-16 05:02:51 main:574] : INFO : Epoch 994 | loss: nan | val_loss: nan | Time: 3496.58 ms
[2021-04-16 05:02:55 main:574] : INFO : Epoch 995 | loss: nan | val_loss: nan | Time: 3727.5 ms
[2021-04-16 05:02:59 main:574] : INFO : Epoch 996 | loss: nan | val_loss: nan | Time: 3706.32 ms
[2021-04-16 05:03:02 main:574] : INFO : Epoch 997 | loss: nan | val_loss: nan | Time: 3455.52 ms
[2021-04-16 05:03:06 main:574] : INFO : Epoch 998 | loss: nan | val_loss: nan | Time: 3763.04 ms
[2021-04-16 05:03:10 main:574] : INFO : Epoch 999 | loss: nan | val_loss: nan | Time: 3727.94 ms
[2021-04-16 05:03:13 main:574] : INFO : Epoch 1000 | loss: nan | val_loss: nan | Time: 3447.16 ms
[2021-04-16 05:03:17 main:574] : INFO : Epoch 1001 | loss: nan | val_loss: nan | Time: 3759.48 ms
[2021-04-16 05:03:21 main:574] : INFO : Epoch 1002 | loss: nan | val_loss: nan | Time: 3569.03 ms
[2021-04-16 05:03:25 main:574] : INFO : Epoch 1003 | loss: nan | val_loss: nan | Time: 3649.98 ms
[2021-04-16 05:03:28 main:574] : INFO : Epoch 1004 | loss: nan | val_loss: nan | Time: 3679.83 ms
[2021-04-16 05:03:32 main:574] : INFO : Epoch 1005 | loss: nan | val_loss: nan | Time: 3519.18 ms
[2021-04-16 05:03:36 main:574] : INFO : Epoch 1006 | loss: nan | val_loss: nan | Time: 3819.24 ms
[2021-04-16 05:03:40 main:574] : INFO : Epoch 1007 | loss: nan | val_loss: nan | Time: 3726.21 ms
[2021-04-16 05:03:43 main:574] : INFO : Epoch 1008 | loss: nan | val_loss: nan | Time: 3484.38 ms
[2021-04-16 05:03:47 main:574] : INFO : Epoch 1009 | loss: nan | val_loss: nan | Time: 3717.85 ms
[2021-04-16 05:03:51 main:574] : INFO : Epoch 1010 | loss: nan | val_loss: nan | Time: 3559.78 ms
[2021-04-16 05:03:54 main:574] : INFO : Epoch 1011 | loss: nan | val_loss: nan | Time: 3665.56 ms
[2021-04-16 05:03:58 main:574] : INFO : Epoch 1012 | loss: nan | val_loss: nan | Time: 3737.41 ms
[2021-04-16 05:04:02 main:574] : INFO : Epoch 1013 | loss: nan | val_loss: nan | Time: 3447.52 ms
[2021-04-16 05:04:06 main:574] : INFO : Epoch 1014 | loss: nan | val_loss: nan | Time: 3647.63 ms
[2021-04-16 05:04:09 main:574] : INFO : Epoch 1015 | loss: nan | val_loss: nan | Time: 3827.92 ms
[2021-04-16 05:04:13 main:574] : INFO : Epoch 1016 | loss: nan | val_loss: nan | Time: 3574.92 ms
[2021-04-16 05:04:17 main:574] : INFO : Epoch 1017 | loss: nan | val_loss: nan | Time: 3768.11 ms
[2021-04-16 05:04:21 main:574] : INFO : Epoch 1018 | loss: nan | val_loss: nan | Time: 4001.33 ms
[2021-04-16 05:04:25 main:574] : INFO : Epoch 1019 | loss: nan | val_loss: nan | Time: 3567.92 ms
[2021-04-16 05:04:29 main:574] : INFO : Epoch 1020 | loss: nan | val_loss: nan | Time: 3724.98 ms
[2021-04-16 05:04:32 main:574] : INFO : Epoch 1021 | loss: nan | val_loss: nan | Time: 3520.83 ms
[2021-04-16 05:04:36 main:574] : INFO : Epoch 1022 | loss: nan | val_loss: nan | Time: 3670.68 ms
[2021-04-16 05:04:40 main:574] : INFO : Epoch 1023 | loss: nan | val_loss: nan | Time: 3769.29 ms
[2021-04-16 05:04:43 main:574] : INFO : Epoch 1024 | loss: nan | val_loss: nan | Time: 3361.79 ms
[2021-04-16 05:04:47 main:574] : INFO : Epoch 1025 | loss: nan | val_loss: nan | Time: 3740.43 ms
[2021-04-16 05:04:51 main:574] : INFO : Epoch 1026 | loss: nan | val_loss: nan | Time: 3751.05 ms
[2021-04-16 05:04:54 main:574] : INFO : Epoch 1027 | loss: nan | val_loss: nan | Time: 3528.38 ms
[2021-04-16 05:04:58 main:574] : INFO : Epoch 1028 | loss: nan | val_loss: nan | Time: 3695.12 ms
[2021-04-16 05:05:02 main:574] : INFO : Epoch 1029 | loss: nan | val_loss: nan | Time: 3618.14 ms
[2021-04-16 05:05:06 main:574] : INFO : Epoch 1030 | loss: nan | val_loss: nan | Time: 3593.54 ms
[2021-04-16 05:05:10 main:574] : INFO : Epoch 1031 | loss: nan | val_loss: nan | Time: 3656.91 ms
[2021-04-16 05:05:13 main:574] : INFO : Epoch 1032 | loss: nan | val_loss: nan | Time: 3466.59 ms
[2021-04-16 05:05:17 main:574] : INFO : Epoch 1033 | loss: nan | val_loss: nan | Time: 3692.4 ms
[2021-04-16 05:05:21 main:574] : INFO : Epoch 1034 | loss: nan | val_loss: nan | Time: 3778.26 ms
[2021-04-16 05:05:24 main:574] : INFO : Epoch 1035 | loss: nan | val_loss: nan | Time: 3548.6 ms
[2021-04-16 05:05:28 main:574] : INFO : Epoch 1036 | loss: nan | val_loss: nan | Time: 3712.03 ms
[2021-04-16 05:05:32 main:574] : INFO : Epoch 1037 | loss: nan | val_loss: nan | Time: 3566.9 ms
[2021-04-16 05:05:35 main:574] : INFO : Epoch 1038 | loss: nan | val_loss: nan | Time: 3571.02 ms
[2021-04-16 05:05:39 main:574] : INFO : Epoch 1039 | loss: nan | val_loss: nan | Time: 3716.55 ms
[2021-04-16 05:05:43 main:574] : INFO : Epoch 1040 | loss: nan | val_loss: nan | Time: 3478.82 ms
[2021-04-16 05:05:47 main:574] : INFO : Epoch 1041 | loss: nan | val_loss: nan | Time: 3667.36 ms
[2021-04-16 05:05:50 main:574] : INFO : Epoch 1042 | loss: nan | val_loss: nan | Time: 3668 ms
[2021-04-16 05:05:54 main:574] : INFO : Epoch 1043 | loss: nan | val_loss: nan | Time: 3417.81 ms
[2021-04-16 05:05:58 main:574] : INFO : Epoch 1044 | loss: nan | val_loss: nan | Time: 3709.02 ms
[2021-04-16 05:06:02 main:574] : INFO : Epoch 1045 | loss: nan | val_loss: nan | Time: 3820.04 ms
[2021-04-16 05:06:05 main:574] : INFO : Epoch 1046 | loss: nan | val_loss: nan | Time: 3520.91 ms
[2021-04-16 05:06:09 main:574] : INFO : Epoch 1047 | loss: nan | val_loss: nan | Time: 3718.9 ms
[2021-04-16 05:06:13 main:574] : INFO : Epoch 1048 | loss: nan | val_loss: nan | Time: 3406.17 ms
[2021-04-16 05:06:16 main:574] : INFO : Epoch 1049 | loss: nan | val_loss: nan | Time: 3643.66 ms
[2021-04-16 05:06:20 main:574] : INFO : Epoch 1050 | loss: nan | val_loss: nan | Time: 3655.21 ms
[2021-04-16 05:06:24 main:574] : INFO : Epoch 1051 | loss: nan | val_loss: nan | Time: 3481.62 ms
[2021-04-16 05:06:28 main:574] : INFO : Epoch 1052 | loss: nan | val_loss: nan | Time: 3980.65 ms
[2021-04-16 05:06:32 main:574] : INFO : Epoch 1053 | loss: nan | val_loss: nan | Time: 4120.58 ms
[2021-04-16 05:06:36 main:574] : INFO : Epoch 1054 | loss: nan | val_loss: nan | Time: 3653.39 ms
[2021-04-16 05:06:40 main:574] : INFO : Epoch 1055 | loss: nan | val_loss: nan | Time: 3718.78 ms
[2021-04-16 05:06:43 main:574] : INFO : Epoch 1056 | loss: nan | val_loss: nan | Time: 3491.03 ms
[2021-04-16 05:06:47 main:574] : INFO : Epoch 1057 | loss: nan | val_loss: nan | Time: 3592.03 ms
[2021-04-16 05:06:51 main:574] : INFO : Epoch 1058 | loss: nan | val_loss: nan | Time: 3621.79 ms
[2021-04-16 05:06:54 main:574] : INFO : Epoch 1059 | loss: nan | val_loss: nan | Time: 3493.44 ms
[2021-04-16 05:06:58 main:574] : INFO : Epoch 1060 | loss: nan | val_loss: nan | Time: 3724.57 ms
[2021-04-16 05:07:02 main:574] : INFO : Epoch 1061 | loss: nan | val_loss: nan | Time: 3801.43 ms
[2021-04-16 05:07:06 main:574] : INFO : Epoch 1062 | loss: nan | val_loss: nan | Time: 3469.95 ms
[2021-04-16 05:07:09 main:574] : INFO : Epoch 1063 | loss: nan | val_loss: nan | Time: 3762.46 ms
[2021-04-16 05:07:13 main:574] : INFO : Epoch 1064 | loss: nan | val_loss: nan | Time: 3379.8 ms
[2021-04-16 05:07:17 main:574] : INFO : Epoch 1065 | loss: nan | val_loss: nan | Time: 3749.39 ms
[2021-04-16 05:07:21 main:574] : INFO : Epoch 1066 | loss: nan | val_loss: nan | Time: 3668.58 ms
[2021-04-16 05:07:24 main:574] : INFO : Epoch 1067 | loss: nan | val_loss: nan | Time: 3410.07 ms
[2021-04-16 05:07:28 main:574] : INFO : Epoch 1068 | loss: nan | val_loss: nan | Time: 3879.21 ms
[2021-04-16 05:07:32 main:574] : INFO : Epoch 1069 | loss: nan | val_loss: nan | Time: 4013.15 ms
[2021-04-16 05:07:36 main:574] : INFO : Epoch 1070 | loss: nan | val_loss: nan | Time: 3575.69 ms
[2021-04-16 05:07:40 main:574] : INFO : Epoch 1071 | loss: nan | val_loss: nan | Time: 3653.72 ms
[2021-04-16 05:07:43 main:574] : INFO : Epoch 1072 | loss: nan | val_loss: nan | Time: 3400.14 ms
[2021-04-16 05:07:47 main:574] : INFO : Epoch 1073 | loss: nan | val_loss: nan | Time: 3660.79 ms
[2021-04-16 05:07:51 main:574] : INFO : Epoch 1074 | loss: nan | val_loss: nan | Time: 3752.82 ms
[2021-04-16 05:07:54 main:574] : INFO : Epoch 1075 | loss: nan | val_loss: nan | Time: 3433.79 ms
[2021-04-16 05:07:58 main:574] : INFO : Epoch 1076 | loss: nan | val_loss: nan | Time: 3708.82 ms
[2021-04-16 05:08:02 main:574] : INFO : Epoch 1077 | loss: nan | val_loss: nan | Time: 3676.25 ms
[2021-04-16 05:08:05 main:574] : INFO : Epoch 1078 | loss: nan | val_loss: nan | Time: 3491.48 ms
[2021-04-16 05:08:09 main:574] : INFO : Epoch 1079 | loss: nan | val_loss: nan | Time: 3736.38 ms
[2021-04-16 05:08:13 main:574] : INFO : Epoch 1080 | loss: nan | val_loss: nan | Time: 3483.38 ms
[2021-04-16 05:08:17 main:574] : INFO : Epoch 1081 | loss: nan | val_loss: nan | Time: 3611.06 ms
[2021-04-16 05:08:20 main:574] : INFO : Epoch 1082 | loss: nan | val_loss: nan | Time: 3700.81 ms
[2021-04-16 05:08:24 main:574] : INFO : Epoch 1083 | loss: nan | val_loss: nan | Time: 3432.99 ms
[2021-04-16 05:08:28 main:574] : INFO : Epoch 1084 | loss: nan | val_loss: nan | Time: 3766.69 ms
[2021-04-16 05:08:32 main:574] : INFO : Epoch 1085 | loss: nan | val_loss: nan | Time: 3766.28 ms
[2021-04-16 05:08:35 main:574] : INFO : Epoch 1086 | loss: nan | val_loss: nan | Time: 3478.49 ms
[2021-04-16 05:08:39 main:574] : INFO : Epoch 1087 | loss: nan | val_loss: nan | Time: 3761.79 ms
[2021-04-16 05:08:43 main:574] : INFO : Epoch 1088 | loss: nan | val_loss: nan | Time: 3462.01 ms
[2021-04-16 05:08:46 main:574] : INFO : Epoch 1089 | loss: nan | val_loss: nan | Time: 3693.96 ms
[2021-04-16 05:08:50 main:574] : INFO : Epoch 1090 | loss: nan | val_loss: nan | Time: 3859.07 ms
[2021-04-16 05:08:54 main:574] : INFO : Epoch 1091 | loss: nan | val_loss: nan | Time: 3497.45 ms
[2021-04-16 05:08:58 main:574] : INFO : Epoch 1092 | loss: nan | val_loss: nan | Time: 3694.53 ms
[2021-04-16 05:09:02 main:574] : INFO : Epoch 1093 | loss: nan | val_loss: nan | Time: 3753.12 ms
[2021-04-16 05:09:05 main:574] : INFO : Epoch 1094 | loss: nan | val_loss: nan | Time: 3572.01 ms
[2021-04-16 05:09:09 main:574] : INFO : Epoch 1095 | loss: nan | val_loss: nan | Time: 3708.97 ms
[2021-04-16 05:09:13 main:574] : INFO : Epoch 1096 | loss: nan | val_loss: nan | Time: 3532.59 ms
[2021-04-16 05:09:16 main:574] : INFO : Epoch 1097 | loss: nan | val_loss: nan | Time: 3608.54 ms
[2021-04-16 05:09:20 main:574] : INFO : Epoch 1098 | loss: nan | val_loss: nan | Time: 3730.48 ms
[2021-04-16 05:09:24 main:574] : INFO : Epoch 1099 | loss: nan | val_loss: nan | Time: 3382.21 ms
[2021-04-16 05:09:27 main:574] : INFO : Epoch 1100 | loss: nan | val_loss: nan | Time: 3721.4 ms
[2021-04-16 05:09:31 main:574] : INFO : Epoch 1101 | loss: nan | val_loss: nan | Time: 3719.71 ms
[2021-04-16 05:09:35 main:574] : INFO : Epoch 1102 | loss: nan | val_loss: nan | Time: 3486.02 ms
[2021-04-16 05:09:39 main:574] : INFO : Epoch 1103 | loss: nan | val_loss: nan | Time: 3739.36 ms
[2021-04-16 05:09:43 main:574] : INFO : Epoch 1104 | loss: nan | val_loss: nan | Time: 3738.4 ms
[2021-04-16 05:09:46 main:574] : INFO : Epoch 1105 | loss: nan | val_loss: nan | Time: 3466.56 ms
[2021-04-16 05:09:50 main:574] : INFO : Epoch 1106 | loss: nan | val_loss: nan | Time: 3763.96 ms
[2021-04-16 05:09:53 main:574] : INFO : Epoch 1107 | loss: nan | val_loss: nan | Time: 3528.52 ms
[2021-04-16 05:09:57 main:574] : INFO : Epoch 1108 | loss: nan | val_loss: nan | Time: 3626.19 ms
[2021-04-16 05:10:01 main:574] : INFO : Epoch 1109 | loss: nan | val_loss: nan | Time: 3717.53 ms
[2021-04-16 05:10:05 main:574] : INFO : Epoch 1110 | loss: nan | val_loss: nan | Time: 3501.27 ms
[2021-04-16 05:10:08 main:574] : INFO : Epoch 1111 | loss: nan | val_loss: nan | Time: 3741.25 ms
[2021-04-16 05:10:12 main:574] : INFO : Epoch 1112 | loss: nan | val_loss: nan | Time: 3797.93 ms
[2021-04-16 05:10:16 main:574] : INFO : Epoch 1113 | loss: nan | val_loss: nan | Time: 3511.61 ms
[2021-04-16 05:10:20 main:574] : INFO : Epoch 1114 | loss: nan | val_loss: nan | Time: 3784.69 ms
[2021-04-16 05:10:23 main:574] : INFO : Epoch 1115 | loss: nan | val_loss: nan | Time: 3421.92 ms
[2021-04-16 05:10:27 main:574] : INFO : Epoch 1116 | loss: nan | val_loss: nan | Time: 3507.09 ms
[2021-04-16 05:10:31 main:574] : INFO : Epoch 1117 | loss: nan | val_loss: nan | Time: 3683.09 ms
[2021-04-16 05:10:34 main:574] : INFO : Epoch 1118 | loss: nan | val_loss: nan | Time: 3421.45 ms
[2021-04-16 05:10:38 main:574] : INFO : Epoch 1119 | loss: nan | val_loss: nan | Time: 3800.46 ms
[2021-04-16 05:10:42 main:574] : INFO : Epoch 1120 | loss: nan | val_loss: nan | Time: 3653.95 ms
[2021-04-16 05:10:45 main:574] : INFO : Epoch 1121 | loss: nan | val_loss: nan | Time: 3502.17 ms
[2021-04-16 05:10:49 main:574] : INFO : Epoch 1122 | loss: nan | val_loss: nan | Time: 3706.7 ms
[2021-04-16 05:10:53 main:574] : INFO : Epoch 1123 | loss: nan | val_loss: nan | Time: 3578.11 ms
[2021-04-16 05:10:57 main:574] : INFO : Epoch 1124 | loss: nan | val_loss: nan | Time: 3529.58 ms
[2021-04-16 05:11:00 main:574] : INFO : Epoch 1125 | loss: nan | val_loss: nan | Time: 3754.74 ms
[2021-04-16 05:11:04 main:574] : INFO : Epoch 1126 | loss: nan | val_loss: nan | Time: 3337 ms
[2021-04-16 05:11:08 main:574] : INFO : Epoch 1127 | loss: nan | val_loss: nan | Time: 3650.48 ms
[2021-04-16 05:11:11 main:574] : INFO : Epoch 1128 | loss: nan | val_loss: nan | Time: 3692.84 ms
[2021-04-16 05:11:15 main:574] : INFO : Epoch 1129 | loss: nan | val_loss: nan | Time: 3509.52 ms
[2021-04-16 05:11:19 main:574] : INFO : Epoch 1130 | loss: nan | val_loss: nan | Time: 3674.68 ms
[2021-04-16 05:11:23 main:574] : INFO : Epoch 1131 | loss: nan | val_loss: nan | Time: 3752.51 ms
[2021-04-16 05:11:26 main:574] : INFO : Epoch 1132 | loss: nan | val_loss: nan | Time: 3514.37 ms
[2021-04-16 05:11:30 main:574] : INFO : Epoch 1133 | loss: nan | val_loss: nan | Time: 3750.52 ms
[2021-04-16 05:11:34 main:574] : INFO : Epoch 1134 | loss: nan | val_loss: nan | Time: 3396.12 ms
[2021-04-16 05:11:37 main:574] : INFO : Epoch 1135 | loss: nan | val_loss: nan | Time: 3607.82 ms
[2021-04-16 05:11:41 main:574] : INFO : Epoch 1136 | loss: nan | val_loss: nan | Time: 3757.63 ms
[2021-04-16 05:11:45 main:574] : INFO : Epoch 1137 | loss: nan | val_loss: nan | Time: 3453.26 ms
[2021-04-16 05:11:49 main:574] : INFO : Epoch 1138 | loss: nan | val_loss: nan | Time: 3695.87 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1060 6GB)
[2021-04-16 06:10:26 main:435] : INFO : Set logging level to 1
[2021-04-16 06:10:26 main:441] : INFO : Running in BOINC Client mode
[2021-04-16 06:10:26 main:444] : INFO : Resolving all filenames
[2021-04-16 06:10:26 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 (exists = 1)
[2021-04-16 06:10:26 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1617250194-29400-1_0_r2100920282_1 (exists = 1)
[2021-04-16 06:10:26 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1617250194-29400-1_0_r2100920282_0 (exists = 0)
[2021-04-16 06:10:26 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1617250194-29400-1 (exists = 1)
[2021-04-16 06:10:26 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-04-16 06:10:26 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5
[2021-04-16 06:10:26 main:474] : INFO : Configuration:
[2021-04-16 06:10:26 main:475] : INFO : Model type: GRU
[2021-04-16 06:10:27 main:476] : INFO : Validation Loss Threshold: 0.0001
[2021-04-16 06:10:27 main:477] : INFO : Max Epochs: 2048
[2021-04-16 06:10:27 main:478] : INFO : Batch Size: 128
[2021-04-16 06:10:27 main:479] : INFO : Learning Rate: 0.01
[2021-04-16 06:10:27 main:480] : INFO : Patience: 10
[2021-04-16 06:10:27 main:481] : INFO : Hidden Width: 12
[2021-04-16 06:10:27 main:482] : INFO : # Recurrent Layers: 4
[2021-04-16 06:10:27 main:483] : INFO : # Backend Layers: 4
[2021-04-16 06:10:27 main:484] : INFO : # Threads: 1
[2021-04-16 06:10:27 main:486] : INFO : Preparing Dataset
[2021-04-16 06:10:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-04-16 06:10:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-04-16 06:10:37 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2021-04-16 06:10:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-04-16 06:10:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-04-16 06:10:37 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2021-04-16 06:10:37 main:494] : INFO : Creating Model
[2021-04-16 06:10:37 main:507] : INFO : Preparing config file
[2021-04-16 06:10:37 main:511] : INFO : Found checkpoint, attempting to load...
[2021-04-16 06:10:37 main:512] : INFO : Loading config
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFB54ED4B59
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/16/21 06:10:38
Install Directory : D:\Program Files\
Data Directory : D:\ProgramData
Project Symstore :
LoadLibraryA( D:\ProgramData\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( D:\ProgramData\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: D:\ProgramData\slots\6;D:\ProgramData\projects\www.mlcathome.org_mlcathome
ModLoad: 0000000083f40000 00000000003df000 D:\ProgramData\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000572d0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.928) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.804 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.804
ModLoad: 0000000055a00000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.928) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.804 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.804
ModLoad: 0000000054ea0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.804 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.804
ModLoad: 0000000030100000 00000000000f1000 C:\Program Files\Bitdefender\Bitdefender Security\atcuf\265221302066127204\atcuf64.dll (1.40.291.0) (-exported- Symbols Loaded)
Linked PDB Filename : E:\builds\ATC-DEFAULT-SOURCES\bin\x64\Release\atcuf64\atcuf64.pdb
File Version : 1.40.291.0 #0xd59eaa1
Company Name : Bitdefender S.R.L. Bucharest, ROMANIA
Product Name : Bitdefender® ATC
Product Version : 13
ModLoad: 0000000055440000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000552b0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000055c50000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.746 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.746
ModLoad: 00000000551a0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.928) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.928 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.928
ModLoad: 0000000054af0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000054cf0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000571e0000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000055720000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000055960000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000056a50000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.928) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000041c80000 0000000000058000 D:\ProgramData\slots\6\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000051f40000 0000000024b49000 D:\ProgramData\slots\6\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f6560000 000000000abe7000 D:\ProgramData\slots\6\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000041a20000 0000000000092000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29301.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\agent\_work\26\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.28.29301.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29301.0
ModLoad: 000000004d5c0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 0000000043ed0000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29301.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\agent\_work\26\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.28.29301.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29301.0
ModLoad: 0000000041a10000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29301.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\agent\_work\26\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.28.29301.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29301.0
ModLoad: 0000000041eb0000 0000000000045000 D:\ProgramData\slots\6\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000007240000 00000000030a5000 D:\ProgramData\slots\6\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000003d80000 00000000034b2000 D:\ProgramData\slots\6\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000082900000 000000001b3a4000 D:\ProgramData\slots\6\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 0000000050840000 0000000000010000 D:\ProgramData\slots\6\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000ed3c0000 000000000919f000 D:\ProgramData\slots\6\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000bb4d0000 0000000003d5b000 D:\ProgramData\slots\6\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000309b0000 000000000020d000 D:\ProgramData\slots\6\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000003aa0000 00000000002db000 D:\ProgramData\slots\6\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ea2f0000 0000000001eca000 D:\ProgramData\slots\6\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000004a100000 0000000000040000 D:\ProgramData\slots\6\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000571b0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000052890000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000056d40000 0000000000469000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000552e0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000055170000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000054750000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000054a10000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.804) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.804 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.804
ModLoad: 0000000054b90000 000000000015f000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000054590000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000056300000 0000000000742000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.329 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.329
ModLoad: 0000000052b70000 0000000000791000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000055df0000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.928) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000543b0000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000055650000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000055900000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000000eb80000 000000000029d000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.6140) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r461_36\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.6140
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.135 driver
Product Version : 27.21.14.6140
ModLoad: 000000004f710000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000e3d80000 00000000015c2000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispsi.inf_amd64_5e5ddf14f45dc8f6\nvcuda64.dll (27.21.14.6140) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r461_36\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.6140
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.135 driver
Product Version : 27.21.14.6140
ModLoad: 0000000055be0000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000004c560000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000054310000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000524b0000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000478a0000 00000000006f1000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.6140) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r461_36\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.6140
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.6140
ModLoad: 00000000557d0000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000054a70000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3634, Write: 309, Other 886
- I/O Transfers Counters -
Read: 6619178, Write: 7289, Other 38748
- Paged Pool Usage -
QuotaPagedPoolUsage: 3448232, QuotaPeakPagedPoolUsage: 3448232
QuotaNonPagedPoolUsage: 40792, QuotaPeakNonPagedPoolUsage: 40920
- Virtual Memory Usage -
VirtualSize: -1416663040, PeakVirtualSize: -819642368
- Pagefile Usage -
PagefileUsage: -1416663040, PeakPagefileUsage: -1416663040
- Working Set Size -
WorkingSetSize: 1169833984, PeakWorkingSetSize: 1169838080, PageFaultCount: 399102
*** Dump of thread ID 7952 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 5781250.000000, User Time: 29375000.000000, Wait Time: 7876390.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFB54ED4B59
- Registers -
rax=0000000051160150 rbx=00000000842a4910 rcx=0000000000000000 rdx=00000000000003ff rsi=000000009dce6440 rdi=0000000019930520
r8=00000000000000b3 r9=0000000000000040 r10=0000000051140cc0 r11=0000000051160320 r12=000000003224cdc0 r13=000000009dce6650
r14=0000000084b3c860 r15=0000000000000000 rip=0000000054ed4b59 rsp=000000009dce62e0 rbp=000000009dce65d0
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
9dce63b0 841ba884 00000040 0000004f 3224cf00 9dce6478 KERNELBASE!RaiseException+0x0
9dce6410 83f61ca6 85592c80 da9a509a 855946e0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9dce64c0 83f6593b 00000074 9dce6728 00000800 00000001 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9dce6610 83f61a78 00000000 00000000 9dce6940 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9dce66e0 83f61cfc 9dce6940 00000000 00000080 9dce6c10 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9dce67a0 83f6c4dd 9dce6c10 9dce6c10 9dce6c10 9dce6c10 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9dce6a90 83f5b2fe 9dce70a8 9dce6c10 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9dcff830 8419c6f8 781238a0 00000000 00000000 7814e210 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9dcff870 55a17034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9dcff8a0 57322651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9dcff920 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 2212 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 7876386.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000009deff7f0 rsi=0000000000000000 rdi=0000000000000064
r8=000000000000000f r9=000000009defe8b8 r10=0000000000000020 r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000005736d3a4 rsp=000000009deff7c8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9deff7c0 54ee907e 9deff888 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0
9deff860 83f7a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
9deff890 55a17034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9deff8c0 57322651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9deff940 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12308 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 7876387.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=000000009dfff430 rsi=0000000000000000 rdi=000000000000000d
r8=000000009dfff0d8 r9=0000000078335be0 r10=0000000000000000 r11=000000009dfff3a0 r12=0000000000000064 r13=000000009dfff430
r14=000000009dfff130 r15=0000000000000000 rip=000000005736d874 rsp=000000009dfff0d8 rbp=0000000078335be0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9dfff0d0 54eec570 9dfff600 514a0000 301e2160 30111487 ntdll!ZwWaitForMultipleObjects+0x0
9dfff3c0 54eec46e 5116f5a0 00000000 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
9dfff400 e3f36714 7833ac20 00000000 00000000 51b4d170 KERNELBASE!WaitForMultipleObjects+0x0
9dfff640 e3fce55d 00000000 78335be0 00000000 00000000 nvcuda64!+0x0
9dfff6f0 e3f360e3 8b4009fb 865eae61 78917680 00000000 nvcuda64!cuProfilerStop+0x0
9dfff720 e424d9d4 78917680 00000000 00000000 00000000 nvcuda64!+0x0
9dfff750 55a17034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
9dfff780 57322651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9dfff800 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 4164 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 7875916.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002a4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002a4
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=00000000000002a4 r15=0000000000000000 rip=000000005736cda4 rsp=000000009e0ffac8 rbp=000000007831f660
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9e0ffac0 54ec165e 789173b0 e3d80000 00000001 000002b8 ntdll!NtWaitForSingleObject+0x0
9e0ffb60 e414cfae 789173b0 00000000 00000000 000002a4 KERNELBASE!WaitForSingleObjectEx+0x0
9e0ffbd0 e3f360e3 7831f660 78e16e30 789173b0 00000000 nvcuda64!cuProfilerStop+0x0
9e0ffc00 e424d9d4 789173b0 00000000 00000000 00000000 nvcuda64!+0x0
9e0ffc30 55a17034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
9e0ffc60 57322651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9e0ffce0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 9892 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 7876380.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000785bf298 rdx=000000009e1ffdc8 rsi=000000009e1ffd30 rdi=0000000000000000
r8=000000009e1ffd08 r9=000000009e1ffd60 r10=0000000000000000 r11=0000000000000246 r12=000000009e1ffdc8 r13=0000000000000000
r14=00000000785bf298 r15=00000000785c3e70 rip=0000000057370714 rsp=000000009e1ffd08 rbp=000000009e1ffd60
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9e1ffd00 57334295 00000102 00000102 00000000 9e1ffd30 ntdll!ZwWaitForAlertByThreadId+0x0
9e1ffd70 54f0c819 785c1650 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
9e1ffda0 e3eb4a9c 785c1650 785c1650 785c1650 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
9e1ffe00 e3f360e3 00000004 8a992c4e 8b367d24 00000000 nvcuda64!+0x0
9e1ffe30 e424d9d4 789172c0 00000000 00000000 00000000 nvcuda64!+0x0
9e1ffe60 55a17034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
9e1ffe90 57322651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9e1fff10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)