Task 14413241
| Name | ParityModified-1647049376-5105-2-0_0 |
| Workunit | 11456916 |
| Created | 5 Apr 2022, 23:43:07 UTC |
| Sent | 10 Apr 2022, 11:36:44 UTC |
| Report deadline | 18 Apr 2022, 11:36:44 UTC |
| Received | 14 Apr 2022, 1:27:19 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 21690 |
| Run time | 6 hours 28 min 16 sec |
| CPU time | 1 hours 56 min 53 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 11,433.61 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.77 GB |
| Peak swap size | 4.54 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 23293.05 (4000000.00G/171.73G)</message>
<stderr_txt>
val_loss: 0.0311543 | Time: 4439.58 ms
[2022-04-14 09:05:35 main:574] : INFO : Epoch 968 | loss: 0.0310765 | val_loss: 0.0311607 | Time: 4502.05 ms
[2022-04-14 09:05:40 main:574] : INFO : Epoch 969 | loss: 0.0310771 | val_loss: 0.0311573 | Time: 4390.84 ms
[2022-04-14 09:05:45 main:574] : INFO : Epoch 970 | loss: 0.0310802 | val_loss: 0.0311616 | Time: 4634.75 ms
[2022-04-14 09:05:50 main:574] : INFO : Epoch 971 | loss: 0.03109 | val_loss: 0.0311533 | Time: 4522.85 ms
[2022-04-14 09:05:55 main:574] : INFO : Epoch 972 | loss: 0.031088 | val_loss: 0.0311596 | Time: 4550.47 ms
[2022-04-14 09:06:00 main:574] : INFO : Epoch 973 | loss: 0.0310843 | val_loss: 0.0311548 | Time: 4487.01 ms
[2022-04-14 09:06:05 main:574] : INFO : Epoch 974 | loss: 0.0310841 | val_loss: 0.0311621 | Time: 4425.23 ms
[2022-04-14 09:06:11 main:574] : INFO : Epoch 975 | loss: 0.0310908 | val_loss: 0.0311681 | Time: 4469.32 ms
[2022-04-14 09:06:15 main:574] : INFO : Epoch 976 | loss: 0.0310884 | val_loss: 0.0311542 | Time: 4399.52 ms
[2022-04-14 09:06:20 main:574] : INFO : Epoch 977 | loss: 0.0310858 | val_loss: 0.0311558 | Time: 4545.45 ms
[2022-04-14 09:06:26 main:574] : INFO : Epoch 978 | loss: 0.0310868 | val_loss: 0.0311566 | Time: 4478.56 ms
[2022-04-14 09:06:31 main:574] : INFO : Epoch 979 | loss: 0.0310891 | val_loss: 0.0311597 | Time: 4501.87 ms
[2022-04-14 09:06:36 main:574] : INFO : Epoch 980 | loss: 0.0310827 | val_loss: 0.0311543 | Time: 4552.87 ms
[2022-04-14 09:06:41 main:574] : INFO : Epoch 981 | loss: 0.031081 | val_loss: 0.0311502 | Time: 4546.86 ms
[2022-04-14 09:06:46 main:574] : INFO : Epoch 982 | loss: 0.0310797 | val_loss: 0.0311508 | Time: 4444.23 ms
[2022-04-14 09:06:51 main:574] : INFO : Epoch 983 | loss: 0.0310774 | val_loss: 0.0311493 | Time: 4464.91 ms
[2022-04-14 09:06:56 main:574] : INFO : Epoch 984 | loss: 0.0310767 | val_loss: 0.0311527 | Time: 4432.76 ms
[2022-04-14 09:07:01 main:574] : INFO : Epoch 985 | loss: 0.0310791 | val_loss: 0.0311514 | Time: 4530.35 ms
[2022-04-14 09:07:06 main:574] : INFO : Epoch 986 | loss: 0.0310792 | val_loss: 0.0311577 | Time: 4384 ms
[2022-04-14 09:07:12 main:574] : INFO : Epoch 987 | loss: 0.0310785 | val_loss: 0.0311595 | Time: 4814.89 ms
[2022-04-14 09:07:17 main:574] : INFO : Epoch 988 | loss: 0.0310918 | val_loss: 0.031181 | Time: 4387.37 ms
[2022-04-14 09:07:22 main:574] : INFO : Epoch 989 | loss: 0.0311422 | val_loss: 0.0311627 | Time: 4407.97 ms
[2022-04-14 09:07:27 main:574] : INFO : Epoch 990 | loss: 0.0311272 | val_loss: 0.0311478 | Time: 4533.27 ms
[2022-04-14 09:07:32 main:574] : INFO : Epoch 991 | loss: 0.0311166 | val_loss: 0.031145 | Time: 4445.51 ms
[2022-04-14 09:07:36 main:574] : INFO : Epoch 992 | loss: 0.0311064 | val_loss: 0.0311513 | Time: 4438.51 ms
[2022-04-14 09:07:42 main:574] : INFO : Epoch 993 | loss: 0.0311011 | val_loss: 0.0311571 | Time: 4520.37 ms
[2022-04-14 09:07:47 main:574] : INFO : Epoch 994 | loss: 0.0310995 | val_loss: 0.0311557 | Time: 4521.66 ms
[2022-04-14 09:07:51 main:574] : INFO : Epoch 995 | loss: 0.0311004 | val_loss: 0.0311687 | Time: 4430.37 ms
[2022-04-14 09:07:56 main:574] : INFO : Epoch 996 | loss: 0.0310944 | val_loss: 0.0311629 | Time: 4542.27 ms
[2022-04-14 09:08:02 main:574] : INFO : Epoch 997 | loss: 0.0310935 | val_loss: 0.0311657 | Time: 4541.73 ms
[2022-04-14 09:08:07 main:574] : INFO : Epoch 998 | loss: 0.0310942 | val_loss: 0.0311571 | Time: 4460.41 ms
[2022-04-14 09:08:12 main:574] : INFO : Epoch 999 | loss: 0.0310927 | val_loss: 0.0311541 | Time: 4526.55 ms
[2022-04-14 09:08:17 main:574] : INFO : Epoch 1000 | loss: 0.0310954 | val_loss: 0.0311507 | Time: 4397.73 ms
[2022-04-14 09:08:22 main:574] : INFO : Epoch 1001 | loss: 0.0310936 | val_loss: 0.0311619 | Time: 4474.98 ms
[2022-04-14 09:08:27 main:574] : INFO : Epoch 1002 | loss: 0.0310918 | val_loss: 0.0311577 | Time: 4822.17 ms
[2022-04-14 09:08:32 main:574] : INFO : Epoch 1003 | loss: 0.0310889 | val_loss: 0.0311589 | Time: 4550.96 ms
[2022-04-14 09:08:37 main:574] : INFO : Epoch 1004 | loss: 0.0310849 | val_loss: 0.0311499 | Time: 4432.74 ms
[2022-04-14 09:08:42 main:574] : INFO : Epoch 1005 | loss: 0.0310831 | val_loss: 0.0311528 | Time: 4550.98 ms
[2022-04-14 09:08:47 main:574] : INFO : Epoch 1006 | loss: 0.031083 | val_loss: 0.0311559 | Time: 4467.43 ms
[2022-04-14 09:08:52 main:574] : INFO : Epoch 1007 | loss: 0.0310852 | val_loss: 0.0311516 | Time: 4453.33 ms
[2022-04-14 09:08:57 main:574] : INFO : Epoch 1008 | loss: 0.0310853 | val_loss: 0.0311463 | Time: 4464.49 ms
[2022-04-14 09:09:02 main:574] : INFO : Epoch 1009 | loss: 0.0310876 | val_loss: 0.0311537 | Time: 4478.62 ms
[2022-04-14 09:09:07 main:574] : INFO : Epoch 1010 | loss: 0.0310828 | val_loss: 0.0311524 | Time: 4508.76 ms
[2022-04-14 09:09:12 main:574] : INFO : Epoch 1011 | loss: 0.0310777 | val_loss: 0.031154 | Time: 4550.88 ms
[2022-04-14 09:09:17 main:574] : INFO : Epoch 1012 | loss: 0.0310769 | val_loss: 0.0311553 | Time: 4429.44 ms
[2022-04-14 09:09:22 main:574] : INFO : Epoch 1013 | loss: 0.031079 | val_loss: 0.0311555 | Time: 4549.66 ms
[2022-04-14 09:09:27 main:574] : INFO : Epoch 1014 | loss: 0.0310828 | val_loss: 0.0311597 | Time: 4458.46 ms
[2022-04-14 09:09:32 main:574] : INFO : Epoch 1015 | loss: 0.0310866 | val_loss: 0.0311573 | Time: 4404.05 ms
[2022-04-14 09:09:36 main:574] : INFO : Epoch 1016 | loss: 0.0310904 | val_loss: 0.0311599 | Time: 4385.88 ms
[2022-04-14 09:09:41 main:574] : INFO : Epoch 1017 | loss: 0.0310874 | val_loss: 0.0311617 | Time: 4485.87 ms
[2022-04-14 09:09:47 main:574] : INFO : Epoch 1018 | loss: 0.0310812 | val_loss: 0.0311571 | Time: 4566.25 ms
[2022-04-14 09:09:52 main:574] : INFO : Epoch 1019 | loss: 0.0310795 | val_loss: 0.0311612 | Time: 4467.38 ms
[2022-04-14 09:09:57 main:574] : INFO : Epoch 1020 | loss: 0.0310752 | val_loss: 0.0311586 | Time: 4394.34 ms
[2022-04-14 09:10:03 main:574] : INFO : Epoch 1021 | loss: 0.0310749 | val_loss: 0.0311632 | Time: 4462.06 ms
[2022-04-14 09:10:08 main:574] : INFO : Epoch 1022 | loss: 0.0310744 | val_loss: 0.0311675 | Time: 4552.55 ms
[2022-04-14 09:10:13 main:574] : INFO : Epoch 1023 | loss: 0.031075 | val_loss: 0.0311611 | Time: 4440.1 ms
[2022-04-14 09:10:17 main:574] : INFO : Epoch 1024 | loss: 0.0310762 | val_loss: 0.0311654 | Time: 4553.99 ms
[2022-04-14 09:10:22 main:574] : INFO : Epoch 1025 | loss: 0.0310762 | val_loss: 0.0311626 | Time: 4713.5 ms
[2022-04-14 09:10:28 main:574] : INFO : Epoch 1026 | loss: 0.0310756 | val_loss: 0.0311577 | Time: 4869.05 ms
[2022-04-14 09:10:33 main:574] : INFO : Epoch 1027 | loss: 0.0310736 | val_loss: 0.03117 | Time: 4549.43 ms
[2022-04-14 09:10:38 main:574] : INFO : Epoch 1028 | loss: 0.0310766 | val_loss: 0.03115 | Time: 4529.53 ms
[2022-04-14 09:10:43 main:574] : INFO : Epoch 1029 | loss: 0.0310822 | val_loss: 0.0311575 | Time: 4577.51 ms
[2022-04-14 09:10:48 main:574] : INFO : Epoch 1030 | loss: 0.0310791 | val_loss: 0.0311641 | Time: 4430.8 ms
[2022-04-14 09:10:53 main:574] : INFO : Epoch 1031 | loss: 0.0310785 | val_loss: 0.0311552 | Time: 4490.2 ms
[2022-04-14 09:10:58 main:574] : INFO : Epoch 1032 | loss: 0.0310772 | val_loss: 0.0311572 | Time: 4826.04 ms
[2022-04-14 09:11:03 main:574] : INFO : Epoch 1033 | loss: 0.0310758 | val_loss: 0.031164 | Time: 4412.26 ms
[2022-04-14 09:11:08 main:574] : INFO : Epoch 1034 | loss: 0.031074 | val_loss: 0.0311577 | Time: 4391.31 ms
[2022-04-14 09:11:14 main:574] : INFO : Epoch 1035 | loss: 0.0310745 | val_loss: 0.0311595 | Time: 4614.39 ms
[2022-04-14 09:11:19 main:574] : INFO : Epoch 1036 | loss: 0.0310725 | val_loss: 0.0311651 | Time: 4536.22 ms
[2022-04-14 09:11:23 main:574] : INFO : Epoch 1037 | loss: 0.0310718 | val_loss: 0.0311583 | Time: 4466.07 ms
[2022-04-14 09:11:29 main:574] : INFO : Epoch 1038 | loss: 0.0310751 | val_loss: 0.0311689 | Time: 4634.31 ms
[2022-04-14 09:11:34 main:574] : INFO : Epoch 1039 | loss: 0.0310703 | val_loss: 0.0311623 | Time: 4506.78 ms
[2022-04-14 09:11:39 main:574] : INFO : Epoch 1040 | loss: 0.0310695 | val_loss: 0.0311537 | Time: 4398.47 ms
[2022-04-14 09:11:44 main:574] : INFO : Epoch 1041 | loss: 0.0310704 | val_loss: 0.0311571 | Time: 4477.29 ms
[2022-04-14 09:11:49 main:574] : INFO : Epoch 1042 | loss: 0.0310876 | val_loss: 0.0311584 | Time: 4479.44 ms
[2022-04-14 09:11:54 main:574] : INFO : Epoch 1043 | loss: 0.0311091 | val_loss: 0.0311539 | Time: 4505.82 ms
[2022-04-14 09:11:59 main:574] : INFO : Epoch 1044 | loss: 0.0310976 | val_loss: 0.0311573 | Time: 4569.2 ms
[2022-04-14 09:12:05 main:574] : INFO : Epoch 1045 | loss: 0.0310994 | val_loss: 0.0311556 | Time: 4623.23 ms
[2022-04-14 09:12:10 main:574] : INFO : Epoch 1046 | loss: 0.0311001 | val_loss: 0.0311522 | Time: 4512.3 ms
[2022-04-14 09:12:15 main:574] : INFO : Epoch 1047 | loss: 0.0310972 | val_loss: 0.0311558 | Time: 4501.54 ms
[2022-04-14 09:12:20 main:574] : INFO : Epoch 1048 | loss: 0.0310944 | val_loss: 0.0311572 | Time: 4478.34 ms
[2022-04-14 09:12:25 main:574] : INFO : Epoch 1049 | loss: 0.0310895 | val_loss: 0.0311589 | Time: 4487.39 ms
[2022-04-14 09:12:31 main:574] : INFO : Epoch 1050 | loss: 0.0310889 | val_loss: 0.0311561 | Time: 4677.28 ms
[2022-04-14 09:12:35 main:574] : INFO : Epoch 1051 | loss: 0.0310879 | val_loss: 0.0311619 | Time: 4518.69 ms
[2022-04-14 09:12:41 main:574] : INFO : Epoch 1052 | loss: 0.0310858 | val_loss: 0.0311556 | Time: 4569.07 ms
[2022-04-14 09:12:46 main:574] : INFO : Epoch 1053 | loss: 0.031113 | val_loss: 0.0311549 | Time: 4544.06 ms
[2022-04-14 09:12:51 main:574] : INFO : Epoch 1054 | loss: 0.0311201 | val_loss: 0.0311553 | Time: 4402.09 ms
[2022-04-14 09:12:56 main:574] : INFO : Epoch 1055 | loss: 0.0311117 | val_loss: 0.0311534 | Time: 4528.43 ms
[2022-04-14 09:13:01 main:574] : INFO : Epoch 1056 | loss: 0.0311041 | val_loss: 0.0311595 | Time: 4487.96 ms
[2022-04-14 09:13:05 main:574] : INFO : Epoch 1057 | loss: 0.0310973 | val_loss: 0.0311514 | Time: 4463.07 ms
[2022-04-14 09:13:10 main:574] : INFO : Epoch 1058 | loss: 0.0310951 | val_loss: 0.0311531 | Time: 4570.75 ms
[2022-04-14 09:13:15 main:574] : INFO : Epoch 1059 | loss: 0.031093 | val_loss: 0.0311574 | Time: 4492.32 ms
[2022-04-14 09:13:20 main:574] : INFO : Epoch 1060 | loss: 0.03109 | val_loss: 0.0311521 | Time: 4448.86 ms
[2022-04-14 09:13:25 main:574] : INFO : Epoch 1061 | loss: 0.031089 | val_loss: 0.0311546 | Time: 4433.21 ms
[2022-04-14 09:13:30 main:574] : INFO : Epoch 1062 | loss: 0.031087 | val_loss: 0.031153 | Time: 4551.43 ms
[2022-04-14 09:13:35 main:574] : INFO : Epoch 1063 | loss: 0.0310875 | val_loss: 0.031157 | Time: 4556.48 ms
[2022-04-14 09:13:40 main:574] : INFO : Epoch 1064 | loss: 0.0310903 | val_loss: 0.0311576 | Time: 4411.44 ms
[2022-04-14 09:13:45 main:574] : INFO : Epoch 1065 | loss: 0.0310894 | val_loss: 0.0311606 | Time: 4435.38 ms
[2022-04-14 09:13:50 main:574] : INFO : Epoch 1066 | loss: 0.0310945 | val_loss: 0.0311622 | Time: 4406.48 ms
[2022-04-14 09:13:55 main:574] : INFO : Epoch 1067 | loss: 0.0310877 | val_loss: 0.0311587 | Time: 4561.06 ms
[2022-04-14 09:14:00 main:574] : INFO : Epoch 1068 | loss: 0.0310887 | val_loss: 0.0311588 | Time: 4400.48 ms
[2022-04-14 09:14:05 main:574] : INFO : Epoch 1069 | loss: 0.0310909 | val_loss: 0.0311593 | Time: 4544.48 ms
[2022-04-14 09:14:10 main:574] : INFO : Epoch 1070 | loss: 0.0310845 | val_loss: 0.0311597 | Time: 4384.35 ms
[2022-04-14 09:14:15 main:574] : INFO : Epoch 1071 | loss: 0.031083 | val_loss: 0.0311597 | Time: 4487.91 ms
[2022-04-14 09:14:20 main:574] : INFO : Epoch 1072 | loss: 0.0310801 | val_loss: 0.0311634 | Time: 4532.73 ms
[2022-04-14 09:14:25 main:574] : INFO : Epoch 1073 | loss: 0.0310799 | val_loss: 0.0311653 | Time: 4551.8 ms
[2022-04-14 09:14:30 main:574] : INFO : Epoch 1074 | loss: 0.0310804 | val_loss: 0.0311567 | Time: 4731.55 ms
[2022-04-14 09:14:35 main:574] : INFO : Epoch 1075 | loss: 0.0310767 | val_loss: 0.0311653 | Time: 4415.55 ms
[2022-04-14 09:14:40 main:574] : INFO : Epoch 1076 | loss: 0.0310746 | val_loss: 0.0311655 | Time: 4726.05 ms
[2022-04-14 09:14:45 main:574] : INFO : Epoch 1077 | loss: 0.031076 | val_loss: 0.0311619 | Time: 4598.17 ms
[2022-04-14 09:14:51 main:574] : INFO : Epoch 1078 | loss: 0.0310783 | val_loss: 0.0311607 | Time: 4528.41 ms
[2022-04-14 09:14:56 main:574] : INFO : Epoch 1079 | loss: 0.0310776 | val_loss: 0.0311656 | Time: 4552.25 ms
[2022-04-14 09:15:01 main:574] : INFO : Epoch 1080 | loss: 0.0310774 | val_loss: 0.0311565 | Time: 4513.81 ms
[2022-04-14 09:15:06 main:574] : INFO : Epoch 1081 | loss: 0.0310819 | val_loss: 0.0311636 | Time: 4475.62 ms
[2022-04-14 09:15:11 main:574] : INFO : Epoch 1082 | loss: 0.0310791 | val_loss: 0.0311593 | Time: 4584.9 ms
[2022-04-14 09:15:16 main:574] : INFO : Epoch 1083 | loss: 0.031079 | val_loss: 0.031162 | Time: 4399.23 ms
[2022-04-14 09:15:21 main:574] : INFO : Epoch 1084 | loss: 0.0310778 | val_loss: 0.0311621 | Time: 4454.21 ms
[2022-04-14 09:15:26 main:574] : INFO : Epoch 1085 | loss: 0.0310743 | val_loss: 0.0311625 | Time: 4426.24 ms
[2022-04-14 09:15:31 main:574] : INFO : Epoch 1086 | loss: 0.0310745 | val_loss: 0.0311597 | Time: 4692.8 ms
[2022-04-14 09:15:36 main:574] : INFO : Epoch 1087 | loss: 0.0310747 | val_loss: 0.0311644 | Time: 4553.78 ms
[2022-04-14 09:15:41 main:574] : INFO : Epoch 1088 | loss: 0.0310763 | val_loss: 0.0311611 | Time: 4527.16 ms
[2022-04-14 09:15:46 main:574] : INFO : Epoch 1089 | loss: 0.0310738 | val_loss: 0.031156 | Time: 4423.26 ms
[2022-04-14 09:15:51 main:574] : INFO : Epoch 1090 | loss: 0.0310819 | val_loss: 0.0311664 | Time: 4451.19 ms
[2022-04-14 09:15:56 main:574] : INFO : Epoch 1091 | loss: 0.031086 | val_loss: 0.0311631 | Time: 4474.85 ms
[2022-04-14 09:16:01 main:574] : INFO : Epoch 1092 | loss: 0.0310791 | val_loss: 0.0311574 | Time: 4543.54 ms
[2022-04-14 09:16:06 main:574] : INFO : Epoch 1093 | loss: 0.0310784 | val_loss: 0.0311599 | Time: 4555.69 ms
[2022-04-14 09:16:11 main:574] : INFO : Epoch 1094 | loss: 0.0310884 | val_loss: 0.0311558 | Time: 4429.33 ms
[2022-04-14 09:16:16 main:574] : INFO : Epoch 1095 | loss: 0.0311069 | val_loss: 0.0311625 | Time: 4381.71 ms
[2022-04-14 09:16:21 main:574] : INFO : Epoch 1096 | loss: 0.0311085 | val_loss: 0.031162 | Time: 4502.01 ms
[2022-04-14 09:16:26 main:574] : INFO : Epoch 1097 | loss: 0.031104 | val_loss: 0.0311681 | Time: 4522.25 ms
[2022-04-14 09:16:31 main:574] : INFO : Epoch 1098 | loss: 0.0311014 | val_loss: 0.0311697 | Time: 4441.32 ms
[2022-04-14 09:16:36 main:574] : INFO : Epoch 1099 | loss: 0.0310979 | val_loss: 0.0311631 | Time: 4381.74 ms
[2022-04-14 09:16:41 main:574] : INFO : Epoch 1100 | loss: 0.0311072 | val_loss: 0.0311562 | Time: 4471.39 ms
[2022-04-14 09:16:46 main:574] : INFO : Epoch 1101 | loss: 0.0311028 | val_loss: 0.0311612 | Time: 4549.15 ms
[2022-04-14 09:16:51 main:574] : INFO : Epoch 1102 | loss: 0.0311005 | val_loss: 0.03116 | Time: 4671.28 ms
[2022-04-14 09:16:56 main:574] : INFO : Epoch 1103 | loss: 0.0310908 | val_loss: 0.0311637 | Time: 4546.66 ms
[2022-04-14 09:17:01 main:574] : INFO : Epoch 1104 | loss: 0.0310888 | val_loss: 0.0311593 | Time: 4483.28 ms
[2022-04-14 09:17:06 main:574] : INFO : Epoch 1105 | loss: 0.0310883 | val_loss: 0.0311558 | Time: 4518.47 ms
[2022-04-14 09:17:12 main:574] : INFO : Epoch 1106 | loss: 0.0310856 | val_loss: 0.0311609 | Time: 4469.74 ms
[2022-04-14 09:17:17 main:574] : INFO : Epoch 1107 | loss: 0.0311103 | val_loss: 0.031152 | Time: 4473.8 ms
[2022-04-14 09:17:22 main:574] : INFO : Epoch 1108 | loss: 0.0311133 | val_loss: 0.0311541 | Time: 4507.27 ms
[2022-04-14 09:17:27 main:574] : INFO : Epoch 1109 | loss: 0.0311064 | val_loss: 0.0311585 | Time: 4493.61 ms
[2022-04-14 09:17:32 main:574] : INFO : Epoch 1110 | loss: 0.031104 | val_loss: 0.0311542 | Time: 4562.65 ms
[2022-04-14 09:17:37 main:574] : INFO : Epoch 1111 | loss: 0.0310979 | val_loss: 0.0311614 | Time: 4468.12 ms
[2022-04-14 09:17:41 main:574] : INFO : Epoch 1112 | loss: 0.0310949 | val_loss: 0.0311634 | Time: 4601.64 ms
[2022-04-14 09:17:47 main:574] : INFO : Epoch 1113 | loss: 0.0310963 | val_loss: 0.0311529 | Time: 4564.26 ms
[2022-04-14 09:17:52 main:574] : INFO : Epoch 1114 | loss: 0.0311028 | val_loss: 0.0311597 | Time: 4540.98 ms
[2022-04-14 09:17:57 main:574] : INFO : Epoch 1115 | loss: 0.031102 | val_loss: 0.0311561 | Time: 4400.01 ms
[2022-04-14 09:18:02 main:574] : INFO : Epoch 1116 | loss: 0.0310993 | val_loss: 0.0311525 | Time: 4418.48 ms
[2022-04-14 09:18:07 main:574] : INFO : Epoch 1117 | loss: 0.0310933 | val_loss: 0.0311543 | Time: 4495.35 ms
[2022-04-14 09:18:12 main:574] : INFO : Epoch 1118 | loss: 0.0310938 | val_loss: 0.0311535 | Time: 4474.24 ms
[2022-04-14 09:18:17 main:574] : INFO : Epoch 1119 | loss: 0.0310913 | val_loss: 0.0311655 | Time: 4810.03 ms
[2022-04-14 09:18:22 main:574] : INFO : Epoch 1120 | loss: 0.0310873 | val_loss: 0.0311522 | Time: 4723.55 ms
[2022-04-14 09:18:27 main:574] : INFO : Epoch 1121 | loss: 0.0310825 | val_loss: 0.0311632 | Time: 4435.87 ms
[2022-04-14 09:18:32 main:574] : INFO : Epoch 1122 | loss: 0.0310815 | val_loss: 0.0311592 | Time: 4417.55 ms
[2022-04-14 09:18:38 main:574] : INFO : Epoch 1123 | loss: 0.0310783 | val_loss: 0.0311574 | Time: 4528.26 ms
[2022-04-14 09:18:43 main:574] : INFO : Epoch 1124 | loss: 0.0310779 | val_loss: 0.0311672 | Time: 4544.04 ms
[2022-04-14 09:18:48 main:574] : INFO : Epoch 1125 | loss: 0.0310801 | val_loss: 0.0311673 | Time: 4482.39 ms
[2022-04-14 09:18:53 main:574] : INFO : Epoch 1126 | loss: 0.0310811 | val_loss: 0.0311689 | Time: 4424.03 ms
[2022-04-14 09:18:58 main:574] : INFO : Epoch 1127 | loss: 0.0310833 | val_loss: 0.0311629 | Time: 4486.16 ms
[2022-04-14 09:19:03 main:574] : INFO : Epoch 1128 | loss: 0.031076 | val_loss: 0.0311655 | Time: 4415.25 ms
[2022-04-14 09:19:08 main:574] : INFO : Epoch 1129 | loss: 0.0310733 | val_loss: 0.0311662 | Time: 4596.73 ms
[2022-04-14 09:19:13 main:574] : INFO : Epoch 1130 | loss: 0.0310929 | val_loss: 0.0311539 | Time: 4391.99 ms
[2022-04-14 09:19:18 main:574] : INFO : Epoch 1131 | loss: 0.0311078 | val_loss: 0.0311586 | Time: 4431.12 ms
[2022-04-14 09:19:23 main:574] : INFO : Epoch 1132 | loss: 0.0311002 | val_loss: 0.0311482 | Time: 4386.61 ms
[2022-04-14 09:19:28 main:574] : INFO : Epoch 1133 | loss: 0.0311001 | val_loss: 0.0311595 | Time: 4407.1 ms
[2022-04-14 09:19:33 main:574] : INFO : Epoch 1134 | loss: 0.0311008 | val_loss: 0.0311575 | Time: 4421.97 ms
[2022-04-14 09:19:38 main:574] : INFO : Epoch 1135 | loss: 0.0310948 | val_loss: 0.0311493 | Time: 4694.63 ms
[2022-04-14 09:19:43 main:574] : INFO : Epoch 1136 | loss: 0.0310929 | val_loss: 0.0311511 | Time: 4559.36 ms
[2022-04-14 09:19:49 main:574] : INFO : Epoch 1137 | loss: 0.0310884 | val_loss: 0.0311612 | Time: 4712.23 ms
[2022-04-14 09:19:54 main:574] : INFO : Epoch 1138 | loss: 0.0310886 | val_loss: 0.031158 | Time: 4396.66 ms
[2022-04-14 09:19:59 main:574] : INFO : Epoch 1139 | loss: 0.0310861 | val_loss: 0.0311538 | Time: 4718.29 ms
[2022-04-14 09:20:04 main:574] : INFO : Epoch 1140 | loss: 0.0310838 | val_loss: 0.0311599 | Time: 4604.85 ms
[2022-04-14 09:20:09 main:574] : INFO : Epoch 1141 | loss: 0.0310812 | val_loss: 0.0311542 | Time: 4525.25 ms
[2022-04-14 09:20:15 main:574] : INFO : Epoch 1142 | loss: 0.0310788 | val_loss: 0.0311554 | Time: 4575.45 ms
[2022-04-14 09:20:19 main:574] : INFO : Epoch 1143 | loss: 0.0310795 | val_loss: 0.0311621 | Time: 4433.83 ms
[2022-04-14 09:20:24 main:574] : INFO : Epoch 1144 | loss: 0.0310788 | val_loss: 0.0311597 | Time: 4397.08 ms
[2022-04-14 09:20:29 main:574] : INFO : Epoch 1145 | loss: 0.0310757 | val_loss: 0.0311644 | Time: 4409.27 ms
[2022-04-14 09:20:34 main:574] : INFO : Epoch 1146 | loss: 0.0310738 | val_loss: 0.0311641 | Time: 4471.43 ms
[2022-04-14 09:20:39 main:574] : INFO : Epoch 1147 | loss: 0.0310749 | val_loss: 0.0311715 | Time: 4472.58 ms
[2022-04-14 09:20:44 main:574] : INFO : Epoch 1148 | loss: 0.0310789 | val_loss: 0.0311609 | Time: 4556.53 ms
[2022-04-14 09:20:49 main:574] : INFO : Epoch 1149 | loss: 0.0310781 | val_loss: 0.0311642 | Time: 4388.98 ms
[2022-04-14 09:20:54 main:574] : INFO : Epoch 1150 | loss: 0.0310762 | val_loss: 0.0311705 | Time: 4781.8 ms
[2022-04-14 09:21:00 main:574] : INFO : Epoch 1151 | loss: 0.0310744 | val_loss: 0.0311615 | Time: 4673.93 ms
[2022-04-14 09:21:04 main:574] : INFO : Epoch 1152 | loss: 0.0310759 | val_loss: 0.0311687 | Time: 4471.02 ms
[2022-04-14 09:21:09 main:574] : INFO : Epoch 1153 | loss: 0.0310752 | val_loss: 0.0311549 | Time: 4493.85 ms
[2022-04-14 09:21:15 main:574] : INFO : Epoch 1154 | loss: 0.0310788 | val_loss: 0.0311743 | Time: 4540.8 ms
[2022-04-14 09:21:20 main:574] : INFO : Epoch 1155 | loss: 0.0310746 | val_loss: 0.0311612 | Time: 4568.13 ms
[2022-04-14 09:21:25 main:574] : INFO : Epoch 1156 | loss: 0.0310718 | val_loss: 0.0311659 | Time: 4490.09 ms
[2022-04-14 09:21:30 main:574] : INFO : Epoch 1157 | loss: 0.0310716 | val_loss: 0.0311658 | Time: 4552.23 ms
[2022-04-14 09:21:35 main:574] : INFO : Epoch 1158 | loss: 0.0310698 | val_loss: 0.0311653 | Time: 4529.95 ms
[2022-04-14 09:21:40 main:574] : INFO : Epoch 1159 | loss: 0.0310744 | val_loss: 0.0311669 | Time: 4423.53 ms
[2022-04-14 09:21:45 main:574] : INFO : Epoch 1160 | loss: 0.0310775 | val_loss: 0.0311648 | Time: 4555.94 ms
[2022-04-14 09:21:50 main:574] : INFO : Epoch 1161 | loss: 0.0310868 | val_loss: 0.031166 | Time: 4434.39 ms
[2022-04-14 09:21:55 main:574] : INFO : Epoch 1162 | loss: 0.0311012 | val_loss: 0.0311549 | Time: 4499.67 ms
[2022-04-14 09:22:00 main:574] : INFO : Epoch 1163 | loss: 0.0310997 | val_loss: 0.0311622 | Time: 4506.83 ms
[2022-04-14 09:22:05 main:574] : INFO : Epoch 1164 | loss: 0.0310976 | val_loss: 0.0311561 | Time: 4574.6 ms
[2022-04-14 09:22:10 main:574] : INFO : Epoch 1165 | loss: 0.0310922 | val_loss: 0.0311536 | Time: 4594.43 ms
[2022-04-14 09:22:15 main:574] : INFO : Epoch 1166 | loss: 0.0310883 | val_loss: 0.0311516 | Time: 4520.99 ms
[2022-04-14 09:22:20 main:574] : INFO : Epoch 1167 | loss: 0.0310812 | val_loss: 0.0311633 | Time: 4523.31 ms
[2022-04-14 09:22:25 main:574] : INFO : Epoch 1168 | loss: 0.0310866 | val_loss: 0.0311568 | Time: 4438.08 ms
[2022-04-14 09:22:30 main:574] : INFO : Epoch 1169 | loss: 0.0310907 | val_loss: 0.0311517 | Time: 4493.27 ms
[2022-04-14 09:22:35 main:574] : INFO : Epoch 1170 | loss: 0.0310871 | val_loss: 0.0311599 | Time: 4462.71 ms
[2022-04-14 09:22:41 main:574] : INFO : Epoch 1171 | loss: 0.0311023 | val_loss: 0.031158 | Time: 4487.83 ms
[2022-04-14 09:22:46 main:574] : INFO : Epoch 1172 | loss: 0.0311179 | val_loss: 0.0311563 | Time: 4462.77 ms
[2022-04-14 09:22:51 main:574] : INFO : Epoch 1173 | loss: 0.0311125 | val_loss: 0.0311513 | Time: 4490.43 ms
[2022-04-14 09:22:56 main:574] : INFO : Epoch 1174 | loss: 0.0311047 | val_loss: 0.0311585 | Time: 4797.03 ms
[2022-04-14 09:23:01 main:574] : INFO : Epoch 1175 | loss: 0.0310993 | val_loss: 0.0311557 | Time: 4428.62 ms
[2022-04-14 09:23:06 main:574] : INFO : Epoch 1176 | loss: 0.0310945 | val_loss: 0.0311584 | Time: 4547.83 ms
[2022-04-14 09:23:11 main:574] : INFO : Epoch 1177 | loss: 0.0310929 | val_loss: 0.0311564 | Time: 4420.49 ms
[2022-04-14 09:23:16 main:574] : INFO : Epoch 1178 | loss: 0.0310956 | val_loss: 0.031158 | Time: 4544.59 ms
[2022-04-14 09:23:22 main:574] : INFO : Epoch 1179 | loss: 0.0310914 | val_loss: 0.0311674 | Time: 4871.02 ms
[2022-04-14 09:23:27 main:574] : INFO : Epoch 1180 | loss: 0.0310857 | val_loss: 0.0311612 | Time: 4514.19 ms
[2022-04-14 09:23:32 main:574] : INFO : Epoch 1181 | loss: 0.031083 | val_loss: 0.0311627 | Time: 4562.18 ms
[2022-04-14 09:23:37 main:574] : INFO : Epoch 1182 | loss: 0.0310863 | val_loss: 0.0311605 | Time: 4442.28 ms
[2022-04-14 09:23:42 main:574] : INFO : Epoch 1183 | loss: 0.0310857 | val_loss: 0.0311589 | Time: 4554.73 ms
[2022-04-14 09:23:47 main:574] : INFO : Epoch 1184 | loss: 0.0310814 | val_loss: 0.0311627 | Time: 4513.2 ms
[2022-04-14 09:23:52 main:574] : INFO : Epoch 1185 | loss: 0.0310811 | val_loss: 0.0311623 | Time: 4639.46 ms
[2022-04-14 09:23:57 main:574] : INFO : Epoch 1186 | loss: 0.0311081 | val_loss: 0.031159 | Time: 4409.03 ms
[2022-04-14 09:24:02 main:574] : INFO : Epoch 1187 | loss: 0.0311364 | val_loss: 0.0311533 | Time: 4542.89 ms
[2022-04-14 09:24:07 main:574] : INFO : Epoch 1188 | loss: 0.031126 | val_loss: 0.0311493 | Time: 4536.4 ms
[2022-04-14 09:24:13 main:574] : INFO : Epoch 1189 | loss: 0.0311183 | val_loss: 0.0311485 | Time: 4459.91 ms
[2022-04-14 09:24:18 main:574] : INFO : Epoch 1190 | loss: 0.0311122 | val_loss: 0.0311547 | Time: 4568.89 ms
[2022-04-14 09:24:23 main:574] : INFO : Epoch 1191 | loss: 0.0311088 | val_loss: 0.0311537 | Time: 4442.7 ms
[2022-04-14 09:24:28 main:574] : INFO : Epoch 1192 | loss: 0.0311067 | val_loss: 0.0311489 | Time: 4583.56 ms
[2022-04-14 09:24:33 main:574] : INFO : Epoch 1193 | loss: 0.0311011 | val_loss: 0.0311525 | Time: 4439.27 ms
[2022-04-14 09:24:38 main:574] : INFO : Epoch 1194 | loss: 0.0311042 | val_loss: 0.0311557 | Time: 4445.52 ms
[2022-04-14 09:24:43 main:574] : INFO : Epoch 1195 | loss: 0.0311107 | val_loss: 0.0311507 | Time: 4442.49 ms
[2022-04-14 09:24:48 main:574] : INFO : Epoch 1196 | loss: 0.0311058 | val_loss: 0.0311517 | Time: 4554.19 ms
[2022-04-14 09:24:53 main:574] : INFO : Epoch 1197 | loss: 0.0311023 | val_loss: 0.031157 | Time: 4452.18 ms
[2022-04-14 09:24:59 main:574] : INFO : Epoch 1198 | loss: 0.0310997 | val_loss: 0.0311532 | Time: 4443.02 ms
[2022-04-14 09:25:04 main:574] : INFO : Epoch 1199 | loss: 0.031093 | val_loss: 0.031156 | Time: 4448.96 ms
[2022-04-14 09:25:09 main:574] : INFO : Epoch 1200 | loss: 0.0310901 | val_loss: 0.0311645 | Time: 4523.94 ms
[2022-04-14 09:25:14 main:574] : INFO : Epoch 1201 | loss: 0.03109 | val_loss: 0.0311499 | Time: 4392.65 ms
[2022-04-14 09:25:19 main:574] : INFO : Epoch 1202 | loss: 0.0310876 | val_loss: 0.0311637 | Time: 4539.17 ms
[2022-04-14 09:25:24 main:574] : INFO : Epoch 1203 | loss: 0.0310917 | val_loss: 0.031162 | Time: 4544.92 ms
[2022-04-14 09:25:29 main:574] : INFO : Epoch 1204 | loss: 0.0310916 | val_loss: 0.0311622 | Time: 4474.61 ms
[2022-04-14 09:25:35 main:574] : INFO : Epoch 1205 | loss: 0.0310921 | val_loss: 0.0311568 | Time: 4682.87 ms
[2022-04-14 09:25:40 main:574] : INFO : Epoch 1206 | loss: 0.0310862 | val_loss: 0.0311598 | Time: 4476.28 ms
[2022-04-14 09:25:45 main:574] : INFO : Epoch 1207 | loss: 0.031086 | val_loss: 0.0311619 | Time: 4515.2 ms
[2022-04-14 09:25:50 main:574] : INFO : Epoch 1208 | loss: 0.0310888 | val_loss: 0.0311679 | Time: 4490.26 ms
[2022-04-14 09:25:55 main:574] : INFO : Epoch 1209 | loss: 0.0310822 | val_loss: 0.0311628 | Time: 4474.85 ms
[2022-04-14 09:26:00 main:574] : INFO : Epoch 1210 | loss: 0.0310797 | val_loss: 0.0311682 | Time: 4423.45 ms
[2022-04-14 09:26:05 main:574] : INFO : Epoch 1211 | loss: 0.0310941 | val_loss: 0.0311633 | Time: 4471.83 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF64C990A2
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/14/22 09:26:06
Install Directory : D:\BOINC\
Data Directory : E:\BOINC
Project Symstore :
LoadLibraryA( E:\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( E:\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( E:\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( E:\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: E:\BOINC\slots\7;E:\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000e25b0000 00000000003df000 E:\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000066e70000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000658b0000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000064bd0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000065d50000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000646f0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1645
ModLoad: 0000000065ac0000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1620
ModLoad: 0000000064770000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1620
ModLoad: 0000000064930000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000064a40000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000657c0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000065ef0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000065b70000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.320
ModLoad: 00000000662c0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000536e0000 0000000000058000 E:\BOINC\slots\7\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000052c80000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.29917.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.29.29917.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft? Visual Studio?
Product Version : 14.29.29917.0
ModLoad: 000000005e650000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.867
ModLoad: 0000000052d10000 000000000001a000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.29917.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.29.29917.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft? Visual Studio?
Product Version : 14.29.29917.0
ModLoad: 0000000051b20000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.29917.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.29.29917.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft? Visual Studio?
Product Version : 14.29.29917.0
ModLoad: 00000000d52f0000 000000000abe7000 E:\BOINC\slots\7\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000dfee0000 0000000024b49000 E:\BOINC\slots\7\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000026650000 00000000002db000 E:\BOINC\slots\7\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000534d0000 000000000020d000 E:\BOINC\slots\7\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000053480000 0000000000045000 E:\BOINC\slots\7\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000000e220000 00000000030a5000 E:\BOINC\slots\7\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000d1e30000 00000000034b2000 E:\BOINC\slots\7\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000b6a80000 000000001b3a4000 E:\BOINC\slots\7\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 000000005e9d0000 0000000000010000 E:\BOINC\slots\7\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000b2d20000 0000000003d5b000 E:\BOINC\slots\7\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000a9b80000 000000000919f000 E:\BOINC\slots\7\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 0000000053440000 0000000000040000 E:\BOINC\slots\7\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000005d20000 0000000001eca000 E:\BOINC\slots\7\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000065870000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000624d0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000065350000 000000000046a000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000064720000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1620
ModLoad: 0000000064ea0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000064340000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1620
ModLoad: 00000000649d0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000064590000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000064180000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000666e0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000626d0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000064ed0000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000064000000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000066210000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000661b0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000253e0000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.127 driver
Product Version : 30.0.15.1215
ModLoad: 00000000a84e0000 000000000169f000 C:\WINDOWS\system32\DriverStore\FileRepository\nvmdi.inf_amd64_2b01a28ee7b06750\nvcuda64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.127 driver
Product Version : 30.0.15.1215
ModLoad: 000000005ef10000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 000000005ee50000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.906
ModLoad: 000000005ed00000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000063f50000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 000000005c600000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1215
ModLoad: 000000000d3e0000 00000000008b3000 C:\WINDOWS\System32\DriverStore\FileRepository\nvmdi.inf_amd64_2b01a28ee7b06750\nvptxJitCompiler64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows PTX JIT Compiler
Product Version : 30.0.15.1215
ModLoad: 000000005f8f0000 0000000000009000 E:\BOINC\slots\7\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a7510000 0000000000fca000 E:\BOINC\slots\7\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 0000000064b40000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 5974, Write: 7881, Other 85222
- I/O Transfers Counters -
Read: 52862939, Write: -1954552094, Other 375170
- Paged Pool Usage -
QuotaPagedPoolUsage: 3538648, QuotaPeakPagedPoolUsage: 3538648
QuotaNonPagedPoolUsage: 58472, QuotaPeakNonPagedPoolUsage: 70848
- Virtual Memory Usage -
VirtualSize: 279445504, PeakVirtualSize: 1524224000
- Pagefile Usage -
PagefileUsage: 279445504, PeakPagefileUsage: 657592320
- Working Set Size -
WorkingSetSize: -1968680960, PeakWorkingSetSize: -1254850560, PageFaultCount: 41442957
*** Dump of thread ID 14528 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1558590.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF64C990A2
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000e2868c40 rdx=00000000246fe480 rsi=0000000000000000 rdi=0000000000000000
r8=00000000246fe480 r9=00000000e2868c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000064c990a2 rsp=00000000246fe458 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
246fe450 e25e9100 00000001 246fe480 246fe480 e2868c30 KERNELBASE!DebugBreak+0x0
246fe890 e25e9ce4 99400000 246febf4 00000000 000003a8 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
246ff7f0 e25ea084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
246ff820 658c7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
246ff850 66ec2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
246ff8d0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5172 (state: Running): ***
- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 426406240.000000, User Time: 31687655424.000000, Wait Time: 1558590.000000
- Registers -
rax=00000000ffffffff rbx=000000005c1e6610 rcx=000000005c1e6610 rdx=0000000000000003 rsi=000000005ab1ff40 rdi=0000000000000003
r8=000000005ab1ff40 r9=0000000023f00ff0 r10=0000000000000004 r11=0000000023f00f50 r12=0000000000000010 r13=0000000000000001
r14=0000000023f00cd0 r15=0000000000000001 rip=00000000a86689f7 rsp=0000000023f00c10 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
23f00c40 a8580dab 23f00f50 b782bc3c 23f00c98 b7824ce0 nvcuda64!+0x0
23f00c80 b782c019 00000001 00000000 00000000 5bf56150 nvcuda64!+0x0
23f00cc0 b7822952 00000000 5a080860 23f01460 23f01760 cudnn64_7!cudnnSetDropoutDescriptor+0x0
23f00dd0 b781fdf4 b78356a0 00000000 00000000 23f00ff0 cudnn64_7!cudnnSetDropoutDescriptor+0x0
23f00f50 b7836325 b78356a0 23f01df8 b78356a0 0000000c cudnn64_7!cudnnSetDropoutDescriptor+0x0
23f01070 b7839441 3a07e000 3a090bd0 3b24a000 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
23f01150 b7838493 a2bc8bf0 00000024 4dd85020 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
23f01200 b783803c a2bc8bf0 4dd85020 23f013d0 0000000c cudnn64_7!cudnnSetDropoutDescriptor+0x0
23f01290 b78391a7 0000000c 23f013d0 00000100 3b24a000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
23f01400 b787cd01 00000000 23f01df8 00000000 23f019d0 cudnn64_7!cudnnSetDropoutDescriptor+0x0
23f01520 b7885e12 00000000 00000000 4dd85020 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
23f016a0 b7884cd9 00000000 00000000 00000000 0000000f cudnn64_7!cudnnSetDropoutDescriptor+0x0
23f017b0 b7884504 4dd85020 00000000 00000000 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
23f01a80 b788700e 23f01ac8 00000001 d199a090 5ab1ff40 cudnn64_7!cudnnSetDropoutDescriptor+0x0
23f01b70 b77882ca 4dd85020 00000000 00000000 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
23f01c40 b779a9bb 0000000c 3a07e000 00000001 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0
23f020f0 b778eff1 23f043d8 18f1c630 00000005 e45f32e0 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
23f02290 b7797d8e 4ec64f00 00000000 e45f32e0 23f02558 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
23f02430 b77adcd3 00000000 00000000 91d67ae0 23f02550 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
23f045c0 e2c589fd 4ec62d60 3a000000 4ec62d60 18f1c630 cudnn64_7!cudnnRNNForwardTraining+0x0
23f04aa0 e2cb25ea 23f04b68 00000001 23f04b68 00000001 torch_cuda!at::native::_cudnn_rnn+0x0
23f04b80 e2cc0cbf 23f05270 23f06a78 23f05bc0 66e9b86b torch_cuda!at::native::set_storage_cuda_+0x0
23f04c60 dad3b9fc 23f05270 00000000 c8ce4050 c8ce4020 torch_cuda!at::native::set_storage_cuda_+0x0
23f04de0 dad731a2 00000001 dc4e67c2 23f04e14 66e9b86b torch_cpu!at::native::mkldnn_sigmoid_+0x0
23f050c0 dc022613 00000000 00000000 00000003 58e59a28 torch_cpu!at::_cudnn_rnn+0x0
23f055c0 dc03080b 0842f907 c8a9e810 23f056f0 00000004 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
23f056a0 dad3b9fc 23f05c20 dc155878 23f05800 a8507a77 torch_cpu!torch::autograd::GraphRoot::apply+0x0
23f05820 dad731a2 e45f3e90 00000000 0842fbf7 e3b7a3f0 torch_cpu!at::native::mkldnn_sigmoid_+0x0
23f05b00 e2c569a1 23f00001 00000001 00000004 00000004 torch_cpu!at::_cudnn_rnn+0x0
23f05cd0 e2c60117 00000000 23f06a78 53482e0d 23f05df0 torch_cuda!at::native::_use_cudnn_ctc_loss+0x0
23f05d60 daac107b dfc11ac0 23f06080 def19ab2 a86d7783 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0
23f05fd0 daaf3b16 00000001 23f06a78 00000080 8e198908 torch_cpu!at::native::fbgemm_pack_quantized_matrix+0x0
23f06160 dae6ae89 23f061d8 00000001 23f061d8 00000001 torch_cpu!at::native::gru+0x0
23f061f0 dc159fa3 23f062f0 00000001 23f06470 23f06a78 torch_cpu!at::zeros_out+0x0
23f06280 dae5dd35 53731ea8 5b8ac620 00000000 53731ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
23f06300 dad388ec dfc175c8 83dd6480 269db700 23f06520 torch_cpu!at::zeros_out+0x0
23f06400 dadac1bb 0000000c 00000080 00000004 c8a9ef00 torch_cpu!at::native::mkldnn_sigmoid_+0x0
23f06480 dc897294 23f065a0 83dd6480 23f06590 23f06738 torch_cpu!at::gru+0x0
23f066b0 dc8962ab 23f06a50 dacc030e 23f06a50 23f06a78 torch_cpu!torch::nn::GRUImpl::forward_helper+0x0
23f067a0 e25c2621 00000001 23f074b0 00000000 53731ea8 torch_cpu!torch::nn::GRUImpl::forward+0x0
23f069a0 e25c705a 00000000 23f00000 23f00601 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::error+0x0
23f06ea0 e25cb950 23f06fa0 23f06fa0 00000000 18be0730 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
23f1fc40 e280c6f8 5bd46780 00000000 00000000 5a09f7a0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
23f1fc80 658c7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
23f1fcb0 66ec2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
23f1fd30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 532 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1558587.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000247ff920 rsi=0000000000000000 rdi=000000000000000d
r8=00000000247ff5c8 r9=000000005bf3bd30 r10=0000000000000000 r11=00000000247ff890 r12=0000000000000064 r13=00000000247ff920
r14=00000000247ff620 r15=0000000000000000 rip=0000000066f0d8c4 rsp=00000000247ff5c8 rbp=000000005bf3bd30
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
247ff5c0 64c1cb10 00000000 24177000 66fda4d0 24177000 ntdll!ZwWaitForMultipleObjects+0x0
247ff8b0 64c1ca0e 5a0a1090 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
247ff8f0 a86bd554 5bf3ddd0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
247ffb30 a87658cd 00000000 5bf3bd30 00000000 00000000 nvcuda64!+0x0
247ffbe0 a86bcf23 b3e706d2 bb0b0d6d 5c561f70 00000000 nvcuda64!cuProfilerStop+0x0
247ffc10 a89f41e4 5c561f70 00000000 00000000 00000000 nvcuda64!+0x0
247ffc40 658c7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
247ffc70 66ec2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
247ffcf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 8144 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 460536.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002e4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002e4
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000005bf1b710 r13=0000000000000000
r14=00000000000002e4 r15=0000000000000000 rip=0000000066f0cdf4 rsp=00000000248ff418 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
248ff410 64bf1a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
248ff4b0 a88e596e 5c562bd0 00000000 00000000 000002e4 KERNELBASE!WaitForSingleObjectEx+0x0
248ff6f0 a86bcf23 00000000 5c562bd0 a84e0000 5bf58c20 nvcuda64!cuProfilerStop+0x0
248ff720 a89f41e4 5c562bd0 00000000 00000000 00000000 nvcuda64!+0x0
248ff750 658c7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
248ff780 66ec2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
248ff800 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 14556 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 134687504.000000, User Time: 5500312576.000000, Wait Time: 1558489.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000e1e2ad98 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000e1e2ad98
r8=0000000000000000 r9=0000000000000064 r10=0000000000008000 r11=000000008e199790 r12=0000000000000000 r13=0000000000000000
r14=00000000242ff3b0 r15=00000000e1e2ad48 rip=0000000066f10764 rsp=00000000242ff388 rbp=00000000242ff3e0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
242ff380 66ed4021 242ff680 00000000 242ff480 00000000 ntdll!NtWaitForAlertByThreadId+0x0
242ff400 64c3cf99 e1e2ad90 e1e2ad88 e1e2ad40 dc4d05b4 ntdll!RtlSleepConditionVariableSRW+0x0
242ff440 52c92879 00000000 1fb3de60 00000000 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
242ff470 52c92b0a 7d342201 00000000 242ff680 e1e2ad88 MSVCP140!std::_Winerror_message+0x0
242ff4a0 dc4d064b e1e2ad40 242ff5a0 e1e2ad40 1fb3de40 MSVCP140!_Cnd_wait+0x0
242ff4e0 dc4d25b1 caa77f60 ffffffff 1fb3de40 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
242ff7d0 dc4d2471 df9f6d10 242ff810 df9f6d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
242ff820 dc4c9744 00080001 cad25020 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
242ff850 64a61bb2 cad25020 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
242ff880 658c7034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
242ff8b0 66ec2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
242ff930 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)