Task 10953261
| Name | ParityModified-1639960289-18236-2-0_0 |
| Workunit | 8246798 |
| Created | 22 Jan 2022, 10:40:26 UTC |
| Sent | 8 Feb 2022, 17:14:34 UTC |
| Report deadline | 16 Feb 2022, 17:14:34 UTC |
| Received | 8 Feb 2022, 19:07:22 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 11606 |
| Run time | 1 hours 31 min 1 sec |
| CPU time | 1 hours 30 min 28 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 10,339.03 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.54 GB |
| Peak swap size | 4.63 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
INFO : Epoch 801 | loss: nan | val_loss: nan | Time: 2887.91 ms
[2022-02-08 19:23:31 main:574] : INFO : Epoch 802 | loss: nan | val_loss: nan | Time: 2807.72 ms
[2022-02-08 19:23:33 main:574] : INFO : Epoch 803 | loss: nan | val_loss: nan | Time: 2851.18 ms
[2022-02-08 19:23:36 main:574] : INFO : Epoch 804 | loss: nan | val_loss: nan | Time: 2826.9 ms
[2022-02-08 19:23:39 main:574] : INFO : Epoch 805 | loss: nan | val_loss: nan | Time: 2844.08 ms
[2022-02-08 19:23:42 main:574] : INFO : Epoch 806 | loss: nan | val_loss: nan | Time: 2862.56 ms
[2022-02-08 19:23:45 main:574] : INFO : Epoch 807 | loss: nan | val_loss: nan | Time: 2784.17 ms
[2022-02-08 19:23:48 main:574] : INFO : Epoch 808 | loss: nan | val_loss: nan | Time: 2899.89 ms
[2022-02-08 19:23:51 main:574] : INFO : Epoch 809 | loss: nan | val_loss: nan | Time: 2932.24 ms
[2022-02-08 19:23:53 main:574] : INFO : Epoch 810 | loss: nan | val_loss: nan | Time: 2802.49 ms
[2022-02-08 19:23:56 main:574] : INFO : Epoch 811 | loss: nan | val_loss: nan | Time: 2875.84 ms
[2022-02-08 19:23:59 main:574] : INFO : Epoch 812 | loss: nan | val_loss: nan | Time: 2783.56 ms
[2022-02-08 19:24:03 main:574] : INFO : Epoch 813 | loss: nan | val_loss: nan | Time: 3500.49 ms
[2022-02-08 19:24:05 main:574] : INFO : Epoch 814 | loss: nan | val_loss: nan | Time: 2936.29 ms
[2022-02-08 19:24:08 main:574] : INFO : Epoch 815 | loss: nan | val_loss: nan | Time: 2829.97 ms
[2022-02-08 19:24:11 main:574] : INFO : Epoch 816 | loss: nan | val_loss: nan | Time: 2917.94 ms
[2022-02-08 19:24:14 main:574] : INFO : Epoch 817 | loss: nan | val_loss: nan | Time: 2864.17 ms
[2022-02-08 19:24:17 main:574] : INFO : Epoch 818 | loss: nan | val_loss: nan | Time: 2861.9 ms
[2022-02-08 19:24:20 main:574] : INFO : Epoch 819 | loss: nan | val_loss: nan | Time: 2845.42 ms
[2022-02-08 19:24:23 main:574] : INFO : Epoch 820 | loss: nan | val_loss: nan | Time: 2850.11 ms
[2022-02-08 19:24:26 main:574] : INFO : Epoch 821 | loss: nan | val_loss: nan | Time: 2947.41 ms
[2022-02-08 19:24:28 main:574] : INFO : Epoch 822 | loss: nan | val_loss: nan | Time: 2843.76 ms
[2022-02-08 19:24:31 main:574] : INFO : Epoch 823 | loss: nan | val_loss: nan | Time: 2899.63 ms
[2022-02-08 19:24:34 main:574] : INFO : Epoch 824 | loss: nan | val_loss: nan | Time: 2877.68 ms
[2022-02-08 19:24:37 main:574] : INFO : Epoch 825 | loss: nan | val_loss: nan | Time: 2846.92 ms
[2022-02-08 19:24:40 main:574] : INFO : Epoch 826 | loss: nan | val_loss: nan | Time: 2897.06 ms
[2022-02-08 19:24:43 main:574] : INFO : Epoch 827 | loss: nan | val_loss: nan | Time: 2765.59 ms
[2022-02-08 19:24:46 main:574] : INFO : Epoch 828 | loss: nan | val_loss: nan | Time: 2880.99 ms
[2022-02-08 19:24:49 main:574] : INFO : Epoch 829 | loss: nan | val_loss: nan | Time: 2947.54 ms
[2022-02-08 19:24:50 main:574] : INFO : Epoch 830 | loss: nan | val_loss: nan | Time: 1831.02 ms
[2022-02-08 19:24:52 main:574] : INFO : Epoch 831 | loss: nan | val_loss: nan | Time: 1346.13 ms
[2022-02-08 19:24:54 main:574] : INFO : Epoch 832 | loss: nan | val_loss: nan | Time: 2471.52 ms
[2022-02-08 19:24:57 main:574] : INFO : Epoch 833 | loss: nan | val_loss: nan | Time: 2933.41 ms
[2022-02-08 19:25:00 main:574] : INFO : Epoch 834 | loss: nan | val_loss: nan | Time: 2795.77 ms
[2022-02-08 19:25:03 main:574] : INFO : Epoch 835 | loss: nan | val_loss: nan | Time: 2857.18 ms
[2022-02-08 19:25:06 main:574] : INFO : Epoch 836 | loss: nan | val_loss: nan | Time: 3007.95 ms
[2022-02-08 19:25:09 main:574] : INFO : Epoch 837 | loss: nan | val_loss: nan | Time: 2717.21 ms
[2022-02-08 19:25:11 main:574] : INFO : Epoch 838 | loss: nan | val_loss: nan | Time: 2900.36 ms
[2022-02-08 19:25:14 main:574] : INFO : Epoch 839 | loss: nan | val_loss: nan | Time: 2830.78 ms
[2022-02-08 19:25:17 main:574] : INFO : Epoch 840 | loss: nan | val_loss: nan | Time: 2838.42 ms
[2022-02-08 19:25:20 main:574] : INFO : Epoch 841 | loss: nan | val_loss: nan | Time: 2973.06 ms
[2022-02-08 19:25:23 main:574] : INFO : Epoch 842 | loss: nan | val_loss: nan | Time: 2856.84 ms
[2022-02-08 19:25:26 main:574] : INFO : Epoch 843 | loss: nan | val_loss: nan | Time: 2916.18 ms
[2022-02-08 19:25:29 main:574] : INFO : Epoch 844 | loss: nan | val_loss: nan | Time: 2886.16 ms
[2022-02-08 19:25:32 main:574] : INFO : Epoch 845 | loss: nan | val_loss: nan | Time: 2849.05 ms
[2022-02-08 19:25:35 main:574] : INFO : Epoch 846 | loss: nan | val_loss: nan | Time: 2999.1 ms
[2022-02-08 19:25:38 main:574] : INFO : Epoch 847 | loss: nan | val_loss: nan | Time: 2792.17 ms
[2022-02-08 19:25:40 main:574] : INFO : Epoch 848 | loss: nan | val_loss: nan | Time: 2872.03 ms
[2022-02-08 19:25:43 main:574] : INFO : Epoch 849 | loss: nan | val_loss: nan | Time: 2857.32 ms
[2022-02-08 19:25:46 main:574] : INFO : Epoch 850 | loss: nan | val_loss: nan | Time: 2870.27 ms
[2022-02-08 19:25:49 main:574] : INFO : Epoch 851 | loss: nan | val_loss: nan | Time: 2985.8 ms
[2022-02-08 19:25:52 main:574] : INFO : Epoch 852 | loss: nan | val_loss: nan | Time: 2795.79 ms
[2022-02-08 19:25:55 main:574] : INFO : Epoch 853 | loss: nan | val_loss: nan | Time: 2876.36 ms
[2022-02-08 19:25:58 main:574] : INFO : Epoch 854 | loss: nan | val_loss: nan | Time: 2936.08 ms
[2022-02-08 19:26:01 main:574] : INFO : Epoch 855 | loss: nan | val_loss: nan | Time: 2806.52 ms
[2022-02-08 19:26:03 main:574] : INFO : Epoch 856 | loss: nan | val_loss: nan | Time: 2927.08 ms
[2022-02-08 19:26:06 main:574] : INFO : Epoch 857 | loss: nan | val_loss: nan | Time: 2774.43 ms
[2022-02-08 19:26:09 main:574] : INFO : Epoch 858 | loss: nan | val_loss: nan | Time: 2807.68 ms
[2022-02-08 19:26:12 main:574] : INFO : Epoch 859 | loss: nan | val_loss: nan | Time: 2842.06 ms
[2022-02-08 19:26:15 main:574] : INFO : Epoch 860 | loss: nan | val_loss: nan | Time: 2793.7 ms
[2022-02-08 19:26:18 main:574] : INFO : Epoch 861 | loss: nan | val_loss: nan | Time: 2855.2 ms
[2022-02-08 19:26:20 main:574] : INFO : Epoch 862 | loss: nan | val_loss: nan | Time: 2827.06 ms
[2022-02-08 19:26:22 main:574] : INFO : Epoch 863 | loss: nan | val_loss: nan | Time: 1486.04 ms
[2022-02-08 19:26:23 main:574] : INFO : Epoch 864 | loss: nan | val_loss: nan | Time: 1212.82 ms
[2022-02-08 19:26:24 main:574] : INFO : Epoch 865 | loss: nan | val_loss: nan | Time: 1172.02 ms
[2022-02-08 19:26:25 main:574] : INFO : Epoch 866 | loss: nan | val_loss: nan | Time: 1143.19 ms
[2022-02-08 19:26:27 main:574] : INFO : Epoch 867 | loss: nan | val_loss: nan | Time: 1139.35 ms
[2022-02-08 19:26:28 main:574] : INFO : Epoch 868 | loss: nan | val_loss: nan | Time: 1194.13 ms
[2022-02-08 19:26:29 main:574] : INFO : Epoch 869 | loss: nan | val_loss: nan | Time: 1169.31 ms
[2022-02-08 19:26:30 main:574] : INFO : Epoch 870 | loss: nan | val_loss: nan | Time: 1155.04 ms
[2022-02-08 19:26:31 main:574] : INFO : Epoch 871 | loss: nan | val_loss: nan | Time: 1227.54 ms
[2022-02-08 19:26:33 main:574] : INFO : Epoch 872 | loss: nan | val_loss: nan | Time: 1255.7 ms
[2022-02-08 19:26:34 main:574] : INFO : Epoch 873 | loss: nan | val_loss: nan | Time: 1185.43 ms
[2022-02-08 19:26:35 main:574] : INFO : Epoch 874 | loss: nan | val_loss: nan | Time: 1231.22 ms
[2022-02-08 19:26:36 main:574] : INFO : Epoch 875 | loss: nan | val_loss: nan | Time: 1191.54 ms
[2022-02-08 19:26:37 main:574] : INFO : Epoch 876 | loss: nan | val_loss: nan | Time: 1251.9 ms
[2022-02-08 19:26:39 main:574] : INFO : Epoch 877 | loss: nan | val_loss: nan | Time: 1236.49 ms
[2022-02-08 19:26:40 main:574] : INFO : Epoch 878 | loss: nan | val_loss: nan | Time: 1186.89 ms
[2022-02-08 19:26:41 main:574] : INFO : Epoch 879 | loss: nan | val_loss: nan | Time: 1201.08 ms
[2022-02-08 19:26:42 main:574] : INFO : Epoch 880 | loss: nan | val_loss: nan | Time: 1180.23 ms
[2022-02-08 19:26:43 main:574] : INFO : Epoch 881 | loss: nan | val_loss: nan | Time: 1216.54 ms
[2022-02-08 19:26:45 main:574] : INFO : Epoch 882 | loss: nan | val_loss: nan | Time: 1148.84 ms
[2022-02-08 19:26:46 main:574] : INFO : Epoch 883 | loss: nan | val_loss: nan | Time: 1199.74 ms
[2022-02-08 19:26:47 main:574] : INFO : Epoch 884 | loss: nan | val_loss: nan | Time: 1216.55 ms
[2022-02-08 19:26:48 main:574] : INFO : Epoch 885 | loss: nan | val_loss: nan | Time: 1190.11 ms
[2022-02-08 19:26:49 main:574] : INFO : Epoch 886 | loss: nan | val_loss: nan | Time: 1224.31 ms
[2022-02-08 19:26:51 main:574] : INFO : Epoch 887 | loss: nan | val_loss: nan | Time: 1169.11 ms
[2022-02-08 19:26:52 main:574] : INFO : Epoch 888 | loss: nan | val_loss: nan | Time: 1206.99 ms
[2022-02-08 19:26:53 main:574] : INFO : Epoch 889 | loss: nan | val_loss: nan | Time: 1173.52 ms
[2022-02-08 19:26:54 main:574] : INFO : Epoch 890 | loss: nan | val_loss: nan | Time: 1199.4 ms
[2022-02-08 19:26:55 main:574] : INFO : Epoch 891 | loss: nan | val_loss: nan | Time: 1180.36 ms
[2022-02-08 19:26:57 main:574] : INFO : Epoch 892 | loss: nan | val_loss: nan | Time: 1204.81 ms
[2022-02-08 19:26:58 main:574] : INFO : Epoch 893 | loss: nan | val_loss: nan | Time: 1211.73 ms
[2022-02-08 19:26:59 main:574] : INFO : Epoch 894 | loss: nan | val_loss: nan | Time: 1199.36 ms
[2022-02-08 19:27:00 main:574] : INFO : Epoch 895 | loss: nan | val_loss: nan | Time: 1201.7 ms
[2022-02-08 19:27:01 main:574] : INFO : Epoch 896 | loss: nan | val_loss: nan | Time: 1207.55 ms
[2022-02-08 19:27:03 main:574] : INFO : Epoch 897 | loss: nan | val_loss: nan | Time: 1237.7 ms
[2022-02-08 19:27:04 main:574] : INFO : Epoch 898 | loss: nan | val_loss: nan | Time: 1180.83 ms
[2022-02-08 19:27:05 main:574] : INFO : Epoch 899 | loss: nan | val_loss: nan | Time: 1195.07 ms
[2022-02-08 19:27:06 main:574] : INFO : Epoch 900 | loss: nan | val_loss: nan | Time: 1188.24 ms
[2022-02-08 19:27:07 main:574] : INFO : Epoch 901 | loss: nan | val_loss: nan | Time: 1206.58 ms
[2022-02-08 19:27:08 main:574] : INFO : Epoch 902 | loss: nan | val_loss: nan | Time: 1121.68 ms
[2022-02-08 19:27:10 main:574] : INFO : Epoch 903 | loss: nan | val_loss: nan | Time: 1148.97 ms
[2022-02-08 19:27:11 main:574] : INFO : Epoch 904 | loss: nan | val_loss: nan | Time: 1172.9 ms
[2022-02-08 19:27:12 main:574] : INFO : Epoch 905 | loss: nan | val_loss: nan | Time: 1219.17 ms
[2022-02-08 19:27:13 main:574] : INFO : Epoch 906 | loss: nan | val_loss: nan | Time: 1241.11 ms
[2022-02-08 19:27:15 main:574] : INFO : Epoch 907 | loss: nan | val_loss: nan | Time: 1254.72 ms
[2022-02-08 19:27:16 main:574] : INFO : Epoch 908 | loss: nan | val_loss: nan | Time: 1185.85 ms
[2022-02-08 19:27:17 main:574] : INFO : Epoch 909 | loss: nan | val_loss: nan | Time: 1287.78 ms
[2022-02-08 19:27:18 main:574] : INFO : Epoch 910 | loss: nan | val_loss: nan | Time: 1353.3 ms
[2022-02-08 19:27:20 main:574] : INFO : Epoch 911 | loss: nan | val_loss: nan | Time: 1311.11 ms
[2022-02-08 19:27:21 main:574] : INFO : Epoch 912 | loss: nan | val_loss: nan | Time: 1276.92 ms
[2022-02-08 19:27:22 main:574] : INFO : Epoch 913 | loss: nan | val_loss: nan | Time: 1307 ms
[2022-02-08 19:27:23 main:574] : INFO : Epoch 914 | loss: nan | val_loss: nan | Time: 1180 ms
[2022-02-08 19:27:25 main:574] : INFO : Epoch 915 | loss: nan | val_loss: nan | Time: 1227.21 ms
[2022-02-08 19:27:26 main:574] : INFO : Epoch 916 | loss: nan | val_loss: nan | Time: 1247.97 ms
[2022-02-08 19:27:27 main:574] : INFO : Epoch 917 | loss: nan | val_loss: nan | Time: 1135.49 ms
[2022-02-08 19:27:28 main:574] : INFO : Epoch 918 | loss: nan | val_loss: nan | Time: 1162.68 ms
[2022-02-08 19:27:29 main:574] : INFO : Epoch 919 | loss: nan | val_loss: nan | Time: 1199.32 ms
[2022-02-08 19:27:31 main:574] : INFO : Epoch 920 | loss: nan | val_loss: nan | Time: 1170.62 ms
[2022-02-08 19:27:32 main:574] : INFO : Epoch 921 | loss: nan | val_loss: nan | Time: 1208.69 ms
[2022-02-08 19:27:33 main:574] : INFO : Epoch 922 | loss: nan | val_loss: nan | Time: 1190.39 ms
[2022-02-08 19:27:34 main:574] : INFO : Epoch 923 | loss: nan | val_loss: nan | Time: 1209.9 ms
[2022-02-08 19:27:35 main:574] : INFO : Epoch 924 | loss: nan | val_loss: nan | Time: 1216.87 ms
[2022-02-08 19:27:37 main:574] : INFO : Epoch 925 | loss: nan | val_loss: nan | Time: 1290 ms
[2022-02-08 19:27:38 main:574] : INFO : Epoch 926 | loss: nan | val_loss: nan | Time: 1221.05 ms
[2022-02-08 19:27:39 main:574] : INFO : Epoch 927 | loss: nan | val_loss: nan | Time: 1181.57 ms
[2022-02-08 19:27:40 main:574] : INFO : Epoch 928 | loss: nan | val_loss: nan | Time: 1210.77 ms
[2022-02-08 19:27:42 main:574] : INFO : Epoch 929 | loss: nan | val_loss: nan | Time: 1221.51 ms
[2022-02-08 19:27:43 main:574] : INFO : Epoch 930 | loss: nan | val_loss: nan | Time: 1177.65 ms
[2022-02-08 19:27:44 main:574] : INFO : Epoch 931 | loss: nan | val_loss: nan | Time: 1191.68 ms
[2022-02-08 19:27:45 main:574] : INFO : Epoch 932 | loss: nan | val_loss: nan | Time: 1224.33 ms
[2022-02-08 19:27:46 main:574] : INFO : Epoch 933 | loss: nan | val_loss: nan | Time: 1278.96 ms
[2022-02-08 19:27:48 main:574] : INFO : Epoch 934 | loss: nan | val_loss: nan | Time: 1160.8 ms
[2022-02-08 19:27:49 main:574] : INFO : Epoch 935 | loss: nan | val_loss: nan | Time: 1180.33 ms
[2022-02-08 19:27:50 main:574] : INFO : Epoch 936 | loss: nan | val_loss: nan | Time: 1161.86 ms
[2022-02-08 19:27:51 main:574] : INFO : Epoch 937 | loss: nan | val_loss: nan | Time: 1180.94 ms
[2022-02-08 19:27:52 main:574] : INFO : Epoch 938 | loss: nan | val_loss: nan | Time: 1199.54 ms
[2022-02-08 19:27:53 main:574] : INFO : Epoch 939 | loss: nan | val_loss: nan | Time: 1196.16 ms
[2022-02-08 19:27:55 main:574] : INFO : Epoch 940 | loss: nan | val_loss: nan | Time: 1187.93 ms
[2022-02-08 19:27:56 main:574] : INFO : Epoch 941 | loss: nan | val_loss: nan | Time: 1180.81 ms
[2022-02-08 19:27:57 main:574] : INFO : Epoch 942 | loss: nan | val_loss: nan | Time: 1140.78 ms
[2022-02-08 19:27:58 main:574] : INFO : Epoch 943 | loss: nan | val_loss: nan | Time: 1184.64 ms
[2022-02-08 19:27:59 main:574] : INFO : Epoch 944 | loss: nan | val_loss: nan | Time: 1165.33 ms
[2022-02-08 19:28:00 main:574] : INFO : Epoch 945 | loss: nan | val_loss: nan | Time: 1151.73 ms
[2022-02-08 19:28:02 main:574] : INFO : Epoch 946 | loss: nan | val_loss: nan | Time: 1185.51 ms
[2022-02-08 19:28:03 main:574] : INFO : Epoch 947 | loss: nan | val_loss: nan | Time: 1203.09 ms
[2022-02-08 19:28:04 main:574] : INFO : Epoch 948 | loss: nan | val_loss: nan | Time: 1220.83 ms
[2022-02-08 19:28:05 main:574] : INFO : Epoch 949 | loss: nan | val_loss: nan | Time: 1188.11 ms
[2022-02-08 19:28:07 main:574] : INFO : Epoch 950 | loss: nan | val_loss: nan | Time: 1252.6 ms
[2022-02-08 19:28:08 main:574] : INFO : Epoch 951 | loss: nan | val_loss: nan | Time: 1209.77 ms
[2022-02-08 19:28:09 main:574] : INFO : Epoch 952 | loss: nan | val_loss: nan | Time: 1214.23 ms
[2022-02-08 19:28:10 main:574] : INFO : Epoch 953 | loss: nan | val_loss: nan | Time: 1195.77 ms
[2022-02-08 19:28:11 main:574] : INFO : Epoch 954 | loss: nan | val_loss: nan | Time: 1163.63 ms
[2022-02-08 19:28:12 main:574] : INFO : Epoch 955 | loss: nan | val_loss: nan | Time: 1163.25 ms
[2022-02-08 19:28:14 main:574] : INFO : Epoch 956 | loss: nan | val_loss: nan | Time: 1273.48 ms
[2022-02-08 19:28:15 main:574] : INFO : Epoch 957 | loss: nan | val_loss: nan | Time: 1169.9 ms
[2022-02-08 19:28:16 main:574] : INFO : Epoch 958 | loss: nan | val_loss: nan | Time: 1178.88 ms
[2022-02-08 19:28:17 main:574] : INFO : Epoch 959 | loss: nan | val_loss: nan | Time: 1169.87 ms
[2022-02-08 19:28:18 main:574] : INFO : Epoch 960 | loss: nan | val_loss: nan | Time: 1216.23 ms
[2022-02-08 19:28:20 main:574] : INFO : Epoch 961 | loss: nan | val_loss: nan | Time: 1209.13 ms
[2022-02-08 19:28:21 main:574] : INFO : Epoch 962 | loss: nan | val_loss: nan | Time: 1267.47 ms
[2022-02-08 19:28:22 main:574] : INFO : Epoch 963 | loss: nan | val_loss: nan | Time: 1203.65 ms
[2022-02-08 19:28:23 main:574] : INFO : Epoch 964 | loss: nan | val_loss: nan | Time: 1164.56 ms
[2022-02-08 19:28:25 main:574] : INFO : Epoch 965 | loss: nan | val_loss: nan | Time: 1225.04 ms
[2022-02-08 19:28:26 main:574] : INFO : Epoch 966 | loss: nan | val_loss: nan | Time: 1288.32 ms
[2022-02-08 19:28:27 main:574] : INFO : Epoch 967 | loss: nan | val_loss: nan | Time: 1161.06 ms
[2022-02-08 19:28:28 main:574] : INFO : Epoch 968 | loss: nan | val_loss: nan | Time: 1160.85 ms
[2022-02-08 19:28:29 main:574] : INFO : Epoch 969 | loss: nan | val_loss: nan | Time: 1211 ms
[2022-02-08 19:28:31 main:574] : INFO : Epoch 970 | loss: nan | val_loss: nan | Time: 1190.69 ms
[2022-02-08 19:28:32 main:574] : INFO : Epoch 971 | loss: nan | val_loss: nan | Time: 1177.95 ms
[2022-02-08 19:28:33 main:574] : INFO : Epoch 972 | loss: nan | val_loss: nan | Time: 1142.81 ms
[2022-02-08 19:28:34 main:574] : INFO : Epoch 973 | loss: nan | val_loss: nan | Time: 1219.6 ms
[2022-02-08 19:28:35 main:574] : INFO : Epoch 974 | loss: nan | val_loss: nan | Time: 1153.17 ms
[2022-02-08 19:28:36 main:574] : INFO : Epoch 975 | loss: nan | val_loss: nan | Time: 1207.76 ms
[2022-02-08 19:28:38 main:574] : INFO : Epoch 976 | loss: nan | val_loss: nan | Time: 1149.29 ms
[2022-02-08 19:28:39 main:574] : INFO : Epoch 977 | loss: nan | val_loss: nan | Time: 1181.35 ms
[2022-02-08 19:28:40 main:574] : INFO : Epoch 978 | loss: nan | val_loss: nan | Time: 1277.38 ms
[2022-02-08 19:28:41 main:574] : INFO : Epoch 979 | loss: nan | val_loss: nan | Time: 1163.69 ms
[2022-02-08 19:28:42 main:574] : INFO : Epoch 980 | loss: nan | val_loss: nan | Time: 1219.43 ms
[2022-02-08 19:28:44 main:574] : INFO : Epoch 981 | loss: nan | val_loss: nan | Time: 1155.21 ms
[2022-02-08 19:28:45 main:574] : INFO : Epoch 982 | loss: nan | val_loss: nan | Time: 1133.32 ms
[2022-02-08 19:28:46 main:574] : INFO : Epoch 983 | loss: nan | val_loss: nan | Time: 1140.18 ms
[2022-02-08 19:28:47 main:574] : INFO : Epoch 984 | loss: nan | val_loss: nan | Time: 1145.89 ms
[2022-02-08 19:28:48 main:574] : INFO : Epoch 985 | loss: nan | val_loss: nan | Time: 1155.51 ms
[2022-02-08 19:28:49 main:574] : INFO : Epoch 986 | loss: nan | val_loss: nan | Time: 1174.61 ms
[2022-02-08 19:28:51 main:574] : INFO : Epoch 987 | loss: nan | val_loss: nan | Time: 1132.23 ms
[2022-02-08 19:28:52 main:574] : INFO : Epoch 988 | loss: nan | val_loss: nan | Time: 1207.05 ms
[2022-02-08 19:28:53 main:574] : INFO : Epoch 989 | loss: nan | val_loss: nan | Time: 1131.94 ms
[2022-02-08 19:28:54 main:574] : INFO : Epoch 990 | loss: nan | val_loss: nan | Time: 1184.57 ms
[2022-02-08 19:28:55 main:574] : INFO : Epoch 991 | loss: nan | val_loss: nan | Time: 1142.99 ms
[2022-02-08 19:28:56 main:574] : INFO : Epoch 992 | loss: nan | val_loss: nan | Time: 1292.48 ms
[2022-02-08 19:28:58 main:574] : INFO : Epoch 993 | loss: nan | val_loss: nan | Time: 1212.34 ms
[2022-02-08 19:28:59 main:574] : INFO : Epoch 994 | loss: nan | val_loss: nan | Time: 1176.69 ms
[2022-02-08 19:29:00 main:574] : INFO : Epoch 995 | loss: nan | val_loss: nan | Time: 1222.72 ms
[2022-02-08 19:29:01 main:574] : INFO : Epoch 996 | loss: nan | val_loss: nan | Time: 1201.5 ms
[2022-02-08 19:29:02 main:574] : INFO : Epoch 997 | loss: nan | val_loss: nan | Time: 1201.18 ms
[2022-02-08 19:29:04 main:574] : INFO : Epoch 998 | loss: nan | val_loss: nan | Time: 1170.78 ms
[2022-02-08 19:29:05 main:574] : INFO : Epoch 999 | loss: nan | val_loss: nan | Time: 1178.36 ms
[2022-02-08 19:29:06 main:574] : INFO : Epoch 1000 | loss: nan | val_loss: nan | Time: 1143.13 ms
[2022-02-08 19:29:07 main:574] : INFO : Epoch 1001 | loss: nan | val_loss: nan | Time: 1165.55 ms
[2022-02-08 19:29:08 main:574] : INFO : Epoch 1002 | loss: nan | val_loss: nan | Time: 1231.71 ms
[2022-02-08 19:29:10 main:574] : INFO : Epoch 1003 | loss: nan | val_loss: nan | Time: 1153.13 ms
[2022-02-08 19:29:11 main:574] : INFO : Epoch 1004 | loss: nan | val_loss: nan | Time: 1173.78 ms
[2022-02-08 19:29:12 main:574] : INFO : Epoch 1005 | loss: nan | val_loss: nan | Time: 1196.98 ms
[2022-02-08 19:29:13 main:574] : INFO : Epoch 1006 | loss: nan | val_loss: nan | Time: 1203.5 ms
[2022-02-08 19:29:14 main:574] : INFO : Epoch 1007 | loss: nan | val_loss: nan | Time: 1172.91 ms
[2022-02-08 19:29:15 main:574] : INFO : Epoch 1008 | loss: nan | val_loss: nan | Time: 1198.52 ms
[2022-02-08 19:29:17 main:574] : INFO : Epoch 1009 | loss: nan | val_loss: nan | Time: 1148.28 ms
[2022-02-08 19:29:18 main:574] : INFO : Epoch 1010 | loss: nan | val_loss: nan | Time: 1181.67 ms
[2022-02-08 19:29:19 main:574] : INFO : Epoch 1011 | loss: nan | val_loss: nan | Time: 1146.56 ms
[2022-02-08 19:29:20 main:574] : INFO : Epoch 1012 | loss: nan | val_loss: nan | Time: 1223.58 ms
[2022-02-08 19:29:21 main:574] : INFO : Epoch 1013 | loss: nan | val_loss: nan | Time: 1273.08 ms
[2022-02-08 19:29:23 main:574] : INFO : Epoch 1014 | loss: nan | val_loss: nan | Time: 1211.19 ms
[2022-02-08 19:29:24 main:574] : INFO : Epoch 1015 | loss: nan | val_loss: nan | Time: 1185.77 ms
[2022-02-08 19:29:25 main:574] : INFO : Epoch 1016 | loss: nan | val_loss: nan | Time: 1203.09 ms
[2022-02-08 19:29:26 main:574] : INFO : Epoch 1017 | loss: nan | val_loss: nan | Time: 1291.27 ms
[2022-02-08 19:29:28 main:574] : INFO : Epoch 1018 | loss: nan | val_loss: nan | Time: 1243.63 ms
[2022-02-08 19:29:29 main:574] : INFO : Epoch 1019 | loss: nan | val_loss: nan | Time: 1276.49 ms
[2022-02-08 19:29:30 main:574] : INFO : Epoch 1020 | loss: nan | val_loss: nan | Time: 1222.79 ms
[2022-02-08 19:29:31 main:574] : INFO : Epoch 1021 | loss: nan | val_loss: nan | Time: 1159.27 ms
[2022-02-08 19:29:32 main:574] : INFO : Epoch 1022 | loss: nan | val_loss: nan | Time: 1182.9 ms
[2022-02-08 19:29:34 main:574] : INFO : Epoch 1023 | loss: nan | val_loss: nan | Time: 1205.38 ms
[2022-02-08 19:29:35 main:574] : INFO : Epoch 1024 | loss: nan | val_loss: nan | Time: 1163.64 ms
[2022-02-08 19:29:36 main:574] : INFO : Epoch 1025 | loss: nan | val_loss: nan | Time: 1176.63 ms
[2022-02-08 19:29:37 main:574] : INFO : Epoch 1026 | loss: nan | val_loss: nan | Time: 1136.1 ms
[2022-02-08 19:29:38 main:574] : INFO : Epoch 1027 | loss: nan | val_loss: nan | Time: 1177.95 ms
[2022-02-08 19:29:40 main:574] : INFO : Epoch 1028 | loss: nan | val_loss: nan | Time: 1188.58 ms
[2022-02-08 19:29:41 main:574] : INFO : Epoch 1029 | loss: nan | val_loss: nan | Time: 1170.58 ms
[2022-02-08 19:29:42 main:574] : INFO : Epoch 1030 | loss: nan | val_loss: nan | Time: 1224.3 ms
[2022-02-08 19:29:43 main:574] : INFO : Epoch 1031 | loss: nan | val_loss: nan | Time: 1244.63 ms
[2022-02-08 19:29:44 main:574] : INFO : Epoch 1032 | loss: nan | val_loss: nan | Time: 1171.5 ms
[2022-02-08 19:29:46 main:574] : INFO : Epoch 1033 | loss: nan | val_loss: nan | Time: 1195.23 ms
[2022-02-08 19:29:47 main:574] : INFO : Epoch 1034 | loss: nan | val_loss: nan | Time: 1292.44 ms
[2022-02-08 19:29:48 main:574] : INFO : Epoch 1035 | loss: nan | val_loss: nan | Time: 1202.22 ms
[2022-02-08 19:29:49 main:574] : INFO : Epoch 1036 | loss: nan | val_loss: nan | Time: 1210.43 ms
[2022-02-08 19:29:50 main:574] : INFO : Epoch 1037 | loss: nan | val_loss: nan | Time: 1192.68 ms
[2022-02-08 19:29:52 main:574] : INFO : Epoch 1038 | loss: nan | val_loss: nan | Time: 1218.89 ms
[2022-02-08 19:29:53 main:574] : INFO : Epoch 1039 | loss: nan | val_loss: nan | Time: 1218.27 ms
[2022-02-08 19:29:54 main:574] : INFO : Epoch 1040 | loss: nan | val_loss: nan | Time: 1194.89 ms
[2022-02-08 19:29:55 main:574] : INFO : Epoch 1041 | loss: nan | val_loss: nan | Time: 1195.9 ms
[2022-02-08 19:29:56 main:574] : INFO : Epoch 1042 | loss: nan | val_loss: nan | Time: 1249.98 ms
[2022-02-08 19:29:58 main:574] : INFO : Epoch 1043 | loss: nan | val_loss: nan | Time: 1209.75 ms
[2022-02-08 19:29:59 main:574] : INFO : Epoch 1044 | loss: nan | val_loss: nan | Time: 1224.29 ms
[2022-02-08 19:30:00 main:574] : INFO : Epoch 1045 | loss: nan | val_loss: nan | Time: 1178.46 ms
[2022-02-08 19:30:01 main:574] : INFO : Epoch 1046 | loss: nan | val_loss: nan | Time: 1188.27 ms
[2022-02-08 19:30:03 main:574] : INFO : Epoch 1047 | loss: nan | val_loss: nan | Time: 1264.45 ms
[2022-02-08 19:30:04 main:574] : INFO : Epoch 1048 | loss: nan | val_loss: nan | Time: 1229.78 ms
[2022-02-08 19:30:05 main:574] : INFO : Epoch 1049 | loss: nan | val_loss: nan | Time: 1196.29 ms
[2022-02-08 19:30:06 main:574] : INFO : Epoch 1050 | loss: nan | val_loss: nan | Time: 1190.55 ms
[2022-02-08 19:30:07 main:574] : INFO : Epoch 1051 | loss: nan | val_loss: nan | Time: 1233.72 ms
[2022-02-08 19:30:09 main:574] : INFO : Epoch 1052 | loss: nan | val_loss: nan | Time: 1210.09 ms
[2022-02-08 19:30:10 main:574] : INFO : Epoch 1053 | loss: nan | val_loss: nan | Time: 1175.64 ms
[2022-02-08 19:30:11 main:574] : INFO : Epoch 1054 | loss: nan | val_loss: nan | Time: 1220.09 ms
[2022-02-08 19:30:12 main:574] : INFO : Epoch 1055 | loss: nan | val_loss: nan | Time: 1152.63 ms
[2022-02-08 19:30:13 main:574] : INFO : Epoch 1056 | loss: nan | val_loss: nan | Time: 1153.56 ms
[2022-02-08 19:30:14 main:574] : INFO : Epoch 1057 | loss: nan | val_loss: nan | Time: 1139.34 ms
[2022-02-08 19:30:16 main:574] : INFO : Epoch 1058 | loss: nan | val_loss: nan | Time: 1196.73 ms
[2022-02-08 19:30:17 main:574] : INFO : Epoch 1059 | loss: nan | val_loss: nan | Time: 1171.94 ms
[2022-02-08 19:30:18 main:574] : INFO : Epoch 1060 | loss: nan | val_loss: nan | Time: 1191.35 ms
[2022-02-08 19:30:19 main:574] : INFO : Epoch 1061 | loss: nan | val_loss: nan | Time: 1149.59 ms
[2022-02-08 19:30:20 main:574] : INFO : Epoch 1062 | loss: nan | val_loss: nan | Time: 1224.58 ms
[2022-02-08 19:30:22 main:574] : INFO : Epoch 1063 | loss: nan | val_loss: nan | Time: 1153.93 ms
[2022-02-08 19:30:23 main:574] : INFO : Epoch 1064 | loss: nan | val_loss: nan | Time: 1139.59 ms
[2022-02-08 19:30:24 main:574] : INFO : Epoch 1065 | loss: nan | val_loss: nan | Time: 1178.76 ms
[2022-02-08 19:30:25 main:574] : INFO : Epoch 1066 | loss: nan | val_loss: nan | Time: 1189.12 ms
[2022-02-08 19:30:26 main:574] : INFO : Epoch 1067 | loss: nan | val_loss: nan | Time: 1156.35 ms
[2022-02-08 19:30:27 main:574] : INFO : Epoch 1068 | loss: nan | val_loss: nan | Time: 1150.8 ms
[2022-02-08 19:30:29 main:574] : INFO : Epoch 1069 | loss: nan | val_loss: nan | Time: 1172.52 ms
[2022-02-08 19:30:30 main:574] : INFO : Epoch 1070 | loss: nan | val_loss: nan | Time: 1178.54 ms
[2022-02-08 19:30:31 main:574] : INFO : Epoch 1071 | loss: nan | val_loss: nan | Time: 1149.65 ms
[2022-02-08 19:30:32 main:574] : INFO : Epoch 1072 | loss: nan | val_loss: nan | Time: 1194.47 ms
[2022-02-08 19:30:33 main:574] : INFO : Epoch 1073 | loss: nan | val_loss: nan | Time: 1184.63 ms
[2022-02-08 19:30:34 main:574] : INFO : Epoch 1074 | loss: nan | val_loss: nan | Time: 1234.64 ms
[2022-02-08 19:30:36 main:574] : INFO : Epoch 1075 | loss: nan | val_loss: nan | Time: 1163.58 ms
[2022-02-08 19:30:37 main:574] : INFO : Epoch 1076 | loss: nan | val_loss: nan | Time: 1128.25 ms
[2022-02-08 19:30:38 main:574] : INFO : Epoch 1077 | loss: nan | val_loss: nan | Time: 1169.67 ms
[2022-02-08 19:30:39 main:574] : INFO : Epoch 1078 | loss: nan | val_loss: nan | Time: 1168.13 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce RTX 3070)
[2022-02-08 19:49:13 main:435] : INFO : Set logging level to 1
[2022-02-08 19:49:13 main:441] : INFO : Running in BOINC Client mode
[2022-02-08 19:49:13 main:444] : INFO : Resolving all filenames
[2022-02-08 19:49:13 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-02-08 19:49:13 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-02-08 19:49:13 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-02-08 19:49:13 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-02-08 19:49:13 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-02-08 19:49:13 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-02-08 19:49:13 main:474] : INFO : Configuration:
[2022-02-08 19:49:13 main:475] : INFO : Model type: GRU
[2022-02-08 19:49:13 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-02-08 19:49:13 main:477] : INFO : Max Epochs: 2048
[2022-02-08 19:49:13 main:478] : INFO : Batch Size: 128
[2022-02-08 19:49:13 main:479] : INFO : Learning Rate: 0.01
[2022-02-08 19:49:13 main:480] : INFO : Patience: 10
[2022-02-08 19:49:13 main:481] : INFO : Hidden Width: 12
[2022-02-08 19:49:13 main:482] : INFO : # Recurrent Layers: 4
[2022-02-08 19:49:13 main:483] : INFO : # Backend Layers: 4
[2022-02-08 19:49:13 main:484] : INFO : # Threads: 1
[2022-02-08 19:49:13 main:486] : INFO : Preparing Dataset
[2022-02-08 19:49:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-02-08 19:49:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-02-08 20:06:22 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-02-08 20:06:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-02-08 20:06:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-02-08 20:06:22 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-02-08 20:06:22 main:494] : INFO : Creating Model
[2022-02-08 20:06:22 main:507] : INFO : Preparing config file
[2022-02-08 20:06:22 main:511] : INFO : Found checkpoint, attempting to load...
[2022-02-08 20:06:22 main:512] : INFO : Loading config
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF900574F69
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 02/08/22 20:06:22
Install Directory : C:\Program Files\BOINC\
Data Directory : Z:\BOINC
Project Symstore :
LoadLibraryA( Z:\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( Z:\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( Z:\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( Z:\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: Z:\BOINC\slots\4;Z:\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000c0a30000 00000000003df000 Z:\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000027d0000 00000000001f5000 C:\Windows\SYSTEM32\ntdll.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 0000000002130000 00000000000be000 C:\Windows\System32\KERNEL32.DLL (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 0000000000540000 00000000002c8000 C:\Windows\System32\KERNELBASE.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 0000000002470000 00000000001a1000 C:\Windows\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 00000000ffee0000 0000000000022000 C:\Windows\System32\win32u.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 0000000002620000 000000000002b000 C:\Windows\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 0000000000400000 000000000010d000 C:\Windows\System32\gdi32full.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 00000000000d0000 000000000009d000 C:\Windows\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000e8a50000 0000000000058000 Z:\BOINC\slots\4\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000000170000 0000000000100000 C:\Windows\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000001890000 00000000000ae000 C:\Windows\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 0000000001330000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000002090000 000000000009c000 C:\Windows\System32\sechost.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000002650000 0000000000125000 C:\Windows\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 00000000e9870000 00000000001e4000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 00000000e2480000 000000000008d000 C:\Windows\SYSTEM32\MSVCP140.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 00000000fd750000 000000000001b000 C:\Windows\SYSTEM32\VCRUNTIME140.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 00000000fd6d0000 000000000000c000 C:\Windows\SYSTEM32\VCRUNTIME140_1.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 0000000085090000 000000000abe7000 Z:\BOINC\slots\4\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000d5840000 000000000020d000 Z:\BOINC\slots\4\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000d5390000 00000000002db000 Z:\BOINC\slots\4\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e1e70000 0000000000040000 Z:\BOINC\slots\4\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000060540000 0000000024b49000 Z:\BOINC\slots\4\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e1e20000 0000000000045000 Z:\BOINC\slots\4\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000009cd30000 00000000034b2000 Z:\BOINC\slots\4\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000a01f0000 00000000030a5000 Z:\BOINC\slots\4\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000fd6c0000 0000000000010000 Z:\BOINC\slots\4\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 000000003bff0000 000000000919f000 Z:\BOINC\slots\4\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000900d0000 0000000003d5b000 Z:\BOINC\slots\4\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000ab180000 0000000001eca000 Z:\BOINC\slots\4\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000045190000 000000001b3a4000 Z:\BOINC\slots\4\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 0000000001860000 0000000000030000 C:\Windows\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000fddf0000 0000000000012000 C:\Windows\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000000ca0000 0000000000472000 C:\Windows\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 0000000000270000 000000000004e000 C:\Windows\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 0000000000510000 0000000000027000 C:\Windows\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 00000000ffc80000 0000000000034000 C:\Windows\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000fff10000 0000000000060000 C:\Windows\System32\WINTRUST.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 00000000fff70000 0000000000156000 C:\Windows\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 00000000ffac0000 0000000000012000 C:\Windows\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000001940000 0000000000744000 C:\Windows\System32\Shell32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 00000000fdff0000 0000000000795000 C:\Windows\SYSTEM32\windows.storage.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 0000000001500000 0000000000355000 C:\Windows\System32\combase.dll (6.2.19041.1348) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 00000000ff930000 000000000002e000 C:\Windows\SYSTEM32\Wldp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 00000000009d0000 00000000000ad000 C:\Windows\System32\SHCORE.dll (6.2.19041.1387) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 0000000001270000 0000000000055000 C:\Windows\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 00000000d50f0000 000000000029d000 C:\Windows\system32\nvcuda.dll (27.21.14.6192) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_00\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.6192
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.162 driver
Product Version : 27.21.14.6192
ModLoad: 00000000f8fb0000 000000000000a000 C:\Windows\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000a6490000 00000000015b8000 C:\Windows\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_5be8de9f3373beaf\nvcuda64.dll (27.21.14.6192) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_00\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.6192
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.162 driver
Product Version : 27.21.14.6192
ModLoad: 0000000000a80000 000000000006b000 C:\Windows\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1081 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1081
ModLoad: 00000000f8f70000 0000000000031000 C:\Windows\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 00000000ff8a0000 000000000000c000 C:\Windows\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000fd910000 000000000009e000 C:\Windows\system32\uxtheme.dll (6.2.19041.1266) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 00000000f1080000 00000000006f2000 C:\Windows\SYSTEM32\nvapi64.dll (27.21.14.6192) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_00\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.6192
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.6192
ModLoad: 00000000013d0000 000000000012a000 C:\Windows\System32\OLE32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1466
ModLoad: 00000000d48d0000 0000000000819000 C:\Windows\System32\DriverStore\FileRepository\nv_dispi.inf_amd64_5be8de9f3373beaf\nvptxJitCompiler64.dll (27.21.14.6192) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 27.21.14.6192
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows PTX JIT Compiler
Product Version : 27.21.14.6192
ModLoad: 0000000000370000 0000000000082000 C:\Windows\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4362, Write: 2035, Other 10070
- I/O Transfers Counters -
Read: 32529962, Write: 1384049391, Other 41958
- Paged Pool Usage -
QuotaPagedPoolUsage: 3470664, QuotaPeakPagedPoolUsage: 3470664
QuotaNonPagedPoolUsage: 46504, QuotaPeakNonPagedPoolUsage: 63232
- Virtual Memory Usage -
VirtualSize: -1066807296, PeakVirtualSize: 533749760
- Pagefile Usage -
PagefileUsage: -1066807296, PeakPagefileUsage: 18948096
- Working Set Size -
WorkingSetSize: 1084641280, PeakWorkingSetSize: -2132426752, PageFaultCount: 21583069
*** Dump of thread ID 21276 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 190156256.000000, User Time: 10012187648.000000, Wait Time: 152770208.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF900574F69
- Registers -
rax=000000008ac28b93 rbx=00000000c0d94910 rcx=00000000580e5e60 rdx=0000000000000001 rsi=00000000580e67a0 rdi=0000000019930520
r8=00000000580e5ef8 r9=0000000000000000 r10=0000000000000000 r11=0000000093e7f300 r12=00000000aa17bcd0 r13=00000000580e69b0
r14=00000000002a9550 r15=0000000000000000 rip=0000000000574f69 rsp=00000000580e6640 rbp=00000000580e6930
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
580e6710 c0caa884 00000040 0000004f aa17b600 0000021c KERNELBASE!RaiseException+0x0
580e6770 c0a51ca6 00000010 e1040000 b76de648 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
580e6820 c0a5593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
580e6970 c0a51a78 00000000 00000000 580e6ca0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
580e6a40 c0a51cfc 580e6ca0 00000000 00000080 580e6f70 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
580e6b00 c0a5c4dd 580e6f70 580e6f70 580e6f70 580e6f70 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
580e6df0 c0a4b2fe 580e7408 580e6f70 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
580ffb90 c0c8c6f8 e2a6ad80 00000000 00000000 e2a6be90 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
580ffbd0 02147034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
580ffc00 02822651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
580ffc80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 19376 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 152770208.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000585ffc70 rsi=0000000000000000 rdi=0000000000000064
r8=00000000585fe33e r9=000000000000003e r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000000286d3f4 rsp=00000000585ffc48 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
585ffc40 0058962e 585ffd08 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
585ffce0 c0a6a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
585ffd10 02147034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
585ffd40 02822651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
585ffdc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 10320 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 152770208.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000586ff660 rsi=0000000000000000 rdi=000000000000000d
r8=0000000000000001 r9=00000000e2c19b00 r10=0000000000000000 r11=00000000586ff5d0 r12=0000000000000064 r13=00000000586ff660
r14=00000000586ff360 r15=0000000000000000 rip=000000000286d8c4 rsp=00000000586ff308 rbp=00000000e2c19ba0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
586ff300 0058cb20 00000000 57e32000 0293a4d0 57e32000 ntdll!ZwWaitForMultipleObjects+0x0
586ff5f0 0058ca1e e1051f40 006e0069 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
586ff630 a66468e4 e2c1e340 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
586ff870 a66de8dd 00000000 e2c19ba0 00000000 00000000 nvcuda64!+0x0
586ff920 a66462b3 bfaa3710 5c3f991b e31f3250 00000000 nvcuda64!cuProfilerStop+0x0
586ff950 a695e054 e31f3250 00000000 00000000 00000000 nvcuda64!+0x0
586ff980 02147034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
586ff9b0 02822651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
586ffa30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3932 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 152704432.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002ac rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002ac
r8=00000000587ffdf8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=00000000000002ac r15=0000000000000000 rip=000000000286cdf4 rsp=00000000587ffd48 rbp=00000000e2c52ac0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
587ffd40 00561a5e 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
587ffde0 a685d55e e31f3460 0056a395 00000000 000002ac KERNELBASE!WaitForSingleObjectEx+0x0
587ffe50 a66462b3 e2c52ac0 e323eab0 e31f3460 00000000 nvcuda64!cuProfilerStop+0x0
587ffe80 a695e054 e31f3460 00000000 00000000 00000000 nvcuda64!+0x0
587ffeb0 02147034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
587ffee0 02822651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
587fff60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 17232 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 152770208.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000e2d0a978 rdx=00000000588ffe58 rsi=00000000588ffdc0 rdi=0000000000000000
r8=000000000000009a r9=0000000000000134 r10=00000000e2ece8b0 r11=00000000588ffdf0 r12=00000000588ffe58 r13=0000000000000000
r14=00000000e2d0a978 r15=00000000e2ece8b0 rip=0000000002870764 rsp=00000000588ffd98 rbp=00000000588ffdf0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
588ffd90 02834295 00000102 00000102 00000000 588ffdc0 ntdll!NtWaitForAlertByThreadId+0x0
588ffe00 005acdd9 e2ecc090 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
588ffe30 a65c4d1c e2ecc090 e2ecc090 e2ecc090 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
588ffe90 a66462b3 00000004 bf910b97 bf910b98 00000000 nvcuda64!+0x0
588ffec0 a695e054 e31f3340 00000000 00000000 00000000 nvcuda64!+0x0
588ffef0 02147034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
588fff20 02822651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
588fffa0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)