Task 5108137
| Name | ParityModified-1619581466-23137-0_0 |
| Workunit | 3065863 |
| Created | 28 Apr 2021, 3:44:28 UTC |
| Sent | 3 May 2021, 18:45:41 UTC |
| Report deadline | 11 May 2021, 18:45:41 UTC |
| Received | 4 May 2021, 0:32:15 UTC |
| Server state | Over |
| Outcome | Validate error |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 6709 |
| Run time | 1 hours 28 min 17 sec |
| CPU time | 1 hours 19 min 6 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 2,621.57 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.56 GB |
| Peak swap size | 3.48 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> INFO : Epoch 1635 | loss: 0.0312413 | val_loss: 0.0312471 | Time: 2428.58 ms [2021-05-03 16:03:56 main:574] : INFO : Epoch 1636 | loss: 0.031241 | val_loss: 0.0312452 | Time: 2458.49 ms [2021-05-03 16:03:58 main:574] : INFO : Epoch 1637 | loss: 0.0312413 | val_loss: 0.0312452 | Time: 2444.94 ms [2021-05-03 16:04:01 main:574] : INFO : Epoch 1638 | loss: 0.0312409 | val_loss: 0.0312441 | Time: 2487.73 ms [2021-05-03 16:04:03 main:574] : INFO : Epoch 1639 | loss: 0.0312406 | val_loss: 0.0312455 | Time: 2592.55 ms [2021-05-03 16:04:06 main:574] : INFO : Epoch 1640 | loss: 0.0312404 | val_loss: 0.0312447 | Time: 2423.33 ms [2021-05-03 16:04:09 main:574] : INFO : Epoch 1641 | loss: 0.0312415 | val_loss: 0.0312469 | Time: 2466.93 ms [2021-05-03 16:04:11 main:574] : INFO : Epoch 1642 | loss: 0.031241 | val_loss: 0.0312478 | Time: 2546.94 ms [2021-05-03 16:04:14 main:574] : INFO : Epoch 1643 | loss: 0.031241 | val_loss: 0.0312454 | Time: 2582.66 ms [2021-05-03 16:04:16 main:574] : INFO : Epoch 1644 | loss: 0.0312402 | val_loss: 0.0312449 | Time: 2469.7 ms [2021-05-03 16:04:19 main:574] : INFO : Epoch 1645 | loss: 0.0312405 | val_loss: 0.0312455 | Time: 2470.83 ms [2021-05-03 16:04:21 main:574] : INFO : Epoch 1646 | loss: 0.0312406 | val_loss: 0.0312507 | Time: 2523.61 ms [2021-05-03 16:04:24 main:574] : INFO : Epoch 1647 | loss: 0.0312422 | val_loss: 0.0312443 | Time: 2516.37 ms [2021-05-03 16:04:27 main:574] : INFO : Epoch 1648 | loss: 0.0312409 | val_loss: 0.031245 | Time: 2490.72 ms [2021-05-03 16:04:29 main:574] : INFO : Epoch 1649 | loss: 0.031241 | val_loss: 0.0312442 | Time: 2473.99 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 960) [2021-05-03 16:07:31 main:435] : INFO : Set logging level to 1 [2021-05-03 16:07:31 main:441] : INFO : Running in BOINC Client mode [2021-05-03 16:07:31 main:444] : INFO : Resolving all filenames [2021-05-03 16:07:31 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-05-03 16:07:31 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1619581466-23137-0_0_r1431718472_1 (exists = 1) [2021-05-03 16:07:31 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1619581466-23137-0_0_r1431718472_0 (exists = 0) [2021-05-03 16:07:31 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2021-05-03 16:07:31 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-05-03 16:07:31 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-05-03 16:07:32 main:474] : INFO : Configuration: [2021-05-03 16:07:32 main:475] : INFO : Model type: GRU [2021-05-03 16:07:32 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-05-03 16:07:32 main:477] : INFO : Max Epochs: 2048 [2021-05-03 16:07:32 main:478] : INFO : Batch Size: 128 [2021-05-03 16:07:32 main:479] : INFO : Learning Rate: 0.01 [2021-05-03 16:07:32 main:480] : INFO : Patience: 10 [2021-05-03 16:07:32 main:481] : INFO : Hidden Width: 12 [2021-05-03 16:07:32 main:482] : INFO : # Recurrent Layers: 4 [2021-05-03 16:07:32 main:483] : INFO : # Backend Layers: 4 [2021-05-03 16:07:32 main:484] : INFO : # Threads: 1 [2021-05-03 16:07:33 main:486] : INFO : Preparing Dataset [2021-05-03 16:07:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-03 16:07:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-03 16:07:36 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-05-03 16:07:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-03 16:07:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-03 16:07:37 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-05-03 16:07:37 main:494] : INFO : Creating Model [2021-05-03 16:07:37 main:507] : INFO : Preparing config file [2021-05-03 16:07:37 main:511] : INFO : Found checkpoint, attempting to load... [2021-05-03 16:07:37 main:512] : INFO : Loading config [2021-05-03 16:07:37 main:514] : INFO : Loading state [2021-05-03 16:07:38 main:559] : INFO : Loading DataLoader into Memory [2021-05-03 16:07:39 main:562] : INFO : Starting Training Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 960) [2021-05-03 16:10:40 main:435] : INFO : Set logging level to 1 [2021-05-03 16:10:40 main:441] : INFO : Running in BOINC Client mode [2021-05-03 16:10:40 main:444] : INFO : Resolving all filenames [2021-05-03 16:10:40 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-05-03 16:10:40 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1619581466-23137-0_0_r1431718472_1 (exists = 1) [2021-05-03 16:10:40 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1619581466-23137-0_0_r1431718472_0 (exists = 0) [2021-05-03 16:10:40 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2021-05-03 16:10:40 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-05-03 16:10:40 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-05-03 16:10:41 main:474] : INFO : Configuration: [2021-05-03 16:10:41 main:475] : INFO : Model type: GRU [2021-05-03 16:10:41 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-05-03 16:10:41 main:477] : INFO : Max Epochs: 2048 [2021-05-03 16:10:41 main:478] : INFO : Batch Size: 128 [2021-05-03 16:10:41 main:479] : INFO : Learning Rate: 0.01 [2021-05-03 16:10:41 main:480] : INFO : Patience: 10 [2021-05-03 16:10:41 main:481] : INFO : Hidden Width: 12 [2021-05-03 16:10:41 main:482] : INFO : # Recurrent Layers: 4 [2021-05-03 16:10:41 main:483] : INFO : # Backend Layers: 4 [2021-05-03 16:10:41 main:484] : INFO : # Threads: 1 [2021-05-03 16:10:41 main:486] : INFO : Preparing Dataset [2021-05-03 16:10:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-03 16:10:42 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-03 16:10:45 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-05-03 16:10:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-03 16:10:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-03 16:10:45 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-05-03 16:10:45 main:494] : INFO : Creating Model [2021-05-03 16:10:45 main:507] : INFO : Preparing config file [2021-05-03 16:10:45 main:511] : INFO : Found checkpoint, attempting to load... [2021-05-03 16:10:45 main:512] : INFO : Loading config [2021-05-03 16:10:45 main:514] : INFO : Loading state [2021-05-03 16:10:47 main:559] : INFO : Loading DataLoader into Memory [2021-05-03 16:10:47 main:562] : INFO : Starting Training [2021-05-03 16:10:50 main:574] : INFO : Epoch 1571 | loss: nan | val_loss: nan | Time: 2835.53 ms [2021-05-03 16:10:52 main:574] : INFO : Epoch 1572 | loss: nan | val_loss: nan | Time: 2428.96 ms [2021-05-03 16:10:55 main:574] : INFO : Epoch 1573 | loss: nan | val_loss: nan | Time: 2451.75 ms [2021-05-03 16:10:58 main:574] : INFO : Epoch 1574 | loss: nan | val_loss: nan | Time: 3149.21 ms [2021-05-03 16:11:00 main:574] : INFO : Epoch 1575 | loss: nan | val_loss: nan | Time: 2495.17 ms [2021-05-03 16:11:03 main:574] : INFO : Epoch 1576 | loss: nan | val_loss: nan | Time: 2435.1 ms [2021-05-03 16:11:05 main:574] : INFO : Epoch 1577 | loss: nan | val_loss: nan | Time: 2492.12 ms [2021-05-03 16:11:08 main:574] : INFO : Epoch 1578 | loss: nan | val_loss: nan | Time: 2467.31 ms [2021-05-03 16:11:10 main:574] : INFO : Epoch 1579 | loss: nan | val_loss: nan | Time: 2459.58 ms [2021-05-03 16:11:13 main:574] : INFO : Epoch 1580 | loss: nan | val_loss: nan | Time: 2423.99 ms [2021-05-03 16:11:16 main:574] : INFO : Epoch 1581 | loss: nan | val_loss: nan | Time: 2416.1 ms [2021-05-03 16:11:18 main:574] : INFO : Epoch 1582 | loss: nan | val_loss: nan | Time: 2500.9 ms [2021-05-03 16:11:21 main:574] : INFO : Epoch 1583 | loss: nan | val_loss: nan | Time: 2735.58 ms [2021-05-03 16:11:24 main:574] : INFO : Epoch 1584 | loss: nan | val_loss: nan | Time: 2410.38 ms [2021-05-03 16:11:26 main:574] : INFO : Epoch 1585 | loss: nan | val_loss: nan | Time: 2425.8 ms [2021-05-03 16:11:29 main:574] : INFO : Epoch 1586 | loss: nan | val_loss: nan | Time: 2512.17 ms [2021-05-03 16:11:31 main:574] : INFO : Epoch 1587 | loss: nan | val_loss: nan | Time: 2443.12 ms [2021-05-03 16:11:34 main:574] : INFO : Epoch 1588 | loss: nan | val_loss: nan | Time: 2434.93 ms [2021-05-03 16:11:36 main:574] : INFO : Epoch 1589 | loss: nan | val_loss: nan | Time: 2478.26 ms [2021-05-03 16:11:39 main:574] : INFO : Epoch 1590 | loss: nan | val_loss: nan | Time: 2473.06 ms [2021-05-03 16:11:42 main:574] : INFO : Epoch 1591 | loss: nan | val_loss: nan | Time: 2922.16 ms [2021-05-03 16:11:44 main:574] : INFO : Epoch 1592 | loss: nan | val_loss: nan | Time: 2466.95 ms [2021-05-03 16:11:47 main:574] : INFO : Epoch 1593 | loss: nan | val_loss: nan | Time: 2489.11 ms [2021-05-03 16:11:49 main:574] : INFO : Epoch 1594 | loss: nan | val_loss: nan | Time: 2463.6 ms [2021-05-03 16:11:52 main:574] : INFO : Epoch 1595 | loss: nan | val_loss: nan | Time: 2568.12 ms [2021-05-03 16:11:55 main:574] : INFO : Epoch 1596 | loss: nan | val_loss: nan | Time: 2455.5 ms [2021-05-03 16:11:57 main:574] : INFO : Epoch 1597 | loss: nan | val_loss: nan | Time: 2499.01 ms [2021-05-03 16:12:00 main:574] : INFO : Epoch 1598 | loss: nan | val_loss: nan | Time: 2489.02 ms [2021-05-03 16:12:02 main:574] : INFO : Epoch 1599 | loss: nan | val_loss: nan | Time: 2477.7 ms [2021-05-03 16:12:05 main:574] : INFO : Epoch 1600 | loss: nan | val_loss: nan | Time: 2455.74 ms [2021-05-03 16:12:07 main:574] : INFO : Epoch 1601 | loss: nan | val_loss: nan | Time: 2438.14 ms [2021-05-03 16:12:10 main:574] : INFO : Epoch 1602 | loss: nan | val_loss: nan | Time: 2445.05 ms [2021-05-03 16:12:13 main:574] : INFO : Epoch 1603 | loss: nan | val_loss: nan | Time: 2444.74 ms [2021-05-03 16:12:15 main:574] : INFO : Epoch 1604 | loss: nan | val_loss: nan | Time: 2465.17 ms [2021-05-03 16:12:18 main:574] : INFO : Epoch 1605 | loss: nan | val_loss: nan | Time: 2470.88 ms [2021-05-03 16:12:20 main:574] : INFO : Epoch 1606 | loss: nan | val_loss: nan | Time: 2575.57 ms [2021-05-03 16:12:23 main:574] : INFO : Epoch 1607 | loss: nan | val_loss: nan | Time: 2781.64 ms [2021-05-03 16:12:26 main:574] : INFO : Epoch 1608 | loss: nan | val_loss: nan | Time: 2524.54 ms [2021-05-03 16:12:28 main:574] : INFO : Epoch 1609 | loss: nan | val_loss: nan | Time: 2750.02 ms [2021-05-03 16:12:31 main:574] : INFO : Epoch 1610 | loss: nan | val_loss: nan | Time: 2522.02 ms [2021-05-03 16:12:34 main:574] : INFO : Epoch 1611 | loss: nan | val_loss: nan | Time: 2479.76 ms [2021-05-03 16:12:36 main:574] : INFO : Epoch 1612 | loss: nan | val_loss: nan | Time: 2418.99 ms [2021-05-03 16:12:39 main:574] : INFO : Epoch 1613 | loss: nan | val_loss: nan | Time: 2600.36 ms [2021-05-03 16:12:42 main:574] : INFO : Epoch 1614 | loss: nan | val_loss: nan | Time: 3018.48 ms [2021-05-03 16:12:45 main:574] : INFO : Epoch 1615 | loss: nan | val_loss: nan | Time: 2692.01 ms [2021-05-03 16:12:47 main:574] : INFO : Epoch 1616 | loss: nan | val_loss: nan | Time: 2519.94 ms [2021-05-03 16:12:50 main:574] : INFO : Epoch 1617 | loss: nan | val_loss: nan | Time: 2455.42 ms [2021-05-03 16:12:52 main:574] : INFO : Epoch 1618 | loss: nan | val_loss: nan | Time: 2425.59 ms [2021-05-03 16:12:55 main:574] : INFO : Epoch 1619 | loss: nan | val_loss: nan | Time: 2489.88 ms [2021-05-03 16:12:57 main:574] : INFO : Epoch 1620 | loss: nan | val_loss: nan | Time: 2430.79 ms [2021-05-03 16:13:00 main:574] : INFO : Epoch 1621 | loss: nan | val_loss: nan | Time: 2478.13 ms [2021-05-03 16:13:02 main:574] : INFO : Epoch 1622 | loss: nan | val_loss: nan | Time: 2441.33 ms [2021-05-03 16:13:05 main:574] : INFO : Epoch 1623 | loss: nan | val_loss: nan | Time: 2498.28 ms [2021-05-03 16:13:08 main:574] : INFO : Epoch 1624 | loss: nan | val_loss: nan | Time: 2453.47 ms [2021-05-03 16:13:10 main:574] : INFO : Epoch 1625 | loss: nan | val_loss: nan | Time: 2432.26 ms [2021-05-03 16:13:13 main:574] : INFO : Epoch 1626 | loss: nan | val_loss: nan | Time: 2473.03 ms [2021-05-03 16:13:15 main:574] : INFO : Epoch 1627 | loss: nan | val_loss: nan | Time: 2462.51 ms [2021-05-03 16:13:18 main:574] : INFO : Epoch 1628 | loss: nan | val_loss: nan | Time: 2426.39 ms [2021-05-03 16:13:20 main:574] : INFO : Epoch 1629 | loss: nan | val_loss: nan | Time: 2469.34 ms [2021-05-03 16:13:23 main:574] : INFO : Epoch 1630 | loss: nan | val_loss: nan | Time: 2393.6 ms [2021-05-03 16:13:25 main:574] : INFO : Epoch 1631 | loss: nan | val_loss: nan | Time: 2445.2 ms [2021-05-03 16:13:28 main:574] : INFO : Epoch 1632 | loss: nan | val_loss: nan | Time: 2420.95 ms [2021-05-03 16:13:30 main:574] : INFO : Epoch 1633 | loss: nan | val_loss: nan | Time: 2415.72 ms [2021-05-03 16:13:33 main:574] : INFO : Epoch 1634 | loss: nan | val_loss: nan | Time: 2449.79 ms [2021-05-03 16:13:35 main:574] : INFO : Epoch 1635 | loss: nan | val_loss: nan | Time: 2456.34 ms [2021-05-03 16:13:38 main:574] : INFO : Epoch 1636 | loss: nan | val_loss: nan | Time: 2475.61 ms [2021-05-03 16:13:40 main:574] : INFO : Epoch 1637 | loss: nan | val_loss: nan | Time: 2432.39 ms [2021-05-03 16:13:43 main:574] : INFO : Epoch 1638 | loss: nan | val_loss: nan | Time: 2567.1 ms [2021-05-03 16:13:45 main:574] : INFO : Epoch 1639 | loss: nan | val_loss: nan | Time: 2443.29 ms [2021-05-03 16:13:48 main:574] : INFO : Epoch 1640 | loss: nan | val_loss: nan | Time: 2427.06 ms [2021-05-03 16:13:51 main:574] : INFO : Epoch 1641 | loss: nan | val_loss: nan | Time: 2593.98 ms [2021-05-03 16:13:53 main:574] : INFO : Epoch 1642 | loss: nan | val_loss: nan | Time: 2731.33 ms [2021-05-03 16:13:56 main:574] : INFO : Epoch 1643 | loss: nan | val_loss: nan | Time: 2836.25 ms [2021-05-03 16:13:59 main:574] : INFO : Epoch 1644 | loss: nan | val_loss: nan | Time: 2619.27 ms [2021-05-03 16:14:02 main:574] : INFO : Epoch 1645 | loss: nan | val_loss: nan | Time: 2647.78 ms [2021-05-03 16:14:05 main:574] : INFO : Epoch 1646 | loss: nan | val_loss: nan | Time: 2648.32 ms [2021-05-03 16:14:07 main:574] : INFO : Epoch 1647 | loss: nan | val_loss: nan | Time: 2496.22 ms [2021-05-03 16:14:10 main:574] : INFO : Epoch 1648 | loss: nan | val_loss: nan | Time: 2473.59 ms [2021-05-03 16:14:12 main:574] : INFO : Epoch 1649 | loss: nan | val_loss: nan | Time: 2403.02 ms [2021-05-03 16:14:15 main:574] : INFO : Epoch 1650 | loss: nan | val_loss: nan | Time: 2530.86 ms [2021-05-03 16:14:18 main:574] : INFO : Epoch 1651 | loss: nan | val_loss: nan | Time: 2544.92 ms [2021-05-03 16:14:20 main:574] : INFO : Epoch 1652 | loss: nan | val_loss: nan | Time: 2499.56 ms [2021-05-03 16:14:23 main:574] : INFO : Epoch 1653 | loss: nan | val_loss: nan | Time: 2492.66 ms [2021-05-03 16:14:25 main:574] : INFO : Epoch 1654 | loss: nan | val_loss: nan | Time: 2525.28 ms [2021-05-03 16:14:28 main:574] : INFO : Epoch 1655 | loss: nan | val_loss: nan | Time: 2450.32 ms [2021-05-03 16:14:30 main:574] : INFO : Epoch 1656 | loss: nan | val_loss: nan | Time: 2508.4 ms [2021-05-03 16:14:33 main:574] : INFO : Epoch 1657 | loss: nan | val_loss: nan | Time: 2447.41 ms [2021-05-03 16:14:35 main:574] : INFO : Epoch 1658 | loss: nan | val_loss: nan | Time: 2450.71 ms [2021-05-03 16:14:38 main:574] : INFO : Epoch 1659 | loss: nan | val_loss: nan | Time: 2401.97 ms [2021-05-03 16:14:40 main:574] : INFO : Epoch 1660 | loss: nan | val_loss: nan | Time: 2401.95 ms [2021-05-03 16:14:43 main:574] : INFO : Epoch 1661 | loss: nan | val_loss: nan | Time: 2586.41 ms [2021-05-03 16:14:46 main:574] : INFO : Epoch 1662 | loss: nan | val_loss: nan | Time: 2497.37 ms [2021-05-03 16:14:48 main:574] : INFO : Epoch 1663 | loss: nan | val_loss: nan | Time: 2426.15 ms [2021-05-03 16:14:51 main:574] : INFO : Epoch 1664 | loss: nan | val_loss: nan | Time: 2446.86 ms [2021-05-03 16:14:53 main:574] : INFO : Epoch 1665 | loss: nan | val_loss: nan | Time: 2473.94 ms [2021-05-03 16:14:56 main:574] : INFO : Epoch 1666 | loss: nan | val_loss: nan | Time: 2470.44 ms [2021-05-03 16:14:58 main:574] : INFO : Epoch 1667 | loss: nan | val_loss: nan | Time: 2433.6 ms [2021-05-03 16:15:01 main:574] : INFO : Epoch 1668 | loss: nan | val_loss: nan | Time: 2607.66 ms [2021-05-03 16:15:04 main:574] : INFO : Epoch 1669 | loss: nan | val_loss: nan | Time: 2430.28 ms [2021-05-03 16:15:06 main:574] : INFO : Epoch 1670 | loss: nan | val_loss: nan | Time: 2507.84 ms [2021-05-03 16:15:09 main:574] : INFO : Epoch 1671 | loss: nan | val_loss: nan | Time: 2466.97 ms [2021-05-03 16:15:11 main:574] : INFO : Epoch 1672 | loss: nan | val_loss: nan | Time: 2482.73 ms [2021-05-03 16:15:14 main:574] : INFO : Epoch 1673 | loss: nan | val_loss: nan | Time: 2482.06 ms [2021-05-03 16:15:16 main:574] : INFO : Epoch 1674 | loss: nan | val_loss: nan | Time: 2444.49 ms [2021-05-03 16:15:19 main:574] : INFO : Epoch 1675 | loss: nan | val_loss: nan | Time: 2453.59 ms [2021-05-03 16:15:22 main:574] : INFO : Epoch 1676 | loss: nan | val_loss: nan | Time: 2454.62 ms [2021-05-03 16:15:24 main:574] : INFO : Epoch 1677 | loss: nan | val_loss: nan | Time: 2486.95 ms [2021-05-03 16:15:27 main:574] : INFO : Epoch 1678 | loss: nan | val_loss: nan | Time: 2433.6 ms [2021-05-03 16:15:29 main:574] : INFO : Epoch 1679 | loss: nan | val_loss: nan | Time: 2483.89 ms [2021-05-03 16:15:32 main:574] : INFO : Epoch 1680 | loss: nan | val_loss: nan | Time: 2445.38 ms [2021-05-03 16:15:34 main:574] : INFO : Epoch 1681 | loss: nan | val_loss: nan | Time: 2456.39 ms [2021-05-03 16:15:37 main:574] : INFO : Epoch 1682 | loss: nan | val_loss: nan | Time: 2442.76 ms [2021-05-03 16:15:39 main:574] : INFO : Epoch 1683 | loss: nan | val_loss: nan | Time: 2429.92 ms [2021-05-03 16:15:42 main:574] : INFO : Epoch 1684 | loss: nan | val_loss: nan | Time: 2480.79 ms [2021-05-03 16:15:44 main:574] : INFO : Epoch 1685 | loss: nan | val_loss: nan | Time: 2590.87 ms [2021-05-03 16:15:47 main:574] : INFO : Epoch 1686 | loss: nan | val_loss: nan | Time: 2472 ms [2021-05-03 16:15:50 main:574] : INFO : Epoch 1687 | loss: nan | val_loss: nan | Time: 2476.26 ms [2021-05-03 16:15:52 main:574] : INFO : Epoch 1688 | loss: nan | val_loss: nan | Time: 2433.81 ms [2021-05-03 16:15:55 main:574] : INFO : Epoch 1689 | loss: nan | val_loss: nan | Time: 2420.79 ms [2021-05-03 16:15:57 main:574] : INFO : Epoch 1690 | loss: nan | val_loss: nan | Time: 2676.22 ms [2021-05-03 16:16:01 main:574] : INFO : Epoch 1691 | loss: nan | val_loss: nan | Time: 2981.78 ms [2021-05-03 16:16:03 main:574] : INFO : Epoch 1692 | loss: nan | val_loss: nan | Time: 2563.68 ms [2021-05-03 16:16:06 main:574] : INFO : Epoch 1693 | loss: nan | val_loss: nan | Time: 2487.2 ms [2021-05-03 16:16:09 main:574] : INFO : Epoch 1694 | loss: nan | val_loss: nan | Time: 2634.25 ms [2021-05-03 16:16:11 main:574] : INFO : Epoch 1695 | loss: nan | val_loss: nan | Time: 2580.83 ms [2021-05-03 16:16:14 main:574] : INFO : Epoch 1696 | loss: nan | val_loss: nan | Time: 2528.22 ms [2021-05-03 16:16:16 main:574] : INFO : Epoch 1697 | loss: nan | val_loss: nan | Time: 2525.52 ms [2021-05-03 16:16:19 main:574] : INFO : Epoch 1698 | loss: nan | val_loss: nan | Time: 2612.29 ms [2021-05-03 16:16:22 main:574] : INFO : Epoch 1699 | loss: nan | val_loss: nan | Time: 2478.88 ms [2021-05-03 16:16:24 main:574] : INFO : Epoch 1700 | loss: nan | val_loss: nan | Time: 2491.02 ms [2021-05-03 16:16:27 main:574] : INFO : Epoch 1701 | loss: nan | val_loss: nan | Time: 2418.97 ms [2021-05-03 16:16:29 main:574] : INFO : Epoch 1702 | loss: nan | val_loss: nan | Time: 2540.72 ms [2021-05-03 16:16:32 main:574] : INFO : Epoch 1703 | loss: nan | val_loss: nan | Time: 2432.22 ms [2021-05-03 16:16:34 main:574] : INFO : Epoch 1704 | loss: nan | val_loss: nan | Time: 2486.34 ms [2021-05-03 16:16:37 main:574] : INFO : Epoch 1705 | loss: nan | val_loss: nan | Time: 2491.92 ms [2021-05-03 16:16:40 main:574] : INFO : Epoch 1706 | loss: nan | val_loss: nan | Time: 2450.44 ms [2021-05-03 16:16:42 main:574] : INFO : Epoch 1707 | loss: nan | val_loss: nan | Time: 2485.87 ms [2021-05-03 16:16:45 main:574] : INFO : Epoch 1708 | loss: nan | val_loss: nan | Time: 2599.61 ms [2021-05-03 16:16:47 main:574] : INFO : Epoch 1709 | loss: nan | val_loss: nan | Time: 2458.62 ms [2021-05-03 16:16:50 main:574] : INFO : Epoch 1710 | loss: nan | val_loss: nan | Time: 2453.3 ms [2021-05-03 16:16:52 main:574] : INFO : Epoch 1711 | loss: nan | val_loss: nan | Time: 2413.8 ms [2021-05-03 16:16:55 main:574] : INFO : Epoch 1712 | loss: nan | val_loss: nan | Time: 2458.87 ms [2021-05-03 16:16:58 main:574] : INFO : Epoch 1713 | loss: nan | val_loss: nan | Time: 2468.41 ms [2021-05-03 16:17:00 main:574] : INFO : Epoch 1714 | loss: nan | val_loss: nan | Time: 2450.07 ms [2021-05-03 16:17:03 main:574] : INFO : Epoch 1715 | loss: nan | val_loss: nan | Time: 2456.1 ms [2021-05-03 16:17:05 main:574] : INFO : Epoch 1716 | loss: nan | val_loss: nan | Time: 2446.86 ms [2021-05-03 16:17:08 main:574] : INFO : Epoch 1717 | loss: nan | val_loss: nan | Time: 2416.75 ms [2021-05-03 16:17:10 main:574] : INFO : Epoch 1718 | loss: nan | val_loss: nan | Time: 2437.56 ms [2021-05-03 16:17:13 main:574] : INFO : Epoch 1719 | loss: nan | val_loss: nan | Time: 2464.97 ms [2021-05-03 16:17:15 main:574] : INFO : Epoch 1720 | loss: nan | val_loss: nan | Time: 2429.49 ms [2021-05-03 16:17:18 main:574] : INFO : Epoch 1721 | loss: nan | val_loss: nan | Time: 2427.49 ms [2021-05-03 16:17:20 main:574] : INFO : Epoch 1722 | loss: nan | val_loss: nan | Time: 2597.99 ms [2021-05-03 16:17:23 main:574] : INFO : Epoch 1723 | loss: nan | val_loss: nan | Time: 2463.07 ms [2021-05-03 16:17:25 main:574] : INFO : Epoch 1724 | loss: nan | val_loss: nan | Time: 2425.99 ms [2021-05-03 16:17:28 main:574] : INFO : Epoch 1725 | loss: nan | val_loss: nan | Time: 2743.01 ms [2021-05-03 16:17:31 main:574] : INFO : Epoch 1726 | loss: nan | val_loss: nan | Time: 2530.79 ms [2021-05-03 16:17:33 main:574] : INFO : Epoch 1727 | loss: nan | val_loss: nan | Time: 2449.03 ms [2021-05-03 16:17:36 main:574] : INFO : Epoch 1728 | loss: nan | val_loss: nan | Time: 2455.08 ms [2021-05-03 16:17:39 main:574] : INFO : Epoch 1729 | loss: nan | val_loss: nan | Time: 2482.89 ms [2021-05-03 16:17:41 main:574] : INFO : Epoch 1730 | loss: nan | val_loss: nan | Time: 2559.73 ms [2021-05-03 16:17:44 main:574] : INFO : Epoch 1731 | loss: nan | val_loss: nan | Time: 2464.84 ms [2021-05-03 16:17:46 main:574] : INFO : Epoch 1732 | loss: nan | val_loss: nan | Time: 2446.14 ms [2021-05-03 16:17:49 main:574] : INFO : Epoch 1733 | loss: nan | val_loss: nan | Time: 2521.36 ms [2021-05-03 16:17:52 main:574] : INFO : Epoch 1734 | loss: nan | val_loss: nan | Time: 2466.51 ms [2021-05-03 16:17:54 main:574] : INFO : Epoch 1735 | loss: nan | val_loss: nan | Time: 2450.94 ms [2021-05-03 16:17:57 main:574] : INFO : Epoch 1736 | loss: nan | val_loss: nan | Time: 2429.94 ms [2021-05-03 16:17:59 main:574] : INFO : Epoch 1737 | loss: nan | val_loss: nan | Time: 2434.01 ms [2021-05-03 16:18:02 main:574] : INFO : Epoch 1738 | loss: nan | val_loss: nan | Time: 2539.25 ms [2021-05-03 16:18:04 main:574] : INFO : Epoch 1739 | loss: nan | val_loss: nan | Time: 2449.01 ms [2021-05-03 16:18:07 main:574] : INFO : Epoch 1740 | loss: nan | val_loss: nan | Time: 2483.72 ms [2021-05-03 16:18:09 main:574] : INFO : Epoch 1741 | loss: nan | val_loss: nan | Time: 2495.13 ms [2021-05-03 16:18:12 main:574] : INFO : Epoch 1742 | loss: nan | val_loss: nan | Time: 2481.41 ms [2021-05-03 16:18:15 main:574] : INFO : Epoch 1743 | loss: nan | val_loss: nan | Time: 2561.46 ms [2021-05-03 16:18:17 main:574] : INFO : Epoch 1744 | loss: nan | val_loss: nan | Time: 2464.26 ms [2021-05-03 16:18:20 main:574] : INFO : Epoch 1745 | loss: nan | val_loss: nan | Time: 2432.81 ms [2021-05-03 16:18:22 main:574] : INFO : Epoch 1746 | loss: nan | val_loss: nan | Time: 2551.82 ms [2021-05-03 16:18:25 main:574] : INFO : Epoch 1747 | loss: nan | val_loss: nan | Time: 2463.97 ms [2021-05-03 16:18:27 main:574] : INFO : Epoch 1748 | loss: nan | val_loss: nan | Time: 2456.85 ms [2021-05-03 16:18:30 main:574] : INFO : Epoch 1749 | loss: nan | val_loss: nan | Time: 2439.13 ms [2021-05-03 16:18:32 main:574] : INFO : Epoch 1750 | loss: nan | val_loss: nan | Time: 2481.38 ms [2021-05-03 16:18:35 main:574] : INFO : Epoch 1751 | loss: nan | val_loss: nan | Time: 2462.62 ms [2021-05-03 16:18:38 main:574] : INFO : Epoch 1752 | loss: nan | val_loss: nan | Time: 2446.11 ms [2021-05-03 16:18:40 main:574] : INFO : Epoch 1753 | loss: nan | val_loss: nan | Time: 2446.77 ms [2021-05-03 16:18:43 main:574] : INFO : Epoch 1754 | loss: nan | val_loss: nan | Time: 2485.99 ms [2021-05-03 16:18:45 main:574] : INFO : Epoch 1755 | loss: nan | val_loss: nan | Time: 2405.03 ms [2021-05-03 16:18:48 main:574] : INFO : Epoch 1756 | loss: nan | val_loss: nan | Time: 2414.57 ms [2021-05-03 16:18:50 main:574] : INFO : Epoch 1757 | loss: nan | val_loss: nan | Time: 2482.04 ms [2021-05-03 16:18:53 main:574] : INFO : Epoch 1758 | loss: nan | val_loss: nan | Time: 2423.07 ms [2021-05-03 16:18:55 main:574] : INFO : Epoch 1759 | loss: nan | val_loss: nan | Time: 2482.19 ms [2021-05-03 16:18:58 main:574] : INFO : Epoch 1760 | loss: nan | val_loss: nan | Time: 2439.43 ms [2021-05-03 16:19:00 main:574] : INFO : Epoch 1761 | loss: nan | val_loss: nan | Time: 2494.51 ms [2021-05-03 16:19:03 main:574] : INFO : Epoch 1762 | loss: nan | val_loss: nan | Time: 2412.46 ms [2021-05-03 16:19:05 main:574] : INFO : Epoch 1763 | loss: nan | val_loss: nan | Time: 2464.38 ms [2021-05-03 16:19:08 main:574] : INFO : Epoch 1764 | loss: nan | val_loss: nan | Time: 2432.55 ms [2021-05-03 16:19:10 main:574] : INFO : Epoch 1765 | loss: nan | val_loss: nan | Time: 2475.52 ms [2021-05-03 16:19:13 main:574] : INFO : Epoch 1766 | loss: nan | val_loss: nan | Time: 2466.33 ms [2021-05-03 16:19:15 main:574] : INFO : Epoch 1767 | loss: nan | val_loss: nan | Time: 2444.94 ms [2021-05-03 16:19:18 main:574] : INFO : Epoch 1768 | loss: nan | val_loss: nan | Time: 2554.66 ms [2021-05-03 16:19:21 main:574] : INFO : Epoch 1769 | loss: nan | val_loss: nan | Time: 2441.04 ms [2021-05-03 16:19:23 main:574] : INFO : Epoch 1770 | loss: nan | val_loss: nan | Time: 2446.2 ms [2021-05-03 16:19:26 main:574] : INFO : Epoch 1771 | loss: nan | val_loss: nan | Time: 2438.01 ms [2021-05-03 16:19:28 main:574] : INFO : Epoch 1772 | loss: nan | val_loss: nan | Time: 2441.15 ms [2021-05-03 16:19:31 main:574] : INFO : Epoch 1773 | loss: nan | val_loss: nan | Time: 2478 ms [2021-05-03 16:19:33 main:574] : INFO : Epoch 1774 | loss: nan | val_loss: nan | Time: 2421.74 ms [2021-05-03 16:19:36 main:574] : INFO : Epoch 1775 | loss: nan | val_loss: nan | Time: 2429.11 ms [2021-05-03 16:19:38 main:574] : INFO : Epoch 1776 | loss: nan | val_loss: nan | Time: 2454.48 ms [2021-05-03 16:19:41 main:574] : INFO : Epoch 1777 | loss: nan | val_loss: nan | Time: 2431.66 ms [2021-05-03 16:19:43 main:574] : INFO : Epoch 1778 | loss: nan | val_loss: nan | Time: 2399.36 ms [2021-05-03 16:19:46 main:574] : INFO : Epoch 1779 | loss: nan | val_loss: nan | Time: 2394.96 ms [2021-05-03 16:19:48 main:574] : INFO : Epoch 1780 | loss: nan | val_loss: nan | Time: 2405.93 ms [2021-05-03 16:19:51 main:574] : INFO : Epoch 1781 | loss: nan | val_loss: nan | Time: 2467.78 ms [2021-05-03 16:19:53 main:574] : INFO : Epoch 1782 | loss: nan | val_loss: nan | Time: 2435.44 ms [2021-05-03 16:19:56 main:574] : INFO : Epoch 1783 | loss: nan | val_loss: nan | Time: 2427.12 ms [2021-05-03 16:19:58 main:574] : INFO : Epoch 1784 | loss: nan | val_loss: nan | Time: 2429.67 ms [2021-05-03 16:20:01 main:574] : INFO : Epoch 1785 | loss: nan | val_loss: nan | Time: 2420.08 ms [2021-05-03 16:20:03 main:574] : INFO : Epoch 1786 | loss: nan | val_loss: nan | Time: 2401.99 ms [2021-05-03 16:20:06 main:574] : INFO : Epoch 1787 | loss: nan | val_loss: nan | Time: 2438.64 ms [2021-05-03 16:20:08 main:574] : INFO : Epoch 1788 | loss: nan | val_loss: nan | Time: 2435.8 ms [2021-05-03 16:20:11 main:574] : INFO : Epoch 1789 | loss: nan | val_loss: nan | Time: 2496.16 ms [2021-05-03 16:20:13 main:574] : INFO : Epoch 1790 | loss: nan | val_loss: nan | Time: 2437.44 ms [2021-05-03 16:20:16 main:574] : INFO : Epoch 1791 | loss: nan | val_loss: nan | Time: 2399.68 ms [2021-05-03 16:20:18 main:574] : INFO : Epoch 1792 | loss: nan | val_loss: nan | Time: 2463.86 ms [2021-05-03 16:20:21 main:574] : INFO : Epoch 1793 | loss: nan | val_loss: nan | Time: 2419.92 ms [2021-05-03 16:20:23 main:574] : INFO : Epoch 1794 | loss: nan | val_loss: nan | Time: 2450.44 ms [2021-05-03 16:20:26 main:574] : INFO : Epoch 1795 | loss: nan | val_loss: nan | Time: 2441.38 ms [2021-05-03 16:20:28 main:574] : INFO : Epoch 1796 | loss: nan | val_loss: nan | Time: 2460.16 ms [2021-05-03 16:20:31 main:574] : INFO : Epoch 1797 | loss: nan | val_loss: nan | Time: 2486.19 ms [2021-05-03 16:20:34 main:574] : INFO : Epoch 1798 | loss: nan | val_loss: nan | Time: 2453.81 ms [2021-05-03 16:20:36 main:574] : INFO : Epoch 1799 | loss: nan | val_loss: nan | Time: 2456 ms [2021-05-03 16:20:39 main:574] : INFO : Epoch 1800 | loss: nan | val_loss: nan | Time: 2443.06 ms [2021-05-03 16:20:41 main:574] : INFO : Epoch 1801 | loss: nan | val_loss: nan | Time: 2447.4 ms [2021-05-03 16:20:44 main:574] : INFO : Epoch 1802 | loss: nan | val_loss: nan | Time: 2473.7 ms [2021-05-03 16:20:46 main:574] : INFO : Epoch 1803 | loss: nan | val_loss: nan | Time: 2510.46 ms [2021-05-03 16:20:49 main:574] : INFO : Epoch 1804 | loss: nan | val_loss: nan | Time: 2438.12 ms [2021-05-03 16:20:51 main:574] : INFO : Epoch 1805 | loss: nan | val_loss: nan | Time: 2416.15 ms [2021-05-03 16:20:54 main:574] : INFO : Epoch 1806 | loss: nan | val_loss: nan | Time: 2457.49 ms [2021-05-03 16:20:56 main:574] : INFO : Epoch 1807 | loss: nan | val_loss: nan | Time: 2472.06 ms [2021-05-03 16:21:00 main:574] : INFO : Epoch 1808 | loss: nan | val_loss: nan | Time: 3304.23 ms [2021-05-03 16:21:03 main:574] : INFO : Epoch 1809 | loss: nan | val_loss: nan | Time: 2598.72 ms [2021-05-03 16:21:05 main:574] : INFO : Epoch 1810 | loss: nan | val_loss: nan | Time: 2451.92 ms [2021-05-03 16:21:08 main:574] : INFO : Epoch 1811 | loss: nan | val_loss: nan | Time: 2532.15 ms [2021-05-03 16:21:10 main:574] : INFO : Epoch 1812 | loss: nan | val_loss: nan | Time: 2503.8 ms [2021-05-03 16:21:13 main:574] : INFO : Epoch 1813 | loss: nan | val_loss: nan | Time: 2416.36 ms [2021-05-03 16:21:15 main:574] : INFO : Epoch 1814 | loss: nan | val_loss: nan | Time: 2450.74 ms [2021-05-03 16:21:18 main:574] : INFO : Epoch 1815 | loss: nan | val_loss: nan | Time: 2487.96 ms [2021-05-03 16:21:20 main:574] : INFO : Epoch 1816 | loss: nan | val_loss: nan | Time: 2437.17 ms [2021-05-03 16:21:23 main:574] : INFO : Epoch 1817 | loss: nan | val_loss: nan | Time: 2442.91 ms [2021-05-03 16:21:25 main:574] : INFO : Epoch 1818 | loss: nan | val_loss: nan | Time: 2416.74 ms [2021-05-03 16:21:28 main:574] : INFO : Epoch 1819 | loss: nan | val_loss: nan | Time: 2455.74 ms [2021-05-03 16:21:31 main:574] : INFO : Epoch 1820 | loss: nan | val_loss: nan | Time: 2442.27 ms [2021-05-03 16:21:33 main:574] : INFO : Epoch 1821 | loss: nan | val_loss: nan | Time: 2463.95 ms [2021-05-03 16:21:36 main:574] : INFO : Epoch 1822 | loss: nan | val_loss: nan | Time: 2501.5 ms [2021-05-03 16:21:38 main:574] : INFO : Epoch 1823 | loss: nan | val_loss: nan | Time: 2470.9 ms [2021-05-03 16:21:41 main:574] : INFO : Epoch 1824 | loss: nan | val_loss: nan | Time: 2464 ms [2021-05-03 16:21:43 main:574] : INFO : Epoch 1825 | loss: nan | val_loss: nan | Time: 2467.02 ms [2021-05-03 16:21:46 main:574] : INFO : Epoch 1826 | loss: nan | val_loss: nan | Time: 2460.41 ms [2021-05-03 16:21:48 main:574] : INFO : Epoch 1827 | loss: nan | val_loss: nan | Time: 2454.94 ms [2021-05-03 16:21:51 main:574] : INFO : Epoch 1828 | loss: nan | val_loss: nan | Time: 2447.78 ms [2021-05-03 16:21:53 main:574] : INFO : Epoch 1829 | loss: nan | val_loss: nan | Time: 2407.8 ms [2021-05-03 16:21:56 main:574] : INFO : Epoch 1830 | loss: nan | val_loss: nan | Time: 2458.81 ms [2021-05-03 16:21:58 main:574] : INFO : Epoch 1831 | loss: nan | val_loss: nan | Time: 2493.35 ms [2021-05-03 16:22:01 main:574] : INFO : Epoch 1832 | loss: nan | val_loss: nan | Time: 2476.43 ms [2021-05-03 16:22:04 main:574] : INFO : Epoch 1833 | loss: nan | val_loss: nan | Time: 2817.2 ms [2021-05-03 16:22:06 main:574] : INFO : Epoch 1834 | loss: nan | val_loss: nan | Time: 2431.09 ms [2021-05-03 16:22:09 main:574] : INFO : Epoch 1835 | loss: nan | val_loss: nan | Time: 2493.04 ms [2021-05-03 16:22:11 main:574] : INFO : Epoch 1836 | loss: nan | val_loss: nan | Time: 2477.47 ms [2021-05-03 16:22:14 main:574] : INFO : Epoch 1837 | loss: nan | val_loss: nan | Time: 2460.65 ms [2021-05-03 16:22:17 main:574] : INFO : Epoch 1838 | loss: nan | val_loss: nan | Time: 2453.93 ms [2021-05-03 16:22:19 main:574] : INFO : Epoch 1839 | loss: nan | val_loss: nan | Time: 2634.37 ms [2021-05-03 16:22:22 main:574] : INFO : Epoch 1840 | loss: nan | val_loss: nan | Time: 2457.63 ms [2021-05-03 16:22:24 main:574] : INFO : Epoch 1841 | loss: nan | val_loss: nan | Time: 2437.19 ms [2021-05-03 16:22:27 main:574] : INFO : Epoch 1842 | loss: nan | val_loss: nan | Time: 2449.47 ms [2021-05-03 16:22:29 main:574] : INFO : Epoch 1843 | loss: nan | val_loss: nan | Time: 2415.04 ms [2021-05-03 16:22:32 main:574] : INFO : Epoch 1844 | loss: nan | val_loss: nan | Time: 2488.3 ms [2021-05-03 16:22:34 main:574] : INFO : Epoch 1845 | loss: nan | val_loss: nan | Time: 2498.28 ms [2021-05-03 16:22:37 main:574] : INFO : Epoch 1846 | loss: nan | val_loss: nan | Time: 2713.29 ms [2021-05-03 16:22:40 main:574] : INFO : Epoch 1847 | loss: nan | val_loss: nan | Time: 2445.27 ms [2021-05-03 16:22:42 main:574] : INFO : Epoch 1848 | loss: nan | val_loss: nan | Time: 2418.98 ms [2021-05-03 16:22:45 main:574] : INFO : Epoch 1849 | loss: nan | val_loss: nan | Time: 2422.73 ms [2021-05-03 16:22:47 main:574] : INFO : Epoch 1850 | loss: nan | val_loss: nan | Time: 2500.55 ms [2021-05-03 16:22:50 main:574] : INFO : Epoch 1851 | loss: nan | val_loss: nan | Time: 2501.89 ms [2021-05-03 16:22:52 main:574] : INFO : Epoch 1852 | loss: nan | val_loss: nan | Time: 2434.7 ms [2021-05-03 16:22:55 main:574] : INFO : Epoch 1853 | loss: nan | val_loss: nan | Time: 2482.63 ms [2021-05-03 16:22:58 main:574] : INFO : Epoch 1854 | loss: nan | val_loss: nan | Time: 2487.7 ms [2021-05-03 16:23:00 main:574] : INFO : Epoch 1855 | loss: nan | val_loss: nan | Time: 2635.52 ms [2021-05-03 16:23:03 main:574] : INFO : Epoch 1856 | loss: nan | val_loss: nan | Time: 2845.1 ms [2021-05-03 16:23:06 main:574] : INFO : Epoch 1857 | loss: nan | val_loss: nan | Time: 2540.45 ms [2021-05-03 16:23:09 main:574] : INFO : Epoch 1858 | loss: nan | val_loss: nan | Time: 2572.2 ms [2021-05-03 16:23:11 main:574] : INFO : Epoch 1859 | loss: nan | val_loss: nan | Time: 2703.92 ms [2021-05-03 16:23:14 main:574] : INFO : Epoch 1860 | loss: nan | val_loss: nan | Time: 2531.44 ms [2021-05-03 16:23:16 main:574] : INFO : Epoch 1861 | loss: nan | val_loss: nan | Time: 2447.72 ms [2021-05-03 16:23:19 main:574] : INFO : Epoch 1862 | loss: nan | val_loss: nan | Time: 2498.32 ms [2021-05-03 16:23:22 main:574] : INFO : Epoch 1863 | loss: nan | val_loss: nan | Time: 2506.82 ms [2021-05-03 16:23:24 main:574] : INFO : Epoch 1864 | loss: nan | val_loss: nan | Time: 2520.12 ms [2021-05-03 16:23:27 main:574] : INFO : Epoch 1865 | loss: nan | val_loss: nan | Time: 2461.44 ms [2021-05-03 16:23:29 main:574] : INFO : Epoch 1866 | loss: nan | val_loss: nan | Time: 2525.26 ms [2021-05-03 16:23:32 main:574] : INFO : Epoch 1867 | loss: nan | val_loss: nan | Time: 2464.36 ms [2021-05-03 16:23:34 main:574] : INFO : Epoch 1868 | loss: nan | val_loss: nan | Time: 2516.74 ms [2021-05-03 16:23:37 main:574] : INFO : Epoch 1869 | loss: nan | val_loss: nan | Time: 2489.42 ms [2021-05-03 16:23:40 main:574] : INFO : Epoch 1870 | loss: nan | val_loss: nan | Time: 2414.81 ms [2021-05-03 16:23:42 main:574] : INFO : Epoch 1871 | loss: nan | val_loss: nan | Time: 2441.29 ms [2021-05-03 16:23:45 main:574] : INFO : Epoch 1872 | loss: nan | val_loss: nan | Time: 2417.15 ms [2021-05-03 16:23:47 main:574] : INFO : Epoch 1873 | loss: nan | val_loss: nan | Time: 2443.73 ms [2021-05-03 16:23:50 main:574] : INFO : Epoch 1874 | loss: nan | val_loss: nan | Time: 2457.55 ms [2021-05-03 16:23:52 main:574] : INFO : Epoch 1875 | loss: nan | val_loss: nan | Time: 2466.97 ms [2021-05-03 16:23:55 main:574] : INFO : Epoch 1876 | loss: nan | val_loss: nan | Time: 2505.28 ms [2021-05-03 16:23:57 main:574] : INFO : Epoch 1877 | loss: nan | val_loss: nan | Time: 2480.04 ms [2021-05-03 16:24:00 main:574] : INFO : Epoch 1878 | loss: nan | val_loss: nan | Time: 2521.26 ms [2021-05-03 16:24:03 main:574] : INFO : Epoch 1879 | loss: nan | val_loss: nan | Time: 2683 ms [2021-05-03 16:24:05 main:574] : INFO : Epoch 1880 | loss: nan | val_loss: nan | Time: 2555.34 ms [2021-05-03 16:24:08 main:574] : INFO : Epoch 1881 | loss: nan | val_loss: nan | Time: 2757.97 ms [2021-05-03 16:24:11 main:574] : INFO : Epoch 1882 | loss: nan | val_loss: nan | Time: 3304.15 ms [2021-05-03 16:24:14 main:574] : INFO : Epoch 1883 | loss: nan | val_loss: nan | Time: 2570.93 ms [2021-05-03 16:24:17 main:574] : INFO : Epoch 1884 | loss: nan | val_loss: nan | Time: 2585.79 ms [2021-05-03 16:24:20 main:574] : INFO : Epoch 1885 | loss: nan | val_loss: nan | Time: 2501.6 ms [2021-05-03 16:24:22 main:574] : INFO : Epoch 1886 | loss: nan | val_loss: nan | Time: 2581.41 ms [2021-05-03 16:24:25 main:574] : INFO : Epoch 1887 | loss: nan | val_loss: nan | Time: 2509.61 ms [2021-05-03 16:24:27 main:574] : INFO : Epoch 1888 | loss: nan | val_loss: nan | Time: 2505.37 ms [2021-05-03 16:24:30 main:574] : INFO : Epoch 1889 | loss: nan | val_loss: nan | Time: 2524.63 ms [2021-05-03 16:24:33 main:574] : INFO : Epoch 1890 | loss: nan | val_loss: nan | Time: 2489.38 ms [2021-05-03 16:24:35 main:574] : INFO : Epoch 1891 | loss: nan | val_loss: nan | Time: 2470.84 ms [2021-05-03 16:24:38 main:574] : INFO : Epoch 1892 | loss: nan | val_loss: nan | Time: 2430.04 ms [2021-05-03 16:24:40 main:574] : INFO : Epoch 1893 | loss: nan | val_loss: nan | Time: 2458.98 ms [2021-05-03 16:24:43 main:574] : INFO : Epoch 1894 | loss: nan | val_loss: nan | Time: 2522.64 ms [2021-05-03 16:24:45 main:574] : INFO : Epoch 1895 | loss: nan | val_loss: nan | Time: 2413.1 ms [2021-05-03 16:24:48 main:574] : INFO : Epoch 1896 | loss: nan | val_loss: nan | Time: 2424.37 ms [2021-05-03 16:24:50 main:574] : INFO : Epoch 1897 | loss: nan | val_loss: nan | Time: 2503.16 ms [2021-05-03 16:24:53 main:574] : INFO : Epoch 1898 | loss: nan | val_loss: nan | Time: 2507.71 ms [2021-05-03 16:24:55 main:574] : INFO : Epoch 1899 | loss: nan | val_loss: nan | Time: 2492.7 ms [2021-05-03 16:24:58 main:574] : INFO : Epoch 1900 | loss: nan | val_loss: nan | Time: 2503.47 ms [2021-05-03 16:25:01 main:574] : INFO : Epoch 1901 | loss: nan | val_loss: nan | Time: 2462.46 ms [2021-05-03 16:25:03 main:574] : INFO : Epoch 1902 | loss: nan | val_loss: nan | Time: 2701.72 ms [2021-05-03 16:25:06 main:574] : INFO : Epoch 1903 | loss: nan | val_loss: nan | Time: 2514.11 ms [2021-05-03 16:25:09 main:574] : INFO : Epoch 1904 | loss: nan | val_loss: nan | Time: 2555.58 ms [2021-05-03 16:25:11 main:574] : INFO : Epoch 1905 | loss: nan | val_loss: nan | Time: 2454.98 ms [2021-05-03 16:25:14 main:574] : INFO : Epoch 1906 | loss: nan | val_loss: nan | Time: 3123.26 ms [2021-05-03 16:25:17 main:574] : INFO : Epoch 1907 | loss: nan | val_loss: nan | Time: 2882.79 ms [2021-05-03 16:25:20 main:574] : INFO : Epoch 1908 | loss: nan | val_loss: nan | Time: 2517.67 ms [2021-05-03 16:25:22 main:574] : INFO : Epoch 1909 | loss: nan | val_loss: nan | Time: 2463.79 ms [2021-05-03 16:25:25 main:574] : INFO : Epoch 1910 | loss: nan | val_loss: nan | Time: 2450.02 ms [2021-05-03 16:25:27 main:574] : INFO : Epoch 1911 | loss: nan | val_loss: nan | Time: 2458.25 ms [2021-05-03 16:25:30 main:574] : INFO : Epoch 1912 | loss: nan | val_loss: nan | Time: 2452.83 ms [2021-05-03 16:25:32 main:574] : INFO : Epoch 1913 | loss: nan | val_loss: nan | Time: 2473.77 ms [2021-05-03 16:25:35 main:574] : INFO : Epoch 1914 | loss: nan | val_loss: nan | Time: 2432.9 ms [2021-05-03 16:25:38 main:574] : INFO : Epoch 1915 | loss: nan | val_loss: nan | Time: 2578.73 ms [2021-05-03 16:25:40 main:574] : INFO : Epoch 1916 | loss: nan | val_loss: nan | Time: 2445.89 ms [2021-05-03 16:25:43 main:574] : INFO : Epoch 1917 | loss: nan | val_loss: nan | Time: 2472.88 ms [2021-05-03 16:25:45 main:574] : INFO : Epoch 1918 | loss: nan | val_loss: nan | Time: 2442.81 ms [2021-05-03 16:25:48 main:574] : INFO : Epoch 1919 | loss: nan | val_loss: nan | Time: 2482.25 ms [2021-05-03 16:25:50 main:574] : INFO : Epoch 1920 | loss: nan | val_loss: nan | Time: 2522.37 ms [2021-05-03 16:25:53 main:574] : INFO : Epoch 1921 | loss: nan | val_loss: nan | Time: 2489 ms [2021-05-03 16:25:56 main:574] : INFO : Epoch 1922 | loss: nan | val_loss: nan | Time: 2510.63 ms [2021-05-03 16:25:58 main:574] : INFO : Epoch 1923 | loss: nan | val_loss: nan | Time: 2566.95 ms [2021-05-03 16:26:02 main:574] : INFO : Epoch 1924 | loss: nan | val_loss: nan | Time: 3683.41 ms [2021-05-03 16:26:05 main:574] : INFO : Epoch 1925 | loss: nan | val_loss: nan | Time: 2627.17 ms [2021-05-03 16:26:08 main:574] : INFO : Epoch 1926 | loss: nan | val_loss: nan | Time: 2551.12 ms [2021-05-03 16:26:10 main:574] : INFO : Epoch 1927 | loss: nan | val_loss: nan | Time: 2715.08 ms [2021-05-03 16:26:13 main:574] : INFO : Epoch 1928 | loss: nan | val_loss: nan | Time: 2512.94 ms [2021-05-03 16:26:16 main:574] : INFO : Epoch 1929 | loss: nan | val_loss: nan | Time: 2507.93 ms [2021-05-03 16:26:18 main:574] : INFO : Epoch 1930 | loss: nan | val_loss: nan | Time: 2566.22 ms [2021-05-03 16:26:21 main:574] : INFO : Epoch 1931 | loss: nan | val_loss: nan | Time: 2475.13 ms [2021-05-03 16:26:23 main:574] : INFO : Epoch 1932 | loss: nan | val_loss: nan | Time: 2405.97 ms [2021-05-03 16:26:26 main:574] : INFO : Epoch 1933 | loss: nan | val_loss: nan | Time: 2400.14 ms [2021-05-03 16:26:28 main:574] : INFO : Epoch 1934 | loss: nan | val_loss: nan | Time: 2430.74 ms [2021-05-03 16:26:31 main:574] : INFO : Epoch 1935 | loss: nan | val_loss: nan | Time: 2459.76 ms [2021-05-03 16:26:33 main:574] : INFO : Epoch 1936 | loss: nan | val_loss: nan | Time: 2450.57 ms [2021-05-03 16:26:36 main:574] : INFO : Epoch 1937 | loss: nan | val_loss: nan | Time: 2448.74 ms [2021-05-03 16:26:38 main:574] : INFO : Epoch 1938 | loss: nan | val_loss: nan | Time: 2455.17 ms [2021-05-03 16:26:41 main:574] : INFO : Epoch 1939 | loss: nan | val_loss: nan | Time: 2465.43 ms [2021-05-03 16:26:43 main:574] : INFO : Epoch 1940 | loss: nan | val_loss: nan | Time: 2471.8 ms [2021-05-03 16:26:46 main:574] : INFO : Epoch 1941 | loss: nan | val_loss: nan | Time: 2407.73 ms [2021-05-03 16:26:48 main:574] : INFO : Epoch 1942 | loss: nan | val_loss: nan | Time: 2472.02 ms [2021-05-03 16:26:51 main:574] : INFO : Epoch 1943 | loss: nan | val_loss: nan | Time: 2448.4 ms [2021-05-03 16:26:54 main:574] : INFO : Epoch 1944 | loss: nan | val_loss: nan | Time: 2462.58 ms [2021-05-03 16:26:56 main:574] : INFO : Epoch 1945 | loss: nan | val_loss: nan | Time: 2458.4 ms [2021-05-03 16:26:59 main:574] : INFO : Epoch 1946 | loss: nan | val_loss: nan | Time: 2497.82 ms [2021-05-03 16:27:01 main:574] : INFO : Epoch 1947 | loss: nan | val_loss: nan | Time: 2482.67 ms [2021-05-03 16:27:04 main:574] : INFO : Epoch 1948 | loss: nan | val_loss: nan | Time: 2454.18 ms [2021-05-03 16:27:06 main:574] : INFO : Epoch 1949 | loss: nan | val_loss: nan | Time: 2478.84 ms [2021-05-03 16:27:09 main:574] : INFO : Epoch 1950 | loss: nan | val_loss: nan | Time: 2379.88 ms [2021-05-03 16:27:11 main:574] : INFO : Epoch 1951 | loss: nan | val_loss: nan | Time: 2469.63 ms [2021-05-03 16:27:14 main:574] : INFO : Epoch 1952 | loss: nan | val_loss: nan | Time: 2429.18 ms [2021-05-03 16:27:16 main:574] : INFO : Epoch 1953 | loss: nan | val_loss: nan | Time: 2437.98 ms [2021-05-03 16:27:19 main:574] : INFO : Epoch 1954 | loss: nan | val_loss: nan | Time: 2551 ms [2021-05-03 16:27:22 main:574] : INFO : Epoch 1955 | loss: nan | val_loss: nan | Time: 2508.63 ms [2021-05-03 16:27:25 main:574] : INFO : Epoch 1956 | loss: nan | val_loss: nan | Time: 2898.78 ms [2021-05-03 16:27:27 main:574] : INFO : Epoch 1957 | loss: nan | val_loss: nan | Time: 2901.77 ms [2021-05-03 16:27:31 main:574] : INFO : Epoch 1958 | loss: nan | val_loss: nan | Time: 2924.84 ms [2021-05-03 16:27:33 main:574] : INFO : Epoch 1959 | loss: nan | val_loss: nan | Time: 2560.55 ms [2021-05-03 16:27:36 main:574] : INFO : Epoch 1960 | loss: nan | val_loss: nan | Time: 2479.75 ms [2021-05-03 16:27:38 main:574] : INFO : Epoch 1961 | loss: nan | val_loss: nan | Time: 2483.7 ms [2021-05-03 16:27:41 main:574] : INFO : Epoch 1962 | loss: nan | val_loss: nan | Time: 2486.51 ms [2021-05-03 16:27:44 main:574] : INFO : Epoch 1963 | loss: nan | val_loss: nan | Time: 2484.12 ms [2021-05-03 16:27:46 main:574] : INFO : Epoch 1964 | loss: nan | val_loss: nan | Time: 2697.17 ms [2021-05-03 16:27:49 main:574] : INFO : Epoch 1965 | loss: nan | val_loss: nan | Time: 2707.66 ms [2021-05-03 16:27:52 main:574] : INFO : Epoch 1966 | loss: nan | val_loss: nan | Time: 2615.5 ms [2021-05-03 16:27:54 main:574] : INFO : Epoch 1967 | loss: nan | val_loss: nan | Time: 2465.27 ms [2021-05-03 16:27:57 main:574] : INFO : Epoch 1968 | loss: nan | val_loss: nan | Time: 2445.52 ms [2021-05-03 16:27:59 main:574] : INFO : Epoch 1969 | loss: nan | val_loss: nan | Time: 2493.88 ms [2021-05-03 16:28:02 main:574] : INFO : Epoch 1970 | loss: nan | val_loss: nan | Time: 2447.96 ms [2021-05-03 16:28:05 main:574] : INFO : Epoch 1971 | loss: nan | val_loss: nan | Time: 2488.73 ms [2021-05-03 16:28:07 main:574] : INFO : Epoch 1972 | loss: nan | val_loss: nan | Time: 2460.45 ms [2021-05-03 16:28:10 main:574] : INFO : Epoch 1973 | loss: nan | val_loss: nan | Time: 2443.32 ms [2021-05-03 16:28:12 main:574] : INFO : Epoch 1974 | loss: nan | val_loss: nan | Time: 2468.76 ms [2021-05-03 16:28:15 main:574] : INFO : Epoch 1975 | loss: nan | val_loss: nan | Time: 2628.3 ms [2021-05-03 16:28:17 main:574] : INFO : Epoch 1976 | loss: nan | val_loss: nan | Time: 2434.7 ms [2021-05-03 16:28:20 main:574] : INFO : Epoch 1977 | loss: nan | val_loss: nan | Time: 2468.04 ms [2021-05-03 16:28:22 main:574] : INFO : Epoch 1978 | loss: nan | val_loss: nan | Time: 2407.21 ms [2021-05-03 16:28:25 main:574] : INFO : Epoch 1979 | loss: nan | val_loss: nan | Time: 2415.21 ms [2021-05-03 16:28:27 main:574] : INFO : Epoch 1980 | loss: nan | val_loss: nan | Time: 2459.42 ms [2021-05-03 16:28:30 main:574] : INFO : Epoch 1981 | loss: nan | val_loss: nan | Time: 3052.1 ms [2021-05-03 16:28:33 main:574] : INFO : Epoch 1982 | loss: nan | val_loss: nan | Time: 2470.49 ms [2021-05-03 16:28:36 main:574] : INFO : Epoch 1983 | loss: nan | val_loss: nan | Time: 2508.54 ms [2021-05-03 16:28:38 main:574] : INFO : Epoch 1984 | loss: nan | val_loss: nan | Time: 2479.51 ms [2021-05-03 16:28:41 main:574] : INFO : Epoch 1985 | loss: nan | val_loss: nan | Time: 2520.54 ms [2021-05-03 16:28:43 main:574] : INFO : Epoch 1986 | loss: nan | val_loss: nan | Time: 2505.74 ms [2021-05-03 16:28:46 main:574] : INFO : Epoch 1987 | loss: nan | val_loss: nan | Time: 2457.4 ms [2021-05-03 16:28:48 main:574] : INFO : Epoch 1988 | loss: nan | val_loss: nan | Time: 2487.14 ms [2021-05-03 16:28:51 main:574] : INFO : Epoch 1989 | loss: nan | val_loss: nan | Time: 2452.67 ms [2021-05-03 16:28:53 main:574] : INFO : Epoch 1990 | loss: nan | val_loss: nan | Time: 2477.09 ms [2021-05-03 16:28:56 main:574] : INFO : Epoch 1991 | loss: nan | val_loss: nan | Time: 2454.64 ms [2021-05-03 16:28:59 main:574] : INFO : Epoch 1992 | loss: nan | val_loss: nan | Time: 2499.64 ms [2021-05-03 16:29:01 main:574] : INFO : Epoch 1993 | loss: nan | val_loss: nan | Time: 2440.76 ms [2021-05-03 16:29:04 main:574] : INFO : Epoch 1994 | loss: nan | val_loss: nan | Time: 2471.68 ms [2021-05-03 16:29:06 main:574] : INFO : Epoch 1995 | loss: nan | val_loss: nan | Time: 2454.37 ms [2021-05-03 16:29:09 main:574] : INFO : Epoch 1996 | loss: nan | val_loss: nan | Time: 2421.79 ms [2021-05-03 16:29:11 main:574] : INFO : Epoch 1997 | loss: nan | val_loss: nan | Time: 2429.36 ms [2021-05-03 16:29:14 main:574] : INFO : Epoch 1998 | loss: nan | val_loss: nan | Time: 2429.02 ms [2021-05-03 16:29:16 main:574] : INFO : Epoch 1999 | loss: nan | val_loss: nan | Time: 2482.05 ms [2021-05-03 16:29:19 main:574] : INFO : Epoch 2000 | loss: nan | val_loss: nan | Time: 2471.21 ms [2021-05-03 16:29:21 main:574] : INFO : Epoch 2001 | loss: nan | val_loss: nan | Time: 2455.53 ms [2021-05-03 16:29:24 main:574] : INFO : Epoch 2002 | loss: nan | val_loss: nan | Time: 2450.68 ms [2021-05-03 16:29:26 main:574] : INFO : Epoch 2003 | loss: nan | val_loss: nan | Time: 2415.16 ms [2021-05-03 16:29:29 main:574] : INFO : Epoch 2004 | loss: nan | val_loss: nan | Time: 2484.54 ms [2021-05-03 16:29:31 main:574] : INFO : Epoch 2005 | loss: nan | val_loss: nan | Time: 2422.26 ms [2021-05-03 16:29:34 main:574] : INFO : Epoch 2006 | loss: nan | val_loss: nan | Time: 2432.96 ms [2021-05-03 16:29:36 main:574] : INFO : Epoch 2007 | loss: nan | val_loss: nan | Time: 2432.44 ms [2021-05-03 16:29:39 main:574] : INFO : Epoch 2008 | loss: nan | val_loss: nan | Time: 2441.4 ms [2021-05-03 16:29:41 main:574] : INFO : Epoch 2009 | loss: nan | val_loss: nan | Time: 2432.99 ms [2021-05-03 16:29:44 main:574] : INFO : Epoch 2010 | loss: nan | val_loss: nan | Time: 2440.95 ms [2021-05-03 16:29:46 main:574] : INFO : Epoch 2011 | loss: nan | val_loss: nan | Time: 2412.92 ms [2021-05-03 16:29:49 main:574] : INFO : Epoch 2012 | loss: nan | val_loss: nan | Time: 2431.81 ms [2021-05-03 16:29:52 main:574] : INFO : Epoch 2013 | loss: nan | val_loss: nan | Time: 2513.42 ms [2021-05-03 16:29:54 main:574] : INFO : Epoch 2014 | loss: nan | val_loss: nan | Time: 2483.1 ms [2021-05-03 16:29:57 main:574] : INFO : Epoch 2015 | loss: nan | val_loss: nan | Time: 2464.75 ms [2021-05-03 16:29:59 main:574] : INFO : Epoch 2016 | loss: nan | val_loss: nan | Time: 2548.04 ms [2021-05-03 16:30:02 main:574] : INFO : Epoch 2017 | loss: nan | val_loss: nan | Time: 2474.87 ms [2021-05-03 16:30:04 main:574] : INFO : Epoch 2018 | loss: nan | val_loss: nan | Time: 2489.83 ms [2021-05-03 16:30:07 main:574] : INFO : Epoch 2019 | loss: nan | val_loss: nan | Time: 2511.89 ms [2021-05-03 16:30:09 main:574] : INFO : Epoch 2020 | loss: nan | val_loss: nan | Time: 2452.14 ms [2021-05-03 16:30:12 main:574] : INFO : Epoch 2021 | loss: nan | val_loss: nan | Time: 2478.69 ms [2021-05-03 16:30:15 main:574] : INFO : Epoch 2022 | loss: nan | val_loss: nan | Time: 2497.92 ms [2021-05-03 16:30:17 main:574] : INFO : Epoch 2023 | loss: nan | val_loss: nan | Time: 2482.18 ms [2021-05-03 16:30:20 main:574] : INFO : Epoch 2024 | loss: nan | val_loss: nan | Time: 2479.08 ms [2021-05-03 16:30:22 main:574] : INFO : Epoch 2025 | loss: nan | val_loss: nan | Time: 2447.56 ms [2021-05-03 16:30:25 main:574] : INFO : Epoch 2026 | loss: nan | val_loss: nan | Time: 2477.54 ms [2021-05-03 16:30:27 main:574] : INFO : Epoch 2027 | loss: nan | val_loss: nan | Time: 2541.97 ms [2021-05-03 16:30:30 main:574] : INFO : Epoch 2028 | loss: nan | val_loss: nan | Time: 2429.87 ms [2021-05-03 16:30:32 main:574] : INFO : Epoch 2029 | loss: nan | val_loss: nan | Time: 2440.35 ms [2021-05-03 16:30:35 main:574] : INFO : Epoch 2030 | loss: nan | val_loss: nan | Time: 2424.46 ms [2021-05-03 16:30:37 main:574] : INFO : Epoch 2031 | loss: nan | val_loss: nan | Time: 2456.38 ms [2021-05-03 16:30:40 main:574] : INFO : Epoch 2032 | loss: nan | val_loss: nan | Time: 2508.7 ms [2021-05-03 16:30:43 main:574] : INFO : Epoch 2033 | loss: nan | val_loss: nan | Time: 2443.28 ms [2021-05-03 16:30:45 main:574] : INFO : Epoch 2034 | loss: nan | val_loss: nan | Time: 2433.82 ms [2021-05-03 16:30:48 main:574] : INFO : Epoch 2035 | loss: nan | val_loss: nan | Time: 2497.38 ms [2021-05-03 16:30:50 main:574] : INFO : Epoch 2036 | loss: nan | val_loss: nan | Time: 2433.72 ms [2021-05-03 16:30:53 main:574] : INFO : Epoch 2037 | loss: nan | val_loss: nan | Time: 2464.61 ms [2021-05-03 16:30:55 main:574] : INFO : Epoch 2038 | loss: nan | val_loss: nan | Time: 2467.81 ms [2021-05-03 16:30:58 main:574] : INFO : Epoch 2039 | loss: nan | val_loss: nan | Time: 2475.91 ms [2021-05-03 16:31:00 main:574] : INFO : Epoch 2040 | loss: nan | val_loss: nan | Time: 2660.94 ms [2021-05-03 16:31:03 main:574] : INFO : Epoch 2041 | loss: nan | val_loss: nan | Time: 2918.99 ms [2021-05-03 16:31:06 main:574] : INFO : Epoch 2042 | loss: nan | val_loss: nan | Time: 2474.74 ms [2021-05-03 16:31:09 main:574] : INFO : Epoch 2043 | loss: nan | val_loss: nan | Time: 2461.24 ms [2021-05-03 16:31:11 main:574] : INFO : Epoch 2044 | loss: nan | val_loss: nan | Time: 2593.58 ms [2021-05-03 16:31:14 main:574] : INFO : Epoch 2045 | loss: nan | val_loss: nan | Time: 2506.67 ms [2021-05-03 16:31:16 main:574] : INFO : Epoch 2046 | loss: nan | val_loss: nan | Time: 2467.02 ms [2021-05-03 16:31:19 main:574] : INFO : Epoch 2047 | loss: nan | val_loss: nan | Time: 2443.35 ms [2021-05-03 16:31:21 main:574] : INFO : Epoch 2048 | loss: nan | val_loss: nan | Time: 2458.93 ms [2021-05-03 16:31:21 main:597] : INFO : Saving trained model to model-final.pt, val_loss nan [2021-05-03 16:31:22 main:603] : INFO : Saving end state to config to file [2021-05-03 16:31:22 main:608] : INFO : Success, exiting.. 16:31:22 (13736): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)