Questions and Answers :
Windows :
Validation error on GPU task done on a 1650
Message board moderation
| Author | Message |
|---|---|
|
Send message Joined: 22 Mar 21 Posts: 2 Credit: 89,586 RAC: 0 |
about 3 out of 6 tasks done had a validation error. |
|
Send message Joined: 9 Jul 20 Posts: 142 Credit: 11,536,204 RAC: 3 |
Your validation rate already looks better now. A certain quota of invalids is to be expected and due to the stochastic nature of neural network learning. The admin John Clemens is already aware of this issue being caused mainly due to NaN errors in midst of the training process and will roll out a fix to periodically check the nature of the computed network weights to catch any NaN weight values and revert/reinitialize the weights to avoid some of the otherwise invalid results. |
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)