Quote:
Originally Posted by Moobb
is there any guidance towards how to construct a neural net? I am thinking about the balance between the number of hidden layers and the number of units per layer.
|
Excellent question. From a theoretical point of view, it is difficult to do an exact analysis. There are bits and pieces of practical results. For instance, there was a tendency to use shallow neural networks for almost two decades, quite successfully in some applications such as computational finance. More recently, deeper neural networks have shown promise in certain applications such as computer vision. The performance seems to be domain-specific, but the jury is still out.