View Single Post
Old 12-20-2017, 11:00 AM
Burine Burine is offline
Junior Member
Join Date: Dec 2017
Posts: 1
Default Re: Paradox in VC dimension

Originally Posted by PCdimension View Post
...both research A and B submitted the same neural network model.

It looks paradoxical that the less educated researcher B submitted a better model (less VC dimension and requires less number of sample).
B's model cannot be better, because A and B used the same model.

If you mean B happened to choose a simpler network than A did (e.g. less layers), then since A is more educated clearly he would know how to put weights regularization, dropout,... to avoid overfitting.
Originally Posted by PCdimension View Post
Later years, countless number of researchers had tried different models but all failed to improve the learning performance.
On which ground could we assume that countless other models failed while C's model is sub-optimal?
Reply With Quote