Thread: Figure 4.3(b)
View Single Post
Old 12-17-2014, 02:09 PM
yaser's Avatar
yaser yaser is offline
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,478
Default Re: Figure 4.3(b)

Originally Posted by ypeels View Post
Another question about this figure: is there any intuition as to why regions of a given color (fixed overfit measure) are roughly linear in the stochastic N-sigma^2 graph, but non-linear (exponential?) in the deterministic N-Qf graph (for Qf > 10)?

Thank you!
The analysis of the stochastic noise figure may be doable given the clean analytic components of the simulation (Legendre, pseudo-inverse, Gaussian noise). In the deterministic noise figure, the noise value is quantified by the complexity of the target Q_f. While deterministic noise (the part of f that cannot be captured by \mathcal H) is indeed related to Q_f, it is not necessarily linearly related to it so that direct parallel with what happens with stochastic noise does not hold.

BTW, the LaTeX stuff is done by delimiters [ math ] and [ /math ] (without the spaces) instead of $ and $. A bit cumbersome when you use a lot of math.
Where everyone thinks alike, no one thinks very much
Reply With Quote