Thread: Figure 4.3(b) View Single Post
#4
12-17-2014, 02:09 PM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,478
Re: Figure 4.3(b)

Quote:
 Originally Posted by ypeels Another question about this figure: is there any intuition as to why regions of a given color (fixed overfit measure) are roughly linear in the stochastic N-sigma^2 graph, but non-linear (exponential?) in the deterministic N-Qf graph (for Qf > 10)? Thank you!
The analysis of the stochastic noise figure may be doable given the clean analytic components of the simulation (Legendre, pseudo-inverse, Gaussian noise). In the deterministic noise figure, the noise value is quantified by the complexity of the target . While deterministic noise (the part of that cannot be captured by ) is indeed related to , it is not necessarily linearly related to it so that direct parallel with what happens with stochastic noise does not hold.

BTW, the LaTeX stuff is done by delimiters [ math ] and [ /math ] (without the spaces) instead of $and$. A bit cumbersome when you use a lot of math.
__________________
Where everyone thinks alike, no one thinks very much