- **Chapter 4 - Overfitting**
(*http://book.caltech.edu/bookforum/forumdisplay.php?f=111*)

- - **Overfitting with Polynomials : deterministic noise**
(*http://book.caltech.edu/bookforum/showthread.php?t=1040*)

Overfitting with Polynomials : deterministic noiseI have some difficulty to understand the idea of deterministic noise. I think there are some disturbing contradiction with what we've seen with the bias-variance tradeoff, particularly with 50th order noiseless target exemple.
Chapter 4 state that: - A 2nd order polynomial could be better than a 10th order polynomial to fit a 50th order polynomial target and it's due to the deterministic noise. --> So I conclude that there is more deterministic noise with 10th order than with the 2nd order. - Deterministic noise=bias But we've seen with the bias-variance tradeoff, that a more complex model than an other have a lower bias. Obvioulsy, I'm wrong somewhere, but where ? |

Re: Overfitting with Polynomials : deterministic noiseQuote:
If you want to isolate the impact of deterministic noise on overfitting without interference from the model complexity, you can fix the model and change the complexity of the target function. |

All times are GMT -7. The time now is 12:35 PM. |

Powered by vBulletin® Version 3.8.3

Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.

The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.