LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Chapter 2 - Training versus Testing (http://book.caltech.edu/bookforum/forumdisplay.php?f=109)
-   -   Bias-Variance Analysis (http://book.caltech.edu/bookforum/showthread.php?t=4597)

prithagupta.nsit 06-21-2015 05:21 AM

Re: Bias-Variance Analysis
Thank you professor, I think I can work from here.

Jackwsimpson 03-05-2017 11:44 AM

Re: Bias-Variance Analysis
I am confused in trying to get from the first line to the second line for the first set of equations on page 63: ... ED[Ex[(g... on the first line to ...Ex[ED[( on the second line.

I sort of see the first line: expected value with respect to data set x (a subset of D I assume) is averaged over all possible data set x's in D. On the second line we have what might be the average of the argument over all of D inside the outer brackets. I don't know how to interpret Ex outside the outer brackets.

In short, I certainly don't understand what exactly is meant by the 2nd line, and I may well not understand the first line. Any further explanation possible?

Vu Van Tu 11-05-2018 03:11 AM

Re: Bias-Variance Analysis
Dear Prof. Yaser,

Can you explain more about variance, the simple idea and example of this?
I read this paragraph but I still cannot fully understand.

'One can also view the variance as a measure of 'instability' in the learning model. Instability manifests in wild reactions to small variations or idiosyn*- crasies in the data, resulting in vastly different hypotheses.'
page 64

how does "small variations or idiosyn*-crasies in the data" effect our final hypothesis (variance of linear model vs constant model for example)?

Thank you very much!

All times are GMT -7. The time now is 09:35 AM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.