LFD Book Forum  

Go Back   LFD Book Forum > Book Feedback - Learning From Data > Chapter 2 - Training versus Testing

Thread Tools Display Modes
Old 06-21-2015, 06:21 AM
prithagupta.nsit prithagupta.nsit is offline
Junior Member
Join Date: Jun 2015
Posts: 7
Default Re: Bias-Variance Analysis

Thank you professor, I think I can work from here.
Reply With Quote
Old 03-05-2017, 12:44 PM
Jackwsimpson Jackwsimpson is offline
Junior Member
Join Date: Mar 2017
Location: On a boat ranging over the eastern third of US & Canada 9 mo, and Sarasota FL the other 3.
Posts: 1
Default Re: Bias-Variance Analysis

I am confused in trying to get from the first line to the second line for the first set of equations on page 63: ... ED[Ex[(g... on the first line to ...Ex[ED[( on the second line.

I sort of see the first line: expected value with respect to data set x (a subset of D I assume) is averaged over all possible data set x's in D. On the second line we have what might be the average of the argument over all of D inside the outer brackets. I don't know how to interpret Ex outside the outer brackets.

In short, I certainly don't understand what exactly is meant by the 2nd line, and I may well not understand the first line. Any further explanation possible?
Reply With Quote
Old 11-05-2018, 04:11 AM
Vu Van Tu Vu Van Tu is offline
Junior Member
Join Date: Nov 2018
Posts: 1
Default Re: Bias-Variance Analysis

Dear Prof. Yaser,

Can you explain more about variance, the simple idea and example of this?
I read this paragraph but I still cannot fully understand.

'One can also view the variance as a measure of 'instability' in the learning model. Instability manifests in wild reactions to small variations or idiosyn*- crasies in the data, resulting in vastly different hypotheses.'
page 64

how does "small variations or idiosyn*-crasies in the data" effect our final hypothesis (variance of linear model vs constant model for example)?

Thank you very much!
Reply With Quote

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT -7. The time now is 11:10 PM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.