LFD Book Forum  

Go Back   LFD Book Forum > Book Feedback - Learning From Data > Chapter 4 - Overfitting

Reply
 
Thread Tools Display Modes
  #1  
Old 11-13-2018, 03:24 AM
stnvntngrn stnvntngrn is offline
Junior Member
 
Join Date: Sep 2018
Posts: 6
Default Problem 4.4 - computation time/variance

I am implementing the framework of problem 4.4, and am wondering how nice I should expect the results to be.

The analogue of figure 4.3(a) that I generate, apart from resolution as per the parameters given in the problem, does not look nearly as nice as the actual figure 4.3(a) -- while the figures are qualitatively the same, mine has significant "noise".

Initially my implementation took 200 experiments at each data point, as a compromise between precision and computation time, but I just let it run over night at with 5000 experiments (took a bit over three hours in the end), and still get noticeable noise, cf. attached image.

As such, I would like to know how many experiments were used to generate figure 4.3(a) in the book. Moreover, if this is not significantly higher than my 5000, do you have any guesses how I could manage to have generated incorrect noise but otherwise seemingly correct data? Finally, if your implementation of 4.3(a) involves some significant clever tricks compared to problem 4.4, or involves a very large number of experiments/very long computation time for an exercise in a book, maybe it would be nice to indicate this in the problem.
Attached Thumbnails
my43a.png  
Reply With Quote
  #2  
Old 11-18-2018, 08:14 PM
htlin's Avatar
htlin htlin is offline
NTU
 
Join Date: Aug 2009
Location: Taipei, Taiwan
Posts: 588
Default Re: Problem 4.4 - computation time/variance

Thanks for asking. The current figure is generated with 1000000 experiments per point to generate high-quality figures for printing. Usually we don't think readers/students need to run so many experiments to understand the concepts, though.
__________________
When one teaches, two learn.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 11:52 AM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2018, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.