LFD Book Forum  

Go Back   LFD Book Forum > Course Discussions > Online LFD course > Homework 4

Reply
 
Thread Tools Display Modes
  #1  
Old 04-30-2012, 01:40 AM
silvrous silvrous is offline
Member
 
Join Date: Apr 2012
Posts: 24
Default Hw4 q4

What is the range of a? [-1,1] of [-INF, +INF] ?
Reply With Quote
  #2  
Old 04-30-2012, 03:04 AM
kkkkk kkkkk is offline
Invited Guest
 
Join Date: Mar 2012
Posts: 71
Default Re: Hw4 q4

From my testing, a is within +/- pi.
This follows from the max/min gradient of sin(pi.x) = pi . cos(pi . x)
It is ok to use a larger range, just that the program will run slower.
Reply With Quote
  #3  
Old 04-30-2012, 07:50 AM
silvrous silvrous is offline
Member
 
Join Date: Apr 2012
Posts: 24
Default Re: Hw4 q4

Thanks, but now I think I've hit another snag. Is the bias in class surely 0.21? My calculation shows it as exactly 0.31...
Reply With Quote
  #4  
Old 04-30-2012, 08:27 AM
Tyler Tyler is offline
Junior Member
 
Join Date: Apr 2012
Posts: 9
Default Re: Hw4 q4

I can't help with that but I have a more basic question. To get ax on two points, do we take the "a" based on the average of the two points

(y1+y2)/(x1+x2)
-or-

calculate "a" on each point and take the average?
1/2 (y1/x1 + y2/x2)
Reply With Quote
  #5  
Old 04-30-2012, 10:22 AM
silvrous silvrous is offline
Member
 
Join Date: Apr 2012
Posts: 24
Default Re: Hw4 q4

The two give very different results, but shouldn't they be equivalent in grading?
Reply With Quote
  #6  
Old 04-30-2012, 10:30 AM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,477
Default Re: Hw4 q4

Quote:
Originally Posted by Tyler View Post
I can't help with that but I have a more basic question. To get ax on two points, do we take the "a" based on the average of the two points

(y1+y2)/(x1+x2)
-or-

calculate "a" on each point and take the average?
1/2 (y1/x1 + y2/x2)
Choose the value of a that minimizes the average mean-squared error on the two points.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote
  #7  
Old 04-30-2012, 10:44 AM
jmknapp jmknapp is offline
Member
 
Join Date: Apr 2012
Location: Columbus OH USA
Posts: 14
Default Re: Hw4 q4

I don't think (y1+y2)/(x1+x2) is valid, i.e., not the best choice for the line a*x. Maybe 1/2*(y1/x1 + y2/x2) is close but is it correct?

Seems like the way to go is to get a formula for the distance function (squared distance) and then minimize it. The answer from that process differs from 1/2*(y1/x1 + y2/x2).

EDIT: Prof. Mostafa posted while I was checking that result.
Reply With Quote
  #8  
Old 04-30-2012, 03:27 PM
kurts kurts is offline
Invited Guest
 
Join Date: Apr 2012
Location: Portland, OR
Posts: 70
Default Re: Hw4 q4

Quote:
Is the bias in class surely 0.21?
In class, the hypothesis that resulted in a bias of 0.21 was of the form ax+b, where the line was free to be offset from the origin. In this problem, b is restricted to be 0, so one would expect the bias to be different.
Reply With Quote
  #9  
Old 04-30-2012, 08:44 PM
kkkkk kkkkk is offline
Invited Guest
 
Join Date: Mar 2012
Posts: 71
Default Re: Hw4 q4

Quote:
Originally Posted by kurts View Post
In class, the hypothesis that resulted in a bias of 0.21 was of the form ax+b, where the line was free to be offset from the origin. In this problem, b is restricted to be 0, so one would expect the bias to be different.
In Lecture 8 slide 15, for y=ax+b, g_bar passes through the origin even though it is not forced to. This is reasonable due to the 'symmetry' of the curve.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 05:20 PM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.