LFD Book Forum Hm 4,q#7
 Register FAQ Calendar Mark Forums Read

#1
07-08-2013, 06:52 AM
 samihaq Member Join Date: May 2012 Posts: 15
Hm 4,q#7

I have two basic questions regarding Q#7

1. How to use 1-step learning for linear regression uses the term Ax + b = y,(b as a constant) as i think in the original form (w = pseudo_inv(X) * y ) it is used for Ax = y. We can take b on other side and subtract from y but then what values of b constant to use.

2. Secondly when we have h(x) = b as hypothesis set then as it is just a constant and there are no parameters, so we cant use any learning algorithm then does it mean that we just to try a range of values for b ?

Thank you very much
#2
07-08-2013, 08:50 AM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,478
Re: Hm 4,q#7

Quote:
 Originally Posted by samihaq 1. How to use 1-step learning for linear regression uses the term Ax + b = y,(b as a constant) as i think in the original form (w = pseudo_inv(X) * y ) it is used for Ax = y. We can take b on other side and subtract from y but then what values of b constant to use.
The constant can be treated as a coefficient of (which is the constant 1).

Quote:
 2. Secondly when we have h(x) = b as hypothesis set then as it is just a constant and there are no parameters, so we cant use any learning algorithm then does it mean that we just to try a range of values for b ?
It is a constant in the sense that the value of the hypothesis does not change for different values of , but the value of the constant itself can change from one hypothesis to another, so should be treated as a parameter.
__________________
Where everyone thinks alike, no one thinks very much
#3
07-08-2013, 10:02 AM
 samihaq Member Join Date: May 2012 Posts: 15
Re: Hm 4,q#7

Thank you very much Professor.

 Thread Tools Display Modes Linear Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 07:50 AM.