LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Homework 4 (http://book.caltech.edu/bookforum/forumdisplay.php?f=133)
-   -   Hm 4,q#7 (http://book.caltech.edu/bookforum/showthread.php?t=4361)

samihaq 07-08-2013 07:52 AM

Hm 4,q#7
 
I have two basic questions regarding Q#7

1. How to use 1-step learning for linear regression uses the term Ax + b = y,(b as a constant) as i think in the original form (w = pseudo_inv(X) * y ) it is used for Ax = y. We can take b on other side and subtract from y but then what values of b constant to use.

2. Secondly when we have h(x) = b as hypothesis set then as it is just a constant and there are no parameters, so we cant use any learning algorithm then does it mean that we just to try a range of values for b ?

Thank you very much

yaser 07-08-2013 09:50 AM

Re: Hm 4,q#7
 
Quote:

Originally Posted by samihaq (Post 11180)
1. How to use 1-step learning for linear regression uses the term Ax + b = y,(b as a constant) as i think in the original form (w = pseudo_inv(X) * y ) it is used for Ax = y. We can take b on other side and subtract from y but then what values of b constant to use.

The constant b can be treated as a coefficient of x_0 (which is the constant 1).

Quote:

2. Secondly when we have h(x) = b as hypothesis set then as it is just a constant and there are no parameters, so we cant use any learning algorithm then does it mean that we just to try a range of values for b ?
It is a constant in the sense that the value of the hypothesis does not change for different values of x, but the value of the constant itself can change from one hypothesis to another, so b should be treated as a parameter.

samihaq 07-08-2013 11:02 AM

Re: Hm 4,q#7
 
Thank you very much Professor.


All times are GMT -7. The time now is 12:59 AM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.