LFD Book Forum  

Go Back   LFD Book Forum > Course Discussions > Online LFD course > Homework 1

Reply
 
Thread Tools Display Modes
  #21  
Old 06-16-2013, 08:48 AM
zhou_jinyuan zhou_jinyuan is offline
Junior Member
 
Join Date: Jun 2013
Posts: 1
Default Re: Confused on question 6.

I just started. Not sure if forum is closed or not. I have confusion too. As I understand hypothesis set is associated with a learning algorithm. does g in choice from a to d come from same learning algorithm or description represents different algorithm? Since we have 256 possible hypothesis, I can conceptually call my learning algorithm "try all" which have all 256 possible functions as its hypothesis. Does this exercise assume we are working with "try all" algorithm?.
Thanks,
Reply With Quote
  #22  
Old 06-16-2013, 01:51 PM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,475
Default Re: Confused on question 6.

Quote:
Originally Posted by zhou_jinyuan View Post
I have confusion too. As I understand hypothesis set is associated with a learning algorithm. does g in choice from a to d come from same learning algorithm or description represents different algorithm? Since we have 256 possible hypothesis, I can conceptually call my learning algorithm "try all" which have all 256 possible functions as its hypothesis. Does this exercise assume we are working with "try all" algorithm?
A hypothesis set is just that; a set of hypotheses. The algorithm is a separate entity that chooses the final hypothesis from this set. It can in principle make that choice any way it wants (some algorithms may be better than others for the same hypothesis set).

To answer your question, the algorithm can try all hypotheses (in the hypothesis set), but it will have to choose one and only one as the final hypothesis that it reports. When we grade the algorithm, what matters is the performance of the final hypothesis it arrived at, regardless of how it arrived at it.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote
  #23  
Old 06-21-2013, 12:07 PM
royal royal is offline
Junior Member
 
Join Date: Jun 2013
Posts: 3
Default Re: Confused on question 6.

It's taking me a while to get my head around whats going on in this question and how I am supposed to calculate the scores.

For a) , the hypothesis g returns 1 for all three points. So does this mean that for each of the points 101,110 and 111 as x_n, then y_n is 1 ?

If so then I am not sure what I am then supposed to compare this to?

Thanks for any help.
Reply With Quote
  #24  
Old 06-21-2013, 01:00 PM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,475
Default Re: Confused on question 6.

Quote:
Originally Posted by royal View Post
For a) , the hypothesis g returns 1 for all three points. So does this mean that for each of the points 101,110 and 111 as x_n, then y_n is 1 ?

If so then I am not sure what I am then supposed to compare this to?
Correct. In this problem, we are considering different target functions (an unusual consideration that is meant to underline the difficulty of learning). You compare the values of g to the values of each f on these 3 points, and compute the score based on the different f's that can be the target function.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote
  #25  
Old 06-21-2013, 02:32 PM
royal royal is offline
Junior Member
 
Join Date: Jun 2013
Posts: 3
Default Re: Confused on question 6.

Thanks for the quick reply.

I've only just realised that the fact I've done very little Boolean other than knowing what the basic gates are is making this confusing for me? I did some further reading, but it's hard to find a quick summary? Sorry to be asking dumb questions but using AND, OR and NOT I get 9 possible functions instead of 8:

a+b+c
a+b*c
a*b*c
a*b+c

a'b'c
a'b+c
a+b'c

a*b'c
a'b*c

Is there something straight forward thats wrong about this or do I need to go and spend an evening learning these before moving on?!
Reply With Quote
  #26  
Old 06-21-2013, 03:22 PM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,475
Default Re: Confused on question 6.

Quote:
Originally Posted by royal View Post
Thanks for the quick reply.

I've only just realised that the fact I've done very little Boolean other than knowing what the basic gates are is making this confusing for me? I did some further reading, but it's hard to find a quick summary? Sorry to be asking dumb questions but using AND, OR and NOT I get 9 possible functions instead of 8:

a+b+c
a+b*c
a*b*c
a*b+c

a'b'c
a'b+c
a+b'c

a*b'c
a'b*c

Is there something straight forward thats wrong about this or do I need to go and spend an evening learning these before moving on?!
No need to go through AND/OR implementation in this case. All you need is to list the all possible target functions (by values) on these three points exhaustively. That would be the 2^3=8 possible binary combinations of of 3 bits.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote
  #27  
Old 09-02-2015, 10:19 PM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,475
Default Re: Confused on question 6.

Could you post the question in an *ANSWER* thread (see above "BEFORE posting answers - please read").
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote
  #28  
Old 09-02-2015, 10:46 PM
henry2015 henry2015 is offline
Member
 
Join Date: Aug 2015
Posts: 31
Default Re: Confused on question 6.

Sorry, deleted.

Will post under the correct thread.
Reply With Quote
  #29  
Old 03-12-2016, 06:43 AM
robbinsleep robbinsleep is offline
Junior Member
 
Join Date: Mar 2016
Posts: 2
Default Re: Confused on question 6.

This is exactly what I am going to ask also
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 10:57 AM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2018, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.