LFD Book Forum Confused on question 6.
 User Name Remember Me? Password
 Register FAQ Calendar Mark Forums Read

 Thread Tools Display Modes
#21
06-16-2013, 08:48 AM
 zhou_jinyuan Junior Member Join Date: Jun 2013 Posts: 1
Re: Confused on question 6.

I just started. Not sure if forum is closed or not. I have confusion too. As I understand hypothesis set is associated with a learning algorithm. does g in choice from a to d come from same learning algorithm or description represents different algorithm? Since we have 256 possible hypothesis, I can conceptually call my learning algorithm "try all" which have all 256 possible functions as its hypothesis. Does this exercise assume we are working with "try all" algorithm?.
Thanks,
#22
06-16-2013, 01:51 PM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,478
Re: Confused on question 6.

Quote:
 Originally Posted by zhou_jinyuan I have confusion too. As I understand hypothesis set is associated with a learning algorithm. does g in choice from a to d come from same learning algorithm or description represents different algorithm? Since we have 256 possible hypothesis, I can conceptually call my learning algorithm "try all" which have all 256 possible functions as its hypothesis. Does this exercise assume we are working with "try all" algorithm?
A hypothesis set is just that; a set of hypotheses. The algorithm is a separate entity that chooses the final hypothesis from this set. It can in principle make that choice any way it wants (some algorithms may be better than others for the same hypothesis set).

To answer your question, the algorithm can try all hypotheses (in the hypothesis set), but it will have to choose one and only one as the final hypothesis that it reports. When we grade the algorithm, what matters is the performance of the final hypothesis it arrived at, regardless of how it arrived at it.
__________________
Where everyone thinks alike, no one thinks very much
#23
06-21-2013, 12:07 PM
 royal Junior Member Join Date: Jun 2013 Posts: 3
Re: Confused on question 6.

It's taking me a while to get my head around whats going on in this question and how I am supposed to calculate the scores.

For a) , the hypothesis g returns 1 for all three points. So does this mean that for each of the points 101,110 and 111 as x_n, then y_n is 1 ?

If so then I am not sure what I am then supposed to compare this to?

Thanks for any help.
#24
06-21-2013, 01:00 PM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,478
Re: Confused on question 6.

Quote:
 Originally Posted by royal For a) , the hypothesis g returns 1 for all three points. So does this mean that for each of the points 101,110 and 111 as x_n, then y_n is 1 ? If so then I am not sure what I am then supposed to compare this to?
Correct. In this problem, we are considering different target functions (an unusual consideration that is meant to underline the difficulty of learning). You compare the values of to the values of each on these 3 points, and compute the score based on the different 's that can be the target function.
__________________
Where everyone thinks alike, no one thinks very much
#25
06-21-2013, 02:32 PM
 royal Junior Member Join Date: Jun 2013 Posts: 3
Re: Confused on question 6.

Thanks for the quick reply.

I've only just realised that the fact I've done very little Boolean other than knowing what the basic gates are is making this confusing for me? I did some further reading, but it's hard to find a quick summary? Sorry to be asking dumb questions but using AND, OR and NOT I get 9 possible functions instead of 8:

a+b+c
a+b*c
a*b*c
a*b+c

a'b'c
a'b+c
a+b'c

a*b'c
a'b*c

Is there something straight forward thats wrong about this or do I need to go and spend an evening learning these before moving on?!
#26
06-21-2013, 03:22 PM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,478
Re: Confused on question 6.

Quote:
 Originally Posted by royal Thanks for the quick reply. I've only just realised that the fact I've done very little Boolean other than knowing what the basic gates are is making this confusing for me? I did some further reading, but it's hard to find a quick summary? Sorry to be asking dumb questions but using AND, OR and NOT I get 9 possible functions instead of 8: a+b+c a+b*c a*b*c a*b+c a'b'c a'b+c a+b'c a*b'c a'b*c Is there something straight forward thats wrong about this or do I need to go and spend an evening learning these before moving on?!
No need to go through AND/OR implementation in this case. All you need is to list the all possible target functions (by values) on these three points exhaustively. That would be the possible binary combinations of of 3 bits.
__________________
Where everyone thinks alike, no one thinks very much
#27
09-02-2015, 10:19 PM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,478
Re: Confused on question 6.

Could you post the question in an *ANSWER* thread (see above "BEFORE posting answers - please read").
__________________
Where everyone thinks alike, no one thinks very much
#28
09-02-2015, 10:46 PM
 henry2015 Member Join Date: Aug 2015 Posts: 31
Re: Confused on question 6.

Sorry, deleted.

Will post under the correct thread.
#29
03-12-2016, 06:43 AM
 robbinsleep Junior Member Join Date: Mar 2016 Posts: 2
Re: Confused on question 6.

This is exactly what I am going to ask also

 Thread Tools Display Modes Linear Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 02:19 AM.

 Contact Us - LFD Book - Top

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.