LFD Book Forum Question on puzzle from lecture #5
 User Name Remember Me? Password
 Register FAQ Calendar Mark Forums Read

 Thread Tools Display Modes
#1
04-18-2012, 06:32 PM
 jcatanz Member Join Date: Apr 2012 Posts: 41
Question on puzzle from lecture #5

In considering the possible dichotomies of 3 points (subject to the restriction of a breakpoint at k=2) you said that

o o o
o o x
o x o

are allowed. Here, o and x can represent -1 and +1.

Then you said

o x x is not allowed,

x o o is allowed,

x o x,

x x o, and

x x x are not allowed.

So that for 3 points, half of the possible dichotomies are eliminated.

If there is a breakpoint at k = 2, all we can say is that not all of the 2^2 = 4 possible dichotomies {+1,-1}, {+1,+1} {-1,+1} {-1,-1} for two points are allowed.

How did you determine which dichotomies are not allowed?

#2
04-18-2012, 09:02 PM
 kkkkk Invited Guest Join Date: Mar 2012 Posts: 71
Re: Question on puzzle from lecture #5

I believe there are other possible solutions. So long that for any 2 of the 3 columns, if there are less than 2^N = 4 unique patterns, the break point of 2 is satisifed.
#3
04-19-2012, 08:49 AM
 jcatanz Member Join Date: Apr 2012 Posts: 41
Re: Question on puzzle from lecture #5

Quote:
 Originally Posted by kkkkk I believe there are other possible solutions. So long that for any 2 of the 3 columns, if there are less than 2^N = 4 unique patterns, the break point of 2 is satisifed.
I agree.

But in the lecture Prof. Abu-Mostafa seemed to prompt the class, asking if each successive dichotomy (composed from counting to 8 in binary) were allowed or not allowed, as if the answer were unique.
#4
04-19-2012, 01:27 PM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,478
Re: Question on puzzle from lecture #5

Quote:
 Originally Posted by jcatanz I agree. But in the lecture Prof. Abu-Mostafa seemed to prompt the class, asking if each successive dichotomy (composed from counting to 8 in binary) were allowed or not allowed, as if the answer were unique.
The unique is the numerical values of the maximum, namely 4. The identity of the 4 patterns is not unique.
__________________
Where everyone thinks alike, no one thinks very much
#5
04-19-2012, 03:38 PM
 jcatanz Member Join Date: Apr 2012 Posts: 41
Re: Question on puzzle from lecture #5

OK, that's what I thought. Thanks, Prof. Abu-Mostafa.
--Joe
#6
01-28-2013, 12:18 PM
 vikram360 Junior Member Join Date: Apr 2012 Posts: 5
Re: Question on puzzle from lecture #5

Quote:
 Originally Posted by yaser The unique is the numerical values of the maximum, namely 4. The identity of the 4 patterns is not unique.
So, ( I'm asking just to reinforce my understanding of this)
What Prof. Abu-Mostafa was saying was, given
o o o
o o x
o x o

are allowed, the following i.e

o x x
x o x
x x o
x x x

are not allowed ?
#7
01-28-2013, 12:44 PM
 vikram360 Junior Member Join Date: Apr 2012 Posts: 5
Re: Question on puzzle from lecture #5

Ok, I got it now. I hadn't watched the Q&A after the lectures (until now) so for anybody who's still having a problem, here's what I've understood.

* You're given 3 points and the break point k (=2 in this case).
* Start enumerating the possibilities and for convenience, lets do this in a binary sequence.
* Note that you don't know which 4th pattern of any two points is not allowed. You just know that one of the four is not allowed (because of the breakpoint).
* (In the lecture), black dots and white dots can be +1 or -1 ( or -1 and +1 - it doesn't matter). All that matters is that not all four combinations of 2 points are allowed. (In my explanation I use o and x)
* So let's start enumerating the possibilities
Possibility 1 (all white)
x1 x2 x3
0 0 0 (allowed because irrespective of which 2 points you take, you've seen just one pattern).
0 0 x (allowed because if you take x1 and x2, you've seen one pattern so far (00) and for x1 and x2 (or x2 and x3) you've seen two patterns (00 and 0x)
0 x 0 (allowed because for x1 and x2, you've seen two patterns so far (00 and 0x) and for x2 and x3 you've seen three patterns so far(00, 0x and x0) (still not 4!))
0 x x (BAM! If you take points x2 and x3, you've seen 4 patterns thus far i.e (00, 0x, x0 and xx) and this contradicts the behavior that is indicated by the breakpoint =2).

Similarly , all other combinations (in increasing binary sequence - if continued from the sequence above) except x 0 0 are 'illegal'.
#8
01-28-2013, 12:49 PM
 John Bang Junior Member Join Date: Jan 2013 Location: Chicago, IL Posts: 8
Re: Question on puzzle from lecture #5

Quote:
 Originally Posted by vikram360 So, ( I'm asking just to reinforce my understanding of this) What Prof. Abu-Mostafa was saying was, given o o o o o x o x o are allowed, the following i.e o x x x o x x x o x x x are not allowed ?
vikram360,

Assuming you meant to include [x o o] in the "allowed" group, then yes.
#9
01-28-2013, 12:50 PM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,478
Re: Question on puzzle from lecture #5

Quote:
 Originally Posted by vikram360 Ok, I got it now. I hadn't watched the Q&A after the lectures (until now)
One of the advantages of the recorded Q&A session is that it was done live after the actual lecture, so if there was a part that was unclear during the lecture, the chances are there was a question about it and it was explained further in that session.
__________________
Where everyone thinks alike, no one thinks very much
#10
04-17-2013, 10:40 AM
 Elroch Invited Guest Join Date: Mar 2013 Posts: 143
Re: Question on puzzle from lecture #5

Quote:
 Originally Posted by vikram360 So, ( I'm asking just to reinforce my understanding of this) What Prof. Abu-Mostafa was saying was, given o o o o o x o x o are allowed, the following i.e o x x x o x x x o x x x are not allowed ?
I think John Bang's inference that you meant to include x o o in the "allowed list" is correct. But, as an alternative, your

o x x
x o x
x x o
x x x

would be allowed on their own but, similarly, it would not be possible to add any other.

 Tags breakpoint, dichotomies, puzzle

 Thread Tools Display Modes Linear Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 08:25 PM.

 Contact Us - LFD Book - Top

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.