LFD Book Forum  

Go Back   LFD Book Forum > Course Discussions > Online LFD course > Homework 3

Reply
 
Thread Tools Display Modes
  #1  
Old 04-18-2012, 06:32 PM
jcatanz jcatanz is offline
Member
 
Join Date: Apr 2012
Posts: 41
Default Question on puzzle from lecture #5

In considering the possible dichotomies of 3 points (subject to the restriction of a breakpoint at k=2) you said that

o o o
o o x
o x o

are allowed. Here, o and x can represent -1 and +1.

Then you said

o x x is not allowed,

x o o is allowed,

x o x,

x x o, and

x x x are not allowed.

So that for 3 points, half of the possible dichotomies are eliminated.

If there is a breakpoint at k = 2, all we can say is that not all of the 2^2 = 4 possible dichotomies {+1,-1}, {+1,+1} {-1,+1} {-1,-1} for two points are allowed.

How did you determine which dichotomies are not allowed?

Reply With Quote
  #2  
Old 04-18-2012, 09:02 PM
kkkkk kkkkk is offline
Invited Guest
 
Join Date: Mar 2012
Posts: 71
Default Re: Question on puzzle from lecture #5

I believe there are other possible solutions. So long that for any 2 of the 3 columns, if there are less than 2^N = 4 unique patterns, the break point of 2 is satisifed.
Reply With Quote
  #3  
Old 04-19-2012, 08:49 AM
jcatanz jcatanz is offline
Member
 
Join Date: Apr 2012
Posts: 41
Default Re: Question on puzzle from lecture #5

Quote:
Originally Posted by kkkkk View Post
I believe there are other possible solutions. So long that for any 2 of the 3 columns, if there are less than 2^N = 4 unique patterns, the break point of 2 is satisifed.
I agree.

But in the lecture Prof. Abu-Mostafa seemed to prompt the class, asking if each successive dichotomy (composed from counting to 8 in binary) were allowed or not allowed, as if the answer were unique.
Reply With Quote
  #4  
Old 04-19-2012, 01:27 PM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,477
Default Re: Question on puzzle from lecture #5

Quote:
Originally Posted by jcatanz View Post
I agree.

But in the lecture Prof. Abu-Mostafa seemed to prompt the class, asking if each successive dichotomy (composed from counting to 8 in binary) were allowed or not allowed, as if the answer were unique.
The unique is the numerical values of the maximum, namely 4. The identity of the 4 patterns is not unique.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote
  #5  
Old 04-19-2012, 03:38 PM
jcatanz jcatanz is offline
Member
 
Join Date: Apr 2012
Posts: 41
Default Re: Question on puzzle from lecture #5

OK, that's what I thought. Thanks, Prof. Abu-Mostafa.
--Joe
Reply With Quote
  #6  
Old 01-28-2013, 12:18 PM
vikram360 vikram360 is offline
Junior Member
 
Join Date: Apr 2012
Posts: 5
Default Re: Question on puzzle from lecture #5

Quote:
Originally Posted by yaser View Post
The unique is the numerical values of the maximum, namely 4. The identity of the 4 patterns is not unique.
So, ( I'm asking just to reinforce my understanding of this)
What Prof. Abu-Mostafa was saying was, given
o o o
o o x
o x o

are allowed, the following i.e

o x x
x o x
x x o
x x x

are not allowed ?
Reply With Quote
  #7  
Old 01-28-2013, 12:44 PM
vikram360 vikram360 is offline
Junior Member
 
Join Date: Apr 2012
Posts: 5
Default Re: Question on puzzle from lecture #5

Ok, I got it now. I hadn't watched the Q&A after the lectures (until now) so for anybody who's still having a problem, here's what I've understood.

* You're given 3 points and the break point k (=2 in this case).
* Start enumerating the possibilities and for convenience, lets do this in a binary sequence.
* Note that you don't know which 4th pattern of any two points is not allowed. You just know that one of the four is not allowed (because of the breakpoint).
* (In the lecture), black dots and white dots can be +1 or -1 ( or -1 and +1 - it doesn't matter). All that matters is that not all four combinations of 2 points are allowed. (In my explanation I use o and x)
* So let's start enumerating the possibilities
Possibility 1 (all white)
x1 x2 x3
0 0 0 (allowed because irrespective of which 2 points you take, you've seen just one pattern).
0 0 x (allowed because if you take x1 and x2, you've seen one pattern so far (00) and for x1 and x2 (or x2 and x3) you've seen two patterns (00 and 0x)
0 x 0 (allowed because for x1 and x2, you've seen two patterns so far (00 and 0x) and for x2 and x3 you've seen three patterns so far(00, 0x and x0) (still not 4!))
0 x x (BAM! If you take points x2 and x3, you've seen 4 patterns thus far i.e (00, 0x, x0 and xx) and this contradicts the behavior that is indicated by the breakpoint =2).

Similarly , all other combinations (in increasing binary sequence - if continued from the sequence above) except x 0 0 are 'illegal'.
Reply With Quote
  #8  
Old 01-28-2013, 12:49 PM
John Bang John Bang is offline
Junior Member
 
Join Date: Jan 2013
Location: Chicago, IL
Posts: 8
Default Re: Question on puzzle from lecture #5

Quote:
Originally Posted by vikram360 View Post
So, ( I'm asking just to reinforce my understanding of this)
What Prof. Abu-Mostafa was saying was, given
o o o
o o x
o x o

are allowed, the following i.e

o x x
x o x
x x o
x x x

are not allowed ?
vikram360,

Assuming you meant to include [x o o] in the "allowed" group, then yes.
Reply With Quote
  #9  
Old 01-28-2013, 12:50 PM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,477
Default Re: Question on puzzle from lecture #5

Quote:
Originally Posted by vikram360 View Post
Ok, I got it now. I hadn't watched the Q&A after the lectures (until now)
One of the advantages of the recorded Q&A session is that it was done live after the actual lecture, so if there was a part that was unclear during the lecture, the chances are there was a question about it and it was explained further in that session.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote
  #10  
Old 04-17-2013, 10:40 AM
Elroch Elroch is offline
Invited Guest
 
Join Date: Mar 2013
Posts: 143
Default Re: Question on puzzle from lecture #5

Quote:
Originally Posted by vikram360 View Post
So, ( I'm asking just to reinforce my understanding of this)
What Prof. Abu-Mostafa was saying was, given
o o o
o o x
o x o

are allowed, the following i.e

o x x
x o x
x x o
x x x

are not allowed ?
I think John Bang's inference that you meant to include x o o in the "allowed list" is correct. But, as an alternative, your

o x x
x o x
x x o
x x x

would be allowed on their own but, similarly, it would not be possible to add any other.
Reply With Quote
Reply

Tags
breakpoint, dichotomies, puzzle

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 06:29 AM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.