LFD Book Forum  

Go Back   LFD Book Forum > Book Feedback - Learning From Data > Chapter 1 - The Learning Problem

Reply
 
Thread Tools Display Modes
  #1  
Old 06-11-2019, 07:44 PM
jewelltaylor9430 jewelltaylor9430 is offline
Junior Member
 
Join Date: Jun 2019
Posts: 1
Unhappy Problem 1.3 Question Please Help

Question 1.3 A: Let p = min(1=<n=<N) y(n)(w*Yx(n)). Show that p > 0.

(For lack of any other notation I use brackets to represent subscripts, sorry)

Question 1.3 B: Show that wT(t)w* >= wT(t-1)w* + p, and conclude that wT(t)w* >= tp

My Questions:
- I understand p is defined in A but I am not familiar with the notation and I do not know what it represents. What is the min expression getting at? Is it the fact the value of p such that the value of n is minimized? Can you give me intuition behind what p actually is?

- How does the the RHS of the first inequality relate to the RHS of the second inequality in B? My understanding is t represents the iteration number of the perceptron algorithim. Is this the case or am I mistaken? Does tp somehow equal wT(t-1)w* + p and if so where the heck does it come from? I am so confused

Any help would be much appreciated, I have been stumped on this question for too long
Reply With Quote
  #2  
Old 06-13-2019, 12:03 AM
htlin's Avatar
htlin htlin is offline
NTU
 
Join Date: Aug 2009
Location: Taipei, Taiwan
Posts: 601
Default Re: Problem 1.3 Question Please Help

Quote:
Originally Posted by jewelltaylor9430 View Post
Question 1.3 A: Let p = min(1=<n=<N) y(n)(w*Yx(n)). Show that p > 0.

(For lack of any other notation I use brackets to represent subscripts, sorry)

Question 1.3 B: Show that wT(t)w* >= wT(t-1)w* + p, and conclude that wT(t)w* >= tp

My Questions:
- I understand p is defined in A but I am not familiar with the notation and I do not know what it represents. What is the min expression getting at? Is it the fact the value of p such that the value of n is minimized? Can you give me intuition behind what p actually is?

- How does the the RHS of the first inequality relate to the RHS of the second inequality in B? My understanding is t represents the iteration number of the perceptron algorithim. Is this the case or am I mistaken? Does tp somehow equal wT(t-1)w* + p and if so where the heck does it come from? I am so confused

Any help would be much appreciated, I have been stumped on this question for too long
\rho represents the distance from the closest \mathbf{x}_n to the boundary represented by \mathbf{w}^* if the latter is reasonably nromalized.

If you can prove that the inner product increases at least by \rho in each iteration, then after t iterations the inner product naturally increases by t \rho which is what you need to prove in B.

Hope this helps.
__________________
When one teaches, two learn.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 10:43 AM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.