

Thread Tools  Display Modes 
#1




I think Q9 average number of irritations is related to implementation of PLA?!
Hi every one!
I was wondering that the average number of irritations is kinda related to the way you exploit the PLA.Am I clear? regards. 
#2




Re: I think Q9 average number of irritations is related to implementation of PLA?!
Quote:
"Start the PLA with the weight vector being all zeros, and at each iteration have the algorithm choose a point randomly from the set of misclassied points."
__________________
Where everyone thinks alike, no one thinks very much 
#3




Re: I think Q9 average number of irritations is related to implementation of PLA?!
Thanks professor,I think I have read the old version.I came up whit this idea:
Is it justified to compare Q7 through 10 to the probabilistic model in lecture #2,bin and marbles,say,all the points in [1,1]*[1,1] as all marbles in bin,random points as random green and red marbles(a sample drawn from bin).p(f(x)~=g(x)) as μ. however,in this model f is determined,while target function is never known to us.Moreover,M is infinite;however,this is related to generalization theory. 
#4




Re: I think Q9 average number of irritations is related to implementation of PLA?!
Quote:
__________________
Where everyone thinks alike, no one thinks very much 
#5




Re: I think Q9 average number of irritations is related to implementation of PLA?!
Dear Yaser,
Thanks a lot for your very interesting and useful course. I have a question on HW1,Q9. I implemented PLA. The implementation looks correct: I answered Q7,Q8, and Q10 correctly. More importantly, I can see from a visualization (see below) that the PLA does its job. Here, dots are data, green line corresponds to the target function f, and 1000 yellow lines correspond to g_i, where i=1:1000. In the first case, the average # of iterations is k1 (relatively small), in the second case it is k2 (relatively large), and k2 is approximately equal to 10*k1. Based on the first case, I had to chose one out 5 possible answers, while, based on the second case, I had to chose another. My (submitted) choice turned out to be wrong. On the other hand, from the above figures, it is intuitively clear that to find g in the 2nd case is more difficult (yellow area is smaller), and, therefore, it should take more iterations for the PLA to converge. In general, isn't it true that the number of iterations significantly depends on the data? Say, it could be k but also it could be 10*k, depending on the sample x1,...,xN? Am I missing something? 
#6




Re: I think Q9 average number of irritations is related to implementation of PLA?!
Quote:
BTW, as alluded to in the preamble of the homework, the goal of the question is to make sure that you go through the experiment, analyze it, and understand the algorithm well. The plots you included in your post look great and they show that the goal was achieved. Having said that, the answer in the solution key should certainly be the correct answer.
__________________
Where everyone thinks alike, no one thinks very much 
#7




Re: I think Q9 average number of irritations is related to implementation of PLA?!
Quote:
Instead of fixing the sample, I should have generated new data for each PLA run! Thank you! Looking forward to solving HW2 
Thread Tools  
Display Modes  

