LFD Book Forum  

Go Back   LFD Book Forum > Course Discussions > Online LFD course > Homework 6

Reply
 
Thread Tools Display Modes
  #11  
Old 05-14-2012, 01:23 PM
cassio cassio is offline
Member
 
Join Date: Apr 2012
Location: Florianopolis - Brazil
Posts: 16
Default Re: Homework 6 #10

Quote:
Originally Posted by Yellin View Post
There may be some confusion here between "nodes", which are the little circles in the neural net diagrams, and "units", which are the x's that enter and leave the circles. So mibeeson's example may mean there are 2 input units, of which one is constant, with two nodes, each receiving the two input units and producing one unit each. Adding one constant unit to the two units from those two nodes makes for 3 hidden units; the three go to one output node, which produces the output unit. Each node needs weights for each of its incoming units, so there are 4 weights from the first layer of nodes plus 3 from the three units entering the output node. Is this reasonable, or am I the one who is confused?
Yellin, in my understanding you are right in the example you gave. And I would like to add the other interpretation of the problem proposed by mjbeeson where rohanag opened my eyes: if I have 2 input units (one of them is the constant) and one node that receive both connections from the input units. Now to next layer, I have the unit value from the node and one constant unit (what result in two units in this hidden layer), both connecting with the output node. Thus, I have two weights in first part and more two in the last. Am I right?

Last edited by cassio; 05-14-2012 at 01:37 PM. Reason: grammar
Reply With Quote
  #12  
Old 05-14-2012, 01:48 PM
mjbeeson mjbeeson is offline
Member
 
Join Date: Apr 2012
Posts: 25
Default Re: Homework 6 #10

I don't think that's the way we are to read the homework. Notice problem 8, where it says,
"10 input units (including the constant value)...and 36 hidden units (include the constant inputs of each hidden layer).
The "including" part important in the counting.
Reply With Quote
  #13  
Old 08-16-2012, 06:00 AM
dvs79 dvs79 is offline
Member
 
Join Date: Jul 2012
Location: Moscow, Russia
Posts: 24
Default Re: Homework 6 #10

Has anybody got the correct answer? My answer was wrong and I can't see where is a mistake in my reasoning.
The maximum number of weights should be for the network looking like 10-18-18-1 (including constant nodes in the first three layers), right? But number of weights for it is not one in the answer key.
Reply With Quote
  #14  
Old 08-17-2012, 09:01 AM
Keith Keith is offline
Member
 
Join Date: Jul 2012
Posts: 16
Default Re: Homework 6 #10

I got this one right. I used Excel (of all things) to explore all arrangements with one and two hidden layers, and also looked at portions of arrangements with more hidden layers. The spreadsheet does the arithmetic with simple copied formulas and gives the correct answer without too much work.
Reply With Quote
  #15  
Old 08-17-2012, 01:39 PM
dvs79 dvs79 is offline
Member
 
Join Date: Jul 2012
Location: Moscow, Russia
Posts: 24
Default Re: Homework 6 #10

Oh, I see. My stupid blunder.

Thnx!
Reply With Quote
  #16  
Old 08-21-2012, 12:33 PM
DavidNJ DavidNJ is offline
Member
 
Join Date: Jul 2012
Posts: 28
Default Re: Homework 6 #10

Now I feel like an idiot!

You could also have used goal seek in Excel.
Reply With Quote
  #17  
Old 08-21-2012, 02:08 PM
tzs29970 tzs29970 is offline
Invited Guest
 
Join Date: Apr 2012
Posts: 52
Default Re: Homework 6 #10

In case anyone is curious, there are 9227465 possible networks that satisfy the constraints of this problem.
Reply With Quote
  #18  
Old 02-13-2013, 03:02 PM
ilya239 ilya239 is offline
Senior Member
 
Join Date: Jul 2012
Posts: 58
Question Re: Homework 6 #10

Quote:
Originally Posted by mjbeeson View Post
Counting weights. Just to clarify if I am counting right: suppose we have 2 input nodes and one hidden layer with 2 nodes and one output node. So then we have 4 weights, right? According to the problem statement the constant input nodes are counted in the "2". Similarly if every input or hidden layer has an even number of nodes then we must get an even number for the total number of weights. Do you agree? Or do I have an off-by-one error in this count somehow?
"2 input nodes", does that include the constant node or not? I.e. does layer 0 look like x^{(0)}_0,x^{(0)}_1,x^{(0)}_2 or like x^{(0)}_0,x^{(0)}_1? What's the right standard terminology to use here?
Reply With Quote
  #19  
Old 02-13-2013, 06:02 PM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,477
Default Re: Homework 6 #10

Quote:
Originally Posted by ilya239 View Post
What's the right standard terminology to use here?
In the statement of this problem (preamble before Problem 9), the constant variables x_0^l are counted as units.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote
  #20  
Old 02-17-2013, 09:15 AM
spramod spramod is offline
Junior Member
 
Join Date: Jan 2013
Posts: 8
Default Re: Homework 6 #10

Professor, after the deadline, could you please post an explanation to this and Question 9, if there's a general case analytical solution, or if there's any other straightforward method?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 02:52 AM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.