
#1




Homework 6 #10
Counting weights. Just to clarify if I am counting right: suppose we have 2 input nodes and one hidden layer with 2 nodes and one output node. So then we have 4 weights, right? According to the problem statement the constant input nodes are counted in the "2". Similarly if every input or hidden layer has an even number of nodes then we must get an even number for the total number of weights. Do you agree? Or do I have an offbyone error in this count somehow?

#2




Re: Homework 6 #10
Maybe I'm not right, but I think that in your example we have 6 weights. 4 to fully connect the input layer with the hidden layer, plus 2 for the hidden layer with the output layer

#3




Re: Homework 6 #10
4 nodes are not needed to connect the input layer with the hidden one, if he wants one of the 2 hidden layer nodes to be constant.
Last edited by rohanag; 05142012 at 11:09 AM. Reason: grammar 
#4




Re: Homework 6 #10
so if you did count the constant nodes in your specification, I think 4 is correct for the final answer

#5




Re: Homework 6 #10
But even the constant is multiplied by a weight that connects it to the next layer, does not?

#6




Re: Homework 6 #10
Yes so, that's why there are 2 weights from the input to the hidden layer, and 2 nodes from the hidden layer to the final output node.

#7




Re: Homework 6 #10
Yes yes, now I understood what you meant. The constant unit does not receive connections from back layers.

#8




Re: Homework 6 #10
Quote:

#9




Re: Homework 6 #10
Quote:
Last edited by cassio; 05142012 at 12:37 PM. Reason: grammar 
#10




Re: Homework 6 #10
I don't think that's the way we are to read the homework. Notice problem 8, where it says,
"10 input units (including the constant value)...and 36 hidden units (include the constant inputs of each hidden layer). The "including" part important in the counting. 
Thread Tools  
Display Modes  

