LFD Book Forum - View Single Post - Clarification on HW6-Q8

invis · #6 08-17-2012, 03:05 AM

Only product of the form $... w_{ij}^{(l)} \delta_j^{(l)}...$ count as operations.

On backward we have: $\delta_i^{(l-1)} = (1-(x_i^{(l-1)})^2) \sum_{j=1}^{d^{(l)}}w_{ij}^{(l)} \delta_j^{(l)}$

$d^{(2)}=1$ and $d^{(1)}=3$ and +1 (constant) for layer (1). So we have the same 4 operations for 2-1 layer, and obviously 18 operations for 1-0 layer. Or we dont need to compute $\delta$ for constants ?