LFD Book Forum Neural network with discrete and continuous input
 User Name Remember Me? Password
 FAQ Calendar Mark Forums Read

 Thread Tools Display Modes
#1
11-01-2012, 06:50 AM
 qkgia Junior Member Join Date: Nov 2012 Posts: 1
Neural network with discrete and continuous input

Dear Prof.

I have a question related to neural network.

Can we train a neural network with inputs containing both discrete and continuous values? Does it affect on back-propagation algorithm? If it does, can we two separate network one for discrete inputs and one for continuous inputs?

Thank you.
#2
11-01-2012, 10:42 AM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,477
Re: Neural network with discrete and continuous input

Quote:
 Originally Posted by qkgia Dear Prof. I have a question related to neural network. Can we train a neural network with inputs containing both discrete and continuous values? Does it affect on back-propagation algorithm? If it does, can we two separate network one for discrete inputs and one for continuous inputs? Thank you.
We can use both continuous and discrete variables in the same way, assuming the discrete variable is numerical, i.e., it is a number albeit discrete, and it has a natural order (e.g., rating of a movie or number of hits on a web site, rather than just a code for events with no order).

For other types of discrete variables, there are still ways to code them for the network so that they can be used together with continuous variables. For instance, a variable that assumes 3 values that have no order can be coded as three binary variables, where only one of the variables is 1 and the others are 0 to designate one of the three values of the original variable.

In all of these cases, it often helps to normalize the numerical range of the variables (say to mean 0 and variance 1) to avoid some of them dominating backpropagation by their shee numerical strength.
__________________
Where everyone thinks alike, no one thinks very much

 Thread Tools Display Modes Linear Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 10:17 AM.

 Contact Us - LFD Book - Top