View Single Post
Old 05-30-2013, 05:09 AM is offline
Join Date: Jul 2012
Posts: 17
Default Re: Under-represented class data

Thank you Elroch. You are right, I do sense that there is a pitfall in sparse data sets.
The data set I have is already quite small (about 200 points), and has about 95% representation of one class and 5% of the other. This is data we are slowly gathering from the field (power grid instability - most of the time, things are running well!), and I expect that in time, we will have data, but this imbalance will always remain. Your point of having a sparse representation in a large data set is comforting, but I have not reached that situation yet.
Do you happen to know of any techniques that try to deal with this sparseness problem in smaller sets?
Reply With Quote