LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Chapter 3 - The Linear Model (http://book.caltech.edu/bookforum/forumdisplay.php?f=110)
-   -   Choice of Error measure for Logistic Regression (http://book.caltech.edu/bookforum/showthread.php?t=4875)

 Yew Lee 01-20-2019 07:40 PM

Choice of Error measure for Logistic Regression

From the textbook (page 91), it seems intuitive that the likelyhood function is the hypothesis.

However, for the case of logistic regression in another book, the choice of the likelyhood function is the bernoulli distribution where y_n is {0, 1}.

In the case of heart attacks as specified in the book, I could have changed the label of y_n from {-1, 1} to {0, 1} and used the bernoulli distribution as the likelyhood function instead.
eg. (h(x)^y_n)*(1-h(x)^(1-y_n)

Therefore, what are the factors involved in the consideration of choosing the error measure and what are the pros and cons in this case?

 Yew Lee 01-20-2019 07:44 PM

Re: Choice of Error measure for Logistic Regression

Quote:
 eg. (h(x)^y_n)*(1-h(x)^(1-y_n)
where h(x) is the sigmoid function being the probability of getting heart attack

 htlin 01-23-2019 02:04 AM

Re: Choice of Error measure for Logistic Regression

There are different ways of deriving the cross-entropy error function. The book presents a specific way based on the notation of our choice. Indeed other ways (from other notations/assumptions) are possible.

Hope this helps.

 All times are GMT -7. The time now is 04:16 AM.