Machine Learning

Why is Logistic Regression called Linear Method?

2018-02-24 14:47:00 +0000
Classification, Logistic Regression


Logistic regression is classified as a linear method because its decision boundary is linear, not because we can get a solution of the problem by solving a linear equation (Since it brings MLE problem to solve the logistic regression problem, it generally does not even provide analytic solution).

Logistic regression makes the decision to make sense much more than the plain linear regression when it comes to the classification problem. The reason is that logistic regression tries for the estimtes to mimick the probabilistic behaviors, while linear regression doesn’t care that aspects.

Notebook for more

Below is my jupyter notebook (hosted on containing (a little bit) details of the story. Its original version is on github repo.