Viewing a single comment thread. View all comments

chatterbox272 t1_iqm72tk wrote

Reply to comment by cthorrez in [D] Why is the machine learning community obsessed with the logistic distribution? by cthorrez

Tanh is not a particularly good intermediate activation function at all. It's too linear around zero and it saturates at both ends.

4

cthorrez OP t1_iqnk270 wrote

Well it's an even worse final output activation for binary classification because the outputs are -1 to 1 not 0 to 1.

I've never seen it used as anything but an internal activation.

1