Activation function
From Rice Wiki
The activation function determines the output of a neuron in a neural network. It generates the output of the neuron from the linear combination of inputs calculated by the neuron.
The choice of activation function varies depending on the machine learning task. A simple linear activation function or no activation function is just linear regression. A sigmoid function can be used for a classification task.
