Residual connection
Also written: residual, skip connection
Adding a layer's input to its output, x + f(x), so each layer only learns a change to the vector and gradients flow straight back through the additions.
Also written: residual, skip connection
Adding a layer's input to its output, x + f(x), so each layer only learns a change to the vector and gradients flow straight back through the additions.