Grad-CAM

Also written: gradient-weighted class activation mapping

A heat map showing where a late convolution layer found evidence for a class. It weights the layer's feature maps by their average gradients, keeps the positive part and resizes the result to the photo.