Diederik P. Kingma

Adam: A Method for Stochastic Optimization

Adam combined momentum with per-parameter adaptive learning rates into an optimizer that just works across a huge range of problems. It is the default optimizer behind most of the papers in this dossier.