Direct nonlinear acceleration
Optimization acceleration techniques such as momentum play a key role in state-of-the-art machine learning algorithms.Recently, generic vector sequence extrapolation creative grids quick trim and circle ruler techniques, such as regularized nonlinear acceleration (RNA) of Scieur et al.[22], were proposed and shown to accelerate fixed point iteratio