This is an implementation and extension of LSTM optimizer model from https://arxiv.org/abs/1606.04474