Base class for all optimizers.
Performs a single optimization step (parameter update).
Unless otherwise specified, this function should not modify the .grad field of the parameters.
.grad
Sets the gradients of all optimized Tensors to zero.
Tensor