Missing support of momentum in SGD optimizer #907
Description
When I use the SGD optimizer, I noticed that it only supports setting the learning rate. Is there a way we can add support for momentum (and decay if possible) in SGD?
{{ message }}
When I use the SGD optimizer, I noticed that it only supports setting the learning rate. Is there a way we can add support for momentum (and decay if possible) in SGD?