lr_decay should be optional
Right now the lr_decay callback has to be set in model_class. Instead, it should be an optional callback, as for example Adam sets the lr by its own.
Right now the lr_decay callback has to be set in model_class. Instead, it should be an optional callback, as for example Adam sets the lr by its own.