create_optimizer.Rd
This factory function creates an optimizer object that holds the state and update logic for a chosen optimization strategy.
create_optimizer(optimizer_type = "hybrid_adam", vmats, ...)
A string identifying the optimizer. One of: "hybrid_adam" (Adam direction with Armijo line search - robust), "adam" (Adam with a learning rate schedule - fast), "nadam" (Nesterov-accelerated Adam - fast and robust), "sgd_momentum" (SGD with momentum and learning rate schedule - classic), "armijo_gradient" (steepest descent with robust Armijo backtracking line search - maximally robust).
The list of initial V matrices, used to set up the dimensions of the optimizer's internal state variables.
Additional hyperparameters for the optimizer (e.g., `beta1`, `beta2`).
An optimizer object (a list with a class attribute).