theta0=1 lr=0.1 beta1=0.9 beta2=0.999 epsilon=1e-8
g=0 lambda=0.1 Adam+L2 theta=0.900000010 m=0.010000 v=0.00001000
g=0 lambda=0.1 AdamW   theta=0.990000000 m=0.000000 v=0.00000000
g=0 lambda=0.01 Adam+L2 theta=0.900000100 m=0.001000 v=0.00000010
g=0 lambda=0.01 AdamW   theta=0.999000000 m=0.000000 v=0.00000000
step=1 Adam+L2=0.900000010 AdamW=0.990000000
step=2 Adam+L2=0.800412248 AdamW=0.980100000
step=3 Adam+L2=0.701586303 AdamW=0.970299000
checks: geometric decay, lambda-zero equality, first-step oracle passed
