Does any one encounter the problem that when using newton method without LM(--lambda 0) causes the line search routine endless? The if condition to break the while loop at Line 417 won't be satisfied(a positive float will never be less than or equal to a negative float).
Or is there some mistakes in my training parameters below?
(The seed does not matter.)
python3 train.py --optim NewtonCG \
--net CNN_4layers \
--bsize 1024 \
--train_set ./data/mnist-5000.mat \
--val_set ./data/mnist/mnist.t.mat \
--dim 28 28 1 \
--seed 1209 \
--GNsize 500 \
--iter_max 100 \
--lambda 0 \
Does any one encounter the problem that when using newton method without LM(--lambda 0) causes the line search routine endless? The if condition to break the while loop at Line 417 won't be satisfied(a positive float will never be less than or equal to a negative float).
Or is there some mistakes in my training parameters below?
(The seed does not matter.)