learning rate #162

Hi, I am now using 4 A100 to train the model, but it is really slow(5 days) for batch size 32, so I would change the batch size to bigger and also the learning rate and milestone. So can you give me suggestions? Thanks!