Learning Rate Finder

Find the optimal learning rate for your AI model training.

Training Configuration

Task Type

Model Size (Billions)

B

Batch Size

Optimizer

Dataset Size (samples)

Recommended Learning Rate

2.0e-5

Range: 2.0e-6 - 6.0e-5

🔥Warmup Steps

57

📉Weight Decay

0.01

Training Schedule

Steps per Epoch313

Total Steps (3 epochs)939

Warmup Steps57

Tips: Use cosine annealing schedule. If training diverges, reduce LR by 2-5x. If training is slow, try increasing LR.