Mixed Precision Calculator

Calculate mixed precision training benefits.

Configuration

Operation Type

Model Size (Billions)

Batch Size

Sequence Length

GPU Type

Current Precision

Target Precision

Training Speedup

16.0x

0.0% memory saved

📦Current Memory

104.3 GB

📦Target Memory

104.3 GB

Current TFLOPS19.5 TFLOPS

Target TFLOPS312 TFLOPS

Bandwidth Improvement2x

Current Time/Batch11762.87 ms

Target Time/Batch735.18 ms

Current Throughput0.7 samples/s

Target Throughput10.9 samples/s

GPUA100 80GB

GPU Memory80 GB

Fits in MemoryNo

Loss Scaling: Dynamic loss scaling recommended to prevent gradient underflow