FLOPs Calculator

Calculate FLOPs for AI model training and inference.

Compute Parameters

Operation Type

Model Parameters (Billions)

B

Sequence Length

Batch Size

Total Tokens to Process

Formula: 2 x Parameters x Tokens

Total FLOPs

14.00 PFLOPs

1.40e+16 operations

🔢FLOPs per Token

14.00 GFLOPs

📊FLOPs per Batch

28.67 TFLOPs

Estimated Time by GPU

NVIDIA H10028.3s

NVIDIA A100 80GB1.5 min

NVIDIA V1003.7 min

RTX 40905.6 min

RTX 309013.1 min