MoE SSD-Streaming Speed Estimator

Includes Layer-Major Double Buffering (Prefetch Hiding) simulation and Model Presets

Model Preset

Total Parameters (Billions) Active Parameters per Token (Billions)

Total Experts

Active Experts

Number of Layers

Quantiz. (Bytes)

Tier 1: GPU VRAM

Capacity (GB)

Bandwidth (GB/s)

Tier 2: PC RAM

Capacity (GB)

Bandwidth (GB/s)

Tier 3: SSD

Capacity (GB)

Bandwidth (GB/s)

Cache Hit Rate / I/O Efficiency (%)

Enable Pipelining Layer-major double buffering

0.00 tok/s

Bottleneck: Calculating...

Total Size

0 GB

Core (Always-On)

0 GB

Single Expert

0 GB

Active per 1 Layer

0 GB

VRAM 0 GB

Native read/tok: 0 ms

RAM 0 GB

Native read/tok: 0 ms

SSD 0 GB

Native read/tok: 0 ms

Without Pipelining: Times are added linearly.