No credit card required
Designed to meet the needs of collaborative teams and growing businesses.
SIGN IN TO UPGRADEStandard features plus
Type | Name | CPU | MEM | GPU | GPU Memory | |
---|---|---|---|---|---|---|
CPU | ||||||
cpu.small | 1 | 4 GB | - | - | $0.0495 | |
cpu.medium | 2 | 8 GB | - | - | $0.099 | |
cpu.large | 4 | 16 GB | - | - | $0.198 | |
NVIDIA-A10 | ||||||
gpu.a10 | 8 | 32 GB | 1 × NVIDIA-A10 | 24 GB | $1.212 | |
gpu.a10.6xlarge | 24 | 96 GB | 1 × NVIDIA-A10 | 24 GB | $1.212 | |
NVIDIA-A100 | ||||||
gpu.a100-40gb | 12 | 192 GB | 1 × NVIDIA-A100 | 40 GB | $3.048 | |
gpu.a100-80gb | 12 | 192 GB | 1 × NVIDIA-A100-80GB | 80 GB | $3.21 | |
gpu.2xa100-40gb | 24 | 384 GB | 2 × NVIDIA-A100 | 80 GB | $6.096 | |
gpu.2xa100-80gb | 24 | 384 GB | 2 × NVIDIA-A100-80GB | 160 GB | $6.42 | |
gpu.4xa100-40gb | 48 | 768 GB | 4 × NVIDIA-A100 | 160 GB | $12.18 | |
gpu.4xa100-80gb | 48 | 768 GB | 4 × NVIDIA-A100-80GB | 320 GB | $12.84 | |
gpu.8xa100-40gb | 96 | 1536 GB | 8 × NVIDIA-A100 | 320 GB | $24.36 | |
gpu.8xa100-80gb | 96 | 1536 GB | 8 × NVIDIA-A100-80GB | 640 GB | $25.68 | |
NVIDIA-A6000 | ||||||
gpu.a6000 | 8 | 64 GB | 1 × NVIDIA-A6000 | 48 GB | $1.65 | |
NVIDIA-H100 | ||||||
gpu.h100-pcie | 12 | 192 GB | 1 × NVIDIA-H100-PCIe | 80 GB | $3.9 | |
gpu.h100-sxm | 12 | 192 GB | 1 × NVIDIA-H100-80GB-HBM3 | 80 GB | $4.2 | |
gpu.2xh100-sxm | 24 | 384 GB | 2 × NVIDIA-H100-80GB-HBM3 | 160 GB | $8.4 | |
gpu.4xh100-sxm | 48 | 768 GB | 4 × NVIDIA-H100-80GB-HBM3 | 320 GB | $16.8 | |
gpu.8xh100-sxm | 96 | 1536 GB | 8 × NVIDIA-H100-80GB-HBM3 | 640 GB | $33.6 |
Model | Price |
---|---|
WizardLM-2 8x22B | $1 / million tokens |
Toppy M 7B | $0.15 / million tokens |
MythoMax L2 13b | $0.3 / million tokens |
Mixtral 8x7b | $0.5 / million tokens |
Mixtral 8x22b | $0.8 / million tokens |
Mistral 7B | $0.11 / million tokens |
Llama2 13b | $0.3 / million tokens |
Llama3 70b | $0.8 / million tokens |
Gemma 7b | $0.1 / million tokens |
Dolphin Mixtral 8x7b | $0.5 / million tokens |
Lepton Search (beta) | $0.015 / step |
Stable Diffusion XL | $0.00015 / step |
Stable Video Diffusion | $0.0092 / step |
Super Resolution | $0.00015 / image |
WhisperX | $0.00007 / second |
Basic | Standard | Enterprise | |
---|---|---|---|
Features | |||
Subscription fee | $0 / month | $30 / month | Contact Us |
Free credits | $10 | $10 | Contact Us |
Storage | $0.153 / GB / Month | $0.153 / GB / Month | $0.153 / GB / Month |
Quota limit | 48 CPU, 2 GPU, 1 Queue, 1 KV | 192 CPU, 8 GPU, 10 Queue, 10 KV | Unlimited |
Model APIs rate limit | 10 requests per minute | Unlimited | Unlimited |
Multi-user support | |||
Elevated quota for scaling | |||
Custom runtime environments | |||
Dedicated account manager | |||
Custom integration and support | |||
Self-hosted deployments | |||
Dedicated API support for control plane | |||
Audit log and RBAC (coming soon) | |||
Tuna | |||
Training | Free for now | Free for now | Free for now |
Training models | No Limit | No Limit | No Limit |
Dedicated inference | $3.6 / hour | $3.6 / hour | $3.6 / hour |