Designed for collaborative teams and growing businesses.
SIGN IN TO UPGRADEType | Name | CPU | MEM | GPU | GPU Memory | |
---|---|---|---|---|---|---|
CPU | ||||||
cpu.small | 1 | 4 GB | - | - | $0.0495 | |
cpu.medium | 2 | 8 GB | - | - | $0.099 | |
cpu.large | 4 | 16 GB | - | - | $0.198 | |
NVIDIA-A10 | ||||||
gpu.a10 | 24 | 96 GB | 1 × NVIDIA-A10 | 24 GB | $1.212 | |
NVIDIA-A100 | ||||||
gpu.a100-80gb | 12 | 192 GB | 1 × NVIDIA-A100-80GB | 80 GB | $3.21 | |
gpu.2xa100-80gb | 24 | 384 GB | 2 × NVIDIA-A100-80GB | 160 GB | $6.42 | |
gpu.4xa100-80gb | 48 | 768 GB | 4 × NVIDIA-A100-80GB | 320 GB | $12.84 | |
gpu.8xa100-80gb | 96 | 1536 GB | 8 × NVIDIA-A100-80GB | 640 GB | $25.68 | |
NVIDIA-A6000 | ||||||
gpu.a6000 | 8 | 64 GB | 1 × NVIDIA-RTX-A6000 | 48 GB | $1.65 | |
NVIDIA-H100 | ||||||
gpu.h100-sxm | 20 | 240 GB | 1 × NVIDIA-H100-80GB-HBM3 | 80 GB | $3 | |
gpu.2xh100-sxm | 40 | 480 GB | 2 × NVIDIA-H100-80GB-HBM3 | 160 GB | $6 | |
gpu.4xh100-sxm | 80 | 960 GB | 4 × NVIDIA-H100-80GB-HBM3 | 320 GB | $12 | |
gpu.8xh100-sxm | 160 | 1920 GB | 8 × NVIDIA-H100-80GB-HBM3 | 640 GB | $24 |
Model | Price |
---|---|
Dolphin Mixtral 8x7b | $0.5 / million tokens |
Gemma 2 9B | $0.07 / million tokens |
Llama3.2 3b | $0.03 / million tokens |
Llama3 8b | $0.07 / million tokens |
Llama3.1 8b | $0.07 / million tokens |
Llama2 13b | $0.3 / million tokens |
Llama3 70b | $0.8 / million tokens |
Llama3.1 70b | $0.8 / million tokens |
Llama3.1 405b | $2.8 / million tokens |
Mistral 7B | $0.07 / million tokens |
Mistral Nemo | $0.18 / million tokens |
Mixtral 8x7b | $0.5 / million tokens |
MythoMax L2 13b | $0.18 / million tokens |
Nous: Hermes 13B | $0.18 / million tokens |
OpenChat 3.5 | $0.07 / million tokens |
Qwen2 72B | $0.8 / million tokens |
Toppy M 7B | $0.07 / million tokens |
WizardLM-2 7B | $0.07 / million tokens |
WizardLM-2 8x22B | $1 / million tokens |
Whisper | $0.00007 / second |
Stable Diffusion XL | $0.00015 / step |
Stable Video Diffusion | $0.0092 / step |
Lepton Search (beta) | $0.015 / step |