| Provider | Instance | GPU | # GPUs | Total VRAM | Fit | Headroom | Host | On-demand $/hr | Spot $/hr | On-demand $/GPU-hr | Spot $/GPU-hr | $/GB-VRAM-hr | Spot disc. | Spot model |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Amazon Web Services (EC2) hyperscaler | p5.48xlarge NVLink + 3200 Gbps EFA | H100 SXM5 80GB NVIDIA · Hopper | 8 | 640 GB | 192vCPU / 2048GB | $98.3200 | $40.0000 | $12.2900 | $5.0000 | $0.15360 | 59.3% | dynamic | ||
| Amazon Web Services (EC2) hyperscaler | p5e.48xlarge NVLink + EFA | H200 SXM5 141GB NVIDIA · Hopper | 8 | 1128 GB | 192vCPU / 2048GB | $84.8000 | $34.0000 | $10.6000 | $4.2500 | $0.07520 | 59.9% | dynamic | ||
| Amazon Web Services (EC2) hyperscaler | p4d.24xlarge NVLink + EFA | A100 SXM4 40GB NVIDIA · Ampere | 8 | 320 GB | 96vCPU / 1152GB | $32.7726 | $11.5700 | $4.0966 | $1.4463 | $0.10240 | 64.7% | dynamic | ||
| Amazon Web Services (EC2) hyperscaler | p4de.24xlarge NVLink + EFA | A100 SXM4 80GB NVIDIA · Ampere | 8 | 640 GB | 96vCPU / 1152GB | $40.9657 | $14.4600 | $5.1207 | $1.8075 | $0.06400 | 64.7% | dynamic | ||
| Amazon Web Services (EC2) hyperscaler | p3.2xlarge PCIe | V100 SXM2 16GB NVIDIA · Volta | 1 | 16 GB | 8vCPU / 61GB | $3.0600 | $0.9200 | $3.0600 | $0.9200 | $0.19130 | 69.9% | dynamic | ||
| Amazon Web Services (EC2) hyperscaler | g5.xlarge PCIe | A10G PCIe 24GB NVIDIA · Ampere | 1 | 24 GB | 4vCPU / 16GB | $1.0060 | $0.4000 | $1.0060 | $0.4000 | $0.04190 | 60.2% | dynamic | ||
| Amazon Web Services (EC2) hyperscaler | g5.12xlarge PCIe | A10G PCIe 24GB NVIDIA · Ampere | 4 | 96 GB | 48vCPU / 192GB | $5.6720 | $2.2700 | $1.4180 | $0.5675 | $0.05910 | 60.0% | dynamic | ||
| Amazon Web Services (EC2) hyperscaler | g5.48xlarge PCIe | A10G PCIe 24GB NVIDIA · Ampere | 8 | 192 GB | 192vCPU / 768GB | $16.2880 | $4.8900 | $2.0360 | $0.6112 | $0.08480 | 70.0% | dynamic | ||
| Amazon Web Services (EC2) hyperscaler | g6.xlarge PCIe | L4 PCIe (low-profile) 24GB NVIDIA · Ada Lovelace | 1 | 24 GB | 4vCPU / 16GB | $0.8048 | $0.3200 | $0.8048 | $0.3200 | $0.03350 | 60.2% | dynamic | ||
| Amazon Web Services (EC2) hyperscaler | g6e.xlarge PCIe | L40S PCIe 48GB NVIDIA · Ada Lovelace | 1 | 48 GB | 4vCPU / 32GB | $1.8610 | $0.7400 | $1.8610 | $0.7400 | $0.03880 | 60.2% | dynamic | ||
| Amazon Web Services (EC2) hyperscaler | g6e.48xlarge PCIe | L40S PCIe 48GB NVIDIA · Ada Lovelace | 8 | 384 GB | 192vCPU / 1536GB | $30.1300 | $12.0500 | $3.7662 | $1.5063 | $0.07850 | 60.0% | dynamic | ||
| Google Cloud Platform (Compute Engine) hyperscaler | a3-highgpu-8g NVLink + GPUDirect-TCPX | H100 SXM5 80GB NVIDIA · Hopper | 8 | 640 GB | 208vCPU / 1872GB | $88.4900 | $35.4000 | $11.0612 | $4.4250 | $0.13830 | 60.0% | fixed_discount | ||
| Google Cloud Platform (Compute Engine) hyperscaler | a3-megagpu-8g NVLink + GPUDirect-TCPXO | H100 SXM5 80GB NVIDIA · Hopper | 8 | 640 GB | 208vCPU / 1872GB | $98.3200 | $39.3300 | $12.2900 | $4.9162 | $0.15360 | 60.0% | fixed_discount | ||
| Google Cloud Platform (Compute Engine) hyperscaler | a3-ultragpu-8g NVLink + RDMA | H200 SXM5 141GB NVIDIA · Hopper | 8 | 1128 GB | 224vCPU / 2952GB | $110.0000 | $44.0000 | $13.7500 | $5.5000 | $0.09750 | 60.0% | fixed_discount | ||
| Google Cloud Platform (Compute Engine) hyperscaler | a2-ultragpu-1g PCIe | A100 SXM4 80GB NVIDIA · Ampere | 1 | 80 GB | 12vCPU / 170GB | $5.0700 | $2.0300 | $5.0700 | $2.0300 | $0.06340 | 60.0% | fixed_discount | ||
| Google Cloud Platform (Compute Engine) hyperscaler | a2-ultragpu-8g NVLink | A100 SXM4 80GB NVIDIA · Ampere | 8 | 640 GB | 96vCPU / 1360GB | $40.5500 | $16.2200 | $5.0687 | $2.0275 | $0.06340 | 60.0% | fixed_discount | ||
| Google Cloud Platform (Compute Engine) hyperscaler | a2-highgpu-1g PCIe | A100 SXM4 40GB NVIDIA · Ampere | 1 | 40 GB | 12vCPU / 85GB | $3.6730 | $1.4700 | $3.6730 | $1.4700 | $0.09180 | 60.0% | fixed_discount | ||
| Google Cloud Platform (Compute Engine) hyperscaler | g2-standard-4 PCIe | L4 PCIe (low-profile) 24GB NVIDIA · Ada Lovelace | 1 | 24 GB | 4vCPU / 16GB | $0.7100 | $0.2100 | $0.7100 | $0.2100 | $0.02960 | 70.4% | fixed_discount | ||
| Google Cloud Platform (Compute Engine) hyperscaler | g2-standard-96 PCIe | L4 PCIe (low-profile) 24GB NVIDIA · Ada Lovelace | 8 | 192 GB | 96vCPU / 432GB | $8.3600 | $2.5100 | $1.0450 | $0.3137 | $0.04350 | 70.0% | fixed_discount | ||
| Microsoft Azure hyperscaler | Standard_ND96isr_H100_v5 NVLink + InfiniBand | H100 SXM5 80GB NVIDIA · Hopper | 8 | 640 GB | 96vCPU / 1900GB | $98.3200 | $30.0000 | $12.2900 | $3.7500 | $0.15360 | 69.5% | dynamic | ||
| Microsoft Azure hyperscaler | Standard_ND96amsr_A100_v4 NVLink + InfiniBand | A100 SXM4 80GB NVIDIA · Ampere | 8 | 640 GB | 96vCPU / 1900GB | $32.7700 | $9.8300 | $4.0963 | $1.2288 | $0.05120 | 70.0% | dynamic | ||
| Microsoft Azure hyperscaler | Standard_NC24ads_A100_v4 PCIe | A100 PCIe 80GB NVIDIA · Ampere | 1 | 80 GB | 24vCPU / 220GB | $3.6730 | $1.1000 | $3.6730 | $1.1000 | $0.04590 | 70.1% | dynamic | ||
| Microsoft Azure hyperscaler | Standard_NV36ads_A10_v5 PCIe | A10 PCIe 24GB NVIDIA · Ampere | 1 | 24 GB | 36vCPU / 440GB | $3.2000 | $0.9600 | $3.2000 | $0.9600 | $0.13330 | 70.0% | dynamic | ||
| Oracle Cloud Infrastructure hyperscaler | BM.GPU.H100.8 NVLink + RDMA | H100 SXM5 80GB NVIDIA · Hopper | 8 | 640 GB | 112vCPU / 2048GB | $80.0000 | $40.0000 | $10.0000 | $5.0000 | $0.12500 | 50.0% | fixed_discount | ||
| Oracle Cloud Infrastructure hyperscaler | BM.GPU.H200.8 NVLink + RDMA | H200 SXM5 141GB NVIDIA · Hopper | 8 | 1128 GB | 112vCPU / 3072GB | $80.0000 | $40.0000 | $10.0000 | $5.0000 | $0.07090 | 50.0% | fixed_discount | ||
| Oracle Cloud Infrastructure hyperscaler | BM.GPU.A100-v2.8 NVLink | A100 SXM4 80GB NVIDIA · Ampere | 8 | 640 GB | 128vCPU / 2048GB | $32.0000 | $16.0000 | $4.0000 | $2.0000 | $0.05000 | 50.0% | fixed_discount | ||
| Oracle Cloud Infrastructure hyperscaler | BM.GPU.MI300X.8 Infinity Fabric + RDMA | Instinct MI300X OAM 192GB AMD · CDNA3 | 8 | 1536 GB | 112vCPU / 2304GB | $48.0000 | $24.0000 | $6.0000 | $3.0000 | $0.03120 | 50.0% | fixed_discount | ||
| Oracle Cloud Infrastructure hyperscaler | VM.GPU.A10.1 PCIe | A10 PCIe 24GB NVIDIA · Ampere | 1 | 24 GB | 15vCPU / 240GB | $2.0000 | $1.0000 | $2.0000 | $1.0000 | $0.08330 | 50.0% | fixed_discount | ||
| Lambda Labs gpu_cloud | 8x H100 SXM (gpu_8x_h100_sxm5) NVLink | H100 SXM5 80GB NVIDIA · Hopper | 8 | 640 GB | 208vCPU / 1800GB | $23.9200 | — | $2.9900 | — | $0.03740 | — | none | ||
| Lambda Labs gpu_cloud | 1x H100 PCIe (gpu_1x_h100_pcie) PCIe | H100 PCIe 80GB NVIDIA · Hopper | 1 | 80 GB | 26vCPU / 200GB | $2.4900 | — | $2.4900 | — | $0.03110 | — | none | ||
| Lambda Labs gpu_cloud | 8x H200 SXM (gpu_8x_h200_sxm5) NVLink | H200 SXM5 141GB NVIDIA · Hopper | 8 | 1128 GB | 192vCPU / 3000GB | $29.5200 | — | $3.6900 | — | $0.02620 | — | none | ||
| Lambda Labs gpu_cloud | 8x A100 SXM (gpu_8x_a100_sxm4_80gb) NVLink | A100 SXM4 80GB NVIDIA · Ampere | 8 | 640 GB | 124vCPU / 1800GB | $14.3200 | — | $1.7900 | — | $0.02240 | — | none | ||
| Lambda Labs gpu_cloud | 1x A100 PCIe (gpu_1x_a100_pcie_80gb) PCIe | A100 PCIe 80GB NVIDIA · Ampere | 1 | 80 GB | 30vCPU / 200GB | $1.2900 | — | $1.2900 | — | $0.01610 | — | none | ||
| Lambda Labs gpu_cloud | 1x A10 (gpu_1x_a10) PCIe | A10 PCIe 24GB NVIDIA · Ampere | 1 | 24 GB | 30vCPU / 200GB | $0.7500 | — | $0.7500 | — | $0.03120 | — | none | ||
| CoreWeave gpu_cloud | HGX H100 (8x H100 SXM) NVLink + InfiniBand 3200 Gbps | H100 SXM5 80GB NVIDIA · Hopper | 8 | 640 GB | 96vCPU / 1024GB | $49.2400 | $24.6200 | $6.1550 | $3.0775 | $0.07690 | 50.0% | dynamic | ||
| CoreWeave gpu_cloud | 1x H100 PCIe PCIe | H100 PCIe 80GB NVIDIA · Hopper | 1 | 80 GB | 24vCPU / 256GB | $4.2500 | $2.1300 | $4.2500 | $2.1300 | $0.05310 | 49.9% | dynamic | ||
| CoreWeave gpu_cloud | 1x A100 SXM 80GB PCIe | A100 SXM4 80GB NVIDIA · Ampere | 1 | 80 GB | 16vCPU / 128GB | $2.2100 | $1.1100 | $2.2100 | $1.1100 | $0.02760 | 49.8% | dynamic | ||
| CoreWeave gpu_cloud | 1x A100 SXM 40GB PCIe | A100 SXM4 40GB NVIDIA · Ampere | 1 | 40 GB | 16vCPU / 128GB | $2.0600 | $1.0300 | $2.0600 | $1.0300 | $0.05150 | 50.0% | dynamic | ||
| CoreWeave gpu_cloud | 1x A40 PCIe | A40 PCIe (datacenter) 48GB NVIDIA · Ampere | 1 | 48 GB | 16vCPU / 128GB | $1.2800 | $0.6400 | $1.2800 | $0.6400 | $0.02670 | 50.0% | dynamic | ||
| CoreWeave gpu_cloud | 1x L40 PCIe | L40 PCIe 48GB NVIDIA · Ada Lovelace | 1 | 48 GB | 16vCPU / 128GB | $1.5900 | $0.8000 | $1.5900 | $0.8000 | $0.03310 | 49.7% | dynamic | ||
| Crusoe Cloud gpu_cloud | 8x H100 SXM NVLink + InfiniBand | H100 SXM5 80GB NVIDIA · Hopper | 8 | 640 GB | 176vCPU / 2000GB | $33.2000 | $21.6000 | $4.1500 | $2.7000 | $0.05190 | 34.9% | dynamic | ||
| Crusoe Cloud gpu_cloud | 8x H200 SXM NVLink + InfiniBand | H200 SXM5 141GB NVIDIA · Hopper | 8 | 1128 GB | 176vCPU / 2000GB | $39.2000 | $25.4800 | $4.9000 | $3.1850 | $0.03480 | 35.0% | dynamic | ||
| Crusoe Cloud gpu_cloud | 1x H100 PCIe PCIe | H100 PCIe 80GB NVIDIA · Hopper | 1 | 80 GB | 32vCPU / 256GB | $2.4500 | $1.6000 | $2.4500 | $1.6000 | $0.03060 | 34.7% | dynamic | ||
| Crusoe Cloud gpu_cloud | 1x A100 SXM 80GB PCIe | A100 SXM4 80GB NVIDIA · Ampere | 1 | 80 GB | 16vCPU / 240GB | $1.6500 | $1.0700 | $1.6500 | $1.0700 | $0.02060 | 35.2% | dynamic | ||
| Crusoe Cloud gpu_cloud | 1x L40S PCIe | L40S PCIe 48GB NVIDIA · Ada Lovelace | 1 | 48 GB | 8vCPU / 80GB | $1.4500 | $0.9500 | $1.4500 | $0.9500 | $0.03020 | 34.5% | dynamic | ||
| Paperspace (by DigitalOcean) gpu_cloud | H100x8 NVLink | H100 SXM5 80GB NVIDIA · Hopper | 8 | 640 GB | 128vCPU / 640GB | $47.6000 | — | $5.9500 | — | $0.07440 | — | none | ||
| Paperspace (by DigitalOcean) gpu_cloud | H100 PCIe | H100 PCIe 80GB NVIDIA · Hopper | 1 | 80 GB | 16vCPU / 80GB | $5.9500 | — | $5.9500 | — | $0.07440 | — | none | ||
| Paperspace (by DigitalOcean) gpu_cloud | A100-80G PCIe | A100 PCIe 80GB NVIDIA · Ampere | 1 | 80 GB | 12vCPU / 90GB | $3.1800 | — | $3.1800 | — | $0.03980 | — | none | ||
| Paperspace (by DigitalOcean) gpu_cloud | A6000 PCIe | RTX A6000 PCIe (workstation) 48GB NVIDIA · Ampere | 1 | 48 GB | 8vCPU / 45GB | $1.8900 | — | $1.8900 | — | $0.03940 | — | none | ||
| Hyperstack (NexGen Cloud) gpu_cloud | 1x H100 SXM PCIe (single) | H100 SXM5 80GB NVIDIA · Hopper | 1 | 80 GB | 28vCPU / 180GB | $2.4000 | — | $2.4000 | — | $0.03000 | — | none | ||
| Hyperstack (NexGen Cloud) gpu_cloud | 1x H100 PCIe PCIe | H100 PCIe 80GB NVIDIA · Hopper | 1 | 80 GB | 28vCPU / 180GB | $1.9500 | — | $1.9500 | — | $0.02440 | — | none | ||
| Hyperstack (NexGen Cloud) gpu_cloud | 1x A100 80GB PCIe | A100 PCIe 80GB NVIDIA · Ampere | 1 | 80 GB | 28vCPU / 180GB | $1.8000 | — | $1.8000 | — | $0.02250 | — | none | ||
| Hyperstack (NexGen Cloud) gpu_cloud | 1x A6000 PCIe | RTX A6000 PCIe (workstation) 48GB NVIDIA · Ampere | 1 | 48 GB | 28vCPU / 180GB | $0.5000 | — | $0.5000 | — | $0.01040 | — | none | ||
| Hyperstack (NexGen Cloud) gpu_cloud | 1x L40 PCIe | L40 PCIe 48GB NVIDIA · Ada Lovelace | 1 | 48 GB | 28vCPU / 180GB | $1.0000 | — | $1.0000 | — | $0.02080 | — | none | ||
| DataCrunch gpu_cloud | 8x H100 SXM NVLink | H100 SXM5 80GB NVIDIA · Hopper | 8 | 640 GB | 176vCPU / 1450GB | $26.8000 | $13.4000 | $3.3500 | $1.6750 | $0.04190 | 50.0% | fixed_discount | ||
| DataCrunch gpu_cloud | 1x H100 SXM PCIe | H100 SXM5 80GB NVIDIA · Hopper | 1 | 80 GB | 22vCPU / 180GB | $3.1700 | $1.5900 | $3.1700 | $1.5900 | $0.03960 | 49.8% | fixed_discount | ||
| DataCrunch gpu_cloud | 8x A100 SXM 80GB NVLink | A100 SXM4 80GB NVIDIA · Ampere | 8 | 640 GB | 128vCPU / 1024GB | $15.1200 | $7.5600 | $1.8900 | $0.9450 | $0.02360 | 50.0% | fixed_discount | ||
| DataCrunch gpu_cloud | 1x RTX 6000 Ada PCIe | RTX 6000 Ada PCIe (workstation) 48GB NVIDIA · Ada Lovelace | 1 | 48 GB | 16vCPU / 120GB | $1.1900 | $0.6000 | $1.1900 | $0.6000 | $0.02480 | 49.6% | fixed_discount | ||
| Nebius gpu_cloud | 1x H100 SXM PCIe | H100 SXM5 80GB NVIDIA · Hopper | 1 | 80 GB | 20vCPU / 160GB | $2.9500 | $1.4800 | $2.9500 | $1.4800 | $0.03690 | 49.8% | fixed_discount | ||
| Nebius gpu_cloud | 8x H100 SXM NVLink + InfiniBand | H100 SXM5 80GB NVIDIA · Hopper | 8 | 640 GB | 160vCPU / 1280GB | $23.6000 | $11.8000 | $2.9500 | $1.4750 | $0.03690 | 50.0% | fixed_discount | ||
| Nebius gpu_cloud | 1x H200 SXM PCIe | H200 SXM5 141GB NVIDIA · Hopper | 1 | 141 GB | 20vCPU / 200GB | $3.5000 | $1.7500 | $3.5000 | $1.7500 | $0.02480 | 50.0% | fixed_discount | ||
| Nebius gpu_cloud | 1x A100 SXM 80GB PCIe | A100 SXM4 80GB NVIDIA · Ampere | 1 | 80 GB | 20vCPU / 160GB | $2.5000 | $1.2500 | $2.5000 | $1.2500 | $0.03120 | 50.0% | fixed_discount | ||
| RunPod marketplace | H100 SXM (Community) PCIe | H100 SXM5 80GB NVIDIA · Hopper | 1 | 80 GB | 16vCPU / 125GB | $2.7900 | — | $2.7900 | — | $0.03490 | — | none | ||
| RunPod marketplace | H100 SXM (Secure) PCIe | H100 SXM5 80GB NVIDIA · Hopper | 1 | 80 GB | 16vCPU / 125GB | $3.9900 | — | $3.9900 | — | $0.04990 | — | none | ||
| RunPod marketplace | H200 SXM (Secure) PCIe | H200 SXM5 141GB NVIDIA · Hopper | 1 | 141 GB | 24vCPU / 250GB | $3.9900 | — | $3.9900 | — | $0.02830 | — | none | ||
| RunPod marketplace | A100 PCIe 80GB (Community) PCIe | A100 PCIe 80GB NVIDIA · Ampere | 1 | 80 GB | 8vCPU / 117GB | $1.6400 | — | $1.6400 | — | $0.02050 | — | none | ||
| RunPod marketplace | RTX A6000 (Community) PCIe | RTX A6000 PCIe (workstation) 48GB NVIDIA · Ampere | 1 | 48 GB | 8vCPU / 50GB | $0.4900 | — | $0.4900 | — | $0.01020 | — | none | ||
| RunPod marketplace | RTX 4090 (Community) PCIe | RTX 4090 PCIe (consumer) 24GB NVIDIA · Ada Lovelace | 1 | 24 GB | 8vCPU / 32GB | $0.3400 | — | $0.3400 | — | $0.01420 | — | none | ||
| RunPod marketplace | RTX 3090 (Community) PCIe | RTX 3090 PCIe (consumer) 24GB NVIDIA · Ampere | 1 | 24 GB | 8vCPU / 24GB | $0.2200 | — | $0.2200 | — | $0.00920 | — | none | ||
| Vast.ai marketplace | H100 SXM 80GB (typical) PCIe | H100 SXM5 80GB NVIDIA · Hopper | 1 | 80 GB | 16vCPU / 128GB | $2.3000 | $1.5000 | $2.3000 | $1.5000 | $0.02870 | 34.8% | bid_based | ||
| Vast.ai marketplace | H100 PCIe 80GB (typical) PCIe | H100 PCIe 80GB NVIDIA · Hopper | 1 | 80 GB | 16vCPU / 128GB | $1.9500 | $1.3000 | $1.9500 | $1.3000 | $0.02440 | 33.3% | bid_based | ||
| Vast.ai marketplace | A100 SXM 80GB (typical) PCIe | A100 SXM4 80GB NVIDIA · Ampere | 1 | 80 GB | 16vCPU / 128GB | $1.1000 | $0.7000 | $1.1000 | $0.7000 | $0.01380 | 36.4% | bid_based | ||
| Vast.ai marketplace | RTX 4090 (typical) PCIe | RTX 4090 PCIe (consumer) 24GB NVIDIA · Ada Lovelace | 1 | 24 GB | 8vCPU / 32GB | $0.3500 | $0.2000 | $0.3500 | $0.2000 | $0.01460 | 42.9% | bid_based | ||
| Vast.ai marketplace | RTX 3090 (typical) PCIe | RTX 3090 PCIe (consumer) 24GB NVIDIA · Ampere | 1 | 24 GB | 8vCPU / 32GB | $0.2000 | $0.1200 | $0.2000 | $0.1200 | $0.00830 | 40.0% | bid_based | ||
| TensorDock marketplace | 1x H100 SXM PCIe | H100 SXM5 80GB NVIDIA · Hopper | 1 | 80 GB | 16vCPU / 80GB | $3.0000 | — | $3.0000 | — | $0.03750 | — | none | ||
| TensorDock marketplace | 1x A100 80GB PCIe | A100 PCIe 80GB NVIDIA · Ampere | 1 | 80 GB | 8vCPU / 60GB | $1.6300 | — | $1.6300 | — | $0.02040 | — | none | ||
| TensorDock marketplace | 1x RTX 4090 PCIe | RTX 4090 PCIe (consumer) 24GB NVIDIA · Ada Lovelace | 1 | 24 GB | 8vCPU / 32GB | $0.3900 | — | $0.3900 | — | $0.01630 | — | none | ||
| TensorDock marketplace | 1x RTX A6000 PCIe | RTX A6000 PCIe (workstation) 48GB NVIDIA · Ampere | 1 | 48 GB | 8vCPU / 32GB | $0.4700 | — | $0.4700 | — | $0.00980 | — | none | ||
| Modal serverless | H100 (function) PCIe | H100 SXM5 80GB NVIDIA · Hopper | 1 | 80 GB | 16vCPU / 80GB | $4.5600 | — | $4.5600 | — | $0.05700 | — | none | ||
| Modal serverless | A100 80GB (function) PCIe | A100 PCIe 80GB NVIDIA · Ampere | 1 | 80 GB | 16vCPU / 80GB | $3.4000 | — | $3.4000 | — | $0.04250 | — | none | ||
| Modal serverless | A100 40GB (function) PCIe | A100 PCIe 40GB NVIDIA · Ampere | 1 | 40 GB | 8vCPU / 40GB | $2.7800 | — | $2.7800 | — | $0.06950 | — | none | ||
| Modal serverless | L40S (function) PCIe | L40S PCIe 48GB NVIDIA · Ada Lovelace | 1 | 48 GB | 8vCPU / 48GB | $1.9500 | — | $1.9500 | — | $0.04060 | — | none | ||
| Modal serverless | A10G (function) PCIe | A10G PCIe 24GB NVIDIA · Ampere | 1 | 24 GB | 4vCPU / 24GB | $1.1000 | — | $1.1000 | — | $0.04580 | — | none | ||
| Modal serverless | T4 (function) PCIe | T4 PCIe (low-profile) 16GB NVIDIA · Turing | 1 | 16 GB | 4vCPU / 16GB | $0.5900 | — | $0.5900 | — | $0.03690 | — | none | ||
| Replicate serverless | 1x H100 PCIe | H100 SXM5 80GB NVIDIA · Hopper | 1 | 80 GB | — | $5.0400 | — | $5.0400 | — | $0.06300 | — | none | ||
| Replicate serverless | 8x H100 NVLink | H100 SXM5 80GB NVIDIA · Hopper | 8 | 640 GB | — | $43.9200 | — | $5.4900 | — | $0.06860 | — | none | ||
| Replicate serverless | 1x A100 80GB PCIe | A100 PCIe 80GB NVIDIA · Ampere | 1 | 80 GB | — | $5.0400 | — | $5.0400 | — | $0.06300 | — | none | ||
| Replicate serverless | 1x A40 PCIe | A40 PCIe (datacenter) 48GB NVIDIA · Ampere | 1 | 48 GB | — | $2.6100 | — | $2.6100 | — | $0.05440 | — | none | ||
| Replicate serverless | 1x T4 PCIe | T4 PCIe (low-profile) 16GB NVIDIA · Turing | 1 | 16 GB | — | $0.8100 | — | $0.8100 | — | $0.05060 | — | none | ||
| Together AI (Dedicated) serverless | 1x H100 PCIe | H100 SXM5 80GB NVIDIA · Hopper | 1 | 80 GB | — | $2.4000 | — | $2.4000 | — | $0.03000 | — | none | ||
| Together AI (Dedicated) serverless | 1x A100 80GB PCIe | A100 PCIe 80GB NVIDIA · Ampere | 1 | 80 GB | — | $1.7600 | — | $1.7600 | — | $0.02200 | — | none |