/* Dracula color scheme for code blocks */
:root {
    --background: #282a36; /* Background Color */
    --background-darker: #1c1e24; /* Background Color */
    --current-line: #44475a; /* Current Line Color */
    --selection: #44475a; /* Selection Color */
    --foreground: #f8f8f2; /* Foreground Color */
    --comment: #8b9ac4; /* Comment Color */
    --cyan: #8be9fd; /* Cyan Color */
    --green: #50fa7b; /* Green Color */
    --orange: #ffb86c; /* Orange Color */
    --pink: #ff79c6; /* Pink Color */
    --purple: #bd93f9; /* Purple Color */
    --red: #ff5555; /* Red Color */
    --yellow: #f1fa8c; /* Yellow Color */
  }

.comment {
    color: var(--comment) !important;
}

.function {
    /* color: #5be1ff !important; */
    color: var(--green) !important;

}

.parameter{
    color: var(--orange) !important;
}

.keyword,
.token.property {
    color: var(--purple) !important;
}

.interpolation
{
    color: var(--yellow) !important;
}

.string {
    color: var(--pink) !important;
}

.builtin,
.class-name
 {
    /* color: #acd1d7 !important; */
    /* color: #fff671 !important; */
    color: var(--cyan) !important;
}

.property, .variable {
    color: var(--foreground) !important;
}

.boolean,
.number{
    color: var(--purple) !important;
}

.code-block, .code-group{
    background-color: var(--background) !important;
}

.flex.rounded-t-2xl{
    background-color: var(--background-darker) !important;
}





const script = document.createElement("script");
script.src = "https://widget.kapa.ai/kapa-widget.bundle.js";
script.async = true;
script.setAttribute("data-website-id", "5b21ac2d-dd52-41f2-b02b-cd82467e45cc");
script.setAttribute("data-project-name", "RunPod");
script.setAttribute("data-project-color", "#070D27");
script.setAttribute("data-project-logo", "https://raw.githubusercontent.com/runpod/docs/refs/heads/main/og-icon-trim.svg",);
// script.setAttribute("data-project-logo", "https://raw.githubusercontent.com/runpod/docs/refs/heads/mintlify-migration/icon_square.svg",);
script.setAttribute("data-button-image-width", 30);
script.setAttribute("data-button-image-height", 30);
document.head.appendChild(script);

GPU types

GPU pools

Runpod Documentation

Explore our guides and examples to deploy your AI/ML application on RunPod.

Introduction

Welcome to RunPod

Create an account and deploy your first GPU.

Quickstart

Get started with RunPod

Manage accounts

Learn how to create, edit, and disable RunPod API keys.

Manage API keys

An overview of available methods for interacting with RunPod.

Connect to RunPod

Pay-as-you-go compute for AI models and compute-intensive workloads.

Overview

Pricing

Discover, deploy, and share preconfigured AI repos.

RunPod Hub

Test and deploy production-ready AI models using public endpoints.

Public endpoints

Publish your repositories to the RunPod Hub.

Publishing guide

Hub publishing guide

Get on-demand access to powerful computing resources.

Explore pricing options for Pods, including on-demand, savings plans, and spot instances.

Learn how to select the right Pod by evaluating your resource requirements.

Choose a Pod

Learn how to create, start, stop, and terminate Pods using the RunPod console or CLI.

Manage Pods

Learn how to connect using the web terminal, SSH, JupyterLab, or VSCode.

Connect to a Pod

Global networking

Access Logs

Instant Clusters

Deploy with PyTorch

Deploy an Instant Cluster with PyTorch

Deploy with Axolotl

Deploy an Instant Cluster with Axolotl

Deploy with SLURM

Deploy an Instant Cluster with SLURM

Fine-tune a model

dstack

Manage Pods with dstack on RunPod

Mods

Running RunPod on Mods

SkyPilot

Running RunPod on SkyPilot

Burn testing

Maintenance and reliability

Secure Cloud partner requirements

RunPod Secure Cloud partner requirements (2025)

Glossary

Serverless

Billing information

Referral programs

Serverless CPU types

Video resources

GraphQL Spec

Run your first serverless endpoint with Stable Diffusion

Generate images with SDXL Turbo

Run Google'S Gemma Model

Run an Ollama Server on a RunPod CPU

Run your first Fast Stable Diffusion with Jupyter Notebook

Run Fooocus in Jupyter Notebook

Set up Ollama on your GPU Pod

Build Docker Images on RunPod with Bazel

How To Connect to a Pod Instance through VSCode

Fine tune an LLM with Axolotl on RunPod

APIs

API Wrapper

Endpoints

Configurations

Manage Templates

Manage Endpoints

RunPod CLI overview

Install runpodctl

Manage Pods with runpodctl

Transfer files

Transfer Files with runpodctl

Projects

Get started

Create your first project

Manage projects

runpodctl

Config

Create

Create Pod

Create Pods

Get Cloud

Get Pod

Project

Project Build

Project Create

Project Deploy

Project Dev

Receive

Remove

Remove Pod

Remove Pods

Send

Ssh Add Key

Ssh List Keys

Start

Start Pod

Stop

Stop Pod

Update

Version

GPU ID	Display Name	Memory (GB)
AMD Instinct MI300X OAM	MI300X	192
NVIDIA A100 80GB PCIe	A100 PCIe	80
NVIDIA A100-SXM4-80GB	A100 SXM	80
NVIDIA A30	A30	24
NVIDIA A40	A40	48
NVIDIA B200	B200	180
NVIDIA GeForce RTX 3070	RTX 3070	8
NVIDIA GeForce RTX 3080	RTX 3080	10
NVIDIA GeForce RTX 3080 Ti	RTX 3080 Ti	12
NVIDIA GeForce RTX 3090	RTX 3090	24
NVIDIA GeForce RTX 3090 Ti	RTX 3090 Ti	24
NVIDIA GeForce RTX 4070 Ti	RTX 4070 Ti	12
NVIDIA GeForce RTX 4080	RTX 4080	16
NVIDIA GeForce RTX 4080 SUPER	RTX 4080 SUPER	16
NVIDIA GeForce RTX 4090	RTX 4090	24
NVIDIA GeForce RTX 5080	RTX 5080	16
NVIDIA GeForce RTX 5090	RTX 5090	32
NVIDIA H100 80GB HBM3	H100 SXM	80
NVIDIA H100 NVL	H100 NVL	94
NVIDIA H100 PCIe	H100 PCIe	80
NVIDIA H200	H200 SXM	141
NVIDIA L4	L4	24
NVIDIA L40	L40	48
NVIDIA L40S	L40S	48
NVIDIA RTX 2000 Ada Generation	RTX 2000 Ada	16
NVIDIA RTX 4000 Ada Generation	RTX 4000 Ada	20
NVIDIA RTX 4000 SFF Ada Generation	RTX 4000 Ada SFF	20
NVIDIA RTX 5000 Ada Generation	RTX 5000 Ada	32
NVIDIA RTX 6000 Ada Generation	RTX 6000 Ada	48
NVIDIA RTX A2000	RTX A2000	6
NVIDIA RTX A4000	RTX A4000	16
NVIDIA RTX A4500	RTX A4500	20
NVIDIA RTX A5000	RTX A5000	24
NVIDIA RTX A6000	RTX A6000	48
Tesla V100-FHHL-16GB	V100 FHHL	16
Tesla V100-PCIE-16GB	Tesla V100	16
Tesla V100-SXM2-16GB	V100 SXM2	16
Tesla V100-SXM2-32GB	V100 SXM2 32GB	32

Pool ID	GPUs Included	Memory (GB)
`AMPERE_16`	A4000, A4500, RTX 4000, RTX 2000	16 GB
`AMPERE_24`	L4, A5000, 3090	24 GB
`ADA_24`	4090	24 GB
`AMPERE_48`	A6000, A40	48 GB
`ADA_48_PRO`	L40, L40S, 6000 Ada	48 GB
`AMPERE_80`	A100	80 GB
`ADA_80_PRO`	H100	80 GB
`HOPPER_141`	H200	141 GB

Get started

Serverless

Hub

Pods

Instant Clusters

Fine-tuning

Integrations

Hosting

References

GPU types

GPU types

GPU pools

Get started

Serverless

Hub

Pods

Instant Clusters

Fine-tuning

Integrations

Hosting

References

​GPU types

​GPU pools

GPU types

GPU pools