RunPod

20 min read
Updated
Suggest editHistory
RawGraph

Last reviewed

Sources

18 citations

Review status

Source-backed

Revision

v2 · 3,901 words

RunPod is a globally distributed GPU cloud computing platform that provides on-demand and serverless GPU compute for artificial intelligence training, fine-tuning, and inference. Founded in 2022 by Zhen Lu and Pardeep Singh, the company grew from a basement Ethereum cryptocurrency mining operation into one of the most widely used GPU clouds in the AI developer community. By January 2026, RunPod reported an annualized revenue run rate of $120 million and a developer base of more than 500,000 users across 31 global regions, having reached that scale after bootstrapping for roughly two years before its first outside funding.[1] The platform offers two primary product families: Pods (long-running GPU instances) and Serverless (autoscaling inference endpoints), along with Instant Clusters for multi-node distributed training, and it splits capacity across a higher-reliability Secure Cloud and a lower-cost Community Cloud.

What is RunPod?

RunPod is headquartered in Mount Laurel, New Jersey, and rents NVIDIA and AMD GPUs by the second to developers, startups, and enterprises building AI applications.[1] Its founders describe the company's purpose in terms of fixing the developer experience for GPUs: RunPod was built, CEO Zhen Lu told TechCrunch, "because we felt that the actual experience of developing software on top of GPUs was just hot garbage."[1] The platform is positioned as a lower-cost, developer-first alternative to hyperscaler GPU rentals and to specialized providers such as CoreWeave and Lambda Labs.

History

Founding

Zhen Lu and Pardeep Singh met while working as software developers at Comcast, where the two built a friendship around shared technical interests. In late 2021, they were both running Ethereum mining rigs out of their homes in New Jersey, having collectively invested around $50,000 in mining hardware.[13] The crypto market's volatility and the Ethereum network's eventual move away from proof-of-work mining made continued operation unprofitable, and the pair looked for a way to repurpose their hardware.

Singh, who had been coding since high school and taught himself software development before funding part of his college education with a YouTube playlist app, saw potential in the AI server space. He proposed converting the mining rigs into GPU cloud servers for AI developers. Lu was initially skeptical; by Singh's own account, it took several conversations before Lu came around to the idea. When the two went to the bank to formalize the arrangement, Lu expressed interest in taking the CEO role. Singh, who preferred deep technical work over business management, readily agreed.[5]

The founders spent roughly three months building the initial platform, with Singh writing much of the backend in Go. They built solutions to two specific architectural problems: connecting distributed compute nodes while keeping them isolated from each other, and allowing containerized workloads to be reachable by external users without requiring static public IP addresses.[5]

How did RunPod start on Reddit?

In early 2022, Lu and Singh launched RunPod as a public beta. Having no marketing budget, they turned to Reddit, posting in AI-focused communities and offering free server time in exchange for feedback.[1] "As first-time founders, we didn't really know how to market or how to do anything," Lu recalled.[1] The response surprised them. Developers who had been frustrated with expensive and complex cloud GPU options were willing to experiment with a new, cheaper platform. Within nine months, the beta testers converted to paying customers and RunPod hit $1 million in revenue. At that point, Lu and Singh quit their Comcast jobs.[1]

The company was deliberately bootstrapped. Rather than raising outside capital early, Lu and Singh insisted the platform pay for itself. There was never a free tier. "It was almost two years where we really didn't have any funding," Lu told TechCrunch.[1] Operating costs had to be covered by revenue, even in months where margins were thin. This constraint shaped the company's lean operating culture throughout its first two years.

By May 2024, RunPod had reached $24 million in annualized revenue and a developer community of over 100,000 users, all without outside funding.[2]

When did RunPod raise funding?

In May 2024, RunPod announced a $20 million seed round co-led by Intel Capital and Dell Technologies Capital.[2][3] Mark Rostick, Vice President and Senior Managing Director at Intel Capital, joined RunPod's board of directors following the round.[2] Angel participants included Julien Chaumond (co-founder of Hugging Face), Nat Friedman (former GitHub CEO), Amjad Masad (CEO of Replit), and Adam Lewis.[3]

The path to investment was unconventional. Radhika Malik, a partner at Dell Technologies Capital, encountered RunPod through Reddit posts and reached out directly.[1] Julien Chaumond contacted the company through its customer support chat after using the product as an ordinary user.[1] The round brought RunPod's total disclosed funding to approximately $22 million, including around $2 million in earlier pre-seed capital.[12]

Growth to $120 million ARR

TechCrunch reported in January 2026 that RunPod had reached $120 million in annualized revenue, up from around $24 million two years earlier.[1] The developer base grew from 100,000 to more than 500,000 users in roughly the same period, ranging from individuals to Fortune 500 enterprise teams with multimillion-dollar annual GPU spend.[1] The company expanded its infrastructure to 31 global regions and added new product lines including Instant Clusters (launched March 2025) and Serverless CPU.[1] Despite not having raised since the 2024 seed, the founders told TechCrunch they were preparing to raise what they believe should command "a healthy Series A."[1]

How does RunPod work?

RunPod exposes GPU compute through three main products. Pods are long-running GPU instances for interactive and sustained work, Serverless provides autoscaling inference endpoints that bill only for active compute, and Instant Clusters connect multiple nodes for distributed training. All three run on top of two infrastructure tiers, Secure Cloud and Community Cloud, and are billed per second with no minimum commitment.[9][10]

Pods

Pods are RunPod's long-running GPU instances, the equivalent of virtual machines with GPU acceleration. A user selects a GPU type, a pre-built or custom Docker container image, storage configuration, and network settings, and the pod launches within minutes. Billing is per second, with no minimum commitment.[9]

Pods support three storage types: temporary container disk storage that persists only while the pod runs, a persistent volume disk that survives pod restarts, and optional network volumes that can be mounted across multiple pods simultaneously. Connectivity options include SSH, JupyterLab, VS Code, Cursor, and HTTP/HTTPS web proxies for services running inside the pod. Pods do not support UDP or Windows containers.[9]

Pods run in one of two infrastructure tiers: Secure Cloud or Community Cloud.

Serverless

Serverless is RunPod's autoscaling compute product for AI inference workloads. Rather than renting a GPU for a fixed period, users deploy a handler function inside a Docker container, and RunPod manages the lifecycle of workers automatically: spinning them up when requests arrive, processing the workload, and shutting them down when traffic subsides. Users pay only for actual compute time; there is no charge for idle periods.[10]

The architecture has three main components. Endpoints are URLs where applications send inference requests. Workers are container instances that RunPod starts and stops automatically. Handler functions are the user-defined code that processes each request.[10]

Serverless supports two endpoint types. Queue-based endpoints route requests through a managed queue with guaranteed execution and automatic retries, suited for batch workloads. Load-balancing endpoints route directly to available workers for real-time applications and streaming responses, supporting HTTP frameworks like FastAPI and Flask.[10]

What is FlashBoot?

Cold starts (the delay between a request arriving and a worker becoming ready) are a known challenge for serverless GPU infrastructure. RunPod introduced FlashBoot to address this problem. FlashBoot is an optimization layer that predicts demand patterns and pre-positions warm workers based on endpoint traffic volume, retaining worker state after spin-down so revival is faster than a fresh boot.[6] Testing on a Whisper transcription endpoint showed that 90% of cold starts completed in under two seconds, with the lowest measured cold start at 563 milliseconds.[6] RunPod states FlashBoot reduced cold-start costs on that endpoint by more than 70%, and the feature is available at no additional charge and enabled by default on new GPU and CPU endpoints.[6]

Users can maintain minimum active worker counts to avoid cold starts entirely for latency-sensitive applications. This option charges for idle workers at a lower "active" rate.[10]

Instant Clusters

Launched in March 2025, Instant Clusters are multi-node GPU environments designed for distributed training and large-scale inference.[1] The product provisions 2 to 8 nodes with up to 64 H100s connected via InfiniBand networking, delivering 1,600 to 3,200 Gbps east-west bandwidth via InfiniBand or RoCE v2 depending on configuration.[18] Clusters are priced on a per-second basis with no long-term contracts required, which positions the product against providers that require bare-metal reservations for multi-node access.

RunPod Hub

RunPod Hub is a marketplace of pre-configured, one-click deployable AI models and tools including Stable Diffusion, ComfyUI, Whisper, vLLM, and various open-source language models. Repository maintainers earn a share of compute revenue when other users run their templates, typically around 7% of the associated compute spend.

What is the difference between Secure Cloud and Community Cloud?

RunPod offers compute through two distinct infrastructure tiers with different cost and reliability profiles. Secure Cloud uses dedicated, certified data-center hardware for production workloads, while Community Cloud is a lower-cost peer-to-peer marketplace of independently owned GPUs best suited to interruptible jobs.

Secure Cloud

Secure Cloud operates through Tier 3 and Tier 4 data centers managed by RunPod's vetted infrastructure partners. Hardware is dedicated: no other user's workloads run on the same physical machine. Network storage is backed by NVMe drives, and provisioning is stable. Secure Cloud data centers hold SOC 2, ISO 27001, and PCI DSS certifications.[7]

RunPod achieved SOC 2 Type I certification in February 2025 and began a six-month SOC 2 Type II audit in March 2025.[7] The company also holds HIPAA and GDPR compliance certifications, allowing healthcare organizations and companies subject to European privacy law to use the platform with Business Associate Agreements in place.[8]

Secure Cloud is priced higher than Community Cloud but lower than hyperscalers for equivalent hardware. It is the appropriate tier for production inference, customer-facing applications, and workloads involving sensitive data.

Community Cloud

Community Cloud connects independent GPU owners to RunPod users through a peer-to-peer marketplace model. Third-party hosts contribute hardware ranging from consumer gaming GPUs to datacenter cards, and RunPod vets providers before adding them to the network. Workloads on Community Cloud run in isolated containers, but the underlying hardware is shared with other users on the same host machine.

Community Cloud prices are substantially lower than Secure Cloud. RTX 4090 instances are available below $0.50 per hour.[17] The tradeoff is reliability: a host can go offline or shut down a machine, potentially interrupting running workloads. Community Cloud is suited for training runs that can checkpoint and resume, batch processing, experimentation, and academic research. It is not recommended for production inference or workloads where interruption has revenue consequences.

What GPUs does RunPod offer?

RunPod's GPU catalog spans consumer, professional, and datacenter hardware. The following table covers the primary options available as of early 2026.[11][14]

GPUVRAMCategorySecure Cloud price (approx.)
NVIDIA B200180 GBDatacenter~$5.98/hr
NVIDIA B300288 GBDatacenterContact sales
NVIDIA H200141 GBDatacenter~$4.31/hr
NVIDIA H100 SXM80 GBDatacenter~$2.69/hr
NVIDIA H100 PCIe80 GBDatacenter~$2.49/hr
AMD MI300X192 GBDatacenter~$2.35/hr
NVIDIA A100 SXM80 GBDatacenter~$1.79/hr
NVIDIA A100 PCIe80 GBDatacenter~$1.19/hr
NVIDIA L40S48 GBProfessional~$1.14/hr
NVIDIA RTX 6000 Ada48 GBProfessional~$0.89/hr
NVIDIA L4048 GBProfessional~$0.79/hr
NVIDIA L424 GBProfessional~$0.44/hr
NVIDIA RTX 409024 GBConsumer~$0.34/hr
NVIDIA RTX 309024 GBConsumer~$0.22/hr
NVIDIA RTX 509032 GBConsumerVariable

Prices listed are approximate Secure Cloud on-demand rates and are subject to change. Community Cloud prices are typically 20 to 50 percent lower. RunPod also offers reserved pricing for monthly or annual commitments, generally discounting on-demand rates by 15 to 25 percent.[17]

The AMD MI300X (192 GB VRAM) was historically available on RunPod at around $2.35 per hour, making it one of the most accessible providers for that GPU. Availability has been intermittent as of early 2026.

RunPod does not currently support Google TPUs or AWS Trainium/Inferentia accelerators.

How much does RunPod cost?

RunPod uses a pay-as-you-go model with no minimum commitments, no ingress fees, and no egress fees. Credits are prepaid and consumed at per-second billing rates.[17]

Pod pricing

Compute typeBilling unitNotes
GPU PodsPer secondCommunity or Secure Cloud
CPU PodsPer secondCPU-only workloads
Reserved PodsMonthly/annual15-25% discount over on-demand

Storage pricing

Storage typeRate
Volume / container disk (running)$0.10/GB/month
Volume / container disk (idle)$0.20/GB/month
Network volume (under 1 TB)$0.07/GB/month
Network volume (over 1 TB)$0.05/GB/month
High-performance network volume$0.14/GB/month

Serverless pricing

Serverless endpoints have two worker modes. Flex workers scale down to zero when idle. Active workers are maintained at a minimum count to reduce cold starts, charged at a lower rate than flex workers.[10]

GPUFlex rateActive rate
NVIDIA B200~$8.64/hr equivalent~$7.34/hr equivalent
NVIDIA H200~$5.58/hr equivalent~$4.74/hr equivalent
NVIDIA L40S~$1.90/hr equivalent~$1.62/hr equivalent
NVIDIA RTX 4090~$1.10/hr equivalent~$0.94/hr equivalent

Serverless also exposes public endpoints for common AI tasks with usage-based pricing: audio transcription at $0.05 per 1,000 characters, image generation at $0.005 to $0.14 per request depending on model, and text generation at $0.00001 to $10.00 per million tokens.[17]

How does RunPod compare to CoreWeave, Lambda Labs, and Modal?

FeatureRunPodLambda LabsCoreWeaveModal (platform)
H100 on-demand price~$2.69/hr~$3.78/hr~$6.16/hrUsage-based
Serverless GPUYesNoLimitedYes
Spot/community GPUYesNoNoNo
Multi-node clustersYes (8 nodes, 64 GPUs)LimitedYes (100+ GPUs, InfiniBand)Limited
No egress feesYesYesNoYes
Uptime SLABest-effort99.9%Enterprise SLAEnterprise SLA
Kubernetes supportNoNoYesNo
SOC 2Type I (2025)YesYesYes
HIPAA complianceYesNoNoNo
Primary audienceDevelopers, startupsDevelopers, researchersEnterprises, large trainingDevelopers

CoreWeave is the dominant choice for large-scale foundation model training because it offers full Kubernetes orchestration, InfiniBand networking across hundreds of GPUs, and enterprise service-level agreements. RunPod's Instant Clusters support up to 8 nodes (64 GPUs) with InfiniBand, which covers mid-scale training runs but not pre-training at foundation model scale.

Lambda Labs occupies a similar market position to RunPod but emphasizes simplicity and a stronger uptime guarantee over price. Lambda's H100 pricing is roughly 40% higher than RunPod's, and Lambda does not offer a serverless product or a community cloud tier.

Modal is a Python-first serverless GPU platform with a developer experience optimized for defining infrastructure in code. Modal's pricing is usage-based like RunPod Serverless, but Modal does not offer persistent pod instances, making it less suitable for workloads that require dedicated long-running compute.

Vast.ai operates a similar peer-to-peer marketplace to RunPod's Community Cloud, sometimes at lower prices, but without Secure Cloud infrastructure or a native serverless product.

What is RunPod used for?

Model training

RunPod Pods are commonly used for supervised fine-tuning and full training of medium-scale models. A researcher can spin up an H100 or A100 instance, attach a persistent network volume containing a dataset, run a training job, and terminate the instance when complete. The per-second billing means there is no cost for idle time between runs. Instant Clusters extend this to distributed training across up to 64 GPUs for runs that require more memory or compute than a single node.

Community Cloud GPUs are particularly popular for fine-tuning runs on consumer hardware. RTX 3090 and RTX 4090 instances at under $0.35 per hour make fine-tuning open-source 7B to 13B parameter models accessible to individual developers and academic researchers.

Inference deployment

RunPod Serverless is designed for deploying models as API endpoints. Developers package a model into a Docker container with a handler function, push the image to a container registry, and deploy it as a RunPod endpoint. The endpoint URL scales from zero to many parallel workers based on traffic. Common deployments include image generation pipelines built on Stable Diffusion or Flux, transcription services using Whisper, and language model chat completions using open-source models served via vLLM or similar inference engines.

FlashBoot makes Serverless viable for latency-sensitive applications by keeping cold-start times under two seconds for high-traffic endpoints.[6]

Generative image and video workloads

RunPod has a substantial community of users running Stable Diffusion, ComfyUI, and related image generation tools. Pre-built templates for these workflows are available in RunPod Hub, allowing users to launch a ComfyUI or Automatic1111 environment with a single click. Video generation models including AnimateDiff and various video-to-video tools are also common RunPod use cases.

LLM development and experimentation

Developers use RunPod to run and experiment with open-source language models including LLaMA, Mistral, Falcon, and others. The JupyterLab integration allows notebook-based experimentation without needing to configure SSH, while the API access enables programmatic model interaction from external applications.

Who uses RunPod?

As of January 2026, RunPod disclosed enterprise customers including Replit, Cursor, OpenAI, Perplexity AI, Wix, and Zillow.[1] Some of these relationships involve internal tooling or research infrastructure rather than customer-facing products. RunPod also integrates with the Cursor code editor via its Model Context Protocol (MCP) server, enabling developers to manage RunPod infrastructure directly from an IDE. The platform sponsors technical competitions including ARC-AGI-2 as a channel for developer adoption.

Pardeep Singh has framed GPU availability as central to retaining this user base: "If we don't have the GPUs, the market sentiment, the user sentiment changes," he told TechCrunch. "Because when they don't see capacity from you, they go somewhere else."[1]

Reception

RunPod's early growth through Reddit was noted as unusual in the infrastructure space. TechCrunch, in its January 2026 coverage, framed the company's origin around "a Reddit post" and pointed to the bootstrapped path to $24 million ARR before taking outside funding as a differentiating characteristic compared with other GPU cloud startups that raised large rounds before achieving scale.[1] Lu has described the broader ambition as building default infrastructure for the next generation of developers: "Our goal is to be what this next generation of software developers grows up on."[1]

Developer community sentiment is generally positive on pricing transparency and ease of use. Users frequently cite the absence of egress fees, the per-second billing with no minimums, and the quality of the web console as advantages over larger cloud providers. A Medium review of the platform described RunPod as "the least disappointing corner of the AI infrastructure hellscape" and praised its straightforward billing model: "no surprise charges, no byzantine pricing structures, no sales calls required to understand your bill."[16]

Critical feedback from users centers on several recurring themes. Community Cloud reliability is the most consistent complaint; GPU owners can take their hardware offline without warning, potentially disrupting long-running jobs. Users have also reported variable network storage performance, occasional portal bugs, and documentation gaps for advanced multi-node configurations. Support response times average 12 to 24 hours, slower than enterprise competitors. One community complaint was that RunPod temporarily removed spot pricing and later restored it behind API access, which users interpreted as adding friction to budget-sensitive workflows.

On Trustpilot, RunPod holds generally positive ratings, though some reviews flag technical issues during initial setup and occasional sluggish uploads.

What are RunPod's limitations?

RunPod carries several documented limitations that affect suitability for certain workloads.

The platform does not offer Kubernetes orchestration. Users who need managed container scheduling, rolling deployments, or Kubernetes-native tooling need to look elsewhere. CoreWeave is the primary alternative for Kubernetes-based AI infrastructure.

Community Cloud instances have no guaranteed uptime. A host machine shutting down will terminate any running pod without warning. Training jobs need to checkpoint regularly to avoid losing progress on Community Cloud.

Multi-node training via Instant Clusters is capped at 8 nodes (64 GPUs) as of early 2026, which covers many mid-scale training use cases but not foundation model pre-training at the scale of GPT-4 or Gemini. For runs requiring hundreds of GPUs with low-latency InfiniBand, CoreWeave or dedicated bare-metal providers are the conventional choice.

Data encryption at rest is not enabled by default on Community Cloud. Users handling regulated data are advised to implement application-level encryption. Secure Cloud provides encrypted storage by default.

RunPod does not support CI/CD integrations natively. There is no built-in connection to GitHub, GitLab, or similar source control systems, and no native pipeline or rollback mechanism. Teams that want GitOps-style GPU deployments need to build their own orchestration on top of the RunPod API.

Windows containers are not supported. All workloads run on Linux.

UDP networking is not available. Only TCP and HTTP/HTTPS are supported for pod communication.

See also

References

  1. TechCrunch. "AI cloud startup Runpod hits $120M in ARR and it started with a Reddit post." January 16, 2026. https://techcrunch.com/2026/01/16/ai-cloud-startup-runpod-hits-120m-in-arr-and-it-started-with-a-reddit-post/
  2. Intel Capital. "RunPod Raises $20M in Seed Funding Co-led by Intel Capital and Dell Technologies Capital." May 8, 2024. https://www.intelcapital.com/runpod-raises-20m-in-seed-funding-co-led-by-intel-capital-and-dell-technologies-capital/
  3. BusinessWire. "RunPod Raises $20M in Seed Funding Co-led by Intel Capital and Dell Technologies Capital." May 8, 2024. https://www.businesswire.com/news/home/20240508053225/en/RunPod-Raises-$20M-in-Seed-Funding-Co-led-by-Intel-Capital-and-Dell-Technologies-Capital
  4. RunPod Blog. "Runpod's $20MM Milestone: Fueling Our Vision, Empowering Our Team." 2024. https://www.runpod.io/blog/runpod-raises-20mm
  5. RunPod Blog. "Founder Series #1: The Runpod Origin Story." https://www.runpod.io/blog/founder-series-1-origin-story
  6. RunPod Blog. "Introducing FlashBoot: 1-Second Serverless Cold-Start." https://www.runpod.io/blog/introducing-flashboot-serverless-cold-start
  7. RunPod Blog. "RunPod Achieves SOC 2 Type I Certification." https://www.runpod.io/blog/runpod-soc2-certification
  8. RunPod Press. "Runpod Achieves HIPAA and GDPR Compliance." https://www.runpod.io/press/runpod-achieves-hipaa-and-gdpr-compliance
  9. RunPod Documentation. "Pods Overview." https://docs.runpod.io/pods/overview
  10. RunPod Documentation. "Serverless Overview." https://docs.runpod.io/serverless/overview
  11. RunPod Documentation. "GPU Types." https://docs.runpod.io/references/gpu-types
  12. Sacra. "RunPod revenue, funding & news." https://sacra.com/c/runpod/
  13. CoveTech News. "From Reddit to Riches: The Rise of Runpod in the AI Cloud Space." https://covetech.net/news/from-reddit-to-riches-the-rise-of-runpod-in-the-ai-cloud-space
  14. DeployBase. "RunPod Review 2026 - Cheapest H100 GPU Pricing and Serverless Guide." https://deploybase.ai/articles/runpod-review
  15. SiliconANGLE. "RunPod nabs $20M to help developers launch AI apps in the cloud." May 9, 2024. https://siliconangle.com/2024/05/09/runpod-nabs-20m-help-developers-launch-ai-apps-cloud/
  16. Medium / Dark Horse. "Runpod.io: The GPU Cloud That Accidentally Got It Right." https://medium.com/@dankdarkhorse/runpod-io-the-gpu-cloud-that-accidentally-got-it-right-617ab468eed6
  17. RunPod Pricing Page. https://www.runpod.io/pricing
  18. RunPod Blog. "Introducing Instant Clusters: On-Demand Multi-Node AI Compute." March 2025. https://www.runpod.io/blog/instant-clusters-runpod

Improve this article

Add missing citations, update stale details, or suggest a clearer explanation.

Suggest edit