Overview
Two ways to run models with CarbonForge.
CarbonForge serves tuned, energy-aware LLM inference through two pathways:
API endpoint
An OpenAI-compatible endpoint managed by CarbonForge. Bring an API key and send the first request in minutes.
Self-hosted container
Pull the cf-bundle container and serve a benchmarked recipe on your own GPUs.
Choosing a pathway
| API endpoint | Self-hosted container | |
|---|---|---|
| Setup | Faster | Slower |
| Whose hardware | CarbonForge's | Yours |
| Data security | SOC 2 compliant infrastructure | Never leaves your infrastructure |
For a quick evaluation, the endpoint is the shortest path. For data-residency or compliance constraints, the container keeps everything in-house.