Production-ready Terraform examples for deploying stdapi.ai — an OpenAI, Anthropic & Cohere compatible API gateway that runs in your own AWS account, in front of Amazon Bedrock and the AWS AI services (Polly, Transcribe, Comprehend). Not just chat: images, video, audio, files, embeddings, moderation and reranking. 14-day free trial included.
Start 14-Day Free Trial · Documentation · GitHub Repository
Single-region production deployment with hardened security defaults and optional monitoring.
Perfect for getting started with production workloads. Includes everything needed for secure, scalable deployment in a single AWS region.
Key Features:
- HTTPS with auto-generated ALB domain (or custom domain with Route53)
- Auto-scaling (CPU, Memory, Request-based)
- KMS encryption for all data at rest
- API key authentication
- Optional WAF protection and CloudWatch alarms
Best for: Most production workloads, quick deployment, single-region requirements
EU multi-region deployment with EU data residency controls.
Deployment that keeps model processing within the EU regions you enable. Eligible failures retry in another enabled EU region.
Key Features:
- Multi-region Bedrock access (4 EU regions: eu-west-3 Paris, eu-west-1 Ireland, eu-central-1 Frankfurt, eu-north-1 Stockholm)
- Regional S3 buckets for multimodal operations
- Region allow-list with global cross-region inference disabled
- All production features (HTTPS, WAF)
- Data residency controls for an EU-only processing footprint
Best for: Enterprise deployments, EU data residency and data sovereignty requirements
US multi-region deployment for maximum availability and performance.
Enterprise deployment leveraging multiple US regions for performance and availability. Eligible failures retry in another enabled US region.
Key Features:
- Multi-region Bedrock access (3 US regions: us-east-1, us-west-2, us-east-2)
- Regional S3 buckets for optimal performance
- Retry across enabled regions, each with its own Bedrock quota
- All production features (HTTPS, WAF)
- Maximum US availability
Best for: Enterprise deployments, US data residency, high availability requirements
Token-based access with an Amazon Cognito user pool in front of the gateway, and no shared API key anywhere.
Single-region deployment where clients obtain a short-lived access token themselves and present it on every request. Access is granted and withdrawn one application at a time, in the pool.
Key Features:
- Amazon Cognito user pool — Self sign-up disabled, one app client per application
- Machine-to-machine credentials — OAuth 2.0
client_credentialsgrant, tokens valid one hour - No API key — User pool tokens are the only accepted credential
- Agent discovery — Authorization server and required scope published from the pool, nothing to keep in sync
- Per-caller identity — The verified caller drives per-user cost attribution
Best for: Multiple client applications, autonomous agents, deployments with no shared secret to rotate
Complete AI chat platform with ChatGPT-like interface, web search, RAG, and multimodal capabilities.
Full-featured deployment of Open WebUI powered by stdapi.ai. Includes web search, document processing, vector storage, and all the features you'd expect from a modern AI chat interface.
Key Features:
- Open WebUI — Feature-rich ChatGPT-like interface
- Web Search — SearXNG integration for real-time information
- Web Scraping — Playwright for content extraction
- RAG Ready — Aurora PostgreSQL with pgvector for semantic search
- Caching — Valkey (Redis-compatible) for performance
- Multimodal — TTS, STT, image generation & editing, document processing
Best for: Private ChatGPT alternative, team AI assistant, complete AI chat platform
🧠 LobeHub
Private AI chat platform with vision, image generation, and knowledge-base embeddings through one OpenAI-compatible connection.
Deployment of LobeHub powered by stdapi.ai, in server DB mode with a self-hosted ParadeDB Postgres.
Key Features:
- LobeHub — Modern chat UI with plugin/agent marketplace and knowledge base
- Single connection — One "OpenAI" provider covers chat, vision, image generation, and embeddings
- Self-hosted ParadeDB — Postgres 17 with
pg_search+pgvectoron EFS - Object storage — Self-hosted RustFS (S3-compatible) for uploads
- Caching — Valkey (Redis-compatible) for sessions
Best for: Evaluating LobeHub against Bedrock models
🔗 n8n
Preconfigured workflow automation with a credential and thirteen sample workflows already in place.
Deployment of n8n powered by stdapi.ai, with an owner account provisioned non-interactively and one runnable sample workflow per stdapi.ai route family imported automatically on first start.
Key Features:
- n8n — Visual workflow automation, backed by Aurora PostgreSQL
- Pre-imported credential and workflows — OpenAI- and Anthropic-compatible credentials plus 13 sample workflows, seeded on first boot
- Non-interactive owner account — No signup screen to click through
- No local image build — The official
n8nio/n8nimage is pulled directly from Docker Hub
Best for: Trying stdapi.ai's full route surface through n8n's node library, no manual setup
Autonomous agent on Amazon Bedrock, with its gateway and dashboard preconfigured against stdapi.ai.
Deployment of Hermes Agent (Nous Research), with config.yaml seeded on first boot and no manual editing before the first run.
Key Features:
- Hermes gateway + dashboard — OpenAI-compatible API and monitoring UI, dashboard behind HTTP Basic Auth
- Preconfigured
config.yaml— stdapi.ai URL and API key already filled in - Persistent state — Config, sessions, memories, and skills on EFS
- No local image build — The image is pulled anonymously from Docker Hub
- ECS Exec — Shell into the container or drive Hermes' interactive CLI directly
Best for: Trying an autonomous agent loop against Bedrock models with zero API-key hunting
🦾 OpenClaw
Autonomous agent gateway with a browser Control UI, preconfigured to drive Amazon Bedrock through stdapi.ai.
Deployment of OpenClaw, a personal-assistant and coding-agent gateway.
Key Features:
- OpenClaw gateway + Control UI — Reachable through the ALB, token-authenticated
- Preconfigured provider — stdapi.ai registered as a custom OpenAI-compatible provider
- Persistence — Config, auth material, and workspace on EFS
- No local image build — The public
ghcr.io/openclaw/openclawimage is pulled anonymously
Best for: Evaluating OpenClaw as a personal assistant or coding agent against Bedrock models
Voice assistant on AWS, bridging Home Assistant's Assist pipeline to Amazon Transcribe and Polly through stdapi.ai.
Deployment of Home Assistant with wyoming-openai as a same-task sidecar.
Key Features:
- Home Assistant — Config on a persistent EFS volume
- wyoming-openai — Bridges Assist's Wyoming protocol to stdapi.ai's OpenAI-compatible audio routes
- Amazon Transcribe + Polly — Speech-to-text and text-to-speech through stdapi.ai
- No local image build — Both images are pulled directly from ghcr.io
Best for: Assist voice through AWS AI services — as a cloud-hosted trial, or as the AWS half of a Home Assistant you run at home
📄 Docling
Document conversion API for RAG, with its optional VLM pipeline routed through stdapi.ai to a Bedrock vision model.
Deployment of Docling Serve, CPU-only, with no web UI — a POST in, structured Markdown/JSON out, for the ingestion stage of a RAG pipeline.
Key Features:
- Docling Serve — Classical layout/OCR/table-structure extraction by default, no LLM call
- Optional VLM pipeline — Page images routed through stdapi.ai to a vision-capable Bedrock model
- Zero backing services — No database, cache, or file storage; models are baked into the image
- CPU-only — No GPU required
Best for: The document-ingestion stage of a RAG pipeline
📚 RAGFlow
Complete RAG platform, with chat, embedding and reranking models bound to stdapi.ai before you ever log in.
Deployment of RAGFlow on ECS Fargate, with every backing service replaced by a managed AWS equivalent: Amazon OpenSearch Service for the document/vector store, Aurora PostgreSQL for metadata, ElastiCache Valkey for the task queue, and Amazon S3 for files.
Key Features:
- Preconfigured providers — Chat, embedding and rerank models bound to the admin tenant during deployment, no admin UI to click through
- Amazon OpenSearch Service — Hybrid BM25 + vector retrieval on a managed VPC domain, no self-hosted Elasticsearch
- Amazon Bedrock reranking — Retrieved chunks reranked through stdapi.ai's Cohere-compatible endpoint
- Task role for S3 — No static access keys for object storage
Best for: Document Q&A over your own corpus, with retrieval quality you can tune
| Example | Deployment Time | Regions | Data residency | Best For |
|---|---|---|---|---|
| Production | ~10 minutes | Single region | The region you deploy in | Most workloads, quick start |
| Production GDPR | ~15 minutes | Multi-region (EU) | EU regions only, global cross-region inference disabled | EU enterprises, EU data residency |
| Production US | ~15 minutes | Multi-region (US) | US regions only | US enterprises, high availability |
| Cognito Authentication | ~10 minutes | Single region | The region you deploy in | Multiple client applications, no shared key |
Region retry covers eligible throttling and availability failures. Streaming requests can only retry before the stream opens, and asynchronous jobs stay in the region that accepted them. Each region you enable adds its own Bedrock quota.
Each of these deploys stdapi.ai in a single region, with the application in front of it.
| Example | Deployment Time | Backing services | Best For |
|---|---|---|---|
| Open WebUI | ~20 minutes | Aurora PostgreSQL, Valkey, S3 | Complete chat platform, teams |
| LobeHub | ~10 minutes | Postgres on EFS, Valkey, S3 | Evaluating LobeHub against Bedrock models |
| n8n | ~15-20 minutes | Aurora PostgreSQL | Workflow automation over the full route surface |
| Hermes Agent | ~5 minutes | EFS | An autonomous agent loop on Bedrock |
| OpenClaw | ~10-15 minutes | EFS | A personal assistant or coding agent |
| Home Assistant | ~5-10 minutes | EFS | Assist voice through Amazon Transcribe and Polly |
| Docling | ~5 minutes | None | The ingestion stage of a RAG pipeline |
| RAGFlow | ~30 minutes | Amazon OpenSearch, Aurora PostgreSQL, Valkey, S3 | Document Q&A over your own corpus |
-
AWS Marketplace Subscription — Start 14-day free trial (includes hardened container images and commercial license)
Want to evaluate first, for free? The AGPL-3.0 Community Edition image
ghcr.io/stdapi-ai/stdapi.ai-community:latestexposes the same API at no cost — see Run locally with Docker. The commercial difference is hardening, support and license rights, not endpoints. -
Terraform or OpenTofu — Install Terraform or OpenTofu >= 1.5
-
AWS Credentials — Configure AWS credentials with appropriate permissions
-
Domain Name (optional) — A domain managed in Route53, to serve HTTPS from your own name instead of the auto-generated ALB domain. Set
alb_domain_nameinmain.tfto use it.
The stdapi.ai license is $0.10 per container-hour on the AWS Marketplace ($0.09 through a private offer), and $0 for the Community Edition image. These examples keep the module defaults, which run one task per availability zone — so a three-AZ region runs three tasks, about $216/month in license, and six in us-east-1. ALB, NAT gateways, Fargate and KMS are billed separately by AWS. Amazon Bedrock usage is billed to you directly by AWS with 0% markup.
git clone https://github.com/stdapi-ai/samples.git
cd samples/getting_started_production # or your chosen exampleNo git? Download the ZIP instead:
curl -L https://github.com/stdapi-ai/samples/archive/refs/heads/main.zip -o samples.zip unzip samples.zip && cd samples-main/getting_started_production
Follow the README in that directory for step-by-step instructions.
These deployment examples are licensed under the MIT License — see LICENSE for details.
The hardened stdapi.ai container image requires a separate AWS Marketplace subscription. The AGPL-3.0 Community Edition image is free.
Ready to deploy 100+ AI models on AWS?