LLM 프록시 도커화: 무료 다중 공급자 액세스를 위한 컨테이너 1개

작성자

카테고리:

← 피드로
DEV Community · Garage23auto · 2026-08-22 개발(SW)

Garage23auto

Dockerize Your LLM Proxy: One Container for Free Multi-Provider Access

Want free LLM access in a repeatable, portable way? Run it as a container.

Why Docker

  • Single command to deploy anywhere
  • Isolated environment with consistent deps
  • Easy to put behind a reverse proxy

DAVIL Cod in Docker

DAVIL Cod ships a Dockerfile. Build and run with provider keys as env vars:

docker build -t davil-cod .
docker run -p 4000:4000 \
  -e PROVIDER_GROQ_APIKEY=... \
  -e PROVIDER_MISTRAL_APIKEY=... \
  davil-cod

Enter fullscreen mode Exit fullscreen mode

Features you get

  • Provider rotation with circuit breaker
  • Disk cache for repeated prompts
  • Dashboard on port 4000

FAQ

Does it persist the cache? Yes — mount a volume for the cache directory.

Can I expose it to my team? Yes — it’s a normal HTTP service with token auth.

원문에서 계속 ↗