LLM Provider Factory & API Key Vault

DDD + Hexagonal LlmProviderFactory supporting OpenAI, Anthropic, Gemini, Azure OpenAI, Azure AI Foundry (Models & Agents), Microsoft Copilot Studio, OpenRouter, Ollama, and in-process litellm.Router. API keys are encrypted at rest (AES-256-GCM) in the local secrets vault.

AES-256-GCM in-process://litellm.Router Role: anonymous (Keys Redacted)
Provider Adapter Kind Model / Agent Endpoint Vault & Readiness API Key
OpenAI
openai
 openai_compatible
gpt-4o
 https://api.openai.com/v1 Encrypted •••••••••••• Server-Only
Anthropic Claude
anthropic
 anthropic
claude-3-5-sonnet-latest
 https://api.anthropic.com/v1 Encrypted •••••••••••• Server-Only
Google Gemini
google_gemini
 google_gemini
gemini-2.5-pro
 https://generativelanguage.googleapis.com/v1beta Encrypted •••••••••••• Server-Only
Azure OpenAI
azure_openai
 azure_openai
gpt-4o
 https://resource.openai.azure.com Encrypted •••••••••••• Server-Only
Microsoft Azure AI Foundry
azure_ai_foundry
 azure_ai_foundry
gpt-4o
 https://foundry.services.ai.azure.com Encrypted •••••••••••• Server-Only
Microsoft Copilot Studio
copilot_studio
 copilot_studio
copilot-studio-agent
 https://directline.botframework.com/v3/directline Encrypted •••••••••••• Server-Only
OpenRouter
openrouter
 openai_compatible
openai/gpt-4o
 https://openrouter.ai/api/v1 Encrypted •••••••••••• Server-Only
LiteLLM In-Process Router
litellm
 litellm
openai/gpt-4o-mini
 in-process://litellm.Router Encrypted •••••••••••• Server-Only
Ollama (Local)
ollama
 openai_compatible
llama3.3
 http://127.0.0.1:11434/v1 Encrypted •••••••••••• Server-Only
CopilotKit Cloud
copilotkit_cloud
 copilotkit_cloud
copilotkit-cloud
 https://api.cloud.copilotkit.ai Encrypted •••••••••••• Server-Only
TypeSafe System One (Jev)
typesafe_jev
 typesafe_jev
jev
 https://api.typesafe.ai Encrypted •••••••••••• Server-Only
MiniMax Speech & Audio
minimax
 minimax
speech-2.8-hd
 https://api.minimax.io/v1 Encrypted •••••••••••• Server-Only
Microsoft Azure AI Speech
azure_speech
 azure_speech
azure-fast-transcription
 https://australiaeast.api.cognitive.microsoft.com Encrypted •••••••••••• Server-Only
ElevenLabs Speech & Scribe
elevenlabs
 elevenlabs
scribe_v2
 https://api.elevenlabs.io/v1 Encrypted •••••••••••• Server-Only
Local Device / Browser Built-In (Web Speech API)
browser_native
 browser_native
browser-tts-default
 browser://web-speech-api Encrypted •••••••••••• Server-Only
API keys are encrypted and hidden for non-admin roles (public, anonymous, viewer, security). Sign in as an Administrator to view, create, update, test, or delete providers. RBAC Protected
Interactive LLM & Agent Factory Prompt Tester POST /copilotkit/providers/invoke
Speech & Audio Workbench (Voice Design & Provider Files)
POST /copilotkit/audio/voices/design