Prerequisites
Install Hermes
- Linux / macOS / WSL2
- Windows (PowerShell)
One-liner:Reload your shell:
Configure RuAPI
Launch the provider wizard:Pick 'Custom endpoint'
The wizard lists every built-in provider (Nous Portal / OpenRouter / Anthropic / OpenAI / …). Scroll to the bottom and select Custom endpoint (self-hosted / VLLM / etc.).
Choose a model
Common picks:
gpt-5(OpenAI-family)- Claude Sonnet (callable via the OpenAI-compatible protocol on RuAPI)
deepseek-chat, Kimi, GLM, etc.
~/.hermes/config.yaml:
First call
Start the CLI:Switch models
Inside a session:hermes model to change the default.
Wire up Telegram / Discord / etc.
Once the model is configured, set up the gateway:Troubleshooting
401 Unauthorized
401 Unauthorized
404 / model not found
404 / model not found
- That model ID isn’t on RuAPI — check the pricing page.
base_urlmust end in/v1.
Why not use Hermes's built-in 'Anthropic' provider?
Why not use Hermes's built-in 'Anthropic' provider?
Hermes’s built-in Anthropic flow is built around Claude Max OAuth — overriding the base URL for third-party gateways isn’t reliable. Custom endpoint (OpenAI-compatible) is the cleanest path on RuAPI, and Claude models work over it too.
Run Nous Portal + RuAPI side by side
Run Nous Portal + RuAPI side by side
Hermes supports multiple providers. Run
hermes model again to add another, and use /model mid-session to switch.Tool / function calling not working
Tool / function calling not working
Function calling passes through the OpenAI-compatible protocol unchanged. If a tool call fails, first verify the model supports tool use (
gpt-5 and Claude Sonnet support it for compatible models — check the capability badges on the pricing page).Advanced
- Auxiliary models: Hermes uses an auxiliary model for vision / web summarization / MoA, defaulting to your main model. To save money, override it to a cheaper one — see Auxiliary Models.
- Credential pools: round-robin keys and auto-failover — see Credential Pools.