omni-inference

Solid

The core OpenAI-compatible inference endpoints: chat completions, embeddings, images, audio (TTS/STT), moderations, rerank, and the Responses API. The primary integration surface for AI agents.

AI & Automation 6,067 stars 1058 forks Updated today MIT

Install

View on GitHub

Quality Score: 93/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

<!-- generated by src/lib/agentSkills/generator.ts; manual edits will be overwritten --> ## Overview The core OpenAI-compatible inference endpoints: chat completions, embeddings, images, audio (TTS/STT), moderations, rerank, and the Responses API. The primary integration surface for AI agents. ## Authentication All requests require a valid Bearer token or session cookie. Obtain a token via `POST /api/auth/login` or configure `REQUIRE_API_KEY=false` for local development. ## Endpoints ### POST /api/v1/chat/completions Create chat completion OpenAI-compatible chat completions endpoint. Routes to configured providers. ```bash curl -X POST https://localhost:20128/api/v1/chat/completions \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" -H "Content-Type: application/json" \ -d '{}' ``` ### POST /api/v1/providers/{provider}/chat/completions Create chat completion (provider-specific) Routes to a specific provider by name. ```bash curl -X POST https://localhost:20128/api/v1/providers/{provider}/chat/completions \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" -H "Content-Type: application/json" \ -d '{}' ``` ### POST /api/v1/api/chat Ollama-compatible chat endpoint Provides compatibility with Ollama's /api/chat format. ```bash curl -X POST https://localhost:20128/api/v1/api/chat \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" -H "Content-Type: application/json" \ -d '{}' ``` ### POST /api/v1/messages Create message (Anthropic-compatible) Anthropic Message...

Details

Author
diegosouzapw
Repository
diegosouzapw/OmniRoute
Created
3 months ago
Last Updated
today
Language
TypeScript
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category