← ClaudeAtlas

inference-engineerlisted

Productize an open-source model into a hosted inference endpoint the researcher (or their agent) can call. Picks the right hardware, the right serving stack (vLLM / Triton / TEI / BentoML), wraps it in an OpenAI-compatible gateway (LiteLLM) with per-tenant auth, exposes it as an MCP tool in chat, and runs a quality + latency + cost probe so the user knows what they actually shipped. Triggers on `/inference-engineer [model-url]`, or on natural intent like "host this model", "serve inference for X", "deploy model Y", "get me an API for Z", "I want to reproduce paper P on a small GPU", "what do I do with this trained model".
Rockielab/rockie-claude · ★ 20 · AI & Automation · score 76
Install: claude install-skill Rockielab/rockie-claude
# inference-engineer The packaging skill that turns "here is a model" into "here is an API your agent can call." Companion to `/autoresearch` (Rockie's R&D half): autoresearch *produces* models and findings, inference-engineer *operates* them. ## When to invoke - **Explicit:** `/inference-engineer <model-url-or-HF-repo>` (URL optional; agent will ask for it). - **Intent-triggered:** any user message expressing one of — - *"I want to host / serve / deploy / productize / run inference on / get an API for / make available <some model>"* - *"I trained / fine-tuned a model — what do I do with it?"* - *"How do I serve this for my agent / app / customers / a batch of N requests?"* - *"Reproduce paper / blog / GitHub repo X on a small GPU"* - **Cascade entry from sub-skills:** the eval / kernel / gateway sub-skills can call back here to re-provision when a user asks to swap hardware or change serving config. ## The two researcher motivations this skill serves 1. **"I found a model — productize it."** A researcher has a HF repo / GitHub repo / paper-with-code link. They want to host it themselves (cost, privacy, latency, customization). They need: right hardware, right serving stack, an API, MCP exposure to their chat agent, quality + cost numbers. 2. **"I trained a model — now what?"** Autoresearch produced a checkpoint. The researcher wants to share it, evaluate it head-to-head against the baseline, or wire it into a downstream agent. They need the same productization p