hermes-atropos-environments

# Hermes Agent Atropos Environments Guide for building RL environments in the hermes-agent repo that integrate with the Atropos training framework. ## Architecture Overview ``` Atropos BaseEnv (atroposlib/envs/base.py) └── HermesAgentBaseEnv (environments/hermes_base_env.py) ├── Handles agent loop orchestration ├── Handles tool resolution per group ├── Handles ToolContext for reward verification └── YOUR ENVIRONMENT (environments/your_env.py) Only implements: setup, get_next_item, format_prompt, compute_reward, evaluate, wandb_log ``` Hermes environments are special because they run a **multi-turn agent loop with tool calling** — not just single-turn completions. The base env handles the loop; you implement the task and scoring. ## File Locations | File | Purpose | |------|---------| | `environments/hermes_base_env.py` | Base class with agent loop + tool resolution | | `environments/agent_loop.py` | `HermesAgentLoop` + `AgentResult` dataclass | | `environments/tool_context.py` | `ToolContext` for reward verification | | `environments/tool_call_parsers.py` | Phase 2 tool call parsers (hermes, mistral, etc.) | | `environments/your_env.py` | Your environment implementation | ## Inference Setup — Ask the User First **IMPORTANT:** Before running any test, evaluation, or data generation command, always ask the user how they want to handle inference. Do NOT assume Open...