slv-jetstreamerlisted
Install: claude install-skill ValidatorsDAO/slv
# SLV Jetstreamer Skill
`jetstreamer` is anza-xyz's high-throughput Solana ETL engine: it streams the Old
Faithful CAR archive directly into a local ClickHouse instance and produces
query-ready aggregations (program invocation counts, slot statuses, pubkey
mentions, …). Together with the `slv-rpc` of1 rolling cache, it gives a
clean separation:
| Layer | Component | Role |
|---|---|---|
| **JSON-RPC** (per-call) | `yellowstone-faithful` (Index RPC) + 30-epoch index cache | `getTransaction` / `getBlock` / `getBlockTime` etc. |
| **SQL analytics** (bulk) | `jetstreamer` + ClickHouse | Cross-epoch aggregations, program-level joins, MEV / DEX research |
Jetstreamer is **not** a server. It runs as a one-shot ETL per epoch and exits;
ClickHouse is the long-running query surface.
## Hardware target
| Resource | Recommended |
|---|---|
| CPU | AMD EPYC 64C+ (jetstreamer hits 2.7 M TPS+ ingest with all cores) |
| RAM | 128 GB+ (754 GB optimal for full-fat ClickHouse buffers) |
| Disk | 4-8 TB NVMe (RAID0 recommended for max write bandwidth — derived data is rebuildable from Old Faithful) |
| Network | 10 Gbps+ (50 Gbps demonstrated to fully saturate ingest path) |
| OS | Ubuntu 24.04, kernel 6.14+ |
| Toolchain | **Clang 16** (RocksDB compatibility — Clang 17/18 do *not* work), GCC 13, Rust (rustup, toolchain pinned by rust-toolchain.toml in jetstreamer repo) |
## Disk layout
The reference layout combines two NVMes into one mdadm RAID0 stripe:
```
/dev/nvme0n1 ─┐