![The llama.cpp panel for a busy chat model: the model name with its size and context, tiles for busy slots, token rates, requests waiting, tokens generated and draft acceptance, one card per slot with a bar for context in use, and the full metrics table.](/assets/devops-llama-panel.svg)

*Illustrative mock-up with made-up data, not a screenshot.*

## Features

- Loaded model at a glance: parameters, quantization, size, context length and slots
- Generation and prompt tokens per second, with lifetime averages
- Requests waiting and tokens generated
- Draft-token acceptance for speculative decoding
- One card per slot, showing how much of its context is in use
- The same data for AI assistants through MCP (`llama_read`)

## Capabilities

- Reads the server's health, properties, models, slots and metrics.

## Limits

- Read-only: it can't run a completion.
- Model file paths and prompt text are never returned.
- The llama.cpp server must be reachable from the machine running devops-client.
- Load tiles need the server started with `--metrics`.