Skip to main content
Version: v0.7

contextguru

Context-guruโ€‹

Context-guru is a Rossoctl Cortex plugin that compacts an agent's growing tool-output context before it reaches the LLM, so a task whose raw context exceeds the model's window still fits โ€” and the agent gets the right answer because of the compaction.

Same agent, same model, same window. The only variable is context-guru:

modecontext-gururequest the model seesagent answer
offdisabled (kill-switch)raw ~18K tok โ†’ truncated to the 12K windowโŒ misses the anomaly, hallucinates a wrong refund
observeshadow (measures, doesn't apply)raw ~18K tok (truncated); logs it would save 52KBโ†’30KBโŒ same wrong answer โ€” proves the measurement is free
enforceappliedcompacted ~10K tok โ†’ fitsโœ… finds the TX4827 duplicate, clears the others

Architectureโ€‹

context-guru is an in-process AuthBridge plugin (not a sidecar service). The agent's outbound LLM calls are routed through AuthBridge's forward proxy (HTTP_PROXY=:8081); the plugin runs in the outbound pipeline and rewrites the request body before it leaves the pod.

context-guru architecture: the finance-agent routes outbound LLM calls through AuthBridge's forward proxy, whose OUTBOUND pipeline runs inference-parser then the context-guru plugin to compact tool context before the request reaches Ollama

Try the Demo!โ€‹