Infrastructurestrategy

Knowledge-graph + Quality-as-a-Service stack (judge-LLM + GEPA + DeepEval)

Advanced operators want eval + prompt optimization + hallucination checks across every internal tool. One QaaS API any tool can call.

TierCCatalog — Pattern outlined, candidates for deeper work
EffortXL · Half-year+
Forengineering lead · infra operator

What

Two backend services run by a single advanced operator: (1) graph backend storing/querying a knowledge graph with multiple query methods (NiFi-like pipeline framework); (2) Quality-as-a-Service API exposing forced telemetry capture, judge-LLM routing across multiple frontier models, ground-truth annotation, GEPA prompt-optimization workers, and DeepEval hallucination checks. Any internal tool can call the QaaS API for eval/optimization.