Recommendation · Money
Compute a production baseline so the agent knows normal from anomalous
Pienaar recommends computing a baseline for production — extremely important in large environments — because most prod environments are in permanent disarray and chaos: engineers know which error logs to ignore and which metrics are unused, but an agent doesn't. Concretely, cluster logs and give the agent statistics on which logs recur daily and are common, not just raw logs; the same approach applies to metrics, object state, and many other things.
AI Engineer · Your AI Agent Is Confidently Wrong About Production — Willem Pienaar, Cleric
Recommendation from Willem Pienaar