AI & Agent Evaluation
2,151total visitsadmin
reading room / notes / ai engineering

Reading room

Short summaries of agent optimization and AI engineering work — harnesses, prompt and context optimization, orchestration, memory, and agentic RL.

$ evals.index --public
category: ai engineering
posts: 1
mode: short summaries
storage: postgres
status: listening
ai eval (43)ai engineering (28)
Sort by source dateLatest firstEarliest first

Filtering by monitoring. Clear filter.

Agent Optimizer in Microsoft Foundry Agent Service (Preview)

product docs · source date 2026-07-14 · 0 comments · original
productionprompt optimizationmonitoringgovernance

1. Problems / challenges / motivations - Optimization research assumes someone will wire traces, evals, candidate generation, and deployment together by hand. - Enterprises will not run a self-improvement loop without lineage, diffs, and rollback. - Production traces are the best optimization signal available and usually go unused. 2. Key ideas - A managed...