AI evaluation
Concept
The practice of systematically testing and measuring the outputs and decisions of AI models and agents, for example correctness, groundedness or orchestration quality, before and during production use.
| Type | Concept |
|---|
Articles about AI evaluation (2)
- 반복 가능한 방식으로 AI 에이전트와 Copilot 확장 기능을 테스트하는 방법
· Mirko Peters
반복 가능한 방식으로 AI 에이전트를 테스트하는 방법: 테스트 세트를 구성하고, 채점 기준(그레이더)을 고르고, 도구 호출을 평가하고, 회귀를 추적합니다. QA 리드를 위한 Copilot Studio 예시를 포함합니다. - How to test AI agents and Copilot extensions in a repeatable way
· Mirko Peters
How to test AI agents in a repeatable way: build a test set, pick graders, score tool calls and track regressions, with a Copilot Studio example for QA leads.
Community wiki
Short info above, community knowledge below: add practical tips, examples or corrections. New contributions are reviewed first; trusted members publish directly.
Experts and companies for this topic
- Mirko Peters · Microsoft MVP
Sources
- Feed for this topic (RSS): entity/ai-evaluation/feed.xml
- Articles on this topic: 2
Maintained by Mirko Peters (Microsoft MVP) · Last updated: