AI evaluation
Concept
The practice of systematically testing and measuring the outputs and decisions of AI models and agents, for example correctness, groundedness or orchestration quality, before and during production use.
| Type | Concept |
|---|
Articles about AI evaluation (2)
- AI エージェントと Copilot 拡張機能を再現性のある方法でテストする方法
· Mirko Peters
AI エージェントを再現性のある方法でテストする方法を解説します。テストセットの作成、評価基準(グレーダー)の選定、ツール呼び出しの採点、回帰の追跡を取り上げ、QA リードのための Copilot Studio の例も紹介します。 - How to test AI agents and Copilot extensions in a repeatable way
· Mirko Peters
How to test AI agents in a repeatable way: build a test set, pick graders, score tool calls and track regressions, with a Copilot Studio example for QA leads.
Community wiki
Short info above, community knowledge below: add practical tips, examples or corrections. New contributions are reviewed first; trusted members publish directly.
Experts and companies for this topic
- Mirko Peters · Microsoft MVP
Sources
- Feed for this topic (RSS): entity/ai-evaluation/feed.xml
- Articles on this topic: 2
Maintained by Mirko Peters (Microsoft MVP) · Last updated: