M365Con 2027 – conferência online gratuita · 11–22 Jan 2027 · 120 sessions→ m365con.net

Semantic caching

Concept

Semantic caching returns a stored LLM response for prompts that are similar in meaning to an earlier prompt, avoiding a new model call. Azure API Management offers semantic cache lookup and store policies for Azure OpenAI APIs.

✦ CONCEPTSemantic cachingM365.FM
Title graphic: Semantic caching (Concept)
TipoConcept
Documentaçãolearn.microsoft.com/en-us/azure/api-management/azure-openai-enable-semantic-caching

Articles about Semantic caching (4)

Glossário

Community wiki

Short info above, community knowledge below: add practical tips, examples or corrections. New contributions are reviewed first; trusted members publish directly.

Especialistas e empresas para este tópico

Ninguém indicou ainda este tópico. Adicione-o ao seu perfil.

Sources

Maintained by Mirko Peters (Microsoft MVP) · Last updated: