M365Con 2027 – bezpłatna konferencja online · 11–22 Jan 2027 · 120 sessions→ m365con.net

Semantic caching

Concept

Semantic caching returns a stored LLM response for prompts that are similar in meaning to an earlier prompt, avoiding a new model call. Azure API Management offers semantic cache lookup and store policies for Azure OpenAI APIs.

✦ CONCEPTSemantic cachingM365.FM
Title graphic: Semantic caching (Concept)
TypConcept
Dokumentacjalearn.microsoft.com/en-us/azure/api-management/azure-openai-enable-semantic-caching

Articles about Semantic caching (4)

Słownik

Community wiki

Short info above, community knowledge below: add practical tips, examples or corrections. New contributions are reviewed first; trusted members publish directly.

Eksperci i firmy w tym temacie

Nikt jeszcze nie wskazał tego tematu. Dodaj go do swojego profilu.

Sources

Maintained by Mirko Peters (Microsoft MVP) · Last updated: