Semantic caching
Concept
Semantic caching returns a stored LLM response for prompts that are similar in meaning to an earlier prompt, avoiding a new model call. Azure API Management offers semantic cache lookup and store policies for Azure OpenAI APIs.
| Tipo | Concept |
|---|---|
| Documentação | learn.microsoft.com/en-us/azure/api-management/azure-openai-enable-semantic-caching |
Articles about Semantic caching (4)
- Desvendando os custos ocultos do Azure AI: contexto, raciocínio e autonomia
· Mirko Peters
Bem-vindo ao nosso mergulho profundo nas realidades financeiras e estruturais de implantar cargas de trabalho inteligentes na nuvem corporativa. Se você vem experimentando… - Desbloqueando os impostos ocultos: contexto, raciocínio e autonomia em agentes de IA do Azure
· Mirko Peters
Bem-vindo de volta ao blog complementar do podcast! Hoje, vamos aprofundar um tema que tem tirado o sono de arquitetos de nuvem, profissionais de FinOps e líderes de TI ni… - Unlocking Hidden Costs in Azure AI: Context, Reasoning, and Autonomy
· Mirko Peters
Welcome to our deep dive into the financial and structural realities of deploying intelligent workloads in the enterprise cloud. If you have been experimenting with… - Unlocking Hidden Taxes: Context, Reasoning, and Autonomy in Azure AI Agents
· Mirko Peters
Welcome back to the podcast companion blog! Today, we are expanding on a topic that has been keeping cloud architects, FinOps professionals, and IT leaders up at ni…
Community wiki
Short info above, community knowledge below: add practical tips, examples or corrections. New contributions are reviewed first; trusted members publish directly.
Especialistas e empresas para este tópico
Ninguém indicou ainda este tópico. Adicione-o ao seu perfil.
Sources
- Documentation: learn.microsoft.com/en-us/azure/api-management/azure-openai-enable-semantic-caching
- Feed for this topic (RSS): entity/semantic-caching/feed.xml
- Articles on this topic: 4
Maintained by Mirko Peters (Microsoft MVP) · Last updated: