LLMLingua
Product
LLMLingua adalah keluarga metode kompresi prompt dari Microsoft Research yang menghapus token kurang penting dari prompt sehingga model bahasa besar dapat bekerja dengan input yang lebih pendek dan lebih hemat biaya.
Short description written with AI from the facts on this page. You can improve it with the edit button below.
Juga dibahas
Episode tentang LLMLingua itu juga membahas Model router (Microsoft Foundry), Pay-as-you-go pricing, Provisioned throughput units (PTU), Semantic caching, Chargeback, dan Microsoft Cost Management.
| Type | Product |
|---|
Community wiki
Short info above, community knowledge below: add practical tips, examples or corrections. New contributions are reviewed first; trusted members publish directly.
Experts and companies for this topic
Nobody has listed this topic yet. Add it to your profile.
Sources
- LLMLingua di microsoft.com microsoft.com
- LLMLingua series (Microsoft Research) microsoft.com
Maintained by Mirko Peters (Microsoft MVP) · Last updated: