· Prompt Engineering
LLM Prompt Compression: LLMLingua, GIST Tokens, and the Path to 480x Compression
A practitioner's guide to LLM prompt compression: LLMLingua, GIST Tokens, 500xCompressor, KV-cache methods, and the rate-distortion limits of compressing context.