#LLM
4 items
Posts
· Prompt Engineering
Automated Prompt Optimization: From AutoPrompt (2020) to TextGrad (2024)
A chronological survey of automated prompt optimization 2020–2025: AutoPrompt, APE, OPRO, EvoPrompt, DSPy, TextGrad, PromptAgent, and how to choose between them.
· Prompt Engineering
LLM Prompt Compression: LLMLingua, GIST Tokens, and the Path to 480x Compression
A practitioner's guide to LLM prompt compression: LLMLingua, GIST Tokens, 500xCompressor, KV-cache methods, and the rate-distortion limits of compressing context.
· Prompt Engineering
Prompt Structuring Techniques: From Chain-of-Thought to the Instruction Hierarchy
A chronological survey of LLM prompt structuring: chain-of-thought, the instruction hierarchy, system prompt design, evaluation frameworks, and the theoretical foundations behind why prompts work.
· LLM Safety
LLM Safety Techniques: Constitutional AI, Harmony, SAIF, and Llama Guard Compared
A practitioner's survey of LLM safety techniques across OpenAI Harmony, Anthropic Constitutional AI, Google SAIF, Meta Llama Guard, and open-source RLHF frameworks.