Llm

LLMs

LLM judges favor first of two options, cited 2023 study says, so swap order

LLM Inference

AIPerf tool benchmarks LLM inference performance at scale

Prompt Engineering

Developer shrinks system prompt from 4,000 to 300 tokens using Synap