Llms

AI software factory

My AI Dark Factory Dream Is Dead (Here's What Actually Works)

LLMs

LLM judges favor first of two options, cited 2023 study says, so swap order

Study finds LLM reasoning uses 3.7× more inference energy on average: A study measured inference energy for 86 open-weight LLM checkpoints across seven benchmarks and six hardware platforms. Most configurations used a median 2.6–4.8× more energy than another configuration scoring at least as well, with gaps up to 27×; reasoning raised energy about 3.7× on average.

AI Research • arXiv