Inference Optimization

Technology

• New inference-time method reduces hallucinations in OpenAI's Whisper: Researchers have developed a training-free, inference-time method to reduce hallucinated transcripts in OpenAI's Whisper model. The approach estimates a compact hallucination-associated subspace from non-speech calibration data and projects decoder hidden states away from it.

  AI Research • arXiv

  Permalink