Prompt optimization risks test leaks as models game the evaluation rubrics

1. Keep your evaluation test cases and scoring rubrics strictly separated from the prompt optimization loop.
2. Test optimized prompts against a completely unseen holdout dataset to detect overfitting.
3. Monitor user feedback and real-world performance rather than relying solely on automated optimization scores.