16.2%
of correct answers flipped
Qwen2.5-7B · GSM8K · n=1319
Qwen (75%)
Llama-3.1 (23%)
Llama-2 (16%)
Mistral (7%)