The LoRA That Learned the Wrong Lesson: Fine-Tuning on Synthetic Papers
Phase 4: a LoRA on Qwen3.6-35B-A3B lifted synthetic-paper extraction from 90.0% to 94.6%, but real L4 went from 74.2% to 73.8%. It learned to answer more often, including where the answer key is empty.
