Your daily digest
Research papers, made simple to understand
The AI and machine learning papers people are reading most, each one rewritten in plain words: the problem, the idea, what was found and why it matters.
- Training & Efficiency
Compact strict alignment supervision outperforms broader coverage in cross-tokenizer distillation
This paper shows that in on-policy distillation between models with different tokenizers, focusing supervision on strictly aligned token positions with a small shared vocabulary subset retains most learning benefits, while adding broader span supervision reduces accuracy.
Paper: Rethinking Cross-Tokenizer On-Policy Distillation: From Alignment Coverage to Supervision Reliability · Bingxi Hou, Guochao Jiang, Guofeng Quan and 4 others
156 upvotes on Hugging Face7 min readRead the article
- Reinforcement Learning & Alignment
- Training & Efficiency
TRACE reduces train-rollout quantization mismatch for efficient FP4 RL training of MoE LLMs
TRACE aligns FP4 quantization between training and rollout in reinforcement learning of Mixture-of-Experts language models, achieving BF16-level performance with up to 5.4× rollout speedup and reduced memory overhead.
Paper: TRACE: Rollout-Guided Quantization-Aware Training for FP4 Reinforcement Learning of MoE Language Models · Xin Wang, Hao Yu, Zhengyang Zhuge and 9 others
75 upvotes on Hugging Face6 min readRead the article
- Image & Video Generation
DuoMatching improves few-step video generation by combining joint and marginal distribution matching
DuoMatching enhances few-step video generation by jointly matching video-level and frame-level distributions using a video teacher and an image teacher, improving visual quality and semantic alignment while preserving motion dynamics, with human preference rates above 80%.
Paper: DuoMatching: Joint-Marginal Distribution Matching for Few-Step Video Generation · Jiahao Zhan, Yan Wang, Yongrui Ma and 5 others
70 upvotes on Hugging Face7 min readRead the article
Browse earlier papers
19 days of papers in October 2026
- WeVisOne-VL unifies object- and pixel-level vision-language tasks with structured token predictionand 2 more papers
- StreamEval benchmark measures interactive streaming video generation across five tasksand 2 more papers
- FocusGUI improves multi-step omni-modal GUI agents by dynamically prioritizing relevant inputsand 2 more papers
- Parameter-efficient fine-tuning scales large multimodal models for brain encodingand 2 more papers
- HexaShell uses coding agents with RGB triangulation to improve robot manipulation on RoboDojoand 2 more papers
- Two efficient models learn high-quality word vectors from huge text corporaand 2 more papers
- Transformer replaces recurrence with multi-head self-attention for faster, better translationand 2 more papers
- Waypoint-OPD improves RL policy transfer by gating shifts using intermediate checkpointsand 2 more papers
- ATAS framework improves spatial and temporal consistency in agentic video generationand 2 more papers
- Jeva architecture enables stable, scalable, and cacheable system one decisionsand 2 more papers
- GroundingPI improves precise visual grounding for physical intelligence tasksand 2 more papers
- DiffusionART stabilizes and speeds up reinforcement learning fine-tuning of diffusion modelsand 2 more papers
- LoGRA cuts LLM RL training memory up to 45.7% using low-rank gradient sketchesand 2 more papers
- UltraText Bench evaluates dense bilingual visual text rendering in image generationand 2 more papers
- AgentGarten enables evolving agents via code-driven worlds and neural renderingand 2 more papers
- STEPQuant reduces memory and preserves accuracy in low-bit quantization of recurrent statesand 2 more papers
- Compact strict alignment supervision outperforms broader coverage in cross-tokenizer distillationYou are reading this day
- Kandinsky 6.0 Video generates synchronized 5-second videos with 44 kHz audio using dual-stream diffusion modelsand 2 more papers
- RealCompanion benchmarks AI understanding of real long-term human conversationsand 2 more papers