Your daily digest
Research papers, made simple to understand
The AI and machine learning papers people are reading most, each one rewritten in plain words: the problem, the idea, what was found and why it matters.
- Reinforcement Learning & Alignment
- Language Models & Architectures
Fine-tuning GPT-3 with human feedback improves instruction following and truthfulness
InstructGPT models, fine-tuned from GPT-3 using human demonstrations and preference rankings via reinforcement learning, outperform much larger GPT-3 models in following instructions, truthfulness, and toxicity reduction on diverse tasks.
Paper: Training language models to follow instructions with human feedback · Long Ouyang, Jeff Wu, Xu Jiang and 17 others
Classic · 20226 min readRead the article
- Training & Efficiency
- Language Models & Architectures
LoRA enables efficient fine-tuning of large language models with minimal parameters and no inference latency
LoRA freezes pre-trained weights and trains low-rank update matrices, reducing trainable parameters by up to 10,000× on GPT-3 175B while matching or exceeding full fine-tuning performance on multiple models and tasks.
Paper: LoRA: Low-Rank Adaptation of Large Language Models · Edward J. Hu, Yelong Shen, Phillip Wallis and 5 others
Classic · 20216 min readRead the article
- Language Models & Architectures
- Training & Efficiency
Language model loss follows predictable power laws with size, data, and compute
This paper finds that Transformer language model performance on cross-entropy loss scales as power laws with model size, dataset size, and training compute, enabling optimal compute allocation by training large models on modest data and stopping early.
Paper: Scaling Laws for Neural Language Models · Jared Kaplan, Sam McCandlish, Tom Henighan and 7 others
Classic · 20206 min readRead the article
Browse earlier papers
27 days of papers in October 2026
- Chain-of-thought prompting improves reasoning in large language modelsand 2 more papers
- Intrinsic Distribution Matching improves one-step text-to-image generation with feature moment constraintsand 2 more papers
- Falcon enables efficient, real-time audio-visual target speaker extraction in complex scenesand 2 more papers
- Capability-driven recursive self-improvement evolves specialized multimodal agent modulesand 2 more papers
- Trajectory2Gym improves tool-use agents by synthesizing and grounding compositional interactionsand 2 more papers
- Survey unifies video understanding and generation via world modeling frameworkand 2 more papers
- Fine-tuning GPT-3 with human feedback improves instruction following and truthfulnessYou are reading this day
- Residual connections enable training of very deep neural networks with improved accuracyand 2 more papers
- WeVisOne-VL unifies object- and pixel-level vision-language tasks with structured token predictionand 2 more papers
- StreamEval benchmark measures interactive streaming video generation across five tasksand 2 more papers
- FocusGUI improves multi-step omni-modal GUI agents by dynamically prioritizing relevant inputsand 2 more papers
- Parameter-efficient fine-tuning scales large multimodal models for brain encodingand 2 more papers
- HexaShell uses coding agents with RGB triangulation to improve robot manipulation on RoboDojoand 2 more papers
- Two efficient models learn high-quality word vectors from huge text corporaand 2 more papers
- Transformer replaces recurrence with multi-head self-attention for faster, better translationand 2 more papers
- Waypoint-OPD improves RL policy transfer by gating shifts using intermediate checkpointsand 2 more papers
- ATAS framework improves spatial and temporal consistency in agentic video generationand 2 more papers
- Jeva architecture enables stable, scalable, and cacheable system one decisionsand 2 more papers
- GroundingPI improves precise visual grounding for physical intelligence tasksand 2 more papers
- DiffusionART stabilizes and speeds up reinforcement learning fine-tuning of diffusion modelsand 2 more papers
- LoGRA cuts LLM RL training memory up to 45.7% using low-rank gradient sketchesand 2 more papers
- UltraText Bench evaluates dense bilingual visual text rendering in image generationand 2 more papers
- AgentGarten enables evolving agents via code-driven worlds and neural renderingand 2 more papers
- STEPQuant reduces memory and preserves accuracy in low-bit quantization of recurrent statesand 2 more papers
- Compact strict alignment supervision outperforms broader coverage in cross-tokenizer distillationand 2 more papers
- Kandinsky 6.0 Video generates synchronized 5-second videos with 44 kHz audio using dual-stream diffusion modelsand 2 more papers
- RealCompanion benchmarks AI understanding of real long-term human conversationsand 2 more papers