Your daily digest

Research papers, made simple to understand

The AI and machine learning papers people are reading most, each one rewritten in plain words: the problem, the idea, what was found and why it matters.

Older

Saturday, 17 October 2026Weekend classics: the landmark papers behind today’s AI

Newer
    • Language Models & Architectures

    Transformer replaces recurrence with multi-head self-attention for faster, better translation

    The Transformer model uses only attention mechanisms, no recurrence or convolution, achieving state-of-the-art BLEU scores on WMT 2014 English-German (28.4) and English-French (41.8) tasks with significantly less training time and cost.

    Paper: Attention Is All You Need · Ashish Vaswani, Noam Shazeer, Niki Parmar and 5 others

    Classic · 20176 min readRead the article

    • Language Models & Architectures

    BERT pre-trains deep bidirectional Transformers for versatile NLP tasks

    BERT introduces masked language modeling and next sentence prediction to pre-train deep bidirectional Transformer encoders, achieving state-of-the-art results on 11 NLP benchmarks including GLUE, SQuAD v1.1 and v2.0, with minimal task-specific changes.

    Paper: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding · Jacob Devlin, Ming-Wei Chang, Kenton Lee and 1 other

    Classic · 20186 min readRead the article

    • Language Models & Architectures

    Scaling up GPT-3 enables strong few-shot NLP task performance without fine-tuning

    GPT-3, a 175B parameter autoregressive language model, achieves competitive few-shot learning on diverse NLP tasks by conditioning on task demonstrations in text, without any gradient updates or fine-tuning, showing smooth performance gains with scale.

    Paper: Language Models are Few-Shot Learners · Tom B. Brown, Benjamin Mann, Nick Ryder and 28 others

    Classic · 20206 min readRead the article

Browse earlier papers

19 days of papers in October 2026

October 2026
12345678910111213141516171819202122232425262728293031

Has papersYou are reading

  1. WeVisOne-VL unifies object- and pixel-level vision-language tasks with structured token predictionand 2 more papers
  2. StreamEval benchmark measures interactive streaming video generation across five tasksand 2 more papers
  3. FocusGUI improves multi-step omni-modal GUI agents by dynamically prioritizing relevant inputsand 2 more papers
  4. Parameter-efficient fine-tuning scales large multimodal models for brain encodingand 2 more papers
  5. HexaShell uses coding agents with RGB triangulation to improve robot manipulation on RoboDojoand 2 more papers
  6. Two efficient models learn high-quality word vectors from huge text corporaand 2 more papers
  7. Transformer replaces recurrence with multi-head self-attention for faster, better translationYou are reading this day
  8. Waypoint-OPD improves RL policy transfer by gating shifts using intermediate checkpointsand 2 more papers
  9. ATAS framework improves spatial and temporal consistency in agentic video generationand 2 more papers
  10. Jeva architecture enables stable, scalable, and cacheable system one decisionsand 2 more papers
  11. GroundingPI improves precise visual grounding for physical intelligence tasksand 2 more papers
  12. DiffusionART stabilizes and speeds up reinforcement learning fine-tuning of diffusion modelsand 2 more papers
  13. LoGRA cuts LLM RL training memory up to 45.7% using low-rank gradient sketchesand 2 more papers
  14. UltraText Bench evaluates dense bilingual visual text rendering in image generationand 2 more papers
  15. AgentGarten enables evolving agents via code-driven worlds and neural renderingand 2 more papers
  16. STEPQuant reduces memory and preserves accuracy in low-bit quantization of recurrent statesand 2 more papers
  17. Compact strict alignment supervision outperforms broader coverage in cross-tokenizer distillationand 2 more papers
  18. Kandinsky 6.0 Video generates synchronized 5-second videos with 44 kHz audio using dual-stream diffusion modelsand 2 more papers
  19. RealCompanion benchmarks AI understanding of real long-term human conversationsand 2 more papers