Bezen

Your daily digest

Research papers, made simple to understand

The AI and machine learning papers people are reading most, each one rewritten in plain words: the problem, the idea, what was found and why it matters.

Multimodal & Vision10 papers, newest first

    • Multimodal & Vision

    WeVisOne-VL unifies object- and pixel-level vision-language tasks with structured token prediction

    WeVisOne-VL integrates a lightweight pixel decoder into a vision-language model, enabling unified object detection, referring localization, counting, OCR, segmentation, and matting. Trained with curriculum fine-tuning and reinforcement learning, it leads on over 30 benchmarks for both discrete and dense visual tasks.

    Paper: WeVisOne-VL: Unified Visual Perception from Objects to Pixels · Tianming Liang, Junyi Pan, Yuxi Li and 5 others

    223 upvotes on Hugging Face23 Oct 20266 min readRead the article

    • Multimodal & Vision
    • Image & Video Generation

    Factor-Aware Predictive Learning improves cinematic video generation using MLLM latents

    FAPL trains a Video Diffusion Transformer to effectively use multimodal large language model latents for temporal inference and factor-aware control, achieving better action sequencing, camera fidelity, and factor-specific editing on cinematic video tasks.

    Paper: Making MLLM Latents Matter: Factor-Aware Predictive Learning for Cinematic Video Generation · Songlin Yang, Zhe Wang, Xiaotong Zhao and 8 others

    165 upvotes on Hugging Face23 Oct 20266 min readRead the article

    • AI Agents
    • Multimodal & Vision

    SpatialScout benchmark tests VLM agents on active 3D object mapping in indoor scenes

    SpatialScout evaluates vision-language models on autonomous exploration and 3D object localization in 80 indoor scenes with 3,140 targets. The best model achieves 41.71% mean IoU, revealing challenges in precise, complete metric mapping through active perception.

    Paper: SpatialScout: Can VLM Agents Actively Explore and Map 3D Scenes? · Zhaoxi Zhang, Hao Liang, Linxuan Wu and 7 others

    129 upvotes on Hugging Face22 Oct 20266 min readRead the article

    • AI Agents
    • Multimodal & Vision

    FocusGUI improves multi-step omni-modal GUI agents by dynamically prioritizing relevant inputs

    FocusGUI addresses Sequential Distraction in omni-modal GUI agents by adaptively compressing relevant perceptual channels into a compact latent injected into a frozen decoder, improving Type Match by +33.2 points and Exact Match by 3× over frozen backbones across four models.

    Paper: Focused Omni-Modal GUI Agents · Fuyao Zhang, Wenwen He, Jiaming Zhang and 6 others

    225 upvotes on Hugging Face21 Oct 20266 min readRead the article

    • AI Agents
    • Multimodal & Vision

    Matrix-Game 4.0 enables real-time playable game worlds with video model rendering

    Matrix-Game 4.0 separates game logic from visual generation using a lightweight engine, a coding agent, and an autoregressive video model, achieving 480p 60 FPS gameplay with 112 ms latency on a single RTX 5090 GPU.

    Paper: Matrix-Game 4.0: Harnessing Video Models for Real-Time Playable Game Worlds · Jihai Zhang, Runjia Qian, Kaiqin Kong and 15 others

    182 upvotes on Hugging Face21 Oct 20266 min readRead the article

    • Multimodal & Vision
    • Training & Efficiency

    Parameter-efficient fine-tuning scales large multimodal models for brain encoding

    This paper shows that low-rank adapters (LoRA) enable efficient fine-tuning of very large pretrained multimodal models (up to 104B parameters) for predicting fMRI brain responses, improving performance and interpretability while reducing training cost by 350×.

    Paper: Scaling Parameter-Efficient Fine-Tuning for Brain Encoding · Zhuofan Josh Ying, Guanglong Sun, Nolan Ho and 6 others

    234 upvotes on Hugging Face20 Oct 20266 min readRead the article

    • Multimodal & Vision
    • Benchmarks & Evaluation

    OmniCompass benchmark evaluates multimodal video grounding and understanding comprehensively

    OmniCompass introduces paired text and text+image target specifications across vision-language and audio-visual tracks, assessing temporal grounding, spatial grounding, and question answering on 820 videos, revealing gaps in grounding, audio-visual integration, and cross-specification consistency.

    Paper: OmniCompass: A Holistic Benchmark for Omni-Modal Video Grounding and Understanding · Xuyang Liu, Shihao Wang, Xinyu Wei and 5 others

    567 upvotes on Hugging Face16 Oct 20266 min readRead the article

    • AI Agents
    • Multimodal & Vision

    VideoJev unifies video event localization and QA with efficient direct scoring

    VideoJev adapts pretrained multimodal LLMs to directly score temporal intervals and answer options for video understanding, improving accuracy by up to 10.8 mIoU points and speeding inference up to 100× on multiple benchmarks.

    Paper: VideoJev: System One Model for Video Understanding and Interaction · Yuhan Zhu, Xiangyu Zeng, Qingyi Si and 15 others

    196 upvotes on Hugging Face14 Oct 20267 min readRead the article

    • Multimodal & Vision
    • Robotics & Physical AI

    GroundingPI improves precise visual grounding for physical intelligence tasks

    GroundingPI is a 4B-parameter foundation model that generates quantized points and boxes for precise visual grounding, achieving state-of-the-art results on 34 benchmarks and improving robotic manipulation and autonomous driving performance.

    Paper: GroundingPI: A Grounding Foundation Model towards Physical Intelligence with Visual Primitives · Qize Yu, Lianrui Fan, Boyu Chen and 23 others

    247 upvotes on Hugging Face13 Oct 20266 min readRead the article

    • Multimodal & Vision

    S-Space reveals an internal spatial coordinate system in multimodal language models

    This paper discovers S-Space, a three-dimensional linear subspace encoding object locations in multimodal language models, enabling accurate spatial reasoning and diagnosis of viewpoint transformation failures, with causal evidence and generalization across tasks.

    Paper: S-Space: Exploring Spatial Workspace in Multimodal Language Models · Zhiyuan Shi, Xiang Li, Xingzhuo Guo and 8 others

    202 upvotes on Hugging Face12 Oct 20265 min readRead the article