task · first seen 4 Oct 2026
GUI visual grounding
Also: UI grounding, GUI grounding
Mapping natural language instructions to target locations on graphical user interface screenshots.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Recurrent Latent Visual Search for GUI GroundingPapers · 4 Oct 2026 · Kaiyu Wu, Beichen Zheng, Weiyao Huang, Keze Wang
- Decoupling What from Where: How Should a Small GUI Grounding Model Receive the Action Type?Papers · 5 Oct 2026 · Aadi Chauhan, Arthur Ilyasov
- ConClick: Element-Wise Contrastive Learning Improves GUI GroundingPapers · 9 Oct 2026 · Ruotian Zhang, Yuhui Zhang, Junzhe Huang, Yu Xin, Hehe Fan, Xiaoxiao Sun
- Seg2Click: Learning Pixel-Level Action Masks for GUI Visual GroundingPapers · 12 Oct 2026 · Jingchao Wang, Dingjiang Huang
- MHVF: Training-Free GUI Grounding via Verification-Guided Multi-Hypothesis SearchPapers · 13 Oct 2026 · Minghua Chen, Xingming Liao, Weiqiang Zhong, Zhuowei Wang
- GroundGUI: GUI Grounding by High-Quality Data and Distillation-to-Reinforcement LearningPapers · 13 Oct 2026 · Qingsong Xie, Jiahao Tian, Jiacheng Tang, Zhifeng Li, Madalina Ciobanu, Navan Pr…
Latest sources
- Rank, Don't Regress: A 279M Text Ranker Beats 2B and 7B VLMs on Referential Urdu GUI GroundingPapers · 15 Nov 2026 · Hamza Raziq Khan, Aimal Khan
- GroundCascade: Selective Second Opinions for GUI GroundingPapers · 9 Nov 2026 · Adrian Phoulady, Hady Ahmady Phoulady
- T2T Technical Report: Synthesizing GUI Agent Trajectories at Scale from Video TutorialsPapers · 8 Nov 2026 · Qingsong Xie, Yanlin Fei, Nazhou Liu, Jiacheng Tang, Madalina Ciobanu, Navan Pre…
- BiGrounder: Bidirectional Training Unlocks the Potential of GUI GroundingPapers · 5 Nov 2026 · Dengyao Shi, Tianyu Fu, Fei Hu, Anyang Su, Hanning Wang, Shuo Wang, Minghui Wu,…
- OmniAI-Lab-CUHKSZ/Awesome-GUI-GroundingCode · 31 Oct 2026 · OmniAI-Lab-CUHKSZ · 26 stars
- Learning to Look Beyond Screens: Transferable Visual Observation from GUI GroundingPapers · 27 Oct 2026 · Ruilin Yao, Xinyu Qiu, Tianyu Zou, Yi Rong, Shengwu Xiong, Shuheng Shen, Changhu…
- AdaGround: Token-Normalized Adaptive Zooming with Verifier-in-the-Loop Refinement for GUI GroundingPapers · 27 Oct 2026 · Bingchao Wang, Yongcheng Jing, Chengyu Wang, Jun Huang, Jie Yang, Wei Liu, Dache…
- Right Click, Wrong Box: Grading GUI Grounding by What a Click DoesPapers · 27 Oct 2026 · Xiaokang Yuan, Binhui Yao, Luwei Yang, Ruimin Chen, Zeng Wang
- PreView: Enhancing GUI Grounding with Preprocessed Views and CuesPapers · 24 Oct 2026 · Wenjun Hou, Kaishuai Xu
- IGG: A Benchmark for Interactive GUI Grounding under Visibility ConstraintsPapers · 23 Oct 2026 · Kyeongseon Kim, Jiyeon Son, Tae-Hyun Oh
- PointerBench: A Diagnostic Benchmark for Fine-Grained GUI GroundingPapers · 22 Oct 2026 · Valentino Sacco, Saurabh Pandey, Alexander Florian Jercher, Maximilian Schilling
- From Seeing to Reporting: A Theory of Reliable Visual Set Generation in Vision-Language ModelsPapers · 18 Oct 2026 · Junzhe Shi, Yuan Gan, Shida Jiang