Publications

2026

  1. Spinning Straw into Gold: Relabeling LLM Agent Trajectories in Hindsight for Successful Demonstrations
    Zichao Li, Gang Wu, Zichao Wang, Ruiyi Zhang, Wanrong Zhu, Ryan A. Rossi, Vlad I Morariu, Jihyung Kil
    ICLR 2026
    paper
  2. GUI-AIMA: Aligning Intrinsic Multimodal Attention with a Context Anchor for GUI Grounding
    Shijie Zhou, Viet Dac Lai, Hao Tan, Jihyung Kil, Wanrong Zhu, Changyou Chen, Ruiyi Zhang
    ECCV 2026
    paper / website
  3. Text-Conditioned Background Generation for Editable Multi-Layer Documents
    Taewon Kang, Chris Tensmeyer, Jihyung Kil, Wanrong Zhu, Ming C Lin, Vlad I Morariu
    ECCV 2026
    paper
  4. Unveiling Inherent Visual Grounding in Multimodal LLMs for Text-Rich Images
    Shijie Zhou, Jihyung Kil, Ming Li, Jiuxiang Gu, Curtis Wigington, Rajiv Jain, Changyou Chen, Ruiyi Zhang
    ACL 2026
  5. DocPrune:Efficient Document Question Answering via Background, Question, and Comprehension-aware Token Pruning
    Joonmyung Choi, Sanghyeok Lee, Jongha Kim, Sehyung Kim, Dohwan Ko, Jihyung Kil, Hyunwoo J. Kim
    CVPR 2026
    paper
  6. AVA-Bench: Atomic Visual Ability Benchmark for Vision Foundation Models
    Zheda Mai, Arpita Chowdhury, Zihe Wang, Sooyoung Jeon, Lemeng Wang, Jiacheng Hou, Jihyung Kil, Wei-Lun Chao
    CVPR 2026
    paper

2025

  1. VisR-Bench: An Empirical Study on Visual Retrieval-Augmented Generation for Multilingual Long Document Understanding
    Jian Chen, Ming Li, Jihyung Kil, Chenguang Wang, Tong Yu, Ryan Rossi, Tianyi Zhou, Changyou Chen, Ruiyi Zhang
    arXiv 2025
    paper
  2. Representation Shift: Unifying Token Compression with FlashAttention
    Joonmyung Choi*, Sanghyeok Lee*, Byungoh Ko, Eunseo Kim, Jihyung Kil, Hyunwoo J. Kim
    ICCV 2025
  3. GUI Agents: A Survey
    Dang Nguyen, Jian Chen, Yu Wang, Gang Wu, Namyong Park, Zhengmian Hu, Hanjia Lyu, Junda Wu, others
    ACL 2025
    paper

2024

  1. MLLM-CompBench: A Comparative Reasoning Benchmark for Multimodal LLMs
    Jihyung Kil*, Zheda Mai*, Justin Lee, Zihe Wang, Kerrie Cheng, Lemeng Wang, Ye Liu, Arpita Chowdhury, Wei-Lun Chao
    NeurIPS 2024
    paper / code / website
  2. ARES: Alternating Reinforcement Learning and Supervised Fine-Tuning for Enhanced Multi-Modal Chain-of-Thought Reasoning Through Diverse AI Feedback
    Ju-Seung Byun*, Jiyun Chun*, Jihyung Kil, Andrew Perrault
    EMNLP 2024
    paper / code
  3. II-MMR: Identifying and Improving Multi-modal Multi-hop Reasoning in Visual Question Answering
    Jihyung Kil, Farideh Tavazoee, Dongyeop Kang, Joo-Kyung Kim
    ACL 2024
    paper
  4. GPT-4V(ision) is a Generalist Web Agent, if Grounded
    Boyuan Zheng, Boyu Gou, Jihyung Kil, Huan Sun, Yu Su
    ICML 2024
    paper / code / website
  5. Dual-View Visual Contextualization for Web Navigation
    Jihyung Kil, Chan Hee Song, Boyuan Zheng, Xiang Deng, Yu Su, Wei-Lun Chao
    CVPR 2024
    paper / poster

2023

  1. PreSTU: Pre-Training for Scene-Text Understanding
    Jihyung Kil, Soravit Changpinyo, Xi Chen, Hexiang Hu, Sebastian Goodman, Wei-Lun Chao, Radu Soricut
    ICCV 2023
    paper / poster

2022

  1. One Step at a Time: Long-Horizon Vision-and-Language Navigation with Milestones
    Chan Hee Song, Jihyung Kil, Tai-Yu Pan, Brian M Sadler, Wei-Lun Chao, Yu Su
    CVPR 2022
    paper / code / poster

2021

  1. Discovering the Unknown Knowns: Turning Implicit Knowledge in the Dataset into Explicit Training Examples for Visual Question Answering
    Jihyung Kil, Cheng Zhang, Dong Xuan, Wei-Lun Chao
    EMNLP 2021
    paper / code / poster
  2. Revisiting Document Representations for Large-Scale Zero-Shot Learning
    Jihyung Kil, Wei-Lun Chao
    NAACL 2021
    paper / code / poster