Professional Summary
Quang Nguyen (full name: Van-Quang Nguyen) is a postdoctoral researcher at RIKEN AIP in the Multimodal Visual Intelligence Team, under the supervision of Prof. Takayuki Okatani. His recent work centers on Multimodal Large Language Models for vision–language understanding and its applications (e.g., on autonomous driving, environmental intelligence). He has published in leading venues such as ECCV, CVPR, IJCAI, FG, CACIE, and TIV, with over 750 citations, and he mentors graduate students on doing research and building AI systems. He is driven by a commitment to translate scientific advances into practical technologies that enhance sustainability, efficiency, and accessibility. Please reach out for potential collaboration.
Education
Ph.D. in Information Sciences
Tohoku University
Master in Information Sciences
Tohoku University
Bachelor in Computer Science
Vietnam National University, UET
Interests
Large Language Models
Agentic Multimodal Large Language Models
Vision-language understanding
MLLMs applications (autonomous driving, environmental intelligence, etc)
Experience
Postdoctoral Researcher
RIKEN AIP, TokyoLead research on multimodal large language models for domain-specific perception, planning, and reasoning across robotics, traffic, and environmental intelligence.Machine Learning Research Intern
Preferred Networks, TokyoBuilt efficient end-to-end object tracking systems and collaborated with product teams on deployment.Machine Learning Engineer (Part-time)
Laboro.AI, TokyoDeveloped computer vision models for industrial clients; contributed to face detection and recognition products.Machine Learning Research Intern
Fujitsu, TokyoPrototyped LSTM-based question-answering systems for enterprise knowledge bases.
Education
Ph.D. in Information Sciences
Tohoku UniversityDean’s Award. Advisor: Prof. Takayuki OkataniMaster in Information Sciences
Tohoku UniversityGPA: 4.0/4.0. Advisor: Prof. Takeshi TokuyamaBachelor in Computer Science
Vietnam National University, UETHighest GPA of cohort (3.9/4.0). Advisor: Assoc. Prof. Ha Quang Thuy
Publications
(2025).
TB-Bench: Training and Testing Multi-Modal AI for Understanding Spatio-Temporal Traffic Behaviors from Dashcam Images/Videos.
CVPR 2025 Workshop on Autonomous Driving.
(2025).
Multimodal artificial intelligence approaches using large language models for expert-level landslide image analysis.
Computer-Aided Civil and Infrastructure Engineering (CACIE), 2025.
(2025).
Critical Scenario Prediction Planning and Reasoning.
In submission to IEEE Transactions on Intelligent Vehicles (TIV) 2025.
(2024).
KTVIC: A Vietnamese Image Captioning Dataset on the Life Domain.
ArXiv preprint, 2024.
(2024).
Exploring the Potential of Multi-Modal AI for Driving Hazard Prediction.
IEEE Transactions on Intelligent Vehicles (TIV), 2024.
(2023).
Visual Abductive Reasoning Meets Driving Hazard Prediction: Problem Formulation and Dataset.
ArXiv preprint, 2023.
(2023).
Leveraging Video Coding Knowledge for Deep Video Enhancement.
ArXiv preprint, 2023.
(2022).
GRIT: Faster and Better Image Captioning Transformer Using Dual Visual Features.
European Conference on Computer Vision (ECCV) 2022.
(2021).
Look Wide and Interpret Twice: Improving Performance on Interactive Instruction-following Tasks.
International Joint Conference on Artificial Intelligence (IJCAI) 2021.
(2020).
Efficient Attention Mechanism for Visual Dialog that can Handle All the Interactions between Multiple Inputs.
European Conference on Computer Vision (ECCV) 2020.
(2019).
CapsuleNet for Micro-expression Recognition.
IEEE International Conference on Automatic Face & Gesture Recognition (FG) 2019.
(2019).
Revisiting a Single-Stage Method for Face Detection.
IEEE International Conference on Automatic Face & Gesture Recognition (FG) 2019.
(2018).
A New Text Semi-supervised Multi-label Learning Model Based on Using the Label-Feature Relations.
International Conference on Computational Collective Intelligence (ICCI) 2018.
(2018).
A New Lifelong Topic Modeling Method and Its Application to Vietnamese Text Multi-label Classification.
Asian Conference on Intelligent Information and Database Systems (ACIIDS) 2018.
(2017).
A Semi-supervised Multi-label Classification Framework with Feature Reduction and Enrichment.
Journal of Information and Telecommunication (JIT), 2017.
(2017).
MASS: A Semi-supervised Multi-label Classification Algorithm with Specific Features.
Asian Conference on Intelligent Information and Database Systems (ACIIDS) 2017.
Awards
Dean’s Award for Excellent Achievements
Tohoku University ∙
March 2023
Recognized for outstanding Ph.D. research in multimodal AI
Best Presentation Award for Ph.D. Research
Tohoku University ∙
March 2022
Awarded for top Ph.D. research presentation in Information Sciences
Winner of Alfred Challenge
AllenAI & Google (ECCV 2020) ∙
August 2020
First place for interactive instruction-following agent competition at ECCV 2020
Honda YES Fellowship
Honda, Japan ∙
October 2019
Fellowship to Honda YES awardees who pursue studies in Japan
Japanese Government Scholarship for Ph.D. Course
MEXT, Japan ∙
October 2019
Full scholarship for Ph.D. studies in 2019-2022
Data Science Summer School Scholarship
Gottingen University ∙
August 2018
Selected to attend Data Science Summer School at Gottingen University, Germany
Honda Young Engineer Scientist Award
Honda Foundation ∙
December 2017
For top 10 engineering students in Vietnam.
Third Prize of National Scientific Student Research Conference
Vietnam ∙
October 2017
Recognized for outstanding research presentation at the national level
Japanese Government Scholarship for Master Course
MEXT, Japan ∙
October 2017
Full scholarship for Master’s studies in 2017-2019
Excellent Thesis Award
Vietnam National University (UET-VNU) ∙
June 2017
Best Bachelor’s thesis with highest score 10/10
First Prize of Scientific Student Research Conference
Vietnam ∙
January 2017
First place award for research presentation at the national conference
Excellent Student Award
Vietnam National University (UET-VNU) ∙
January 2017
Highest GPA among the K57 cohort
AmCham Scholarship
American Chamber and the US Embassy ∙
May 2017
Scholarship awarded by the American Chamber of Commerce and the US Embassy in Vietnam
Fostering ASEAN Future Leaders Scholarship
Korea ∙
September 2015
Fully funded scholarship for one-year exchange program in South Korea in 2015-2016
Machine Learning Summer School Scholarship
Kyoto University ∙
August 2015
Selected to attend Machine Learning Summer School at Kyoto University, Japan
Merit-based University Scholarships
UET-VNU ∙
January 2013
Received merit-based scholarships throughout undergraduate studies (2013-2017)
Shinnyo-en Scholarships
Japan ∙
November 2012
Awarded in 3 consecutive years (2013-2016) for academic excellence
Hoa Trang Nguyen Award
Vietnam ∙
October 2012
Prestigious award recognizing outstanding academic achievement
Second Highest Score in University Entrance Examination
Vietnam ∙
January 2012
Achieved the second highest score in the UET entrance examination
Merit-based New South Wales University Scholarship
Australia ∙
June 2012
Merit-based cholarship from University of New South Wales, Australia
First Prize of Vietnam National Chemistry Olympiad
Vietnam ∙
January 2012
First place in the National Chemistry Olympiad competition
Telecom Corporation Scholarship
Vietnam ∙
January 2012
Scholarship awarded by Vietnam Telecom Corporation for academic excellence
Odon Vallet Scholarship for Top High-School Students
Odon Vallet, France ∙
June 2011
Prestigious scholarship for top high-school students in Vietnam
Third Prize of National Chemistry Olympiad
Vietnam ∙
January 2011
Third place in the Vietnam National Chemistry Olympiad competition