APEX Group

Augmenting People via Empowering X (perception, mobility, cognition, social and emotional needs)

About Us

Augmenting People by Empowering X (APEX) Group at the Hong Kong University of Science and Technology (Guangzhou) is dedicated to designing and developing intelligent interactive computing technologies to empower people in overcoming physical, cognitive, as well as emotional and social challenges. APEX group members (APEXers) leverage methods from computer science, AI, engineering, interaction design, human factor, psychology, and more to invent such empowering technologies in two primary research directions are

  • Proactive Healthy Aging Interactive Technologies: Multi-sensory immersive interaction techniques for physical exercise, cognitive training, and emotional wellbeing for older adults.
  • Intelligent Empowering Technologies for New AI-Era Learning Paradigms: Intelligent interactive systems to enhance critical thinking, creativity, and collaboration skills in the AI era.

Founded and led by Prof. Mingming Fan, APEX group has published over 100 scientific papers in leading international journals and conferences primarily in the field of Human-Computer Interaction (HCI), including more than 80 A-ranked publications according to China Computer Federation (CCF) recommendations (generally recognized top-tier venues). The group has received ten international paper awards, including five Best Paper or Honorable Mention Awards from CHI (a premier HCI conference), a UbiComp Best Paper Honorable Mention Award, an ACM Multimedia Best Paper Honorable Mention Award among others. APEX group's research is generously supported by both government and industrial grants.

Prof. Fan has graduated four PhD students and over twenty MPhil students. Currently, APEX group consists of over 20 PhD and MPhil students, who are actively inventing, deploying, and testing empowering technologies.

Team

Prof. Mingming Fan, Director

Associate Professor, Computational Media and Arts Thrust and Internet of Things Thrust, HKUST (GZ)

He leads Augmenting People via Empowering X (APEX) Group to conduct Human-Computer Interaction (HCI) research by exploring the design principles, interaction techniques and applications of Accessibile Computing, Human-AI Interaction and VR/AR/MR, in particular for addressing aging, accessibility, and education/learning challenges.

Recent News

  • Sept, 2025: Two papers accepted at IMWUT 2025. Congrats to Fan, Peixuan, and their co-authors!
  • Sept, 2025: One paper accepted at ASSETS 2025. Congrats to Shumeng, and co-authors!
  • Aug, 2025: Prof. Fan was invited to give a talk at the ROP project kickoff meeting and received the Best Presentation Award. [link]
  • Aug, 2025: One art paper accepted at Siggraph Asia 2025 Art track. Congrats to Shumeng!
  • July, 2025: One paper accepted at IMWUT 2025. Congrats to Ruohao, and co-authors!

Research Directions

Step 1
01

Proactive Healthy Aging Interactive Technologies

Targeting proactive health management and longevity goals for older adults, we invent multi-sensory immersive intelligent interaction techniques to empower them to better perform physical exercises and cognitive wellness training at home or within their communities. Concurrently, we also invent novel intelligent interaction technologies to help older adults manage emotional wellbeing and address social isolation.

Accessibility Tools
User-Centered Design
Independent Living
Step 2
02

Intelligent Empowering Technologies for New AI-Era Learning Paradigms

Against the backdrop of Artificial Intelligence's impact on education and workplaces, we invent intelligent interactive technologies aimed at enhancing people's transferable skills, such as critical thinking, creativity, and team collaboration.

AI Interaction
Collaborative Systems
Scientific Studies

Research Focus Areas

Perception

Mobility

Cognition

Social

Emotional Needs

Education

Awards

Our research excellence recognized by top international conferences

Best Paper Honorable Mention Award

ACM MM 2024

Invented a VR-Mediated Cognitive Defusion for Managing Negative Thoughts

Best Paper Honorable Mention Award

CHI 2024

Invented a novel electrotactile wearable on fingertip edges to help Blind and Low Vision (BLV) People comprehend charts

Best Paper Honorable Mention Award

CHI 2024

Designed an AI- and AR-powered app to assist BLV People to use digital-screen parcel lockers

Best Paper Honorable Mention Award

CHI 2024

Promoting traditional Chinese cultural heritage by assisting traditional Chinese opera (Xiqu) performers

Best Paper Honorable Mention Award

CHI 2023

Invented a novel voice-accompanying hand-to-face gesture interaction technique

Best Paper Honorable Mention Award

Chinese CHI 2023

Invented an AR-based approach to help with the learning of Chinese traditional opera (Xiqu) makeup

Best Paper Honorable Mention Award

Chinese CHI 2022

A systematic review of communication in immersive social Virtual Reality (VR)

Best Artifact Award

ASSETS 2020

Invented a novel eyelid gesture interaction for people with motor impairments to use touchscreen without touch

Best Paper Award

CHI 2019

Investigated how livestreamers utilize streaming to promote traditional Chinese heritage

Best Paper Honorable Mention Award

UbiComp 2015

Invented a novel active acoustic sensing IoT technique for monitoring content level in a container

Portfolio

Our latest research projects and innovative solutions

  • All
  • VR/AR
  • Accessibility
  • AI/AR
  • Culture
  • Gesture
BCI VR Motor Imagery
VR/AR Research

BCI VR Motor Imagery

Brain-Computer Interface VR system for motor imagery training and rehabilitation applications.

BargeIn Interaction
Accessibility

BargeIn Interaction

Novel interaction technique for accessible communication and interruption handling in digital environments.

FloraJing AI Assistant
AI/AR Integration

FloraJing AI Assistant

AI-powered assistant for plant care and gardening guidance using computer vision and natural language processing.

Remote Chess
Cultural Heritage

Remote Chess System

Innovative remote chess playing system that preserves traditional game experience in digital format.

Silver Cycling
Gesture Interaction

Silver Cycling

Accessible cycling interface designed for elderly users with simplified gesture controls and safety features.

VR Shuttlecock
VR Learning

VR Shuttlecock Training

Virtual reality system for badminton training with motion tracking and real-time feedback.