Yichuan Zhang

Research

Multimodal Cognitive State Modelling

Inferring attention and uncertainty from eye-tracking, mouse, and screen behaviour to drive adaptive AI assistance.

Status
Active
Period
2024 – Present
Cognitive state modelling overview

This thread builds a behavioural data platform integrating eye-tracking (Tobii Pro), mouse, and screen logs. GMM-HMM and LSTM models map raw signals to latent cognitive states such as attention and uncertainty, enabling real-time AI adaptation.