Research

My research interest is Human Computer Interaction, especially Mobile Interfaces, Intelligent Interactive Systems, Learning Techologies, Machine Learning and Its Application in User Interfaces and Mobile Reading. My recent research projects:

AttentiveLearner Lepton: Understanding Mobile Reading via Camera Based Gaze Tracking and Kinematic Touch Modeling
  • Lepton is an intelligent mobile reading system and a set of dual=channel sensing algorithms to achieve scalable and fine-grained understanding of users’ reading behaviors, comprehension, and engagements on unmodified smartphones.
  • Lepton tracks the periodic lateral patterns, i.e. saccade, of users’ eye gaze via the front camera, and infers their muscle stiffness during text scrolling via a Mass-Spring-Damper based kinematic model from touch events. Lepton leverages signals from the two channels to infer users’ comprehension and engagements during reading.
LivePulse SmartRSVP: Towards Attentive Speed Reading on Small Screen Wearable Devices (Homepage)
  • SmartRSVP is an attentive speed-reading system to facilitate text reading on small-screen wearable devices.
  • SmartRSVP uses camera-based facial alignment and eye-gaze tracking techniques to determine a user’s visual attention and then to play/pause the presentation of dynamic texts (text presentation via Rapid Serial Visual Presentation); SmartRSVP uses heart-rate viability features to infer the user’s cognitive workload, which is further used to regulate the speed of dynamic texts in real time.