Publications

publications by categories in reversed chronological order.

2025

  1. SpellRing.jpg
    SpellRing: SpellRing: Recognizing Continuous Fingerspelling in American Sign Language using a Ring
    Hyunchul Lim , Nam Anh Dang , Dylan Lee , Tianhong Catherine Yu , Jane Lu , Franklin Mingzhe Li , Yiqi Jin , Yan Ma , Xiaojun Bi , François Guimbretière , and Cheng Zhang
    In (Accepted with minor revision) Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems , 2025
  2. seamfit.jpg
    SeamFit: Towards Practical Smart Clothing for Automatic Exercise Logging
    Tianghong Catherine Yu , Mary Zhang , Luis Miguel Sy Malenab , Chi-Jung Lee , Hao Jiang , Ruidong Zhang , François Guimbretière , and Cheng Zhang
    (Accepted with Minor Revision) Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2025

2024

  1. emotionalVoice.jpg
    Exploring the Impact of Emotional Voice Integration in Sign-to-Speech Translators for Deaf-to-Hearing Communication
    Hyunchul Lim , Minghan Gao , Franklin Mingzhe Li , Nam Anh Dang , Ianip Sit , Michelle M Olson , and Cheng Zhang
    2024
  2. wristsonic1.jpg
    WristSonic: Enabling Fine-grained Hand-Face Interactions on Smartwatches Using Active Acoustic Sensing
    Saif Mahmud , Kian Mahmoodi , Chi-Jung Lee , Francois Guimbretiere , and Cheng Zhang
    2024
  3. actsonic.png
    ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Waves Around the Body
    Saif Mahmud , Vineet Parikh , Qikang Liang , Ke Li , Ruidong Zhang , Ashwin Ajit , Vipin Gunda , Devansh Agarwal , François Guimbretière , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2024
  4. ring-a-pose.png
    Ring-a-Pose: A Ring for Continuous Hand Pose Tracking
    Tianhong Catherine Yu , Guilin Hu , Ruidong Zhang , Hyunchul Lim , Saif Mahmud , Chi-Jung Lee , Ke Li , Devansh Agarwal , Shuyang Nie , Jinseok Oh , François Guimbretière , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2024
  5. SonicID.jpeg
    SonicID: User Identification on Smart Glasses with Acoustic Sensing
    Ke Li , Devansh Agarwal , Ruidong Zhang , Vipin Gunda , Tianjun Mo , Saif Mahmud , Boao Chen , François Guimbretière , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2024
  6. GazeTrak.jpg
    GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass Frame
    Ke Li , Ruidong Zhang , Boao Chen , Siyuan Chen , Sicheng Yin , Saif Mahmud , Qikang Liang , François Guimbretière , and Cheng Zhang
    The 30th Annual International Conference on Mobile Computing and Networking (MobiCom 24), Oct 2024
  7. seampose.jpg
    SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking
    Tianhong Catherine Yu ,  Manru ,  Zhang , Peter He , Chi-Jung Lee , Cassidy Cheesman , Saif Mahmud , Ruidong Zhang , François Guimbretière , and Cheng Zhang
    Annual ACM Symposium on User Interface Software and Technology (UIST’24), Oct 2024
  8. AI-Powered Eyewear for Routine Facial Expression Analysis in Parkinson’s Disease
    Hwai Yin Ooi , Cheng Zhang, Ke Li , Jordan Narins , and Harini Sarva
    International Congress of Parkinson’s Disease and Movement Disorders, Oct 2024
  9. echoguide.jpg
    :trophy: EchoGuide: Active Acoustic Guidance for LLM-Based Eating Event Analysis from Egocentric Videos
    Vineet Parikh , Saif Mahmud , Devansh Agarwal , Ke Li , François Guimbretière , and Cheng Zhang
    Proceedings of the 2024 ACM International Symposium on Wearable Computers (ISWC’24), Oct 2024
  10. munchsonic.jpg
    MunchSonic: Tracking Fine-grained Dietary Actions through Active Acoustic Sensing on Eyeglasses
    Saif Mahmud , Devansh Agarwal , Ashwin Ajit , Qikang Liang , Thalia Viranda , Francois Guimbretiere , and Cheng Zhang
    Proceedings of the 2024 ACM International Symposium on Wearable Computers (ISWC’24), Oct 2024
  11. EchoWrist.jpg
    EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a Wristband
    Chi-Jung Lee , Ruidong Zhang , Devansh Agarwal , Tianhong Catherine Yu , Vipin Gunda , Oliver Lopez , James Kim , Sicheng Yin , Boao Deng , Ke Li , Mose Sakashita , François Guimbretière , and Cheng Zhang
    Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI 24), May 2024
  12. EyeEcho.jpg
    EyeEcho: Continuous and Low-power Facial Expression Tracking on Glasses
    Ke Li , Ruidong Zhang , Siyuan Chen , Boao Chen , Mose Sakashita , François Guimbretière , and Cheng Zhang
    Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI 24), May 2024
  13. Beyond-Voice.jpg
    :trophy: Beyond-Voice: Towards Continuous 3D Hand Pose Tracking on Commercial Home Assistant Devices
    Yin Li , Rohan Reddy , Cheng Zhang, and Rajalakshmi Nandakumar
    The ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN 24), May 2024

2023

  1. DTouch.png
    D-Touch: Recognizing and Predicting Fine-grained Hand-face Touching Activities Using a Neck-mounted Wearable
    Hyunchul Lim , Ruidong Zhang , Samhita Pendyal , Jeyeon Jo , and Cheng Zhang
    In Proceedings of the 28th International Conference on Intelligent User Interfaces , May 2023
  2. Ruidong_EchoSpeech.png
    EchoSpeech: Continuous Silent Speech Recognition on Minimally-Obtrusive Eyewear Powered by Acoustic Sensing
    Ruidong Zhang , Ke Li , Yihong Hao , Yufan Wang , Zhengnan Lai , François Guimbretière , and Cheng Zhang
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems , May 2023
  3. ReMotion.png
    ReMotion: Supporting Remote Collaboration in Open Space with Automatic Robotic Embodiment
    Mose Sakashita , Ruidong Zhang , Xiaoyi Li , Hyunju Kim , Michael Russo , Cheng Zhang, Malte F Jung , and François Guimbretière
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems , May 2023
  4. posesonic.png
    PoseSonic: 3D Upper Body Pose Estimation Through Egocentric Acoustic Sensing on Smartglasses
    Saif Mahmud , Ke Li , Guilin Hu , Hao Chen , Richard Jin , Ruidong Zhang , François Guimbretière , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2023
  5. EchoNose.jpg
    EchoNose: Sensing Mouth, Breathing and Tongue Gestures inside Oral Cavity using a Non-contact Nose Interface
    Rujia Sun , Xiaohe Zhou , Benjamin Steeper , Ruidong Zhang , Sicheng Yin , Ke Li , Shengzhang Wu , Sam Tilsen , Francois Guimbretiere , and Cheng Zhang
    In Proceedings of the 2023 ACM International Symposium on Wearable Computers , Oct 2023
  6. C-Auth.jpg
    C-Auth: Exploring the Feasibility of Using Egocentric View of Face Contour for User Authentication on Glasses
    Hyunchul Lim , Guilin Hu , Richard Jin , Hao Chen , Ryan Mao , Ruidong Zhang , and Cheng Zhang
    In Proceedings of the 2023 ACM International Symposium on Wearable Computers , Oct 2023
  7. HPSpeech.jpg
    :trophy: HPSpeech: Silent Speech Interface for Commodity Headphones
    Ruidong Zhang , Hao Chen , Devansh Agarwal , Richard Jin , Ke Li , François Guimbretière , and Cheng Zhang
    In Proceedings of the 2023 ACM International Symposium on Wearable Computers , Oct 2023

2022

  1. EarIO.png
    Eario: A low-power acoustic sensing earable for continuously tracking detailed facial movements
    Ke Li , Ruidong Zhang , Bo Liang , François Guimbretière , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2022
  2. bodytrak.png
    BodyTrak: Inferring Full-Body Poses from Body Silhouettes Using a Miniature Camera on a Wristband
    Hyunchul Lim , Yaxuan Li , Matthew Dressa , Fang Hu , Jae Hoon Kim , Ruidong Zhang , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2022
  3. EatingTrak.png
    EatingTrak: Detecting fine-grained eating moments in the wild using a wrist-mounted IMU
    Ruidong Zhang , Jihai Zhang , Nitish Gade , Peng Cao , Seyun Kim , Junchi Yan , and Cheng Zhang
    Proceedings of the ACM on Human-Computer Interaction (MobileHCI’22), Oct 2022
  4. Understanding How People with Visual Impairments Take Selfies: Experiences and Challenges
    Ricardo E Gonzalez Penuela , Paul Vermette , Zihan Yan , Cheng Zhang, Keith Vertanen , and Shiri Azenkot
    In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility , Oct 2022

2021

  1. teethtap.png
    Teethtap: Recognizing discrete teeth gestures using motion and acoustic sensing on an earpiece
    Wei Sun , Franklin Mingzhe Li , Benjamin Steeper , Songlin Xu , Feng Tian , and Cheng Zhang
    In 26th International Conference on Intelligent User Interfaces , Oct 2021
  2. ThumbTrak.png
    ThumbTrak: Recognizing micro-finger poses using a ring with proximity sensing
    Wei Sun , Franklin Mingzhe Li , Congshu Huang , Zhenyu Lei , Benjamin Steeper , Songyun Tao , Feng Tian , and Cheng Zhang
    In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction , Oct 2021
  3. NeckFace.png
    Neckface: Continuously tracking full facial expressions on neck-mounted wearables
    Tuochao Chen , Yaxuan Li , Songyun Tao , Hyunchul Lim , Mose Sakashita , Ruidong Zhang , Francois Guimbretiere , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2021
  4. HandyTrak.png
    HandyTrak: Recognizing the Holding Hand on a Commodity Smartphone from Body Silhouette Images
    Hyunchul Lim , David Lin , Jessica Tweneboah , and Cheng Zhang
    In The 34th Annual ACM Symposium on User Interface Software and Technology , Oct 2021
  5. SpeeChin.png
    Speechin: A smart necklace for silent speech recognition
    Ruidong Zhang , Mingyang Chen , Benjamin Steeper , Yaxuan Li , Zihan Yan , Yizhuo Chen , Songyun Tao , Tuochao Chen , Hyunchul Lim , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2021

2020

  1. FingerTrak.png
    :trophy: FingerTrak: Continuous 3D hand pose tracking by deep learning hand silhouettes captured by miniature thermal cameras on wrist
    Fang Hu , Peng He , Songlin Xu , Yin Li , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2020
  2. vibrosense.png
    Vibrosense: Recognizing home activities by deep learning subtle vibrations on an interior surface of a house from a single point using laser doppler vibrometry
    Wei Sun , Tuochao Chen , Jiayi Zheng , Zhenyu Lei , Lucy Wang , Benjamin Steeper , Peng He , Matthew Dressa , Feng Tian , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2020
  3. Cface.png
    C-face: Continuously reconstructing facial expressions by deep learning contours of the face with ear-mounted miniature cameras
    Tuochao Chen , Benjamin Steeper , Kinan Alsheikh , Songyun Tao , François Guimbretière , and Cheng Zhang
    In Proceedings of the 33rd annual ACM symposium on user interface software and technology , Oct 2020

2019

  1. Novel gestures for wearables.
    Cheng Zhang
    Georgia Institute of Technology, Atlanta, GA, USA , Oct 2019

2018

  1. Fingerping.png
    FingerPing: Recognizing fine-grained hand poses using active acoustic on-body sensing
    Cheng Zhang, Qiuyue Xue , Anandghan Waghmare , Ruichen Meng , Sumeet Jain , Yizeng Han , Xinyu Li , Kenneth Cunefare , Thomas Ploetz , Thad Starner , Omer Inan , and Gregory D Abowd
    In Proceedings of the 2018 CHI conference on human factors in computing systems , Oct 2018
  2. Wristwash.png
    Wristwash: towards automatic handwashing assessment using a wrist-worn device
    Hong Li , Shishir Chawla , Richard Li , Sumeet Jain , Gregory D Abowd , Thad Starner , Cheng Zhang, and Thomas Plötz
    In Proceedings of the 2018 ACM international symposium on wearable computers , Oct 2018

2017

  1. bioacoustic.png
    Bioacoustics-based human-body-mediated communication
    Cheng Zhang, Sinan Hersek , Yiming Pu , Danrui Sun , Qiuyue Xue , Thad E Starner , Gregory D Abowd , and Omer T Inan
    Computer, Oct 2017
  2. Understanding the cost of driving trips
    Caleb Southern , Yunnuo Cheng , Cheng Zhang, and Gregory D Abowd
    In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems , Oct 2017
  3. SoundTrak.jpg
    Soundtrak: Continuous 3d tracking of a finger using active acoustics
    Cheng Zhang, Qiuyue Xue , Anandghan Waghmare , Sumeet Jain , Yiming Pu , Sinan Hersek , Kent Lyons , Kenneth A Cunefare , Omer T Inan , and Gregory D Abowd
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2017
  4. Fingorbit.jpg
    FingOrbits: interaction with wearables using synchronized thumb movements
    Cheng Zhang, Xiaoxuan Wang , Anandghan Waghmare , Sumeet Jain , Thomas Ploetz , Omer T Inan , Thad E Starner , and Gregory D Abowd
    In Proceedings of the 2017 ACM International Symposium on Wearable Computers , Oct 2017
  5. FingerSound.jpeg
    FingerSound: Recognizing unistroke thumb gestures using a ring
    Cheng Zhang, Anandghan Waghmare , Pranav Kundra , Yiming Pu , Scott Gilliland , Thomas Ploetz , Thad E Starner , Omer T Inan , and Gregory D Abowd
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2017
  6. Crowdstory: Fine-grained event storyline generation by fusion of multi-modal crowdsourced data
    Bin Guo , Yi Ouyang , Cheng Zhang, Jiafan Zhang , Zhiwen Yu , Di Wu , and Yu Wang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2017

2016

  1. Driver classification based on driving behaviors
    Cheng Zhang, Mitesh Patel , Senaka Buthpitiya , Kent Lyons , Beverly Harrison , and Gregory D Abowd
    In Proceedings of the 21st International Conference on Intelligent User Interfaces , Oct 2016
  2. watchout.jpeg
    WatchOut: extending interactions on a smartwatch with inertial sensing
    Cheng Zhang, Junrui Yang , Caleb Southern , Thad E Starner , and Gregory D Abowd
    In Proceedings of the 2016 ACM International Symposium on Wearable Computers , Oct 2016
  3. beyondtouchscreen.png
    Beyond the Touchscreen: An Exploration of Extending Interactions on Commodity Smartphones
    ACM Transactions on Interactive Intelligent Systems (TiiS), Oct 2016
  4. Tapskin.jpg
    TapSkin: Recognizing on-skin input for smartwatches
    Cheng Zhang, AbdelKareem Bedri , Gabriel Reyes , Bailey Bercik , Omer T Inan , Thad E Starner , and Gregory D Abowd
    In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces , Oct 2016

2015

  1. beyondtouch.jpg
    Beyondtouch: Extending the input language with built-in sensors on commodity smartphones
    Cheng Zhang, Anhong Guo , Dingtian Zhang , Caleb Southern , Rosa Arriaga , and Gregory Abowd
    In Proceedings of the 20th International Conference on Intelligent User Interfaces , Oct 2015
  2. Inferringeating.jpg
    :trophy: Inferring meal eating activities in real world settings from ambient sounds: A feasibility study
    Edison Thomaz , Cheng Zhang, Irfan Essa , and Gregory D Abowd
    In Proceedings of the 20th International Conference on Intelligent User Interfaces , Oct 2015
  3. beyondtouch.jpg
    BeyondTouch
    Cheng Zhang, Anhong Guo , Dingtian Zhang , Caleb Southern , Rosa Arriaga , and Gregory Abowd
    In Proceedings of the 20th International Conference on Intelligent User Interfaces , Oct 2015

2013

  1. inkjet.jpeg
    :trophy: :trophy: Instant inkjet circuits: lab-based inkjet printing to support rapid prototyping of UbiComp devices
    Yoshihiro Kawahara , Steve Hodges , Benjamin S Cook , Cheng Zhang, and Gregory D Abowd
    In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing , Oct 2013
  2. backtap.jpeg
    BackTap: robust four-point tapping on the back of an off-the-shelf smartphone
    Cheng Zhang, Aman Parnami , Caleb Southern , Edison Thomaz , Gabriel Reyes , Rosa Arriaga , and Gregory D Abowd
    In Adjunct Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology , Oct 2013

2011

  1. T-Maze: a tangible programming tool for children
    Danli Wang , Cheng Zhang, and Hongan Wang
    In Proceedings of the 10th international conference on interaction design and children , Oct 2011
  2. CoolMag: a tangible interaction tool to customize instruments for children in music education
    Cheng Zhang, Li Shen , Danli Wang , Feng Tian , and Hongan Wang
    In Proceedings of the 13th international conference on Ubiquitous computing , Oct 2011