Publications

publications by categories in reversed chronological order.

2024

  1. AI-Powered Eyewear for Routine Facial Expression Analysis in Parkinson’s Disease
    Hwai Yin Ooi , Cheng Zhang, Ke Li , Jordan Narins , and Harini Sarva
    To Appear, International Congress of Parkinson’s Disease and Movement Disorders, 2024
  2. echoguide.jpg
    :trophy: EchoGuide: Active Acoustic Guidance for LLM-Based Eating Event Analysis from Egocentric Videos
    Vineet Parikh , Saif Mahmud , Devansh Agarwal , Ke Li , François Guimbretière , and Cheng Zhang
    To Appear, Proceedings of the 2024 ACM International Symposium on Wearable Computers (ISWC’24), 2024
  3. munchsonic.jpg
    MunchSonic: Tracking Fine-grained Dietary Actions through Active Acoustic Sensing on Eyeglasses
    Saif Mahmud , Devansh Agarwal , Ashwin Ajit , Qikang Liang , Thalia Viranda , Francois Guimbretiere , and Cheng Zhang
    To Appear, Proceedings of the 2024 ACM International Symposium on Wearable Computers (ISWC’24), 2024
  4. ring-a-pose.png
    Ring-a-Pose: A Ring for Continuous Hand Pose Tracking
    Tianhong Catherine Yu , Guilin Hu , Ruidong Zhang , Hyunchul Lim , Saif Mahmud , Chi-Jung Lee , Ke Li , Devansh Agarwal , Shuyang Nie , Jinseok Oh , François Guimbretière , and Cheng Zhang
    Accepted for Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2024
  5. seampose.jpg
    SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking
    Tianhong Catherine Yu ,  Manru ,  Zhang , Peter He , Chi-Jung Lee , Cassidy Cheesman , Saif Mahmud , Ruidong Zhang , François Guimbretière , and Cheng Zhang
    To Appear, Annual ACM Symposium on User Interface Software and Technology (UIST’24), 2024
  6. SonicID.jpeg
    SonicID: User Identification on Smart Glasses with Acoustic Sensing
    Ke Li , Devansh Agarwal , Ruidong Zhang , Vipin Gunda , Tianjun Mo , Saif Mahmud , Boao Chen , François Guimbretière , and Cheng Zhang
    Accepted for Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2024
  7. actsonic.png
    ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Waves Around the Body
    Saif Mahmud , Vineet Parikh , Qikang Liang , Ke Li , Ruidong Zhang , Ashwin Ajit , Vipin Gunda , Devansh Agarwal , François Guimbretière , and Cheng Zhang
    Accepted for Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2024
  8. GazeTrak.jpg
    GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass Frame
    Ke Li , Ruidong Zhang , Boao Chen , Siyuan Chen , Sicheng Yin , Saif Mahmud , Qikang Liang , François Guimbretière , and Cheng Zhang
    The 30th Annual International Conference on Mobile Computing and Networking (MobiCom 24), Oct 2024
  9. EchoWrist.jpg
    EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a Wristband
    Chi-Jung Lee , Ruidong Zhang , Devansh Agarwal , Tianhong Catherine Yu , Vipin Gunda , Oliver Lopez , James Kim , Sicheng Yin , Boao Deng , Ke Li , Mose Sakashita , François Guimbretière , and Cheng Zhang
    Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI 24), May 2024
  10. EyeEcho.jpg
    EyeEcho: Continuous and Low-power Facial Expression Tracking on Glasses
    Ke Li , Ruidong Zhang , Siyuan Chen , Boao Chen , Mose Sakashita , François Guimbretière , and Cheng Zhang
    Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI 24), May 2024
  11. Beyond-Voice.jpg
    :trophy: Beyond-Voice: Towards Continuous 3D Hand Pose Tracking on Commercial Home Assistant Devices
    Yin Li , Rohan Reddy , Cheng Zhang, and Rajalakshmi Nandakumar
    The ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN 24), May 2024

2023

  1. DTouch.png
    D-Touch: Recognizing and Predicting Fine-grained Hand-face Touching Activities Using a Neck-mounted Wearable
    Hyunchul Lim , Ruidong Zhang , Samhita Pendyal , Jeyeon Jo , and Cheng Zhang
    In Proceedings of the 28th International Conference on Intelligent User Interfaces , May 2023
  2. Ruidong_EchoSpeech.png
    EchoSpeech: Continuous Silent Speech Recognition on Minimally-Obtrusive Eyewear Powered by Acoustic Sensing
    Ruidong Zhang , Ke Li , Yihong Hao , Yufan Wang , Zhengnan Lai , François Guimbretière , and Cheng Zhang
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems , May 2023
  3. ReMotion.png
    ReMotion: Supporting Remote Collaboration in Open Space with Automatic Robotic Embodiment
    Mose Sakashita , Ruidong Zhang , Xiaoyi Li , Hyunju Kim , Michael Russo , Cheng Zhang, Malte F Jung , and François Guimbretière
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems , May 2023
  4. posesonic.png
    PoseSonic: 3D Upper Body Pose Estimation Through Egocentric Acoustic Sensing on Smartglasses
    Saif Mahmud , Ke Li , Guilin Hu , Hao Chen , Richard Jin , Ruidong Zhang , François Guimbretière , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2023
  5. EchoNose.jpg
    EchoNose: Sensing Mouth, Breathing and Tongue Gestures inside Oral Cavity using a Non-contact Nose Interface
    Rujia Sun , Xiaohe Zhou , Benjamin Steeper , Ruidong Zhang , Sicheng Yin , Ke Li , Shengzhang Wu , Sam Tilsen , Francois Guimbretiere , and Cheng Zhang
    In Proceedings of the 2023 ACM International Symposium on Wearable Computers , Oct 2023
  6. C-Auth.jpg
    C-Auth: Exploring the Feasibility of Using Egocentric View of Face Contour for User Authentication on Glasses
    Hyunchul Lim , Guilin Hu , Richard Jin , Hao Chen , Ryan Mao , Ruidong Zhang , and Cheng Zhang
    In Proceedings of the 2023 ACM International Symposium on Wearable Computers , Oct 2023
  7. HPSpeech.jpg
    :trophy: HPSpeech: Silent Speech Interface for Commodity Headphones
    Ruidong Zhang , Hao Chen , Devansh Agarwal , Richard Jin , Ke Li , François Guimbretière , and Cheng Zhang
    In Proceedings of the 2023 ACM International Symposium on Wearable Computers , Oct 2023

2022

  1. EarIO.png
    Eario: A low-power acoustic sensing earable for continuously tracking detailed facial movements
    Ke Li , Ruidong Zhang , Bo Liang , François Guimbretière , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2022
  2. bodytrak.png
    BodyTrak: Inferring Full-Body Poses from Body Silhouettes Using a Miniature Camera on a Wristband
    Hyunchul Lim , Yaxuan Li , Matthew Dressa , Fang Hu , Jae Hoon Kim , Ruidong Zhang , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2022
  3. EatingTrak.png
    EatingTrak: Detecting fine-grained eating moments in the wild using a wrist-mounted IMU
    Ruidong Zhang , Jihai Zhang , Nitish Gade , Peng Cao , Seyun Kim , Junchi Yan , and Cheng Zhang
    Proceedings of the ACM on Human-Computer Interaction (MobileHCI’22), Oct 2022
  4. Understanding How People with Visual Impairments Take Selfies: Experiences and Challenges
    Ricardo E Gonzalez Penuela , Paul Vermette , Zihan Yan , Cheng Zhang, Keith Vertanen , and Shiri Azenkot
    In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility , Oct 2022

2021

  1. teethtap.png
    Teethtap: Recognizing discrete teeth gestures using motion and acoustic sensing on an earpiece
    Wei Sun , Franklin Mingzhe Li , Benjamin Steeper , Songlin Xu , Feng Tian , and Cheng Zhang
    In 26th International Conference on Intelligent User Interfaces , Oct 2021
  2. ThumbTrak.png
    ThumbTrak: Recognizing micro-finger poses using a ring with proximity sensing
    Wei Sun , Franklin Mingzhe Li , Congshu Huang , Zhenyu Lei , Benjamin Steeper , Songyun Tao , Feng Tian , and Cheng Zhang
    In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction , Oct 2021
  3. NeckFace.png
    Neckface: Continuously tracking full facial expressions on neck-mounted wearables
    Tuochao Chen , Yaxuan Li , Songyun Tao , Hyunchul Lim , Mose Sakashita , Ruidong Zhang , Francois Guimbretiere , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2021
  4. HandyTrak.png
    HandyTrak: Recognizing the Holding Hand on a Commodity Smartphone from Body Silhouette Images
    Hyunchul Lim , David Lin , Jessica Tweneboah , and Cheng Zhang
    In The 34th Annual ACM Symposium on User Interface Software and Technology , Oct 2021
  5. SpeeChin.png
    Speechin: A smart necklace for silent speech recognition
    Ruidong Zhang , Mingyang Chen , Benjamin Steeper , Yaxuan Li , Zihan Yan , Yizhuo Chen , Songyun Tao , Tuochao Chen , Hyunchul Lim , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2021

2020

  1. FingerTrak.png
    :trophy: FingerTrak: Continuous 3D hand pose tracking by deep learning hand silhouettes captured by miniature thermal cameras on wrist
    Fang Hu , Peng He , Songlin Xu , Yin Li , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2020
  2. vibrosense.png
    Vibrosense: Recognizing home activities by deep learning subtle vibrations on an interior surface of a house from a single point using laser doppler vibrometry
    Wei Sun , Tuochao Chen , Jiayi Zheng , Zhenyu Lei , Lucy Wang , Benjamin Steeper , Peng He , Matthew Dressa , Feng Tian , and Cheng Zhang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2020
  3. Cface.png
    C-face: Continuously reconstructing facial expressions by deep learning contours of the face with ear-mounted miniature cameras
    Tuochao Chen , Benjamin Steeper , Kinan Alsheikh , Songyun Tao , François Guimbretière , and Cheng Zhang
    In Proceedings of the 33rd annual ACM symposium on user interface software and technology , Oct 2020

2019

  1. Novel gestures for wearables.
    Cheng Zhang
    Georgia Institute of Technology, Atlanta, GA, USA , Oct 2019

2018

  1. Fingerping.png
    FingerPing: Recognizing fine-grained hand poses using active acoustic on-body sensing
    Cheng Zhang, Qiuyue Xue , Anandghan Waghmare , Ruichen Meng , Sumeet Jain , Yizeng Han , Xinyu Li , Kenneth Cunefare , Thomas Ploetz , Thad Starner , Omer Inan , and Gregory D Abowd
    In Proceedings of the 2018 CHI conference on human factors in computing systems , Oct 2018
  2. Wristwash.png
    Wristwash: towards automatic handwashing assessment using a wrist-worn device
    Hong Li , Shishir Chawla , Richard Li , Sumeet Jain , Gregory D Abowd , Thad Starner , Cheng Zhang, and Thomas Plötz
    In Proceedings of the 2018 ACM international symposium on wearable computers , Oct 2018

2017

  1. bioacoustic.png
    Bioacoustics-based human-body-mediated communication
    Cheng Zhang, Sinan Hersek , Yiming Pu , Danrui Sun , Qiuyue Xue , Thad E Starner , Gregory D Abowd , and Omer T Inan
    Computer, Oct 2017
  2. Understanding the cost of driving trips
    Caleb Southern , Yunnuo Cheng , Cheng Zhang, and Gregory D Abowd
    In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems , Oct 2017
  3. SoundTrak.jpg
    Soundtrak: Continuous 3d tracking of a finger using active acoustics
    Cheng Zhang, Qiuyue Xue , Anandghan Waghmare , Sumeet Jain , Yiming Pu , Sinan Hersek , Kent Lyons , Kenneth A Cunefare , Omer T Inan , and Gregory D Abowd
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2017
  4. Fingorbit.jpg
    FingOrbits: interaction with wearables using synchronized thumb movements
    Cheng Zhang, Xiaoxuan Wang , Anandghan Waghmare , Sumeet Jain , Thomas Ploetz , Omer T Inan , Thad E Starner , and Gregory D Abowd
    In Proceedings of the 2017 ACM International Symposium on Wearable Computers , Oct 2017
  5. FingerSound.jpeg
    FingerSound: Recognizing unistroke thumb gestures using a ring
    Cheng Zhang, Anandghan Waghmare , Pranav Kundra , Yiming Pu , Scott Gilliland , Thomas Ploetz , Thad E Starner , Omer T Inan , and Gregory D Abowd
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2017
  6. Crowdstory: Fine-grained event storyline generation by fusion of multi-modal crowdsourced data
    Bin Guo , Yi Ouyang , Cheng Zhang, Jiafan Zhang , Zhiwen Yu , Di Wu , and Yu Wang
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Oct 2017

2016

  1. Driver classification based on driving behaviors
    Cheng Zhang, Mitesh Patel , Senaka Buthpitiya , Kent Lyons , Beverly Harrison , and Gregory D Abowd
    In Proceedings of the 21st International Conference on Intelligent User Interfaces , Oct 2016
  2. watchout.jpeg
    WatchOut: extending interactions on a smartwatch with inertial sensing
    Cheng Zhang, Junrui Yang , Caleb Southern , Thad E Starner , and Gregory D Abowd
    In Proceedings of the 2016 ACM International Symposium on Wearable Computers , Oct 2016
  3. beyondtouchscreen.png
    Beyond the Touchscreen: An Exploration of Extending Interactions on Commodity Smartphones
    ACM Transactions on Interactive Intelligent Systems (TiiS), Oct 2016
  4. Tapskin.jpg
    TapSkin: Recognizing on-skin input for smartwatches
    Cheng Zhang, AbdelKareem Bedri , Gabriel Reyes , Bailey Bercik , Omer T Inan , Thad E Starner , and Gregory D Abowd
    In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces , Oct 2016

2015

  1. beyondtouch.jpg
    Beyondtouch: Extending the input language with built-in sensors on commodity smartphones
    Cheng Zhang, Anhong Guo , Dingtian Zhang , Caleb Southern , Rosa Arriaga , and Gregory Abowd
    In Proceedings of the 20th International Conference on Intelligent User Interfaces , Oct 2015
  2. Inferringeating.jpg
    :trophy: Inferring meal eating activities in real world settings from ambient sounds: A feasibility study
    Edison Thomaz , Cheng Zhang, Irfan Essa , and Gregory D Abowd
    In Proceedings of the 20th International Conference on Intelligent User Interfaces , Oct 2015
  3. beyondtouch.jpg
    BeyondTouch
    Cheng Zhang, Anhong Guo , Dingtian Zhang , Caleb Southern , Rosa Arriaga , and Gregory Abowd
    In Proceedings of the 20th International Conference on Intelligent User Interfaces , Oct 2015

2013

  1. inkjet.jpeg
    :trophy: :trophy: Instant inkjet circuits: lab-based inkjet printing to support rapid prototyping of UbiComp devices
    Yoshihiro Kawahara , Steve Hodges , Benjamin S Cook , Cheng Zhang, and Gregory D Abowd
    In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing , Oct 2013
  2. backtap.jpeg
    BackTap: robust four-point tapping on the back of an off-the-shelf smartphone
    Cheng Zhang, Aman Parnami , Caleb Southern , Edison Thomaz , Gabriel Reyes , Rosa Arriaga , and Gregory D Abowd
    In Adjunct Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology , Oct 2013

2011

  1. T-Maze: a tangible programming tool for children
    Danli Wang , Cheng Zhang, and Hongan Wang
    In Proceedings of the 10th international conference on interaction design and children , Oct 2011
  2. CoolMag: a tangible interaction tool to customize instruments for children in music education
    Cheng Zhang, Li Shen , Danli Wang , Feng Tian , and Hongan Wang
    In Proceedings of the 13th international conference on Ubiquitous computing , Oct 2011