Human–Machine Interaction via Dual Modes of Voice and Gesture Enabled by Triboelectric Nanogenerator and Machine Learning

With the development of science and technology, human–machine interaction has brought great benefits to the society. Here, we design a voice and gesture signal translator (VGST), which can translate natural actions into electrical signals and realize efficient communication in human–machine interface. By spraying silk protein on the copper of the device, the VGST can achieve improved output and a wide frequency response of 20–2000 Hz with a high sensitivity of 167 mV/dB, and the resolution of frequency detection can reach 0.1 Hz. By designing its internal structure, its resonant frequency and output voltage can be adjusted. The VGST can be used as a high-fidelity platform to effectively recover recorded music and can also be combined with machine learning algorithms to realize the function of speech recognition with a high accuracy rate of 97%. It also has good antinoise performance to recognize speech correctly even in noisy environments. Meanwhile, in gesture recognition, the triboelectric translator is able to recognize simple hand gestures and to judge the distance between hand and the VGST based on the principle of electrostatic induction. This work demonstrates that triboelectric nanogenerator (TENG) technology can have great application prospects and significant advantages in human–machine interaction and high-fidelity platforms.

相关文章

  • Multimodal Finger-Shaped Tactile Sensor for Multi-Directional Force and Material Identification
    [Chengcheng Han, Zhi Cao, Ziyao An, Zhiwei Zhang, Zhong Lin Wang, Zhiyi Wu]
  • A universal self-triggered passive management strategy for enhancing the output power of triboelectric nanogenerators
    [Zhenjie Wang, Jianlong Wang, Zheng Yang, Jinzhi Zhu, Peinian Zhang, Xin Yu, Hengyu Li, Yang Yu, Yu Zhang, Zhong Lin Wang, Tinghai Cheng]
  • Ultrahigh-Current-Density Tribovoltaic Nanogenerators Based on Hydrogen Bond-Activated Flexible Organic Semiconductor Textiles
    [Guoxu Liu, Beibei Fan, Youchao Qi, Kai Han, Jie Cao, Xianpeng Fu, Zhaozheng Wang, Tianzhao Bu, Jianhua Zeng, Sicheng Dong, Likun Gong, Zhong Lin Wang, Chi Zhang]
  • qq

    成果名称:低表面能涂层

    合作方式:技术开发

    联 系 人:周老师

    联系电话:13321314106

    ex

    成果名称:低表面能涂层

    合作方式:技术开发

    联 系 人:周老师

    联系电话:13321314106

    yx

    成果名称:低表面能涂层

    合作方式:技术开发

    联 系 人:周老师

    联系电话:13321314106

    ph

    成果名称:低表面能涂层

    合作方式:技术开发

    联 系 人:周老师

    联系电话:13321314106

    广告图片

    润滑集