Human–Machine Interaction via Dual Modes of Voice and Gesture Enabled by Triboelectric Nanogenerator and Machine Learning

With the development of science and technology, human–machine interaction has brought great benefits to the society. Here, we design a voice and gesture signal translator (VGST), which can translate natural actions into electrical signals and realize efficient communication in human–machine interface. By spraying silk protein on the copper of the device, the VGST can achieve improved output and a wide frequency response of 20–2000 Hz with a high sensitivity of 167 mV/dB, and the resolution of frequency detection can reach 0.1 Hz. By designing its internal structure, its resonant frequency and output voltage can be adjusted. The VGST can be used as a high-fidelity platform to effectively recover recorded music and can also be combined with machine learning algorithms to realize the function of speech recognition with a high accuracy rate of 97%. It also has good antinoise performance to recognize speech correctly even in noisy environments. Meanwhile, in gesture recognition, the triboelectric translator is able to recognize simple hand gestures and to judge the distance between hand and the VGST based on the principle of electrostatic induction. This work demonstrates that triboelectric nanogenerator (TENG) technology can have great application prospects and significant advantages in human–machine interaction and high-fidelity platforms.

相关文章

  • Schottky MSM-Structured Tribovoltaic Nanogenerator Enabling Over 25,000 nC Charge Transfer via Single Droplet Impact
    [Yahui Li, Han Ren, Zhiyuan Hu, Zhifeng Hu, Jiaxiang Wang, Mingyu Zhang, Yangtao Yu, Sicheng Chen, Zhong Lin Wang, Zhuoqing Yang]
  • Machine Learning Enhanced Self-Charging Power Sources
    [Rui Gu, Liang Wei, Nuo Xu, Yao Xiong, Qijun Sun, Zhong Lin Wang]
  • A flexibility-pneumatic triboelectric nanogenerator for stable output of irregular wave energy
    [Jianlong Wang, Zheng Yang, Zhenjie Wang, Xinxian Wang, Yanrui Zhao, Jinbiao Ma, Hengyu Li, Yang Yu, Zhong Lin Wang, Tinghai Cheng]
  • qq

    成果名称:低表面能涂层

    合作方式:技术开发

    联 系 人:周老师

    联系电话:13321314106

    ex

    成果名称:低表面能涂层

    合作方式:技术开发

    联 系 人:周老师

    联系电话:13321314106

    yx

    成果名称:低表面能涂层

    合作方式:技术开发

    联 系 人:周老师

    联系电话:13321314106

    ph

    成果名称:低表面能涂层

    合作方式:技术开发

    联 系 人:周老师

    联系电话:13321314106

    广告图片

    润滑集