WO2020140552A1 - 触觉反馈方法 - Google Patents

触觉反馈方法 Download PDF

Info

Publication number
WO2020140552A1
WO2020140552A1 PCT/CN2019/111097 CN2019111097W WO2020140552A1 WO 2020140552 A1 WO2020140552 A1 WO 2020140552A1 CN 2019111097 W CN2019111097 W CN 2019111097W WO 2020140552 A1 WO2020140552 A1 WO 2020140552A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
haptic feedback
feedback method
audio event
algorithm model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/111097
Other languages
English (en)
French (fr)
Inventor
李涛
向征
郭璇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
AAC Technologies Holdings Shenzhen Co Ltd
AAC Technologies Pte Ltd
Original Assignee
AAC Acoustic Technologies Shenzhen Co Ltd
AAC Technologies Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by AAC Acoustic Technologies Shenzhen Co Ltd, AAC Technologies Pte Ltd filed Critical AAC Acoustic Technologies Shenzhen Co Ltd
Publication of WO2020140552A1 publication Critical patent/WO2020140552A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B6/00—Tactile signalling systems, e.g. tactile personal calling systems
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/041—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal based on mfcc [mel -frequency spectral coefficients]
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2250/00—Aspects of algorithms or signal processing methods without intrinsic musical character, yet specifically adapted for or used in electrophonic musical processing
    • G10H2250/131—Mathematical functions for musical analysis, processing, synthesis or composition
    • G10H2250/215—Transforms, i.e. mathematical transforms into domains appropriate for musical signal processing, coding or compression
    • G10H2250/235—Fourier transform; Discrete Fourier Transform [DFT]; Fast Fourier Transform [FFT]

Definitions

  • the invention relates to the field of electroacoustics, and in particular to a haptic feedback method applied to mobile electronic products.
  • Tactile feedback technology is a tactile feedback mechanism that combines hardware and software, supplemented by actions such as force or vibration.
  • Haptic feedback technology has been adopted by a large number of digital devices, providing excellent haptic feedback for mobile phones, automobiles, wearable devices, games, medical and consumer electronics and other products.
  • haptic feedback technology can simulate human's real haptic experience, and can enhance the user experience by customizing the unique haptic feedback effect, and enhance the effects of games, music and videos.
  • An object of the present invention is to provide a haptic feedback method.
  • the haptic feedback method When the haptic feedback method is applied to a mobile electronic product, it can provide users with real-time haptic feedback, so that the mobile electronic product has a good user experience.
  • the present invention provides a tactile feedback method, which includes the following steps:
  • Step S1 Perform algorithm training on the audio clips containing known audio event types and obtain an algorithm model
  • Step S2 Obtain audio, identify the audio through the algorithm model to obtain different audio event types in the audio, and match the audio event types to different vibration effects according to preset rules as tactile feedback output.
  • the step S1 specifically includes:
  • Step S11 Provide an audio segment containing a known audio event type
  • Step S12 Extract the MFCC feature of the audio clip and use it as the input of the support vector machine algorithm, and use the known audio event type contained in the audio clip as the output of the support vector machine algorithm, and train the support vector machine algorithm model to obtain The algorithm model is described.
  • the step S2 specifically includes:
  • Step S21 Acquire audio and frame the audio to obtain multi-frame audio clips
  • Step S22 Extract the MFCC feature of each of the audio clips and input it to the algorithm model for matching identification to obtain the audio event type of each of the audio clips;
  • Step S23 Match different vibration effects according to the preset rule according to the acquired audio event type and output as tactile feedback.
  • extracting the MFCC characteristics of each audio segment includes: sequentially passing each of the audio segments through FFT Fourier transform processing, Mel frequency filter bank filtering processing, and logarithmic energy processing And DCT cepstrum processing to obtain the MFCC characteristics.
  • each of the audio segments includes one of the audio event types.
  • the preset rule is: each type of audio event corresponds to a different vibration effect.
  • the haptic feedback method of the present invention recognizes the audio event type of audio in real time, thereby outputting a vibration effect matching the audio event type.
  • the haptic feedback method is applied to mobile electronic products to make the mobile
  • the electronic product can output the vibration effect matching the audio event type according to the audio event type, which makes up for the inefficiency of audio and visual feedback in a specific scene, realizes real-time tactile feedback, and improves the user experience.
  • step S1 of the haptic feedback method of the present invention is a partial flowchart of step S1 of the haptic feedback method of the present invention
  • FIG. 3 is a partial flowchart of step S2 of the haptic feedback method of the present invention.
  • the present invention provides a haptic feedback method, which can be applied to mobile electronic products.
  • the method includes the following steps:
  • Step S1 Perform algorithm training on the audio clips containing known audio event types and obtain an algorithm model
  • step S1 specifically includes:
  • Step S11 Provide an audio segment containing a known audio event type
  • Step S12 Extract the MFCC feature of the audio segment and use it as the input of the support vector machine (SVM) algorithm, and use the known audio event type contained in the audio segment as the output of the support vector machine (SVM) algorithm to perform the support vector machine (SVM) Algorithm model training to get the algorithm model.
  • SVM support vector machine
  • Step S2 Obtain audio, identify the audio through the algorithm model to obtain different audio event types in the audio, and match the audio event types to different vibration effects according to preset rules as tactile feedback output.
  • step S2 specifically includes:
  • Step S21 Acquire audio and frame the audio to obtain multi-frame audio clips
  • Step S22 Extract the MFCC feature of each of the audio clips and input it to the algorithm model for matching identification to obtain the audio event type of each of the audio clips;
  • extracting the MFCC feature of each audio segment includes: sequentially passing each of the audio segments through FFT Fourier transform processing, Mel frequency filter bank filtering processing, and logarithmic energy processing And DCT cepstrum processing to obtain the MFCC characteristics.
  • each of the audio segments includes one of the audio event types.
  • the audio event type can be obtained through artificial classification.
  • the audio event type includes but is not limited to any type of shooting, explosion, object collision, screaming or engine roaring.
  • Step S23 Match different vibration effects according to the preset rule according to the acquired audio event type and output as tactile feedback.
  • the preset rule is: each of the audio event types corresponds to a different vibration effect.
  • the support vector machine is a machine learning method based on statistical learning theory.
  • the support vector machine is used to construct the algorithm model, and Recognize the audio according to the algorithm model to obtain different types of audio events, and output the vibration effect corresponding to the audio event type.
  • the support vector machine (SVM) realizes real-time recognition for the haptic feedback method of the present invention Audio provides conditions.
  • the haptic feedback method of the present invention recognizes the audio event type of the mobile electronic product in real time, thereby providing the mobile electronic product with
  • the vibration effect matching the type of the audio event achieves the effect of enhancing the game, music and video of the mobile electronic product, intuitively and unambiguously reconstructs the "mechanical" touch, and makes up for the inefficiency of audio and visual feedback in specific scenarios, Realize real-time tactile feedback and improve user experience.
  • applying tactile feedback technology to mobile games can create a realistic vibration, such as the recoil of a certain weapon in a shooting game or the impact of an explosion, or playing the guitar in an instrument application.
  • Vibration when stringing for example, when we are playing a piano application, when there is no tactile feedback, we can only distinguish the sound of the music through the sound, and the addition of tactile feedback technology can provide different vibrations according to different treble and bass Intensity, so as to simulate the real vibration feeling of playing the guitar.
  • Another example is the video.
  • the device supports haptic feedback technology we can feel that the device will follow the scene changes and generate corresponding vibration, which is also a kind of improvement of the user experience.
  • the haptic feedback method of the present invention recognizes the audio event type of audio in real time, thereby outputting a vibration effect matching the audio event type.
  • the haptic feedback method is applied to mobile electronic products to make the mobile
  • the electronic product can output the vibration effect matching the audio event type according to the audio event type, which makes up for the inefficiency of audio and visual feedback in a specific scene, realizes real-time tactile feedback, and improves the user experience.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)

Abstract

一种触觉反馈方法，该方法包括如下步骤：步骤S1、将包含已知音频事件类型的音频片段进行算法训练并得到算法模型（S1）；步骤S2、获取音频，通过算法模型对音频进行识别以获取该音频中不同的音频事件类型，将该音频事件类型按预设规则匹配不同的振动效果作为触觉反馈输出（S2）。与相关技术相比，该触觉反馈方法应用于移动电子产品时为用户提供实时的触觉反馈，使得移动电子产品的使用体验佳。

Description

触觉反馈方法 技术领域
本发明涉及电声领域，尤其涉及一种运用于移动电子产品的触觉反馈方法。
 背景技术
触觉反馈技术是一种通过硬件与软件结合、辅以作用力或振动等动作的触觉反馈机制。触觉反馈技术已被大量数字设备所采用，为手机、汽车、可穿戴设备、游戏、医疗和消费电子等产品提供了出色的触觉反馈功能。
相关技术的触觉反馈技术能够模拟人的真实触觉体验，可以通过定制独特的触觉反馈效果提升用户体验，增强游戏、音乐和视频的效果。
 技术问题
然而，相关技术中，缺乏基于事件检测的触觉反馈方案的成熟应用。首先，现有大多数基于事件检测的应用并没有为之配置触觉反馈功能和体验；其次，一些为音频匹配振动的触觉反馈方案存在对音频质量要求较高、使用场景单一、用户体验不佳的问题。
因此，实有必要提供一种新的触觉反馈方法解决上述技术问题。
 技术解决方案
本发明的目的在于提供一种触觉反馈方法，该触觉反馈方法应用于移动电子产品时能够为用户提供实时的触觉反馈，使得移动电子产品的使用体验佳。
为达到上述目的，本发明提供一种触觉反馈方法，该方法包括如下步骤:
步骤S1、将包含已知音频事件类型的音频片段进行算法训练并得到算法模型；
步骤S2、获取音频，通过所述算法模型对所述音频进行识别以获取该音频中不同的音频事件类型，将该音频事件类型按预设规则匹配不同的振动效果作为触觉反馈输出。
优选的，所述步骤S1中，具体包括：
步骤S11、提供包含已知音频事件类型的音频片段；
步骤S12、提取该音频片段的MFCC特征并作为支持向量机算法的输入，并将该音频片段中包含的已知音频事件类型作为支持向量机算法的输出，进行支持向量机算法模型训练以得到所述算法模型。
优选的，所述步骤S2中，具体包括：
步骤S21、获取音频并对该音频进行分帧，得到多帧音频片段；
步骤S22、提取每一所述音频片段的MFCC特征并输入至所述算法模型进行匹配识别，以获取每一所述音频片段的音频事件类型；
步骤S23、根据获取的所述音频事件类型按预设规则匹配不同的振动效果并作为触觉反馈输出。
优选的，在所述步骤S22中，提取每一音频片段的MFCC特征包括：将每一所述音频片段顺次通过FFT傅里叶变换处理、梅尔频率滤波器组滤波处理、对数能量处理以及DCT求倒谱处理，以得到所述MFCC特征。
优选的，每一所述音频片段包括一个所述音频事件类型。
优选的，在步骤S23中，所述预设规则为：每一所述音频事件类型对应一个不同的振动效果。
 有益效果
与相关技术相比，本发明的触觉反馈方法实时识别音频的音频事件类型，从而输出与该所述音频事件类型匹配的振动效果，所述触觉反馈方法应用到移动电子产品中，使所述移动电子产品能够根据所述音频事件类型输出该所述音频事件类型匹配的振动效果，弥补了在特定场景下音频与视觉反馈的低效问题，实现实时的触觉反馈，提升用户的使用体验。
 附图说明
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其它的附图，其中：
图1为本发明触觉反馈方法的流程图；
图2为本发明触觉反馈方法的步骤S1的部分流程图；
图3为本发明触觉反馈方法的步骤S2的部分流程图。
 本发明的实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅是本发明的一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例，都属于本发明保护的范围。
请同时参阅图1~3所示，本发明提供一种触觉反馈方法，该触觉反馈方法可以应用于移动电子产品中，该方法包括如下步骤:
步骤S1、将包含已知音频事件类型的音频片段进行算法训练并得到算法模型；
进一步的，所述步骤S1中，具体包括：
步骤S11、提供包含已知音频事件类型的音频片段；
步骤S12、提取该音频片段的MFCC特征并作为支持向量机（SVM）算法的输入，并将该音频片段中包含的已知音频事件类型作为支持向量机（SVM）算法的输出，进行支持向量机（SVM）算法模型训练以得到所述算法模型。
步骤S2、获取音频，通过所述算法模型对所述音频进行识别以获取该音频中不同的音频事件类型，将该音频事件类型按预设规则匹配不同的振动效果作为触觉反馈输出。
进一步的，所述步骤S2中，具体包括：
步骤S21、获取音频并对该音频进行分帧，得到多帧音频片段；
具体的，在提取所述音频片段的MFCC特征之前，需要对所述音频依次进行预加重、分帧和加窗等预处理的工作，经过预处理后获得多帧所述音频片段。
步骤S22、提取每一所述音频片段的MFCC特征并输入至所述算法模型进行匹配识别，以获取每一所述音频片段的音频事件类型；
具体的，在所述步骤S22中，提取每一音频片段的MFCC特征包括：将每一所述音频片段顺次通过FFT傅里叶变换处理、梅尔频率滤波器组滤波处理、对数能量处理以及DCT求倒谱处理，以得到所述MFCC特征。
需要说明的是，每一所述音频片段包括一个所述音频事件类型。所述音频事件类型可以通过人为分类获得，在本实施方中，所述音频事件类型包括但不限于打枪、爆炸、物体碰撞、尖叫声或发动机轰鸣声中的任意一种类型。
步骤S23、根据获取的所述音频事件类型按预设规则匹配不同的振动效果并作为触觉反馈输出。
具体的，在步骤S23中，所述预设规则为：每一所述音频事件类型对应一个不同的振动效果。
值得一提的是，所述支持向量机（SVM）是一种基于统计学习理论的一种机器学习方法，在本实施方式中所述支持向量机（SVM）用以构建所述算法模型，并根据所述算法模型对所述音频进行识别以获取不同的所述音频事件类型，并输出该音频事件类型对应的振动效果，所述支持向量机（SVM）为本发明的触觉反馈方法实现实时识别音频提供了条件。
上述方法应用到所述移动电子产品时，可以根据实际应用场景定制独特的触觉反馈效果，本发明的触觉反馈方法实时识别所述移动电子产品的音频事件类型，从而为所述移动电子产品提供与该所述音频事件类型匹配的振动效果，达到增强所述移动电子产品游戏、音乐和视频的效果，直观无误地重建“机械”触感，弥补了在特定场景下音频与视觉反馈的低效问题，实现实时的触觉反馈，提升用户的使用体验。比如在移动游戏应用时，将触觉反馈技术应用到移动游戏中能够创造逼真的振感，如射击游戏中某种武器的后座力或爆炸时的冲击力，或乐器应用程序中弹动吉他琴弦时的振颤感；如当我们在玩某款钢琴应用时，在没有触觉反馈时只能通过声音来辨别乐曲声音，而加入了触觉反馈技术后则可以根据不同高音和低音提供不同的振动强度，从而模拟体验弹吉他的真实振感。又比如在音乐方面，可以根据音乐的节拍、重低音等特征匹配不同强度的振动，从而提升诸如来电提醒等通知效果、提供更加丰富的体验音乐旋律和节奏。再比如在视频方面，当我们在看一场电影时，如果设备支持触觉反馈技术，我们可以感受到设备会跟随场景的变化而产生相应的振动，这也是一种用户体验的提升。
与相关技术相比，本发明的触觉反馈方法实时识别音频的音频事件类型，从而输出与该所述音频事件类型匹配的振动效果，所述触觉反馈方法应用到移动电子产品中，使所述移动电子产品能够根据所述音频事件类型输出该所述音频事件类型匹配的振动效果，弥补了在特定场景下音频与视觉反馈的低效问题，实现实时的触觉反馈，提升用户的使用体验。
以上所述的仅是本发明的实施方式，在此应当指出，对于本领域的普通技术人员来说，在不脱离本发明创造构思的前提下，还可以做出改进，但这些均属于本发明的保护范围。

Claims (6)

  1. 一种触觉反馈方法，其特征在于，该方法包括如下步骤:
    步骤S1、将包含已知音频事件类型的音频片段进行算法训练并得到算法模型；
    步骤S2、获取音频，通过所述算法模型对所述音频进行识别以获取该音频中不同的音频事件类型，将该音频事件类型按预设规则匹配不同的振动效果作为触觉反馈输出。
  2. 根据权利要求1所述的触觉反馈方法，其特征在于，所述步骤S1中，具体包括：
    步骤S11、提供包含已知音频事件类型的音频片段；
    步骤S12、提取该音频片段的MFCC特征并作为支持向量机算法的输入，并将该音频片段中包含的已知音频事件类型作为支持向量机算法的输出，进行支持向量机算法模型训练以得到所述算法模型。
  3. 根据权利要求2所述的触觉反馈方法，其特征在于，所述步骤S2中，具体包括：
    步骤S21、获取音频并对该音频进行分帧，得到多帧音频片段；
    步骤S22、提取每一所述音频片段的MFCC特征并输入至所述算法模型进行匹配识别，以获取每一所述音频片段的音频事件类型；
    步骤S23、根据获取的所述音频事件类型按预设规则匹配不同的振动效果并作为触觉反馈输出。
  4. 根据权利要求3所述的触觉反馈方法，其特征在于，在所述步骤S22中，提取每一音频片段的MFCC特征包括：将每一所述音频片段顺次通过FFT傅里叶变换处理、梅尔频率滤波器组滤波处理、对数能量处理以及DCT求倒谱处理，以得到所述MFCC特征。
  5. 根据权利要求4所述的触觉反馈方法，其特征在于，每一所述音频片段包括一个所述音频事件类型。
  6. 根据权利要求5所述的触觉反馈方法，其特征在于，在步骤S23中，所述预设规则为：每一所述音频事件类型对应一个不同的振动效果。
PCT/CN2019/111097 2018-12-31 2019-10-14 触觉反馈方法 Ceased WO2020140552A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811651545.3 2018-12-31
CN201811651545.3A CN109871120A (zh) 2018-12-31 2018-12-31 触觉反馈方法

Publications (1)

Publication Number Publication Date
WO2020140552A1 true WO2020140552A1 (zh) 2020-07-09

Family

ID=66917398

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/111097 Ceased WO2020140552A1 (zh) 2018-12-31 2019-10-14 触觉反馈方法

Country Status (3)

Country Link
US (1) US11430307B2 (zh)
CN (1) CN109871120A (zh)
WO (1) WO2020140552A1 (zh)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109871120A (zh) * 2018-12-31 2019-06-11 瑞声科技(新加坡)有限公司 触觉反馈方法
CN110917613A (zh) * 2019-11-30 2020-03-27 吉林大学 一种基于振动触觉的游戏智能桌垫
CN115691548B (zh) * 2021-07-26 2025-08-22 中车株洲电力机车研究所有限公司 列车水箱水位定位方法、装置、设备及存储介质
CN114115538B (zh) * 2021-11-23 2026-03-20 瑞声开泰声学科技(上海)有限公司 一种触觉反馈数据处理方法、装置及计算机可读存储介质
CN114283848A (zh) * 2021-12-21 2022-04-05 高乃睿 一种交互方法、装置、设备及可读存储介质
CN115565546B (zh) * 2022-06-16 2025-08-05 上海灿羽信息科技有限公司 一种tens信号生成方法、装置、设备及介质
CN114897105B (zh) * 2022-06-16 2025-07-22 上海灿羽信息科技有限公司 基于多频带融合的tens信号生成方法、系统、设备及介质
CN115407875B (zh) * 2022-08-19 2026-01-20 瑞声开泰声学科技(上海)有限公司 触觉反馈效果的生成方法、系统及相关设备
CN116185167B (zh) * 2022-10-20 2025-10-24 瑞声开泰声学科技(上海)有限公司 音乐分轨匹配振动的触觉反馈方法、系统及相关设备
CN116185200A (zh) * 2023-03-02 2023-05-30 北京有竹居网络技术有限公司 触觉反馈内容的生成方法、装置、电子设备及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102509545A (zh) * 2011-09-21 2012-06-20 哈尔滨工业大学 一种实时声学事件检测系统及检测方法
CN103971702A (zh) * 2013-08-01 2014-08-06 哈尔滨理工大学 声音监控方法、装置及系统
CN104707331A (zh) * 2015-03-31 2015-06-17 北京奇艺世纪科技有限公司 一种游戏体感产生方法及装置
US20150268726A1 (en) * 2014-03-21 2015-09-24 Immersion Corporation Systems and methods for converting sensory data to haptic effects
CN107924238A (zh) * 2015-09-08 2018-04-17 朴栽成 根据频率变化提供实时振动的振动提供系统及其振动提供方法
CN109871120A (zh) * 2018-12-31 2019-06-11 瑞声科技(新加坡)有限公司 触觉反馈方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2529184A4 (en) * 2010-01-29 2016-03-09 Nokia Technologies Oy SYSTEMS, METHODS AND APPARATUSES FOR DELIVERING CONTEXT-BASED NAVIGATION SERVICES
US9030446B2 (en) * 2012-11-20 2015-05-12 Samsung Electronics Co., Ltd. Placement of optical sensor on wearable electronic device
US9449613B2 (en) * 2012-12-06 2016-09-20 Audeme Llc Room identification using acoustic features in a recording
US9691238B2 (en) * 2015-07-29 2017-06-27 Immersion Corporation Crowd-based haptics

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102509545A (zh) * 2011-09-21 2012-06-20 哈尔滨工业大学 一种实时声学事件检测系统及检测方法
CN103971702A (zh) * 2013-08-01 2014-08-06 哈尔滨理工大学 声音监控方法、装置及系统
US20150268726A1 (en) * 2014-03-21 2015-09-24 Immersion Corporation Systems and methods for converting sensory data to haptic effects
CN104707331A (zh) * 2015-03-31 2015-06-17 北京奇艺世纪科技有限公司 一种游戏体感产生方法及装置
CN107924238A (zh) * 2015-09-08 2018-04-17 朴栽成 根据频率变化提供实时振动的振动提供系统及其振动提供方法
CN109871120A (zh) * 2018-12-31 2019-06-11 瑞声科技(新加坡)有限公司 触觉反馈方法

Also Published As

Publication number Publication date
CN109871120A (zh) 2019-06-11
US11430307B2 (en) 2022-08-30
US20200211338A1 (en) 2020-07-02

Similar Documents

Publication Publication Date Title
WO2020140552A1 (zh) 触觉反馈方法
CN112309365B (zh) 语音合成模型的训练方法、装置、存储介质以及电子设备
KR101641418B1 (ko) 청각 주목도에 기반한 햅틱 신호 생성 방법 및 이를 위한 장치
CN113921022B (zh) 音频信号分离方法、装置、存储介质和电子设备
Yun et al. Generating real-time, selective, and multimodal haptic effects from sound for gaming experience enhancement
CN109615682A (zh) 动画生成方法、装置、电子设备及计算机可读存储介质
WO2020224322A1 (zh) 音乐文件的处理方法、装置、终端及存储介质
TW201503107A (zh) 語音控制系統、電子裝置及語音控制方法
CN114999441B (zh) 虚拟形象生成方法、装置、设备、存储介质以及程序产品
CN106778186A (zh) 一种用于虚拟现实交互设备的身份识别方法及装置
WO2017166651A1 (zh) 语音识别模型训练方法、说话人类型识别方法及装置
CN110215607A (zh) 基于电刺激的按摩方法和装置
CN106383676A (zh) 用于声音的即时光色渲染系统及其应用
WO2020008856A1 (ja) 情報処理装置、情報処理方法、および記録媒体
CN112331187B (zh) 多任务语音识别模型训练方法、多任务语音识别方法
WO2024082389A1 (zh) 音乐分轨匹配振动的触觉反馈方法、系统及相关设备
JP2021128252A (ja) 音源分離プログラム、音源分離装置、音源分離方法及び生成プログラム
CN119889310B (zh) 基于对话内容生成实时音频的方法、系统及电子设备
CN113823305A (zh) 一种音频中节拍器噪声抑制方法及系统
Altinsoy et al. Touchscreens and musical interaction
CN113450811B (zh) 对音乐进行通透处理的方法及设备
CN111696566B (zh) 语音处理方法、装置和介质
Yan et al. An Adaptive Musical Vibrotactile System (MuViT) for Modern Smartphones
WO2020176383A1 (en) Audio data with embedded tags for rendering customized haptic effects
Chauhan Auditory-tactile interaction using digital signal processing in musical instruments

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19906918

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19906918

Country of ref document: EP

Kind code of ref document: A1