WO2022176075A1 - Dispositif de commande de position de perception de vibration, procédé de commande de position de perception de vibration et programme - Google Patents

Dispositif de commande de position de perception de vibration, procédé de commande de position de perception de vibration et programme Download PDF

Info

Publication number
WO2022176075A1
WO2022176075A1 PCT/JP2021/005981 JP2021005981W WO2022176075A1 WO 2022176075 A1 WO2022176075 A1 WO 2022176075A1 JP 2021005981 W JP2021005981 W JP 2021005981W WO 2022176075 A1 WO2022176075 A1 WO 2022176075A1
Authority
WO
WIPO (PCT)
Prior art keywords
vibration
sound
position control
perception position
control device
Prior art date
Application number
PCT/JP2021/005981
Other languages
English (en)
Japanese (ja)
Inventor
十季 武田
有信 新島
幸生 小池
Original Assignee
日本電信電話株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電信電話株式会社 filed Critical 日本電信電話株式会社
Priority to PCT/JP2021/005981 priority Critical patent/WO2022176075A1/fr
Publication of WO2022176075A1 publication Critical patent/WO2022176075A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones

Definitions

  • the present invention relates to a vibration perception position control device, a vibration perception position control method, and a program.
  • Non-Patent Document 1 discloses a glove-type device composed of five vibrators for presenting vibrations to fingers corresponding to a melody as research on learning support for piano performance using vibrations. .
  • the disclosed technology aims to make one vibrator feel multiple vibration sources.
  • the disclosed technique includes a sound image localization setting unit that performs settings for localizing a sound image in a driving signal of an acoustic device based on information indicating the direction of the sound source of each sound included in the sound data, and a vibration indication of the vibration device.
  • a vibration signal generation unit that generates a vibration signal based on information;
  • a synchronization control unit that performs control for synchronizing the timing of generating sound and vibration;
  • a sound control unit that controls the acoustic device according to the drive signal; a vibration control unit that controls vibration of the vibration device according to a vibration signal.
  • a single transducer can make you feel multiple vibration sources.
  • FIG. 1 is a functional configuration diagram of a vibration perception position control device;
  • FIG. 7 is a flowchart showing an example of the flow of vibration perception position control processing;
  • FIG. 4 is a diagram for explaining localization information and vibration parameter information;
  • FIG. 1 is a diagram showing an example of the appearance of a vibration perception position control device.
  • the vibration perception position control device 10 is a device for making the user perceive vibration when held by the user's fingers.
  • An xy coordinate system is defined as shown in the figure for explaining the processing to be described later.
  • FIG. 2 is a diagram showing an example of how to hold the vibration perception position control device.
  • the user holds the vibration perception position control device 10 with the thumb, middle finger, and little finger of the right hand.
  • the vibration perception position control device 10 generates sound and vibration through processing to be described later, and utilizes a human illusion to perceive that any combination of the thumb, middle finger, and little finger is vibrating. That is, the vibration perception position control device 10 can cause the perception that only the thumb is vibrating, or that the thumb and middle finger are vibrating, or that the thumb, middle finger, and little finger are vibrating. It can also be perceived as vibrating.
  • the gripping method described above is just an example, and the part of the body to be contacted may be other than the finger, and may be contacted via a medium. Further, the user does not need to hold the vibration perception position control device 10, and may touch the vibration perception position control device 10 installed on a wall, a desk, or the like, for example.
  • FIG. 3 is a diagram showing a hardware configuration example of the vibration perception position control device.
  • the vibration perception position control device 10 includes a CPU 101, a memory 102, a communication device 103, a sound device 104, and a vibration device 105, which are interconnected via a bus.
  • the memory 102 stores programs and the like that describe the processing details described in the present embodiment.
  • the CPU 101 executes processing described in programs stored in the memory 102 .
  • the communication device 103 is a device for transmitting and receiving signals to and from other devices.
  • the audio device 104 is, for example, a speaker capable of stereo reproduction, and is a device that receives a drive signal and generates sound. Note that the vibration perception position control device 10 does not have to include the acoustic device 104, in which case the drive signal is transmitted to external headphones, earphones, or the like.
  • the vibration device 105 is a device that receives a vibration signal and generates vibration.
  • the vibrating device 105 may be composed of one oscillator, or may be composed of a plurality of oscillators.
  • FIG. 4 is a functional configuration diagram of the vibration perception position control device.
  • the vibration perception position control device 10 includes a localization information acquisition unit 11, a vibration parameter information acquisition unit 12, a sound image localization setting unit 13, a vibration signal generation unit 14, a synchronization control unit 15, a sound control unit 16, a vibration A control unit 17 is provided. These units are realized by a CPU 101 and a memory 102 that constitute a computer. Specifically, each unit is implemented by CPU 101 executing processing described in a program stored in memory 102 .
  • the localization information acquisition unit 11 acquires localization information.
  • the localization information is information indicating the direction of the sound source of each sound included in the sound data.
  • the localization information is information that associates a value indicating the time at which each sound included in the sound data is generated with a value indicating the angle of the direction of the sound source with respect to the positive x-axis direction in the xy coordinates. is.
  • the vibration parameter information acquisition unit 12 acquires vibration parameter information.
  • the vibration parameter information is information indicating the vibration of the vibrating device 105, and is information indicating the vibration of each vibrator when the vibrating device 105 is composed of a plurality of vibrators.
  • the sound image localization setting unit 13 makes settings for localizing the sound image in the driving signal of the acoustic device 104 .
  • the audio device 104 is an external device such as headphones or earphones
  • the relative positional relationship between the user and the vibration perception position control device 10, such as the holding posture of the vibration perception position control device 10 is assumed in advance. shall be For example, by holding the vibration perception position control device 10 with one hand with the back of the hand facing upward or downward, the positive direction of the x-axis corresponds to the right direction, and the positive direction of the y-axis corresponds to the front direction of the body. Corresponding gripping may be envisaged.
  • the localization setting unit 13 sets so that only the earphone that is brought into contact with the right ear emits sound.
  • the setting for localizing the sound image may be a known method, for example, a setting that adjusts the sound volume of a plurality of speakers or the like.
  • the vibration signal generator 14 generates a vibration signal based on the vibration parameter information. Note that when the vibration device 105 includes a plurality of vibrators, a vibration signal is generated for each vibrator. The vibration signal generator 14 generates a vibration signal that attenuates a sine wave of 100 Hz within 0.15 seconds, for example.
  • the synchronization control unit 15 performs control to synchronize the timing of generating sound and vibration.
  • the localization information and the vibration parameter information are information specified in chronological order, and the times at which sound and vibration are to be generated are specified. Synchronization control is performed according to the specified time.
  • the sound control unit 16 controls the acoustic device 104 according to the drive signal at the timing controlled by the synchronization control unit 15 .
  • the vibration control section 17 controls the vibration of the vibration device 105 according to the vibration signal at the timing controlled by the synchronization control section 15 .
  • FIG. 5 is a flowchart showing an example of the flow of vibration perception position control processing.
  • the vibration perception position control device 10 starts the vibration perception position control processing when the power is turned on or an instruction is received via the communication device 103 or the like.
  • the vibration perception position control device 10 may store the data indicating the pitch of the sound for each time in the memory 102 in advance, or may receive the data via the communication device 103 or the like.
  • the localization information acquisition unit 11 acquires localization information via the communication device 103 (step S1).
  • the localization information is information that includes combinations of times and angles ⁇ in time series.
  • the angle ⁇ is the angle of the sound source with respect to the positive direction of the x-axis.
  • An example of localization information is ((t1, -90), (t2, 0), (t3, 90)).
  • the sound image localization setting unit 13 performs settings for localizing the sound image based on the localization information (step S2).
  • the vibration parameter information acquisition unit 12 acquires vibration parameter information via the communication device 103 or the like (step S3).
  • the vibration parameter information is information that includes, in time series, combinations of times and identifiers indicating transducers (hereinafter referred to as transducer IDs). If there is one oscillator, the oscillator ID may be omitted.
  • An example of vibration parameter information is ((t1, v2), (t2, v1, v2)).
  • v1 and v2 are examples of transducer IDs.
  • the vibration device 105 vibrates the vibrator v2 at the time t1, and vibrates the vibrators v1 and v2 at the time t2.
  • the vibration signal generator 14 generates a vibration signal based on the vibration parameter information (step S4). Subsequently, when the vibrating device 105 is composed of a plurality of vibrators, the vibration signal generator 14 assigns vibrations to each vibrator (step S5). That is, the vibration signal generator 14 generates a vibration signal for each vibrator. Note that if the vibrating device 105 is composed of one vibrator, the vibrating signal generator 14 does not have to execute the process of step S5.
  • the synchronization control unit 15 synchronizes the timing of sound and vibration (step S6). Specifically, the synchronization control unit 15 performs synchronization control according to the designation of the time indicated by the localization information and the vibration parameter information.
  • the sound control section 16 and the vibration control section 17 control sound and vibration at the timing controlled by the synchronization control section 15 (step S7). Specifically, the sound control unit 16 controls the acoustic device 104 according to the drive signal at the timing controlled by the synchronization control unit 15 . Further, the vibration control section 17 controls the vibration of the vibration device 105 according to the vibration signal at the timing controlled by the synchronization control section 15 .
  • FIG. 6 is a diagram for explaining localization information and vibration parameter information.
  • Localization information corresponding to FIG. 6 is, for example, ((t1, -90), (t2, 0), (t3, 90), (t4, 0)).
  • the vibration parameter information is, for example, ((t1, v2), (t2, v1, v2), (t3, v1), (t4, v1, v2)).
  • the acoustic device 104 Based on the localization information and the vibration parameter information described above, at time t1, the acoustic device 104 emits sound so that the direction of -90 degrees seems to be the sound source, and the vibrator v1 included in the vibration device 105 does not vibrate. , vibrator v2 oscillates.
  • the acoustic device 104 emits sound so that the direction of 0 degrees is felt as the sound source, and the vibrator v1 and the vibrator v2 included in the vibration device 105 vibrate.
  • the acoustic device 104 emits sound so that the sound source is felt to be in the direction of 90 degrees, the vibrator v1 included in the vibration device 105 vibrates, and the vibrator v2 does not vibrate.
  • the acoustic device 104 emits sound so that the direction of 0 degrees is felt as the sound source, and the vibrator v1 and the vibrator v2 included in the vibration device 105 vibrate.
  • part of the various information described above may be in a format conforming to the MIDI (Musical Instrument Digital Interface) standard.
  • MIDI Musical Instrument Digital Interface
  • vibration perception position control device 10 According to the vibration perception position control device 10 according to the present embodiment, sound and vibration can be synchronized, and the direction of the sound source can be set for each sound. As a result, it is possible to create an illusion that a location corresponding to the direction of each sound source is vibrating.
  • the sound image localization setting unit 13 selects one of the specified fingers among the plurality of fingers. Settings are made to localize the sound image so that the combined fingers are vibrating. Specifically, the combination of fingers that causes the sense of vibration is defined by information indicating the direction of the sound source and the premise of how the fingers are in contact with each other. Then, the sound image localization setting unit 13 sets the drive signal of the acoustic device 104 to localize the sound image so that the direction from the vibrating device 105 to the finger whose vibration is to be perceived is the direction of the sound source. This allows the user to feel that the specified finger is vibrating.
  • the vibration signal generation unit 14 described above may generate vibration signals such that the strength of vibration corresponding to each sound repeats strength and weakness. This makes it possible for the user to feel that something has changed for each sound, making it easier for the user to have the illusion that the location corresponding to the direction of each sound source is vibrating.
  • the vibration perception position control device 10 may be, for example, a mobile terminal such as a smartphone. In that case, each process described above may be defined in an application program installed in a smartphone or the like.
  • This specification describes at least a vibration perception position control device, a vibration perception position control method, and a program described in each of the following items.
  • (Section 1) a sound image localization setting unit that performs settings for localizing a sound image in a driving signal of the acoustic device based on information indicating the direction of the sound source of each sound included in the sound data; a vibration signal generator that generates a vibration signal based on information indicated by the vibration of the vibration device; a synchronization control unit that performs control for synchronizing the timing of generating sound and vibration; a sound control unit that controls the audio device according to the drive signal; a vibration control unit that controls vibration of the vibration device according to the vibration signal; Vibration perception position control device.
  • the sound image localization setting unit when the contact positions and the gripping postures of the plurality of fingers gripping the vibration perception position control device are predetermined positions and postures, making settings for localizing the sound image so that the combined fingers are felt to vibrate;
  • the vibration perception position control device according to claim 1.
  • the sound image localization setting unit performs setting for localizing the sound image in the drive signal so that the direction from the vibrating device toward the finger whose vibration is to be perceived is the direction of the sound source.
  • the vibration perception position control device according to claim 2. (Section 4)
  • the vibration signal generation unit generates the vibration signal such that the strength of vibration corresponding to each sound repeats strength and weakness.
  • the vibration perception position control device according to any one of items 1 to 3.
  • the vibrating device is composed of one vibrator, The vibration perception position control device according to any one of items 1 to 4.
  • the vibrating device is composed of a plurality of vibrators, The vibration signal generation unit generates a vibration signal based on information indicating vibration of each transducer included in the plurality of transducers.
  • the vibration perception position control device according to any one of items 1 to 4.
  • (Section 7) A method performed by a device for controlling the perceived position of vibration, comprising: a step of making settings for localizing a sound image in a driving signal of the acoustic device based on information indicating the direction of the sound source of each sound contained in the sound data; generating a vibration signal based on the information indicative of the vibration of the vibration device; a step of performing control for synchronizing the timing of generating sound and vibration; controlling the acoustic device according to the drive signal; and controlling vibration of the vibration device according to the vibration signal.
  • Vibration perception position control method A program for causing a computer to function as each unit in the vibration perception position control device according to any one of items 1 to 6.
  • vibration perception position control device 11 localization information acquisition unit 12 vibration parameter information acquisition unit 13 sound image localization setting unit 14 vibration signal generation unit 15 synchronization control unit 16 sound control unit 17 vibration control unit

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)

Abstract

La présente invention concerne un dispositif de commande de position de perception de vibration comprenant une unité de réglage de localisation d'image sonore qui effectue un réglage pour un signal de commande d'un dispositif sonore pour localiser une image sonore sur la base d'informations indiquant des directions de sources sonores de sons inclus dans des données sonores, une unité de génération de signal de vibration qui génère un signal de vibration sur la base d'informations indiquées par la vibration d'un dispositif de vibration, une unité de commande de synchronisation qui effectue une commande pour synchroniser le moment de la génération des sons et le moment de la génération de la vibration, une unité de commande de son qui commande le dispositif sonore en fonction du signal d'attaque, et une unité de commande de vibration qui commande la vibration du dispositif de vibration en fonction du signal de vibration.
PCT/JP2021/005981 2021-02-17 2021-02-17 Dispositif de commande de position de perception de vibration, procédé de commande de position de perception de vibration et programme WO2022176075A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/005981 WO2022176075A1 (fr) 2021-02-17 2021-02-17 Dispositif de commande de position de perception de vibration, procédé de commande de position de perception de vibration et programme

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/005981 WO2022176075A1 (fr) 2021-02-17 2021-02-17 Dispositif de commande de position de perception de vibration, procédé de commande de position de perception de vibration et programme

Publications (1)

Publication Number Publication Date
WO2022176075A1 true WO2022176075A1 (fr) 2022-08-25

Family

ID=82930357

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/005981 WO2022176075A1 (fr) 2021-02-17 2021-02-17 Dispositif de commande de position de perception de vibration, procédé de commande de position de perception de vibration et programme

Country Status (1)

Country Link
WO (1) WO2022176075A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015228054A (ja) * 2014-05-30 2015-12-17 和俊 尾花 情報処理システム、情報処理装置、情報処理プログラム、および情報処理方法
WO2017175868A1 (fr) * 2016-04-07 2017-10-12 国立研究開発法人科学技術振興機構 Dispositif de conversion d'informations tactiles, procédé de conversion d'informations tactiles, programme de conversion d'informations tactiles et structure d'agencement d'éléments
WO2019124068A1 (fr) * 2017-12-19 2019-06-27 ソニー株式会社 Programme, procédé et dispositif de traitement d'informations

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015228054A (ja) * 2014-05-30 2015-12-17 和俊 尾花 情報処理システム、情報処理装置、情報処理プログラム、および情報処理方法
WO2017175868A1 (fr) * 2016-04-07 2017-10-12 国立研究開発法人科学技術振興機構 Dispositif de conversion d'informations tactiles, procédé de conversion d'informations tactiles, programme de conversion d'informations tactiles et structure d'agencement d'éléments
WO2019124068A1 (fr) * 2017-12-19 2019-06-27 ソニー株式会社 Programme, procédé et dispositif de traitement d'informations

Similar Documents

Publication Publication Date Title
JP6908686B2 (ja) 音響の包括的な知覚のための装置
US10339772B2 (en) Sound to haptic effect conversion system using mapping
US9753537B2 (en) Apparatus, information processing program, system, and method for controlling vibrations to be imparted to a user of an apparatus
US10796540B2 (en) Information processing system, information processing apparatus, storage medium having stored therein information processing program, and information processing method
US9785236B2 (en) Haptic interface for portable electronic device
EP3564789A1 (fr) Système de déformation haptique transformant un signal haptique dans un ensemble de motifs d'effets haptiques vibrotactiles
US11966513B2 (en) Haptic output systems
JP2010502086A (ja) ハプティックな刺激を発生させるために音声信号及び／又はビデオ信号を処理するデバイス及び方法
WO2017128481A1 (fr) Procédé de commande d'ostéophone, dispositif et appareil d'ostéophone
WO2019038888A1 (fr) Dispositif de commande de vibration
JP6757853B2 (ja) 知覚可能な低音レスポンス
WO2022176075A1 (fr) Dispositif de commande de position de perception de vibration, procédé de commande de position de perception de vibration et programme
US10198920B1 (en) Wearable electronic device including audio output transducer and haptic actuator driving and related methods
WO2023112144A1 (fr) Appareil, procédé et programme de commande de position de détection de vibration
WO2018066299A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations et programme
JP2018064216A (ja) 力覚データ生成装置、電子機器、力覚データ生成方法、および制御プログラム
US11688255B2 (en) Methods and systems applied to transposing audio signals to haptic stimuli in the body for multichannel immersion
JP2015032994A (ja) 電子機器及びプログラム
WO2022264537A1 (fr) Dispositif de génération de signal haptique, procédé de génération de signal haptique, et programme
CN113163302B (zh) 真无线多声道扬声装置及其多音源发声的方法
JP7109552B2 (ja) デュアルパネルオーディオアクチュエータおよびこれを含むモバイル装置
JP7440683B1 (ja) 入力デバイス及び情報処理システム
WO2022153822A1 (fr) Dispositif de production de signal vibratoire
WO2022215129A1 (fr) Dispositif de sortie de vibration, procédé de sortie de vibration et programme
CN115460532A (zh) 音频输出控制方法、头戴设备及计算机可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21926514

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21926514

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP