WO2024089804A1 - Dispositif d'estimation de position, procédé d'estimation de position et programme - Google Patents

Dispositif d'estimation de position, procédé d'estimation de position et programme Download PDF

Info

Publication number
WO2024089804A1
WO2024089804A1 PCT/JP2022/039936 JP2022039936W WO2024089804A1 WO 2024089804 A1 WO2024089804 A1 WO 2024089804A1 JP 2022039936 W JP2022039936 W JP 2022039936W WO 2024089804 A1 WO2024089804 A1 WO 2024089804A1
Authority
WO
WIPO (PCT)
Prior art keywords
ear
open
user
type earphone
earphone
Prior art date
Application number
PCT/JP2022/039936
Other languages
English (en)
Japanese (ja)
Inventor
達也 加古
詩穂里 小塚
大将 千葉
弘章 伊藤
賢一 野口
Original Assignee
日本電信電話株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電信電話株式会社 filed Critical 日本電信電話株式会社
Priority to PCT/JP2022/039936 priority Critical patent/WO2024089804A1/fr
Publication of WO2024089804A1 publication Critical patent/WO2024089804A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K15/00—Acoustics not otherwise provided for
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones

Definitions

  • the present invention relates to technology for reproducing acoustic signals using open-ear earphones that do not block the ear canal.
  • Earphones are classified into canal-type earphones that block the ear canal, and open-ear-type earphones that do not.
  • Canal-type earphones have an "ear tip" shaped like an earplug attached to the tip of the earphone, which seals the ear canal. With canal-type earphones, it is necessary to select an ear tip that fits the size of the ear canal, but it is difficult for users to determine for themselves whether the ear tip is the optimal size.
  • Non-Patent Document 1 is known as a conventional technique for determining whether or not an optimal size canal-type earphone is being worn. Non-Patent Document 1 describes that by playing sound while the canal-type earphone is worn, it is possible to check whether the canal-type earphone is worn and sealing the ear canal.
  • Open-ear earphones are attached by hooking parts of the earphone onto the part of the auricle (the part of the ear that sticks outwards) called the concha. Open-ear earphones do not use ear tips, so there is no need to adjust the size.
  • the present invention aims to provide a position estimation device, a position estimation method, and a program that estimate whether an open-ear type earphone is correctly placed on the ear.
  • a position estimation device includes a memory unit that stores a resonant frequency f1 of a space formed by a user's ear and the open-ear type earphone, and an estimation unit that obtains a resonant frequency f2 of the space formed by the user's ear and the open-ear type earphone using a picked-up signal obtained by picking up a predetermined signal through a speaker included in the open-ear type earphone while the user is wearing the open-ear type earphone, and estimates that the open-ear type earphone is worn in an ideal position on the user's ear if the resonant frequencies f1 and f2 are equal, and the resonant frequency f1 is obtained using a picked-up signal obtained by picking up a predetermined signal through a speaker while the open-ear type earphone is worn in an ideal position on the user's ear.
  • the present invention has the effect of being able to estimate whether an open-ear type earphone including a speaker and a microphone is correctly placed on the ear without using any special device.
  • FIG. 1 is a diagram for explaining a simulation situation.
  • FIG. 13 is a diagram showing the relationship between space volume and resonant frequency.
  • FIG. 13 shows frequency characteristics measured while changing the position of the open-ear earphone.
  • FIG. 11 is a diagram showing an example of a mounting position.
  • FIG. 1 is a functional block diagram of a position estimation device according to a first embodiment.
  • FIG. 4 is a diagram showing an example of a processing flow of the position estimation device according to the first embodiment.
  • FIG. 13 is a diagram showing an example of the configuration of a computer to which the present technique is applied.
  • the resonance frequency between the open-ear earphone and the ear is used to estimate whether the earphone is worn correctly.
  • Open-ear earphones often have a microphone for voice capture in the housing, so that they can be used not only for listening to music, but also for voice calls and voice recognition when connected to a smartphone or PC.
  • the housing often also has a microphone for capturing environmental sounds in order to achieve noise cancellation, echo cancellation, etc.
  • the open-ear earphones according to this embodiment are considered to include a speaker and a microphone.
  • the phenomenon in which the resonant frequency changes depending on the volume of the space formed between the ear and the housing of the open-ear earphone is used to estimate whether the open-ear earphone is correctly placed on the ear.
  • a specific signal is played from a speaker included in the open-ear earphones, and the played sound is picked up by a microphone included in the open-ear earphones.
  • the resonant frequency that occurs in the space between the ear and the housing is found from the frequency characteristics of the picked-up acoustic signal, and from the found resonant frequency it is estimated whether the open-ear earphones are worn in the usual position (appropriate wearing position) or in a position different from the usual position (inappropriate wearing position).
  • FIG. 1 is a diagram for explaining the situation of the simulation
  • FIG. 2 is a diagram showing the relationship between the volume of the space and the resonant frequency.
  • the volume of the space 20 is changed by changing the position of the housing 10 of the open-ear type earphone.
  • the volume is changed every 200 mm 3 , and the frequency characteristics are obtained at 600 mm 3 to 1400 mm 3.
  • the sound pressure level at the eardrum position and the sound pressure level at a position 150 mm from the rear side of the housing are obtained.
  • the rear side of the housing is the surface opposite to the surface on which the earphone is worn
  • the position 150 mm from the rear side of the housing is a position 150 mm away from the rear side of the housing in the direction of the rear side of the housing as viewed from the center of the housing.
  • the position of the peak frequency that appears in the 10 kHz-11 kHz band shifted whether it was at the eardrum position or 150 mm from the rear of the housing. Note that the smaller the space, the more the position of the peak frequency shifts to a higher frequency. In this embodiment, by observing the position of this peak frequency, it is possible to determine whether the headphones are being worn in a different position than usual.
  • the resonant frequency is obtained by calculating the impulse response using the TSP method, and then calculating the resonant frequency from the impulse response.
  • a TSP Time Stretched Pulse
  • the stretched signal is compressed (impulse-converted) by convolving the time-reversed TSP signal with the picked-up signal to find the impulse response.
  • Figure 3 shows the frequency characteristics measured while changing the wearing position of the open-ear type earphone.
  • Figure 4 shows examples of wearing positions. Wearing positions 1 and 3 show examples when the open-ear type earphone is worn in a position different from the usual wearing position (inappropriate wearing position), and wearing positions 2 and 4 show examples when the open-ear type earphone is worn in the same position as the usual wearing position (appropriate wearing position).
  • This configuration it is possible to estimate whether the wearing position is correct from the speaker and microphone included in typical open-ear earphones without using special sensors, etc., and it is possible to solve the problem of open-ear earphones not being able to be worn in the appropriate position.
  • This invention is particularly useful for open-ear earphones that are attached behind the ears, where the wearing position is easily shifted.
  • FIG. 5 is a functional block diagram of the position estimation device according to the first embodiment, and FIG. 6 shows the processing flow thereof.
  • the position estimation device includes a generation unit 110, a storage unit 130, and an estimation unit 140.
  • the position estimation device is connected to the open-ear earphones 90 so as to be able to communicate with them via wired or wireless communication, and outputs a predetermined signal that is reproduced by a speaker 91 included in the open-ear earphones 90. Furthermore, the position estimation device receives as input a picked-up signal that is obtained by picking up the predetermined signal reproduced by the speaker 91 with a microphone 92 included in the open-ear earphones 90.
  • the position estimation device estimates the wearing position of the open-ear earphones from the picked-up sound signal and outputs the estimation result.
  • the location estimation device is a special device configured by loading a special program into a publicly known or dedicated computer having, for example, a central processing unit (CPU), a main memory (RAM), etc.
  • the location estimation device executes each process under the control of the central processing unit, for example.
  • Data input to the location estimation device and data obtained by each process are stored in, for example, the main memory, and the data stored in the main memory is read out to the central processing unit as necessary and used for other processes.
  • At least a part of each processing unit of the location estimation device may be configured with hardware such as an integrated circuit.
  • Each storage unit of the location estimation device may be configured with, for example, a main storage device such as a RAM (Random Access Memory), or middleware such as a relational database or a key-value store.
  • each storage unit does not necessarily have to be provided inside the location estimation device, and may be configured with an auxiliary storage device configured with a semiconductor memory element such as a hard disk, optical disk, or flash memory, and may be configured to be
  • the estimation process consists of a preparation stage, which is carried out before estimating the mounting position, and an estimation stage. First, the preparation stage will be explained.
  • a user of the open-ear type earphones wears the open-ear type earphones in the ideal position (appropriate wearing position) of the auricle. Whether or not the earphones are worn in the ideal position may be judged subjectively by the user, or may be judged objectively by a third party with specialized knowledge who checks the wearing position.
  • the generating unit 110 generates a predetermined signal to be played by the speaker 91 (S101) and outputs the signal to the speaker 91.
  • the predetermined signal is a TSP signal.
  • the sound played by the speaker 91 is picked up by the microphone 92 (S105).
  • the estimation unit 140 receives a collected sound signal obtained by collecting sound with the microphone 92 as an input, obtains the resonance frequency f2 of the space formed by the user's ear and the open-ear type earphone using the collected sound signal (S109), and stores the frequency in the storage unit 130 (S111).
  • the estimation unit 140 obtains an impulse response by compressing (impulsing) the extended signal by convolving the time-reversed TSP signal with the collected sound signal using the TSP method, and obtains the resonance frequency f2 from the impulse response.
  • the preparation stage includes the above steps S101 to S111. Next, the estimation stage will be explained.
  • ⁇ Estimation stage> First, a user of the open-ear type earphones places the open-ear type earphones on the auricle.
  • the generating unit 110 generates a predetermined signal to be played by the speaker 91 (S201) and outputs it to the speaker 91.
  • the predetermined signal is the same as the signal used in the preparation stage.
  • a predetermined signal is played through the speaker 91 (S203).
  • the sound played by the speaker 91 is picked up by the microphone 92 (S205).
  • the estimation unit 240 receives the collected sound signal obtained by collecting sound with the microphone 92 as an input, and obtains the resonance frequency f 1 of the space formed by the user's ear and the open-ear earphone using the collected sound signal (S209).
  • the method of obtaining the resonance frequency from the collected sound signal is the same as that in the preparation stage.
  • the estimation unit 240 refers to the resonance frequency f 2 stored in the storage unit 130, and if the resonance frequencies f 1 and f 2 match (YES in S211), it estimates that the open-ear earphone is attached to the ideal position of the user's ear, and outputs an estimation result indicating that the wearing position is appropriate (S213).
  • the estimation unit 240 estimates that the open-ear earphone is not attached to the ideal position of the user's ear, and outputs an estimation result indicating that the wearing position is inappropriate (S215).
  • the resonance frequencies f 1 and f 2 match not only when they match completely, but also when the difference between the resonance frequencies f 1 and f 2 is within a predetermined range. In actual use, even if the open-ear type earphone is worn in an appropriate position, the position may change slightly, and the resonant frequency may change slightly accordingly. Therefore, when the difference between the resonant frequencies f1 and f2 falls within the range that can be considered to be the ideal position, the resonant frequencies f1 and f2 are considered to be the same.
  • the location estimation device is implemented on a smartphone.
  • a position estimation application is started automatically or by user operation, and a preparatory process is performed.
  • the position estimation device When the application is launched, the position estimation device displays a message on the smartphone's touch panel encouraging the user to place the open-ear earphones 90 in an appropriate position and play a specific signal. For example, the position estimation device displays a play button along with the message "Put the open-ear earphones 90 in an appropriate position and tap the 'Play' button.”
  • the position estimation device When an operation intended to play a predetermined signal is performed (for example, when the "play" button is tapped), the position estimation device generates a predetermined signal (S101) and plays it on the speaker 91 (S103). Furthermore, the sound played on the speaker 91 is collected by the microphone 92 (S105), and the position estimation device obtains a resonance frequency f2 using the collected sound signal (S109) and stores it in the storage unit 130 (S111). If the obtained resonance frequency f2 is within an appropriate range, the position estimation device displays a message on the touch panel of the smartphone indicating that preparation for position estimation is complete.
  • the position estimation device displays a message saying "The appropriate position of the open-ear type earphone 90 has been registered.” If the obtained resonance frequency f2 is not within the appropriate range, the position estimation device displays a message on the touch panel of the smartphone indicating that position estimation is not complete. For example, the position estimation device displays a play button along with a message saying "The open-ear type earphone 90 is not attached in an appropriate position. Please attach it in an appropriate position and tap the 'Play' button again," and repeats the above-mentioned processes S101 to S111. Note that the appropriate range of the resonance frequency f2 may be obtained in advance by experiment or simulation, taking into account various ear shapes and sizes.
  • a position estimation application is started automatically or by user operation, and the estimation stage processing is performed.
  • the position estimation device When the application is started, the position estimation device automatically generates a predetermined signal (S201) and plays it on the speaker 91 (S203). Furthermore, the sound played on the speaker 91 is collected by the microphone 92 (S205), and the collected sound signal is used to obtain the resonance frequency f1 (S209). If the obtained resonance frequency f1 matches the resonance frequency f2 stored in the storage unit 130 (YES in S211), the position estimation device may display a message indicating that the open-ear type earphone 90 is attached in an appropriate position on the touch panel of the smartphone, or may not display any message (in this case, the absence of any message means that the open-ear type earphone 90 is attached in an appropriate position).
  • the position estimation device displays a message indicating that the open-ear type earphone 90 is not attached in an appropriate position on the touch panel of the smartphone, as well as a message urging the user to reattach the open-ear type earphone 90 to an appropriate position.
  • the position estimation device displays a completion button along with a message saying, "The open-ear type earphones 90 are not attached in an appropriate position. Please put them back in an appropriate position and tap the 'Done'button.” When the 'Done' button is tapped, the above-mentioned processes S201 to S211 are repeated.
  • the predetermined signal is generated by the generating unit 110, but a configuration may be adopted in which a predetermined signal generated in advance is stored in a storage unit (not shown) and output to the speaker 91. In this case, the position estimation device does not need to include the generating unit 110.
  • the present invention is not limited to the above-mentioned embodiment and modified examples.
  • the above-mentioned various processes may be executed not only in chronological order as described, but also in parallel or individually depending on the processing capacity of the device executing the processes or as necessary.
  • appropriate modifications are possible within the scope of the present invention.
  • ⁇ Program and recording medium> The various processes described above can be implemented by loading a program that executes each step of the above method into the recording unit 2020 of the computer 2000 shown in FIG. 7, and operating the control unit 2010, input unit 2030, output unit 2040, display unit 2050, etc.
  • the program describing this processing can be recorded on a computer-readable recording medium.
  • Examples of computer-readable recording media include magnetic recording devices, optical disks, magneto-optical recording media, and semiconductor memories.
  • the program may be distributed, for example, by selling, transferring, or lending portable recording media such as DVDs or CD-ROMs on which the program is recorded. Furthermore, the program may be distributed by storing the program in a storage device of a server computer and transferring the program from the server computer to other computers via a network.
  • a computer that executes such a program for example, first stores in its own storage device the program recorded on a portable recording medium or the program transferred from a server computer. Then, when executing a process, the computer reads the program stored on its own recording medium and executes the process according to the read program. As another execution form of the program, the computer may read the program directly from the portable recording medium and execute the process according to the program, or may execute the process according to the received program each time a program is transferred from the server computer to the computer.
  • the above-mentioned process may also be executed by a so-called ASP (Application Service Provider) type service that does not transfer the program from the server computer to the computer, but realizes the processing function only by issuing an execution instruction and obtaining the results.
  • ASP Application Service Provider
  • the program in this form includes information used for processing by an electronic computer that is equivalent to a program (such as data that is not a direct command to the computer but has properties that specify the processing of the computer).
  • the device is configured by executing a specific program on a computer, but at least a portion of the processing may be realized by hardware.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Headphones And Earphones (AREA)

Abstract

L'invention concerne un dispositif d'estimation de position et analogue permettant d'estimer si une position d'un écouteur laissant l'oreille ouverte et porté sur l'oreille est correcte ou non. Le dispositif d'estimation de position comprend : une unité de stockage qui stocke une fréquence de résonance f1 d'un espace formé entre l'oreille d'un utilisateur et l'écouteur laissant l'oreille ouverte ; et une unité d'estimation qui obtient une fréquence de résonance f2 de l'espace formé entre l'oreille de l'utilisateur et ledit écouteur par l'utilisation d'un signal de collecte de son obtenu par un microphone, inclus dans ledit écouteur, collectant le son lorsqu'un signal prédéterminé est reproduit par un haut-parleur inclus dans ledit écouteur, dans un état dans lequel ledit écouteur est porté par l'utilisateur, et estime, lorsque les fréquences de résonance f1 et f2 correspondent, que ledit écouteur est porté à une position idéale sur l'oreille de l'utilisateur. La fréquence de résonance f1 est obtenue par l'utilisation d'un signal de collecte de son acquis par la collecte de son à l'aide du microphone lorsque le signal prédéterminé est reproduit par le haut-parleur dans l'état dans lequel l'écouteur laissant l'oreille ouverte est porté à la position idéale sur l'oreille de l'utilisateur.
PCT/JP2022/039936 2022-10-26 2022-10-26 Dispositif d'estimation de position, procédé d'estimation de position et programme WO2024089804A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/039936 WO2024089804A1 (fr) 2022-10-26 2022-10-26 Dispositif d'estimation de position, procédé d'estimation de position et programme

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/039936 WO2024089804A1 (fr) 2022-10-26 2022-10-26 Dispositif d'estimation de position, procédé d'estimation de position et programme

Publications (1)

Publication Number Publication Date
WO2024089804A1 true WO2024089804A1 (fr) 2024-05-02

Family

ID=90830369

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/039936 WO2024089804A1 (fr) 2022-10-26 2022-10-26 Dispositif d'estimation de position, procédé d'estimation de position et programme

Country Status (1)

Country Link
WO (1) WO2024089804A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019062342A (ja) * 2017-09-26 2019-04-18 株式会社Ｊｖｃケンウッド 信号処理装置、信号処理方法、及びプログラム
WO2022118526A1 (fr) * 2020-12-04 2022-06-09 パナソニックＩｐマネジメント株式会社 Écouteur et procédé d'ajustement du port
JP2022145772A (ja) * 2017-09-26 2022-10-04 カシオ計算機株式会社 音響機器、音響機器の制御方法及び制御プログラム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019062342A (ja) * 2017-09-26 2019-04-18 株式会社Ｊｖｃケンウッド 信号処理装置、信号処理方法、及びプログラム
JP2022145772A (ja) * 2017-09-26 2022-10-04 カシオ計算機株式会社 音響機器、音響機器の制御方法及び制御プログラム
WO2022118526A1 (fr) * 2020-12-04 2022-06-09 パナソニックＩｐマネジメント株式会社 Écouteur et procédé d'ajustement du port

Similar Documents

Publication Publication Date Title
US10599389B2 (en) Adaptive receiver
EP2202998B1 (fr) Dispositif et procédé pour le traitement de données audio
CN106664473B (zh) 信息处理装置、信息处理方法和程序
CN102656903B (zh) 音频处理装置
US20060093159A1 (en) Method and apparatus to compensate for frequency characteristic of earphones
CN100525101C (zh) 使用波束形成算法来记录信号的方法和设备
US8315399B2 (en) Device for and a method of processing audio data
WO2017195616A1 (fr) Dispositif et procédé de traitement d'informations
US9525954B2 (en) Audio device and audio producing method
CN113574593A (zh) 调谐方法、制造方法、计算机可读存储介质和调谐系统
US20130044901A1 (en) Microphone arrays and microphone array establishing methods
TWI773382B (zh) 耳機及耳機狀態檢測方法
TW201118719A (en) System and method for modifying an audio signal
WO2024089804A1 (fr) Dispositif d'estimation de position, procédé d'estimation de position et programme
JP5112545B1 (ja) 情報処理装置および同装置の音響信号処理方法
TWI746001B (zh) 頭戴式裝置及其立體音效控制方法
US11516600B2 (en) Feedback control using a correlation measure
TWI837867B (zh) 聲音補償方法及頭戴式裝置
WO2023013019A1 (fr) Dispositif de rétroaction de parole, procédé de rétroaction de parole et programme
Brunet et al. New trends in modeling and identification of loudspeaker with nonlinear distortion
KR20230057333A (ko) 휴대용 노래방을 위한 저복잡도 하울링 억제
Collins et al. In/Out: Speaker as Microphone, Microphone as Speaker, the Symmetry of It All
JP2023153700A (ja) 音響システム、及びイヤホン
TW202416009A (zh) 聲音補償方法及頭戴式裝置
JP2021048553A (ja) 基音周波数決定装置、疑似低音処理装置、基音周波数決定方法および音響処理方法