CN113709653A - Directional location listening method, hearing device, program product and medium - Google Patents

Directional location listening method, hearing device, program product and medium Download PDF

Info

Publication number
CN113709653A
CN113709653A CN202110984816.2A CN202110984816A CN113709653A CN 113709653 A CN113709653 A CN 113709653A CN 202110984816 A CN202110984816 A CN 202110984816A CN 113709653 A CN113709653 A CN 113709653A
Authority
CN
China
Prior art keywords
sound
user
sounding
target
sounding body
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110984816.2A
Other languages
Chinese (zh)
Other versions
CN113709653B (en
Inventor
米波
王承谦
孙小越
张兴金
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Techology Co Ltd
Original Assignee
Goertek Techology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Techology Co Ltd filed Critical Goertek Techology Co Ltd
Priority to CN202110984816.2A priority Critical patent/CN113709653B/en
Publication of CN113709653A publication Critical patent/CN113709653A/en
Application granted granted Critical
Publication of CN113709653B publication Critical patent/CN113709653B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/302Electronic adaptation of stereophonic sound system to listener position or orientation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/20Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/403Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers loud-speakers

Abstract

The invention discloses a directional positioning listening method, a hearing device, a program product and a medium, wherein the method comprises the following steps: acquiring a plurality of sound-producing bodies within a recognizable range of a hearing device; acquiring a target sounding body in a plurality of sounding bodies; performing an amplification operation on the sound signal of the target sounding body, and performing a cancellation operation on the sound signals of the other sounding bodies except the target sounding body; the invention realizes that the user can quickly select the sound of the target sound-producing body to be heard in a noisy environment, amplify the sound of the target sound-producing body and shield the sounds of other sound-producing bodies, thereby enabling the user to clearly hear the sound of the target sound-producing body and eliminate the interference of other sounds, and meeting the requirements of clear listening and conversation between the user and the target sound-producing body.

Description

Directional location listening method, hearing device, program product and medium
Technical Field
The present invention relates to the field of directional location listening technology, and in particular, to a directional location listening method, a hearing device, a program product, and a medium.
Background
In the prior art, a user often can only realize the listening of high quality and low interference of digital media by using a hearing device with a noise reduction function, and for a plurality of pronunciation main bodies in a real environment, the noise reduction technology in the prior art can reduce the noise of the sounds of all the surrounding pronunciation main bodies, so that the requirements of effective listening and conversation between people and a target pronunciation main body cannot be met.
Disclosure of Invention
In view of the above, the main objective of the present invention is to provide a directional localized listening method, a hearing device, a program product and a medium, which are intended to solve the technical problem that a user of the hearing device cannot clearly listen and talk with a target pronunciation subject in the same space.
In order to achieve the above object, the present invention provides a directional location listening method applied to a hearing device, comprising the following steps:
acquiring a plurality of sound-producing bodies within a recognizable range of a hearing device;
acquiring a target sounding body in a plurality of sounding bodies;
the amplification operation is performed on the sound signal of the target sounding body, and the cancellation operation is performed on the sound signals of the other sounding bodies except the target sounding body.
Optionally, the step of acquiring a target utterance body of the plurality of utterance bodies includes:
acquiring the time difference of the sound signals of each sound generating body reaching a first microphone of the left hearing device and a second microphone of the right hearing device;
if the time difference generated by the sounding body is smaller than a preset time threshold, judging that the sounding body is located in the opposite range of the user;
if one sounding body exists in the opposite range, the sounding body in the opposite range is used as a target sounding body.
Optionally, if the time difference generated by the sounding body is smaller than the preset threshold, after the step of determining that the sounding body is located in the direct-facing range of the user, the method further includes:
if a plurality of sounding bodies exist in the opposite range, acquiring a switching instruction of a user;
analyzing the switching instruction to obtain a sounding body selected by a user;
and taking the sound body selected by the user as a target sound body.
Optionally, if the time difference generated by the sounding body is smaller than the preset threshold, after the step of determining that the sounding body is located in the direct-facing range of the user, the method further includes:
if a plurality of sounding bodies exist in the opposite range, acquiring a distance mode selected by a user in advance; the distance mode is divided into a short-distance mode, a medium-distance mode and a long-distance mode;
and determining a target sounding body based on the distance mode selected by the user in advance.
Optionally, the step of acquiring a target utterance body of the plurality of utterance bodies includes:
acquiring a target position selected by a user;
acquiring sounding bodies in a target position from a plurality of sounding bodies;
if one sounding body exists in the target position, the sounding body is used as a target sounding body; alternatively, the first and second electrodes may be,
and if a plurality of sounding bodies exist in the target orientation, acquiring a distance mode selected by a user in advance, and determining the target sounding body based on the distance mode selected by the user in advance.
Optionally, the step of determining the target utterance based on a distance mode pre-selected by a user includes:
acquiring the intensity of a plurality of sounding body sound signals;
calculating and obtaining the distance between the sounding body and the user based on the strength of the sound signal;
and if the distance between the sounding body and the user is within the distance range corresponding to the distance mode selected by the user in advance, taking the sounding body as the target sounding body.
Optionally, the step of obtaining a plurality of sound emitters within a recognizable range of the hearing device comprises:
obtaining sound signals of the sound producing bodies within the recognizable range;
and identifying the sound signals by using a tone identification algorithm to obtain a plurality of sounding bodies.
To achieve the above object, there is also provided a computer program product comprising a computer program which, when being executed by a processor, carries out the steps of the directional listening method as above.
To achieve the above object, there is also provided a computer storage medium having a directional location listening method program stored thereon, the directional location listening method program, when executed by a processor, implementing the steps of the directional location listening method as above.
In order to achieve the above object, there is also provided a hearing device comprising a memory, a processor and a directional location listening method program stored on the memory and executable on the processor, wherein the processor implements the steps of the directional location listening method as described above when executing the directional location listening method program.
One or more technical solutions provided in the embodiments of the present invention have at least the following technical effects or advantages: acquiring a plurality of sounding bodies in an identifiable range; by correctly identifying the sounding bodies around the user, the target sounding body can be obtained more accurately.
Acquiring a target sounding body in a plurality of sounding bodies; the target sounding body is selected from the multiple sounding bodies, so that the requirements of a user on specific listening and conversation with the target sounding body are met.
Performing an amplification operation on the sound signal of the target sounding body, and performing a cancellation operation on the sound signals of the other sounding bodies except the target sounding body; the sound signal of the target sounding body is amplified and the sounds of other sounding bodies are shielded, so that a user can clearly hear the sound of the target sounding body and the interference of other sounds is eliminated.
Drawings
Fig. 1 is a schematic flow chart of a first embodiment of the directional listening method of the present application;
FIG. 2 is a block diagram of the directional location listening method of the present application;
fig. 3 is a flowchart illustrating an implementation step of step S120 in the first embodiment of the directional listening method of the present application;
FIG. 4 is a schematic diagram of a method for determining a dead zone in a directional listening method according to the present application;
fig. 5 is a flowchart illustrating another specific implementation step of step S120 in the first embodiment of the directional listening method of the present application;
fig. 6 is a schematic diagram of a distance mode determination method of the directional listening method according to the present application;
fig. 7 is a flowchart illustrating another specific implementation step of step S120 in the first embodiment of the directional listening method of the present application;
fig. 8 is a flowchart illustrating the specific implementation step of step S124-1 in the first embodiment of the directional listening method of the present application;
fig. 9 is a flowchart illustrating the detailed implementation step of step S110 in the first embodiment of the directional listening method of the present application.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: acquiring a plurality of sounding bodies in an identifiable range; acquiring a target sounding body in a plurality of sounding bodies; performing an amplification operation on the sound signal of the target sounding body, and performing a cancellation operation on the sound signals of the other sounding bodies except the target sounding body; the invention realizes that the user can quickly select the sound of the target sound-producing body to be heard in a noisy environment, amplify the sound of the target sound-producing body and shield the sounds of other sound-producing bodies, thereby enabling the user to clearly hear the sound of the target sound-producing body and eliminate the interference of other sounds, and meeting the requirements of clear listening and conversation between the user and the target sound-producing body.
In order to better understand the technical solution, the technical solution will be described in detail with reference to the drawings and the specific embodiments.
Referring to fig. 1, fig. 1 shows a first embodiment of the directional listening method of the present application, comprising the following steps:
step S110: a plurality of sound producing bodies within a range recognizable by the hearing device are acquired.
Specifically, the sounding body may be an object capable of sounding, and is not limited to a human being herein, and may be a vehicle, a robot, or an animal. During the use of the hearing device by the user, a plurality of different sound generators may be present around the user; wherein the plurality of sound-producing bodies include a sound-producing body that the user wants to listen to.
Specifically, the recognizable range may be within 10 meters to 20 meters, and is not limited herein.
It should be noted that, the hearing device in this embodiment may be an earphone, wherein the earphone may be an in-ear type or a half-in-ear type, and the form of the earphone is not limited to an earplug, and may also be a headset, and is not limited herein; in addition, the hearing device may also be applied to Virtual Reality (or VR), Augmented Reality (or AR) or Mediated Reality (or MR); fig. 2, 4 and 6 illustrate a wireless headset, but the wireless headset is not limited to the one illustrated in the figures and may be another hearing device.
Step S120: a target sounding body of the plurality of sounding bodies is acquired.
Specifically, as shown in fig. 2, but not limited to, the sounding body 1, the sounding body 2, the sounding body 3, and the sounding body 4 are present around the user, wherein in the present embodiment, the target sounding body may be any one of the sounding bodies, and may be the sounding body 1, or the sounding body 2, or may be the sounding body 3, or the sounding body 4, which is not limited herein.
Specifically, a user switching instruction is executed in the multiple sounding bodies, and the target sounding body selected by the user can be obtained by analyzing the switching instruction, that is, the user can switch among the multiple sounding bodies to select the sounding body which the user wants to listen to as the target sounding body; in addition, the target sounding body can be adjusted at any time according to the requirements of the user.
It should be noted that, in another embodiment, the target sounding body may be a plurality of sounding bodies; for example, when the user wants to listen to both of sound emitting unit 1 and sound emitting unit 3, sound emitting unit 1 and sound emitting unit 2 can be simultaneously used as the target sound emitting unit.
Step S130: the amplification operation is performed on the sound signal of the target sounding body, and the cancellation operation is performed on the sound signals of the other sounding bodies except the target sounding body.
Specifically, when performing the amplification operation, the sound signal may be amplified using a sound amplifier, wherein the sound signal is amplified by the amplifier without distortion, and sufficient power is output to drive the speaker to generate sound; in the present embodiment, a preamplifier or a power amplifier may be employed; wherein the preamplifier performs an amplifying operation with an amplitude of the amplified sound signal; the power amplifier amplifies the power of the sound signal, so that the power amplifier can drive the loudspeaker system to execute amplification operation; and is not limited thereto. The degree of sound amplification can be preset and can be set according to habits and requirements of users.
Specifically, when the cancellation operation is performed, the hearing device can generate sound waves with the same intensity and opposite directions from other sound generating bodies so as to cancel the sound signals of the other sound generating bodies; for example, the sound waves with the same intensity and opposite direction as the sound generating body 1 are output by the loudspeaker of the hearing device to cancel the sound signal of the sound generating body 1.
In the present embodiment, a plurality of sounding bodies within a recognizable range are acquired; by correctly identifying the sounding bodies around the user, the target sounding body can be obtained more accurately. Acquiring a target sounding body in a plurality of sounding bodies; the target sounding body is selected from the multiple sounding bodies, so that the requirements of a user on specific listening and conversation with the target sounding body are met. Performing an amplification operation on a sound signal of a target sounding body; performing a cancelling operation on sound signals of other sound generating bodies except the target sound generating body; the sound signal of the target sounding body is amplified and the sounds of other sounding bodies are shielded, so that a user can clearly hear the sound of the target sounding body and the interference of other sounds is eliminated.
Referring to fig. 3, fig. 3 is a detailed implementation step of step S120 in the first embodiment of the directional listening method of the present application, and the step of acquiring a target sounding body in a plurality of sounding bodies includes:
step S121: the time difference between the arrival of the sound signal of each sound producing body at the first microphone of the left hearing device and the arrival at the second microphone of the right hearing device is obtained.
Specifically, as shown in fig. 4, Mic1 is the first microphone of the left-side hearing device, Mic2 is the second microphone of the right-side hearing device; acquiring time differences of sound signals of the sounding bodies 1, 2, 3 and 4 reaching Mic1 and Mic 2; it is obvious that the smaller the time difference is, the closer the sounding body is to the user's direct range is. The number of the first microphones of the left-side hearing device and the second microphones of the right-side hearing device is not limited to one, and may be plural.
Step S122: and if the time difference generated by the sounding body is smaller than the preset time threshold, judging that the sounding body is positioned in the opposite range of the user.
Specifically, as shown in fig. 4, if the time difference between the sound generators 1 and 2 is smaller than the preset time threshold, it is determined that the sound generators 1 and 2 are located within the direct range of the hearing device user.
It should be further noted that, in this embodiment, the preset time threshold is not limited herein, and may be adjusted according to the requirement of the user. And if the user needs a larger positive range, adaptively increasing the preset time threshold.
Step S123: if one sounding body exists in the opposite range, the sounding body in the opposite range is used as a target sounding body.
Specifically, in one embodiment, if only one sounding body exists in the determined facing range, the sounding body is taken as the target sounding body.
Step S124: and if a plurality of sounding bodies exist in the opposite range, acquiring a switching instruction of the user.
Specifically, if two or more sounding bodies exist in the just-facing range, the switching instruction of the user is acquired. As shown in fig. 4, when the sounding bodies 1 and 2 are within the range directly opposite to the user, the user can select the sounding bodies to switch and obtain the switching instruction of the user.
In another embodiment, if there are a plurality of sound generating bodies within the facing range, the plurality of sound generating bodies may be used as the target sound generating body; that is, as shown in fig. 4, when the sound generating body 1 and the sound generating body 2 are within the range directly facing the user, both the sound generating body 1 and the sound generating body 2 are set as the target sound generating bodies.
Step S125: and analyzing the switching instruction to obtain the sounding body selected by the user.
Step S126: and taking the sound body selected by the user as a target sound body.
Specifically, as shown in fig. 4, when the user selects the sound signal of the sounding body 2, the sounding body 2 is set as the target sounding body.
In this embodiment, the direct range of the user can be correctly determined by using the time difference between the arrival of the sound signal at the first microphone of the left hearing device and the arrival at the second microphone of the right hearing device; if a plurality of sounding bodies exist in the range, the switching instruction of the user is obtained, the sounding bodies meeting the user listening requirement are selected according to the switching operation of the user, the listening experience of the user is further improved, and the user can listen to the sound of a specific target main body in a noisy environment or when the distance is far away.
Referring to fig. 5, fig. 5 is another specific implementation step of step S120 in the first embodiment of the directional listening method of the present application, and the step of acquiring a target sounding body of a plurality of sounding bodies includes:
step S121-1: the time difference between the arrival of the sound signal of each sound producing body at the first microphone of the left hearing device and the arrival at the second microphone of the right hearing device is obtained.
Step S122-1: and if the time difference generated by the sounding body is smaller than the preset time threshold, judging that the sounding body is positioned in the opposite range of the user.
Step S123-1: if one sounding body exists in the opposite range, the sounding body in the opposite range is used as a target sounding body.
Step S124-1: if a plurality of sounding bodies exist in the opposite range, acquiring a distance mode selected by a user in advance; the distance mode is divided into a short-distance mode, a medium-distance mode and a long-distance mode;
specifically, in an embodiment, the user may pre-select a distance mode meeting the habit of the user, wherein the distance mode is divided into a short-distance mode (e.g., 0-1.5m), a medium-distance mode (e.g., 1.5m-4m), and a long-distance mode (more than 4m), and the distance mode is not limited to the distance range mentioned above, and the distance range refers to a region formed by taking the user as the center of a circle and taking the distance as a radius; can be adjusted adaptively according to the requirements of users.
Step S125-1: and determining a target sounding body based on the distance mode selected by the user in advance.
Specifically, as shown in fig. 6, the sounding body 1 is in the close range mode, and the sounding body 2, the sounding body 3, and the sounding body 4 are in the middle range mode, and if the distance mode pre-selected by the user is in the middle range mode and the sounding body 1 and the sounding body 2 are in the direct range of the user, the sounding body 2 is automatically selected as the target sounding body; meanwhile, if the distance mode selected in advance by the user is the close range mode and the sounding body 1 and the sounding body 2 are in the direct range of the user, the sounding body 1 is automatically selected as the target sounding body.
In this embodiment, the direct range of the user can be correctly determined by using the time difference between the arrival of the sound signal at the first microphone of the left hearing device and the arrival at the second microphone of the right hearing device; if a plurality of sounding bodies exist in the opposite range, the target sounding body which the user wants to listen to can be locked more accurately and more quickly through the distance mode selected by the user in advance. In the embodiment, the sound of a target sound generating body desired to be heard can be quickly selected by a user in a noisy environment, and other sounds are properly amplified and shielded, so that the user can clearly hear the desired sound and eliminate interference, and a using scene such as a user can realize the function of only hearing the sound of a speaker through a hearing device when listening to a lecture seat; meanwhile, a remote communication function can be realized, for example, two people are far away in the same room and do not communicate with each other through audio communication, and under the condition that the two people are inconvenient to come near, the function of mutual clear communication can be realized through the hearing device without speaking loudly.
Referring to fig. 7, fig. 7 is another specific implementation step of step S120 in the first embodiment of the directional listening method of the present application, and the step of acquiring a target sounding body of a plurality of sounding bodies includes:
step S121-2: and acquiring the target position selected by the user.
Specifically, the direction facing the front of the user is the 12 o 'clock direction, the direction facing the back of the user is the 6 o' clock direction, the right left of the user is the 9 o 'clock direction, and the right of the user is the 3 o' clock direction; in this embodiment, the azimuth can be divided into six azimuths, specifically, the 1 o 'clock to 3 o' clock direction is azimuth one, 3 o 'clock to 5 o' clock is azimuth two, 5 o 'clock to 7 o' clock is azimuth three, 7 o 'clock to 9 o' clock is azimuth four, 9 o 'clock to 11 o' clock is azimuth five, and 11 o 'clock to 1 o' clock is azimuth six.
Referring to fig. 4, a specific application scenario of the present embodiment may be that when the user is facing the sounding body 1 and the sounding body 2 (sounding bodies in the facing range), but the user wants to listen to the sound of the sounding body 3 in the direction from 1 o 'clock to 3 o' clock of the current user, the user may use the direction from one o 'clock to three o' clock (direction one) of the current user as the target direction without moving the head (without changing the facing range). In this embodiment, the target position may be selected according to the requirement of the user, and is not necessarily the direct range of the user.
Step S122-2: a sounding body in a target orientation is acquired from a plurality of sounding bodies.
Specifically, different sound generators have different timbres, and the sound signals can be identified through a timbre identification algorithm, so that the sound generators in the target direction can be obtained from the multiple sound generators.
Step S123-2: and if one sounding body exists in the target direction, the sounding body is taken as the target sounding body.
Step S124-2: and if a plurality of sounding bodies exist in the target orientation, acquiring a distance mode selected by a user in advance, and determining the target sounding body based on the distance mode selected by the user in advance.
Specifically, the detailed implementation of step S123-2 refers to the detailed implementation of step S124-1 to step S125-1, and is not described herein again.
If there are a plurality of sound producing units in the target direction, the switching command of the user may be acquired and analyzed, and the sound producing unit selected by the user may be acquired as the target sound producing unit.
In this embodiment, the user may set the current target direction, that is, the function of moving the head of the user to select the direction may be cancelled, so that the specific direction listening function is realized only through the target direction selected by the user without specific alignment, and the requirement of listening in the specific direction of the user is further satisfied.
Referring to fig. 8, fig. 8 is a detailed implementation step of step S124-1 in the first embodiment of the directional listening method of the present application, and the step of determining the target sounding body based on the distance mode selected by the user in advance includes:
step S124-1-1: the intensities of a plurality of sounding body sound signals are acquired.
Specifically, decibel values of the multiple sounding body sound signals may be obtained as intensities, and amplitudes of the multiple sounding body sound signals may also be obtained as intensities, which is not limited herein; the intensity of the sound signals of the plurality of sounding bodies can be acquired through a microphone of the earphone.
Step S124-1-2: and calculating and obtaining the distance between the sounding body and the user based on the strength of the sound signal.
Specifically, the distance between the sounding body and the user is calculated by using the relationship between the intensity of the sound signal and the distance.
Step S124-1-3: and if the distance between the sounding body and the user is within the distance range corresponding to the distance mode selected by the user in advance, taking the sounding body as the target sounding body.
Specifically, for example, if the distance mode selected in advance by the user is the middle distance mode and the distance between the sounding body and the user is within the distance range of 1.5m to 4m, the sounding body is taken as the target sounding body.
In this embodiment, the distance mode is preset by the user, so that the target sounding body which the user wants to listen to can be locked more quickly, and the listening experience of the user is guaranteed.
Referring to fig. 9, fig. 9 is a detailed implementation step of step S110 in the first embodiment of the directional localized listening method of the present application, and the step of acquiring a plurality of sound-generating bodies within a recognizable range of a hearing device includes:
step S111: sound signals of the sounding bodies each within the recognizable range are obtained.
Specifically, in this embodiment, the sound signal of the sound generating body in the recognizable range may be acquired through a microphone of the hearing device, the sound signal of the sound generating body in the recognizable range may be acquired through a speaker, or the sound signal of the sound generating body in the recognizable range may be acquired through another device in the hearing device, which is not limited herein; in particular, the sound signals of the sound producing bodies within the recognizable range can be obtained by the microphone of the earphone.
Step S112: and identifying the sound signals by using a tone identification algorithm to obtain a plurality of sounding bodies.
Specifically, the spectrum showing different frequency components of a sound is called a sound power spectrum, and there are three basic forms in terms of identifying timbre features: the instant power spectrum reflects the energy state of each frequency at a specific moment of the voice; the short-time power spectrum is a spectrogram of energy between two time points in the speech stream of one or more syllables along with frequency distribution; the long-term power spectrum is represented by the average probability of different spectral components in speech, which can be expressed as a long-term average spectral density. In this embodiment, if the real-time power spectrum, the short-time power spectrum, or the long-time power spectrum of the sound signal of the sounding body is different, the sounding body is considered to be a different sounding body.
Specifically, a voiceprint recognition technology may be used, in which a voiceprint recognition is performed by converting a voice signal into an electrical signal and then using a computer, and if the voiceprint features extracted based on the voice signal are different, the sound-producing body is different. By utilizing the voiceprint recognition technology, the accuracy of obtaining the sounding body can be further improved.
In another embodiment, the infrared device in the hearing device can also be combined to identify the sound-producing bodies around the user. For example, the infrared device of the hearing device recognizes that five different objects are around, and further, the microphone of the hearing device acquires sound signals of the five objects; if the sound signal of the object is detected, taking the object as a sound producing body; if the sound signal of the object is not detected, the object is not used as a sound producing body.
In this embodiment, a plurality of sound producing bodies are accurately obtained through a tone recognition algorithm, so that it is ensured that the target sound producing body can be correctly selected.
The present application also protects a computer program product comprising a computer program which when executed by a processor performs the steps of any of the above-mentioned directional localized listening methods.
The application also protects a computer storage medium on which a directional location listening method program is stored, the directional location listening method program, when executed by a processor, implementing any of the steps of the directional location listening method described above.
The application also protects a hearing device, which comprises a memory, a processor and a directional location listening method program stored on the memory and capable of running on the processor, wherein the processor realizes any one of the steps of the directional location listening method when executing the directional location listening method program.
The present invention relates to a hearing device: at least comprises a structural shell, a first microphone, a second microphone, a loudspeaker, a processor 12 and a memory 11.
The processor 12 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 12. The processor 12 described above may be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the memory 11, and the processor 12 reads the information in the memory 11 and completes the steps of the method in combination with the hardware thereof.
It will be appreciated that memory 11 in embodiments of the invention may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The non-volatile Memory may be a Read Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static random access memory (Static RAM, SRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic random access memory (Synchronous DRAM, SDRAM), Double data rate Synchronous Dynamic random access memory (ddr DRAM), Enhanced Synchronous SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The memory 11 of the systems and methods described in connection with the embodiments of the invention is intended to comprise, without being limited to, these and any other suitable types of memory.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (10)

1. A directional localized listening method for a hearing device, the method comprising the steps of:
acquiring a plurality of sound-producing bodies within a recognizable range of the hearing device;
acquiring a target sounding body in the plurality of sounding bodies;
and executing amplification operation on the sound signals of the target sound producing body, and executing cancellation operation on the sound signals of other sound producing bodies except the target sound producing body.
2. The directional localized listening method of claim 1, wherein said step of acquiring a target sounding body of said plurality of sounding bodies comprises:
acquiring the time difference of the sound signals of the sound generators reaching a first microphone of a left hearing device and a second microphone of a right hearing device;
if the time difference generated by the sounding body is smaller than a preset time threshold, judging that the sounding body is positioned in a right-facing range of a user;
and if a sounding body exists in the opposite range, taking the sounding body in the opposite range as the target sounding body.
3. The directional localized listening method of claim 2, wherein said step of determining that said sound-emitting body is within a user's direct range if said time difference generated by said sound-emitting body is less than a predetermined threshold value, further comprises:
if a plurality of sounding bodies exist in the opposite range, acquiring a switching instruction of a user;
analyzing the switching instruction to obtain a sounding body selected by a user;
and taking the sounding body selected by the user as the target sounding body.
4. The directional localized listening method of claim 2, wherein said step of determining that said sound-emitting body is within a user's direct range if said time difference generated by said sound-emitting body is less than a predetermined threshold value, further comprises:
if a plurality of sounding bodies exist in the opposite range, acquiring a distance mode selected by a user in advance; the distance mode comprises a short-distance mode, a medium-distance mode and a long-distance mode;
determining the target sounding body based on the user pre-selected distance pattern.
5. The directional localized listening method of claim 1, wherein said step of acquiring a target sounding body of said plurality of sounding bodies comprises:
acquiring a target position selected by a user;
acquiring sounding bodies in the target orientation from the plurality of sounding bodies;
if one sounding body exists in the target position, taking the sounding body as the target sounding body; alternatively, the first and second electrodes may be,
if a plurality of sounding bodies exist in the target position, obtaining a distance mode selected by a user in advance, and determining the target sounding body based on the distance mode selected by the user in advance.
6. A directional localized listening method as claimed in claim 4 or 5, characterized in that said step of determining said target sounding body based on a distance pattern preselected by said user comprises:
acquiring the intensity of a plurality of sounding body sound signals;
calculating and obtaining the distance between the sounding body and the user based on the strength of the sound signal;
and if the distance between the sounding body and the user is within the distance range corresponding to the distance mode selected by the user in advance, taking the sounding body as the target sounding body.
7. The directional localized listening method of any one of claims 1-5, wherein said step of obtaining a plurality of sound-producing volumes within an identifiable range of said hearing device comprises:
obtaining sound signals of the sound-producing bodies each within the recognizable range;
and identifying the sound signals by using a tone identification algorithm to obtain a plurality of sounding bodies.
8. A computer program product, comprising a computer program which, when being executed by a processor, carries out the steps of the directional localized listening method according to any one of claims 1-7.
9. A computer storage medium, characterized in that the computer storage medium has stored thereon a directional listening method program, which when executed by a processor performs the steps of the directional listening method according to any one of claims 1-7.
10. A hearing device comprising a memory, a processor and a directional localized listening method program stored on said memory and executable on said processor, said processor implementing the steps of the directional localized listening method according to any one of claims 1-7 when executing said directional localized listening method program.
CN202110984816.2A 2021-08-25 2021-08-25 Directional location listening method, hearing device and medium Active CN113709653B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110984816.2A CN113709653B (en) 2021-08-25 2021-08-25 Directional location listening method, hearing device and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110984816.2A CN113709653B (en) 2021-08-25 2021-08-25 Directional location listening method, hearing device and medium

Publications (2)

Publication Number Publication Date
CN113709653A true CN113709653A (en) 2021-11-26
CN113709653B CN113709653B (en) 2022-10-18

Family

ID=78654886

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110984816.2A Active CN113709653B (en) 2021-08-25 2021-08-25 Directional location listening method, hearing device and medium

Country Status (1)

Country Link
CN (1) CN113709653B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103000183A (en) * 2011-09-14 2013-03-27 财团法人工业技术研究院 Speech enhancement method
US20130287225A1 (en) * 2010-12-21 2013-10-31 Nippon Telegraph And Telephone Corporation Sound enhancement method, device, program and recording medium
US20180040332A1 (en) * 2016-08-03 2018-02-08 Akihito Aiba Voice processing device, audio and video output apparatus, communication system, and sound processing method
CN108538320A (en) * 2018-03-30 2018-09-14 广东欧珀移动通信有限公司 Recording control method and device, readable storage medium storing program for executing, terminal
US20190214011A1 (en) * 2016-10-14 2019-07-11 Samsung Electronics Co., Ltd. Electronic device and method for processing audio signal by electronic device
CN110223686A (en) * 2019-05-31 2019-09-10 联想(北京)有限公司 Audio recognition method, speech recognition equipment and electronic equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130287225A1 (en) * 2010-12-21 2013-10-31 Nippon Telegraph And Telephone Corporation Sound enhancement method, device, program and recording medium
CN103000183A (en) * 2011-09-14 2013-03-27 财团法人工业技术研究院 Speech enhancement method
US20180040332A1 (en) * 2016-08-03 2018-02-08 Akihito Aiba Voice processing device, audio and video output apparatus, communication system, and sound processing method
US20190214011A1 (en) * 2016-10-14 2019-07-11 Samsung Electronics Co., Ltd. Electronic device and method for processing audio signal by electronic device
CN108538320A (en) * 2018-03-30 2018-09-14 广东欧珀移动通信有限公司 Recording control method and device, readable storage medium storing program for executing, terminal
CN110223686A (en) * 2019-05-31 2019-09-10 联想(北京)有限公司 Audio recognition method, speech recognition equipment and electronic equipment

Also Published As

Publication number Publication date
CN113709653B (en) 2022-10-18

Similar Documents

Publication Publication Date Title
US10097921B2 (en) Methods circuits devices systems and associated computer executable code for acquiring acoustic signals
US9037458B2 (en) Systems, methods, apparatus, and computer-readable media for spatially selective audio augmentation
JP5705980B2 (en) System, method and apparatus for enhanced generation of acoustic images in space
JP6121481B2 (en) 3D sound acquisition and playback using multi-microphone
CN107872762B (en) Voice activity detection unit and hearing device comprising a voice activity detection unit
CN108475511A (en) Adaptive beamformer for creating reference channel
US11354088B2 (en) Media-compensated pass-through and mode-switching
JP2021511755A (en) Speech recognition audio system and method
JP2010506525A (en) Hearing aid driving method and hearing aid
JP5130298B2 (en) Hearing aid operating method and hearing aid
US8320580B2 (en) System and method for directional sound transmission with a linear array of exponentially spaced loudspeakers
CN113709653B (en) Directional location listening method, hearing device and medium
US20190306618A1 (en) Methods circuits devices systems and associated computer executable code for acquiring acoustic signals
CN113921037A (en) Pointing hearing aid device and method thereof
US20230359430A1 (en) Media-compensated pass-through and mode-switching
Suzuki et al. Spot-forming method by using two shotgun microphones
CN114650480A (en) Active noise reduction-enabled device, active noise reduction method, and storage medium
EP4331239A1 (en) Apparatus, methods and computer programs for controlling audibility of sound sources

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant