CN112612444A - Sound source position positioning method, sound source position positioning device, electronic equipment and storage medium - Google Patents
Sound source position positioning method, sound source position positioning device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112612444A CN112612444A CN202011584012.5A CN202011584012A CN112612444A CN 112612444 A CN112612444 A CN 112612444A CN 202011584012 A CN202011584012 A CN 202011584012A CN 112612444 A CN112612444 A CN 112612444A
- Authority
- CN
- China
- Prior art keywords
- initial position
- target object
- sound
- sound source
- head
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000008569 process Effects 0.000 claims abstract description 16
- 230000001133 acceleration Effects 0.000 claims description 4
- 230000002618 waking effect Effects 0.000 claims description 2
- 230000003993 interaction Effects 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 210000005069 ears Anatomy 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000004886 head movement Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000002360 explosive Substances 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
Abstract
The embodiment of the invention discloses a sound source position positioning method, a sound source position positioning device, electronic equipment and a storage medium. Wherein the method comprises the following steps: acquiring a first initial position of a head of a target object and a second initial position of a sound source of target sound information corresponding to the first initial position; determining angle parameter information of the current position of the head of the target object relative to the first initial position based on rotation parameter information of the head of the target object in a rotation process; adjusting the position of the sound source to the second initial position based on the angle parameter information. The voice data played by the earphone is fixed at one position, so that a user can be perceptually considered to have a conversation with a character at a real position, the reality of voice interaction is improved, and the user experience is improved.
Description
Technical Field
Embodiments of the present invention relate to positioning technologies, and in particular, to a method and an apparatus for positioning a sound source, an electronic device, and a storage medium.
Background
In recent years, under the background of rapid popularization of new-generation consumer electronics devices such as global smart phones and tablet computers, earphone products, particularly wireless earphone products, have shown an explosive growth trend. The mobile phone voice assistant is more intelligent, and through the mobile phone voice assistant, the user can play music, inquire weather, make a call and control intelligent equipment in a home, and the user only needs a sentence to wake up the voice assistant.
The voice assistant voice interaction data are sent to a loudspeaker of the Bluetooth headset through Bluetooth communication to be played, the played sound does not have the sense of direction, namely when the head of a user rotates, the played sound rotates along with the head, the user does not consider to have a conversation with a character in a real position in perception, voice interaction does not have the sense of reality, and user experience is poor.
Disclosure of Invention
Embodiments of the present invention provide a sound source position positioning method, an apparatus, an electronic device, and a storage medium, so as to fix voice data played by an earphone at a position, so that a user perceptually considers that the user is in a conversation with a character at a real position, thereby improving the reality of voice interaction and improving user experience.
In a first aspect, an embodiment of the present invention provides a sound source position locating method, where the method includes:
acquiring a first initial position of a head of a target object and a second initial position of a sound source of target sound information corresponding to the first initial position;
determining angle parameter information of the current position of the head of the target object relative to the first initial position based on rotation parameter information of the head of the target object in a rotation process;
adjusting the position of the sound source to the second initial position based on the angle parameter information.
In a second aspect, an embodiment of the present invention further provides a sound source position locating apparatus, including:
an initial position acquisition module, configured to acquire a first initial position of a head of a target object and a second initial position of a sound source of target sound information corresponding to the first initial position;
the angle parameter information determining module is used for determining the angle parameter information of the current position of the head of the target object relative to the first initial position based on the rotation parameter information of the head of the target object in the rotation process;
and the sound source position positioning module is used for adjusting the position of the sound source to the second initial position based on the angle parameter information.
In a third aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:
one or more processors;
storage means for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the sound source position localization method according to any of the embodiments of the present invention.
In a fourth aspect, embodiments of the present invention further provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the sound source position location method according to any of the embodiments of the present invention.
According to the technical scheme of the embodiment of the invention, by acquiring the first initial position of the head of the target object and the second initial position of the sound source of the target sound information corresponding to the first initial position, when the head of the target object rotates, the rotation parameter information of the head of the target object in the rotation process is obtained, determining angle parameter information of the current position of the head of the target object relative to the first initial position by calculating rotation parameter information of the target object during the head movement in real time, determining the angle parameter information of the current position of the head of the target object relative to the first initial position based on the angle parameter information, the position of the sound source may be adjusted to a second initial position, such that when the head of the target object is rotated, the position of the sound source can be kept fixed, and when the user communicates with the sound playing module, the user can be perceptually considered to have a conversation with a character at a real position, so that the interactive reality sense is achieved, and the user experience is improved.
Drawings
FIG. 1 is a flowchart of a sound source position locating method according to a first embodiment of the present invention;
FIG. 2 is a flowchart of a sound source position locating method according to a second embodiment of the present invention;
fig. 3 is a flowchart of the implementation of the sound source position locating method according to the third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a sound source position locating apparatus according to a fourth embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device in a fifth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a flowchart of a sound source position locating method according to an embodiment of the present invention, where the embodiment is applicable to a situation where a sound source position is located, and particularly, is applicable to a situation where the sound source position is fixed at a certain position, the method may be executed by a sound source position locating device, where the sound source position locating device may be implemented by software and/or hardware, and the sound source position locating device may be configured on an electronic computing device, and specifically includes the following steps:
s110, a first initial position of the head of the target object and a second initial position of a sound source of the target sound information corresponding to the first initial position are obtained.
Illustratively, the target object may be a person.
The first initial position may be an initial position of a head of the target object. The initial position here may be a position of the head of the target object before the rotation is performed.
In the embodiment of the present invention, a headset may be disposed on the head of the target object, and specifically, as is well known to those skilled in the art, the headset may be worn on the ear of the target object, a gyroscope is disposed in the headset, and the first initial position of the head of the target object may be obtained according to the gyroscope. Specifically, the initial position of the earphone may be recorded by using a gyroscope, and since the earphone is disposed on an ear of the target object, the initial position of the earphone recorded by the gyroscope here is the first initial position of the head of the target object.
It should be noted that the first initial position here may be an initial position of the head of the target object obtained by the gyroscope of the headphone, or may be an angle set by the user before the head of the target object starts to rotate, for example, 0 °, by setting the angle of the gyroscope in the headphone to an angle, and setting the angle as the first initial position. Specifically, the first initial position is directly obtained, or the first initial position is set by a user, which can be selected by the user according to the user's requirement, and is not limited herein.
The target sound information may be a sound received by the target object at the first initial position.
The second initial position may be a position of a sound source of the sound received by the target object at the first initial position.
Specifically, for example, the first initial position and the second initial position are described in the following scenarios:
the target object (person) is standing in a room with the front facing the balcony and the person is currently (at this time, the head of the person has not started to rotate) standing at the center position of the room, which is the first initial position of the head of the target object.
The balcony is a second initial position when the sound heard by the ears of the person is emitted from the balcony.
Optionally, before the obtaining a first initial position of the head of the target object and a second initial position of a sound source of the target sound information corresponding to the first initial position, the method further includes: and responding to the starting triggering operation of the earphone arranged on the head of the target object, and waking up the sound playing module so as to enable the sound playing module to play the target sound information.
For example, the on trigger operation may be an operation of turning on the headphones performed on the headphones on the head of the target object. Specifically, the opening triggering operation is executed in a voice or key mode.
The sound playing module may be any device capable of playing sound, such as a speaker, a loudspeaker, or a mobile phone voice assistant (e.g. may be a boy, a boy love, or airpots Pro).
When the starting triggering operation of the earphone is detected, the sound playing module can be awakened in response to the starting triggering operation, so that the sound playing module can play the target sound information.
When the sound playing module responds, at this time, the head of the target object does not start to rotate, the current position (i.e., the first initial position) may be obtained through a gyroscope in the headset, or an initial angle may be set for the current gyroscope, for example, the first initial position may be set to be the initial angle of 0 °.
After the first initial position is obtained, when the head of the target object is at the first initial position, the position of the target sound information played by the sound playing module, namely the second initial position, is obtained by using the earphone.
The advantage of this arrangement is that the first initial position and the second initial position can be obtained according to the set gyroscope in the headset, and no extra equipment is needed for obtaining the first initial position and the second initial position, so that the cost is saved.
And S120, determining angle parameter information of the current position of the head of the target object relative to the first initial position based on the rotation parameter information of the head of the target object in the rotation process.
For example, the rotation parameter information may be rotation information of the head of the target object during rotation. Optionally, the rotation parameter information here may be, but is not limited to: angular velocity and acceleration.
The current position may be a position where the head of the target object rotates during the rotation of the head of the target object, and the position is the current position.
The angle parameter information may be relative angle information of a position with respect to the first initial position when the target object is rotated to the position. Optionally, the angle parameter information here may be, but is not limited to: a horizontal azimuth and a vertical azimuth of the current position of the head of the target object with respect to the first initial position.
After the first initial position and the second initial position are acquired, the head of the target object starts to rotate from the first initial position, and rotation parameter information of the head of the target object in the rotating process is acquired in real time, specifically, the rotation parameter information of the head of the target object in the rotating process may be acquired in real time based on a gyroscope in the headset.
And S130, adjusting the position of the sound source to a second initial position based on the angle parameter information.
For example, according to the determined angle parameter information, the position of the sound source of the target sound information may be adjusted to the second initial position using a certain calculation rule.
In the prior art, because the earphones are worn on the head of the target object, when the head of the target object rotates, the earphones also rotate along with the rotation of the head of the target object, because the existing earphone designs make the sound heard by the user be stereo ring sound, the target sound information played by the sound playing module has no direction sense, namely when the head of the target object rotates, the sound played by the sound playing module rotates along with the head of the target object, namely the target sound information heard in the earphones is the target sound information rotated along with the rotation of the head of the target object, so that the sound source position of the target sound information played by the sound playing module cannot be fixed at the same position, the user can perceptively think that the target sound information is in conversation with people at different positions, and the voice interaction has no sense of reality.
In the embodiment of the invention, an audio processing unit can be arranged in the earphone, and the audio processing unit is utilized to perform certain calculation on the angle parameter information, so that the position of the sound source of the target sound information can be adjusted to a second initial position, namely the position of the sound source of the target sound information can be always fixed at the initial position of the sound source along with the rotation of the head of the target object, thus the position of the sound source is kept fixed when the head of the target object rotates, and a user can be perceptually considered to have a conversation with a person at a real position during actual interactive experience, thereby improving the user experience.
In an embodiment of the present invention, after adjusting the position of the sound source to the second initial position based on the angle parameter information, the method further includes: and controlling the sound playing module to end playing the target sound information in response to the ending control operation of the earphone.
For example, the end control operation may be an operation of ending the control of the headphones performed on the head of the target object. Specifically, the ending control operation is executed by voice or by pressing a key.
When the ending control operation of the earphone is detected, the sound playing module can be controlled to end playing the target sound information in response to the ending control operation. At this time, the interaction between the earphone and the sound playing module is finished.
The advantage of setting up like this is, accessible response to the end control operation to the earphone, to control the sound broadcast module and end the broadcast target sound information, has realized the end automation control of broadcast of target sound information.
According to the technical scheme of the embodiment of the invention, by acquiring the first initial position of the head of the target object and the second initial position of the sound source of the target sound information corresponding to the first initial position, when the head of the target object rotates, the rotation parameter information of the head of the target object in the rotation process is obtained, determining angle parameter information of the current position of the head of the target object relative to the first initial position by calculating rotation parameter information of the target object during the head movement in real time, determining the angle parameter information of the current position of the head of the target object relative to the first initial position based on the angle parameter information, the position of the sound source may be adjusted to a second initial position, such that when the head of the target object is rotated, the position of the sound source can be kept fixed, and when the user communicates with the sound playing module, the user can be perceptually considered to have a conversation with a character at a real position, so that the interactive reality sense is achieved, and the user experience is improved.
Example two
Fig. 2 is a flowchart of a sound source position locating method according to a second embodiment of the present invention, which may be combined with various alternatives in the above embodiments. In this embodiment of the present invention, optionally, the adjusting the position of the sound source to the second initial position based on the angle parameter information includes: and determining sound parameter information of the target object receiving target sound information based on the angle parameter information, and reconstructing the sound parameter information to adjust the position of the sound source to a second initial position.
As shown in fig. 2, the method of the embodiment of the present invention specifically includes the following steps:
s210, a first initial position of the head of the target object and a second initial position of the sound source of the target sound information corresponding to the first initial position are obtained.
S220, determining angle parameter information of the current position of the head of the target object relative to the first initial position based on the rotation parameter information of the head of the target object in the rotation process.
And S230, determining sound parameter information of the target object receiving the target sound information based on the angle parameter information, and reconstructing the sound parameter information to adjust the position of the sound source to a second initial position.
For example, the sound parameter information may be parameter information of target sound information received by the target object, and specific sound parameter information herein may include, but is not limited to: the left and right ears of the target object receive the time difference, the level difference, and the binaural reverberation of the target sound information.
According to the angle parameter information, the sound parameter information of the target object receiving the target sound information can be determined, and specifically, the sound parameter information of the target object receiving the target sound information can be determined by performing certain calculation on the angle parameter information by using a data processing unit of a gyroscope in the headset.
After the sound parameter information of the target sound information received by the target object is calculated, the sound parameter information can be reconstructed, new left and right ear audio streams are generated, and the position of the sound source is adjusted to the second initial position, so that the sound source can be fixed at one position, a user can be perceptually considered to have a conversation with a character at a real position, and the user experience is improved.
Optionally, the position of the sound source is adjusted to the second initial position based on the angle parameter information, which may be specifically obtained based on the following formula:
HL＝HL0(deltaDH，deltaDV)；
HR＝HR0(deltaDH，deltaDV)；
wherein, HL0 is the target sound information received by the left ear of the target object before the head of the target object is rotated, HR0 is the target sound information received by the right ear of the target object before the head of the target object is rotated; deltaDH is the horizontal azimuth angle of the current position of the head of the target object relative to the first initial position, deltaDV is the vertical azimuth angle of the current position of the head of the target object relative to the first initial position; HL is target sound information output by a left headphone of the headphones configured for the target object when the position of the sound source is adjusted to the second initial position, and HR is target sound information output by a right headphone of the headphones configured for the target object when the position of the sound source is adjusted to the second initial position.
It should be noted that, in the process of adjusting the position of the sound source to the second initial position by the above formula, the sound parameter information of the target object receiving target sound information may be obtained based on the above formula.
According to the technical scheme of the embodiment of the invention, the sound parameter information of the target object receiving the target sound information is determined according to the angle parameter information, and the determined sound parameter information is reconstructed to adjust the position of the sound source to the second initial position, so that the position of the sound source can be fixed at one position, a user can be perceptually considered to have a conversation with a character at a real position, and the user experience is improved.
EXAMPLE III
Embodiments of the present invention may be combined with various alternatives of the above embodiments. In the embodiment of the present invention, the technical solution of the embodiment of the present invention is applied to an actual scene, in which a gyroscope is disposed in an earphone, a sound playing module is a voice assistant, and specifically, with reference to an execution flowchart of the sound source position locating method described in fig. 3, specific implementation steps of applying the embodiment of the present invention to the actual scene are as follows:
(1) the earphone wakes up the mobile phone voice assistant through voice or key pressing.
(2) When the voice assistant responds, the earphone sets the current position of the gyroscope to be 0 degree of the initial angle, namely the first initial position.
(3) In the voice assistant broadcasting process, if the head of the target object moves, the gyroscope (specifically, the gyroscope data processing unit) may detect rotation parameter information of the head rotation of the target object, such as acceleration and angular velocity data, so as to calculate angle parameter information of the head rotation of the target object, such as a horizontal azimuth and a vertical azimuth of the current position of the head of the target object relative to the first initial position.
(4) The headphones (specifically, the audio processing unit in the headphones) may determine, according to the angle parameter information of the head rotation of the target object calculated in step 3, sound parameter information of the target object receiving the target sound information, for example, time difference, sound level difference, and binaural reverberation of the target sound information received by the left ear and the right ear of the target object, reconstruct audio data (i.e., the target sound information) of the voice assistant received by the left ear and the right ear, calculate parameters such as time difference, sound level difference, and binaural reverberation of the audio data of the left ear and the right ear, respectively, generate new audio streams of the left ear and the right ear, and play the new audio streams of the left ear and the right ear through speakers of the left headphones and the right ears.
(5) The step 4 operation and operation are continuously performed as the user moves his head.
(6) And responding to the ending control operation of the earphone, controlling the voice assistant to end playing the target sound information, ending the interaction of the voice assistant, and ending the control operation by the gyroscope data processing unit and the audio processing unit.
Through the above procedures, the method for controlling the positioning of the sounding position of the voice assistant by using the gyroscope on the Bluetooth headset can be completed, so that a user can perceive that the sounding position of the voice assistant is still located at the initial sounding position.
Example four
Fig. 4 is a schematic structural diagram of a sound source position locating apparatus according to a fourth embodiment of the present invention, as shown in fig. 4, the apparatus includes: an initial position obtaining module 31, an angle parameter information determining module 32 and an acoustic source position locating module 33.
The initial position acquiring module 31 is configured to acquire a first initial position of the head of the target object and a second initial position of a sound source of the target sound information corresponding to the first initial position;
an angle parameter information determining module 32, configured to determine, based on rotation parameter information of the head of the target object during a rotation process, angle parameter information of a current position of the head of the target object relative to the first initial position;
and a sound source position locating module 33, configured to adjust the position of the sound source to the second initial position based on the angle parameter information.
On the basis of the technical scheme of the embodiment of the invention, the device also comprises:
and the target sound information playing module is used for responding to the starting triggering operation of the earphone arranged on the head of the target object and awakening the sound playing module so as to enable the sound playing module to play the target sound information.
On the basis of the technical solution of the embodiment of the present invention, the sound source position locating module 33 includes:
a sound parameter information determination unit configured to determine sound parameter information of the target object receiving the target sound information based on the angle parameter information, wherein the sound parameter information includes a time difference, a sound level difference, and binaural reverberation of the target object when the target sound information is received by a left ear and a right ear of the target object;
a sound source position locating unit for reconstructing the sound parameter information to adjust the position of the sound source to the second initial position.
Optionally, the angle parameter information includes: a horizontal azimuth and a vertical azimuth of a current position of the head of the target object with respect to the first initial position.
On the basis of the technical solution of the embodiment of the present invention, the sound source position locating module 33 is specifically configured to:
adjusting the position of the sound source to the second initial position based on the angle parameter information according to the following formula:
HL＝HL0(deltaDH，deltaDV)；
HR＝HR0(deltaDH，deltaDV)；
wherein, HL0 is the target sound information received by the left ear of the target object before the head of the target object is rotated, HR0 is the target sound information received by the right ear of the target object before the head of the target object is rotated; deltaDH is the horizontal azimuth angle of the current position of the head of the target object relative to the first initial position, deltaDV is the vertical azimuth angle of the current position of the head of the target object relative to the first initial position; HL is target sound information output by a left headphone of the headphones configured for the target object when the position of the sound source is adjusted to the second initial position, and HR is target sound information output by a right headphone of the headphones configured for the target object when the position of the sound source is adjusted to the second initial position.
Optionally, a gyroscope is disposed in the earphone.
Correspondingly, on the basis of the technical scheme of the embodiment of the invention, the device also comprises:
and the rotation parameter information acquisition module is used for acquiring the rotation parameter information of the head of the target object in the rotation process based on the gyroscope.
On the basis of the technical scheme of the embodiment of the invention, the device also comprises:
and the target sound information ending playing module is used for responding to ending control operation of the earphone and controlling the sound playing module to end playing the target sound information.
Optionally, the rotation parameter information at least includes: angular velocity and acceleration.
The sound source position locating device provided by the embodiment of the invention can execute the sound source position locating method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.
EXAMPLE five
Fig. 5 is a schematic structural diagram of an electronic apparatus according to a fifth embodiment of the present invention, as shown in fig. 5, the electronic apparatus includes a processor 70, a memory 71, an input device 72, and an output device 73; the number of the processors 70 in the electronic device may be one or more, and one processor 70 is taken as an example in fig. 5; the processor 70, the memory 71, the input device 72 and the output device 73 in the electronic apparatus may be connected by a bus or other means, and the bus connection is exemplified in fig. 5.
The memory 71 is a computer-readable storage medium that can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the sound source position location method in the embodiment of the present invention (for example, the initial position acquisition module 31, the angle parameter information determination module 32, and the sound source position location module 33). The processor 70 executes various functional applications of the electronic device and data processing by executing software programs, instructions, and modules stored in the memory 71, thereby implementing the sound source position locating method described above.
The memory 71 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 71 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory 71 may further include memory located remotely from the processor 70, which may be connected to the electronic device through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 72 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function controls of the electronic apparatus. The output device 73 may include a display device such as a display screen.
EXAMPLE six
An embodiment of the present invention also provides a storage medium containing computer-executable instructions for performing a sound source position location method when executed by a computer processor.
Of course, the embodiment of the present invention provides a storage medium containing computer-executable instructions, and the computer-executable instructions are not limited to the operations of the method described above, and can also perform related operations in the sound source position location method provided by any embodiment of the present invention.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes instructions for enabling a computer electronic device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.
It should be noted that, in the embodiment of the sound source position locating device, the included units and modules are only divided according to the functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A sound source position locating method, comprising:
acquiring a first initial position of a head of a target object and a second initial position of a sound source of target sound information corresponding to the first initial position;
determining angle parameter information of the current position of the head of the target object relative to the first initial position based on rotation parameter information of the head of the target object in a rotation process;
adjusting the position of the sound source to the second initial position based on the angle parameter information.
2. The method according to claim 1, wherein before the acquiring a first initial position of a head of a target object and a second initial position of a sound source of target sound information corresponding to the first initial position, the method further comprises:
and responding to the starting triggering operation of the earphone arranged on the head of the target object, and waking up the sound playing module so as to enable the sound playing module to play the target sound information.
3. The method of claim 1, wherein the adjusting the position of the sound source to the second initial position based on the angle parameter information comprises:
determining sound parameter information of the target object for receiving the target sound information based on the angle parameter information, wherein the sound parameter information comprises time difference, sound level difference and binaural reverberation of the target object for receiving the target sound information by the left ear and the right ear;
reconstructing the sound parameter information to adjust the position of the sound source to the second initial position.
4. The method of claim 1, wherein the angle parameter information comprises: a horizontal azimuth and a vertical azimuth of a current position of the head of the target object relative to the first initial position;
the adjusting the position of the sound source to the second initial position based on the angle parameter information includes:
adjusting the position of the sound source to the second initial position based on the angle parameter information according to the following formula:
HL＝HL0(deltaDH，deltaDV)；
HR＝HR0(deltaDH，deltaDV)；
wherein, HL0 is the target sound information received by the left ear of the target object before the head of the target object is rotated, HR0 is the target sound information received by the right ear of the target object before the head of the target object is rotated; deltaDH is the horizontal azimuth angle of the current position of the head of the target object relative to the first initial position, deltaDV is the vertical azimuth angle of the current position of the head of the target object relative to the first initial position; HL is target sound information output by a left headphone of the headphones configured for the target object when the position of the sound source is adjusted to the second initial position, and HR is target sound information output by a right headphone of the headphones configured for the target object when the position of the sound source is adjusted to the second initial position.
5. The method of claim 2, wherein a gyroscope is disposed in the headset; the method further comprises the following steps:
and acquiring rotation parameter information of the head of the target object in the rotation process based on the gyroscope.
6. The method according to claim 2, wherein after the adjusting the position of the sound source to the second initial position based on the angle parameter information, the method further comprises:
and responding to the ending control operation of the earphone, and controlling the sound playing module to end playing the target sound information.
7. The method of claim 1, wherein the rotation parameter information comprises at least: angular velocity and acceleration.
8. A sound source position locating apparatus, comprising:
an initial position acquisition module, configured to acquire a first initial position of a head of a target object and a second initial position of a sound source of target sound information corresponding to the first initial position;
the angle parameter information determining module is used for determining the angle parameter information of the current position of the head of the target object relative to the first initial position based on the rotation parameter information of the head of the target object in the rotation process;
and the sound source position positioning module is used for adjusting the position of the sound source to the second initial position based on the angle parameter information.
9. An electronic device, characterized in that the electronic device comprises:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the sound source position location method of any of claims 1-7.
10. A storage medium containing computer-executable instructions for performing the sound source position location method according to any one of claims 1 to 7 when executed by a computer processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011584012.5A CN112612444A (en) | 2020-12-28 | 2020-12-28 | Sound source position positioning method, sound source position positioning device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011584012.5A CN112612444A (en) | 2020-12-28 | 2020-12-28 | Sound source position positioning method, sound source position positioning device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112612444A true CN112612444A (en) | 2021-04-06 |
Family
ID=75248392
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011584012.5A Pending CN112612444A (en) | 2020-12-28 | 2020-12-28 | Sound source position positioning method, sound source position positioning device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112612444A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114189788A (en) * | 2021-11-24 | 2022-03-15 | 深圳市豪恩声学股份有限公司 | Tuning method, tuning device, electronic device, and storage medium |
| CN114543844A (en) * | 2021-04-09 | 2022-05-27 | 恒玄科技(上海)股份有限公司 | Audio playing processing method and device of wireless audio equipment and wireless audio equipment |
| CN114543844B (en) * | 2021-04-09 | 2024-05-03 | 恒玄科技(上海)股份有限公司 | Audio playing processing method and device of wireless audio equipment and wireless audio equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150373477A1 (en) * | 2014-06-23 | 2015-12-24 | Glen A. Norris | Sound Localization for an Electronic Call |
| CN108279860A (en) * | 2017-06-14 | 2018-07-13 | 深圳市佳创视讯技术股份有限公司 | It is a kind of promoted virtual reality come personally audio experience method and system |
| CN110428850A (en) * | 2019-08-02 | 2019-11-08 | 深圳市无限动力发展有限公司 | Voice pick-up method, device, storage medium and mobile robot |
| CN111788835A (en) * | 2018-02-28 | 2020-10-16 | 谷歌有限责任公司 | Spatial audio enabling secure headphone usage during sports and commuting |
-
2020
- 2020-12-28 CN CN202011584012.5A patent/CN112612444A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150373477A1 (en) * | 2014-06-23 | 2015-12-24 | Glen A. Norris | Sound Localization for an Electronic Call |
| CN108279860A (en) * | 2017-06-14 | 2018-07-13 | 深圳市佳创视讯技术股份有限公司 | It is a kind of promoted virtual reality come personally audio experience method and system |
| CN111788835A (en) * | 2018-02-28 | 2020-10-16 | 谷歌有限责任公司 | Spatial audio enabling secure headphone usage during sports and commuting |
| CN110428850A (en) * | 2019-08-02 | 2019-11-08 | 深圳市无限动力发展有限公司 | Voice pick-up method, device, storage medium and mobile robot |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114543844A (en) * | 2021-04-09 | 2022-05-27 | 恒玄科技(上海)股份有限公司 | Audio playing processing method and device of wireless audio equipment and wireless audio equipment |
| CN114543844B (en) * | 2021-04-09 | 2024-05-03 | 恒玄科技(上海)股份有限公司 | Audio playing processing method and device of wireless audio equipment and wireless audio equipment |
| CN114189788A (en) * | 2021-11-24 | 2022-03-15 | 深圳市豪恩声学股份有限公司 | Tuning method, tuning device, electronic device, and storage medium |
| CN114189788B (en) * | 2021-11-24 | 2024-01-23 | 深圳市豪恩声学股份有限公司 | Tuning method, tuning device, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10681453B1 (en) | Automatic active noise reduction (ANR) control to improve user interaction | |
| WO2018149275A1 (en) | Method and apparatus for adjusting audio output by speaker | |
| CN109257682B (en) | Sound pickup adjusting method, control terminal and computer readable storage medium | |
| US10354651B1 (en) | Head-mounted device control based on wearer information and user inputs | |
| WO2017181365A1 (en) | Earphone channel control method, related apparatus, and system | |
| US10051368B2 (en) | Mobile apparatus and control method thereof | |
| US9781538B2 (en) | Multiuser, geofixed acoustic simulations | |
| EP3364638B1 (en) | Recording method, recording playing method and apparatus, and terminal | |
| US20180357038A1 (en) | Audio metadata modification at rendering device | |
| US20230034046A1 (en) | Primary-secondary ear switching method and apparatus for tws earphones in communication scenario, and medium | |
| CN109379490B (en) | Audio playing method and device, electronic equipment and computer readable medium | |
| WO2016123901A1 (en) | Terminal and method for directionally playing audio signal thereby | |
| US11430447B2 (en) | Voice activation based on user recognition | |
| US20200174735A1 (en) | Wearable audio device capability demonstration | |
| CN111179923B (en) | Audio playing method based on wearable device and wearable device | |
| US11665499B2 (en) | Location based audio signal message processing | |
| CN106302974B (en) | information processing method and electronic equipment | |
| EP3618459A1 (en) | Method and apparatus for playing audio data | |
| CN107404587B (en) | Audio playing control method, audio playing control device and mobile terminal | |
| US10516939B1 (en) | Systems and methods for steering speaker array and microphone array with encoded light rays | |
| CN112612444A (en) | Sound source position positioning method, sound source position positioning device, electronic equipment and storage medium | |
| CN113038337B (en) | Audio playing method, wireless earphone and computer readable storage medium | |
| US20230045721A1 (en) | Audio signal processing method, electronic apparatus, and storage medium | |
| WO2020102994A1 (en) | 3d sound effect realization method and apparatus, and storage medium and electronic device | |
| WO2022062999A1 (en) | Method for allocating channels and related device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220824 Address after: No. 159, Chengjiang Middle Road, Jiangyin City, Wuxi City, Jiangsu Province Applicant after: JIANGSU ZIMI ELECTRONIC TECHNOLOGY Co.,Ltd. Address before: 211100 8th floor, building C4, 19-1 Suyuan Avenue, Jiangning District, Nanjing City, Jiangsu Province (Jiangning Development Zone) Applicant before: Nanjing Ziniu Software Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right |