CN113068101B - Ring array pickup control method and device, storage medium and ring array - Google Patents
Ring array pickup control method and device, storage medium and ring array Download PDFInfo
- Publication number
- CN113068101B CN113068101B CN202110282876.XA CN202110282876A CN113068101B CN 113068101 B CN113068101 B CN 113068101B CN 202110282876 A CN202110282876 A CN 202110282876A CN 113068101 B CN113068101 B CN 113068101B
- Authority
- CN
- China
- Prior art keywords
- ring
- finger
- sound source
- target sound
- rings
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
- H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
- H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
- H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2410/00—Microphones
- H04R2410/05—Noise reduction with a separate noise microphone
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The embodiment of the application provides a ring array pickup control method, device, storage medium and ring array, the ring array includes a plurality of spaced rings, each the ring all includes the microphone, ring array pickup control method includes: acquiring sound signals collected by each finger ring and the moment when each sound signal is collected; determining the position of a target sound source according to a plurality of sound signals and the time when each sound signal is collected, wherein each sound signal is obtained by collecting sound emitted by the target sound source through the corresponding finger ring; and controlling the plurality of finger rings to collect sound signals from the direction of the target sound source. According to the method, the plurality of finger ring arrays are formed by arranging and combining the plurality of finger rings, the target sound source is positioned through the time difference and the intensity difference, and the sound signal of the target sound source is enhanced through the beam forming algorithm, so that the pickup quality of the finger ring arrays is improved.
Description
Technical Field
The present disclosure relates to the field of pickup technologies, and in particular, to a method and an apparatus for controlling pickup of a finger ring array, a storage medium, and a finger ring array.
Background
With the continuous development of digital signal processing technology, microphone array technology has begun to be widely used in a variety of systems including computers, mobile terminals, audio/video teleconferencing systems, voice recognition systems, and the like. Compared with a single microphone, the microphone array can realize spatial sampling of specific signals in a specific direction of a space domain through beam forming, and the beam forming is also called spatial filtering, specifically, the main beam is formed in a desired direction by weighting each array element, so that the desired signal is enhanced, and meanwhile, a deep zero point is formed in the interference signal direction, so that the purpose of suppressing the interference signal is achieved.
Disclosure of Invention
The embodiment of the application provides a finger ring array pickup control method and device, a storage medium and a finger ring array. The finger rings are arranged into different shapes, the target sound source is positioned, the sound signals of the target sound source are enhanced through a beam forming algorithm, the sound signals in other directions are restrained, and the pickup quality of the pickup array is improved.
A finger ring array pickup control method, the finger ring array including a plurality of spaced finger rings, each of the finger rings including a microphone, the finger ring array pickup control method comprising:
acquiring sound signals collected by each finger ring and the moment when each sound signal is collected;
determining the position of a target sound source according to a plurality of sound signals and the time when each sound signal is collected, wherein each sound signal is obtained by collecting sound emitted by the target sound source through the corresponding finger ring;
and controlling the plurality of finger rings to collect sound signals from the direction of the target sound source.
A finger ring array pickup control device applied to a finger ring array, comprising:
the acquisition module is used for acquiring the sound signals acquired by each finger ring and the moment when each sound signal is acquired;
the determining module is used for determining the position of the target sound source according to a plurality of sound signals and the time when each sound signal is acquired;
and the control module is used for controlling the plurality of finger rings to collect sound signals from the direction of the target sound source.
A storage medium having stored therein a computer program which, when executed on a computer, causes the computer to perform a finger ring array pickup control method as any one of the above.
A finger ring array for performing a finger ring array pickup control method as any one of the above.
According to the ring array pickup control method, the ring array pickup control device and the ring array, a plurality of ring arrays are formed by arranging and combining the plurality of rings, a target sound source is positioned through time difference and intensity difference of sound signals reaching each ring, the sound signals of the target sound source are enhanced through a beam forming algorithm, and the sound signals in other directions are restrained, so that the ring array pickup quality is improved, environmental noise is effectively restrained, and echo influence is eliminated.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings that are required to be used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained from these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic diagram of a finger ring array worn on a finger of a user according to an embodiment of the present application.
Fig. 2 is a schematic diagram of a single finger ring structure of a finger ring array according to an embodiment of the present application.
Fig. 3 is a schematic diagram of a first layout manner of a finger ring array according to an embodiment of the present application.
Fig. 4 is a schematic diagram of a second layout manner of a finger ring array according to an embodiment of the present application.
Fig. 5 is a flow chart of a method for controlling pickup of a finger ring array according to an embodiment of the present application.
Fig. 6 is a schematic flow chart of positioning according to a time difference according to an embodiment of the present application.
Fig. 7 is a schematic flow chart of positioning according to an intensity difference according to an embodiment of the present application.
Fig. 8 is a flow chart of a beam forming method according to an embodiment of the present application.
Fig. 9 is a schematic diagram of an application scenario of a finger ring array according to an embodiment of the present application.
Fig. 10 is a schematic structural diagram of a finger ring array pickup control device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It will be apparent that the described embodiments are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by a person skilled in the art without any inventive effort, are intended to be within the scope of the present application based on the embodiments herein.
Referring to fig. 1 and fig. 2, fig. 1 is a schematic diagram of a finger ring array worn on a finger of a user according to an embodiment of the present application, and fig. 2 is a schematic diagram of a single finger ring structure of the finger ring array according to an embodiment of the present application.
The finger ring array 100 provided in the embodiment of the present application includes a plurality of finger rings, and the structure and function of each finger ring may be the same, and only the structure and function of one finger ring will be described below as an example.
The ring may be worn on the user's finger. The ring comprises a ring-shaped structure 10, and the ring-shaped structure 10 can be made of metal, such as gold, silver, and the like, or nonmetal, such as agate, jade, plastic, and the like. The annular structure 10 can be a closed ring structure, a structure with spherical objects connected in series, such as a pearl ring, or an annular structure 10 with a notch, wherein the annular structure 10 with the notch can facilitate a user to adjust the size of the finger ring.
Wherein the ring is provided with electronic components which can be glued to the surface of the ring structure 10 or fixed inside the ring structure 10. If the material of the ring structure 10 is metal, metal shielding may occur to the charged electronic component or poor heat dissipation may occur. In this case, the electrically charged electronic component may be isolated from the metal ring structure 10 by the encapsulation structure of the outer layer as an insulator, or there may be an insulator such as plastic, rubber, etc. between the electrically charged electronic component and the metal ring structure 10 to achieve electrical isolation between the two. It will be appreciated that the annular structure 10 is made of an insulating material, so that metal shielding of the electronic component by the metal annular structure 10 can be avoided. Or, the ring structure 10 is provided with a hollowed-out insulating ornament, and the electronic element is arranged in the ornament, so that the influence of the metal ring structure 10 on the electronic element can be avoided.
The finger ring further includes a processing chip 40, a battery 30, and a microphone 20, and the processing chip 40 may have a processor and memory integrated thereon. A processor such as a CPU (Central Processing Unit ) may perform data processing. The memory may store data, such as an operating system and application programs. The processing chip 40 may run an operating system and applications stored on a memory.
Wherein the battery 30 is connected to the processing chip 40 to realize that the battery 30 supplies power to the processing chip 40. Wherein a power management circuit may be provided in the finger ring array 100 for distributing the voltage provided by the battery 30 to the various electronic devices in the finger ring array 100. It is understood that the type of battery may be a lithium battery or a solar battery, etc.
Wherein the microphone 20 may be provided one on each finger ring. For example, the smart ring may be worn on each or part of the fingers of one palm, or may be worn on part or all of the fingers of both palms. The intelligent finger rings are sleeved on the fingers, and each intelligent finger ring is provided with one microphone 20, so that a plurality of microphones 20 on a plurality of intelligent finger rings can form an effective array, and the intelligent finger rings are favorable for acquiring sound in all directions. The microphone 20 is electrically connected to the processing chip 40 and the battery 30, and it is understood that the electrical connection may be a direct connection to enable transmission of electrical signals, or an indirect connection, for example, through a switch or other electronic device. The intelligent ring can also be provided with an inlet hole, which is beneficial to the entry of sound pressure and air pressure.
Referring to fig. 3 and fig. 4 simultaneously, fig. 3 is a schematic diagram of a first layout manner of a finger ring array according to an embodiment of the present application. Fig. 4 is a schematic diagram of a second layout manner of a finger ring array according to an embodiment of the present application. It will be appreciated that when a user wears a plurality of finger rings, a variety of wear patterns may be formed depending on individual size and wear habits. Each finger can be provided with one finger ring to form a linear finger ring array as shown in fig. 3, or each finger can be provided with two finger rings to form a ring array as shown in fig. 4.
Through the combination of different finger ring wearing positions and different finger ring numbers of users, different finger ring microphone arrays are formed, and then the corresponding algorithms of a sound source positioning method, beam forming and the like are matched, so that the effect of picking up sound in a certain specific direction is achieved, and meanwhile, the sound pick-up effect of sound in other directions is restrained.
Referring to fig. 5, fig. 5 is a schematic flow chart of a finger ring array pickup control method according to an embodiment of the present application. The finger ring array pickup control method can be applied to the finger ring array 100, and the pickup control is realized by picking up sound by the microphone 20 of the finger ring array 100 and processing the picked-up sound by the processing chip 40. The pickup control method comprises the following steps:
110, acquiring the sound signal collected by each finger ring and the moment when each sound signal is collected.
It will be appreciated that the coordinates of each of the finger loops are first preset. The ring array can be connected with electronic products such as mobile phones, computers and tablet computers through wireless connection technologies such as Bluetooth connection, software matched with the rings is downloaded and applicable to the electronic products, the mode of wearing the rings by a user can be preset in the software in advance, the coordinates of the rings in the ring array are preset according to a specific wearing mode, and the interval distance of the rings can be obtained through the coordinates.
It will be appreciated that the sound signal may include a number of information such as energy, sound intensity, amplitude, wavelength, phase, pitch, frequency and period. The intensity of sound will fade gradually as it propagates through the spatial distance, so that it will appear that there will be a difference in the intensity of sound received by each finger loop. Thus, the position of the sound source is calculated and determined from the difference in sound intensity in combination with a correlation algorithm. It will be appreciated that due to the inconsistent distance of each finger loop from the target sound source, a time difference may be created between the moments when each two finger loops collect sound signals. Likewise, the position of the sound source can be calculated and determined by means of time differences and related algorithms.
120, determining the position of the target sound source according to the plurality of sound signals and the time when each sound signal is collected.
In some embodiments, the time difference may be used, as well as the sound intensity difference, to locate the sound source.
Referring to fig. 6, fig. 6 is a schematic flow chart of positioning according to a time difference according to an embodiment of the present application. Wherein, generating the localization to the sound source according to the time difference specifically comprises the following steps:
and 121, acquiring the time difference of sound signals acquired by each two finger rings according to the plurality of moments.
It will be appreciated that the distances between each finger ring and the target sound source are different, and it is the difference between these distances that makes the time when each finger ring collects the sound signal different, and the time difference when each two finger rings collect the sound signal can be obtained according to the multiple times.
122, determining a difference value between the distances between the corresponding two finger rings and the target sound source according to each time difference.
It will be appreciated that the propagation velocity of sound in air is known as: the propagation speed is 340m/s when the air is at 15 ℃; the propagation speed was 346m/s at an air temperature of 25 ℃. Assuming that the position coordinates of the target sound source are (X, y, z), the geometric coordinates of the first ring, the second ring and the third ring are preset in the matching software according to step 110 to be (X 1 ，Y 1 ，Z 1 )、(X 2 ，Y 2 ，Z 2 )、(X 3 ，Y 3 ，Z 3 ) And then according to the formula:
ΔS＝ΔT*C (1)
wherein deltat is the time difference and deltas is the difference between the distances between each two finger rings and the target sound source.
The difference between the distances of each two of the finger loops from the target sound source can be determined by formula (1).
123, determining the position of the target sound source according to the difference value between the distances between every two finger rings and the target sound source.
It can be understood that a set of ternary quadratic equations is obtained according to the formula (1) Δs=Δt×c and the coordinate values of the rings preset in step 110, as follows:
the position coordinates (x, y, z) of the target sound source can be calculated and determined by solving the equation set, thereby determining the position of the target sound source.
In some embodiments, the over-intensity difference may be used to locate the sound source. Referring to fig. 7, fig. 7 is a schematic flow chart of positioning according to an intensity difference according to an embodiment of the present application. Wherein, generating the localization to the sound source according to the intensity difference specifically comprises the following steps:
141, acquiring the sound intensity of each sound signal.
It will be appreciated that the sound signal may include a number of information such as energy, sound intensity, amplitude, wavelength, phase, pitch, frequency and period. The intensity of the sound will fade gradually as it propagates through the spatial distances, so that it will appear that there is a difference in the intensity of the sound received by each finger loop. The corresponding sound intensity can be obtained by analyzing the sound signal received by each finger loop, thereby obtaining the intensity difference.
142, obtaining the time difference of sound signals collected by each two finger rings according to the plurality of moments.
It will be appreciated that the distances between each finger ring and the target sound source are different, and it is the difference between these distances that makes the time when each finger ring collects the sound signal different, and the time difference when each two finger rings collect the sound signal can be obtained according to the multiple times.
143, determining a sound attenuation coefficient of the target sound source according to each sound intensity and each time difference.
When sound emitted by a sound source propagates in air, the following sound intensity attenuation model can be defined:
wherein y is i Representing the intensity of sound detected by the ith finger loop,
represents the gain of the ith finger loop, S represents the sound intensity at 1m from the sound source (which can be considered to be the intensity of the target sound source), r i Represents the coordinates of the ith finger ring, r represents the coordinates of the sound source, α represents the sound attenuation coefficient, ε i Representing the ambient sound near the ith finger loop.
When the two rings are in the same environment and the noise is negligible, it can be obtained by equation (3):
wherein y is i And y j Representing the detected sound intensities of the ith and jth finger loops, r i And r j Representing the coordinates of the ith and jth finger loops, respectively, r representing the coordinates of the sound source, alpha ij Representing the sound attenuation coefficient determined by the ith and jth finger loops.
The sound attenuation coefficient alpha determined by the ith and jth finger ring can be obtained according to the formula (4) ij The sound attenuation coefficient α can then be obtained as:
n is the number of the rings in the ring array which participate in the sound signal acquisition work.
144, determining the position of the target sound source according to the sound attenuation coefficient.
Let k be ij For the distance ratio of the ith slave node and the jth slave node to the sound source, there are
Since the sound attenuation coefficient has been obtained before, k ij The value of (2) can be obtained by the following formula:
order the
Equation (7) can be expressed as:
|r-C ij | 2 ＝ρ ij 2 (8)
it will be appreciated that a circle can be obtained for every two rings, and that a plurality of circles can be determined using a plurality of rings, the intersection of which is the sound source location.
It can be understood that the direction of the target sound source can be determined efficiently and accurately by acquiring the time difference and the intensity difference and combining the corresponding algorithm, so that subsequent sound processing is facilitated.
130, controlling the plurality of finger rings to collect sound signals from the direction of the target sound source.
After determining and calculating the position of the target sound source in step 120, the ring can be controlled to collect the sound signal from the direction of the target sound source. It will be appreciated that this process is a process performed on the sound signal to achieve the pick-up of sound in a particular direction by employing a corresponding human voice enhancement algorithm as well as a noise filtering algorithm. A beamforming algorithm is employed in the embodiments of the present application to process the sound signals.
It can be appreciated that the digital beam former is the basis of full digital ultrasound imaging and is also the guarantee of high-performance color ultrasound. Beamforming, which is spatial filtering. And N array elements are sampled simultaneously by using the FPGA at a certain moment to obtain one sample of each channel at the same moment, and the data of each channel at the same moment is obtained just like photographing. The wave beam forming is spatial filtering, compared with time domain filtering, is time domain sequence, and is carried out filtering, filtering coefficient, sampling sequence is continuously input and convolved with the filtering coefficient to obtain response output; the beam forming is to obtain a plurality of beam outputs through a spatial filtering coefficient aiming at different array elements at a certain moment; spatial filter coefficients, typically narrowband phase shift coefficients. And multiplying the snapshot data with M groups of spatial filter coefficient matrixes to obtain M spatial filter data, wherein the maximum value is the beam arrival direction. Beamforming refers to a method of processing (e.g., weighting, delaying, summing, etc.) the outputs of the array elements of a multi-element array arranged in a certain geometry (e.g., straight line, cylinder, arc, etc.) to form spatial directivity.
Referring to fig. 8, fig. 8 is a flow chart of a beam forming method according to the present embodiment. The method for processing the sound signal by using the beam forming method comprises the following specific steps of:
131, determining the distance between each finger ring and the target sound source.
The distance between each finger ring and the target sound source can be determined through the formula (1) according to the moment when the sound signal is acquired by each finger ring.
And 132, calculating a time delay compensation value of each ring according to the distance and the position of the target sound source.
It will be appreciated that the location of the target sound source may be obtained by step 120 to determine the geometric relationship of the target sound source and each ring.
It will be appreciated that digital beamforming consists of two parts, transmit and receive. Digital is a key technique for receive beamforming that achieves beam focusing by replacing LC delay lines in an analog beamformer with sequential memory FIFO or random access memory dual port RAM, i.e., digital delay compensation instead of compensation for analog delay. Calculating delay compensation values of all channels of the microphone array by obtaining the position of the target sound source, selecting one ring in the ring array as a reference, performing no delay compensation on the voice signals received by the reference microphone, and performing no delay compensation on the voice signals S received by the microphones on all the rings in the ring array i The following delay compensation calculation is carried out, and the specific formula is as follows:
S i '(k)＝S i (k') (9)
where i is the number of each finger ring, d is the spacing of each finger ring, C is the speed of sound in air (340 m/s in this embodiment), f s For sampling frequency of microphone array speech signal, round []Representing a rounding operation.
And 133, performing beam forming processing on the sound signal according to the time delay compensation value, wherein the beam forming direction is aligned to the target sound source direction.
It can be appreciated that the beamforming process is performed based on the delay compensation values for each finger of the finger array. After the sound source position is obtained in step 120, the sound signal after analog-digital conversion is sent to a weighted superposition module in an STM32F407 microprocessor to form a beam, and the direction of the beam is aligned to the direction of the target sound source.
134, performing enhancement processing on the collected sound signals from the direction of the target sound source; and performing suppression processing on the collected sound signals from directions other than the direction of the target sound source.
It can be understood that the step of enhancing the collected sound signal from the direction of the target sound source further includes the step of enhancing the collected sound signal from the direction of the target sound source; and performing suppression processing on the collected sound signals from directions other than the direction of the target sound source. The sound signal of the target sound source can be enhanced and the sound signals in other directions can be restrained through the wave beam forming algorithm, so that the pick-up quality of the finger ring array is improved, the environmental noise is effectively restrained, and the echo influence is eliminated.
Referring to fig. 9, fig. 9 is an application scenario schematic diagram of a finger ring array provided in an embodiment of the present application.
In this embodiment, the user wears the finger ring by any finger on the palm to form a differently shaped finger ring array 100, with a microphone on each finger ring. The ring acquires the sound signal collected by each microphone and the collection time corresponding to the sound signal. The position information of the target sound source 101 can be determined by a correlation algorithm, so that sound signals from the direction of the target sound source 101 are enhanced by a sound enhancement algorithm, and sounds in other directions except the direction of the target sound source 101 are restrained, and sound in the direction range of the target sound source 101 is directionally recorded.
Referring to fig. 10, fig. 10 is a schematic structural diagram of a finger ring array pickup control device according to an embodiment of the present application. The finger ring array pickup control device 150 includes an acquisition module 151, a determination module 152, and a control module 153.
An acquiring module 151, configured to acquire a sound signal acquired by each finger ring and a time when each sound signal is acquired;
a determining module 152, configured to determine a position of a target sound source according to a plurality of the sound signals and a time when each of the sound signals is collected;
the control module 153 is configured to control the plurality of finger rings to collect sound signals from a direction in which the target sound source is located.
It can be understood that each finger ring is provided with a microphone, and a user obtains a sound signal collected by each microphone and a collection time corresponding to the sound signal through an acquisition module 151 matched with the electronic product. Each finger loop may computationally determine location information of the target sound source using a correlation algorithm by the determination module 152. By the control module 153, according to the determined position information of the target sound source, a sound enhancement algorithm such as a beam forming algorithm is used to enhance the sound signal from the direction of the target sound source and inhibit the sound in other directions except the direction of the target sound source, so as to realize the control of the ring array to directionally record the sound in the direction range of the target sound source. Therefore, the pickup quality of the finger ring array is improved, the environmental noise is effectively restrained, and the echo influence is eliminated.
According to the finger ring array pickup control method, the finger ring array pickup control device and the finger ring array, the finger rings with the plurality of embedded microphones are worn at the designated positions by a user to form the plurality of finger ring arrays, the microphone arrays are matched with corresponding algorithms, the target sound source is positioned through the time difference and the intensity difference of the sound signals reaching each finger ring, the sound signals of the target sound source are enhanced through the beam forming algorithm, and the sound signals in other directions are restrained, so that the pickup quality of the finger ring arrays is improved, the environmental noise is effectively restrained, and the echo influence is eliminated.
It should be noted that, those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be implemented by a computer program to instruct related hardware, and the computer program may be stored in a computer readable storage medium, where the storage medium may include, but is not limited to: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like.
The method, the device and the storage medium for controlling the pickup of the ring array provided by the embodiment of the application are described in detail. The principles and embodiments of the present application are described herein with specific examples, the above examples being provided only to assist in understanding the methods of the present application and their core ideas; meanwhile, those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, and the present description should not be construed as limiting the present application in view of the above.
Claims (8)
1. A finger ring array pickup control method, wherein the finger ring array includes a plurality of spaced finger rings, each of the finger rings including a microphone, the finger ring array pickup control method comprising:
acquiring sound signals acquired by each ring and the moment when each sound signal is acquired, wherein each ring comprises a first ring, a second ring and a third ring;
acquiring the time difference of sound signals acquired by each two finger rings according to a plurality of moments;
determining a difference value between the distances between the corresponding two finger rings and the target sound source according to each time difference; wherein the position coordinates of the target sound source are (X, y, z), and the geometric coordinates of the first finger ring, the second finger ring and the third finger ring are (X 1 ，Y 1 ，Z 1 )、(X 2 ，Y 2 ，Z 2 )、(X 3 ，Y 3 ，Z 3 ) Calculating the difference value between each two finger rings and the target sound source according to the formula delta S=delta T.C, wherein delta T is the time difference, delta S is the difference value between each two finger rings and the target sound source, and C is the propagation speed of sound in air;
obtaining a set of ternary quadratic equations according to the formula Δs=Δt×c and the geometric coordinates of the first ring, the second ring and the third ring:
calculating position coordinates (x, y, z) of the target sound source by solving the ternary quadratic equation set to determine the position of the target sound source, wherein the geometric coordinates of the rings are obtained from the coordinates of each ring in a preset ring array, and the coordinates of each ring in the preset ring array are set according to the mode that a preset user wears the rings;
and controlling the plurality of finger rings to collect sound signals from the direction of the target sound source.
2. The finger ring array pickup control method according to claim 1, wherein said controlling the plurality of finger rings to collect sound signals from a direction in which the target sound source is located comprises:
determining the distance between each ring and the target sound source;
calculating a time delay compensation value of each ring according to the distance and the position of the target sound source;
and carrying out beam forming processing on the sound signal according to the time delay compensation value, wherein the beam forming direction is aligned to the target sound source direction.
3. The finger ring array sound pickup control method according to claim 1, wherein said controlling said plurality of finger rings to collect sound signals from a direction in which said target sound source is located further comprises:
and carrying out enhancement processing on the collected sound signals from the direction of the target sound source.
4. The method of claim 3, further comprising, after the enhancing the collected sound signal from the direction in which the target sound source is located:
and performing suppression processing on the collected sound signals from the directions outside the direction of the target sound source so as to weaken the collected sound signals from the directions outside the direction of the target sound source.
5. The finger ring array pickup control method according to claim 1, wherein:
the arrangement mode of the finger rings is a linear array or a circular array.
6. A finger ring array pickup control device applied to a finger ring array, comprising:
the acquisition module is used for acquiring the sound signals acquired by each ring and the time when each sound signal is acquired, and the rings comprise a first ring, a second ring and a third ring;
the determining module is used for acquiring the time difference of sound signals acquired by each two finger rings according to a plurality of moments; determining a difference value between the distances between the corresponding two finger rings and the target sound source according to each time difference; wherein the position coordinates of the target sound source are (X, y, z), and the geometric coordinates of the first finger ring, the second finger ring and the third finger ring are (X 1 ，Y 1 ，Z 1 )、(X 2 ，Y 2 ，Z 2 )、(X 3 ，Y 3 ，Z 3 ) Calculating the difference value between each two finger rings and the target sound source according to the formula delta S=delta T.C, wherein delta T is the time difference, delta S is the difference value between each two finger rings and the target sound source, and C is the propagation speed of sound in air; obtaining a set of ternary quadratic equations according to the formula Δs=Δt×c and the geometric coordinates of the first ring, the second ring and the third ring:
calculating position coordinates (x, y, z) of the target sound source by solving the ternary quadratic equation set to determine the position of the target sound source, wherein the geometric coordinates of the rings are obtained from the coordinates of each ring in a preset ring array, and the coordinates of each ring in the preset ring array are set according to the mode that a preset user wears the rings;
and the control module is used for controlling the plurality of finger rings to collect sound signals from the direction of the target sound source.
7. A storage medium having stored therein a computer program which, when executed on a computer, causes the computer to execute the finger ring array pickup control method according to any one of claims 1 to 5.
8. A finger ring array comprising a plurality of spaced finger rings, each finger ring comprising a processor, a memory and a microphone, the memory storing a computer program, the processor being operable to perform the steps of the finger ring array pickup control method of any one of claims 1 to 5 by invoking the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110282876.XA CN113068101B (en) | 2021-03-16 | 2021-03-16 | Ring array pickup control method and device, storage medium and ring array |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110282876.XA CN113068101B (en) | 2021-03-16 | 2021-03-16 | Ring array pickup control method and device, storage medium and ring array |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113068101A CN113068101A (en) | 2021-07-02 |
| CN113068101B true CN113068101B (en) | 2023-06-09 |
Family
ID=76560677
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110282876.XA Active CN113068101B (en) | 2021-03-16 | 2021-03-16 | Ring array pickup control method and device, storage medium and ring array |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113068101B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102597919A (en) * | 2009-11-02 | 2012-07-18 | 斯坦利·维斯马尔 | Electronic finger ring and the fabrication thereof |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW201539249A (en) * | 2014-04-02 | 2015-10-16 | zhi-hong Tang | 3C smart ring |
| US10043125B2 (en) * | 2015-04-06 | 2018-08-07 | Qualcomm Incorporated | Smart ring |
| CN105044676B (en) * | 2015-09-15 | 2016-12-21 | 北京理工大学 | A kind of sound localization method based on energy |
| US10635173B2 (en) * | 2016-08-08 | 2020-04-28 | Motorola Solutions, Inc. | Smart ring providing multi-mode control in a personal area network |
| CN108962272A (en) * | 2018-06-21 | 2018-12-07 | 湖南优浪语音科技有限公司 | Sound pick-up method and system |
| CN109164414A (en) * | 2018-09-07 | 2019-01-08 | 深圳市天博智科技有限公司 | Localization method, device and storage medium based on microphone array |
| CN109788382A (en) * | 2019-01-25 | 2019-05-21 | 深圳大学 | A kind of distribution microphone array pickup system and method |
| CN110197671A (en) * | 2019-06-17 | 2019-09-03 | 深圳壹秘科技有限公司 | Orient sound pick-up method, sound pick-up outfit and storage medium |
-
2021
- 2021-03-16 CN CN202110282876.XA patent/CN113068101B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102597919A (en) * | 2009-11-02 | 2012-07-18 | 斯坦利·维斯马尔 | Electronic finger ring and the fabrication thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113068101A (en) | 2021-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110364166B (en) | Electronic equipment for realizing speech signal recognition | |
| US20220382381A1 (en) | Multifunctional Radar Systems and Methods of Operation Thereof | |
| Ishi et al. | Evaluation of a MUSIC-based real-time sound localization of multiple sound sources in real noisy environments | |
| Dey et al. | Direction of arrival estimation and localization of multi-speech sources | |
| Famoriji et al. | An intelligent deep learning-based direction-of-arrival estimation scheme using spherical antenna array with unknown mutual coupling | |
| Garg et al. | Owlet: Enabling spatial information in ubiquitous acoustic devices | |
| Agarwal et al. | Higher-order-statistics-based direction-of-arrival estimation of multiple wideband sources with single acoustic vector sensor | |
| Pujol et al. | BeamLearning: An end-to-end deep learning approach for the angular localization of sound sources using raw multichannel acoustic pressure data | |
| He et al. | Closed-form DOA estimation using first-order differential microphone arrays via joint temporal-spectral-spatial processing | |
| Salvati et al. | Power method for robust diagonal unloading localization beamforming | |
| Yadav et al. | Support vector machine-based direction of arrival estimation with uniform linear array | |
| US20140269198A1 (en) | Beamforming Sensor Nodes And Associated Systems | |
| CN113068101B (en) | Ring array pickup control method and device, storage medium and ring array | |
| CN112859000A (en) | Sound source positioning method and device | |
| Ding et al. | Microphone array acoustic source localization system based on deep learning | |
| Tourbabin et al. | Enhanced robot audition by dynamic acoustic sensing in moving humanoids | |
| CN116343808A (en) | Flexible microphone array voice enhancement method and device, electronic equipment and medium | |
| Lim et al. | Time delay estimation based on log-sum and lp-norm penalized minor component analysis | |
| Li et al. | Acoustic enhanced camera tracking system based on small-aperture MEMS microphone array | |
| Astapov et al. | A two-stage approach to 2D DOA estimation for a compact circular microphone array | |
| CN109239665B (en) | Multi-sound-source continuous positioning method and device based on signal subspace similarity spectrum and particle filter | |
| Wu et al. | Sound source localization based on multi-task learning and image translation network | |
| Essid et al. | Multiview approaches to event detection and scene analysis | |
| Dey et al. | Microphone array principles | |
| Ahmad et al. | A survey of deep neural network in acoustic direction finding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |