CN107331402B - Recording method and recording device based on double microphones - Google Patents
Recording method and recording device based on double microphones Download PDFInfo
- Publication number
- CN107331402B CN107331402B CN201710462027.6A CN201710462027A CN107331402B CN 107331402 B CN107331402 B CN 107331402B CN 201710462027 A CN201710462027 A CN 201710462027A CN 107331402 B CN107331402 B CN 107331402B
- Authority
- CN
- China
- Prior art keywords
- recording
- microphone
- voice
- mode
- field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000012545 processing Methods 0.000 claims abstract description 53
- 230000000694 effects Effects 0.000 claims abstract description 11
- 230000008569 process Effects 0.000 claims description 12
- 230000009467 reduction Effects 0.000 claims description 9
- 230000009977 dual effect Effects 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 claims description 3
- 229920001296 polysiloxane Polymers 0.000 claims description 3
- 239000000047 product Substances 0.000 description 10
- 230000008859 change Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 4
- VYPSYNLAJGMNEJ-UHFFFAOYSA-N Silicium dioxide Chemical compound O=[Si]=O VYPSYNLAJGMNEJ-UHFFFAOYSA-N 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 239000000741 silica gel Substances 0.000 description 3
- 229910002027 silica gel Inorganic materials 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 239000007795 chemical reaction product Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000003796 beauty Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000002401 inhibitory effect Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000000452 restraining effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/003—Changing voice quality, e.g. pitch or formants
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
- G11B2020/10537—Audio or video recording
- G11B2020/10546—Audio or video recording specifically adapted for audio data
Landscapes
- Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The embodiment of the invention provides a recording method and a recording device based on double microphones, wherein the recording method is based on a terminal device provided with a first microphone and a second microphone, and comprises the following steps: receiving a recording mode set by a user; according to a recording rule corresponding to the recording mode, the first microphone and the second microphone are turned on or off, and voice data are picked up through the turned-on first microphone and/or the turned-on second microphone; and determining a voice processing mode matched with the recording rule, and performing sound effect processing on the voice data through the voice processing mode. The invention solves the problems of insufficient voice volume and serious low-frequency loss during recording, provides necessary premise guarantee for realizing high-definition remote pickup in a complex environment, realizes that voice data with high sound effect quality is conveniently picked up in different recording modes, saves recording cost and further improves the use experience of users.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a recording method and recording equipment based on double microphones.
Background
With the rise of network live broadcast, a plurality of live broadcast equipment products begin to emerge on the market continuously, and recording and video recording are one of two most core functions of the network live broadcast equipment, wherein the recording is particularly important for reproducing live broadcast sites, because visual guidance is one of the main functions of ears, high-definition sound effect is very important for the creation of 'telepresence', the recording quality becomes an important standard for distinguishing the grades of the plurality of live broadcast equipment products, and at present, the sound pickup of the network live broadcast equipment becomes one of the major bottlenecks for acquiring live sites.
Live broadcasting is divided into indoor live broadcasting and outdoor live broadcasting, wherein the indoor live broadcasting mainly focuses on the definition and fidelity of voice, and the recording is easy to realize by externally connecting a professional microphone, but users have the requirements of beauty and convenience, so that the indoor live broadcasting generally needs to be externally connected with an independent sound card and a directional microphone to record sound; when outdoor live broadcast is outdoor recording, then it is portable to need live broadcast equipment, high durability and convenient use, because outdoor live broadcast environment often is more complicated, not only need face stronger noise and more pronunciation interference source, and because the distance that the speaker is from the microphone often far away, consequently often need realize the recording to sound through long-range recording, current live broadcast low end product is usually to come the pickup through single omnidirectionality microphone, its pickup tone quality receives the influence of interference noise easily, and often realize monophony/binaural pickup through placing one or two directive property microphones on some high-end products, still be difficult to realize high-fidelity pickup and fall the noise.
In the process of implementing the invention, the inventor finds that at least the following problems exist in the prior art: the recording of the sound is realized by connecting an independent sound card and a directional microphone in an indoor live broadcast mode, the cost is high, the occupied space is large, the mobility is poor, and the recording can be realized only by debugging technical personnel; the distance between a speaker and a live broadcasting product is often far away in the live broadcasting process of outdoor live broadcasting, the loss of low-frequency components of sound picked up by a directional microphone is obvious along with the increase of the distance, high-fidelity sound pickup and noise reduction are difficult to realize, and obvious voice distortion occurs in outdoor recording, meanwhile, another big problem of sound pickup of outdoor live broadcasting equipment is the diversity of working forms in the outdoor live broadcasting process, for example, a user not only can aim a camera at himself but also can aim at scenery in front of the user, at the moment, the microphone is placed at the front part/rear part and is easy to cause the change of recording environment due to the direction adjustment of the live broadcasting equipment, in order to obtain higher sensitivity, the microphone on the live broadcasting equipment is usually larger in size, even if the microphone is fully directional, the microphone can bring larger directivity due to the size, when the microphone is reversed, the recording tone quality of high-frequency band is, and the audio parameters of live broadcast equipment pickup system are fixed, and can not be automatically adjusted due to the change of the position of the product, so that the live broadcast needs to be fixed by the user during live broadcast, and the flexibility of the live broadcast used by the user is influenced.
Therefore, a recording method is needed to solve a series of problems encountered in the above-mentioned live broadcasting process.
Disclosure of Invention
The embodiment of the invention provides a recording method and recording equipment based on double microphones, which provide an integrated pickup scheme for live equipment products, realize the convenience of indoor use of the live equipment by users, solve the problems of insufficient far-field voice volume and serious low-frequency loss caused by the use of a single-directional microphone by the current live equipment, and simultaneously solve the problem that when the user turns the product to the direction due to the live requirement during use, a microphone pickup system cannot adapt to the change to cause the influence of the recording voice quality caused by the change of the product direction.
In one aspect, an embodiment of the present invention provides a recording method based on two microphones, where the recording method is based on a terminal device provided with a first microphone and a second microphone, and includes:
receiving a recording mode set by a user;
according to a recording rule corresponding to the recording mode, the first microphone and the second microphone are turned on or off, and voice data are picked up through the turned-on first microphone and/or the turned-on second microphone;
and determining a voice processing mode matched with the recording rule, and performing sound effect processing on the voice data through the voice processing mode.
In another aspect, an embodiment of the present invention provides a recording apparatus based on two microphones, where the recording apparatus is provided with a first microphone and a second microphone, and includes:
the first receiving unit is used for receiving a recording mode set by a user;
the opening and closing unit is used for opening or closing the first microphone and the second microphone according to a recording rule corresponding to the recording mode and picking up voice data through the opened first microphone and/or the opened second microphone;
and the determining and processing unit is used for determining a voice processing mode matched with the recording rule and carrying out sound effect processing on the voice data through the voice processing mode.
The technical scheme has the following beneficial effects: the recording mode set by the user is received, so that the voice data can be picked up according to the recording mode defined by the user, and the use experience of the user is greatly improved; according to the recording rule corresponding to the recording mode, the first microphone and the second microphone are opened or closed, and voice data are picked up through the opened first microphone and/or the opened second microphone, so that the problems of insufficient voice volume and serious low-frequency loss during recording are solved, necessary precondition guarantee is provided for realizing high-definition remote pickup in a complex environment, meanwhile, the self-adaption to the orientation change of the recording equipment is realized on the premise of ensuring the recording tone quality, and the personalized recording requirement of a user is met; confirm with recording rule assorted speech processing mode, and pass through speech processing mode is right speech data carries out the audio processing, has realized picking up the speech data of high audio quality under the recording mode of difference conveniently, simultaneously, avoids the user to need purchase the condition of a series of complex, the with high costs equipment of degree of operation such as independent sound card, professional microphone, has practiced thrift the recording cost, and furtherly has improved user's use and has experienced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart of a recording method based on two microphones according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a dual-microphone based recording apparatus according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a dual microphone recording apparatus according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a dual microphone according to an embodiment of the present invention;
FIG. 5 is a flow chart of a recording method based on two microphones according to a preferred embodiment of the present invention;
fig. 6 is a schematic structural diagram of a recording apparatus based on two microphones according to a preferred embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, a recording method based on two microphones in an embodiment of the present invention is based on a terminal device having a first microphone and a second microphone, and includes:
101. receiving a recording mode set by a user;
102. according to a recording rule corresponding to the recording mode, the first microphone and the second microphone are turned on or off, and voice data are picked up through the turned-on first microphone and/or the turned-on second microphone;
103. and determining a voice processing mode matched with the recording rule, and performing sound effect processing on the voice data through the voice processing mode.
Preferably, the first microphone and the second microphone are respectively arranged on the front side and the back side of the terminal equipment, and the bottoms of the first microphone and the second microphone are connected through a silica gel sleeve.
Preferably, the recording modes include a far-field recording mode and a near-field recording mode;
wherein, the recording rule that the recording mode corresponds includes:
when the recording mode is a far-field recording mode, far-field voice is picked up through the first microphone and the second microphone;
when the recording mode is a near-field recording mode, picking up near-field voice data through a microphone picking up voice from the front and closing another microphone;
wherein, with the speech processing mode of recording rule assorted includes:
the voice processing mode matched with the recording rule corresponding to the far-field recording mode is that far-field voice is picked up according to a picked-up voice angle calculated by a beam forming algorithm;
and the voice processing mode matched with the recording rule corresponding to the near-field recording mode is to process the picked near-field voice in a voice noise reduction and voice enhancement mode.
Optionally, the recording method further includes:
receiving a recording direction set by a user;
wherein, when the recording mode is far field recording mode, the recording rule that the recording mode corresponds includes:
and based on the recording direction set by the user, picking up far-field voice through a microphone matched with the recording direction and closing another microphone.
Optionally, the recording method further includes:
monitoring the rotation angle of the terminal equipment, and judging the current recording mode when the rotation angle of the terminal equipment is larger than a preset angle;
and if the current recording mode is judged to be the far-field recording mode, switching the current far-field recording mode into the near-field recording mode.
Optionally, the recording method further includes:
sending the picked voice data to a cloud server; and/or
And storing the picked voice data to a preset storage position of the terminal equipment.
As shown in fig. 2, a recording apparatus based on two microphones in an embodiment of the present invention is a recording apparatus provided with a first microphone and a second microphone, and includes:
a first receiving unit 21 for receiving a recording mode set by a user;
the opening and closing unit 22 is configured to open or close the first microphone and the second microphone according to a recording rule corresponding to the recording mode, and pick up voice data through the opened first microphone and/or the opened second microphone;
and the determining and processing unit 23 is configured to determine a voice processing mode matched with the recording rule, and perform sound effect processing on the voice data through the voice processing mode.
Preferably, the first microphone and the second microphone are respectively arranged on the front side and the back side of the terminal equipment, and the bottoms of the first microphone and the second microphone are connected through a silica gel sleeve.
Preferably, the recording modes include a far-field recording mode and a near-field recording mode;
wherein, the recording rule that the recording mode corresponds includes:
when the recording mode is a far-field recording mode, far-field voice is picked up through the first microphone and the second microphone;
when the recording mode is a near-field recording mode, picking up near-field voice data through a microphone picking up voice from the front and closing another microphone;
wherein, with the speech processing mode of recording rule assorted includes:
the voice processing mode matched with the recording rule corresponding to the far-field recording mode is that far-field voice is picked up according to a picked-up voice angle calculated by a beam forming algorithm;
and the voice processing mode matched with the recording rule corresponding to the near-field recording mode is to process the picked near-field voice in a voice noise reduction and voice enhancement mode.
Optionally, the sound recording apparatus further comprises:
the second receiving unit is used for receiving the recording direction set by the user;
wherein, when the recording mode is far field recording mode, the recording rule that the recording mode corresponds includes:
and based on the recording direction set by the user, picking up far-field voice through a microphone matched with the recording direction and closing another microphone.
The technical scheme of the embodiment of the invention has the following beneficial effects: the recording mode set by the user is received, so that the voice data can be picked up according to the recording mode defined by the user, and the use experience of the user is greatly improved; according to the recording rule corresponding to the recording mode, the first microphone and the second microphone are opened or closed, and voice data are picked up through the opened first microphone and/or the opened second microphone, so that the problems of insufficient voice volume and serious low-frequency loss during recording are solved, necessary precondition guarantee is provided for realizing high-definition remote pickup in a complex environment, meanwhile, the self-adaption to the orientation change of the recording equipment is realized on the premise of ensuring the recording tone quality, and the personalized recording requirement of a user is met; confirm with recording rule assorted speech processing mode, and pass through speech processing mode is right speech data carries out the audio processing, has realized picking up the speech data of high audio quality under the recording mode of difference conveniently, simultaneously, avoids the user to need purchase the condition of a series of complex, the with high costs equipment of degree of operation such as independent sound card, professional microphone, has practiced thrift the recording cost, and furtherly has improved user's use and has experienced.
The above technical solutions of the embodiments of the present invention are described in detail below with reference to application examples:
the application example of the invention aims to provide an integrated pickup scheme for live broadcast equipment products, realize the convenience of indoor user use of the live broadcast equipment, solve the problems of insufficient far-field voice volume and serious low-frequency loss caused by using a unidirectional microphone by the current live broadcast equipment, and simultaneously solve the problem that when a user turns the product to the direction because of the live broadcast requirement, a microphone pickup system cannot adapt to the change to cause the influence of the change of the product direction on the recording tone quality.
As shown in fig. 1, a recording method based on two microphones in an embodiment of the present invention is based on a terminal device having a first microphone and a second microphone, and includes:
101. and receiving a recording mode set by a user.
Specifically, relevant parameters of the recording mode set by the user are received.
Preferably, the first microphone and the second microphone are respectively arranged on the front side and the back side of the terminal equipment, and the bottoms of the first microphone and the second microphone are connected through a silica gel sleeve.
Preferably, the first microphone and the second microphone are omni-directional microphones.
For example, in a terminal device a provided with a first microphone and a second microphone, referring to fig. 3, the first microphone and the second microphone are respectively disposed on the front side and the back side of the terminal device a, and a layer of silicone sleeve is used between the bottoms of the first microphone and the second microphone to realize fixation and vibration isolation, so as to form a "back-to-back" dual-microphone array, which is formed as shown in fig. 4; the first microphone and the second microphone which are arranged back to back are all full-directional microphones; in the user interface of the terminal device a, an option of a set recording mode is provided, and the user determines relevant parameters of the selected recording mode through the selected recording mode, and then receives the relevant parameters of the recording mode selected by the user through the terminal device a.
102. According to a recording rule corresponding to the recording mode, the first microphone and the second microphone are turned on or off, and voice data are picked up through the turned-on first microphone and/or the turned-on second microphone;
preferably, the recording modes include a far-field recording mode and a near-field recording mode;
wherein, the recording rule that the recording mode corresponds includes:
1) and when the recording mode is a far-field recording mode, the far-field voice is picked up through the first microphone and the second microphone.
2) When the recording mode is a near-field recording mode, picking up near-field voice data through a microphone picking up voice from the front and closing another microphone; for example, when the recording mode is the near-field recording mode, near-field voice data is picked up by a microphone that picks up voice from directly in front, such as the first microphone, and the second microphone is turned off.
103. And determining a voice processing mode matched with the recording rule, and performing sound effect processing on the voice data through the voice processing mode.
Wherein, with the speech processing mode of recording rule assorted includes:
1) the voice processing mode matched with the recording rule corresponding to the far-field recording mode is that far-field voice is picked up according to a picked-up voice angle calculated by a beam forming algorithm; for example, the voice processing method matched with the recording rule corresponding to the far-field recording mode is to calculate an angle, such as a 60-degree angle, at which the first microphone and the second microphone pick up far-field voice according to a beam forming algorithm, and pick up far-field voice.
2) And the voice processing mode matched with the recording rule corresponding to the near-field recording mode is to process the picked near-field voice in a voice noise reduction and voice enhancement mode.
For example, in a terminal device a provided with a first microphone and a second microphone, the terminal device a receives a relevant parameter of a recording mode selected by a user, determines that the recording mode is a far-field recording mode, then, according to a recording rule corresponding to the far-field recording mode, determines whether the first microphone and the second microphone are in an open state, and if the first microphone or the second microphone is not open, opens the first microphone or the second microphone; subsequently, the array formed by arranging the first microphone and the second microphone "back to back" along the axis direction may implement a Beam at a certain angle along the axis by using a Beam-Forming BF (Beam-Forming) algorithm, for example, 60 degrees, and the first microphone and the second microphone pick up a voice signal within an angle range of 60 degrees.
Through this embodiment, terminal equipment's recording in-process only picks up the speech signal in certain angle beam range to reach the purpose of restraining the sound outside the angle scope, provide important prerequisite guarantee for the recording in-process picks up the speech data of high sound effect quality.
For another example, in a terminal device a provided with a first microphone and a second microphone, the terminal device a receives relevant parameters of a recording mode selected by a user, determines that the recording mode is a near-field recording mode, then, according to a recording rule corresponding to the near-field recording mode, determines that a microphone picking up voice from the front side, such as the first microphone, picks up near-field voice data through the first microphone, and turns off the second microphone, and then, processes the picked-up near-field voice through voice noise reduction and voice enhancement.
Optionally, the recording method further includes: receiving a recording direction set by a user; wherein, when the recording mode is far field recording mode, the recording rule that the recording mode corresponds includes: and based on the recording direction set by the user, picking up far-field voice through a microphone matched with the recording direction and closing another microphone.
For example, in a terminal device a provided with a first microphone and a second microphone, a relevant parameter of a recording mode selected by a user is received by the terminal device a, the recording mode is determined to be a far-field recording mode, and a recording direction set by the user is received by the terminal device a as a backward recording, the terminal device a records the far-field voice backward by the second microphone, and then, the first microphone is turned off and the far-field voice is picked up by the second microphone.
Through the embodiment, the sound in the front/rear direction of the terminal equipment can be independently recorded through the user-defined recording direction, and the purpose of inhibiting the sound in the other direction is achieved, so that the voice can be further picked up in a targeted manner, and the recording experience of the user is improved.
Optionally, the recording method further includes: monitoring the rotation angle of the terminal equipment, and judging the current recording mode when the rotation angle of the terminal equipment is larger than a preset angle; and if the current recording mode is judged to be the far-field recording mode, switching the current far-field recording mode into the near-field recording mode.
For example, in the terminal device a provided with the first microphone and the second microphone, a gyroscope is further provided, the rotation direction of the terminal device a is monitored through the gyroscope, when the rotation angle of the terminal device a is 180 degrees and is a predetermined angle, for example, 170 degrees, the rotation angle is larger than the predetermined angle, then the current recording mode is judged, the current recording mode is judged to be a far-field recording mode, the current recording mode is switched from the far-field recording mode to a near-field recording mode, near-field voice is picked up according to a recording rule corresponding to the near-field recording mode, and the picked-up near-field voice is processed through voice noise reduction and voice enhancement.
Through this embodiment, realized the position change of self-adaptation recording equipment under the prerequisite of guaranteeing recording tone quality, solved under live broadcast environment, live the problem that reduces the flexibility that the user used because of fixed position, satisfied user's individualized recording demand.
Optionally, the recording method further includes: sending the picked voice data to a cloud server; and/or storing the picked-up voice data to a predetermined storage location of the terminal device.
For example, in the previous example, the picked near-field voice data is sent to the cloud server, so that the cloud server distributes the picked near-field voice data to each client terminal device, and at the same time, the picked near-field voice data is stored in a predetermined storage location of the terminal device a, such as a ". \\ \ data \ data \ com.
In a specific reference scenario, as shown in fig. 5, in a live broadcast device B provided with a first microphone, a second microphone and a gyroscope, the live broadcast device B picks up a voice signal and ambient noise through the first microphone and the second microphone, and performs sound amplification processing through the first microphone located in front to improve the gain and the anti-interference capability of the first microphone; meanwhile, the rotation angle of the live broadcast equipment B is monitored through a gyroscope; when receiving that a recording mode set by a user through a display interface of the live broadcast equipment B is a far-field recording mode and a pickup direction is backward recording, setting the recording mode of the live broadcast equipment B as the far-field recording mode and the pickup direction as backward recording, realizing backward recording by the live broadcast equipment B through a second microphone, setting the far-field voice data to be picked up through the second microphone, closing the first microphone, and Processing, denoising, analyzing and the like Digital signals of the picked-up far-field voice data through a Digital Signal Processor (DSP); and then selecting a voice processing mode according to the far-field recording mode and the user-defined pickup direction, calculating the angle of the microphone along the axis beam through a beam forming BF algorithm, if 60 degrees, picking up the voice signal within the 60-degree angle range through a second microphone, and then sending the picked voice signal data to a cloud server so as to distribute the picked far-field voice data in the live broadcast to each client terminal device through the cloud server.
Preferably, as shown in fig. 6, when the solution of the present invention is implemented on a live broadcasting device, the live broadcasting device B not only needs 1-2 cameras with higher imaging quality, two microphones arranged back-to-back, a gyroscope, meanwhile, in order to realize the storage and transmission of voice signals, an ADC (Analog-to-digital converter) chip with high precision and high sampling rate is required to convert Analog signals picked up by the microphone into digital signals of the system, in addition, a high-performance DSP is required to be equipped for voice signal processing, noise reduction and other functions, and the functions of data transmission and comprehensive analysis processing are realized through an AP (Audio processor) for data input central control, and the Digital signal of the AP is converted into an analog signal that can make the earphone sound through a DAC (Digital to analog converter). In conclusion, the method can be realized under the scenes of low cost and low energy consumption, and has strong feasibility; the user can break away from the equipment that the current live broadcast needs is bulky, can realize the long-range pickup of high definition under indoor outer complex environment.
The embodiment of the present invention provides a recording apparatus based on two microphones, which can implement the above-mentioned method embodiment, and for specific function implementation, please refer to the description in the method embodiment, which is not described herein again.
It should be understood that the specific order or hierarchy of steps in the processes disclosed is an example of exemplary approaches. Based upon design preferences, it is understood that the specific order or hierarchy of steps in the processes may be rearranged without departing from the scope of the present disclosure. The accompanying method claims present elements of the various steps in a sample order, and are not intended to be limited to the specific order or hierarchy presented.
In the foregoing detailed description, various features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments of the subject matter require more features than are expressly recited in each claim. Rather, as the following claims reflect, invention lies in less than all features of a single disclosed embodiment. Thus, the following claims are hereby expressly incorporated into the detailed description, with each claim standing on its own as a separate preferred embodiment of the invention.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. To those skilled in the art; various modifications to these embodiments will be readily apparent, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
What has been described above includes examples of one or more embodiments. It is, of course, not possible to describe every conceivable combination of components or methodologies for purposes of describing the aforementioned embodiments, but one of ordinary skill in the art may recognize that many further combinations and permutations of various embodiments are possible. Accordingly, the embodiments described herein are intended to embrace all such alterations, modifications and variations that fall within the scope of the appended claims. Furthermore, to the extent that the term "includes" is used in either the detailed description or the claims, such term is intended to be inclusive in a manner similar to the term "comprising" as "comprising" is interpreted when employed as a transitional word in a claim. Furthermore, any use of the term "or" in the specification of the claims is intended to mean a "non-exclusive or".
Those of skill in the art will further appreciate that the various illustrative logical blocks, units, and steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate the interchangeability of hardware and software, various illustrative components, elements, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design requirements of the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present embodiments.
The various illustrative logical blocks, or elements, described in connection with the embodiments disclosed herein may be implemented or performed with a general purpose processor, a digital signal processor, an Application Specific Integrated Circuit (ASIC), a field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital signal processor core, or any other similar configuration.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. For example, a storage medium may be coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC, which may be located in a user terminal. In the alternative, the processor and the storage medium may reside in different components in a user terminal.
In one or more exemplary designs, the functions described above in connection with the embodiments of the invention may be implemented in hardware, software, firmware, or any combination of the three. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media that facilitate transfer of a computer program from one place to another. Storage media may be any available media that can be accessed by a general purpose or special purpose computer. For example, such computer-readable media can include, but is not limited to, RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store program code in the form of instructions or data structures and which can be read by a general-purpose or special-purpose computer, or a general-purpose or special-purpose processor. Additionally, any connection is properly termed a computer-readable medium, and, thus, is included if the software is transmitted from a website, server, or other remote source via a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wirelessly, e.g., infrared, radio, and microwave. Such discs (disk) and disks (disc) include compact disks, laser disks, optical disks, DVDs, floppy disks and blu-ray disks where disks usually reproduce data magnetically, while disks usually reproduce data optically with lasers. Combinations of the above may also be included in the computer-readable medium.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (8)
1. A recording method based on double microphones is characterized in that the recording method is based on a terminal device provided with a first microphone and a second microphone, and comprises the following steps:
receiving a recording mode set by a user;
according to a recording rule corresponding to the recording mode, the first microphone and the second microphone are turned on or off, and voice data are picked up through the turned-on first microphone and/or the turned-on second microphone;
determining a voice processing mode matched with the recording rule, and performing sound effect processing on the voice data through the voice processing mode;
the recording mode comprises a far-field recording mode and a near-field recording mode;
wherein, the recording rule that the recording mode corresponds includes:
when the recording mode is a far-field recording mode, far-field voice is picked up through the first microphone and the second microphone;
when the recording mode is a near-field recording mode, picking up near-field voice data through a microphone picking up voice from the front and closing another microphone;
wherein, with the speech processing mode of recording rule assorted includes:
the voice processing mode matched with the recording rule corresponding to the far-field recording mode is that far-field voice is picked up according to a picked-up voice angle calculated by a beam forming algorithm;
and the voice processing mode matched with the recording rule corresponding to the near-field recording mode is to process the picked near-field voice in a voice noise reduction and voice enhancement mode.
2. The recording method according to claim 1, wherein the first microphone and the second microphone are respectively disposed on a front side and a back side of the terminal device, and bottoms of the first microphone and the second microphone are connected by a silicone sleeve.
3. The audio recording method according to claim 1 or 2, further comprising:
receiving a recording direction set by a user;
wherein, when the recording mode is far field recording mode, the recording rule that the recording mode corresponds includes:
and based on the recording direction set by the user, picking up far-field voice through a microphone matched with the recording direction and closing another microphone.
4. The audio recording method according to claim 1, further comprising:
monitoring the rotation angle of the terminal equipment, and judging the current recording mode when the rotation angle of the terminal equipment is larger than a preset angle;
and if the current recording mode is judged to be the far-field recording mode, switching the current far-field recording mode into the near-field recording mode.
5. The audio recording method according to claim 1, further comprising:
sending the picked voice data to a cloud server; and/or
And storing the picked voice data to a preset storage position of the terminal equipment.
6. A recording apparatus based on dual microphones, characterized in that, the recording apparatus is provided with first microphone and second microphone, includes:
the first receiving unit is used for receiving a recording mode set by a user;
the opening and closing unit is used for opening or closing the first microphone and the second microphone according to a recording rule corresponding to the recording mode and picking up voice data through the opened first microphone and/or the opened second microphone;
the determining and processing unit is used for determining a voice processing mode matched with the recording rule and performing sound effect processing on the voice data through the voice processing mode;
the recording mode comprises a far-field recording mode and a near-field recording mode;
wherein, the recording rule that the recording mode corresponds includes:
when the recording mode is a far-field recording mode, far-field voice is picked up through the first microphone and the second microphone;
when the recording mode is a near-field recording mode, picking up near-field voice data through a microphone picking up voice from the front and closing another microphone;
wherein, with the speech processing mode of recording rule assorted includes:
the voice processing mode matched with the recording rule corresponding to the far-field recording mode is that far-field voice is picked up according to a picked-up voice angle calculated by a beam forming algorithm;
and the voice processing mode matched with the recording rule corresponding to the near-field recording mode is to process the picked near-field voice in a voice noise reduction and voice enhancement mode.
7. The recording device according to claim 6, wherein the first microphone and the second microphone are respectively disposed on a front surface and a back surface of the terminal device, and bottoms of the first microphone and the second microphone are connected by a silicone sleeve.
8. The audio recording apparatus according to claim 6 or 7, further comprising:
the second receiving unit is used for receiving the recording direction set by the user;
wherein, when the recording mode is far field recording mode, the recording rule that the recording mode corresponds includes:
and based on the recording direction set by the user, picking up far-field voice through a microphone matched with the recording direction and closing another microphone.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710462027.6A CN107331402B (en) | 2017-06-19 | 2017-06-19 | Recording method and recording device based on double microphones |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710462027.6A CN107331402B (en) | 2017-06-19 | 2017-06-19 | Recording method and recording device based on double microphones |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107331402A CN107331402A (en) | 2017-11-07 |
| CN107331402B true CN107331402B (en) | 2020-06-23 |
Family
ID=60195335
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710462027.6A Expired - Fee Related CN107331402B (en) | 2017-06-19 | 2017-06-19 | Recording method and recording device based on double microphones |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107331402B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108111934A (en) * | 2017-12-21 | 2018-06-01 | 广东小天才科技有限公司 | Control method and device for microphone, microphone and storage medium |
| CN108364664B (en) * | 2018-02-01 | 2020-04-24 | 云知声智能科技股份有限公司 | Method for automatic data acquisition and marking |
| CN108401200A (en) * | 2018-04-09 | 2018-08-14 | 北京唱吧科技股份有限公司 | A kind of microphone apparatus |
| CN108900938A (en) * | 2018-09-04 | 2018-11-27 | 深圳市领芯者科技有限公司 | Microphone is broadcast live |
| CN109036411A (en) * | 2018-09-05 | 2018-12-18 | 深圳市友杰智新科技有限公司 | A kind of intelligent terminal interactive voice control method and device |
| CN109243452A (en) * | 2018-10-26 | 2019-01-18 | 北京雷石天地电子技术有限公司 | A kind of method and system for sound control |
| CN112071312B (en) * | 2019-06-10 | 2024-03-29 | 海信视像科技股份有限公司 | Voice control method and display device |
| CN110809216B (en) * | 2019-09-25 | 2021-03-02 | 云知声智能科技股份有限公司 | Pickup method and device of microphone array |
| CN110827819A (en) * | 2019-11-26 | 2020-02-21 | 珠海格力电器股份有限公司 | Household equipment control method and control system |
| CN113066482A (en) * | 2019-12-13 | 2021-07-02 | 阿里巴巴集团控股有限公司 | Voice model updating method, voice data processing method, voice model updating device, voice data processing device and storage medium |
| CN111757214A (en) * | 2020-05-26 | 2020-10-09 | 深圳市长丰影像器材有限公司 | Multi-scene recording method and device for microphone, electronic equipment and storage medium |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7206418B2 (en) * | 2001-02-12 | 2007-04-17 | Fortemedia, Inc. | Noise suppression for a wireless communication device |
| CN101076203A (en) * | 2007-06-15 | 2007-11-21 | 南京大学 | Audio-transmitter array for picking up signals of adjacent-field sound source |
| TWI389579B (en) * | 2009-04-27 | 2013-03-11 | Univ Nat Chiao Tung | Acoustic camera |
| US8903108B2 (en) * | 2011-12-06 | 2014-12-02 | Apple Inc. | Near-field null and beamforming |
| US20150063589A1 (en) * | 2013-08-28 | 2015-03-05 | Csr Technology Inc. | Method, apparatus, and manufacture of adaptive null beamforming for a two-microphone array |
| US9888317B2 (en) * | 2013-10-22 | 2018-02-06 | Nokia Technologies Oy | Audio capture with multiple microphones |
| CN104123950B (en) * | 2014-07-17 | 2015-11-25 | 努比亚技术有限公司 | A kind of way of recording and device |
| CN105959457B (en) * | 2016-06-28 | 2017-11-24 | 广东欧珀移动通信有限公司 | The way of recording and terminal based on dual microphone |
-
2017
- 2017-06-19 CN CN201710462027.6A patent/CN107331402B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN107331402A (en) | 2017-11-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107331402B (en) | Recording method and recording device based on double microphones | |
| US11979734B2 (en) | Method to determine loudspeaker change of placement | |
| US10129648B1 (en) | Hinged computing device for binaural recording | |
| US11315555B2 (en) | Terminal holder and far-field voice interaction system | |
| EP3373602A1 (en) | A method of localizing a sound source, a hearing device, and a hearing system | |
| CN105794231B (en) | Hands-free beam pattern configuration | |
| US9984675B2 (en) | Voice controlled audio recording system with adjustable beamforming | |
| CN102474697B (en) | Hearing aid, signal processing method and program | |
| EP3111670B1 (en) | Method of and apparatus for determining an equalization filter | |
| CN109804559A (en) | Gain control in spatial audio systems | |
| JP2018511212A5 (en) | ||
| KR20060107328A (en) | Imaging device, sound record device, and sound record method | |
| CN105679356B (en) | The way of recording, device and terminal | |
| US9179218B2 (en) | Mobile device for multi-channel sound collection and output using common connector, and driving method thereof | |
| CN106872945A (en) | Sound localization method, device and electronic equipment | |
| US20170230776A1 (en) | Optimizing the performance of an audio playback system with a linked audio/video feed | |
| US20230260525A1 (en) | Transform ambisonic coefficients using an adaptive network for preserving spatial direction | |
| US20170150266A1 (en) | Binaural recording system and earpiece set | |
| CN103905960B (en) | Enhancing stereo audio record in hand-held device | |
| CN108370486A (en) | Audio output device and method for controlling audio output device | |
| US20160057527A1 (en) | Binaural recording system and earpiece set | |
| GB2610459A (en) | Audio processing method, apparatus, electronic device and storage medium | |
| US20170094412A1 (en) | Wearable recording and playback system | |
| CN116156390B (en) | Audio processing method and electronic equipment | |
| US20200374387A1 (en) | Method of enhancing a hearing aid system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200623 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |