WO2017031972A1 - 指向性录音方法、装置及录音设备 - Google Patents

指向性录音方法、装置及录音设备 Download PDF

Info

Publication number
WO2017031972A1
WO2017031972A1 PCT/CN2016/075948 CN2016075948W WO2017031972A1 WO 2017031972 A1 WO2017031972 A1 WO 2017031972A1 CN 2016075948 W CN2016075948 W CN 2016075948W WO 2017031972 A1 WO2017031972 A1 WO 2017031972A1
Authority
WO
WIPO (PCT)
Prior art keywords
recording device
orientation
initial
target
picked
Prior art date
Application number
PCT/CN2016/075948
Other languages
English (en)
French (fr)
Inventor
仇存收
马骅
常青
韩博
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to US15/557,760 priority Critical patent/US20180156887A1/en
Priority to EP16838235.6A priority patent/EP3252775A4/en
Publication of WO2017031972A1 publication Critical patent/WO2017031972A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S3/00—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received
    • G01S3/80—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received using ultrasonic, sonic or infrasonic waves
    • G01S3/802—Systems for determining direction or deviation from predetermined direction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/326—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only for microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/18—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using ultrasonic, sonic, or infrasonic waves
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H04R2430/20—Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/15—Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops

Definitions

  • the present invention relates to the field of signal processing, and in particular, to a directional recording method, apparatus, and recording apparatus.
  • a recording device with directional recording function is usually provided with a microphone array composed of a plurality of microphones.
  • the recording device can pick up sound signals through each microphone in the microphone array and separately use a Beam Forming algorithm. Adjusting the phase and amplitude of the sound signal picked up by each microphone, so that the resulting sound signal can have a higher signal-to-noise ratio in a specific direction range, thereby maintaining the sound signal propagating in a specific direction range, and attenuating or shielding
  • the sound pickup effect of the sound signal transmitted from other directions realizes the directional recording function.
  • the recording device uses the directional recording function to record only the sound signal propagating in a specific direction range, and the direction in which the sound signal is retained is usually a tapered region, the tapered region is usually called an image.
  • a picked-up beam having a sound signal with a maximum signal to noise ratio is often referred to as the direction of the picked up beam.
  • the direction of the pickup beam is usually the same as the orientation of the recording device, wherein the orientation of the recording device can be the orientation of any part of the recording device.
  • the pointing of the head of the recording device When the user adjusts the posture of the recording device so that the orientation of the recording device is the target sound source, the recording device can record the sound of the target sound source through the directional recording function, and shield the sound generated by other noise sources, thereby Can achieve better recording results.
  • the target source is a speaker.
  • the user when the user uses the recording device to record in the venue, the user can first adjust the orientation of the recording device so that the recording device faces the speaker.
  • the recording device uses the directional recording function to record, a pickup beam indicating the speaker is generated, so that the recording device only retains the sound signal emitted by the speaker, and attenuates or shields the sound signal of other noise sources, thereby achieving better. Recording effect.
  • the recording device is easy to change direction due to collision with other objects, especially when a portable recording device such as a voice recorder or a mobile phone collides with other objects.
  • the orientation of the recording device changes, the orientation of the picked-up beam will also change, so that the picked-up beam no longer points to the target sound source.
  • the picked-up beam is no longer facing the target sound source, the sound signal propagating in the direction is picked up by the picked-up beam, and the sound signal propagating in the direction of the target sound source is attenuated or shielded, resulting in poor recording performance. .
  • the embodiment of the invention provides a directional recording method, a device and a recording device, so as to solve the problem that the existing directional recording method is likely to cause a deterioration of the recording effect when the orientation of the recording device changes.
  • an embodiment of the present invention provides a directional recording method, in which a recording device collects a voice of a target sound source through a microphone array of the recording device, where the method includes: generating an initial sound beam by a beamforming algorithm, where The initial sound beam is directed to the target sound source; the initial orientation of the initial sound beam is recorded; the orientation of the recording device is detected to change, and the initial sound wave is adjusted according to the orientation change of the recording device A beam is obtained to obtain the target picked-up beam, and the target picked-up beam is directed to the target sound source.
  • the method before the generating the initial sound beam by the beamforming algorithm, the method further includes: prompting the user to display the display interface of the recording device The head end of the recording device faces the target sound source.
  • the adjusting the initial sound beam to obtain the target sound beam comprises: determining the a direction of deflection of the recording device toward the deflection direction; controlling the initial pickup beam to deflect a specified adjustment angle to the specified adjustment direction to obtain a target pickup beam, wherein the specified adjustment direction is opposite to the direction of the deflection direction,
  • the specified adjustment angle is the same as the orientation deflection angle.
  • determining the orientation deflection angle and the direction of the deflection direction of the recording device includes: acquiring a direction sensor in the recording device The recording device generates an angular velocity reported when the orientation changes; and calculates the orientation deflection angle and the orientation deflection direction according to the angular velocity.
  • the initial tuning beam is controlled to be specified in the specified adjustment direction deflection An angle
  • obtaining a target sound beam includes: determining a deflected pointing of the initial sound beam according to an initial direction of the initial sound beam and the direction of the deflection angle and the direction of the deflection direction; Adjusting the specified adjustment angle toward the specified adjustment direction to obtain a target orientation; generating a target pointed to the target Labeled beam.
  • the detecting the change of the orientation of the recording device is specifically: It is detected that the orientation of the recording device changes, and the change value exceeds a preset range.
  • the embodiment of the present invention further provides a directional recording device, wherein a recording device collects a voice of a target sound source through a microphone array of the recording device, the device includes: a generating unit, which generates an initial pickup by using a beamforming algorithm a sound beam, wherein the initial sound beam is directed to the target sound source; a recording unit for recording an initial orientation of the initial sound beam; and an adjustment unit configured to detect a change in orientation of the sound recording device After the initial sounding beam is adjusted according to the orientation change of the recording device to obtain the target sound beam, the target sound beam is directed to the target sound source, and the recording device is changed in orientation, The initial picked-up beam beam is directionally adjusted to obtain a target picked-up beam beam, the target pick-up beam beam having the same orientation as the initial direction of the initial picked-up beam beam.
  • the device further includes: a reminding unit, configured to: in a display interface of the recording device, prompt the user to face the head end of the recording device The target sound source.
  • the adjusting unit includes: determining a subunit, configured to detect an orientation of the recording device After the change is made, the direction of the deflection of the recording device and the direction of the deflection are determined; the control subunit is configured to control the initial fixed beam pickup beam to deflect the specified adjustment angle to the specified adjustment direction to obtain the target pickup beam, wherein The specified adjustment direction is opposite to the direction of the deflection, and the specified adjustment angle is the same as the orientation deflection angle.
  • the determining subunit includes: an angular velocity acquiring subunit, configured to acquire a direction sensor in the recording device The angular velocity reported when the recording device is changed toward the change; the deflection angle calculation subunit is configured to calculate the orientation deflection angle and the orientation deflection direction according to the angular velocity.
  • the control subunit includes: a pointing sub-unit after the deflection, Determining a post-deflection pointing of the initial picked-up beam according to an initial orientation of the initial picked-up beam and the orientation deflection angle and the orientation deflection direction; a target pointing determination sub-unit for using the deflected Pointing towards the finger Adjusting the direction to adjust the specified adjustment angle to obtain a target pointing; the sound beam generating subunit is configured to generate a target sound beam directed to the target.
  • the detecting the change of the orientation of the recording device is specifically: It is detected that the orientation of the recording device changes, and the change value exceeds a preset range.
  • the embodiment of the present invention further provides a recording device, including: a processor, a memory, a microphone array, and a direction sensor; the recording device collects a voice of a target sound source through a microphone array of the recording device
  • the processor configured to generate an initial sound beam by a beamforming algorithm, wherein the initial sound beam is directed to the target sound source; and the memory is configured to record an initial orientation of the initial sound beam;
  • the processor is further configured to: after detecting a change in the orientation of the recording device, adjust the initial picked-up beam to obtain the target picked-up beam according to a change in orientation of the recording device, and the target picks up The tone beam points to the target sound source.
  • the processor is further configured to: in a display interface of the recording device, prompt a user to direct a head end of the recording device toward the target sound source.
  • the processor is further configured to determine an orientation deflection angle and a deflection direction of the recording device Controlling the initial picked-up beam to deflect a specified adjustment angle to a specified adjustment direction to obtain a target picked-up beam, wherein the specified adjustment direction is opposite to the direction of the deflection, the specified adjustment angle being the same as the orientation deflection angle .
  • the processor is further configured to acquire a direction change of a direction sensor in the recording device in the recording device The angular velocity reported at the time; the orientation deflection angle and the orientation deflection direction are calculated based on the angular velocity.
  • the processor is further configured to: according to the initial sound collection wave Determining the deflection of the initial picked-up beam after the initial orientation of the beam and the orientation deflection angle and the direction of the deflection direction; and adjusting the specified adjustment angle by pointing the deflection direction toward the specified adjustment direction to obtain a target Pointing; generating a target pickup beam directed to the target.
  • the detecting the change of the orientation of the recording device is specifically: Detection The orientation to the recording device changes and the change value exceeds a preset range.
  • an embodiment of the present invention further provides a computer readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by a recording device, cause the recording
  • the apparatus performs the method of any of the preceding first aspect or any one of the possible implementations of the first aspect.
  • an initial sound beam is generated by a beamforming algorithm, wherein the initial sound beam is directed to the target sound source; an initial orientation of the initial sound beam is recorded; and the recording device is detected
  • the orientation changes the initial picked-up beam is adjusted to obtain the target picked-up beam according to a change in orientation of the recording device, and the target picked-up beam is directed to the target sound source.
  • the directional recording method, device and recording device provided by the embodiments of the present invention can adjust the pointing of the picked-up beam according to the orientation change of the recording device, thereby ensuring that the picked-up beam always points to the target sound source. Avoid recording deterioration due to changes in the orientation of the recording device.
  • FIG. 1 is a schematic diagram showing the orientation of a head end of a recording device of the present invention and a recording device;
  • FIG. 2 is a flow chart of an embodiment of a directional recording method of the present invention.
  • FIG. 3 is a schematic diagram showing the relationship between the orientation of the recording device of the present invention and a target sound source;
  • FIG. 4 is a schematic diagram showing the relationship between a picked-up beam and a target sound source according to the present invention
  • Figure 5 is another schematic view showing the relationship between the orientation of the recording device of the present invention and the target sound source
  • FIG. 6 is another schematic diagram showing the relationship between a picked-up beam and a target sound source according to the present invention.
  • FIG. 7 is another schematic diagram showing the relationship between a picked-up beam and a target sound source according to the present invention.
  • FIG. 8 is another schematic diagram showing the relationship between a sound beam and a target sound source according to the present invention.
  • FIG. 9 is a schematic structural view of an embodiment of a directional recording apparatus according to the present invention.
  • FIG. 10 is a schematic structural view of an embodiment of a recording apparatus of the present invention.
  • the recording device may include a professional recording device such as a voice recorder or a tape recorder, and may also include a terminal having a recording function such as a mobile phone or a tablet computer.
  • the orientation of the recording device may refer to the orientation of the microphone or the microphone array in the recording device, or the head end orientation of the recording device, or the direction indicated by any axis of the recording device or the direction corresponding to any one of the recording devices.
  • an end provided with a earphone can be generally used as a head end of the recording device, and a direction corresponding to a microphone hole disposed at the head end is used as a recording device.
  • the head end is oriented, wherein the microphone may be a primary microphone or a noise reduction microphone.
  • the direction of the ray of the noise reduction microphone may be taken as the end point of the main microphone or the direction of the recording device; or the ray of the main microphone with the noise reduction microphone as the end point
  • the direction is the orientation of the recording device.
  • the pointing of the beam may refer to a sound pickup direction when the recording device picks up the sound through the sound beam, and may be identified by an angle with the x-axis, the y-axis, and the z-axis in the space coordinate system, such as a beam.
  • the pointer pointing to (a, b, c) identifies the beam at an angle a to the x-axis, an angle b to the y-axis, and an angle c to the z-axis.
  • the same pointing of the two beams means that the directions of the two picked-up beams are the same in the same spatial coordinate system as the x-axis, the y-axis and the z-axis.
  • the method includes the following steps:
  • Step 201 Generate an initial sound beam by a beamforming algorithm, wherein the initial sound beam is directed to the target sound source.
  • the recording device may first determine the location of the target sound source by the sound source positioning, and then determine the initial orientation of the initial sound beam according to the position of the recording device and the location of the target sound source. After the pointing determination, the recording device may process the voice collected by the wind array by using a beamforming algorithm to generate an initial sound beam, so that the initial sound beam is obtained. Point to the target sound source.
  • FIG. 3 is a schematic diagram showing the relationship between the orientation of the recording apparatus of the present invention and the target sound source
  • FIG. 4 is a schematic diagram showing the relationship between the picked-up beam and the target sound source of the present invention.
  • the orientation of the recording device is related to the target sound source as shown in FIG. 3, the recording device can generate a picked-up beam as shown in FIG. 4 after the initial pointing. That is, the orientation of the recording device is the same as the y-axis, and the initial orientation is at an angle a with the y-axis in the clockwise direction.
  • the recording device may also prompt the user to adjust the pointing of the recording device on the display interface of the recording device, and direct the head end of the recording device toward the target sound source.
  • the recording device can process the voice collected by the gust array by a beamforming algorithm with the head end orientation as a direction parameter, thereby generating an initial sound beam, thereby making the initial The pickup beam is directed to the target sound source.
  • FIG. 5 is another schematic diagram of the relationship between the orientation of the recording device of the present invention and the target sound source
  • FIG. 6 is another schematic diagram of the relationship between the picked-up beam and the target sound source of the present invention.
  • the recording device may also be adjusted to make the recording device face the target sound source, so that the orientation of the recording device is related to the target sound source as shown in FIG. .
  • the recording device can then generate an initial picked-up beam as shown in FIG. That is, the orientation of the recording device is the same as the initial orientation of the initial picked-up beam and at an angle a to the y-axis in the clockwise direction.
  • the speaker In a meeting or lecture, the speaker usually speaks or speaks at the speaker's location in the venue. Since the location of the speaker in the venue is a pre-set and fixed location, the speaker can be pre-arranged before the speaker starts speaking.
  • the orientation of the recording device is adjusted so that the recording device is oriented toward a predetermined position. After the recording device is oriented to the predetermined position, the recording device can directly generate the initial picked-up beam using the beamforming algorithm with the orientation of the recording device as a direction parameter, thereby avoiding determining the initial pointing of the initial picked-up beam by the sound source positioning. The delay.
  • Step 202 Record an initial orientation of the initial picked-up beam.
  • the recording device After the initial picked-up beam is formed, the recording device records the initial orientation of the initial picked-up beam. Depending on how the initial picked-up beam is generated, the initial pointing may be the same as the orientation when the recording device generates the initial picked-up beam, or may be at a fixed angular difference a from the orientation at which the recording device generates the initial picked-up beam.
  • the initial orientation of the initial picked-up beam is the same as the orientation of the recording device when generating the initial picked-up beam.
  • Step 203 detecting that the orientation of the recording device changes, according to the orientation of the recording device. Varying, adjusting the initial picked-up beam to obtain the target picked-up beam, the target picked-up beam pointing to the target sound source.
  • the recording device can detect whether the orientation of itself changes, and after detecting that the orientation of the self changes, the initial pickup beam is directionally adjusted to obtain a target sound beam, so that the target sound beam is directed to the target sound source. .
  • the orientation of the recording device is changed and can be determined by the information reported by the direction sensor.
  • the direction sensor may include a south needle, a compass, a gyroscope, and the like.
  • the recording device may adjust the initial sound wave after detecting that the orientation of the recording device changes and the change value exceeds a preset range. Beam to obtain the target picked-up beam.
  • the recording device may determine the orientation deflection angle of the recording device and the direction of the deflection direction; then control the initial pickup beam to deflect the specified adjustment angle to the specified adjustment direction to obtain the target pickup wave.
  • a bundle wherein the specified adjustment direction is opposite to the orientation deflection direction, and the specified adjustment angle is the same as the orientation deflection angle.
  • the recording device may directly acquire the direction of the deflection direction and the direction of the deflection reported by the direction sensor; or the recording device may also acquire the direction change of the direction sensor in the recording device.
  • the angular velocity reported at the time is then calculated based on the angular velocity to calculate the direction of deflection of the recording device and the direction of deflection.
  • the recording device may firstly deflect the angle according to the orientation of the recording device due to a specific angular difference between the initial picked-up beam and the orientation of the recording device. Deviating direction, determining a deflection angle and a deflection direction of the initial sound beam, and a pointing direction of the initial sound beam; and then adjusting the specified angle of adjustment to the specified adjustment direction to obtain a target orientation; Regenerating a target pickup beam directed to the target.
  • the recording device can simultaneously maintain a plurality of picked-up beams, the recording device can simultaneously maintain the initial picked-up beam and the target picked-up beam; the recording device can also release the initial picked-up beam while retaining only the target picked-up beam.
  • the specified adjustment direction generally includes a clockwise direction or a counterclockwise direction.
  • Figure 7 is another schematic diagram of the relationship between the picked-up beam and the target sound source of the present invention.
  • the orientation before the orientation of the recording device changes is as shown in FIG. 6, and the orientation toward the change is as shown in FIG. Since the initial pointing of the initial sound beam as shown in FIG. 6 is the same as the orientation of the recording device and both are at an angle ⁇ with the y-axis in the clockwise direction, as shown in FIG. 7, the direction of the recording device is deflected clockwise. After ⁇ , the initial pickup beam is also deflected by ⁇ in a clockwise direction, and the angle between the post-deflection direction of the initial picked-up beam and the y-axis in the clockwise direction is ⁇ + ⁇ .
  • FIG. 8 is another schematic diagram showing the relationship between the picked-up beam and the target sound source according to the present invention. Since the target is directed to the counter-clockwise adjustment ⁇ after the deflection of the initial picked-up beam, the target pointing is also in the clockwise direction at the angle ⁇ as in the y-axis direction. Therefore, the generated target pickup beam can be as shown in FIG. Since the pointing of the target picked-up beam is at an angle ⁇ to the y-axis in the clockwise direction, the target picked-up beam is identical to the initial orientation of the initial picked-up beam, so that the target picked-up beam can be directed to the target sound source.
  • the picked-up beam is generally conical, and for convenience of description, FIGS. 3 to 8 illustrate the present invention in a plan view.
  • the orientation change of the recording device in the three-dimensional space can be converted into a change in orientation in one or several two-dimensional planes by coordinate system conversion. Therefore, the manner in which the recording device generates the target pickup beam after the change in the three-dimensional space is similar to the manner in which the recording device generates the target pickup beam after the orientation change in the two-dimensional space, and details are not described herein again.
  • an initial picked-up beam is generated by a beamforming algorithm, wherein the initial picked-up beam is directed to the target sound source; an initial orientation of the initial picked-up beam is recorded; and an orientation of the recording device is detected A change occurs, the initial picked-up beam is adjusted to obtain the target picked-up beam according to a change in orientation of the recording device, and the target picked-up beam is directed to the target sound source.
  • the pointing of the picked-up beam can be adjusted according to the change of the orientation of the recording device, thereby ensuring that the picked-up beam always points to the target sound source, and the recording effect is prevented from being deteriorated due to the change of the recording device orientation.
  • the present invention also provides a directional recording apparatus and a recording apparatus.
  • FIG. 9 a schematic structural diagram of an embodiment of a directional recording apparatus of the present invention is shown.
  • the device can be placed on a recording device.
  • the apparatus may include a generating unit 901, a recording unit 902, and an adjusting unit 903.
  • the generating unit 901 is configured to generate an initial sound beam by a beamforming algorithm, wherein the initial sound beam is directed to the target sound source; and the recording unit 902 is configured to record an initial direction of the initial sound beam;
  • the adjusting unit 903 is configured to: after detecting that the orientation of the recording device changes, detecting that the orientation of the recording device changes, adjusting the initial collected beam according to a change in orientation of the recording device to obtain the A target sound beam that is directed to the target sound source.
  • the device further includes: a reminding unit, configured to remind the user to face the head end of the recording device toward the target sound source on the display interface of the recording device.
  • a reminding unit configured to remind the user to face the head end of the recording device toward the target sound source on the display interface of the recording device.
  • the adjusting unit 903 includes: a determining subunit, configured to determine an orientation deflection angle and a direction of the deflection direction of the recording device after detecting that the orientation of the recording device changes; the control subunit is configured to: Controlling the initial fixed beam pick-up beam to deflect a specified adjustment angle to a specified adjustment direction to obtain a target picked-up beam, wherein the specified adjustment direction is opposite to the direction of the deflected direction, the specified adjustment angle and the orientation deflection angle the same.
  • the determining subunit includes: an angular velocity acquiring subunit, configured to acquire an angular velocity reported by a direction sensor in the recording device when the recording device changes direction; a deflection angle calculation subunit, configured to The angular velocity is calculated as the orientation deflection angle and the orientation deflection direction.
  • control subunit includes: a deflected pointing determination subunit, configured to determine the initial sound beam according to an initial orientation of the initial sound beam and the orientation deflection angle and the orientation deflection direction Pointing after the deflection; the target pointing determining subunit, configured to adjust the specified adjustment angle to the specified adjustment direction to obtain the target pointing direction; and the sound beam generating subunit for generating the pointing The target pickup beam to which the target points.
  • a deflected pointing determination subunit configured to determine the initial sound beam according to an initial orientation of the initial sound beam and the orientation deflection angle and the orientation deflection direction Pointing after the deflection
  • the target pointing determining subunit configured to adjust the specified adjustment angle to the specified adjustment direction to obtain the target pointing direction
  • the sound beam generating subunit for generating the pointing The target pickup beam to which the target points.
  • the pointing of the picked-up beam can be adjusted according to the change of the orientation of the recording device, thereby ensuring that the picked-up beam always points to the target sound source, and the recording effect is prevented from being deteriorated due to the change of the recording device orientation.
  • FIG. 10 is a schematic structural diagram of an embodiment of a recording apparatus according to the present invention.
  • the recording device may include a processor 1001, a memory 1002, a microphone array 1003, and a direction sensor 1004. These components communicate over one or more buses. It will be understood by those skilled in the art that the structure of the terminal shown in the figure does not constitute a limitation of the present invention. It may be a bus-shaped structure or a star-shaped structure, and may include more or less than the illustration. Parts, or combinations of parts, or different parts.
  • the processor 1001 is a control center of the terminal, and connects various parts of the entire terminal by using various interfaces and lines, by running or executing software programs and/or modules stored in the memory 1002, and calling data stored in the memory 1002. To perform various functions of the terminal and/or process data.
  • the processor 1001 may be composed of an integrated circuit (IC), for example, may be composed of a single packaged IC, or may be composed of a plurality of packaged ICs that have the same function or different functions.
  • the processor 1001 may include only a central processing unit (CPU), or may be a GPU, a digital signal processor (DSP), and a control chip (for example, a baseband) in a communication unit. A combination of chips).
  • the CPU may be a single operation core, and may also include multiple operation cores.
  • the memory 1002 can be used to store software programs and modules, and the processor 1001 executes various functional applications of the terminals and implements data processing by running software programs and modules stored in the memory 1002.
  • the memory 1002 mainly includes a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function, such as a sound playing program, an image playing program, and the like; and the data storage area can be stored according to the terminal. Use the created data (such as audio data, phone book, etc.).
  • the memory 1002 may include a volatile memory, such as a nonvolatile volatile random access memory (NVRAM) or a phase change random access memory (PRAM).
  • NVRAM nonvolatile volatile random access memory
  • PRAM phase change random access memory
  • MRAM magnetoresistive random access memory
  • non-volatile memory such as at least one disk storage device, electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory) , referred to as EEPROM), flash memory devices, such as NOR flash memory or NAND flash memory.
  • the nonvolatile memory stores an operating system and applications executed by the processor 1001.
  • the processor 1001 loads running programs and data from the non-volatile memory into memory and stores the digital content in a plurality of storage devices.
  • the operating system includes various components and/or drivers for controlling and managing conventional system tasks such as memory management, storage device control, power management, and the like, as well as facilitating communication between various hardware and software.
  • the operating system may be an Android system of Google Inc., an iOS system developed by Apple Corporation, a Windows operating system developed by Microsoft Corporation, or an embedded operating system such as Vxworks.
  • a microphone array 1003 (also referred to as a microphone) is used to convert the sound signal into an electrical signal and to transmit the electrical signal to the processor 1001.
  • the direction sensor 1004 is configured to detect a change in the position and posture of the recording device, and provide the detected information to the processor 1001.
  • the recording device may further include a communication unit, configured to establish a communication channel, to enable the terminal to connect to the remote server through the communication channel, and to enable the remote server to send data or media from the remote server.
  • the communication unit may include a wireless local area network (Wireless Local Area Network) module, a Bluetooth module, a baseband module, and the like, and a radio frequency (RF) circuit corresponding to the communication module.
  • RF radio frequency
  • W-CDMA Wideband Code Division Multiple Access
  • HSDPA High Speed Downlink Packet Access
  • the communication module is used to control communication of components in the terminal, and can support Direct Memory Access.
  • the processor 1001 may be configured to generate an initial sound beam by a beamforming algorithm, wherein the initial sound beam is directed to the target sound source; and the memory 1002 may be used for recording The initial direction of the initial sound beam; the processor 1001 is further configured to: after detecting a change in the orientation of the recording device, adjust the initial sound beam according to a change in orientation of the recording device to obtain The target sound beam, the target sound beam is directed to the target sound source.
  • the detecting that the orientation of the recording device changes may be: detecting that the orientation of the recording device changes, and the change value exceeds a preset range.
  • the processor 1001 is further configured to: in a display interface of the recording device, remind the user to face the head end of the recording device toward the target sound source.
  • the processor 1001 is further configured to determine a direction of deflection of the recording device and a direction of deflection; and control the initial pickup beam to deflect a specified adjustment angle to a specified adjustment direction to obtain a target sound beam, where And the specified adjustment direction is opposite to the direction of the deflection direction, and the specified adjustment angle is the same as the orientation deflection angle.
  • the processor 1001 is further configured to acquire an angular velocity reported by a direction sensor in the recording device when the recording device changes direction; and calculate the orientation deflection angle and the orientation according to the angular velocity. Deflection direction.
  • the processor 1001 is further configured to determine, after the initial orientation of the initial sound beam and the direction of the deflection angle and the direction of the deflection direction, the deflection of the initial sound beam; Adjusting the specified adjustment angle by the deflected pointing toward the specified adjustment direction to obtain a target pointing; and generating a target picked-up beam directed to the target.
  • the present invention further provides a computer readable storage medium, wherein the computer readable storage medium may store one or more programs, and the program may include the implementation of the directional recording method provided by the present invention. Some or all of the steps in the example.
  • the one or more programs include instructions that, when executed by the recording device, can perform the directional recording method in the foregoing embodiments.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).
  • the techniques in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on such understanding, the technical solution in the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product, which may be stored in a storage medium such as a ROM/RAM. , disk, CD, etc., including a number of instructions to make a meter
  • a computer device (which may be a personal computer, server, or network device, etc.) performs the methods described in various embodiments of the present invention or in certain portions of the embodiments.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Health & Medical Sciences (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

一种指向性录音方法、装置及录音设备。所述录音设备通过所述录音设备的麦克风阵列采集目标声源的语音，所述方法包括：通过波束形成算法产生初始拾音波束，其中，所述初始拾音波束指向所述目标声源（201）；记录所述初始拾音波束的初始指向（202）；检测到所述录音设备的朝向发生变化，根据所述录音设备的朝向变化，调整所述初始拾音波束以得到所述目标拾音波束，所述目标拾音波束指向所述目标声源（203）。所述指向性录音方法、装置及录音设备，可以根据录音设备的朝向变化，调整拾音波束的指向，从而保证拾音波束始终指向目标声源，避免因为录音设备朝向变化而导致录音效果变差。

Description

指向性录音方法、装置及录音设备
本申请要求于2015年08月26日提交中国专利局，申请号为201510530941.0、发明名称为“指向性录音方法、装置及录音设备”的中国专利申请，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及信号处理领域，尤其涉及指向性录音方法、装置及录音设备。
背景技术
为满足噪音环境下的录音需求，具有指向性录音功能的录音设备应用范围越来越广泛。具有指向性录音功能的录音设备上通常设置有由多个麦克风组成的麦克风阵列，录音设备在进行录音时，可以通过麦克风阵列中的各个麦克风拾取声音信号，并通过波束形成(Beam Forming)算法单独调节每个麦克风所拾取声音信号的相位与波幅，使得最终形成的声音信号可以在特定方向范围内具有较高的信噪比，从而达到保留特定方向范围内传播来的声音信号，并衰减或屏蔽其他方向传播来的声音信号的拾音效果，实现指向性录音功能。由于录音设备在使用指向性录音功能录音时，仅保留特定方向范围内传播来的声音信号，而声音信号被保留的方向范围通常为一个锥形区域，因此该锥形区域通常被形象的称为拾音波束，具有声音信号具有最大信噪比方向通常被称为该拾音波束的指向。
为便于用户使用，现有技术中的录音设备在采用指向性录音功能录音时，拾音波束的指向通常与录音设备的朝向相同，其中，录音设备的朝向可以是录音设备任意一个部件的指向，例如录音设备的头端的指向。当用户通过调成录音设备的姿态，使得录音设备的朝向为目标声源后，录音设备就可以通过指向性录音功能录制目标声源发出的声音，并屏蔽其他噪声源所的发出的声音，从而可以达到较好的录音效果。例如，在会议或讲座等会场内使用录音设备录制发言人的声音时，目标声源即为发言人。因此用户在使用录音设备在会场内进行录音时，可以首先调整录音设备的朝向，使录音设备朝向发言人。当录音设备采用指向性录音功能进行录音时，会生成指示发言人的拾音波束，使得录音设备仅保留发言人所发出的声音信号，并衰减或屏蔽其他噪声源的声音信号，从而达到较好的录音效果。
但是在实际使用中，录音设备很容易因为与其他物体发生碰撞等原因而发生朝向变化，尤其是录音笔、手机等便携式录音设备在与其他物体发生碰撞后，朝向会发 生较大的变化。一旦录音设备的朝向发生变化，拾音波束的指向也会随之发生变化，使得拾音波束不再指向目标声源。当拾音波束不再朝向目标声源时，其方向传播来的声音信号就会被拾音波束所拾取，而目标声源方向传播来的声音信号则会被衰减或屏蔽，导致录音效果变差。
发明内容
本发明实施例提供了指向性录音方法、装置及录音设备，以解决现有指向性录音方法在录音设备朝向发生变化时，容易导致录音效果变差的问题。
第一方面，本发明实施例提供了一种指向性录音方法，录音设备通过所述录音设备的麦克风阵列采集目标声源的语音，该方法包括：通过波束形成算法产生初始拾音波束，其中，所述初始拾音波束指向所述目标声源；记录所述初始拾音波束的初始指向；检测到所述录音设备的朝向发生变化，根据所述录音设备的朝向变化，调整所述初始拾音波束以得到所述目标拾音波束，所述目标拾音波束指向所述目标声源。
结合第一方面，在第一方面第一种可能的实现方式中，在所述通过波束形成算法产生初始拾音波束之前，所述方法还包括：在所述录音设备的显示界面，提醒用户将所述录音设备的头端朝向所述目标声源。
结合第一方面或第一方面第一种可能的实现方式，在第一方面第二种可能的实现方式中，调整所述初始拾音波束以得到所述目标拾音波束，包括：确定所述录音设备的朝向偏转角度与朝向偏转方向；控制所述初始拾音波束向指定调整方向偏转指定调整角度，得到目标拾音波束，其中，所述指定调整方向与所述朝向偏转方向相反，所述指定调整角度与所述朝向偏转角度相同。
结合第一方面第二种可能的实现方式，在第一方面第三种可能的实现方式中，确定所述录音设备的朝向偏转角度与朝向偏转方向包括：获取所述录音设备中的方向传感器在所述录音设备发生朝向变化时上报的角速度；根据所述角速度计算出所述朝向偏转角度与所述朝向偏转方向。
结合第一方面第二种可能的实现方式或第一方面第三种可能的实现方式，在第一方面第四种可能的实现方式中，控制所述初始拾音波束向指定调整方向偏转指定调整角度，得到目标拾音波束包括：根据所述初始拾音波束的初始指向及所述朝向偏转角度与所述朝向偏转方向，确定所述初始拾音波束的偏转后指向；将所述偏转后指向朝所述指定调整方向调整所述指定调整角度，得到目标指向；生成指向为所述目标指向的目 标拾音波束。
结合第一方面或第一方面第一至四种可能的实现方式其中任意一种，在第一方面第五种可能的实现方式中，所述检测到所述录音设备的朝向发生变化具体为：检测到所述录音设备的朝向发生变化，且变化值超过预设范围。
第二方面，本发明实施例还提供了一种指向性录音装置，录音设备通过所述录音设备的麦克风阵列采集目标声源的语音，所述装置包括：生成单元，通过波束形成算法产生初始拾音波束，其中，所述初始拾音波束指向所述目标声源；记录单元，用于记录所述初始拾音波束的初始指向；调整单元，用于在检测到所述录音设备的朝向发生变化后，根据所述录音设备的朝向变化，调整所述初始拾音波束以得到所述目标拾音波束，所述目标拾音波束指向所述目标声源所述录音设备发生朝向变化后，对所述初始拾音波束波束进行指向调整得到目标拾音波束波束，所述目标拾音波束波束的指向与所述初始拾音波束波束的初始指向相同。
结合第二方面，在第二方面第一种可能的实现方式中，所述装置还包括：提醒单元，用于在所述录音设备的显示界面，提醒用户将所述录音设备的头端朝向所述目标声源。
结合第二方面或第二方面第一种可能的实现方式，在第二方面第二种可能的实现方式中，所述调整单元包括：确定子单元，用于在检测到所述录音设备的朝向发生变化后，确定所述录音设备的朝向偏转角度与朝向偏转方向；控制子单元，用于控制所述初始固定波束拾音波束向指定调整方向偏转指定调整角度，得到目标拾音波束，其中，所述指定调整方向与所述朝向偏转方向相反，所述指定调整角度与所述朝向偏转角度相同。
结合第二方面第二种可能的实现方式，在第二方面第三种可能的实现方式中，所述确定子单元包括：角速度获取子单元，用于获取所述录音设备中的方向传感器在所述录音设备发生朝向变化时上报的角速度；偏转角度计算子单元，用于根据所述角速度计算出所述朝向偏转角度与所述朝向偏转方向。
结合第二方面第二种可能的实现方式或第二方面第三种可能的实现方式，在第二方面第四种可能的实现方式中，所述控制子单元包括：偏转后指向确定子单元，用于根据所述初始拾音波束的初始指向及所述朝向偏转角度与所述朝向偏转方向，确定所述初始拾音波束的偏转后指向；目标指向确定子单元，用于将所述偏转后指向朝所述指 定调整方向调整所述指定调整角度，得到目标指向；拾音波束生成子单元，用于生成指向为所述目标指向的目标拾音波束。
结合第二方面或第二方面第一至四种可能的实现方式其中任意一种，在第二方面第五种可能的实现方式中，所述检测到所述录音设备的朝向发生变化具体为：检测到所述录音设备的朝向发生变化，且变化值超过预设范围。
第三方面，本发明实施例还提供了一种录音设备，所述录音设备包括：包括处理器、存储器、麦克风阵列及方向传感器；录音设备通过所述录音设备的麦克风阵列采集目标声源的语音；所述处理器，用于通过波束形成算法产生初始拾音波束，其中，所述初始拾音波束指向所述目标声源；所述存储器，用于记录所述初始拾音波束的初始指向；所述处理器，还用于在检测到所述录音设备的朝向发生变化后，根据所述录音设备的朝向变化，调整所述初始拾音波束以得到所述目标拾音波束，所述目标拾音波束指向所述目标声源。
结合第三方面，在第三方面第一种可能的实现方式中，所述处理器，还用于在所述录音设备的显示界面，提醒用户将所述录音设备的头端朝向所述目标声源。
结合第三方面或第三方面第一种可能的实现方式，在第三方面第二种可能的实现方式中，所述处理器，还用于确定所述录音设备的朝向偏转角度与朝向偏转方向；控制所述初始拾音波束向指定调整方向偏转指定调整角度，得到目标拾音波束，其中，所述指定调整方向与所述朝向偏转方向相反，所述指定调整角度与所述朝向偏转角度相同。
结合第三方面第二种可能的实现方式，在第三方面第三种可能的实现方式中，所述处理器，还用于获取所述录音设备中的方向传感器在所述录音设备发生朝向变化时上报的角速度；根据所述角速度计算出所述朝向偏转角度与所述朝向偏转方向。
结合第三方面第二种可能的实现方式或第三方面第三种可能的实现方式，在第三方面第四种可能的实现方式中，所述处理器，还用于根据所述初始拾音波束的初始指向及所述朝向偏转角度与所述朝向偏转方向，确定所述初始拾音波束的偏转后指向；将所述偏转后指向朝所述指定调整方向调整所述指定调整角度，得到目标指向；生成指向为所述目标指向的目标拾音波束。
结合第三方面或第三方面第一至四种可能的实现方式其中任意一种，在第三方面第五种可能的实现方式中，所述检测到所述录音设备的朝向发生变化具体为：检测 到所述录音设备的朝向发生变化，且变化值超过预设范围。
第四方面，本发明实施例还提供了一种存储一个或多个程序的计算机可读存储介质，所述一个或多个程序包括指令，所述指令当被录音设备执行时，使所述录音设备执行前述第一方面或第一方面任意一种可能的实现方式中所述方法。
在本发明实施例中，通过波束形成算法产生初始拾音波束，其中，所述初始拾音波束指向所述目标声源；记录所述初始拾音波束的初始指向；检测到所述录音设备的朝向发生变化，根据所述录音设备的朝向变化，调整所述初始拾音波束以得到所述目标拾音波束，所述目标拾音波束指向所述目标声源。与现有技术相比，本发明实施例所提供的指向性录音方法、装置及录音设备，可以根据录音设备的朝向变化，调整拾音波束的指向，从而保证拾音波束始终指向目标声源，避免因为录音设备朝向变化而导致录音效果变差。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，对于本领域普通技术人员而言，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为本发明录音设备的头端及录音设备的朝向示意图；
图2为本发明指向性录音方法一个实施例的流程图；
图3为本发明录音设备的朝向与目标声源之间关系的一个示意图；
图4为本发明拾音波束与目标声源之间关系的一个示意图；
图5为本发明录音设备的朝向与目标声源之间关系的另一个示意图；
图6为本发明拾音波束与目标声源关系的另一个示意图；
图7为本发明拾音波束与目标声源关系的另一个示意图；
图8为本发明拾音波束与目标声源关系的另一个示意图；
图9为本发明指向性录音装置一个实施例的结构示意图；
图10为本发明录音设备一个实施例的结构示意图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整的描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
在本发明实施例中，录音设备可以包括录音笔、录音机等专业录音设备，也可以包括手机、平板电脑等具有录音功能的终端。录音设备的朝向可以是指录音设备中麦克风的或麦克风阵列的指向，也可以是录音设备的头端朝向，或者也可以是录音设备任意一个轴线所指方向或录音设备任意一个面所对应方向。例如，如图1所示，在所述录音设备为手机时，通常可以以设置有耳机听筒的一端作为所述录音设备的头端，并以设置在头端的麦克风孔所对应的方向作为录音设备的头端朝向，其中，所述麦克风可以是主麦克风也可以是降噪麦克风。在录音设备为同时具有主麦克风和降噪麦克风时，也可以以主麦克风为端点并且经过降噪麦克风的射线的方向作为录音设备的朝向；或者，以降噪麦克风为端点并且经过主麦克风的射线的方向作为录音设备的朝向。
在本发明实施例中，波束的指向可以是指录音设备通过拾音波束进行拾音时的拾音方向，可以通过与空间坐标系中x轴、y轴及z轴夹角标识，例如波束的指向为(a，b，c)标识波束的指向与x轴成夹角a、与y轴成夹角b，与z轴成夹角c。两个波束的指向相同是指两个拾音波束的指向在同一个空间坐标系中与x轴、y轴及z轴的夹角都相同。
参见图2，为本发明指向性录音方法一个实施例的流程图。在使用本发明实施例对录音设备进行控制时，音设备通过所述录音设备的麦克风阵列采集目标声源的语音。如图2所示，该方法包括如下步骤：
步骤201，通过波束形成算法产生初始拾音波束，其中，所述初始拾音波束指向所述目标声源。
可选的，录音设备可以首先通过声源定位确定目标声源的所在位置，然后根据录音设备的位置及目标声源的所在位置确定初始拾音波束的初始指向。在所述指向确定之后，录音设备可以以所述初始指向为方向参数，通过波束形成算法对所述克风阵列采集到的语音进行处理，产生初始拾音波束，从而使得所述初始拾音波束指向所述目标声源。
例如，图3为本发明录音设备的朝向与目标声源之间关系的一个示意图，图4为本发明拾音波束与目标声源之间关系的一个示意图。在录音设备的朝向与目标声源为关系如图3所示时，录音设备在所述初始指向后可以生成如图4所示的拾音波束。即，录音设备的朝向与y轴相同，而所述初始指向与y轴在顺时针方向上成夹角α。
可选的，录音设备也可以在启动指向性录音功能前，在所述录音设备的显示界面，提醒用户调整所述录音设备的指向，将所述录音设备的头端朝向所述目标声源。在头端朝向所述目标声源之后，录音设备可以以头端朝向作为方向参数，通过波束形成算法对所述克风阵列采集到的语音进行处理，产生初始拾音波束，从而使得所述初始拾音波束指向所述目标声源。
例如，图5为本发明录音设备的朝向与目标声源之间关系的另一个示意图，图6为本发明拾音波束与目标声源关系的另一个示意图。在录音设备的朝向与目标声源为关系如图3所示时，也可以先调整录音设备，使录音设备朝向目标声源，从而使录音设备的朝向与目标声源为关系如图5所示。然后录音设备可以生成如图6所示的初始拾音波束。即，录音设备的朝向与初始拾音波束的初始指向相同，且与y轴在顺时针方向上成夹角α。
在会议或讲座中，发言人通常在会场内发言人位置进行发言或演讲，由于会场内的发言人所在位置是预先设定并且固定不变的预定位置，因此在发言人开始发言之前，可以预先对录音设备的朝向进行调整，从而使录音设备朝向预定位置。在录音设备朝向目预定位置后，录音设备可以直接以所述录音设备的朝向为方向参数，使用波束形成算法生成初始拾音波束，从而避免通过声源定位确定初始拾音波束的初始指向所带来的延迟。
步骤202，记录所述初始拾音波束的初始指向。
在初始拾音波束形成后，录音设备记录所述初始拾音波束的初始指向。根据初始拾音波束的生成方式不同，所述初始指向可以与录音设备生成初始拾音波束时的朝向相同，或者也可以与录音设备生成初始拾音波束时的朝向成固定的角度差α。
例如，在图4所示的情况中，所述初始拾音波束的初始指向与录音设备的在生成初始拾音波束时的朝向间存在角度差α；而在如图6所示的情况中，所述初始拾音波束的初始指向与录音设备的在生成初始拾音波束时的朝向相同。
步骤203，检测到所述录音设备的朝向发生变化，根据所述录音设备的朝向 变化，调整所述初始拾音波束以得到所述目标拾音波束，所述目标拾音波束指向所述目标声源。
录音设备可以检测自身的朝向是否发生变化，并在检测到自身的朝向发生变化后，对所述初始拾音波束进行指向调整得到目标拾音波束，从而使得目标拾音波束指向所述目标声源。其中，录音设备的朝向是发生变化，可以通过方向传感器上报的信息确定。其中，其中所述方向传感器可以包括南针、罗盘和陀螺仪等。为避免录音设备因发生微小的朝向变化而调整所述初始拾音波束，录音设备可以在检测到所述录音设备的朝向发生变化，且变化值超过预设范围后，才调整所述初始拾音波束以得到所述目标拾音波束。
在检测到所述录音设备发生朝向变化后，录音设备可以确定所述录音设备的朝向偏转角度与朝向偏转方向；然后控制所述初始拾音波束向指定调整方向偏转指定调整角度，得到目标拾音波束，其中，所述指定调整方向与所述朝向偏转方向相反，所述指定调整角度与所述朝向偏转角度相同。
在确定所述录音设备的朝向偏转角度与朝向偏转方向时，录音设备可以直接获取方向传感器上报的朝向偏转角度与朝向偏转方向；或者，录音设备也可以获取方向传感器在所述录音设备发生朝向变化时上报的角速度，然后根据该角速度进行计算，从而计算出所述录音设备的朝向偏转角度与朝向偏转方向。
在控制所述初始拾音波束向指定调整方向偏转指定调整角度时，由于初始拾音波束与录音设备的朝向之间成特定角度差，因此录音设备可以首先根据所述录音设备的朝向偏转角度与朝向偏转方向，确定所述初始拾音波束的偏转角度及偏转方向，以及初始拾音波束的偏转后指向；然后将所述偏转后指向朝指定调整方向调整所述指定调整角度，得到目标指向；再生成指向为所述目标指向的目标拾音波束。当录音设备能同时维持多个拾音波束时，录音设备可以同时保持初始拾音波束和目标拾音波束；录音设备还可以释放所述初始拾音波束，而仅保留所述目标拾音波束。在此需要说明的是，所述指定调整方向通常包括顺时针方向或逆时针方向。
例如，图7为本发明拾音波束与目标声源关系的另一个示意图。在录音设备的朝向发生变化前的朝向如图6所示，而朝向变化后的朝向如图7所示时。由于如图6所示初始拾音波束的初始指向与录音设备的朝向相同且均与y轴在顺时针方向上成夹角α，因此如图7所示，在录音设备的朝向朝顺时针偏转了β后，初始拾音波束也向顺时针偏转了β，此时初始拾音波束的偏转后方向与y轴在顺时针方向的夹角为α+β。
图8为本发明拾音波束与目标声源关系的另一个示意图。由于目标指向有初始拾音波束的偏转后指向朝逆时针方向调整β从而得到，因此目标指向与y轴方向同样也在顺时针方向成夹角α。因此生成的目标拾音波束可以如图8所示。由于目标拾音波束的指向与y轴在顺时针方向上成夹角α，因此目标拾音波束就与初始拾音波束的初始指向相同，从而可以使目标拾音波束指向目标声源。
在此需要说明的是，在实际使用中，拾音波束通常为圆锥状，为便于描述，图3至图8均以俯视图方式对本发明进行说明。进一步需要说明的是，录音设备在三维空间中的朝向变化，通过坐标系转换，均可以转换为在某一个或几个二维平面内发生朝向变化。因此录音设备在三维空间中发生朝向变化后生成目标拾音波束的方式与录音设备在二维空间内发生朝向变化后生成目标拾音波束的方式相类似，在此就不再赘述。
在本实施例中，通过波束形成算法产生初始拾音波束，其中，所述初始拾音波束指向所述目标声源；记录所述初始拾音波束的初始指向；检测到所述录音设备的朝向发生变化，根据所述录音设备的朝向变化，调整所述初始拾音波束以得到所述目标拾音波束，所述目标拾音波束指向所述目标声源。采用本实施例，可以根据录音设备的朝向变化，调整拾音波束的指向，从而保证拾音波束始终指向目标声源，避免因为录音设备朝向变化而导致录音效果变差。
与本发明指向性录音方法相对应，本发明还提供了指向性录音装置及录音设备。
参见图9，为本发明指向性录音装置一个实施例的结构示意图。该装置可以设置在录音设备上。
如图9所示，所述装置可以包括生成单元901，记录单元902及调整单元903。
其中，生成单元901，用于通过波束形成算法产生初始拾音波束，其中，所述初始拾音波束指向所述目标声源；记录单元902，用于记录所述初始拾音波束的初始指向；调整单元903，用于在检测到所述录音设备的朝向发生变化后，检测到所述录音设备的朝向发生变化，根据所述录音设备的朝向变化，调整所述初始拾音波束以得到所述目标拾音波束，所述目标拾音波束指向所述目标声源。
可选的，所述装置还包括：提醒单元，用于在所述录音设备的显示界面，提醒用户将所述录音设备的头端朝向所述目标声源。
可选的，所述调整单元903包括：确定子单元，用于在检测到所述录音设备的朝向发生变化后，确定所述录音设备的朝向偏转角度与朝向偏转方向；控制子单元，用于控制所述初始固定波束拾音波束向指定调整方向偏转指定调整角度，得到目标拾音波束，其中，所述指定调整方向与所述朝向偏转方向相反，所述指定调整角度与所述朝向偏转角度相同。
可选的，所述确定子单元包括：角速度获取子单元，用于获取所述录音设备中的方向传感器在所述录音设备发生朝向变化时上报的角速度；偏转角度计算子单元，用于根据所述角速度计算出所述朝向偏转角度与所述朝向偏转方向。
可选的，所述控制子单元包括：偏转后指向确定子单元，用于根据所述初始拾音波束的初始指向及所述朝向偏转角度与所述朝向偏转方向，确定所述初始拾音波束的偏转后指向；目标指向确定子单元，用于将所述偏转后指向朝所述指定调整方向调整所述指定调整角度，得到目标指向；拾音波束生成子单元，用于生成指向为所述目标指向的目标拾音波束。
采用本实施例，可以根据录音设备的朝向变化，调整拾音波束的指向，从而保证拾音波束始终指向目标声源，避免因为录音设备朝向变化而导致录音效果变差。
参见图10，为本发明录音设备一个实施例的结构示意图。
如图10所示，所述录音设备可以包括处理器1001、存储器1002、麦克风阵列1003及方向传感器1004。这些组件通过一条或多条总线进行通信。本领域技术人员可以理解，图中示出的终端的结构并不构成对本发明的限定，它既可以是总线形结构，也可以是星型结构，还可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
其中，处理器1001为终端的控制中心，利用各种接口和线路连接整个终端的各个部分，通过运行或执行存储在存储器1002内的软件程序和/或模块，以及调用存储在存储器1002内的数据，以执行终端的各种功能和/或处理数据。所述处理器1001可以由集成电路(Integrated Circuit，简称IC)组成，例如可以由单颗封装的IC所组成，也可以由连接多颗相同功能或不同功能的封装IC而组成。举例来说，处理器1001可以仅包括中央处理器(Central Processing Unit，简称CPU)，也可以是GPU、数字信号处理器(Digital Signal Processor，简称DSP)、及通信单元中的控制芯片(例如基带芯片)的组合。在本发明实施方式中，CPU可以是单运算核心，也可以包括多运算核心。
存储器1002可用于存储软件程序以及模块，处理器1001通过运行存储在存储器1002的软件程序以及模块，从而执行终端的各种功能应用以及实现数据处理。存储器1002主要包括程序存储区和数据存储区，其中，程序存储区可存储操作系统、至少一个功能所需的应用程序，比如声音播放程序、图像播放程序等等；数据存储区可存储根据终端的使用所创建的数据(比如音频数据、电话本等)等。在本发明具体实施方式中，存储器1002可以包括易失性存储器，例如非挥发性动态随机存取内存(Nonvolatile Random Access Memory，简称NVRAM)、相变化随机存取内存(Phase Change RAM，简称PRAM)、磁阻式随机存取内存(Magetoresistive RAM，简称MRAM)等，还可以包括非易失性存储器，例如至少一个磁盘存储器件、电子可擦除可编程只读存储器(Electrically Erasable Programmable Read-Only Memory，简称EEPROM)、闪存器件，例如反或闪存(NOR flash memory)或是反及闪存(NAND flash memory)。非易失存储器储存处理器1001所执行的操作系统及应用程序。所述处理器1001从所述非易失存储器加载运行程序与数据到内存并将数字内容储存于大量储存装置中。所述操作系统包括用于控制和管理常规系统任务，例如内存管理、存储设备控制、电源管理等，以及有助于各种软硬件之间通信的各种组件和/或驱动器。在本发明实施方式中，所述操作系统可以是Google公司的Android系统、Apple公司开发的iOS系统或Microsoft公司开发的Windows操作系统等，或者是Vxworks这类的嵌入式操作系统。
麦克风阵列1003(又被称为麦克风)用于将声音信号转换为电信号，并将电信号传输给处理器1001。
方向传感器1004用于检测录音设备的位置及姿态变化情况，并将检测得到的信息提供给处理器1001。
可选的，所述录音设备还可以包括通信单元，所述通信单元用于建立通信信道，使终端通过所述通信信道以连接至远程服务器，可行远程服务器发送数据或从所述远程服务器下媒体数据。所述通信单元可以包括无线局域网(Wireless Local Area Network，简称wireless LAN)模块、蓝牙模块、基带(Base Band)模块等通信模块，以及所述通信模块对应的射频(Radio Frequency，简称RF)电路，用于进行无线局域网络通信、蓝牙通信、红外线通信及/或蜂窝式通信系统通信，例如宽带码分多重接入(Wideband Code Division Multiple Access，简称W-CDMA)及/或高速下行封包存取(High Speed Downlink Packet Access，简称HSDPA)。所述通信模块用于控制终端中的各组件的通信，并且可以支持直接内存存取(Direct Memory Access)。
在本发明实施例中，所述处理器1001，可以用于通过波束形成算法产生初始拾音波束，其中，所述初始拾音波束指向所述目标声源；所述存储器1002，可以用于记录所述初始拾音波束的初始指向；所述处理器1001，还用于在检测到所述录音设备的朝向发生变化后，根据所述录音设备的朝向变化，调整所述初始拾音波束以得到所述目标拾音波束，所述目标拾音波束指向所述目标声源。其中，所述检测到所述录音设备的朝向发生变化具体可以为：检测到所述录音设备的朝向发生变化，且变化值超过预设范围。
可选的，所述处理器1001，还用于在所述录音设备的显示界面，提醒用户将所述录音设备的头端朝向所述目标声源。
可选的，所述处理器1001，还用于确定所述录音设备的朝向偏转角度与朝向偏转方向；控制所述初始拾音波束向指定调整方向偏转指定调整角度，得到目标拾音波束，其中，所述指定调整方向与所述朝向偏转方向相反，所述指定调整角度与所述朝向偏转角度相同。
可选的，所述处理器1001，还用于获取所述录音设备中的方向传感器在所述录音设备发生朝向变化时上报的角速度；根据所述角速度计算出所述朝向偏转角度与所述朝向偏转方向。
可选的，所述处理器1001，还可以还用于根据所述初始拾音波束的初始指向及所述朝向偏转角度与所述朝向偏转方向，确定所述初始拾音波束的偏转后指向；将所述偏转后指向朝所述指定调整方向调整所述指定调整角度，得到目标指向；生成指向为所述目标指向的目标拾音波束。
具体实现中，本发明还提供一种计算机可读存储介质，其中，该计算机可读存储介质中可以存储有一个或多个程序，该程序执行时可包括本发明提供的指向性录音方法各实施例中的部分或全部步骤。其中，所述一个或多个程序包括指令，所述指令当被录音设备执行时，所述录音设备可以执行前述实施例中的指向性录音方法。所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory，ROM)或随机存储记忆体(Random Access Memory，RAM)等。
本领域的技术人员可以清楚地了解到本发明实施例中的技术可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解，本发明实施例中的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计 算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例或者实施例的某些部分所述的方法。
本说明书中的各个实施例均采用递进的方式描述，各个实施例之间相同相似的部分互相参见即可，每个实施例重点说明的都是与其他实施例的不同之处。尤其，对于装置实施例及设备实施例而言，由于其基本相似于方法实施例，所以描述的比较简单，相关之处参见方法实施例的部分说明即可。
以上所述的本发明实施方式，并不构成对本发明保护范围的限定。任何在本发明的精神和原则之内所作的修改、等同替换和改进等，均应包含在本发明的保护范围之内。

Claims (19)

  1. 一种指向性录音方法，其特征在于，录音设备通过所述录音设备的麦克风阵列采集目标声源的语音，所述方法包括：
    通过波束形成算法产生初始拾音波束，其中，所述初始拾音波束指向所述目标声源；
    记录所述初始拾音波束的初始指向；
    检测到所述录音设备的朝向发生变化，根据所述录音设备的朝向变化，调整所述初始拾音波束以得到目标拾音波束，所述目标拾音波束指向所述目标声源。
  2. 如权利要求1所述的方法，其特征在于，在所述通过波束形成算法产生初始拾音波束之前，所述方法还包括：
    在所述录音设备的显示界面，提醒用户将所述录音设备的头端朝向所述目标声源。
  3. 如权利要求1或2所述的方法，其特征在于，调整所述初始拾音波束以得到所述目标拾音波束，包括：
    确定所述录音设备的朝向偏转角度与朝向偏转方向；
    控制所述初始拾音波束向指定调整方向偏转指定调整角度，得到目标拾音波束，其中，所述指定调整方向与所述朝向偏转方向相反，所述指定调整角度与所述朝向偏转角度相同。
  4. 如权利要求3所述的方法，其特征在于，确定所述录音设备的朝向偏转角度与朝向偏转方向包括：
    获取所述录音设备中的方向传感器在所述录音设备发生朝向变化时上报的角速度；
    根据所述角速度计算出所述朝向偏转角度与所述朝向偏转方向。
  5. 如权利要求3或4任一项所述的方法，其特征在于，控制所述初始拾音波束向指定调整方向偏转指定调整角度，得到目标拾音波束包括：
    根据所述初始拾音波束的初始指向及所述朝向偏转角度与所述朝向偏转方向，确定所述初始拾音波束的偏转后指向；
    将所述偏转后指向朝所述指定调整方向调整所述指定调整角度，得到目标指向；
    生成指向为所述目标指向的目标拾音波束。
  6. 如权利要求1至5任一项所述的方法，其特征在于，所述检测到所述录音设备的 朝向发生变化具体为：
    检测到所述录音设备的朝向发生变化，且变化值超过预设范围。
  7. 一种指向性录音装置，其特征在于，录音设备通过所述录音设备的麦克风阵列采集目标声源的语音，所述装置包括：
    生成单元，用于通过波束形成算法产生初始拾音波束，其中，所述初始拾音波束指向所述目标声源；
    记录单元，用于记录所述初始拾音波束的初始指向；
    调整单元，用于在检测到所述录音设备的朝向发生变化后，检测到所述录音设备的朝向发生变化，根据所述录音设备的朝向变化，调整所述初始拾音波束以得到目标拾音波束，所述目标拾音波束指向所述目标声源。
  8. 如权利要求7所述的装置，其特征在于，所述装置还包括：
    提醒单元，用于在所述录音设备的显示界面，提醒用户将所述录音设备的头端朝向所述目标声源。
  9. 如权利要求7或8所述的装置，其特征在于，所述调整单元包括：
    确定子单元，用于在检测到所述录音设备的朝向发生变化后，确定所述录音设备的朝向偏转角度与朝向偏转方向；
    控制子单元，用于控制所述初始固定波束拾音波束向指定调整方向偏转指定调整角度，得到目标拾音波束，其中，所述指定调整方向与所述朝向偏转方向相反，所述指定调整角度与所述朝向偏转角度相同。
  10. 如权利要求9所述的装置，其特征在于，所述确定子单元包括：
    角速度获取子单元，用于获取所述录音设备中的方向传感器在所述录音设备发生朝向变化时上报的角速度；
    偏转角度计算子单元，用于根据所述角速度计算出所述朝向偏转角度与所述朝向偏转方向。
  11. 如权利要求9或10所述的装置，其特征在于，所述控制子单元包括：
    偏转后指向确定子单元，用于根据所述初始拾音波束的初始指向及所述朝向偏转角度与所述朝向偏转方向，确定所述初始拾音波束的偏转后指向；
    目标指向确定子单元，用于将所述偏转后指向朝所述指定调整方向调整所述指定调 整角度，得到目标指向；
    拾音波束生成子单元，用于生成指向为所述目标指向的目标拾音波束。
  12. 如权利要求7至11任一项所述的装置，其特征在于，所述检测到所述录音设备的朝向发生变化具体为：
    检测到所述录音设备的朝向发生变化，且变化值超过预设范围。
  13. 一种录音设备，其特征在于，包括处理器、存储器、麦克风阵列及方向传感器；录音设备通过所述录音设备的麦克风阵列采集目标声源的语音；
    所述处理器，用于通过波束形成算法产生初始拾音波束，其中，所述初始拾音波束指向所述目标声源；
    所述存储器，用于记录所述初始拾音波束的初始指向；
    所述处理器，还用于在检测到所述录音设备的朝向发生变化后，根据所述录音设备的朝向变化，调整所述初始拾音波束以得到目标拾音波束，所述目标拾音波束指向所述目标声源。
  14. 如权利要求13所述的录音设备，其特征在于，
    所述处理器，还用于在所述录音设备的显示界面，提醒用户将所述录音设备的头端朝向所述目标声源。
  15. 如权利要求13或14所述的录音设备，其特征在于，
    所述处理器，还用于确定所述录音设备的朝向偏转角度与朝向偏转方向；控制所述初始拾音波束向指定调整方向偏转指定调整角度，得到目标拾音波束，其中，所述指定调整方向与所述朝向偏转方向相反，所述指定调整角度与所述朝向偏转角度相同。
  16. 如权利要求15所述的录音设备，其特征在于，
    所述处理器，还用于获取所述录音设备中的方向传感器在所述录音设备发生朝向变化时上报的角速度；根据所述角速度计算出所述朝向偏转角度与所述朝向偏转方向。
  17. 如权利要求15或16所述的录音设备，其特征在于，
    所述处理器，还用于根据所述初始拾音波束的初始指向及所述朝向偏转角度与所述朝向偏转方向，确定所述初始拾音波束的偏转后指向；将所述偏转后指向朝所述指定调整方向调整所述指定调整角度，得到目标指向；生成指向为所述目标指向的目标拾音波 束。
  18. 如权利要求13至17任一项所述的录音设备，其特征在于，所述检测到所述录音设备的朝向发生变化具体为：
    检测到所述录音设备的朝向发生变化，且变化值超过预设范围。
  19. 一种存储一个或多个程序的计算机可读存储介质，所述一个或多个程序包括指令，所述指令当被录音设备执行时，使所述录音设备执行根据权利要求1至6任一项所述方法。
PCT/CN2016/075948 2015-08-26 2016-03-09 指向性录音方法、装置及录音设备 WO2017031972A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US15/557,760 US20180156887A1 (en) 2015-08-26 2016-03-09 Directional recording method and apparatus, and recording device
EP16838235.6A EP3252775A4 (en) 2015-08-26 2016-03-09 Directivity recording method, apparatus and recording device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510530941.0 2015-08-26
CN201510530941.0A CN106486147A (zh) 2015-08-26 2015-08-26 指向性录音方法、装置及录音设备

Publications (1)

Publication Number Publication Date
WO2017031972A1 true WO2017031972A1 (zh) 2017-03-02

Family

ID=58099429

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/075948 WO2017031972A1 (zh) 2015-08-26 2016-03-09 指向性录音方法、装置及录音设备

Country Status (4)

Country Link
US (1) US20180156887A1 (zh)
EP (1) EP3252775A4 (zh)
CN (1) CN106486147A (zh)
WO (1) WO2017031972A1 (zh)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019032819A1 (en) * 2017-08-10 2019-02-14 Nuance Communications, Inc. AUTOMATED CLINICAL DOCUMENTATION SYSTEM AND METHOD
US10809970B2 (en) 2018-03-05 2020-10-20 Nuance Communications, Inc. Automated clinical documentation system and method
US11043207B2 (en) 2019-06-14 2021-06-22 Nuance Communications, Inc. System and method for array data simulation and customized acoustic modeling for ambient ASR
US11216480B2 (en) 2019-06-14 2022-01-04 Nuance Communications, Inc. System and method for querying data points from graph data structures
US11222103B1 (en) 2020-10-29 2022-01-11 Nuance Communications, Inc. Ambient cooperative intelligence system and method
US11222716B2 (en) 2018-03-05 2022-01-11 Nuance Communications System and method for review of automated clinical documentation from recorded audio
US11227679B2 (en) 2019-06-14 2022-01-18 Nuance Communications, Inc. Ambient clinical intelligence system and method
US11316865B2 (en) 2017-08-10 2022-04-26 Nuance Communications, Inc. Ambient cooperative intelligence system and method
US11515020B2 (en) 2018-03-05 2022-11-29 Nuance Communications, Inc. Automated clinical documentation system and method
US11531807B2 (en) 2019-06-28 2022-12-20 Nuance Communications, Inc. System and method for customized text macros
US11670408B2 (en) 2019-09-30 2023-06-06 Nuance Communications, Inc. System and method for review of automated clinical documentation

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107071689B (zh) * 2017-04-19 2018-12-14 音曼（北京）科技有限公司 一种方向自适应的空间音频处理方法及系统
CN107343101B (zh) * 2017-07-05 2019-11-12 广东小天才科技有限公司 一种实现定向录音的方法、装置、设备及存储介质
CN110278512A (zh) * 2018-03-13 2019-09-24 中兴通讯股份有限公司 拾音设备、声音输出方法、装置、存储介质及电子装置
TWI690921B (zh) * 2018-08-24 2020-04-11 緯創資通股份有限公司 收音處理裝置及其收音處理方法
CN109640224B (zh) * 2018-12-26 2022-01-21 北京猎户星空科技有限公司 一种拾音方法及装置
DE102019134541A1 (de) * 2019-12-16 2021-06-17 Sennheiser Electronic Gmbh & Co. Kg Verfahren zur Steuerung eines Mikrofonarrays und Vorrichtung zur Steuerung eines Mikrofonarrays
CN113132863B (zh) * 2020-01-16 2022-05-24 华为技术有限公司 立体声拾音方法、装置、终端设备和计算机可读存储介质
EP3917160A1 (en) * 2020-05-27 2021-12-01 Nokia Technologies Oy Capturing content
CN111883186B (zh) * 2020-07-10 2022-12-23 上海明略人工智能(集团)有限公司 录音设备、语音采集方法及装置、存储介质及电子设备
CN111918170A (zh) * 2020-07-10 2020-11-10 北京搜狗科技发展有限公司 拾音方式切换方法、装置和电子设备
CN113923562B (zh) * 2020-07-10 2024-08-20 北京搜狗智能科技有限公司 拾音方法和装置
CN113556501A (zh) * 2020-08-26 2021-10-26 华为技术有限公司 音频处理方法及电子设备
CN112351248B (zh) * 2020-10-20 2023-05-30 杭州海康威视数字技术股份有限公司 一种关联图像数据和声音数据的处理方法
CN112839285A (zh) * 2021-01-07 2021-05-25 惠州Tcl移动通信有限公司 一种录音方法、终端、及存储介质
CN113067939A (zh) * 2021-03-16 2021-07-02 读书郎教育科技有限公司 一种移动终端的定向录音控制系统及方法
CN113473306A (zh) * 2021-06-30 2021-10-01 Oppo广东移动通信有限公司 定向录音方法、装置、电子设备及存储介质
CN113655985A (zh) * 2021-08-09 2021-11-16 维沃移动通信有限公司 音频录制方法、装置、电子设备及可读存储介质
CN114173252A (zh) * 2021-12-14 2022-03-11 Oppo广东移动通信有限公司 音频采集方向的控制方法、装置、耳机以及存储介质
CN114422897A (zh) * 2022-01-12 2022-04-29 Oppo广东移动通信有限公司 音频处理方法、装置、电子设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5974386A (en) * 1995-09-22 1999-10-26 Nikon Corporation Timeline display of sound characteristics with thumbnail video
CN101727965A (zh) * 2008-10-29 2010-06-09 三洋电机株式会社 录音装置
CN102403022A (zh) * 2010-09-13 2012-04-04 三洋电机株式会社 录音装置、录音条件设定方法以及录音条件设定程序
CN104244137A (zh) * 2014-09-30 2014-12-24 广东欧珀移动通信有限公司 一种录像过程中提升远景录音效果的方法及系统
CN104335273A (zh) * 2012-06-08 2015-02-04 苹果公司 基于系统状态来调节音频波束形成设置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100677554B1 (ko) * 2005-01-14 2007-02-02 삼성전자주식회사 비임형성 방식을 이용한 녹음 장치 및 그 방법
EP2517478B1 (en) * 2009-12-24 2017-11-01 Nokia Technologies Oy An apparatus
US8525868B2 (en) * 2011-01-13 2013-09-03 Qualcomm Incorporated Variable beamforming with a mobile platform
CN103778950A (zh) * 2012-10-22 2014-05-07 爱国者电子科技有限公司 录音电路关闭状态下的录音方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5974386A (en) * 1995-09-22 1999-10-26 Nikon Corporation Timeline display of sound characteristics with thumbnail video
CN101727965A (zh) * 2008-10-29 2010-06-09 三洋电机株式会社 录音装置
CN102403022A (zh) * 2010-09-13 2012-04-04 三洋电机株式会社 录音装置、录音条件设定方法以及录音条件设定程序
CN104335273A (zh) * 2012-06-08 2015-02-04 苹果公司 基于系统状态来调节音频波束形成设置
CN104244137A (zh) * 2014-09-30 2014-12-24 广东欧珀移动通信有限公司 一种录像过程中提升远景录音效果的方法及系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3252775A4 *

Cited By (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11074996B2 (en) 2017-08-10 2021-07-27 Nuance Communications, Inc. Automated clinical documentation system and method
US11316865B2 (en) 2017-08-10 2022-04-26 Nuance Communications, Inc. Ambient cooperative intelligence system and method
WO2019032812A1 (en) * 2017-08-10 2019-02-14 Nuance Communications, Inc. SYSTEM AND METHOD FOR AUTOMATED CLINICAL DOCUMENTATION (ACD)
US10546655B2 (en) 2017-08-10 2020-01-28 Nuance Communications, Inc. Automated clinical documentation system and method
US11605448B2 (en) 2017-08-10 2023-03-14 Nuance Communications, Inc. Automated clinical documentation system and method
US10957428B2 (en) 2017-08-10 2021-03-23 Nuance Communications, Inc. Automated clinical documentation system and method
US10957427B2 (en) 2017-08-10 2021-03-23 Nuance Communications, Inc. Automated clinical documentation system and method
US11257576B2 (en) 2017-08-10 2022-02-22 Nuance Communications, Inc. Automated clinical documentation system and method
US11295838B2 (en) 2017-08-10 2022-04-05 Nuance Communications, Inc. Automated clinical documentation system and method
WO2019032778A1 (en) * 2017-08-10 2019-02-14 Nuance Communications, Inc. SYSTEM AND METHOD FOR AUTOMATED CLINICAL DOCUMENTATION (ACD)
US10978187B2 (en) 2017-08-10 2021-04-13 Nuance Communications, Inc. Automated clinical documentation system and method
US11101023B2 (en) 2017-08-10 2021-08-24 Nuance Communications, Inc. Automated clinical documentation system and method
US11101022B2 (en) 2017-08-10 2021-08-24 Nuance Communications, Inc. Automated clinical documentation system and method
US11114186B2 (en) 2017-08-10 2021-09-07 Nuance Communications, Inc. Automated clinical documentation system and method
US11404148B2 (en) 2017-08-10 2022-08-02 Nuance Communications, Inc. Automated clinical documentation system and method
US11322231B2 (en) 2017-08-10 2022-05-03 Nuance Communications, Inc. Automated clinical documentation system and method
WO2019032819A1 (en) * 2017-08-10 2019-02-14 Nuance Communications, Inc. AUTOMATED CLINICAL DOCUMENTATION SYSTEM AND METHOD
US11043288B2 (en) 2017-08-10 2021-06-22 Nuance Communications, Inc. Automated clinical documentation system and method
US11295839B2 (en) 2017-08-10 2022-04-05 Nuance Communications, Inc. Automated clinical documentation system and method
US11482308B2 (en) 2017-08-10 2022-10-25 Nuance Communications, Inc. Automated clinical documentation system and method
US11222716B2 (en) 2018-03-05 2022-01-11 Nuance Communications System and method for review of automated clinical documentation from recorded audio
US11515020B2 (en) 2018-03-05 2022-11-29 Nuance Communications, Inc. Automated clinical documentation system and method
US11295272B2 (en) 2018-03-05 2022-04-05 Nuance Communications, Inc. Automated clinical documentation system and method
US11250383B2 (en) 2018-03-05 2022-02-15 Nuance Communications, Inc. Automated clinical documentation system and method
US11250382B2 (en) 2018-03-05 2022-02-15 Nuance Communications, Inc. Automated clinical documentation system and method
US10809970B2 (en) 2018-03-05 2020-10-20 Nuance Communications, Inc. Automated clinical documentation system and method
US11270261B2 (en) 2018-03-05 2022-03-08 Nuance Communications, Inc. System and method for concept formatting
US11494735B2 (en) 2018-03-05 2022-11-08 Nuance Communications, Inc. Automated clinical documentation system and method
US11043207B2 (en) 2019-06-14 2021-06-22 Nuance Communications, Inc. System and method for array data simulation and customized acoustic modeling for ambient ASR
US11216480B2 (en) 2019-06-14 2022-01-04 Nuance Communications, Inc. System and method for querying data points from graph data structures
US11227679B2 (en) 2019-06-14 2022-01-18 Nuance Communications, Inc. Ambient clinical intelligence system and method
US11531807B2 (en) 2019-06-28 2022-12-20 Nuance Communications, Inc. System and method for customized text macros
US11670408B2 (en) 2019-09-30 2023-06-06 Nuance Communications, Inc. System and method for review of automated clinical documentation
US11222103B1 (en) 2020-10-29 2022-01-11 Nuance Communications, Inc. Ambient cooperative intelligence system and method

Also Published As

Publication number Publication date
EP3252775A4 (en) 2018-02-28
CN106486147A (zh) 2017-03-08
EP3252775A1 (en) 2017-12-06
US20180156887A1 (en) 2018-06-07

Similar Documents

Publication Publication Date Title
WO2017031972A1 (zh) 指向性录音方法、装置及录音设备
US10909988B2 (en) Systems and methods for displaying a user interface
US10575096B2 (en) Sound processing method and apparatus
US10492015B2 (en) Automated user/sensor location recognition to customize audio performance in a distributed multi-sensor environment
US20190251995A1 (en) Method for voice recording and electronic device thereof
JP7082126B2 (ja) デバイス内の非対称配列の複数のマイクからの空間メタデータの分析
US9516241B2 (en) Beamforming method and apparatus for sound signal
US11223924B2 (en) Audio distance estimation for spatial audio processing
US10257611B2 (en) Stereo separation and directional suppression with omni-directional microphones
US20180242095A1 (en) Speaker position identification with respect to a user based on timing information for enhanced sound adjustment
CN109804559A (zh) 空间音频系统中的增益控制
US11582573B2 (en) Disabling/re-enabling head tracking for distracted user of spatial audio application
US20150110284A1 (en) Noise reduction in multi-microphone systems
WO2016082199A1 (zh) 录取录像对象的声音的方法和移动终端
US10078135B1 (en) Identifying a physical distance using audio channels
CN110691300A (zh) 音频播放设备及用于提供信息的方法
US9516417B2 (en) Boundary binaural microphone array
CN110719545B (zh) 音频播放设备及用于播放音频的方法
CN107113499B (zh) 定向音频捕获
US10945067B2 (en) Area reproduction method, computer readable recording medium which records area reproduction program, and area reproduction system
EP3917160A1 (en) Capturing content
US20240129684A1 (en) Interpolation of finite impulse response filters for generating sound fields
CN118158799A (zh) 跟踪定位方法、装置、设备及可读存储介质
CN108476555A (zh) 音频处理的方法和终端设备
JP2017181341A (ja) 電子機器、測位方法及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16838235

Country of ref document: EP

Kind code of ref document: A1

REEP Request for entry into the european phase

Ref document number: 2016838235

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 15557760

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE