WO2021248364A1 - Audio recording method and apparatus for unmanned aerial vehicle, chip, unmanned aerial vehicle, and system - Google Patents

Audio recording method and apparatus for unmanned aerial vehicle, chip, unmanned aerial vehicle, and system Download PDF

Info

Publication number
WO2021248364A1
WO2021248364A1 PCT/CN2020/095351 CN2020095351W WO2021248364A1 WO 2021248364 A1 WO2021248364 A1 WO 2021248364A1 CN 2020095351 W CN2020095351 W CN 2020095351W WO 2021248364 A1 WO2021248364 A1 WO 2021248364A1
Authority
WO
WIPO (PCT)
Prior art keywords
unmanned aerial
aerial vehicle
audio signal
state
preset threshold
Prior art date
Application number
PCT/CN2020/095351
Other languages
French (fr)
Chinese (zh)
Inventor
薛政
莫品西
边云锋
刘洋
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2020/095351 priority Critical patent/WO2021248364A1/en
Priority to CN202080025857.2A priority patent/CN113748688A/en
Publication of WO2021248364A1 publication Critical patent/WO2021248364A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64DEQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
    • B64D47/00Equipment not otherwise provided for
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0316Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude
    • G10L21/0324Details of processing therefor
    • G10L21/034Automatic adjustment
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/10527Audio or video recording; Data buffering arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/08Mouthpieces; Microphones; Attachments therefor
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U20/00Constructional aspects of UAVs
    • B64U20/20Constructional aspects of UAVs for noise reduction
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00UAVs specially adapted for particular uses or applications
    • B64U2101/15UAVs specially adapted for particular uses or applications for conventional or electronic warfare
    • B64U2101/17UAVs specially adapted for particular uses or applications for conventional or electronic warfare for detecting, disrupting or countering communications
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U50/00Propulsion; Power supply
    • B64U50/10Propulsion
    • B64U50/19Propulsion using electrically powered motors
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/10527Audio or video recording; Data buffering arrangements
    • G11B2020/10537Audio or video recording
    • G11B2020/10546Audio or video recording specifically adapted for audio data

Definitions

  • This application relates to unmanned aerial vehicles, in particular to an unmanned aerial vehicle recording method, an unmanned aerial vehicle recording device, a chip, an unmanned aerial vehicle, an unmanned aerial vehicle recording system, a computer-readable storage medium, and a computer program product.
  • the embodiments of the present application provide a recording method of an unmanned aerial vehicle, an unmanned aerial vehicle recording device, a chip, an unmanned aerial vehicle, and an unmanned aerial vehicle recording system.
  • an embodiment of the present application provides a recording method for an unmanned aerial vehicle, including:
  • the working state includes the flight state and the landing state
  • an embodiment of the present application provides a recording device for an unmanned aerial vehicle, including:
  • a memory for storing processor executable instructions
  • the processor is configured to:
  • the working state includes the flight state and the landing state
  • an embodiment of the present application provides a chip installed on an unmanned aerial vehicle, including a processor and a memory, the memory is used to store instructions, and the processor calls the instructions stored in the memory to implement the following operations :
  • the working state includes the flight state and the landing state
  • an embodiment of the present application provides an unmanned aerial vehicle, the unmanned aerial vehicle is equipped with a chip and a microphone, the chip includes a processor and a memory, the memory is used to store instructions, and the processor calls the The instructions stored in the memory are used to implement the following operations:
  • the working state includes the flight state and the landing state
  • an embodiment of the present application provides an unmanned aerial vehicle recording system, including an unmanned aerial vehicle and a designated application, the unmanned aerial vehicle is equipped with a chip and a microphone, the designated application is installed in an electronic device, and the unmanned aerial vehicle
  • the chip includes a processor and a memory, the memory is used to store instructions, and when the processor responds to a request of the application, the instructions stored in the memory are invoked to implement the following operations :
  • the working state includes the flight state and the landing state
  • the present application provides a computer-readable storage medium, including instructions, which when run on a computer, cause the computer to execute the method described in the first aspect.
  • the present application provides a computer program product containing instructions that, when the instructions run on a computer, cause the computer to execute the method described in the first aspect.
  • This application determines whether the UAV's working status is in flight or on the ground, and adjusts the parameters of the recording device according to the working state of the UAV to record, so that the audio can be ensured regardless of whether the UAV is in flight or on the ground. Recording effect.
  • Fig. 1 is a flowchart of a recording method for an unmanned aerial vehicle according to an exemplary embodiment of the present application.
  • Fig. 2 is a flowchart of adjusting the parameters of the recording device and processing the recorded audio signal when the unmanned aerial vehicle is in the flying state and in the landing state according to an exemplary embodiment of the present application.
  • Fig. 3 is an unmanned aerial vehicle recording device shown in an exemplary embodiment of the present application.
  • Fig. 4 is a chip shown in an exemplary embodiment of the present application.
  • Fig. 5 is an unmanned aerial vehicle shown in an exemplary embodiment of the present application.
  • Fig. 6 is an unmanned aerial vehicle recording system shown in an exemplary embodiment of the present application.
  • the embodiment of the present application first proposes a recording method for the unmanned aerial vehicle, which can be applied in
  • the computer hardware installed in the unmanned aerial vehicle may be, for example, a management chip mounted in the unmanned aerial vehicle.
  • the unmanned aerial vehicle is also equipped with at least one recording device, and the management chip controls the recording process of the recording device.
  • the method can also be applied to a system composed of terminal equipment or an application on the terminal device and a management chip on an unmanned aerial vehicle.
  • an application on the terminal device can issue a command to control the management chip on an unmanned aerial vehicle.
  • the terminal device may be, for example, an unmanned aerial vehicle remote control, a mobile phone terminal, a tablet computer, a notebook computer, a PC terminal, and the like.
  • Fig. 1 is a flow chart of a recording method for an unmanned aerial vehicle according to an exemplary embodiment of the present application. As shown in Fig. 1, the method includes:
  • S101 Determine the working state of the unmanned aerial vehicle in the case of recording through the recording device; the working state includes the flight state and the landing state;
  • the recording device may be a microphone, a voice recorder, or a voice recorder, etc., which is not limited in this application.
  • a microphone will be used as an example for description below.
  • the sound level is different. For example, in the flight state (when in motion or suspended state), the sound of the propeller is extremely large. At this time, the maximum sound pressure level of the propeller sound may be greater than The maximum recording sound pressure level of the microphone causes the problem of overloading the propeller sound to be recorded. For example, when the maximum sound pressure level of the propeller sound is 135db and the maximum sound pressure level of the microphone is 128db, the propeller sound to be recorded is relative to the microphone In terms of overload, the audio signal recorded by the microphone will be clipped at this time, resulting in the subsequent failure to restore a clear and complete blade sound.
  • the main recorded sound is the human voice in the environment, but because there is a certain distance between the microphone and the sound source, the human voice to be recorded will be too small.
  • the unmanned aerial vehicle due to the internal circuit noise, fuselage vibration noise, fan noise, etc., the unmanned aerial vehicle itself will cause interference to the already too small human voice to be recorded. Therefore, when the unmanned aerial vehicle performs recording in different working states, the parameters of the microphone need to be adjusted accordingly to ensure the quality of the recording. How to adjust the parameters of the microphone according to different scenes will be introduced in the following embodiments.
  • the number of microphones used to record audio signals can be one or multiple , The specific number can be set according to demand. And when setting multiple microphones, you can use different microphones to record in different scenarios. For example, when recording a mono audio signal, you can set microphone 1 and microphone 2 respectively, which can be used when the UAV is in flight. When the UAV is on the ground, use the microphone 2 to record. Among them, the microphone 1 and the microphone 2 can be of the same specification or different specifications. Those skilled in the art can perform according to their needs.
  • Configuration of course, preferably, you can configure a microphone suitable for the scene to record according to different recording scenes, thereby reducing the adjustment of the microphone parameters, for example, when the unmanned aerial vehicle is in flight, the sound of the recording is too loud. You can choose to configure a microphone with a lower sensitivity for recording. Conversely, when the UAV is on the ground, you can choose to configure a microphone with a higher sensitivity for recording because the recorded human voice is small.
  • the working state of the unmanned aerial vehicle may be determined before the recording is started, and how to adjust the microphone parameters is determined according to the determined working state of the unmanned aerial vehicle, and then the recording is started; of course, the recording may also be started. After that, the working status of the unmanned aerial vehicle is determined in real time, and then the parameters of the microphone are adjusted according to the working status of the unmanned aerial vehicle for recording.
  • the embodiment of the present application also provides a method for determining the working state of the unmanned aerial vehicle.
  • Several methods for determining the working state of the unmanned aerial vehicle will be introduced below.
  • the operating status of the unmanned aerial vehicle can be determined based on the received operating status message of the unmanned aerial vehicle. Specifically, it can be judged by receiving the flight control status message sent by the flight control module inside the unmanned aerial vehicle.
  • the working status of the human aircraft is used to collect the working status data of the unmanned aerial vehicle measured by the sensors in real time, and to receive the control commands and data transmitted by the terminal equipment used to remotely control the unmanned aerial vehicle.
  • Various working conditions are controlled, and the working status data of the UAV and working status parameters such as the engine and the onboard power system are transmitted to the remote control terminal in real time.
  • the flight control module can establish real-time communication with the flight control module, obtain the real-time working status of the unmanned aerial vehicle from the flight control module, and determine that the unmanned aerial vehicle is in the flying state when a message indicating that the unmanned aerial vehicle is in flight is received. ; When receiving a message indicating that the UAV is on the ground, it is determined that the UAV is on the ground. And after confirming the working status message of the unmanned aerial vehicle, correspondingly adjust the parameters of the recorded audio signal.
  • the flight control module can also actively send an indication message in real time, and it can send a message indicating the real-time working status of the unmanned aerial vehicle during the working process of the unmanned aerial vehicle.
  • the working state of the unmanned aerial vehicle when the working state of the unmanned aerial vehicle changes, It can also send a message indicating the transition of the unmanned aerial vehicle's working state. For example, it can send a message indicating that the unmanned aerial vehicle enters the landing state when the unmanned aerial vehicle is switched from the flying state to the landing state.
  • the state correspondingly adjusts the parameters of the recorded audio signal to ensure the recording effect.
  • the embodiments of the present application also provide other methods for determining the operating status of the unmanned aerial vehicle.
  • the motion state of the unmanned aerial vehicle can be determined by analyzing the characteristics of the recorded audio signal. For example, in the case of recording an audio signal, the energy of the audio signal recorded in real time can be used to determine the unmanned aerial vehicle's performance.
  • the UAV In the working state, since the UAV mainly records the sound of the propeller when in flight, and mainly records the human voice in the environment when it is on the ground, there is a great difference in the amplitude between the recorded sound of the propeller and the audio signal of the human voice. Moreover, the amplitude of the audio signal can reflect the energy of the audio signal, so the working state of the UAV can be judged by analyzing and calculating the energy of the recorded audio signal. For example, by defining a first preset threshold, when the energy of the recorded audio signal is greater than the first preset threshold, it is determined that the unmanned aerial vehicle is in a flying state; otherwise, it is determined that the unmanned aerial vehicle is in a landing state.
  • the specific value of the first preset threshold can be determined by those skilled in the art according to actual needs, which is not limited in the embodiment of the present application. Based on the definition of the first preset threshold, when the UAV is switching the working state, when the energy of the recorded audio signal changes from less than the first preset threshold to greater than the first preset threshold in real-time analysis, It can be determined that the unmanned aerial vehicle has entered the flying state; on the contrary, when the energy of the recorded audio signal changes from greater than the first preset threshold to less than the first preset threshold, it is determined that the unmanned aerial vehicle has entered the landing state.
  • the energy of the recorded audio signal changes from less than the first preset threshold to greater than the first preset threshold, and there is no rebound within a period of time.
  • it is less than the first preset threshold it is determined that the unmanned aerial vehicle enters the flying state, and the determination that the unmanned aerial vehicle enters the landing state can also be judged based on the same principle.
  • the embodiment of the present application also provides a determination method.
  • the working state of the unmanned aerial vehicle can be determined by the obtained motor speed of the unmanned aerial vehicle. Since the unmanned aerial vehicle is in flight state, the blades of the unmanned aerial vehicle rotate at a high speed. The speed is extremely large; while the UAV is in the landing state, the blades are close to stop rotating, at this time the motor speed is small, so the motor speed of the UAV can also reflect the working status of the UAV, which can be done by collecting the motor speed in real time. judge.
  • the second preset threshold can also be defined to determine that the drone is in a flying state when the motor speed is greater than the second preset threshold; otherwise, it is determined that the drone is in a landing state.
  • the unmanned aerial vehicle is switching the working state, when the motor speed changes from less than the second preset threshold to greater than the second preset threshold, it is determined that the drone enters the flying state; on the contrary, when the motor speed changes from greater than the second preset threshold
  • the preset threshold value is changed to be less than the second preset threshold value, it is determined that the drone enters the landing state.
  • the working status of the unmanned aerial vehicle can also be determined by detecting the zero-crossing rate of the recorded audio signal, pitch detection, etc., which will not be listed here. It can be understood that in consideration of obtaining the judgment result faster, the working state of the unmanned aerial vehicle can be determined by only one method shown in the above-mentioned embodiment. Under the condition of ensuring the accuracy of the judgment result, the above can be selected. The two or more methods shown can be freely combined to determine the working state of the unmanned aerial vehicle. The specific selection is not limited in the embodiment of the present application.
  • the parameters of the microphone need to be adjusted accordingly to ensure the recording effect.
  • the gain parameter, working frequency or frequency response of the microphone can be adjusted.
  • the specific adjustment can be freely set according to the working state of the UAV. Certainly, this application is not limited. The following will cite an example of adjusting the gain parameter of the microphone according to the working state of the unmanned aerial vehicle.
  • the unmanned aerial vehicle Take an unmanned aerial vehicle equipped with an analog microphone as an example.
  • the unmanned aerial vehicle s propeller sound is too loud when it is in flight, and the ambient human voice recorded when it is on the ground is too small, so you can adjust the unmanned aerial vehicle in different working states accordingly.
  • the analog gain of the analog microphone can be understood as the multiple that the front circuit in the analog microphone amplifies the recorded audio signal. Since the analog microphone converts the acoustic signal into an electrical signal (audio signal), the electrical signal obtained is relatively weak, and it needs to pass the front The subsequent transmission and processing can only be carried out after the built-in circuit is further amplified. Therefore, the degree of amplification of the recorded audio signal can be adjusted by adjusting the analog gain, so as to avoid continuing to use the original analog gain, which may cause the amplified audio signal to be clipped.
  • the analog gain of the analog microphone can be lowered to avoid over-amplification of the recorded audio signal, and the amplified audio signal is controlled within the first specified range; similarly, when When the UAV is on the ground, the analog gain of the analog microphone can be increased to increase the degree of amplification of the recorded audio signal, and the amplified audio signal can be controlled within the second specified range.
  • the maximum value of the first specified range and the second specified range are both smaller than the clipping point, and the clipping point can be understood as the maximum value at which the audio signal will not be clipped.
  • the first designated range and the second designated range may be the same range or different ranges, and can be specifically set by those skilled in the art according to actual needs, which are not limited in the embodiment of the present application.
  • the digital gain of the digital microphone can also be adjusted to control the amplification of the recorded audio signal, which is similar to the method of adjusting the analog gain. No further introduction.
  • stereo sound effects can be recorded.
  • two or more microphones can be set to record according to actual needs.
  • an energy-based stereo enhancement method can be adopted to enhance the recorded stereo sound effect by adjusting the energy of the recorded audio signal.
  • the equalizer used may be an equalizer for processing analog signals, or an equalizer for processing digital signals.
  • the equalizer for example, when the unmanned aerial vehicle is in flight, for the audio signal that is recorded and amplified by the pre-circuit, you can consider using an equalizer to ensure the equalization between the signals of different frequencies, and appropriately perform the processing on the signals of different frequencies. Shrink, that is, reduce its amplitude to ensure the effect of recording.
  • the unmanned aerial vehicle While the unmanned aerial vehicle is recording the human voice in the environment when it is on the ground, the audio signal in the recording environment is too small. At this time, the internal circuit noise of the unmanned aerial vehicle, the vibration noise of the fuselage, and the fan noise will be affected. It will have a great impact on the recording effect, so it is necessary to perform vocal enhancement processing and noise reduction processing on the recorded audio signal.
  • the human voice enhancement processing of the audio signal a method similar to the above stereo enhancement processing can be used, and for the noise reduction processing of the audio signal, the Wiener filter can be used to achieve noise reduction, or the AI algorithm can intelligently identify the scene for noise reduction To correct the waveform of the recorded audio signal.
  • the microphone is usually equipped with acoustic resistance material to prevent the recorded sound from damaging the microphone, and the acoustic resistance material is mainly used to suppress high-frequency signals, so when recording the human voice in the environment, in order to avoid recording the sound too much Small, the high-frequency signal can be amplified by the equalizer, that is, its amplitude can be increased.
  • the adjustment of microphone parameters and the processing of recorded audio signals in the above embodiments are only exemplary, and those skilled in the art can select more microphone parameters to adjust and process the recorded audio signals according to their needs. This application will not enumerate one by one.
  • the built-in management chip of the unmanned aerial vehicle can determine the working state of the unmanned aerial vehicle according to the pre-stored corresponding
  • the processing algorithm in the working state is automatically executed, where the processing algorithm can be the method shown in one or more of the above embodiments to adjust the microphone parameters and process the recorded audio signal.
  • the different working states of the UAV can correspond to Different processing algorithms. Of course, it is also possible for the user to decide which algorithm to use to process the audio signal.
  • FIG. 2 illustrate the flow chart of adjusting microphone parameters and processing the recorded audio signal when the UAV is in flight and in the landing state.
  • S201 Determine the working state of the unmanned aerial vehicle; execute S202 to S204 when it is determined that the unmanned aerial vehicle is in the flying state, and execute S205 to S207 when it is determined that the unmanned aerial vehicle is in the landing state;
  • FIG. 3 is an unmanned aerial vehicle recording device shown in an exemplary embodiment of the present application.
  • the device 30 includes a processor 301 for storing Processor executable instructions memory 302, internal bus 304 and network interface 303;
  • the processor 301 is configured to determine the working state of the unmanned aerial vehicle in the case of recording through the recording device, and the working state includes the flight state and the landing state;
  • FIG. 4 is a chip shown in an exemplary embodiment of the present application.
  • the chip 40 includes a processor 401 and a memory 402, and the memory 402 is used for To store instructions, the processor 401 calls the instructions stored in the memory 402 to implement the following operations: in the case of recording through a recording device, determine the working state of the unmanned aerial vehicle, the working state including the flight state and the landing state;
  • FIG. 5 is an unmanned aerial vehicle shown in an exemplary embodiment of the present application.
  • the unmanned aerial vehicle 50 includes a chip 40 and a recording device 501.
  • the chip 40 includes processing The processor 401 and the memory 402.
  • the memory 402 is used to store instructions.
  • the processor 401 calls the instructions stored in the memory 402 to implement the following operations: in the case of recording through the recording device 501, the operating state of the UAV 50 is determined.
  • Working status includes flight status and landing status;
  • the recording operation is performed according to the adjusted parameters of the recording device 501.
  • FIG. 6 is an unmanned aerial vehicle recording system shown in an exemplary embodiment of this application.
  • the unmanned aerial vehicle recording system includes the unmanned aerial vehicle recording system shown in FIG. The human aircraft 50 and the designated application 601.
  • the designated application 601 is installed on the electronic device 60.
  • the processor 401 in response to the request of the designated application 601, calls the instructions stored in the memory 402 to implement the following operations:
  • the working state of the unmanned aerial vehicle 50 determines the working state of the unmanned aerial vehicle 50, the working state including the flight state and the landing state;
  • the recording operation is performed according to the adjusted parameters of the recording device 501.
  • the relevant part can refer to the part of the description of the method embodiment.
  • the device embodiments described above are merely illustrative, where the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the objectives of the solutions of the embodiments. Those of ordinary skill in the art can understand and implement without creative work.
  • the computer can be implemented in whole or in part by software, hardware, firmware, or any combination thereof.
  • software it can be implemented in the form of a computer program product in whole or in part.
  • the computer program product includes one or more computer instructions.
  • the computer program instructions When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application are generated in whole or in part.
  • the computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
  • Computer instructions can be stored in a computer-readable storage medium or transmitted through a computer-readable storage medium.
  • Computer instructions can be sent from one website site, computer, server, or data center to another website site, computer via wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) , Server or data center for transmission.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center integrated with one or more available media.
  • the usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)).

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The present application provides an audio recording method for an unmanned aerial vehicle, comprising: in the case of audio recording by means of an audio recording device, determining a working state of an unmanned aerial vehicle, the working state comprising a flight state and a landing state; and adjusting the parameters of the audio recording device according to the working state of the unmanned aerial vehicle, and performing an audio recording operation according to the adjusted parameters of the audio recording device. In this way, the audio recording effect can be ensured no matter whether the unmanned aerial vehicle is in a flight state or in a landing state. The present application further provides an audio recording apparatus for an unmanned aerial vehicle, a chip, an unmanned aerial vehicle, an audio recording system for an unmanned aerial vehicle, a computer-readable storage medium and a computer program product containing instructions.

Description

无人飞行器录音方法、装置、芯片、无人飞行器、系统Unmanned aerial vehicle recording method, device, chip, unmanned aerial vehicle, system 技术领域Technical field
本申请涉及无人飞行器,尤其涉及一种无人飞行器录音的方法、无人飞行器录音的装置、芯片、无人飞行器、无人飞行器录音系统、计算机可读存储介质以及计算机程序产品。This application relates to unmanned aerial vehicles, in particular to an unmanned aerial vehicle recording method, an unmanned aerial vehicle recording device, a chip, an unmanned aerial vehicle, an unmanned aerial vehicle recording system, a computer-readable storage medium, and a computer program product.
背景技术Background technique
由于无人飞行器工作时存在极强的桨声,因此极少会配置录音功能,其拍摄的画面的音效往往依靠后期处理时再进行合成,而合成的音效会缺少临场感。而对于少数具有录音功能的无人飞行器,也只能录制单一的桨音,且由于无人飞行器工作时发出的桨声过大,还会存在过载问题,影响录制效果,且无法录制桨声以外的环境声音。Due to the strong paddle sound when the UAV is working, it is rarely equipped with a recording function. The sound effects of the pictures taken are often synthesized during post-processing, and the synthesized sound effects will lack a sense of presence. For a few unmanned aerial vehicles with recording function, only a single propeller sound can be recorded, and because the propeller sound emitted by the unmanned aerial vehicle is too loud, there will be overload problems, which affect the recording effect, and it is impossible to record other than the propeller sound. Environmental sound.
发明内容Summary of the invention
本申请实施例提供一种无人飞行器录音的方法、无人飞行器录音的装置、芯片、无人飞行器以及无人飞行器录音系统。The embodiments of the present application provide a recording method of an unmanned aerial vehicle, an unmanned aerial vehicle recording device, a chip, an unmanned aerial vehicle, and an unmanned aerial vehicle recording system.
第一方面,本申请实施例提供一种无人飞行器录音的方法,包括:In the first aspect, an embodiment of the present application provides a recording method for an unmanned aerial vehicle, including:
在通过录音设备进行录音的情况下,确定无人飞行器的工作状态;所述工作状态包括飞行状态和落地状态;In the case of recording through a recording device, determine the working state of the unmanned aerial vehicle; the working state includes the flight state and the landing state;
根据所述无人飞行器的工作状态调整所述录音设备的参数;Adjusting the parameters of the recording device according to the working state of the unmanned aerial vehicle;
根据调整后的所述录音设备的参数进行录音操作。Perform recording operations according to the adjusted parameters of the recording device.
第二方面,本申请实施例提供一种无人飞行器录音的装置,包括:In the second aspect, an embodiment of the present application provides a recording device for an unmanned aerial vehicle, including:
处理器;processor;
用于存储处理器可执行指令的存储器;A memory for storing processor executable instructions;
其中,所述处理器被配置为:Wherein, the processor is configured to:
在通过录音设备进行录音的情况下,确定无人飞行器的工作状态;所述工作状态包括飞行状态和落地状态;In the case of recording through a recording device, determine the working state of the unmanned aerial vehicle; the working state includes the flight state and the landing state;
根据所述无人飞行器的工作状态调整所述录音设备的参数;Adjusting the parameters of the recording device according to the working state of the unmanned aerial vehicle;
根据调整后的所述录音设备的参数进行录音操作。Perform recording operations according to the adjusted parameters of the recording device.
第三方面,本申请实施例提供一种芯片,安装在无人飞行器上,包括处理器和存储器,所述存储器用于存储指令,所述处理器调用所述存储器存储的指令用于实现以下操作:In a third aspect, an embodiment of the present application provides a chip installed on an unmanned aerial vehicle, including a processor and a memory, the memory is used to store instructions, and the processor calls the instructions stored in the memory to implement the following operations :
在通过录音设备进行录音的情况下,确定无人飞行器的工作状态;所述工作状态包括飞行状态和落地状态;In the case of recording through a recording device, determine the working state of the unmanned aerial vehicle; the working state includes the flight state and the landing state;
根据所述无人飞行器的工作状态调整所述录音设备的参数;Adjusting the parameters of the recording device according to the working state of the unmanned aerial vehicle;
根据调整后的所述录音设备的参数进行录音操作。Perform recording operations according to the adjusted parameters of the recording device.
第四方面,本申请实施例提供一种无人飞行器,所述无人飞行器上装有芯片和麦克风,所述芯片包括处理器和存储器,所述存储器用于存储指令,所述处理器调用所述存储器存储的指令用于实现以下操作:In a fourth aspect, an embodiment of the present application provides an unmanned aerial vehicle, the unmanned aerial vehicle is equipped with a chip and a microphone, the chip includes a processor and a memory, the memory is used to store instructions, and the processor calls the The instructions stored in the memory are used to implement the following operations:
在通过录音设备进行录音的情况下,确定无人飞行器的工作状态;所述工作状态包括飞行状态和落地状态;In the case of recording through a recording device, determine the working state of the unmanned aerial vehicle; the working state includes the flight state and the landing state;
根据所述无人飞行器的工作状态调整所述录音设备的参数;Adjusting the parameters of the recording device according to the working state of the unmanned aerial vehicle;
根据调整后的所述录音设备的参数进行录音操作。Perform recording operations according to the adjusted parameters of the recording device.
第五方面,本申请实施例提供一种无人飞行器录音系统,包括无人飞行器和指定应用,所述无人飞行器上装有芯片和麦克风,所述指定应用安装于电子设备,所述无人飞行器与所述电子设备通信连接,所述芯片包括处理器和存储器,所述存储器用于存储指令,所述处理器在响应所述应用的请求时,调用所述存储器存储的指令用于实现以下操作:In a fifth aspect, an embodiment of the present application provides an unmanned aerial vehicle recording system, including an unmanned aerial vehicle and a designated application, the unmanned aerial vehicle is equipped with a chip and a microphone, the designated application is installed in an electronic device, and the unmanned aerial vehicle In communication with the electronic device, the chip includes a processor and a memory, the memory is used to store instructions, and when the processor responds to a request of the application, the instructions stored in the memory are invoked to implement the following operations :
在通过录音设备进行录音的情况下,确定无人飞行器的工作状态;所述工作状态包括飞行状态和落地状态;In the case of recording through a recording device, determine the working state of the unmanned aerial vehicle; the working state includes the flight state and the landing state;
根据所述无人飞行器的工作状态调整所述录音设备的参数;Adjusting the parameters of the recording device according to the working state of the unmanned aerial vehicle;
根据调整后的所述录音设备的参数进行录音操作。Perform recording operations according to the adjusted parameters of the recording device.
第六方面,本申请提供一种计算机可读存储介质,包括指令,当其在计算机上运行时,使得所述计算机执行上述第一方面所述的方法。In a sixth aspect, the present application provides a computer-readable storage medium, including instructions, which when run on a computer, cause the computer to execute the method described in the first aspect.
第七方面,本申请提供一种包含指令的计算机程序产品,当所述指令在计算机上运行时,使得所述计算机执行上述第一方面所述的方法。In a seventh aspect, the present application provides a computer program product containing instructions that, when the instructions run on a computer, cause the computer to execute the method described in the first aspect.
本申请通过确定无人飞行器的工作状态为飞行状态或落地状态,根据无人飞行器的工作状态调整录音设备的参数进行录音,实现了无论无人飞行器在飞行状态或落地状态,都能确保音频的录制效果。This application determines whether the UAV's working status is in flight or on the ground, and adjusts the parameters of the recording device according to the working state of the UAV to record, so that the audio can be ensured regardless of whether the UAV is in flight or on the ground. Recording effect.
附图说明Description of the drawings
图1是本申请一示例性实施例示出的一种无人飞行器录音的方法流程图。Fig. 1 is a flowchart of a recording method for an unmanned aerial vehicle according to an exemplary embodiment of the present application.
图2是本申请一示例性实施例示出的无人飞行器处于飞行状态下和处于落地状态下调整录音设备的参数和处理所录制的音频信号的流程图。Fig. 2 is a flowchart of adjusting the parameters of the recording device and processing the recorded audio signal when the unmanned aerial vehicle is in the flying state and in the landing state according to an exemplary embodiment of the present application.
图3是本申请一示例性实施例示出的一种无人飞行器录音的装置。Fig. 3 is an unmanned aerial vehicle recording device shown in an exemplary embodiment of the present application.
图4是本申请一示例性实施例示出的一种芯片。Fig. 4 is a chip shown in an exemplary embodiment of the present application.
图5是本申请一示例性实施例示出的一种无人飞行器。Fig. 5 is an unmanned aerial vehicle shown in an exemplary embodiment of the present application.
图6是本申请一示例性实施例示出的一种无人飞行器录音系统。Fig. 6 is an unmanned aerial vehicle recording system shown in an exemplary embodiment of the present application.
具体实施方式detailed description
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.
针对无人飞行器没有录音功能,或者是具有录音功能的无人飞行器只能录制单一的桨声同时还存在过载的问题,本申请实施例首先提出一种无人飞行器录音的方法,可以是应用在安装于无人飞行器内部的计算机硬件上,例如可以是无人飞行器内部搭载的管理芯片,其中该无人飞行器还搭载了至少一套录音设备,由管理芯片控制录音设备的录音过程。或者该方法还可以应用在由终端设备或终端设备上的应用程序和无人飞行器上的管理芯片组成的系统中,例如可以由终端设备上的应用程序发出命令控制无人飞行器上的管理芯片,以实现对无人飞行器上的麦克风的录音过程的控制,其中终端设备可以是例如无人飞行器遥控器、手机终端、平板电脑、笔记本电脑、PC端等。Regarding the unmanned aerial vehicle without the recording function, or the unmanned aerial vehicle with the recording function can only record a single propeller sound and also has the problem of overload, the embodiment of the present application first proposes a recording method for the unmanned aerial vehicle, which can be applied in The computer hardware installed in the unmanned aerial vehicle may be, for example, a management chip mounted in the unmanned aerial vehicle. The unmanned aerial vehicle is also equipped with at least one recording device, and the management chip controls the recording process of the recording device. Or the method can also be applied to a system composed of terminal equipment or an application on the terminal device and a management chip on an unmanned aerial vehicle. For example, an application on the terminal device can issue a command to control the management chip on an unmanned aerial vehicle. In order to realize the control of the recording process of the microphone on the unmanned aerial vehicle, the terminal device may be, for example, an unmanned aerial vehicle remote control, a mobile phone terminal, a tablet computer, a notebook computer, a PC terminal, and the like.
图1是本申请一示例性实施例示出的一种无人飞行器录音的方法流程图,如图1所示,包括:Fig. 1 is a flow chart of a recording method for an unmanned aerial vehicle according to an exemplary embodiment of the present application. As shown in Fig. 1, the method includes:
S101,在通过录音设备进行录音的情况下,确定无人飞行器的工作状态;所述工作状态包括飞行状态和落地状态;S101: Determine the working state of the unmanned aerial vehicle in the case of recording through the recording device; the working state includes the flight state and the landing state;
S102,根据所述无人飞行器的工作状态调整所述录音设备的参数;S102: Adjust the parameters of the recording device according to the working state of the unmanned aerial vehicle;
S103,根据调整后的所述录音设备的参数进行录音操作。S103: Perform a recording operation according to the adjusted parameters of the recording device.
其中录音设备可以是麦克风、录音机或录音笔等,本申请对此不做限定,为方便描述,下文将以麦克风为例进行说明。The recording device may be a microphone, a voice recorder, or a voice recorder, etc., which is not limited in this application. For the convenience of description, a microphone will be used as an example for description below.
由于无人飞行器工作在不同的状态时,发出的声音大小也不一样,例如在飞行状态(运动或悬空状态时)下,发出的桨声极大,此时桨声的最大声压级可能大于麦克风的最大录音声压级,导致待录制的桨声存在过载的问题,例如在桨声的最大声压级为135db,而麦克风的最大录音声压级为128db时,待录制的桨声相对麦克风而言是过载的,此时麦克风所录制的音频信号会出现被削波的现象,导致其后续无法还原得到清晰完整的桨叶声。而在落地状态下,由于桨叶此时不再转动,主要录制的声音为环境中的人声,但由于麦克风与声源之间存在一定的距离,因此会导致待录制的人声过小,同时由于无人飞行器本身内部存在的电路噪声、机身振动噪声、风扇噪声等,将对本就过小的待录制人声造成干扰。因此对于无人飞行器在不同的工作状态进行录音时,需要对应调整麦克风的参数,以保证录音的质量,具体如何根据不同的场景调整麦克风的参数将在后面的实施例中展开介绍。Since the unmanned aerial vehicle works in different states, the sound level is different. For example, in the flight state (when in motion or suspended state), the sound of the propeller is extremely large. At this time, the maximum sound pressure level of the propeller sound may be greater than The maximum recording sound pressure level of the microphone causes the problem of overloading the propeller sound to be recorded. For example, when the maximum sound pressure level of the propeller sound is 135db and the maximum sound pressure level of the microphone is 128db, the propeller sound to be recorded is relative to the microphone In terms of overload, the audio signal recorded by the microphone will be clipped at this time, resulting in the subsequent failure to restore a clear and complete blade sound. In the landing state, since the blades are no longer rotating at this time, the main recorded sound is the human voice in the environment, but because there is a certain distance between the microphone and the sound source, the human voice to be recorded will be too small. At the same time, due to the internal circuit noise, fuselage vibration noise, fan noise, etc., the unmanned aerial vehicle itself will cause interference to the already too small human voice to be recorded. Therefore, when the unmanned aerial vehicle performs recording in different working states, the parameters of the microphone need to be adjusted accordingly to ensure the quality of the recording. How to adjust the parameters of the microphone according to different scenes will be introduced in the following embodiments.
需要注意的是,在S101中,考虑到录音可能会有录制单声道、双声道立体声或多声道立体声的不同要求,因此录制音频信号所采用的麦克风数量可以是一个也可以是多个,具体数量可以根据需求设定。且在设置多个麦克风的时候,可以对应不同的场景下,通过不同的麦克风进行录制,例如在录制单声道音频信号时,可以分别设置麦克风1、麦克风2,可以在无人飞行器处于飞行状态时,通过麦克风1进行录制;在无人飞行器处于落地状态时,通过麦克风2进行录制,其中,麦克风1和麦克风2可以是相同规格,也可以是不同的规格,本领域技术人员可以根据需求进行配置,当然,优选的,可以对应不同的录音场景分别配置适用该场景的麦克风进行录制,由此可以实现减少麦克风的参数的调整,例如在无人飞行器处于飞行状态时由于录制的桨声过大可以选择配置灵敏度较低的麦克风进行录制,相反的,在无人飞行器处于落地状态时由于录制的人声较小可以选择配置灵敏度较高的麦克风进行录制。It should be noted that in S101, considering that recording may have different requirements for recording mono, dual-channel stereo or multi-channel stereo, the number of microphones used to record audio signals can be one or multiple , The specific number can be set according to demand. And when setting multiple microphones, you can use different microphones to record in different scenarios. For example, when recording a mono audio signal, you can set microphone 1 and microphone 2 respectively, which can be used when the UAV is in flight. When the UAV is on the ground, use the microphone 2 to record. Among them, the microphone 1 and the microphone 2 can be of the same specification or different specifications. Those skilled in the art can perform according to their needs. Configuration, of course, preferably, you can configure a microphone suitable for the scene to record according to different recording scenes, thereby reducing the adjustment of the microphone parameters, for example, when the unmanned aerial vehicle is in flight, the sound of the recording is too loud. You can choose to configure a microphone with a lower sensitivity for recording. Conversely, when the UAV is on the ground, you can choose to configure a microphone with a higher sensitivity for recording because the recorded human voice is small.
在一个实施例中,可以是在开始录音前先确定无人飞行器的工作状态,根据所确定的无人飞行器的工作状态确定如何调整麦克风的参数,再开始录音;当然,还可以是在开始录音后,实时确定无人飞行器的工作状态,再根据无人飞行器的工作状态调整麦克风的参数进行录音。In one embodiment, the working state of the unmanned aerial vehicle may be determined before the recording is started, and how to adjust the microphone parameters is determined according to the determined working state of the unmanned aerial vehicle, and then the recording is started; of course, the recording may also be started. After that, the working status of the unmanned aerial vehicle is determined in real time, and then the parameters of the microphone are adjusted according to the working status of the unmanned aerial vehicle for recording.
为实现获取无人飞行器的工作状态,本申请实施例还提供了确定无人飞行器的工作状态的方法,下面将介绍几种可以实现确定无人飞行器工作状态的方法。In order to obtain the working state of the unmanned aerial vehicle, the embodiment of the present application also provides a method for determining the working state of the unmanned aerial vehicle. Several methods for determining the working state of the unmanned aerial vehicle will be introduced below.
在一个实施例中,可以根据接收到的无人飞行器的工作状态消息确定无人飞行器的工作状态,具体来说,可以通过接收无人飞行器内部的飞控模块发送的飞控状态消息来判断无人飞行器的工作状态。其中飞控模块用于实时采集各传感器测量的无人飞行器工作状态数据,以及接收用于遥控无人飞行器的终端设备传输的控制命令及数据,经计算处理,输出控制指令实现对无人飞行器中各种工作状态的控制,同时将无人飞行器的工作状态数据及发动机、机载电源系统等工作状态参数实时传送给遥控终端。In one embodiment, the operating status of the unmanned aerial vehicle can be determined based on the received operating status message of the unmanned aerial vehicle. Specifically, it can be judged by receiving the flight control status message sent by the flight control module inside the unmanned aerial vehicle. The working status of the human aircraft. Among them, the flight control module is used to collect the working status data of the unmanned aerial vehicle measured by the sensors in real time, and to receive the control commands and data transmitted by the terminal equipment used to remotely control the unmanned aerial vehicle. Various working conditions are controlled, and the working status data of the UAV and working status parameters such as the engine and the onboard power system are transmitted to the remote control terminal in real time.
在录制音频信号的情况下,可以与飞控模块建立实时通信,向飞控模块获取无人飞行器的实时工作状态,在接收到指示无人飞行器处于飞行状态的消息时确定无人飞行器为飞行状态;在接收到指示无人飞行器处于落地状态的消息时确定无人飞行器为落地状态。并在确定无人飞行器的工作状态消息后对应调整录制的音频信号的参数。当然,也可以是由飞控模块实时主动发送指示消息,可以在无人飞行器工作的过程中发送指示无人飞行器的实时工作状态的消息,进一步的,在无人飞行器的工作状态发生转换时,还可以发送指示无人飞行器工作状态转换的消息,例如可以在无人飞行器从飞行状态切换为落地状态时发送指示无人飞行器进入落地状态的消息,由此可以实现及时地根据无人飞行器的工作状态对应调整所录制的音频信号的参数,保证录制效果。In the case of recording audio signals, it can establish real-time communication with the flight control module, obtain the real-time working status of the unmanned aerial vehicle from the flight control module, and determine that the unmanned aerial vehicle is in the flying state when a message indicating that the unmanned aerial vehicle is in flight is received. ; When receiving a message indicating that the UAV is on the ground, it is determined that the UAV is on the ground. And after confirming the working status message of the unmanned aerial vehicle, correspondingly adjust the parameters of the recorded audio signal. Of course, the flight control module can also actively send an indication message in real time, and it can send a message indicating the real-time working status of the unmanned aerial vehicle during the working process of the unmanned aerial vehicle. Furthermore, when the working state of the unmanned aerial vehicle changes, It can also send a message indicating the transition of the unmanned aerial vehicle's working state. For example, it can send a message indicating that the unmanned aerial vehicle enters the landing state when the unmanned aerial vehicle is switched from the flying state to the landing state. The state correspondingly adjusts the parameters of the recorded audio signal to ensure the recording effect.
由于通过飞控模块获取无人飞行器时需要与飞控模块建立实时的通信,因此需要保证通信连接不中断,但无人飞行器在工作的过程中可能会出现通信信号不佳的问题,这将有可能导致获取无人飞行器的工作状态失败的问题,为避免与飞控模块之间耦合的限制,本申请实施例还提供其他的确定无人飞行器工作状态的方法。在一个实 施例中,可以通过分析所录制的音频信号的特征来确定无人飞行器的运动状态,例如,在录制音频信号的情况下,可以根据实时录制的音频信号的能量来判断无人飞行器的工作状态,由于无人飞行器在飞行状态时主要录制桨声,在落地状态时主要录制环境中的人声,而所录制的桨声与人声的音频信号之间的幅度存在极大的差异,且音频信号的幅度大小可以反映音频信号的能量大小,因此可以通过分析计算所录制的音频信号的能量来判断无人飞行器的工作状态。例如可以通过定义第一预设阈值,在录制的音频信号的能量大于第一预设阈值时,确定无人飞行器处于飞行状态;否则,确定无人飞行器处于落地状态。其中,第一预设阈值具体设置为何值,可以由本领域技术人员根据实际需求自行确定,本申请实施例不作限定。在定义第一预设阈值的基础上,当无人飞行器在进行工作状态的切换时,在实时分析所录制的音频信号的能量从小于第一预设阈值变化为大于第一预设阈值时,可以确定无人飞行器进入飞行状态;相反的,在录制的音频信号的能量从大于第一预设阈值变化为小于第一预设阈值时,确定无人飞行器进入落地状态。在一些情况下,考虑到可能存在短时的噪声干扰,也可以是在录制的音频信号的能量从小于第一预设阈值变化为大于第一预设阈值,且在一段时间内不出现反弹至小于第一预设阈值时,才确定无人飞行器进入飞行状态,对于确定无人飞行器进入落地状态也可以依此同理进行判断。Since it is necessary to establish real-time communication with the flight control module when acquiring the unmanned aerial vehicle through the flight control module, it is necessary to ensure that the communication connection is not interrupted, but the unmanned aerial vehicle may have a problem of poor communication signal during the working process, which will cause problems. This may lead to the problem of failure to obtain the operating status of the unmanned aerial vehicle. In order to avoid the limitation of coupling with the flight control module, the embodiments of the present application also provide other methods for determining the operating status of the unmanned aerial vehicle. In one embodiment, the motion state of the unmanned aerial vehicle can be determined by analyzing the characteristics of the recorded audio signal. For example, in the case of recording an audio signal, the energy of the audio signal recorded in real time can be used to determine the unmanned aerial vehicle's performance. In the working state, since the UAV mainly records the sound of the propeller when in flight, and mainly records the human voice in the environment when it is on the ground, there is a great difference in the amplitude between the recorded sound of the propeller and the audio signal of the human voice. Moreover, the amplitude of the audio signal can reflect the energy of the audio signal, so the working state of the UAV can be judged by analyzing and calculating the energy of the recorded audio signal. For example, by defining a first preset threshold, when the energy of the recorded audio signal is greater than the first preset threshold, it is determined that the unmanned aerial vehicle is in a flying state; otherwise, it is determined that the unmanned aerial vehicle is in a landing state. Wherein, the specific value of the first preset threshold can be determined by those skilled in the art according to actual needs, which is not limited in the embodiment of the present application. Based on the definition of the first preset threshold, when the UAV is switching the working state, when the energy of the recorded audio signal changes from less than the first preset threshold to greater than the first preset threshold in real-time analysis, It can be determined that the unmanned aerial vehicle has entered the flying state; on the contrary, when the energy of the recorded audio signal changes from greater than the first preset threshold to less than the first preset threshold, it is determined that the unmanned aerial vehicle has entered the landing state. In some cases, taking into account that there may be short-term noise interference, it can also be that the energy of the recorded audio signal changes from less than the first preset threshold to greater than the first preset threshold, and there is no rebound within a period of time. When it is less than the first preset threshold, it is determined that the unmanned aerial vehicle enters the flying state, and the determination that the unmanned aerial vehicle enters the landing state can also be judged based on the same principle.
由于依靠分析所录制的音频信号的能量确定无人飞行器的工作状态时,有时候可能会存在噪声干扰的问题,导致误判无人飞行器在切换工作状态,因此本申请实施例还提供一种确定无人飞行器的工作状态的方法,在一个实施例中,还可以通过获取的无人飞行器的电机转速确定无人飞行器的工作状态,由于无人飞行器在飞行状态时桨叶高速转动,此时电机转速极大;而无人飞行器在落地状态时桨叶接近停止转动,此时电机转速较小,因此无人飞行器的电机转速也可以反映无人飞行器的工作状态,可以通过实时采集电机转速来进行判断。与上一实施例示出的方法类似,同样可以通过定义第二预设阈值,在电机转速大于第二预设阈值时,确定无人机处于飞行状态;否则,确定无人机处于落地状态。当无人飞行器在进行工作状态的切换时,在电机转速从小于第二预设阈值变化为大于第二预设阈值时,确定无人机进入飞行状态;相反的,在电机转速从大于第二预设阈值变化为小于第二预设阈值时,确定无人机进入落地状态。When the working state of the unmanned aerial vehicle is determined by analyzing the energy of the recorded audio signal, there may sometimes be a problem of noise interference, leading to misjudgment that the unmanned aerial vehicle is switching the working state. Therefore, the embodiment of the present application also provides a determination method. In an embodiment, the working state of the unmanned aerial vehicle can be determined by the obtained motor speed of the unmanned aerial vehicle. Since the unmanned aerial vehicle is in flight state, the blades of the unmanned aerial vehicle rotate at a high speed. The speed is extremely large; while the UAV is in the landing state, the blades are close to stop rotating, at this time the motor speed is small, so the motor speed of the UAV can also reflect the working status of the UAV, which can be done by collecting the motor speed in real time. judge. Similar to the method shown in the previous embodiment, the second preset threshold can also be defined to determine that the drone is in a flying state when the motor speed is greater than the second preset threshold; otherwise, it is determined that the drone is in a landing state. When the unmanned aerial vehicle is switching the working state, when the motor speed changes from less than the second preset threshold to greater than the second preset threshold, it is determined that the drone enters the flying state; on the contrary, when the motor speed changes from greater than the second preset threshold When the preset threshold value is changed to be less than the second preset threshold value, it is determined that the drone enters the landing state.
在一些可选的例子中,还可以通过检测所录制的音频信号的过零率、基音检测等方式确定无人飞行器的工作状态,在此不再一一进行列举。可以理解,在考虑更快获取判断结果的情况下,可以仅通过上述实施例所示出的一种方法确定无人飞行器的工作状态,在确保判断结果的准确度的情况下,可以选择上面所示出的两个或两个以上的方法进行自由组合来判断无人飞行器的工作状态,具体如何选择,本申请实施例不作限定。In some optional examples, the working status of the unmanned aerial vehicle can also be determined by detecting the zero-crossing rate of the recorded audio signal, pitch detection, etc., which will not be listed here. It can be understood that in consideration of obtaining the judgment result faster, the working state of the unmanned aerial vehicle can be determined by only one method shown in the above-mentioned embodiment. Under the condition of ensuring the accuracy of the judgment result, the above can be selected. The two or more methods shown can be freely combined to determine the working state of the unmanned aerial vehicle. The specific selection is not limited in the embodiment of the present application.
在确定无人飞行器的工作状态后,需要对应调整麦克风的参数以确保录制效果,例如可以是调整麦克风的增益参数、工作频率或频响等,具体如何调整可以根据无人飞行器的工作状态自由设定,本申请并不限制。下面将举出根据无人飞行器的工作状态调整麦克风的增益参数的例子。After determining the working state of the UAV, the parameters of the microphone need to be adjusted accordingly to ensure the recording effect. For example, the gain parameter, working frequency or frequency response of the microphone can be adjusted. The specific adjustment can be freely set according to the working state of the UAV. Certainly, this application is not limited. The following will cite an example of adjusting the gain parameter of the microphone according to the working state of the unmanned aerial vehicle.
以搭载模拟麦克风的无人飞行器为例,无人飞行器在飞行状态时所录制的桨声 过大,在落地状态时所录制的环境人声过小,因此可以对应调整无人飞行器在不同工作状态下模拟麦克风的模拟增益。模拟增益可以理解为是模拟麦克风中的前置电路对所录制的音频信号进行放大的倍数,由于模拟麦克风在将声信号转换成电信号(音频信号)时得到的电信号较微弱,需要通过前置电路进一步地放大后才能进行后续的传输和处理,因此通过调整模拟增益可以调整对所录制的音频信号的放大程度,避免继续沿用原来的模拟增益可能导致放大后的音频信号被削波。Take an unmanned aerial vehicle equipped with an analog microphone as an example. The unmanned aerial vehicle’s propeller sound is too loud when it is in flight, and the ambient human voice recorded when it is on the ground is too small, so you can adjust the unmanned aerial vehicle in different working states accordingly. The analog gain of the analog microphone. The analog gain can be understood as the multiple that the front circuit in the analog microphone amplifies the recorded audio signal. Since the analog microphone converts the acoustic signal into an electrical signal (audio signal), the electrical signal obtained is relatively weak, and it needs to pass the front The subsequent transmission and processing can only be carried out after the built-in circuit is further amplified. Therefore, the degree of amplification of the recorded audio signal can be adjusted by adjusting the analog gain, so as to avoid continuing to use the original analog gain, which may cause the amplified audio signal to be clipped.
具体的,当无人飞行器在飞行状态时,可以调低模拟麦克风的模拟增益,以避免对所录制的音频信号放大过度,将放大后的音频信号控制在第一指定范围内;同理,当无人飞行器在落地状态时,可以调高模拟麦克风的模拟增益,以提高对所录制的音频信号的放大程度,将放大后的音频信号控制在第二指定范围内。其中,第一指定范围和第二指定范围的最大值均小于削波点,该削波点可以理解为音频信号不会被削波的最大值。另外,第一指定范围和第二指定范围可以是相同的范围,也可以是不同的范围,具体可以由本领域技术人员根据实际需求进行设置,本申请实施例不做限定。Specifically, when the unmanned aerial vehicle is in flight, the analog gain of the analog microphone can be lowered to avoid over-amplification of the recorded audio signal, and the amplified audio signal is controlled within the first specified range; similarly, when When the UAV is on the ground, the analog gain of the analog microphone can be increased to increase the degree of amplification of the recorded audio signal, and the amplified audio signal can be controlled within the second specified range. Wherein, the maximum value of the first specified range and the second specified range are both smaller than the clipping point, and the clipping point can be understood as the maximum value at which the audio signal will not be clipped. In addition, the first designated range and the second designated range may be the same range or different ranges, and can be specifically set by those skilled in the art according to actual needs, which are not limited in the embodiment of the present application.
当然,在一些可选的例子中,对于搭载数字麦克风的无人飞行器,同样可以是调整数字麦克风的数字增益来控制所录制的音频信号的放大倍数,其与调整模拟增益的方法类似,在此不再展开介绍。Of course, in some optional examples, for UAVs equipped with digital microphones, the digital gain of the digital microphone can also be adjusted to control the amplification of the recorded audio signal, which is similar to the method of adjusting the analog gain. No further introduction.
由于无人飞行器在飞行状态时录制的是桨声,为了使得录制的桨声更加生动,可以录制立体声音效,具体可以是根据实际需求,设置两个或两个以上的麦克风进行录制,对于录制得到的立体声音频信号,可以采用基于相位的立体声增强方法,主要通过对所录制的音频信号的相位谱进行调整,以实现压缩噪声,增强录制的立体声效果。或者还可以是采用基于能量的立体声增强方法,通过对所录制的音频信号的能量进行调整,增强录制的立体声音效。Since the unmanned aerial vehicle records the sound of the oars in flight, in order to make the recorded oars more vivid, stereo sound effects can be recorded. Specifically, two or more microphones can be set to record according to actual needs. For the stereo audio signal, you can use a phase-based stereo enhancement method, mainly by adjusting the phase spectrum of the recorded audio signal to achieve compression noise and enhance the stereo effect of the recording. Alternatively, an energy-based stereo enhancement method can be adopted to enhance the recorded stereo sound effect by adjusting the energy of the recorded audio signal.
对于无人飞行器录制的音频信号,其并非只有单一频率的声波,而是由各种频率的声波叠加而成,因此还可以通过均衡处理调节不同频率的信号的强度。具体的可以通过均衡器分离不同频率的信号,并采取不同程度的放大或缩小,从而改变声音的效果。其中,采用的均衡器可以是处理模拟信号的均衡器,也可以是处理数字信号的均衡器。例如在无人飞行器处于飞行状态时,对于录制所得且经由前置电路放大后的音频信号,可以考虑采用均衡器在确保不同频率的信号之间的均衡的同时,适当的对不同频率的信号进行缩小,也即是减小其幅度,以保证录制的效果。For the audio signal recorded by the UAV, it is not only a sound wave of a single frequency, but a superposition of sound waves of various frequencies, so the intensity of signals of different frequencies can also be adjusted through equalization processing. Specifically, signals of different frequencies can be separated by an equalizer, and different degrees of amplification or reduction can be adopted to change the sound effect. Among them, the equalizer used may be an equalizer for processing analog signals, or an equalizer for processing digital signals. For example, when the unmanned aerial vehicle is in flight, for the audio signal that is recorded and amplified by the pre-circuit, you can consider using an equalizer to ensure the equalization between the signals of different frequencies, and appropriately perform the processing on the signals of different frequencies. Shrink, that is, reduce its amplitude to ensure the effect of recording.
而无人飞行器在落地状态录制的是环境中的人声,由于录制环境中的人声存在音频信号过小的问题,此时无人飞行器内部的电路噪声、机身振动噪声、风扇噪声等将会对录制效果造成很大影响,因此需要对录制的音频信号进行人声增强处理和降噪处理。对于音频信号的人声增强处理,可以采用与上述立体声增强处理类似的方法,而对于音频信号的降噪处理,可以采用维纳滤波实现降噪,或者也可以通过AI算法智能识别场景进行降噪,以修正录制的音频信号的波形。另外,由于麦克风上通常装有声阻材料以防止录制的声音过大损坏麦克风,而声阻材料主要是用于抑制高频的信号,因此在录制环境中的人声时,为避免录制的声音太小,可以通过均衡器对高频信号进行放大,也即是对其幅度进行增大。While the unmanned aerial vehicle is recording the human voice in the environment when it is on the ground, the audio signal in the recording environment is too small. At this time, the internal circuit noise of the unmanned aerial vehicle, the vibration noise of the fuselage, and the fan noise will be affected. It will have a great impact on the recording effect, so it is necessary to perform vocal enhancement processing and noise reduction processing on the recorded audio signal. For the human voice enhancement processing of the audio signal, a method similar to the above stereo enhancement processing can be used, and for the noise reduction processing of the audio signal, the Wiener filter can be used to achieve noise reduction, or the AI algorithm can intelligently identify the scene for noise reduction To correct the waveform of the recorded audio signal. In addition, because the microphone is usually equipped with acoustic resistance material to prevent the recorded sound from damaging the microphone, and the acoustic resistance material is mainly used to suppress high-frequency signals, so when recording the human voice in the environment, in order to avoid recording the sound too much Small, the high-frequency signal can be amplified by the equalizer, that is, its amplitude can be increased.
可以理解,上述实施例中为调整麦克风的参数以及对所录制的音频信号处理只是示例性的,本领域技术人员可以根据需求对选择更多的麦克风参数进行调整和对所录制的音频信号的处理,本申请不再一一列举,另外,对于调整麦克风的参数以及对所录制的音频信号处理,可以是由无人飞行器内置的管理芯片在确定无人飞行器的工作状态后,根据预存的对应该工作状态下的处理算法自动执行,其中处理算法可以是采用上述一个或多个实施例示出的方法对麦克风进行参数调整和对所录制的音频信号进行处理,无人飞行器不同的工作状态可以对应有不同的处理算法。当然也可以是由用户自行决定采用哪种算法对音频信号进行处理。下面以图2说明在无人飞行器处于飞行状态下和处于落地状态下调整麦克风参数和处理所录制的音频信号的流程图。It can be understood that the adjustment of microphone parameters and the processing of recorded audio signals in the above embodiments are only exemplary, and those skilled in the art can select more microphone parameters to adjust and process the recorded audio signals according to their needs. This application will not enumerate one by one. In addition, for adjusting the microphone parameters and processing the recorded audio signal, the built-in management chip of the unmanned aerial vehicle can determine the working state of the unmanned aerial vehicle according to the pre-stored corresponding The processing algorithm in the working state is automatically executed, where the processing algorithm can be the method shown in one or more of the above embodiments to adjust the microphone parameters and process the recorded audio signal. The different working states of the UAV can correspond to Different processing algorithms. Of course, it is also possible for the user to decide which algorithm to use to process the audio signal. The following uses FIG. 2 to illustrate the flow chart of adjusting microphone parameters and processing the recorded audio signal when the UAV is in flight and in the landing state.
如图2所示,包括以下步骤:As shown in Figure 2, it includes the following steps:
S201,确定无人飞行器的工作状态;在确定无人飞行器处于飞行状态时执行S202到S204,在确定无人飞行器处于落地状态时执行S205到S207;S201: Determine the working state of the unmanned aerial vehicle; execute S202 to S204 when it is determined that the unmanned aerial vehicle is in the flying state, and execute S205 to S207 when it is determined that the unmanned aerial vehicle is in the landing state;
S202,调低模拟增益;S202, lower the analog gain;
S203,立体声增强处理;S203, stereo enhancement processing;
S204,均衡处理;S204, equalization processing;
S205,调高模拟增益;S205, increase the analog gain;
S206,降噪处理和人声增强处理;S206, noise reduction processing and vocal enhancement processing;
S207,均衡处理。S207, equalizing processing.
其中,对于如何确定无人飞行器的工作状态,以及各处理的具体过程可以参照前面实施例的介绍,在此不再展开介绍。Among them, how to determine the working status of the unmanned aerial vehicle and the specific process of each processing can refer to the introduction of the previous embodiment, and the introduction is not repeated here.
本申请还提供一种无人飞行器录音的装置,图3是本申请一示例性实施例示出的一种无人飞行器录音的装置,如图3所示,装置30包括处理器301,用于存储处理器可执行指令的存储器302,内部总线304和网络接口303;The present application also provides an unmanned aerial vehicle recording device. FIG. 3 is an unmanned aerial vehicle recording device shown in an exemplary embodiment of the present application. As shown in FIG. 3, the device 30 includes a processor 301 for storing Processor executable instructions memory 302, internal bus 304 and network interface 303;
其中,处理器301被配置为在通过录音设备进行录音的情况下,确定无人飞行器的工作状态,所述工作状态包括飞行状态和落地状态;Wherein, the processor 301 is configured to determine the working state of the unmanned aerial vehicle in the case of recording through the recording device, and the working state includes the flight state and the landing state;
根据所述无人飞行器的工作状态调整所述录音设备的参数;Adjusting the parameters of the recording device according to the working state of the unmanned aerial vehicle;
根据调整后的所述录音设备的参数进行录音操作。Perform recording operations according to the adjusted parameters of the recording device.
本申请提供的录音装置涉及的具体实现过程可以参考上文方法实施例的描述,在此不再赘述。For the specific implementation process involved in the recording device provided in the present application, reference may be made to the description of the above method embodiment, which will not be repeated here.
本申请还提供一种芯片,集成在无人飞行器上,图4是本申请一示例性实施例示出的一种芯片,如图4所示,芯片40包括处理器401和存储器402,存储器402用于存储指令,处理器401调用存储器402存储的指令用于实现以下操作:在通过录音设备进行录音的情况下,确定无人飞行器的工作状态,所述工作状态包括飞行状态和落地状态;The present application also provides a chip integrated on an unmanned aerial vehicle. FIG. 4 is a chip shown in an exemplary embodiment of the present application. As shown in FIG. 4, the chip 40 includes a processor 401 and a memory 402, and the memory 402 is used for To store instructions, the processor 401 calls the instructions stored in the memory 402 to implement the following operations: in the case of recording through a recording device, determine the working state of the unmanned aerial vehicle, the working state including the flight state and the landing state;
根据所述无人飞行器的工作状态调整所述录音设备的参数;Adjusting the parameters of the recording device according to the working state of the unmanned aerial vehicle;
根据调整后的所述录音设备的参数进行录音操作。Perform recording operations according to the adjusted parameters of the recording device.
本申请提供的芯片涉及的具体实现过程可以参考上文方法实施例的描述,在此不再赘述。For the specific implementation process involved in the chip provided in this application, reference may be made to the description of the above method embodiment, and details are not described herein again.
本申请还提供一种无人飞行器,图5是本申请一示例性实施例示出的一种无人飞行器,如图5所示,无人飞行器50包括芯片40和录音设备501,芯片40包括处理器401和存储器402,存储器402用于存储指令,处理器401调用存储器402存储的指令用于实现以下操作:在通过录音设备501进行录音的情况下,确定无人飞行器50的工作状态,所述工作状态包括飞行状态和落地状态;The present application also provides an unmanned aerial vehicle. FIG. 5 is an unmanned aerial vehicle shown in an exemplary embodiment of the present application. As shown in FIG. 5, the unmanned aerial vehicle 50 includes a chip 40 and a recording device 501. The chip 40 includes processing The processor 401 and the memory 402. The memory 402 is used to store instructions. The processor 401 calls the instructions stored in the memory 402 to implement the following operations: in the case of recording through the recording device 501, the operating state of the UAV 50 is determined. Working status includes flight status and landing status;
根据无人飞行器50的工作状态调整录音设备501的参数;Adjust the parameters of the recording device 501 according to the working state of the unmanned aerial vehicle 50;
根据调整后的所述录音设备501的参数进行录音操作。The recording operation is performed according to the adjusted parameters of the recording device 501.
本申请提供的无人飞行器涉及的具体实现过程可以参考上文方法实施例的描述,在此不再赘述。For the specific implementation process related to the unmanned aerial vehicle provided in the present application, reference may be made to the description of the above method embodiment, which will not be repeated here.
本申请还提供一种无人飞行器录音系统,图6是本申请一示例性实施例示出的一种无人飞行器录音系统,如图6所示,无人飞行器录音系统包括图5所示的无人飞行器50和指定应用601,指定应用601安装于电子设备60上,其中,处理器401在响应指定应用601的请求时,调用存储器402存储的指令用于实现以下操作:This application also provides an unmanned aerial vehicle recording system. FIG. 6 is an unmanned aerial vehicle recording system shown in an exemplary embodiment of this application. As shown in FIG. 6, the unmanned aerial vehicle recording system includes the unmanned aerial vehicle recording system shown in FIG. The human aircraft 50 and the designated application 601. The designated application 601 is installed on the electronic device 60. The processor 401, in response to the request of the designated application 601, calls the instructions stored in the memory 402 to implement the following operations:
在通过录音设备501进行录音的情况下,确定无人飞行器50的工作状态,所述工作状态包括飞行状态和落地状态;In the case of recording through the recording device 501, determine the working state of the unmanned aerial vehicle 50, the working state including the flight state and the landing state;
根据无人飞行器50的工作状态调整录音设备501的参数;Adjust the parameters of the recording device 501 according to the working state of the unmanned aerial vehicle 50;
根据调整后的所述录音设备501的参数进行录音操作。The recording operation is performed according to the adjusted parameters of the recording device 501.
本申请提供的无人飞行器录音系统涉及的具体实现过程可以参考上文方法实施例的描述,在此不再赘述。For the specific implementation process involved in the unmanned aerial vehicle recording system provided in the present application, reference may be made to the description of the above method embodiment, which will not be repeated here.
对于装置实施例而言,由于其基本对应于方法实施例,所以相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。As for the device embodiment, since it basically corresponds to the method embodiment, the relevant part can refer to the part of the description of the method embodiment. The device embodiments described above are merely illustrative, where the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the objectives of the solutions of the embodiments. Those of ordinary skill in the art can understand and implement without creative work.
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行计算机程序指令时,全部或部分地产生按照本申请实施例的流程或功能。计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。计算机指令可以存储在计算机可读存储介质中,或者通过计算机可读存储介质进行传输。计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中 心进行传输。计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如,固态硬盘(solid state disk,SSD))等。In the foregoing embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented by software, it can be implemented in the form of a computer program product in whole or in part. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. Computer instructions can be stored in a computer-readable storage medium or transmitted through a computer-readable storage medium. Computer instructions can be sent from one website site, computer, server, or data center to another website site, computer via wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) , Server or data center for transmission. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center integrated with one or more available media. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)).
需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply one of these entities or operations. There is any such actual relationship or order between. The terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements that are not explicitly listed. Elements, or also include elements inherent to such processes, methods, articles, or equipment. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or equipment that includes the element.
以上对本申请实施例所提供的方法和装置进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。The methods and devices provided by the embodiments of the application are described in detail above. Specific examples are used in this article to illustrate the principles and implementations of the application. The descriptions of the above embodiments are only used to help understand the methods and methods of the application. Core idea; At the same time, for those of ordinary skill in the art, according to the idea of this application, there will be changes in the specific implementation and scope of application. In summary, the content of this specification should not be construed as a limitation to this application .

Claims (67)

  1. 一种无人飞行器录音的方法,其特征在于,包括:An unmanned aerial vehicle recording method, characterized in that it comprises:
    在通过录音设备进行录音的情况下,确定无人飞行器的工作状态;所述工作状态包括飞行状态和落地状态;In the case of recording through a recording device, determine the working state of the unmanned aerial vehicle; the working state includes the flight state and the landing state;
    根据所述无人飞行器的工作状态调整所述录音设备的参数;Adjusting the parameters of the recording device according to the working state of the unmanned aerial vehicle;
    根据调整后的所述录音设备的参数进行录音操作。Perform recording operations according to the adjusted parameters of the recording device.
  2. 根据权利要求1所述的方法,其特征在于,所述确定无人飞行器的工作状态包括:The method according to claim 1, wherein the determining the working status of the unmanned aerial vehicle comprises:
    根据接收到的无人飞行器的工作状态消息确定无人飞行器的工作状态;和/或Determine the working status of the unmanned aerial vehicle according to the received working status message of the unmanned aerial vehicle; and/or
    分析所录制的音频信号的特征以确定无人飞行器的工作状态;和/或Analyze the characteristics of the recorded audio signal to determine the operating status of the UAV; and/or
    根据所获取的无人飞行器的电机转速确定无人飞行器的工作状态。Determine the working state of the unmanned aerial vehicle according to the obtained motor speed of the unmanned aerial vehicle.
  3. 根据权利要求2所述的方法,其特征在于,所述工作状态消息包括指示无人飞行器处于飞行状态的消息和指示无人飞行器处于落地状态的消息。The method according to claim 2, wherein the working status message includes a message indicating that the unmanned aerial vehicle is in a flying state and a message indicating that the unmanned aerial vehicle is in a landing state.
  4. 根据权利要求2所述的方法,其特征在于,所述音频信号的特征包括所述音频信号的能量;The method according to claim 2, wherein the characteristics of the audio signal include the energy of the audio signal;
    所述确定无人飞行器的工作状态包括:The determining the working status of the unmanned aerial vehicle includes:
    在所述音频信号的能量大于第一预设阈值时,确定无人飞行器处于飞行状态;否则,确定无人飞行器处于落地状态。When the energy of the audio signal is greater than the first preset threshold, it is determined that the unmanned aerial vehicle is in a flying state; otherwise, it is determined that the unmanned aerial vehicle is in a landing state.
  5. 根据权利要求4所述的方法,其特征在于,所述确定无人飞行器的工作状态还包括:The method according to claim 4, wherein said determining the working status of the unmanned aerial vehicle further comprises:
    在所述音频信号的能量从小于所述第一预设阈值变化为大于所述第一预设阈值时,确定无人飞行器进入飞行状态;When the energy of the audio signal changes from less than the first preset threshold to greater than the first preset threshold, determining that the unmanned aerial vehicle enters a flight state;
    在所述音频信号的能量从大于所述第一预设阈值变化为小于所述第一预设阈值时,确定无人飞行器进入落地状态。When the energy of the audio signal changes from greater than the first preset threshold to less than the first preset threshold, it is determined that the unmanned aerial vehicle enters the landing state.
  6. 根据权利要求2所述的方法,其特征在于,所述根据所获取的无人飞行器的电机转速确定无人飞行器的工作状态包括:The method according to claim 2, wherein the determining the operating state of the unmanned aerial vehicle according to the obtained motor speed of the unmanned aerial vehicle comprises:
    在所述电机转速大于第二预设阈值时,确定无人飞行器处于飞行状态;否则,确定无人飞行器处于落地状态。When the motor speed is greater than the second preset threshold, it is determined that the unmanned aerial vehicle is in a flying state; otherwise, it is determined that the unmanned aerial vehicle is in a landing state.
  7. 根据权利要求6所述的方法,其特征在于,所述根据所获取的无人飞行器的电机转速确定无人飞行器的工作状态还包括:The method according to claim 6, wherein the determining the working state of the unmanned aerial vehicle according to the obtained motor speed of the unmanned aerial vehicle further comprises:
    在所述电机转速从小于所述第二预设阈值变化为大于所述第二预设阈值时,确定无人飞行器进入飞行状态;When the rotation speed of the motor changes from less than the second preset threshold to greater than the second preset threshold, determining that the unmanned aerial vehicle enters a flying state;
    在所述电机转速从大于所述第二预设阈值变化为小于所述第二预设阈值时,确定无人飞行器进入落地状态。When the rotation speed of the motor changes from greater than the second preset threshold to less than the second preset threshold, it is determined that the unmanned aerial vehicle enters the landing state.
  8. 根据权利要求1所述的方法,其特征在于,所述录音设备的参数包括:The method according to claim 1, wherein the parameters of the recording device include:
    所述录音设备的模拟增益。The analog gain of the recording device.
  9. 根据权利要求8所述的方法,其特征在于,所述调整所述录音设备的参数包括:The method according to claim 8, wherein the adjusting the parameters of the recording device comprises:
    在所述无人飞行器处于飞行状态时,调整所述录音设备的模拟增益以将所录制的音频信号控制在第一指定范围内;When the unmanned aerial vehicle is in flight, adjusting the analog gain of the recording device to control the recorded audio signal within a first specified range;
    在所述无人飞行器处于落地状态时,调整所述录音设备的模拟增益以将所录制的 音频信号控制在第二指定范围内。When the unmanned aerial vehicle is in the landing state, the analog gain of the recording device is adjusted to control the recorded audio signal within the second specified range.
  10. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method according to claim 1, wherein the method further comprises:
    在录制的音频信号为立体声音频信号时,增强所录制的立体声音频信号。When the recorded audio signal is a stereo audio signal, enhance the recorded stereo audio signal.
  11. 根据权利要求10所述的方法,其特征在于,所述增强所录制的立体声音频信号包括:The method according to claim 10, wherein said enhancing the recorded stereo audio signal comprises:
    基于相位增强所述立体声音频信号;或Enhancing the stereo audio signal based on phase; or
    基于能量增强所述立体声音频信号。The stereo audio signal is enhanced based on energy.
  12. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method according to claim 1, wherein the method further comprises:
    在录制的音频信号为人声音频信号时,对所录制的人声音频信号进行增强人声处理和降噪处理。When the recorded audio signal is a human voice audio signal, the recorded human voice audio signal is processed to enhance human voice and reduce noise.
  13. 根据权利要求1所述的方法,其特征在于,所述录音设备为麦克风。The method according to claim 1, wherein the recording device is a microphone.
  14. 一种无人飞行器录音的装置,其特征在于,包括:An unmanned aerial vehicle recording device, characterized in that it comprises:
    处理器;processor;
    用于存储处理器可执行指令的存储器;A memory for storing processor executable instructions;
    其中,所述处理器被配置为:Wherein, the processor is configured to:
    在通过录音设备进行录音的情况下,确定无人飞行器的工作状态;所述工作状态包括飞行状态和落地状态;In the case of recording through a recording device, determine the working state of the unmanned aerial vehicle; the working state includes the flight state and the landing state;
    根据所述无人飞行器的工作状态调整所述录音设备的参数;Adjusting the parameters of the recording device according to the working state of the unmanned aerial vehicle;
    根据调整后的所述录音设备的参数进行录音操作。Perform recording operations according to the adjusted parameters of the recording device.
  15. 根据权利要求14所述的装置,其特征在于,所述处理器被配置为:The device according to claim 14, wherein the processor is configured to:
    根据接收到的无人飞行器的工作状态消息确定无人飞行器的工作状态;和/或Determine the working status of the unmanned aerial vehicle according to the received working status message of the unmanned aerial vehicle; and/or
    分析所录制的音频信号的特征以确定无人飞行器的工作状态;和/或Analyze the characteristics of the recorded audio signal to determine the operating status of the UAV; and/or
    根据所获取的无人飞行器的电机转速确定无人飞行器的工作状态。Determine the working state of the unmanned aerial vehicle according to the obtained motor speed of the unmanned aerial vehicle.
  16. 根据权利要求15所述的装置,其特征在于,所述工作状态消息包括指示无人飞行器处于飞行状态的消息和指示无人飞行器处于落地状态的消息。The apparatus according to claim 15, wherein the working status message includes a message indicating that the unmanned aerial vehicle is in a flying state and a message indicating that the unmanned aerial vehicle is in a landing state.
  17. 根据权利要求15所述的装置,其特征在于,所述音频信号的特征包括所述音频信号的能量;The device according to claim 15, wherein the feature of the audio signal includes the energy of the audio signal;
    所述处理器被配置为:The processor is configured to:
    在所述音频信号的能量大于第一预设阈值时,确定无人飞行器处于飞行状态;否则,确定无人飞行器处于落地状态。When the energy of the audio signal is greater than the first preset threshold, it is determined that the unmanned aerial vehicle is in a flying state; otherwise, it is determined that the unmanned aerial vehicle is in a landing state.
  18. 根据权利要求17所述的装置,其特征在于,所述处理器被配置为:The device according to claim 17, wherein the processor is configured to:
    在所述音频信号的能量从小于所述第一预设阈值变化为大于所述第一预设阈值时,确定无人飞行器进入飞行状态;When the energy of the audio signal changes from less than the first preset threshold to greater than the first preset threshold, determining that the unmanned aerial vehicle enters a flight state;
    在所述音频信号的能量从大于所述第一预设阈值变化为小于所述第一预设阈值时,确定无人飞行器进入落地状态。When the energy of the audio signal changes from greater than the first preset threshold to less than the first preset threshold, it is determined that the unmanned aerial vehicle enters the landing state.
  19. 根据权利要求15所述的装置,其特征在于,所述处理器被配置为:The device according to claim 15, wherein the processor is configured to:
    在所述电机转速大于第二预设阈值时,确定无人飞行器处于飞行状态;否则,确定无人飞行器处于落地状态。When the motor speed is greater than the second preset threshold, it is determined that the unmanned aerial vehicle is in a flying state; otherwise, it is determined that the unmanned aerial vehicle is in a landing state.
  20. 根据权利要求19所述的装置,其特征在于,所述处理器被配置为:The device of claim 19, wherein the processor is configured to:
    在所述电机转速从小于所述第二预设阈值变化为大于所述第二预设阈值时,确定 无人飞行器进入飞行状态;When the rotation speed of the motor changes from less than the second preset threshold to greater than the second preset threshold, determining that the unmanned aerial vehicle enters a flying state;
    在所述电机转速从大于所述第二预设阈值变化为小于所述第二预设阈值时,确定无人飞行器进入落地状态。When the rotation speed of the motor changes from greater than the second preset threshold to less than the second preset threshold, it is determined that the unmanned aerial vehicle enters the landing state.
  21. 根据权利要求14所述的装置,其特征在于,所述录音设备的参数包括:The apparatus according to claim 14, wherein the parameters of the recording device include:
    所述录音设备的模拟增益。The analog gain of the recording device.
  22. 根据权利要求21所述的装置,其特征在于,所述处理器被配置为:The device according to claim 21, wherein the processor is configured to:
    在所述无人飞行器处于飞行状态时,调整所述录音设备的模拟增益以将所录制的音频信号控制在第一指定范围内;When the unmanned aerial vehicle is in flight, adjusting the analog gain of the recording device to control the recorded audio signal within a first specified range;
    在所述无人飞行器处于落地状态时,调整所述录音设备的模拟增益以将所录制的音频信号控制在第二指定范围内。When the unmanned aerial vehicle is in a landing state, the analog gain of the recording device is adjusted to control the recorded audio signal within a second specified range.
  23. 根据权利要求14所述的装置,其特征在于,所述处理器被配置为:The device according to claim 14, wherein the processor is configured to:
    在录制的音频信号为立体声音频信号时,增强所录制的立体声音频信号。When the recorded audio signal is a stereo audio signal, enhance the recorded stereo audio signal.
  24. 根据权利要求23所述的装置,其特征在于,所述处理器被配置为:The device according to claim 23, wherein the processor is configured to:
    基于相位增强所述立体声音频信号;或Enhancing the stereo audio signal based on phase; or
    基于能量增强所述立体声音频信号。The stereo audio signal is enhanced based on energy.
  25. 根据权利要求14所述的装置,其特征在于,所述处理器被配置为:The device according to claim 14, wherein the processor is configured to:
    在录制的音频信号为人声音频信号时,对所录制的人声音频信号进行增强人声处理和降噪处理。When the recorded audio signal is a human voice audio signal, the recorded human voice audio signal is processed to enhance human voice and reduce noise.
  26. 根据权利要求14所述的装置,其特征在于,所述录音设备为麦克风。The apparatus according to claim 14, wherein the recording device is a microphone.
  27. 一种芯片,应用于无人飞行器上,其特征在于,包括处理器和存储器,所述存储器用于存储指令,所述处理器调用所述存储器存储的指令用于实现以下操作:A chip applied to an unmanned aerial vehicle, characterized by comprising a processor and a memory, the memory is used to store instructions, and the processor calls the instructions stored in the memory to implement the following operations:
    在通过录音设备进行录音的情况下,确定无人飞行器的工作状态;所述工作状态包括飞行状态和落地状态;In the case of recording through a recording device, determine the working state of the unmanned aerial vehicle; the working state includes the flight state and the landing state;
    根据所述无人飞行器的工作状态调整所述录音设备的参数;Adjusting the parameters of the recording device according to the working state of the unmanned aerial vehicle;
    根据调整后的所述录音设备的参数进行录音操作。Perform recording operations according to the adjusted parameters of the recording device.
  28. 根据权利要求27所述的芯片,其特征在于,所述处理器具体用于:The chip according to claim 27, wherein the processor is specifically configured to:
    根据接收到的无人飞行器的工作状态消息确定无人飞行器的工作状态;和/或Determine the working status of the unmanned aerial vehicle according to the received working status message of the unmanned aerial vehicle; and/or
    分析所录制的音频信号的特征以确定无人飞行器的工作状态;和/或Analyze the characteristics of the recorded audio signal to determine the operating status of the UAV; and/or
    根据所获取的无人飞行器的电机转速确定无人飞行器的工作状态。Determine the working state of the unmanned aerial vehicle according to the obtained motor speed of the unmanned aerial vehicle.
  29. 根据权利要求28所述的芯片,其特征在于,所述工作状态消息包括指示无人飞行器处于飞行状态的消息和指示无人飞行器处于落地状态的消息。The chip according to claim 28, wherein the working status message includes a message indicating that the unmanned aerial vehicle is in a flying state and a message indicating that the unmanned aerial vehicle is in a landing state.
  30. 根据权利要求28所述的芯片,其特征在于,所述音频信号的特征包括所述音频信号的能量;The chip according to claim 28, wherein the characteristics of the audio signal include energy of the audio signal;
    所述处理器具体用于:The processor is specifically used for:
    在所述音频信号的能量大于第一预设阈值时,确定无人飞行器处于飞行状态;否则,确定无人飞行器处于落地状态。When the energy of the audio signal is greater than the first preset threshold, it is determined that the unmanned aerial vehicle is in a flying state; otherwise, it is determined that the unmanned aerial vehicle is in a landing state.
  31. 根据权利要求30所述的芯片,其特征在于,所述处理器具体用于:The chip according to claim 30, wherein the processor is specifically configured to:
    在所述音频信号的能量从小于所述第一预设阈值变化为大于所述第一预设阈值时,确定无人飞行器进入飞行状态;When the energy of the audio signal changes from less than the first preset threshold to greater than the first preset threshold, determining that the unmanned aerial vehicle enters a flight state;
    在所述音频信号的能量从大于所述第一预设阈值变化为小于所述第一预设阈值 时,确定无人飞行器进入落地状态。When the energy of the audio signal changes from greater than the first preset threshold to less than the first preset threshold, it is determined that the unmanned aerial vehicle enters the landing state.
  32. 根据权利要求28所述的芯片,其特征在于,所述处理器具体用于:The chip according to claim 28, wherein the processor is specifically configured to:
    在所述电机转速大于第二预设阈值时,确定无人飞行器处于飞行状态;否则,确定无人飞行器处于落地状态。When the motor speed is greater than the second preset threshold, it is determined that the unmanned aerial vehicle is in a flying state; otherwise, it is determined that the unmanned aerial vehicle is in a landing state.
  33. 根据权利要求32所述的芯片,其特征在于,所述处理器具体用于:The chip according to claim 32, wherein the processor is specifically configured to:
    在所述电机转速从小于所述第二预设阈值变化为大于所述第二预设阈值时,确定无人飞行器进入飞行状态;When the motor speed changes from less than the second preset threshold to greater than the second preset threshold, determining that the unmanned aerial vehicle enters a flying state;
    在所述电机转速从大于所述第二预设阈值变化为小于所述第二预设阈值时,确定无人飞行器进入落地状态。When the rotation speed of the motor changes from greater than the second preset threshold to less than the second preset threshold, it is determined that the unmanned aerial vehicle enters the landing state.
  34. 根据权利要求27所述的芯片,其特征在于,所述录音设备的参数包括:The chip according to claim 27, wherein the parameters of the recording device include:
    所述录音设备的模拟增益。The analog gain of the recording device.
  35. 根据权利要求34所述的芯片,其特征在于,所述处理器具体用于:The chip according to claim 34, wherein the processor is specifically configured to:
    在所述无人飞行器处于飞行状态时,调整所述录音设备的模拟增益以将所录制的音频信号控制在第一指定范围内;When the unmanned aerial vehicle is in flight, adjusting the analog gain of the recording device to control the recorded audio signal within a first specified range;
    在所述无人飞行器处于落地状态时,调整所述录音设备的模拟增益以将所录制的音频信号控制在第二指定范围内。When the unmanned aerial vehicle is in a landing state, the analog gain of the recording device is adjusted to control the recorded audio signal within a second specified range.
  36. 根据权利要求27所述的芯片,其特征在于,所述处理器具体用于:The chip according to claim 27, wherein the processor is specifically configured to:
    在录制的音频信号为立体声音频信号时,增强所录制的立体声音频信号。When the recorded audio signal is a stereo audio signal, enhance the recorded stereo audio signal.
  37. 根据权利要求36所述的芯片,其特征在于,所述处理器具体用于:The chip according to claim 36, wherein the processor is specifically configured to:
    基于相位增强所述立体声音频信号;或Enhancing the stereo audio signal based on phase; or
    基于能量增强所述立体声音频信号。The stereo audio signal is enhanced based on energy.
  38. 根据权利要求27所述的芯片,其特征在于,所述处理器具体用于:The chip according to claim 27, wherein the processor is specifically configured to:
    在录制的音频信号为人声音频信号时,对所录制的人声音频信号进行增强人声处理和降噪处理。When the recorded audio signal is a human voice audio signal, the recorded human voice audio signal is processed to enhance human voice and reduce noise.
  39. 根据权利要求27所述的芯片,其特征在于,所述录音设备为麦克风。The chip according to claim 27, wherein the recording device is a microphone.
  40. 一种无人飞行器,其特征在于,所述无人飞行器上装有芯片和录音设备,所述芯片包括处理器和存储器,所述存储器用于存储指令,所述处理器调用所述存储器存储的指令用于实现以下操作:An unmanned aerial vehicle, characterized in that a chip and a recording device are mounted on the unmanned aerial vehicle, the chip includes a processor and a memory, the memory is used for storing instructions, and the processor calls the instructions stored in the memory Used to achieve the following operations:
    在通过录音设备进行录音的情况下,确定无人飞行器的工作状态;所述工作状态包括飞行状态和落地状态;In the case of recording through a recording device, determine the working state of the unmanned aerial vehicle; the working state includes the flight state and the landing state;
    根据所述无人飞行器的工作状态调整所述录音设备的参数;Adjusting the parameters of the recording device according to the working state of the unmanned aerial vehicle;
    根据调整后的所述录音设备的参数进行录音操作。Perform recording operations according to the adjusted parameters of the recording device.
  41. 根据权利要求40所述的无人飞行器,其特征在于,所述处理器具体用于:The unmanned aerial vehicle according to claim 40, wherein the processor is specifically configured to:
    根据接收到的无人飞行器的工作状态消息确定无人飞行器的工作状态;和/或Determine the working status of the unmanned aerial vehicle according to the received working status message of the unmanned aerial vehicle; and/or
    分析所录制的音频信号的特征以确定无人飞行器的工作状态;和/或Analyze the characteristics of the recorded audio signal to determine the operating status of the UAV; and/or
    根据所获取的无人飞行器的电机转速确定无人飞行器的工作状态。Determine the working state of the unmanned aerial vehicle according to the obtained motor speed of the unmanned aerial vehicle.
  42. 根据权利要求41所述的无人飞行器,其特征在于,所述工作状态消息包括指示无人飞行器处于飞行状态的消息和指示无人飞行器处于落地状态的消息。The unmanned aerial vehicle according to claim 41, wherein the working status message includes a message indicating that the unmanned aerial vehicle is in a flying state and a message indicating that the unmanned aerial vehicle is in a landing state.
  43. 根据权利要求41所述的无人飞行器,其特征在于,所述音频信号的特征包括所述音频信号的能量;The unmanned aerial vehicle of claim 41, wherein the feature of the audio signal includes the energy of the audio signal;
    所述处理器具体用于:The processor is specifically used for:
    在所述音频信号的能量大于第一预设阈值时,确定无人飞行器处于飞行状态;否则,确定无人飞行器处于落地状态。When the energy of the audio signal is greater than the first preset threshold, it is determined that the unmanned aerial vehicle is in a flying state; otherwise, it is determined that the unmanned aerial vehicle is in a landing state.
  44. 根据权利要求43所述的无人飞行器,其特征在于,所述处理器具体用于:The unmanned aerial vehicle according to claim 43, wherein the processor is specifically configured to:
    在所述音频信号的能量从小于所述第一预设阈值变化为大于所述第一预设阈值时,确定无人飞行器进入飞行状态;When the energy of the audio signal changes from less than the first preset threshold to greater than the first preset threshold, determining that the unmanned aerial vehicle enters a flight state;
    在所述音频信号的能量从大于所述第一预设阈值变化为小于所述第一预设阈值时,确定无人飞行器进入落地状态。When the energy of the audio signal changes from greater than the first preset threshold to less than the first preset threshold, it is determined that the unmanned aerial vehicle enters the landing state.
  45. 根据权利要求41所述的无人飞行器,其特征在于,所述处理器具体用于:The unmanned aerial vehicle according to claim 41, wherein the processor is specifically configured to:
    在所述电机转速大于第二预设阈值时,确定无人飞行器处于飞行状态;否则,确定无人飞行器处于落地状态。When the motor speed is greater than the second preset threshold, it is determined that the unmanned aerial vehicle is in a flying state; otherwise, it is determined that the unmanned aerial vehicle is in a landing state.
  46. 根据权利要求45所述的无人飞行器,其特征在于,所述处理器具体用于:The unmanned aerial vehicle according to claim 45, wherein the processor is specifically configured to:
    在所述电机转速从小于所述第二预设阈值变化为大于所述第二预设阈值时,确定无人飞行器进入飞行状态;When the motor speed changes from less than the second preset threshold to greater than the second preset threshold, determining that the unmanned aerial vehicle enters a flying state;
    在所述电机转速从大于所述第二预设阈值变化为小于所述第二预设阈值时,确定无人飞行器进入落地状态。When the rotation speed of the motor changes from greater than the second preset threshold to less than the second preset threshold, it is determined that the unmanned aerial vehicle enters the landing state.
  47. 根据权利要求40所述的无人飞行器,其特征在于,所述录音设备的参数包括:The unmanned aerial vehicle of claim 40, wherein the parameters of the recording device include:
    所述录音设备的模拟增益。The analog gain of the recording device.
  48. 根据权利要求47所述的无人飞行器,其特征在于,所述处理器具体用于:The unmanned aerial vehicle according to claim 47, wherein the processor is specifically configured to:
    在所述无人飞行器处于飞行状态时,调整所述录音设备的模拟增益以将所录制的音频信号控制在第一指定范围内;When the unmanned aerial vehicle is in flight, adjusting the analog gain of the recording device to control the recorded audio signal within a first specified range;
    在所述无人飞行器处于落地状态时,调整所述录音设备的模拟增益以将所录制的音频信号控制在第二指定范围内。When the unmanned aerial vehicle is in a landing state, the analog gain of the recording device is adjusted to control the recorded audio signal within a second specified range.
  49. 根据权利要求40所述的无人飞行器,其特征在于,所述处理器具体用于:The unmanned aerial vehicle according to claim 40, wherein the processor is specifically configured to:
    在录制的音频信号为立体声音频信号时,增强所录制的立体声音频信号。When the recorded audio signal is a stereo audio signal, enhance the recorded stereo audio signal.
  50. 根据权利要求49所述的无人飞行器,其特征在于,所述处理器具体用于:The unmanned aerial vehicle according to claim 49, wherein the processor is specifically configured to:
    基于相位增强所述立体声音频信号;或Enhancing the stereo audio signal based on phase; or
    基于能量增强所述立体声音频信号。The stereo audio signal is enhanced based on energy.
  51. 根据权利要求40所述的无人飞行器,其特征在于,所述处理器具体用于:The unmanned aerial vehicle according to claim 40, wherein the processor is specifically configured to:
    在录制的音频信号为人声音频信号时,对所录制的人声音频信号进行增强人声处理和降噪处理。When the recorded audio signal is a human voice audio signal, the recorded human voice audio signal is processed to enhance human voice and reduce noise.
  52. 根据权利要求40所述的无人飞行器,其特征在于,所述录音设备为麦克风。The unmanned aerial vehicle of claim 40, wherein the recording device is a microphone.
  53. 一种无人飞行器录音系统,其特征在于,包括无人飞行器和指定应用,所述无人飞行器上装有芯片和录音设备,所述指定应用安装于电子设备,所述无人飞行器与所述电子设备通信连接,所述芯片包括处理器和存储器,所述存储器用于存储指令,所述处理器在响应所述应用的请求时,调用所述存储器存储的指令用于实现以下操作:An unmanned aerial vehicle recording system, characterized in that it comprises an unmanned aerial vehicle and a designated application, the unmanned aerial vehicle is equipped with a chip and a recording device, the designated application is installed in an electronic device, and the unmanned aerial vehicle is connected to the electronic device. The device is in communication connection, the chip includes a processor and a memory, the memory is used to store instructions, and when the processor responds to a request of the application, the instructions stored in the memory are invoked to implement the following operations:
    在通过录音设备进行录音的情况下,确定无人飞行器的工作状态;所述工作状态包括飞行状态和落地状态;In the case of recording through a recording device, determine the working state of the unmanned aerial vehicle; the working state includes the flight state and the landing state;
    根据所述无人飞行器的工作状态调整所述录音设备的参数;Adjusting the parameters of the recording device according to the working state of the unmanned aerial vehicle;
    根据调整后的所述录音设备的参数进行录音操作。Perform recording operations according to the adjusted parameters of the recording device.
  54. 根据权利要求53所述的无人飞行器录音系统,其特征在于,所述处理器具体用于:The unmanned aerial vehicle recording system according to claim 53, wherein the processor is specifically configured to:
    根据接收到的无人飞行器的工作状态消息确定无人飞行器的工作状态;和/或Determine the working status of the unmanned aerial vehicle according to the received working status message of the unmanned aerial vehicle; and/or
    分析所录制的音频信号的特征以确定无人飞行器的工作状态;和/或Analyze the characteristics of the recorded audio signal to determine the operating status of the UAV; and/or
    根据所获取的无人飞行器的电机转速确定无人飞行器的工作状态。Determine the working state of the unmanned aerial vehicle according to the obtained motor speed of the unmanned aerial vehicle.
  55. 根据权利要求54所述的无人飞行器录音系统,其特征在于,所述工作状态消息包括指示无人飞行器处于飞行状态的消息和指示无人飞行器处于落地状态的消息。The unmanned aerial vehicle recording system according to claim 54, wherein the working status message includes a message indicating that the unmanned aerial vehicle is in a flying state and a message indicating that the unmanned aerial vehicle is in a landing state.
  56. 根据权利要求54所述的无人飞行器录音系统,其特征在于,所述音频信号的特征包括所述音频信号的能量;The unmanned aerial vehicle recording system of claim 54, wherein the characteristics of the audio signal include the energy of the audio signal;
    所述处理器具体用于:The processor is specifically used for:
    在所述音频信号的能量大于第一预设阈值时,确定无人飞行器处于飞行状态;否则,确定无人飞行器处于落地状态。When the energy of the audio signal is greater than the first preset threshold, it is determined that the unmanned aerial vehicle is in a flying state; otherwise, it is determined that the unmanned aerial vehicle is in a landing state.
  57. 根据权利要求56所述的无人飞行器录音系统,其特征在于,所述处理器具体用于:The unmanned aerial vehicle recording system according to claim 56, wherein the processor is specifically configured to:
    在所述音频信号的能量从小于所述第一预设阈值变化为大于所述第一预设阈值时,确定无人飞行器进入飞行状态;When the energy of the audio signal changes from less than the first preset threshold to greater than the first preset threshold, determining that the unmanned aerial vehicle enters a flight state;
    在所述音频信号的能量从大于所述第一预设阈值变化为小于所述第一预设阈值时,确定无人飞行器进入落地状态。When the energy of the audio signal changes from greater than the first preset threshold to less than the first preset threshold, it is determined that the unmanned aerial vehicle enters the landing state.
  58. 根据权利要求54所述的无人飞行器录音系统,其特征在于,所述处理器具体用于:The unmanned aerial vehicle recording system according to claim 54, wherein the processor is specifically configured to:
    在所述电机转速大于第二预设阈值时,确定无人飞行器处于飞行状态;否则,确定无人飞行器处于落地状态。When the motor speed is greater than the second preset threshold, it is determined that the unmanned aerial vehicle is in a flying state; otherwise, it is determined that the unmanned aerial vehicle is in a landing state.
  59. 根据权利要求58所述的无人飞行器录音系统,其特征在于,所述处理器具体用于:The unmanned aerial vehicle recording system according to claim 58, wherein the processor is specifically configured to:
    在所述电机转速从小于所述第二预设阈值变化为大于所述第二预设阈值时,确定无人飞行器进入飞行状态;When the motor speed changes from less than the second preset threshold to greater than the second preset threshold, determining that the unmanned aerial vehicle enters a flying state;
    在所述电机转速从大于所述第二预设阈值变化为小于所述第二预设阈值时,确定无人飞行器进入落地状态。When the rotation speed of the motor changes from greater than the second preset threshold to less than the second preset threshold, it is determined that the unmanned aerial vehicle enters the landing state.
  60. 根据权利要求53所述的无人飞行器录音系统,其特征在于,所述录音设备的参数包括:The unmanned aerial vehicle recording system of claim 53, wherein the parameters of the recording device include:
    所述录音设备的模拟增益。The analog gain of the recording device.
  61. 根据权利要求60所述的无人飞行器录音系统,其特征在于,所述处理器具体用于:The unmanned aerial vehicle recording system according to claim 60, wherein the processor is specifically configured to:
    在所述无人飞行器处于飞行状态时,调整所述录音设备的模拟增益以将所录制的音频信号控制在第一指定范围内;When the unmanned aerial vehicle is in flight, adjusting the analog gain of the recording device to control the recorded audio signal within a first specified range;
    在所述无人飞行器处于落地状态时,调整所述录音设备的模拟增益以将所录制的音频信号控制在第二指定范围内。When the unmanned aerial vehicle is in a landing state, the analog gain of the recording device is adjusted to control the recorded audio signal within a second specified range.
  62. 根据权利要求53所述的无人飞行器录音系统,其特征在于,所述处理器具体用于:The unmanned aerial vehicle recording system according to claim 53, wherein the processor is specifically configured to:
    在录制的音频信号为立体声音频信号时,增强所录制的立体声音频信号。When the recorded audio signal is a stereo audio signal, the recorded stereo audio signal is enhanced.
  63. 根据权利要求62所述的无人飞行器录音系统,其特征在于,所述处理器具体用于:The unmanned aerial vehicle recording system according to claim 62, wherein the processor is specifically configured to:
    基于相位增强所述立体声音频信号;或Enhancing the stereo audio signal based on phase; or
    基于能量增强所述立体声音频信号。The stereo audio signal is enhanced based on energy.
  64. 根据权利要求53所述的无人飞行器录音系统,其特征在于,所述处理器具体用于:The unmanned aerial vehicle recording system according to claim 53, wherein the processor is specifically configured to:
    在录制的音频信号为人声音频信号时,对所录制的人声音频信号进行增强人声处理和降噪处理。When the recorded audio signal is a human voice audio signal, the recorded human voice audio signal is processed to enhance human voice and reduce noise.
  65. 根据权利要求53所述的无人飞行器录音系统,其特征在于,所述录音设备为麦克风。The unmanned aerial vehicle recording system of claim 53, wherein the recording device is a microphone.
  66. 一种计算机可读存储介质,其特征在于,包括指令,当其在计算机上运行时,使得所述计算机执行如权利要求1-13任一项所述的方法。A computer-readable storage medium, characterized by comprising instructions, which when run on a computer, causes the computer to execute the method according to any one of claims 1-13.
  67. 一种包含指令的计算机程序产品,其特征在于,当所述指令在计算机上运行时,使得所述计算机执行如权利要求1-13任一项所述的方法。A computer program product containing instructions, characterized in that, when the instructions are run on a computer, the computer is caused to execute the method according to any one of claims 1-13.
PCT/CN2020/095351 2020-06-10 2020-06-10 Audio recording method and apparatus for unmanned aerial vehicle, chip, unmanned aerial vehicle, and system WO2021248364A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2020/095351 WO2021248364A1 (en) 2020-06-10 2020-06-10 Audio recording method and apparatus for unmanned aerial vehicle, chip, unmanned aerial vehicle, and system
CN202080025857.2A CN113748688A (en) 2020-06-10 2020-06-10 Recording method, device and chip for unmanned aerial vehicle, unmanned aerial vehicle and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/095351 WO2021248364A1 (en) 2020-06-10 2020-06-10 Audio recording method and apparatus for unmanned aerial vehicle, chip, unmanned aerial vehicle, and system

Publications (1)

Publication Number Publication Date
WO2021248364A1 true WO2021248364A1 (en) 2021-12-16

Family

ID=78728393

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/095351 WO2021248364A1 (en) 2020-06-10 2020-06-10 Audio recording method and apparatus for unmanned aerial vehicle, chip, unmanned aerial vehicle, and system

Country Status (2)

Country Link
CN (1) CN113748688A (en)
WO (1) WO2021248364A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106054918A (en) * 2016-05-30 2016-10-26 北京小米移动软件有限公司 Method and device for providing information of unmanned aerial vehicle
CN206282146U (en) * 2016-11-23 2017-06-27 歌尔股份有限公司 A kind of unmanned plane and wearable device
US10210856B1 (en) * 2018-03-23 2019-02-19 Bell Helicopter Textron Inc. Noise control system for a ducted rotor assembly
CN109887522A (en) * 2019-01-24 2019-06-14 深圳市微纳感知计算技术有限公司 A kind of microphone array gain adjusting method therefore, device and terminal device

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105899965B (en) * 2014-08-29 2018-10-02 深圳市大疆创新科技有限公司 Unmanned vehicle for acquiring audio data
CN205051857U (en) * 2015-10-15 2016-02-24 深圳市大疆创新科技有限公司 Flying device , shooting device and device of making an uproar falls in recording thereof
KR102503684B1 (en) * 2016-06-24 2023-02-28 삼성전자주식회사 Electronic apparatus and operating method thereof
CN106774381B (en) * 2016-11-23 2019-07-19 歌尔股份有限公司 Detection method, the wearable device of a kind of unmanned plane and its state of flight
CN109625261B (en) * 2017-10-06 2023-09-22 松下电器(美国)知识产权公司 Unmanned aerial vehicle
CN109074045A (en) * 2017-10-31 2018-12-21 深圳市大疆创新科技有限公司 Reminding method, unmanned plane and the ground end equipment of unmanned machine information
WO2019227279A1 (en) * 2018-05-28 2019-12-05 深圳市大疆创新科技有限公司 Noise reduction method and apparatus, and unmanned aerial vehicle
CN108777707A (en) * 2018-05-28 2018-11-09 北京京东尚科信息技术有限公司 Unmanned vehicle audio frequency transmission method and device
CN109120790B (en) * 2018-08-30 2021-01-15 Oppo广东移动通信有限公司 Call control method and device, storage medium and wearable device
CN110415687B (en) * 2019-05-21 2021-04-13 腾讯科技(深圳)有限公司 Voice processing method, device, medium and electronic equipment
CN110475195A (en) * 2019-07-10 2019-11-19 深圳市世纪南方科技有限公司 Applied to the control method of unmanned plane megaphone, device, system and equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106054918A (en) * 2016-05-30 2016-10-26 北京小米移动软件有限公司 Method and device for providing information of unmanned aerial vehicle
CN206282146U (en) * 2016-11-23 2017-06-27 歌尔股份有限公司 A kind of unmanned plane and wearable device
US10210856B1 (en) * 2018-03-23 2019-02-19 Bell Helicopter Textron Inc. Noise control system for a ducted rotor assembly
CN109887522A (en) * 2019-01-24 2019-06-14 深圳市微纳感知计算技术有限公司 A kind of microphone array gain adjusting method therefore, device and terminal device

Also Published As

Publication number Publication date
CN113748688A (en) 2021-12-03

Similar Documents

Publication Publication Date Title
US20210217433A1 (en) Voice processing method and apparatus, and device
CN106648527A (en) Volume control method, device and playing equipment
WO2016180100A1 (en) Method and device for improving audio processing performance
US10692481B2 (en) Systems, apparatus, and methods for drone audio noise reduction
WO2019002849A1 (en) Detection of replay attack
CN104081452B (en) The method of regulation active denoising system
WO2014173069A1 (en) Sound effect adjusting method, apparatus, and device
WO2022227793A1 (en) Loudspeaker parameter configuration method and related apparatus
WO2018095061A1 (en) Unmanned aerial vehicle and method for detecting flight state thereof, and wearable apparatus
CN111294719B (en) Method and device for detecting in-ear state of ear-wearing type device and mobile terminal
CN205051857U (en) Flying device , shooting device and device of making an uproar falls in recording thereof
CN106356070A (en) Audio signal processing method and device
EP4052482A1 (en) Microphone with adjustable signal processing
EP3987821B1 (en) Apparatus for and method of wind detection by means of acceleration measurements
US11153684B2 (en) Dynamic debuzzer for speakers
CN113068100A (en) Closed-loop automatic detection vibration reduction method, system, terminal and storage medium
CN206282146U (en) A kind of unmanned plane and wearable device
WO2021248364A1 (en) Audio recording method and apparatus for unmanned aerial vehicle, chip, unmanned aerial vehicle, and system
US11257511B1 (en) Voice equalization based on face position and system therefor
CN112217486B (en) Audio playing control method and system, electronic equipment and storage medium
CN116994596A (en) Howling suppression method and device, storage medium and electronic equipment
CN108605191A (en) abnormal sound detection method and device
CN112866877B (en) Speaker control method, speaker control device, electronic apparatus, and storage medium
CN115835094A (en) Audio signal processing method, system, device, product and medium
WO2022222486A1 (en) Resonance control method and apparatus for air supply device, and electronic device and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20939791

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20939791

Country of ref document: EP

Kind code of ref document: A1