WO2019000420A1 - Procédé et appareil de synchronisation vidéo et audio, et véhicule aérien sans pilote - Google Patents

Procédé et appareil de synchronisation vidéo et audio, et véhicule aérien sans pilote Download PDF

Info

Publication number
WO2019000420A1
WO2019000420A1 PCT/CN2017/091233 CN2017091233W WO2019000420A1 WO 2019000420 A1 WO2019000420 A1 WO 2019000420A1 CN 2017091233 W CN2017091233 W CN 2017091233W WO 2019000420 A1 WO2019000420 A1 WO 2019000420A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
video
audio
frame
time stamp
Prior art date
Application number
PCT/CN2017/091233
Other languages
English (en)
Chinese (zh)
Inventor
张志鹏
尹小俊
王乃博
马宁
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2017/091233 priority Critical patent/WO2019000420A1/fr
Priority to CN201780006065.9A priority patent/CN108496372A/zh
Publication of WO2019000420A1 publication Critical patent/WO2019000420A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording

Definitions

  • the present application relates to synchronization technology, and in particular, to a method and device for synchronizing video and audio, and a drone.
  • the existing aerial drones due to the large noise of the propeller and the distance from the target, are basically silent video, and the sound information is the background music or live recording added by post processing. Especially when adding live recording, in order to achieve audio and video synchronization, manual and manual synchronization of audio and video is required, the operation is complicated, and the efficiency is low.
  • Embodiments of the present invention provide a method and a device for synchronizing video and audio, and a drone to realize automatic synchronization of audio and video, and improve synchronization efficiency of audio and video.
  • a first aspect of the embodiments of the present invention provides a method for synchronizing video and audio, including:
  • a second aspect of the embodiments of the present invention provides a method for synchronizing video and audio, including:
  • a third aspect of the embodiments of the present invention provides a method for synchronizing video and audio, including:
  • a fourth aspect of the embodiments of the present invention provides a synchronization device, including:
  • a communication interface one or more processors; the one or more processors operating separately or in cooperation, the communication interface being coupled to the processor;
  • the communication interface is configured to: acquire video information captured by a video capture device mounted on the drone, and acquire audio information recorded by the recording device, wherein time synchronization of the video capture device and the recording device;
  • the processor is configured to: align the video information and the audio information according to timestamp information included in the video information and timestamp information included in the audio information.
  • a fifth aspect of the embodiments of the present invention provides a control device, including:
  • a communication interface one or more processors; the one or more processors operating separately or in cooperation, the communication interface being in communication with the processor;
  • the communication interface is configured to: acquire video information captured by a video capture device carried by the drone;
  • the processor is configured to: generate timestamp information in the video information;
  • the communication interface is configured to: send the video information that generates the timestamp information to the synchronization device, so that the synchronization device: according to the timestamp information in the video information, and the audio recorded by the recording device acquired by the synchronization device Time stamp information in the information, the video information and the audio information are aligned, wherein the video capture device and the recording device are time synchronized.
  • a sixth aspect of the embodiments of the present invention provides a control device, including:
  • a communication interface one or more processors; the one or more processors operating separately or in cooperation, the communication interface being in communication with the processor;
  • the communication interface is configured to: acquire audio information recorded by a recording device on the remote control of the drone;
  • the processor is configured to: generate timestamp information in the audio information;
  • the communication interface is configured to: send audio information that generates timestamp information to a synchronization device And the synchronization device, according to the timestamp information in the audio information, and the timestamp information in the video information captured by the video capturing device acquired by the synchronization device, to the audio information and the video information. Alignment is performed in which the time of the video capture device and the recording device are synchronized.
  • a seventh aspect of the embodiments of the present invention provides a drone, including:
  • a power system mounted to the fuselage for providing flight power
  • a video capture device mounted on the body for capturing video
  • An eighth aspect of the embodiments of the present invention provides a remote controller, including:
  • a recording device mounted on the body portion for recording audio information
  • the video and audio synchronization method, device and drone provided by the embodiment obtain the video information captured by the video capture device carried by the drone through the synchronization device, and acquire the audio information recorded by the recording device, and are included according to the video information.
  • the time stamp information and the time stamp information included in the audio information align the video information and the audio information, thereby realizing automatic synchronization of the audio information and the video information, without manual manual operation, and the synchronization accuracy and efficiency are high.
  • FIG. 1 is a flowchart of a method for synchronizing video and audio according to an embodiment of the present invention
  • FIG. 2 is a flowchart of a method for synchronizing video and audio according to another embodiment of the present invention.
  • FIG. 3 is a flowchart of a method for synchronizing video and audio according to another embodiment of the present invention.
  • FIG. 4 is a structural diagram of a synchronization device according to an embodiment of the present invention.
  • FIG. 5 is a structural diagram of a control device according to an embodiment of the present invention.
  • FIG. 6 is a structural diagram of a control device according to an embodiment of the present invention.
  • FIG. 7 is a structural diagram of a drone according to an embodiment of the present invention.
  • a component when referred to as being "fixed” to another component, it can be directly on the other component or the component can be in the middle. When a component is considered to "connect” another component, it can be directly connected to another component or possibly a central component.
  • FIG. 1 is a flowchart of a method for synchronizing video and audio according to an embodiment of the present invention. As shown in FIG. 1, the method in this embodiment may include:
  • Step 101 Obtain video information captured by a video capture device carried by the drone, and acquire audio information recorded by the recording device, wherein the video capture device and the recording device are synchronized in time.
  • the execution body of this embodiment may be a synchronization device, and the synchronization device may be disposed on a drone such as an unmanned aerial vehicle, an unmanned ship or an unmanned vehicle, or a remote controller of the drone, or may be independently set. At the ground end.
  • the sync device is a device with computing and/or processing functions.
  • the control device is independently disposed at the ground end, the synchronization device may be a smartphone, a tablet, a ground control station, a laptop, a watch, or the like.
  • the synchronization device and the flight controller on the drone are connected by an Application Programming Interface (API).
  • API Application Programming Interface
  • the flight controller of the synchronization device and the drone can pass Wired party Connection, for example, by at least one of the following: Universal Asynchronous Receiver/Transmitter (UART), Universal Serial Bus (USB), and Flight Controller Area Network (Controller Area Network) , referred to as CAN) bus connection.
  • UART Universal Asynchronous Receiver/Transmitter
  • USB Universal Serial Bus
  • CAN Flight Controller Area Network
  • the synchronization device and the flight controller of the drone can be connected by wireless, for example, by at least one of the following methods: Wireless-Fidelity (WI-FI) ), Bluetooth, software defined radio (SDR) or other custom protocols.
  • WI-FI Wireless-Fidelity
  • SDR software defined radio
  • the video information is obtained by a video capturing device mounted on the drone
  • the audio information is obtained by recording through a recording device or other independent recording device set on the remote control of the drone, the video capturing device and the recording.
  • the device is synchronized in time.
  • the UAV real-time or periodic video information obtained by the video shooting device is sent to the synchronization device in units of video files or in units of video frames, and the synchronization device obtains audio information in a similar manner. I will not repeat them here.
  • the video information and the audio information in the embodiment all include timestamp information.
  • the synchronization device acquires video information in units of video files.
  • the file header of the video file corresponding to the video information includes timestamp information.
  • the synchronization device acquires video information in units of frames.
  • time stamp information may be carried in a frame header of each video frame of the video information, for example, the video information includes a video frame. 1 and video frame 2, the timestamp information when the video frame 1 is captured may be carried in the frame header of the video frame 1, and the timestamp information when the video frame 2 is captured is carried in the frame header of the video frame 2.
  • the time stamp information may be carried in the frame header of the video frame with the preset number of frames in the video information.
  • the video information includes video frame 1, video frame 2, video frame 3, and video frame 4.
  • the timestamp information when the video frame 1 is captured is carried in the frame header of the video frame 1
  • the timestamp information when the video frame 3 is captured is carried in the frame header of the video frame 3.
  • the location of the timestamp information in the audio information is the same as the video information, and details are not described herein again.
  • the recording device and the video capturing device carried by the drone are used.
  • the frame number (including the superframe number) is used for communication. Since the frame number can be rolled back for hours or even days, it can be used to align video information and audio information.
  • the video capture device and the recording device are accurately synchronized in time, the time of radio wave propagation is negligible, so the distance between the drone and the subject is large (recording device and subject) The distance between them is relatively close, and there is no problem that the sound and picture are not synchronized due to the propagation delay of the video information and the audio information. Therefore, preferably, the timestamp information in this embodiment may be a frame number used by the video capturing device and the recording device for communication. Of course, the actual timestamp information may also be other information, such as time information of a video frame or a video file, and time information of an audio frame or an audio file.
  • Step 102 Align the video information and the audio information according to timestamp information included in the video information and timestamp information included in the audio information.
  • the synchronization device acquires video information in units of video files and audio information in units of audio files, according to timestamp information of the video files in the video information, and timestamp information of the audio files in the audio information, Align the audio files in the video files and audio information in the video information.
  • the video information includes a video file 1, a video file 2, and a video file 3.
  • the file header of the video file 1 includes a frame number a
  • the file header of the video file 2 includes a frame number b
  • the file header of the video file 3 includes a frame. No.
  • the audio information includes an audio file 1, an audio file 2, and an audio file 3.
  • the file header of the audio file 1 includes a frame number a
  • the file header of the audio file 2 includes a frame number b
  • the file header of the audio file 3 Including the frame number c, the video file 1 is aligned with the audio file 1, the video file 2 is aligned with the audio file 2, and the video file 3 is aligned with the audio file 3.
  • the description herein is merely illustrative and not a limitation of the invention.
  • the synchronization device acquires video information in units of frames and audio information in units of frames, if time stamp information is included in a frame header of each video frame in the video information, each of the audio information The time stamp information is included in the frame header of each audio frame, and the video frame and the audio frame including the same time stamp information are aligned.
  • the video information includes a video frame 1, a video frame 2, and a video frame 3.
  • the frame header of the video frame 1 includes a frame number a
  • the frame header of the video frame 2 includes a frame number b.
  • the frame header of the video frame 3 includes Frame number c; audio information includes audio frame 1, audio frame 2 and audio frame 3, frame header of audio frame 1 includes frame number a, frame header of audio frame 2 includes frame number b, frame header of audio frame 3 Including frame number c, video frame 1 is aligned with audio frame 1, video frame 2 is aligned with audio frame 2, and video frame 3 is aligned with audio frame 3.
  • frame number c video frame 1 is aligned with audio frame 1
  • video frame 2 is aligned with audio frame 2
  • video frame 3 is aligned with audio frame 3.
  • the video information includes a video frame 1, a video frame 2, and a video frame 3.
  • the frame header of the video frame 1 includes a frame number a
  • the frame header of the video frame 3 includes a frame number c.
  • the audio information includes an audio frame 1.
  • Audio frame 2 and audio frame 3 the frame header of the audio frame 1 includes the frame number a, and the frame header of the audio frame 3 includes the frame number c, respectively, the video frame 1 is aligned with the audio frame 1, and the video frame 3 and the audio are respectively Frame 3 is aligned.
  • the description herein is merely illustrative and not a limitation of the invention.
  • the video information captured by the video capture device carried by the drone is acquired by the synchronization device, and the audio information recorded by the recording device is obtained, and according to the timestamp information included in the video information and the timestamp information included in the audio information,
  • the video information and the audio information are aligned, thereby realizing the automatic synchronization of the audio information and the video information, without manual manual operation, and the synchronization accuracy and efficiency are high.
  • FIG. 2 is a flowchart of a method for synchronizing video and audio according to another embodiment of the present invention. As shown in FIG. 2, the method in this embodiment may include:
  • Step 201 Obtain video information captured by a video capture device carried by the drone.
  • the execution body of this embodiment may be a control device provided on the drone, and the control device is a device having a computing function and/or a processing function.
  • the control device and the flight controller on the drone, as well as the video capture device, are connected via an API.
  • the flight controller of the control device and the drone, and the video capture device of the drone can be connected by wire, for example, by at least one of the following methods: Universal Asynchronous Receiver/Transmitter , referred to as UART), Universal Serial Bus (USB), and Flight Controller Area Network (CAN) bus connection.
  • UART Universal Asynchronous Receiver/Transmitter
  • USB Universal Serial Bus
  • CAN Flight Controller Area Network
  • the video information obtained by the control device from the video capturing device may be video information in units of video files, video information in frame units, or other information.
  • the video information in the form is not limited in this embodiment.
  • Step 202 Generate timestamp information in the video information.
  • the generating the timestamp information in the video information including generating the timestamp information in the file header of the video file corresponding to the video information.
  • the timestamp information includes a frame number for communication between the recording device and the video capturing device, which is consistent with the foregoing embodiment, and details are not described herein again.
  • the generating timestamp information in the video information includes: generating a timestamp in a frame header of each video frame in the video information. information.
  • generating the timestamp information in the video information including: generating, in the video information, a timestamp information by using a video frame of a preset number of frames. This is consistent with the above embodiment, and will not be described again here.
  • Step 203 Send the video information with the timestamp information to the synchronization device, so that the synchronization device according to the timestamp information in the video information and the time in the audio information recorded by the recording device acquired by the synchronization device Stamping information, aligning the video information with the audio information, wherein the video capture device and the recording device are time synchronized.
  • a method for transmitting video information to a synchronization device, and a synchronization device according to the timestamp information in the acquired video information, and the timestamp information in the audio information recorded by the recording device acquired by the synchronization device is consistent with the foregoing embodiment, and details are not described herein again.
  • the video information captured by the video capture device carried by the drone is obtained by the control device, and the time stamp information is generated by the control device in the acquired video information, and the video information generating the time stamp information is sent to the synchronization device.
  • the synchronization device is enabled to align the video information and the audio information according to the timestamp information in the received video information and the timestamp information in the audio information acquired from the recording device, thereby realizing the video information and the audio information. Automatic alignment, no manual manual operation, and high efficiency of synchronization.
  • FIG. 3 is a flowchart of a method for synchronizing video and audio according to another embodiment of the present invention. As shown in FIG. 3, the method in this embodiment may include:
  • Step 301 Acquire audio information recorded by a recording device on the remote control of the drone.
  • the execution body of this embodiment may be a control device disposed on the remote controller of the drone, and the recording device is disposed on the remote controller of the drone.
  • the control device is a device having computing functions and/or processing functions.
  • the control device is connected to the recording device via an API.
  • the control device and the recording device can be connected by wire, for example, by at least one of the following methods: Universal Asynchronous Receiver/Transmitter (UART), Universal Serial Bus (Universal Serial Bus) USB), Flight Controller Area Network (Controller Area Network, CAN) bus connection.
  • the audio information obtained by the control device from the recording device may be audio information in units of audio files, audio information in units of frames, and other forms of audio information. This is not limited.
  • Step 302 Generate timestamp information in the audio information.
  • the generating time stamp information in the audio information includes generating timestamp information in a file header of an audio file corresponding to the audio information.
  • the timestamp information includes a frame number for communication between the recording device and the video capturing device, which is consistent with the foregoing embodiment, and details are not described herein again.
  • the generating time stamp information in the audio information includes: generating a time stamp in a frame header of each audio frame in the audio information. information.
  • the generating the timestamp information in the audio information includes: generating, in the audio information, an audio frame separated by a preset number of frames to generate a timestamp information. This is consistent with the above embodiment, and will not be described again here.
  • Step 303 Send the audio information that generates the timestamp information to the synchronization device, so that the synchronization device is based on the timestamp information in the audio information, and the video information captured by the video capture device acquired by the synchronization device.
  • Time stamp information for aligning the audio information with the video information, wherein the video capture device and the recording device are time synchronized.
  • the method for transmitting audio information to the synchronization device, and the synchronization device according to the timestamp information in the acquired video information, and the timestamp information in the audio information recorded by the recording device acquired by the synchronization device is consistent with the foregoing embodiment, and details are not described herein again.
  • the audio information recorded by the recording device on the remote control of the UAV is obtained by the control device, and the timestamp information is generated in the obtained audio information by the control device, and the audio information of the timestamp information is sent to the synchronization device.
  • the synchronization device can align the audio information and the video information according to the timestamp information in the received audio information and the timestamp information in the video information acquired from the video capturing device, thereby realizing the video information and audio. Automatic alignment of information, no manual manual operation, and high efficiency of synchronization.
  • the embodiment of the invention provides a synchronization device.
  • the synchronization device may specifically be the synchronization device described in the foregoing embodiment.
  • 4 is a structural diagram of a synchronization device according to an embodiment of the present invention.
  • the synchronization device 40 includes: a communication interface 41, one or more processors 42; and the one or more processors 42 are separated or coordinated.
  • the communication interface 41 is connected to the processor 42;
  • the communication interface 41 is configured to: acquire video information captured by a video capture device mounted on the drone, and acquire audio information recorded by the recording device, wherein the video capture device and the recording device are time synchronized;
  • the processor 42 is configured to: align the video information and the audio information according to timestamp information included in the video information and timestamp information included in the audio information.
  • the location of the timestamp information in the video information and the audio information may include the following possible ways:
  • time stamp information is included in a file header of a video file corresponding to the video information; and time stamp information is included in a file header of the audio file corresponding to the audio information.
  • the processor 42 is configured to: according to the timestamp information of the video file in the video information, and the timestamp information of the audio file in the audio information, in the video file and the audio information in the video information.
  • the audio files are aligned.
  • the communication interface 41 is configured to: receive video information in units of frames sent by the video capturing device, and receive audio information in units of frames sent by the recording device.
  • time stamp information is included in the frame header of each video frame of the video information
  • time stamp information is included in the frame header of each audio frame of the audio information
  • the processor 42 is configured to: Video frames and audio frames including the same timestamp information are aligned.
  • the processor 42 is configured to: time included in the video frame of the preset preset number of frames according to the interval The stamp information, and the time stamp information included in the audio frame of the preset preset frame number, are aligned with the video frame of the preset preset frame number and the audio frame of the preset preset frame number.
  • the video information and the timestamp information of the audio information in the embodiment include a frame number used by the video capturing device and the recording device to communicate.
  • the processor 42 is configured to: align the video information and the audio information according to a frame number included in the video information and a frame number included in the audio information.
  • the video information captured by the video capture device carried by the drone is acquired by the synchronization device, and the audio information recorded by the recording device is obtained, and according to the timestamp information included in the video information and the timestamp information included in the audio information,
  • the video information and the audio information are aligned, thereby realizing the automatic synchronization of the audio information and the video information, without manual manual operation, and the synchronization accuracy and efficiency are high.
  • FIG. 5 is a structural diagram of a control device according to an embodiment of the present invention.
  • the control device 50 includes: a communication interface 51, one or more processors 52; and the one or more processors 52 alone or Working in cooperation, the communication interface 51 and the processor 52 are communicatively connected;
  • the communication interface 51 is configured to: acquire video information captured by a video capture device carried by the drone;
  • the processor 52 is configured to: generate timestamp information in the video information;
  • the communication interface 51 is configured to: send the video information that generates the timestamp information to the synchronization device, so that the synchronization device records according to the timestamp information in the video information and the recording device acquired by the synchronization device. Time stamp information in the audio information, the video information and the audio information being aligned, wherein the video capture device and the recording device are time synchronized.
  • the processor 52 is configured to: generate timestamp information in a file header of a video file corresponding to the video information.
  • the processor 52 is configured to: generate timestamp information in a frame header of each video frame in the video information.
  • the processor 52 is configured to: in the video information, generate a timestamp information by using a video frame of a preset number of frames.
  • the video information and the timestamp information of the audio information both include a frame number used when the video capturing device and the recording device communicate.
  • control device provided by the embodiment of the present invention are similar to the embodiment shown in FIG. 2, and details are not described herein again.
  • the video information captured by the video capture device carried by the drone is obtained by the control device, and the time stamp information is generated by the control device in the acquired video information, and the video information generating the time stamp information is sent to the synchronization device.
  • the synchronization device is enabled to align the video information and the audio information according to the timestamp information in the received video information and the timestamp information in the audio information acquired from the recording device, thereby realizing the video information and the audio information. Automatic alignment, no manual manual operation, and high efficiency of synchronization.
  • FIG. 6 is a structural diagram of a control device according to an embodiment of the present invention.
  • the control device 60 includes: a communication interface 61, one or more processors 62; and the one or more processors 62 alone or Working in cooperation, the communication interface 61 and the processor 62 are communicatively connected;
  • the communication interface 61 is configured to: acquire audio information recorded by a recording device on the remote control of the drone;
  • the processor 62 is configured to: generate timestamp information in the audio information
  • the communication interface 61 is configured to: send the audio information generated by the timestamp information to the synchronization device, so that the synchronization device according to the timestamp information in the audio information, and the video capture device acquired by the synchronization device Time stamp information in the captured video information, the audio information and the video information being aligned, wherein the video capture device and the recording device are time synchronized.
  • the processor 52 is configured to: generate timestamp information in a file header of the audio file corresponding to the audio information.
  • the processor 52 is configured to: generate timestamp information in a frame header of each frame of the audio information.
  • the processor 52 is configured to generate, in the audio information, a timestamp information by using an audio frame of a preset number of frames.
  • the video information and the timestamp information of the audio information both include a frame number used when the video capturing device and the recording device communicate.
  • control device provided by the embodiment of the present invention are similar to the embodiment shown in FIG. 3, and details are not described herein again.
  • the audio information recorded by the recording device on the remote control of the UAV is obtained by the control device, and the timestamp information is generated in the obtained audio information by the control device, and the audio information of the timestamp information is sent to the synchronization device.
  • the synchronization device can align the audio information and the video information according to the timestamp information in the received audio information and the timestamp information in the video information acquired from the video capturing device, thereby realizing the video information and audio. Automatic alignment of information, no manual manual operation, and high efficiency of synchronization.
  • FIG. 7 is a structural diagram of a drone according to an embodiment of the present invention, and the drone may be an unmanned aerial vehicle, an unmanned vehicle, or an unmanned vehicle.
  • the drone 700 includes a fuselage, a power system, and a flight controller 718, the power system including at least one of a motor 707, a propeller 706, and an electronic governor 717.
  • a flight controller 718 is in communication with the power system for controlling the flight of the drone; wherein the flight controller 718 includes an Inertial Measurement Unit (IMU)
  • IMU Inertial Measurement Unit
  • the inertial measurement unit generally includes a gyroscope and an accelerometer.
  • the inertial measurement unit is configured to detect a pitch angle, a roll angle, a yaw angle, an acceleration, and the like of the drone.
  • the drone 700 further includes: a control device 711, a sensing system 708, a communication system 710, a supporting device 702, and a video capturing device 704.
  • the supporting device 702 may specifically be a cloud platform, and the control device 711 is configured to acquire video information from the video capturing device 704 and generate timestamp information in the video information.
  • the communication system 710 may specifically include a transmitter, and the transmitter is configured to send the video information that generates the timestamp information to the synchronization device 712.
  • the antennas 714, 716 represent electromagnetic waves generated during communication between the transmitter and antenna 714.
  • control device 711 The specific principles, implementation manners, and beneficial effects of the control device 711 provided by the embodiments of the present invention are similar to the foregoing embodiments, and are not described herein again.
  • An embodiment of the present invention provides a UAV remote controller, where the remote controller includes a body portion;
  • a recording device mounted on the body portion for recording audio information
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
  • the above-described integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium.
  • the above software functional unit is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform the methods of the various embodiments of the present invention. Part of the steps.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

Selon un mode de réalisation, la présente invention concerne un procédé et un appareil destinés à une synchronisation vidéo et audio et un véhicule aérien sans pilote. Le procédé consiste à : acquérir des informations vidéo photographiées par un appareil photographique vidéo installé au niveau d'un véhicule aérien sans pilote, et acquérir des informations audio enregistrées par un appareil d'enregistrement, l'appareil photographique vidéo et l'appareil d'enregistrement étant synchronisés dans le temps ; et effectuer un alignement des informations vidéo et des informations audio selon des informations d'horodatage incluses dans les informations vidéo et des informations d'horodatage incluses dans les informations audio. L'invention réalise un alignement automatique et une synchronisation d'informations vidéo et d'informations audio, ce qui permet d'augmenter l'efficacité de synchronisation.
PCT/CN2017/091233 2017-06-30 2017-06-30 Procédé et appareil de synchronisation vidéo et audio, et véhicule aérien sans pilote WO2019000420A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2017/091233 WO2019000420A1 (fr) 2017-06-30 2017-06-30 Procédé et appareil de synchronisation vidéo et audio, et véhicule aérien sans pilote
CN201780006065.9A CN108496372A (zh) 2017-06-30 2017-06-30 视频和音频的同步方法、设备及无人机

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/091233 WO2019000420A1 (fr) 2017-06-30 2017-06-30 Procédé et appareil de synchronisation vidéo et audio, et véhicule aérien sans pilote

Publications (1)

Publication Number Publication Date
WO2019000420A1 true WO2019000420A1 (fr) 2019-01-03

Family

ID=63344750

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/091233 WO2019000420A1 (fr) 2017-06-30 2017-06-30 Procédé et appareil de synchronisation vidéo et audio, et véhicule aérien sans pilote

Country Status (2)

Country Link
CN (1) CN108496372A (fr)
WO (1) WO2019000420A1 (fr)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109672837A (zh) * 2019-01-24 2019-04-23 深圳慧源创新科技有限公司 航拍设备实时视频录制方法、移动终端和计算机存储介质
CN110022449A (zh) * 2019-03-01 2019-07-16 苏州臻迪智能科技有限公司 一种音频和视频合成方法、装置、电子设备及存储介质
CN110191368A (zh) * 2019-05-31 2019-08-30 北京奇艺世纪科技有限公司 视频数据采集及对齐方法、装置、电子设备及系统
CN111447396A (zh) * 2020-03-06 2020-07-24 视联动力信息技术股份有限公司 一种音视频传输方法、装置、电子设备及存储介质
CN111757144B (zh) * 2020-04-13 2022-03-08 湖南化工职业技术学院（湖南工业高级技工学校） 一种网络计算机多媒体视频播放方法和系统
CN111641858A (zh) * 2020-04-29 2020-09-08 上海推乐信息技术服务有限公司 一种音视频同步方法及系统
WO2022032458A1 (fr) * 2020-08-10 2022-02-17 北京小米移动软件有限公司 Procédé et appareil de transmission de données multimodales, et procédé et appareil de traitement de données multimodales
CN112416289B (zh) * 2020-11-12 2022-12-09 北京字节跳动网络技术有限公司 一种音频同步方法、装置、设备和存储介质
CN113660513A (zh) * 2021-08-17 2021-11-16 北京小米移动软件有限公司 同步播放时间的方法、装置及存储介质
CN114554250B (zh) * 2022-01-17 2023-06-27 北京理工大学重庆创新中心 一种无人机或无人车的视频和位置同步方法
CN115623265A (zh) * 2022-11-15 2023-01-17 成都索贝数码科技股份有限公司 一种实时拍摄带有现场原声音轨短视频的方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105791702A (zh) * 2016-04-27 2016-07-20 王正作 一种无人机航拍音视频实时同步传输系统
CN105979167A (zh) * 2016-06-24 2016-09-28 谭圆圆 视频制作方法及视频制作装置
CN106231226A (zh) * 2015-09-21 2016-12-14 零度智控（北京）智能科技有限公司 影音合成方法、装置及系统

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101197993A (zh) * 2006-12-05 2008-06-11 中兴通讯股份有限公司 视频和音频同步装置
US9598182B2 (en) * 2015-05-11 2017-03-21 Lily Robotics, Inc. External microphone for an unmanned aerial vehicle

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106231226A (zh) * 2015-09-21 2016-12-14 零度智控（北京）智能科技有限公司 影音合成方法、装置及系统
CN105791702A (zh) * 2016-04-27 2016-07-20 王正作 一种无人机航拍音视频实时同步传输系统
CN105979167A (zh) * 2016-06-24 2016-09-28 谭圆圆 视频制作方法及视频制作装置

Also Published As

Publication number Publication date
CN108496372A (zh) 2018-09-04

Similar Documents

Publication Publication Date Title
WO2019000420A1 (fr) Procédé et appareil de synchronisation vidéo et audio, et véhicule aérien sans pilote
CN111476911B (zh) 虚拟影像实现方法、装置、存储介质与终端设备
WO2020253844A1 (fr) Procédé et dispositif permettant de traiter des informations multimédia, et support de stockage
WO2019119434A1 (fr) Procédé de traitement d'informations, véhicule aérien sans pilote, appareil de commande à distance, et support de stockage non volatile
US11618586B2 (en) Detection and signaling of conditions of an unmanned aerial vehicle
CN108432237B (zh) 电子装置以及用于电子装置的控制方法、记录介质
WO2018232688A1 (fr) Procédé de commande d'un dispositif de photographie, dispositif de photographie et système
CN107439004B (zh) 一种跟踪和识别的方法、系统及飞行器
WO2018209575A1 (fr) Procédé et dispositif de transmission de données, support d'informations lisible par une machine, et système
US20230393808A1 (en) Image capture device control using mobile platform voice recognition
WO2023130706A1 (fr) Procédé de commande de synchronisation de trame à caméras multiples et dispositif automoteur
CN107172341B (zh) 一种无人机控制方法、无人机、地面站及无人机系统
WO2014208378A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations, programme, et système de traitement d'informations
US9699562B2 (en) Audio output control method and apparatus
WO2017185338A1 (fr) Procédé et appareil de génération de fichier audio-vidéo
US11671551B2 (en) Synchronization of multi-device image data using multimodal sensor data
US10991392B2 (en) Apparatus, electronic device, system, method and computer program for capturing audio signals
WO2017166239A1 (fr) Procédé, dispositif et système de commande d'obturateur de caméra
CN104253943A (zh) 使用移动终端的视频拍摄方法和装置
WO2021114950A1 (fr) Procédé de multiplexage de canal http à trajets multiples et terminal
US9578308B2 (en) Method and apparatus for low cost 3D video making
CN113436635A (zh) 分布式麦克风阵列的自校准方法、装置和电子设备
EP2490138A1 (fr) Procédé et agencement pour le transfert de données multimédia
WO2019023829A1 (fr) Procédé d'interférence de véhicule aérien sans pilote et dispositif d'interférence
CN115297093B (zh) 边缘设备数据访问方法、相关装置及计算机程序产品

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17915836

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17915836

Country of ref document: EP

Kind code of ref document: A1