CN107872605A - A kind of UAS and unmanned plane audio/video processing method - Google Patents
A kind of UAS and unmanned plane audio/video processing method Download PDFInfo
- Publication number
- CN107872605A CN107872605A CN201610851005.4A CN201610851005A CN107872605A CN 107872605 A CN107872605 A CN 107872605A CN 201610851005 A CN201610851005 A CN 201610851005A CN 107872605 A CN107872605 A CN 107872605A
- Authority
- CN
- China
- Prior art keywords
- video
- audio
- voice data
- recording device
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention discloses a kind of UAS and unmanned plane audio/video processing method, the UAS includes：Unmanned plane device；The unmanned plane device includes：The video acquisition module and communication module being arranged on unmanned aerial vehicle body；Video acquisition module is used to gather video data；The unmanned plane device also includes：Synthesis module；Communication module is used to receive voice data；The synthesis module is used for the video data for gathering the video acquisition module and synthesizes audio-video frequency media stream with the voice data of the video data synchronization；Or the UAS also includes：Synthesizer；The communication module is used to the video data transmitting that the video acquisition module gathers delivering to the synthesizer, and audio-video frequency media stream is synthesized by the video data and with the voice data of the video data synchronization by the synthesizer.The synchronous recording of voice data and video data can be realized and be effectively synthesized, reduce the recording scene of UAS more authentic and validly.
Description
Technical field
The present invention relates to unmanned air vehicle technique field, and in particular to a kind of UAS and unmanned plane audio frequency and video processing side
Method.
Background technology
Unmanned plane is also known as UAV, is divided into rotor wing unmanned aerial vehicle and fixed-wing unmanned plane, in civil area with rotor
Unmanned plane is Main Morphology, the non-manned aircraft manipulated using beeper and presetting apparatus.Since 2015
Presentation ascendant trend is compared in the unmanned plane market of consumer level, and more and more unmanned plane products with HD video recording function go out
It is existing, shoot, applied in special and civil area for HD video.
The unmanned plane of video capture function is generally configured with, it is general by the way of unmanned plane equipment end hangs video camera.With
The progress of SOC technologies, the development of high-definition camera technology, possesses the unmanned plane of UAV Flight Control and video taking capability
It is further also more and more to miniaturization evolution, the Small and micro-satellite of built-in HD video shoot function.Clapped with video
The integrated unmanned plane of camera shooting function is mainly by rotor, fuselage, core flight control hardware, video record hardware composition.Relative to
The common equipment with video acquisition function, the general collection for supporting sound simultaneously, such as：Digital video recorder (DV), tool
There is the smart mobile phone of video capture function, it is possible to achieve synchronous recording audio content and video content are into same file or straight
Connected the function that wireless network transmissions are gone out.H.264 or HEVC the video source coding techniques of main flow mainly uses MPEG2,
Etc. video encoding standard, the audio decoding techniques of main flow mainly use the audio coding standards such as PCM, MP3, AAC or Opus.And nothing
Man-machine device, there are its particularity, particularly rotor wing unmanned aerial vehicle because fuselage rotor can produce larger mechanicalness noise and flight wind is made an uproar,
Substantial amounts of noise can be recorded by carrying out sound collection using the airborne microphone carried of unmanned machine equipment, therefore be taken on most unmanned planes
Disappeared airborne microphone, and video record module on such unmanned plane device body body gathers video content, is recorded to
Video content is not include acoustic information, and audio content to video mainly by way of off-line editing when post-processing
It is added, the addition of this audio content is needed by special audio frequency and video software for editing, by sound accompaniment or aside voice mixing
Into video file.
It can be seen that existing unmanned plane product is without the audio data collecting for solving the problems, such as to associate with video well,
It is all less desirable in terms of real-time and ease for use even if being added by way of later stage compilation.
The content of the invention
In view of the above problems, it is proposed that the present invention solves the above problems or solved at least in part to provide one kind
State the UAS and unmanned plane audio/video processing method of problem.
According to one aspect of the present invention, there is provided a kind of UAS, the UAS include：Unmanned plane fills
Put；
The unmanned plane device includes：The video acquisition module and communication module being arranged on unmanned aerial vehicle body；
The video acquisition module is used to gather video data；
The unmanned plane device also includes：Synthesis module；The communication module is used to receive voice data；The synthesis mould
Block is used for the video data for gathering the video acquisition module and synthesized with the voice data of the video data synchronization
Audio-video frequency media stream；
Or
The UAS also includes：Synthesizer；The communication module is used to gather the video acquisition module
Video data transmitting deliver to the synthesizer, by the synthesizer by the video data and same with the video data
The voice data of step synthesizes audio-video frequency media stream.
Alternatively, the UAS also includes：Recording device；The voice data is gathered by the recording device
's；
The communication module, for receiving control instruction, timestamp is carried in the control instruction；
The video acquisition module, for the time indicated by the timestamp carried in the control instruction to be arranged to work as
Preceding local zone time, and start to gather video data；
The recording device, for receiving the control instruction；Indicated by the timestamp that will be carried in the control instruction
Time be arranged to current local time, and start gather voice data.
Alternatively, temporal information is included in the video data, temporal information is included in the voice data；
The communication module, the voice data of the recording device transmission is received for the cycle to schedule；It is described
Synthesis module, video data and voice data for temporal information to be matched synthesize audio-video frequency media stream；
Or
The synthesizer, voice data and the institute that the recording device is sent are received for the cycle to schedule
State the video data of video acquisition module collection；And video data and voice data that temporal information matches are synthesized into sound and regarded
Frequency Media Stream.
Alternatively, the UAS also includes：Control device；
The control device, for carrying out clock alignment to the video acquisition module and the recording device so that institute
The local clock for stating video acquisition module and the recording device is synchronous with reference clock；
The control device, for sending the control instruction to the communication module and the recording device respectively.
Alternatively, when the UAS includes the synthesizer, the synthesizer is arranged at the control
In device.
Alternatively, the recording device is one or more；
When the recording device is multiple,
The communication module is used to receive the multistage voice data that the multiple recording device is sent；The synthesis module is used
Audio-video frequency media stream is synthesized in the video data and multistage voice data that temporal information matches, in the audio-video frequency media stream
Including a plurality of audio stream；Or the synthesis module is used to the multistage voice data that temporal information matches being mixed into one
Audio stream, then video data that temporal information matches and the audio stream are synthesized into audio-video frequency media stream, audio frequency and video matchmaker
Body stream includes an audio stream；
Or
The synthesizer receives the multistage voice data that the multiple recording device is sent；And temporal information is matched
Video data and multistage voice data synthesize audio-video frequency media stream, the audio-video frequency media stream includes a plurality of audio stream；Or
Person, the multistage voice data that temporal information matches is mixed into an audio stream, then the video counts that temporal information is matched
Audio-video frequency media stream is synthesized according to the audio stream, the audio-video frequency media stream includes an audio stream.
Alternatively, the communication module is connected with the control device by wireless network, the control device with it is described
Recording device is connected by wireless network；
When the unmanned plane device includes synthesis module, the communication module passes through wireless network with the recording device
Network connects；The unmanned plane device, the recording device and the control device are in identical wireless network.
According to another aspect of the present invention, there is provided a kind of unmanned plane audio/video processing method, this method include：
Video data is gathered by the video acquisition module being arranged on unmanned aerial vehicle body；
Voice data is gathered by the recording device being separated with unmanned aerial vehicle body；
The video data of the video acquisition module collection is obtained, obtains the voice data of the recording device collection, will
The video data and synthesize audio-video frequency media stream with the voice data of the video data synchronization.
Alternatively, the video acquisition module collection video data by being arranged on unmanned aerial vehicle body includes：
Control instruction is sent to the video acquisition module, timestamp is carried in the control instruction；So that the video
The time indicated by timestamp that acquisition module will carry in the control instruction is arranged to current local time, and starts to gather
Video data；
The recording device collection voice data by being separated with unmanned aerial vehicle body includes：
To the recording device send the control instruction so that the recording device will carry in the control instruction
Time indicated by timestamp is arranged to current local time, and starts to gather voice data.
Alternatively, temporal information is included in the video data, temporal information is included in the voice data；
It is described to synthesize audio-video frequency media stream by the video data and with the voice data of the video data synchronization
Including：Video data and voice data that temporal information matches are synthesized into audio-video frequency media stream.
Alternatively, the recording device is one or more；
When the recording device is multiple, the voice data for obtaining the recording device collection includes：Obtain institute
State the multistage voice data of multiple recording device collections；
The video data that temporal information is matched and voice data, which synthesize audio-video frequency media stream, to be included：By the time
The video data and multistage voice data of information match synthesize audio-video frequency media stream, and the audio-video frequency media stream includes a plurality of
Audio stream；Or the multistage voice data that temporal information matches is mixed into an audio stream, then temporal information is matched
Video data and the audio stream synthesize audio-video frequency media stream, the audio-video frequency media stream includes an audio stream.
From the foregoing, on the one hand technical scheme provided by the invention utilizes the video acquisition being arranged on unmanned aerial vehicle body
Module gathers video data, on the other hand utilizes the recording device being separated with unmanned plane device to gather voice data, realizes and divide
From the video data acquiring and audio data collecting of formula, in the feelings for ensuring the clock of video acquisition module and recording device and being calibrated
Under condition, the video data of synchronous acquisition is synthesized with voice data, obtains audio-video frequency media stream；Because recording device does not exist
On unmanned plane device, recording device will not be by unmanned plane when with video acquisition module synchronous recording audio on unmanned plane device
Noise caused by device itself is disturbed, and can effectively realize the synchronous recording of voice data and video data, and then realize
The video data of synchronization and being effectively synthesized for voice data, can be more authentic and validly from the two dimensions reduction of sound and video
The recording scene of UAS.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention,
And can be practiced according to the content of specification, and in order to allow above and other objects of the present invention, feature and advantage can
Become apparent, below especially exemplified by the embodiment of the present invention.
Brief description of the drawings
By reading the detailed description of hereafter preferred embodiment, it is various other the advantages of and benefit it is common for this area
Technical staff will be clear understanding.Accompanying drawing is only used for showing the purpose of preferred embodiment, and is not considered as to the present invention
Limitation.And in whole accompanying drawing, identical part is denoted by the same reference numerals.In the accompanying drawings：
Fig. 1 shows a kind of schematic diagram of UAS according to an embodiment of the invention；
Fig. 2 shows the video data and voice data that temporal information according to an embodiment of the invention matches；
Fig. 3 shows a kind of schematic diagram of UAS in accordance with another embodiment of the present invention；
Fig. 4 shows a kind of schematic diagram of UAS according to another embodiment of the invention；
Fig. 5 shows a kind of flow chart of unmanned plane audio/video processing method according to an embodiment of the invention.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although the disclosure is shown in accompanying drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
Limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Completely it is communicated to those skilled in the art.
Fig. 1 shows a kind of schematic diagram of UAS according to an embodiment of the invention.As shown in figure 1, the nothing
Man-machine system 100 includes：Both unmanned plane device 110 and recording device 120, unmanned plane device 110 and recording device 120 are mutual
Separation.
Unmanned plane device 110 includes：The video acquisition module 111 and communication module 112 being arranged on unmanned aerial vehicle body, nothing
Human-machine device 110 flies up or landed process with unmanned aerial vehicle body carrying video acquisition module 111 and communication module 112.Video
Acquisition module 111 has clock alignment ability with recording device 120, and video acquisition module 111 is used to gather video data, recorded
Device 120 is used to gather voice data.
Unmanned plane device 110 also includes：Synthesis module 113；Communication module 112 is used to receive the transmission of recording device 120
Voice data；Synthesis module 113 be used for the video data that gathers video acquisition module 111 and with the video data synchronization
Voice data synthesizes audio-video frequency media stream.
Communication module 112 is connected with recording device 120 by wireless network.
It can be seen that on the one hand the UAS shown in Fig. 1 utilizes the video acquisition module 111 being arranged on unmanned aerial vehicle body
Video data is gathered, on the other hand utilizes the recording device 120 being separated with unmanned plane device 110 to gather voice data, realizes
The video data acquiring and audio data collecting of separate type, ensuring the clock quilt of video acquisition module 111 and recording device 120
In the case of calibration, the video data of synchronous acquisition is synthesized with voice data, obtains audio-video frequency media stream；Due to recording
Device 120 is not on unmanned plane device 110, and recording device 120 is same with the video acquisition module 111 on unmanned plane device 110
It will not be disturbed while walking recording audio by noise caused by unmanned plane device 110 itself, audio number can be effectively realized
According to the synchronous recording with video data, and then the video data of synchronization and being effectively synthesized for voice data are realized, can be trueer
The real recording scene that UAS 100 is effectively reduced from two dimensions of sound and video.
In one embodiment of the invention, in the UAS shown in Fig. 1, for unmanned plane device 110,
Communication module 112, for receiving control instruction, timestamp is carried in the control instruction；In the case of one kind, video acquisition module
111, the time for the timestamp carried in the control instruction to be indicated is arranged to current local time, and starts to gather video
Data；For recording device 120, recording device 120 receives identical control instruction, recording dress with communication module 112
Put 120 and the time of the timestamp carried in the control instruction instruction is arranged to current local time, and start to gather audio number
According to.Wherein, communication module 112 is simultaneously emitted by with the control instruction received by recording device 120, in receivable error
In the range of, communication module 112 receives the control instruction, and then video acquisition module 111 and recording simultaneously with recording device 120
The time that device 120 can indicate the timestamp in control instruction as current time, starts simultaneously at recorded content.
In another case, when video acquisition module 111 is carried out with recording device 120 before recorded content is started
The synchronous calibration of clock, then video acquisition module 111, connect for the local zone time when video acquisition module 111 with communication module 112
When the timestamp carried in the control instruction received matches, start to gather video data.For recording device 120, record
Mixer 120 receives identical control instruction with communication module 112, and recording device 120 receives the control instruction, works as recording
When the local zone time of device 120 matches with the timestamp carried in the control instruction, start to gather voice data.Wherein,
Because video acquisition module 111 and recording device 120 have identical clock, then video acquisition module 111 and recording device 120
Match respectively with the timestamp carried in the control instruction identical at the time of, start recorded video and audio respectively, i.e.,
Video acquisition module 111 is started simultaneously at recording device 120 and recorded.
Further, temporal information, the institute of recording device 120 are included in the video data that video acquisition module 111 is gathered
Temporal information, the temporal information included in the video data and the time included in voice data are included in the voice data of collection
Information is recorded according to identical clock.Communication module 112, recording device is received for the cycle to schedule
120 voice datas sent；Synthesis module 113, video data and voice data for temporal information to be matched synthesize
Audio-video frequency media stream；Fig. 2 shows the video data and audio number that temporal information according to an embodiment of the invention matches
According to.
In the UAS 100 shown in Fig. 1, synthesis module 113 is integrated in unmanned plane device 110, i.e., at nobody
The synthesis of video data and voice data is carried out in machine device 110, wherein, video data is by regarding in unmanned plane device 110
What frequency acquisition module 111 was gathered, voice data is gathered by recording device 120, and the present embodiment only need to be by recording device
120 voice datas gathered are sent into unmanned plane device 110.Because the data volume of voice data is less than the number of video data
According to amount, when the scheme synthesized after the less voice data of the present embodiment transmitted data amount can reduce transmission to a certain extent
Between and bandwidth usage, improve audio frequency and video combined coefficient.
In other embodiments of the invention, can not also be provided in unmanned plane device 110 to video data and
The synthesis module that voice data is synthesized, but the synthesis of video data and voice data is carried out in other devices.Fig. 3 shows
A kind of schematic diagram of UAS in accordance with another embodiment of the present invention is gone out, as shown in figure 3, the UAS 100
Including：Unmanned plane device 110, recording device 120 and synthesizer 130；Unmanned plane device 110 includes：It is arranged at unmanned plane machine
Video acquisition module 111 and communication module 112 with it, when video acquisition module 111 has identical with recording device 120
Clock, video acquisition module 111 are used to gather video data, and recording device 120 is used to gather voice data.In the present embodiment,
Communication module 112 is used to the video data transmitting that video acquisition module 111 gathers delivering to synthesizer 130, by synthesizer 130
Audio-video frequency media stream is synthesized by video data and with the voice data of the video data synchronization.Specifically, synthesizer 130
It is connected with the communication module 112 in unmanned plane device 110 by wireless network, synthesizer 130 passes through nothing with recording device 120
Line network connection, synthesizer 130 are used for the voice data and regard that cycle reception recording device 120 is sent to schedule
The video data that frequency acquisition module 111 gathers, and video data and voice data that temporal information matches are synthesized into sound and regarded
Frequency Media Stream.
In the UAS 100 shown in Fig. 3, video data and voice data are carried out not in unmanned plane device 110
Synthesis, but the synthesis of video data and voice data is carried out in synthesizer 130, it is necessary to by unmanned plane device 110
Video acquisition module 111 gather video data transmitting deliver in synthesizer 130, it is also necessary to recording device 120 is gathered
Voice data is sent into synthesizer 130.
Or in another embodiment, can also by above-mentioned synthesizer 130 and the integrated setting of recording device 120,
Then when carrying out the synthesis of video data and voice data, it is only necessary to which the video acquisition module 111 in unmanned plane device 110 is adopted
The video data transmitting of collection is delivered in synthesizer 130.
Fig. 4 shows a kind of schematic diagram of UAS according to another embodiment of the invention.As shown in figure 4, should
UAS includes：Unmanned plane device 110, recording device 120 and control device 140.
Unmanned plane device 110 includes：Unmanned aerial vehicle body and the video acquisition module 111 being arranged on unmanned aerial vehicle body, depending on
The communication module with the identical function of communication module 112 shown in Fig. 1 is integrated with frequency acquisition module 111 so that unmanned plane device
110 can be communicated with other devices.
Control device 140, for sending control instruction, the control to video acquisition module 111 and recording device 120 simultaneously
Timestamp is carried in instruction；After video acquisition module 111 receives the control instruction by communication module, by the control instruction
The time of the timestamp instruction of carrying starts simultaneously at collection video data as current local time；Recording device 120 receives
To after the control instruction, using the time of the timestamp carried in the control instruction instruction as current local time, and open simultaneously
Begin collection voice data.
Wherein, in a specific embodiment, control device 140 fills to video acquisition module 111 and recording at the same time
Before putting 120 transmission control instructions, default communication protocol can be first passed through to examine video acquisition module 111 and recording device
The time of information is received both 120 whether within an error insignificant time cycle, specifically, control device 140 is same
When to video acquisition module 111 and recording device 120 send detection signal, then receive video acquisition module 111 and recording respectively
Device 120 return confirmation signal, if video acquisition module 111 return confirmation signal time returned with recording device 120
Error between the time of confirmation signal is in the range of default acceptable error, then it is assumed that video acquisition module 111 and recording fill
Control instruction can be received simultaneously by putting 120, therefore control device 140 is again simultaneously to video acquisition module 111 and recording device
120 send control instruction.
Or control device 140, for carrying out clock alignment to video acquisition module 111 and recording device 120 so that
The local clock of video acquisition module 111 and recording device 120 is synchronous with reference clock.Control device 140, for respectively to
Video acquisition module 111 and recording device 120 send control instruction, and timestamp is carried in the control instruction；Video acquisition module
111 by communication module after the control instruction is received, when its local zone time and the timestamp phase that is carried in the control instruction
During matching, start to gather video data；Recording device 120 is after the control instruction is received, when its local zone time and the control
When the timestamp carried in system instruction matches, start to gather voice data.
No matter which kind of mode above-mentioned video acquisition module 111 and recording device 120 is controlled to record by control device 140 using
Content processed, control device 140 can only send a control instruction to control video acquisition module 111 and recording device 120
Recording starting time point, control device 140 can also in video acquisition module 111 and the midway of the recorded content of recording device 120,
The control instruction for carrying timestamp is sent again, to cause video acquisition module 111 and recording device 120 again to set timestamp
Current local time is set to, to eliminate the problem of clock after previous calibration may produce drift in the process of running so that whole
The clock alignment of individual recording process keeps accurate.
Then, the synthesis of video data and voice data is carried out：
In the case of one kind, video acquisition module 111 is also integrated with the conjunction with the identical function of synthesis module 113 shown in Fig. 1
Into module so that the synthesis of video data and voice data can be carried out in unmanned plane device 110.Video acquisition module 111
Temporal information is included in the video data gathered, temporal information, video are included in the voice data that recording device 120 is gathered
Acquisition module 111, the voice data of the transmission of recording device 120 is received by communication module for the cycle to schedule, and
The video data and voice data that temporal information matches are synthesized by audio-video frequency media stream by synthesis module.
In another case, do not have the function of being synthesized to video data and voice data in unmanned plane device 110,
It can be integrated with by the function setting in control device 140 in control device 140 and the phase of synthesizer 130 shown in Fig. 3
Same function, control device 140, receive video acquisition module 111 for the cycle to schedule and sent by communication module
Video data, and, to schedule the cycle receive the voice data that recording device 120 is sent, and by temporal information phase
The video data and voice data of matching synthesize audio-video frequency media stream.
In the UAS shown in Fig. 4, it can be seen that recording device 120 is one or more；Work as recording device
120 be one when, the recording device 120 gathers a section audio data within a time cycle, when the section audio packet contains
Between information, then UAS gather the section audio data and video acquisition module 111 in same a period of time one section
Video data is synthesized according to temporal information, obtains the audio-video frequency media stream with an audio stream.When recording device 120 is
When multiple, the plurality of recording device 120 gathers multistage voice data within a time cycle, when being included per section audio data
Between information, then UAS the multistage voice data and video acquisition module 111 are gathered in same a period of time one
Section video data is synthesized, including two ways：Multistage voice data is concurrently entered with video data according to temporal information
Row synthesis, obtains the audio-video frequency media stream with a plurality of audio stream；Or first mixed multistage voice data, obtain one
Bar audio stream, then the audio stream is synthesized with video data according to temporal information, obtain the sound with an audio stream and regard
Frequency Media Stream.
In one embodiment of the invention, the communication module in unmanned plane device 110 with control device 140 by wireless
Network connection, control device 140 are connected with recording device 120 by wireless network；When carrying out audio in unmanned plane device 110
During the synthesis of data and video data, the communication module in unmanned plane device 110 is connected with recording device 120 by wireless network
Connect；Unmanned plane device 110, recording device 120 and control device 140 are in identical wireless network.
For example, UAS in concert scene, sets four records in the four corners of the world four direction of stage respectively
Mixer 120, the voice data that this four recording devices 120 gather concert scene is utilized respectively, unmanned plane device 110 is existing
Field airflight, the video acquisition module 111 on unmanned plane device 110 is utilized to gather the video data at concert scene；Each
Recording device 120 is connected with the communication module in unmanned plane device 110 by wireless network；Control device 140 is respectively with four
Individual recording device 120 is connected by wireless network, and control device 140 passes through wireless with the communication module in unmanned plane device 110
Network connection.Clock is respectively to video acquisition module 111 and four recording devices on the basis of the clock local by control device 140
120 enter row clock synchronization so that video acquisition module 111 and four recording devices 120 are respectively provided with identical clock.Control device
140 send control instructions to video acquisition module 111 and four recording devices 120 respectively so that video acquisition module 111 with
And four recording devices 120 start recorded content, video acquisition module when the timestamp with being carried in control instruction matches
111 video datas recorded include temporal information, and the voice data that each recording device is recorded also includes temporal information.Unmanned plane
Synthesis module is also provided with device 110, then the four section audio data recorded four recording devices 120 are sent to unmanned plane
In device 110, video data and four section audio Data Synthesis can be to include four by the synthesizer in unmanned plane device 110
The audio-video frequency media stream of audio stream, four section audio data mixings can also be first one by the synthesizer in unmanned plane device 110
Bar audio stream, then video data and an audio stream are synthesized to the audio-video frequency media stream for including an audio stream.
In one embodiment of the invention, UAV Flight Control unit is also included in unmanned plane device 110, for controlling
The state of flight of unmanned aerial vehicle body processed.
In one embodiment of the invention, control device 140 can be such as smart mobile phone, PAD mobile terminals, record
Device 120 and control device 140 can be integrated in same equipment, and recording device 120 and control device are such as integrated in into shifting
In dynamic terminal (such as smart mobile phone).
Fig. 5 shows a kind of flow chart of unmanned plane audio/video processing method according to an embodiment of the invention.Such as Fig. 5
Shown, this method includes：
Step S510, video data is gathered by the video acquisition module being arranged on unmanned aerial vehicle body.
Step S520, voice data is gathered by the recording device being separated with unmanned aerial vehicle body.
Step S530, the video data of the video acquisition module collection is obtained, obtain the sound of the recording device collection
Frequency evidence, audio-video frequency media stream is synthesized by the video data and with the voice data of the video data synchronization.
It can be seen that on the one hand the method shown in Fig. 5 utilizes the video acquisition module collection video being arranged on unmanned aerial vehicle body
Data, on the other hand utilize the recording device being separated with unmanned plane device to gather voice data, realize the video counts of separate type
According to collection and audio data collecting, in the case where ensuring that video acquisition module and recording device are synchronized time calibration,
The video data of synchronous acquisition is synthesized with voice data, obtains audio-video frequency media stream；Because recording device is not at nobody
On machine device, recording device will not be by unmanned plane while with video acquisition module synchronous recording audio on unmanned plane device
Noise caused by device itself is disturbed, and can effectively realize the synchronous recording of voice data and video data, and then realize
The video data of synchronization and being effectively synthesized for voice data, can be more authentic and validly from the two dimensions reduction of sound and video
The recording scene of UAS.
In one embodiment of the invention, step S510 is adopted by the video acquisition module being arranged on unmanned aerial vehicle body
Collection video data includes：Control instruction is sent to the video acquisition module, timestamp is carried in the control instruction；So that institute
Stating the time indicated by the timestamp that video acquisition module will carry in the control instruction is arranged to current local time, and opens
Begin collection video data.Step S520 gathers voice data by the recording device being separated with unmanned aerial vehicle body to be included：To institute
State recording device and send the control instruction so that indicated by the timestamp that the recording device will carry in the control instruction
Time be arranged to current local time, and start gather voice data.
In another embodiment of the present invention, in the video data for obtaining the video acquisition module collection, obtain
Before the voice data for taking the recording device collection, the method shown in Fig. 1 further comprises：Regarded by reference clock to described
Frequency acquisition module and the recording device carry out clock alignment so that the local of the video acquisition module and the recording device
Clock is synchronous with reference clock.
Wherein, step S510 gathers video data by the video acquisition module being arranged on unmanned aerial vehicle body and included：To
The video acquisition module sends control instruction, and timestamp is carried in the control instruction；So that the video acquisition module is worked as
Its local zone time starts to gather video data when with the timestamp carried in the control instruction matching；Step S520 by with
The recording device collection voice data that unmanned aerial vehicle body is separated includes：The control instruction is sent to the recording device, is made
The recording device is obtained when the timestamp carried in its local zone time and the control instruction matches, starts to gather audio number
According to.
In one embodiment of the invention, temporal information is included in video data, temporal information is included in voice data；
Step S530 is by the video data and synthesizes audio-video frequency media stream with the voice data of the video data synchronization and includes：
Video data and voice data that temporal information matches are synthesized into audio-video frequency media stream.
In one embodiment of the invention, recording device is one or more；When the recording device is multiple, step
The voice data that rapid S530 obtains the recording device collection includes：Obtain more section audio numbers of the multiple recording device collection
According to；Video data and voice data that temporal information matches are synthesized audio-video frequency media stream by step S530 to be included：By the time
The video data and multistage voice data of information match synthesize audio-video frequency media stream, and the audio-video frequency media stream includes a plurality of
Audio stream；Or the multistage voice data that temporal information matches is mixed into an audio stream, then temporal information is matched
Video data and the audio stream synthesize audio-video frequency media stream, the audio-video frequency media stream includes an audio stream.
It should be noted that each embodiment of method shown in Fig. 5 and each embodiment pair of UAS shown in Fig. 1-Fig. 4
Should be identical, above it has been described in detail, has will not be repeated here.
In summary, on the one hand technical scheme provided by the invention utilizes the video acquisition mould being arranged on unmanned aerial vehicle body
Block gathers video data, on the other hand utilizes the recording device being separated with unmanned plane device to gather voice data, realizes separation
The video data acquiring and audio data collecting of formula, ensuring that video acquisition module and recording device entered row clock synchronous calibration
In the case of, the video data of synchronous acquisition is synthesized with voice data, obtains audio-video frequency media stream；Due to recording device
Not on unmanned plane device, recording device will not while with video acquisition module synchronous recording audio on unmanned plane device
The noise caused by unmanned plane device itself disturbs, and can effectively realize the synchronous recording of voice data and video data,
And then the video data of synchronization and being effectively synthesized for voice data are realized, can be more authentic and validly from sound and video two
Dimension reduces the recording scene of UAS, has the advantages that：(1) real-time synchronization is recorded while recorded video,
Solve the problems, such as that unmanned plane recorded video does not have sound；(2) simply, flexibly, it is easy to accomplish；(3) it is inexpensive；(4) multichannel is supported
Voice data is recorded simultaneously；(5) autgmentability is strong.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent substitution and improvements made within the spirit and principles in the present invention etc., are all contained in protection scope of the present invention
It is interior.
Claims (10)
1. a kind of UAS, it is characterised in that the UAS includes：Unmanned plane device；
The unmanned plane device includes：The video acquisition module and communication module being arranged on unmanned aerial vehicle body；
The video acquisition module is used to gather video data；
The unmanned plane device also includes：Synthesis module；The communication module is used to receive voice data；The synthesis module is used
In the video data for gathering the video acquisition module and synthesize sound with the voice data of the video data synchronization and regard
Frequency Media Stream；
Or
The UAS also includes：Synthesizer；The communication module is used to regard what the video acquisition module gathered
Frequency according to sending to the synthesizer, by the synthesizer by the video data and with the video data synchronization
Voice data synthesizes audio-video frequency media stream.
2. UAS as claimed in claim 1, it is characterised in that the UAS also includes：Recording device；Institute
Voice data is stated to be gathered by the recording device；
The communication module, for receiving control instruction, timestamp is carried in the control instruction；
The video acquisition module, for the time indicated by the timestamp carried in the control instruction to be arranged into current sheet
The ground time, and start to gather video data；
The recording device, for receiving the control instruction, and indicated by the timestamp that will be carried in the control instruction
Time is arranged to current local time, and starts to gather voice data.
3. UAS as claimed in claim 2, it is characterised in that temporal information is included in the video data, it is described
Temporal information is included in voice data；
The communication module, the voice data of the recording device transmission is received for the cycle to schedule；The synthesis
Module, video data and voice data for temporal information to be matched synthesize audio-video frequency media stream；
Or
The synthesizer, receive voice data that the recording device sends for the cycle to schedule and described regard
The video data of frequency acquisition module collection；And the video data and voice data that temporal information matches are synthesized into audio frequency and video matchmaker
Body stream.
4. UAS as claimed in claim 2, it is characterised in that the UAS also includes：Control device；
The control device, for carrying out clock alignment to the video acquisition module and the recording device so that described to regard
The local clock of frequency acquisition module and the recording device is synchronous with reference clock；
The control device, for sending the control instruction to the communication module and the recording device respectively.
5. UAS as claimed in claim 4, it is characterised in that
When the UAS includes the synthesizer, the synthesizer is arranged in the control device.
6. UAS as claimed in claim 3, it is characterised in that the recording device is one or more；
When the recording device is multiple,
The communication module is used to receive the multistage voice data that the multiple recording device is sent；The synthesis module is used for will
The video data and multistage voice data that temporal information matches synthesize audio-video frequency media stream, and the audio-video frequency media stream includes
A plurality of audio stream；Or the synthesis module is used to the multistage voice data that temporal information matches being mixed into an audio
Stream, then video data that temporal information matches and the audio stream are synthesized into audio-video frequency media stream, the audio-video frequency media stream
Include an audio stream；
Or
The synthesizer receives the multistage voice data that the multiple recording device is sent；And regarded what temporal information matched
Frequency evidence and multistage voice data synthesize audio-video frequency media stream, and the audio-video frequency media stream includes a plurality of audio stream；Or will
The multistage voice data that temporal information matches is mixed into an audio stream, then the video data that temporal information is matched and institute
State audio stream and synthesize audio-video frequency media stream, the audio-video frequency media stream includes an audio stream.
7. UAS as claimed in claim 5, it is characterised in that
The communication module is connected with the control device by wireless network, and the control device passes through with the recording device
Wireless network connects；
When the unmanned plane device includes synthesis module, the communication module is connected with the recording device by wireless network
Connect；The unmanned plane device, the recording device and the control device are in identical wireless network.
8. a kind of unmanned plane audio/video processing method, it is characterised in that this method includes：
Video data is gathered by the video acquisition module being arranged on unmanned aerial vehicle body；
Voice data is gathered by the recording device being separated with unmanned aerial vehicle body；
The video data of the video acquisition module collection is obtained, the voice data of the recording device collection is obtained, by described in
Video data and synthesize audio-video frequency media stream with the voice data of the video data synchronization.
9. method as claimed in claim 8, it is characterised in that the video acquisition mould by being arranged on unmanned aerial vehicle body
Block collection video data includes：
Control instruction is sent to the video acquisition module, timestamp is carried in the control instruction；So that the video acquisition
The time that the timestamp carried in the control instruction indicates is arranged to current local time by module, and starts to gather video counts
According to；
The recording device collection voice data by being separated with unmanned aerial vehicle body includes：
The control instruction is sent to the recording device so that the time that the recording device will carry in the control instruction
The time of stamp instruction is arranged to current local time, and starts to gather voice data.
10. method as claimed in claim 9, it is characterised in that temporal information, the audio number are included in the video data
Temporal information is included in；
It is described by the video data and to synthesize audio-video frequency media stream with the voice data of the video data synchronization and include：
Video data and voice data that temporal information matches are synthesized into audio-video frequency media stream.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610851005.4A CN107872605A (en) | 2016-09-26 | 2016-09-26 | A kind of UAS and unmanned plane audio/video processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610851005.4A CN107872605A (en) | 2016-09-26 | 2016-09-26 | A kind of UAS and unmanned plane audio/video processing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107872605A true CN107872605A (en) | 2018-04-03 |
Family
ID=61751841
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610851005.4A Pending CN107872605A (en) | 2016-09-26 | 2016-09-26 | A kind of UAS and unmanned plane audio/video processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107872605A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107979731A (en) * | 2016-10-25 | 2018-05-01 | 杭州萤石网络有限公司 | A kind of method, apparatus and system for obtaining audio, video data |
| CN110022449A (en) * | 2019-03-01 | 2019-07-16 | 苏州臻迪智能科技有限公司 | A kind of audio and video synthetic method, device, electronic equipment and storage medium |
| CN110300322A (en) * | 2019-04-24 | 2019-10-01 | 网宿科技股份有限公司 | A kind of method of screen recording, client and terminal device |
| CN110855886A (en) * | 2019-11-19 | 2020-02-28 | 中国北方车辆研究所 | Unmanned platform remote control operation visual sound system |
| CN111447396A (en) * | 2020-03-06 | 2020-07-24 | 视联动力信息技术股份有限公司 | Audio and video transmission method and device, electronic equipment and storage medium |
| WO2020177483A1 (en) * | 2019-03-01 | 2020-09-10 | 苏州臻迪智能科技有限公司 | Method and apparatus for processing audio and video, electronic device, and storage medium |
| CN112235597A (en) * | 2020-09-17 | 2021-01-15 | 深圳市捷视飞通科技股份有限公司 | Method and device for synchronous protection of streaming media live broadcast audio and video and computer equipment |
| CN112689049A (en) * | 2020-12-21 | 2021-04-20 | 苏州臻迪智能科技有限公司 | Sound receiving method and device, electronic equipment and computer readable storage medium |
| CN113419557A (en) * | 2021-06-17 | 2021-09-21 | 哈尔滨工业大学 | Audio synthesis method for unmanned aerial vehicle |
| CN113596549A (en) * | 2020-10-13 | 2021-11-02 | 杭州涂鸦信息技术有限公司 | Audio and video synchronization method and device based on different reference clocks and computer equipment |
| WO2022111712A1 (en) * | 2020-11-30 | 2022-06-02 | 华为技术有限公司 | Audio and video synchronization method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103673996A (en) * | 2013-12-10 | 2014-03-26 | 苏州市峰之火数码科技有限公司 | Method for conveniently acquiring good aerial sound |
| CN103822617A (en) * | 2013-12-11 | 2014-05-28 | 苏州市峰之火数码科技有限公司 | Aerial photography sound effect enhancing method |
| CN104038716A (en) * | 2014-05-19 | 2014-09-10 | 新疆午马广告传媒有限公司 | Unmanned aerial photography machine synchronous sound recording method |
| WO2015002586A1 (en) * | 2013-07-04 | 2015-01-08 | Telefonaktiebolaget L M Ericsson (Publ) | Audio and video synchronization |
| CN105141822A (en) * | 2015-09-22 | 2015-12-09 | 杨珊珊 | Aerial photography device and aerial photography method thereof |
-
2016
- 2016-09-26 CN CN201610851005.4A patent/CN107872605A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015002586A1 (en) * | 2013-07-04 | 2015-01-08 | Telefonaktiebolaget L M Ericsson (Publ) | Audio and video synchronization |
| CN103673996A (en) * | 2013-12-10 | 2014-03-26 | 苏州市峰之火数码科技有限公司 | Method for conveniently acquiring good aerial sound |
| CN103822617A (en) * | 2013-12-11 | 2014-05-28 | 苏州市峰之火数码科技有限公司 | Aerial photography sound effect enhancing method |
| CN104038716A (en) * | 2014-05-19 | 2014-09-10 | 新疆午马广告传媒有限公司 | Unmanned aerial photography machine synchronous sound recording method |
| CN105141822A (en) * | 2015-09-22 | 2015-12-09 | 杨珊珊 | Aerial photography device and aerial photography method thereof |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107979731A (en) * | 2016-10-25 | 2018-05-01 | 杭州萤石网络有限公司 | A kind of method, apparatus and system for obtaining audio, video data |
| CN110022449A (en) * | 2019-03-01 | 2019-07-16 | 苏州臻迪智能科技有限公司 | A kind of audio and video synthetic method, device, electronic equipment and storage medium |
| WO2020177483A1 (en) * | 2019-03-01 | 2020-09-10 | 苏州臻迪智能科技有限公司 | Method and apparatus for processing audio and video, electronic device, and storage medium |
| CN110300322B (en) * | 2019-04-24 | 2021-07-13 | 网宿科技股份有限公司 | Screen recording method, client and terminal equipment |
| CN110300322A (en) * | 2019-04-24 | 2019-10-01 | 网宿科技股份有限公司 | A kind of method of screen recording, client and terminal device |
| US11115706B2 (en) | 2019-04-24 | 2021-09-07 | Wangsu Science & Technology Co., Ltd. | Method, client, and terminal device for screen recording |
| CN110855886A (en) * | 2019-11-19 | 2020-02-28 | 中国北方车辆研究所 | Unmanned platform remote control operation visual sound system |
| CN111447396A (en) * | 2020-03-06 | 2020-07-24 | 视联动力信息技术股份有限公司 | Audio and video transmission method and device, electronic equipment and storage medium |
| CN112235597A (en) * | 2020-09-17 | 2021-01-15 | 深圳市捷视飞通科技股份有限公司 | Method and device for synchronous protection of streaming media live broadcast audio and video and computer equipment |
| CN112235597B (en) * | 2020-09-17 | 2022-07-29 | 深圳市捷视飞通科技股份有限公司 | Method and device for synchronous protection of streaming media live broadcast audio and video and computer equipment |
| CN113596549A (en) * | 2020-10-13 | 2021-11-02 | 杭州涂鸦信息技术有限公司 | Audio and video synchronization method and device based on different reference clocks and computer equipment |
| CN113596549B (en) * | 2020-10-13 | 2023-09-22 | 杭州涂鸦信息技术有限公司 | Audio and video synchronization method and device based on different reference clocks and computer equipment |
| WO2022111712A1 (en) * | 2020-11-30 | 2022-06-02 | 华为技术有限公司 | Audio and video synchronization method and device |
| CN114584648A (en) * | 2020-11-30 | 2022-06-03 | 华为技术有限公司 | Method and equipment for synchronizing audio and video |
| CN112689049A (en) * | 2020-12-21 | 2021-04-20 | 苏州臻迪智能科技有限公司 | Sound receiving method and device, electronic equipment and computer readable storage medium |
| CN113419557A (en) * | 2021-06-17 | 2021-09-21 | 哈尔滨工业大学 | Audio synthesis method for unmanned aerial vehicle |
| CN113419557B (en) * | 2021-06-17 | 2022-07-19 | 哈尔滨工业大学 | Audio synthesis method for unmanned aerial vehicle |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107872605A (en) | A kind of UAS and unmanned plane audio/video processing method | |
| DE60307200T2 (en) | Communication protocol for the transmission control of timing data over a bus between devices in synchronization with a periodic reference signal | |
| TWI595786B (en) | Timestamp-based audio and video processing method and system thereof | |
| CN1231059C (en) | Data transmitting method, data receiving method, data transmitting device and data receiving device | |
| CN102655584B (en) | The method and system that media data sends and played in a kind of Telepresence | |
| CN103828384B (en) | Wireless channel perception self-adaption video bitrate coding based on software | |
| JP2001523927A (en) | How to filter a packet data stream | |
| CN100452885C (en) | High-speeld code-flow playing and receiving device based on PCI | |
| CN104071333A (en) | Big dipper and 4G-based unmanned aerial vehicle | |
| CN203167160U (en) | System wirelessly and synchronously transmitting video images and telemeasuring data | |
| CN110865782B (en) | Data transmission method, device and equipment | |
| CN106034258A (en) | Router and broadcasting method for multipath broadcast digital television signals | |
| CN107197317A (en) | The live broadcasting method and system of LAN multiple signals | |
| CN106231226A (en) | Audio-visual synthetic method, Apparatus and system | |
| JP2005033630A (en) | Information processor and method, program recording medium, and program | |
| CN206332831U (en) | USB microphone array multichannel harvester based on XMOS platforms | |
| EP3196876B1 (en) | Transmitting device, transmitting method, receiving device and receiving method | |
| CN103188531A (en) | Multi-source signal collection system and method | |
| CN104954725A (en) | SDI (Serial Digital Interface)-based bidirectional auxiliary data transmission method | |
| CN104579625B (en) | DRM single-frequency network synchronization implementation methods based on ARM and CPLD | |
| CN103929233B (en) | A kind of method for mixing multi-standard Remote Radio Unit and its transmission time division signal | |
| CN102821341B (en) | Two-wire digital audio interface | |
| EP3258467B1 (en) | Transmission and reception of audio streams | |
| US11363570B1 (en) | System and method for providing real time audio content to flying camera video | |
| CN101500124A (en) | Method for transmitting WLAN signal in wired television system and passive network bridge |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180403 |