CN111615826A - Video processing method, device, system and medium - Google Patents
Video processing method, device, system and medium Download PDFInfo
- Publication number
- CN111615826A CN111615826A CN201980007974.3A CN201980007974A CN111615826A CN 111615826 A CN111615826 A CN 111615826A CN 201980007974 A CN201980007974 A CN 201980007974A CN 111615826 A CN111615826 A CN 111615826A
- Authority
- CN
- China
- Prior art keywords
- video
- video data
- receivers
- data packets
- continuous
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64C—AEROPLANES; HELICOPTERS
- B64C39/00—Aircraft not otherwise provided for
- B64C39/02—Aircraft not otherwise provided for characterised by special use
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U10/00—Type of UAV
- B64U10/10—Rotorcrafts
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
- B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Mechanical Engineering (AREA)
- Remote Sensing (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention provides a video processing method, a device, a system and a medium, wherein the method comprises the following steps: receiving videos shot by an unmanned aerial vehicle flying at a flight site through a plurality of receivers arranged at the flight site at intervals; acquiring video data packets of the video received by each of the plurality of receivers, and generating a continuous video from the video data packets acquired from the plurality of receivers; and sending the continuous video to display equipment so that the display equipment can display the continuous video, thereby improving the image transmission quality and ensuring that the display equipment still displays the continuous video shot by the unmanned aerial vehicle to a user even if the unmanned aerial vehicle can fly in various sheltering environments.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a video processing method, apparatus, system, and medium.
Background
The implementation process of the racing sports of the unmanned aerial vehicle can be as follows: the unmanned aerial vehicle is hung with the shooting device, and in the racing process of the unmanned aerial vehicle, the shooting device sends the video collected in real time to display equipment of a user, such as the display equipment worn by the user, for example, head-mounted display equipment worn by the user. By playing the video through the display device, the user can experience a sensation of sitting in the cockpit.
In order to enhance ornamental and entertainment properties, the flying field of the unmanned aerial vehicle racing sports can be specially arranged, and factors influencing wireless signal transmission, such as walls, tunnels, metal/nonmetal barriers, terrain shielding and the like, are generated. However, due to the above factors, the display device has problems of delay, even chain breakage and the like in the process of receiving the video, and the video received by the display device has phenomena of sticking, blurring or flickering and the like, so that the image transfer amount is low.
Disclosure of Invention
In view of this, embodiments of the present invention provide a video processing method, an apparatus, a system, and a medium, which can improve image transmission quality and ensure that a display device still displays a continuous video captured by an unmanned aerial vehicle to a user even when the unmanned aerial vehicle can fly in various occlusion environments.
A first aspect of an embodiment of the present invention provides a video processing method, where the method includes:
receiving videos shot by an unmanned aerial vehicle flying at a flight site through a plurality of receivers arranged at the flight site at intervals;
acquiring video data packets of the video received by each of the plurality of receivers, and generating a continuous video from the video data packets acquired from the plurality of receivers;
and sending the continuous video to a display device to enable the display device to display the continuous video.
A second aspect of the embodiments of the present invention provides a video processing apparatus, including a memory and a processor;
the memory is used for storing program codes;
the processor, invoking the program code, when executed, is configured to:
receiving videos shot by an unmanned aerial vehicle flying at a flight site through a plurality of receivers arranged at the flight site at intervals;
acquiring video data packets of the video received by each of the plurality of receivers, and generating a continuous video from the video data packets acquired from the plurality of receivers;
and sending the continuous video to a display device to enable the display device to display the continuous video.
A third aspect of an embodiment of the present invention provides a video processing system, including a plurality of receivers arranged at intervals on a flight site, an unmanned aerial vehicle flying at the flight site, a video processing apparatus, and a display device, wherein:
the unmanned aerial vehicle is used for shooting videos;
the plurality of receivers are used for receiving videos shot by the unmanned aerial vehicle and sending video data packets of the videos to the video processing device;
the video processing device is configured to acquire a video data packet of the video received by each of the plurality of receivers, generate a continuous video according to the video data packet acquired from the plurality of receivers, and send the continuous video to the display device;
the display device is used for displaying the continuous video.
A fourth aspect of the embodiments of the present invention provides a computer storage medium, in which computer program instructions are stored, and the computer program instructions, when executed by a processor, are configured to perform the video processing method according to the first aspect.
In the embodiment of the invention, the video shot by the unmanned aerial vehicle flying at the flying field is received by the plurality of receivers arranged at intervals at the flying field, the video data packet of the video received by each of the plurality of receivers is obtained, the continuous video is generated according to the video data packets obtained from the plurality of receivers, and the continuous video is sent to the display device so as to enable the display device to display the continuous video. By the mode, the image transmission quality can be improved, and the display equipment can still display continuous videos shot by the unmanned aerial vehicle to a user even if the unmanned aerial vehicle can fly in various sheltering environments.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic diagram of a video processing system according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a continuous video according to an embodiment of the present invention;
fig. 3 is a schematic flow chart of a video processing method according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a flight competition scenario according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of another continuous video proposed by an embodiment of the present invention;
fig. 6 is a schematic flow chart of another video processing method proposed by the embodiment of the present invention;
fig. 7 is a schematic flow chart of another video processing method according to an embodiment of the present invention;
fig. 8 is a schematic flow chart of another video processing method proposed by the embodiment of the present invention;
fig. 9 is a block diagram of a video processing apparatus according to an embodiment of the present invention.
Detailed Description
In order to better understand the video processing method, apparatus, system, and medium disclosed in the embodiments of the present application, a video processing system to which the embodiments of the present application are applicable is first described below.
Referring to fig. 1, fig. 1 is a schematic diagram of an architecture of a video processing system according to an embodiment of the present disclosure. As shown in fig. 1, the video processing system includes at least a video processing apparatus 101, a plurality of receivers 102, at least one unmanned aerial vehicle 103, and at least one display device 104. A plurality of receivers 102 are provided at intervals in a flight field in which at least one unmanned aerial vehicle 103 flies.
Each unmanned aerial vehicle in the at least one unmanned aerial vehicle 103 is mounted with a shooting device, and the unmanned aerial vehicle can shoot videos of the unmanned aerial vehicle in the flying process of the flying field in real time through the shooting device. Each of the at least one unmanned aerial vehicle 103 establishes a communication connection with the plurality of receivers 102, and each of the at least one unmanned aerial vehicle 103 transmits the video acquired by shooting to the plurality of receivers 102.
The plurality of receivers 102 establish a communication connection with the video processing apparatus 101, and the plurality of receivers 102 can transmit video captured by shooting by the unmanned aerial vehicle to the video processing apparatus 101.
The video processing apparatus 101 may acquire video data packets of video received by each of the plurality of receivers 102 and generate continuous video from the video data packets acquired from the plurality of receivers. The video processing apparatus 101 establishes a communication connection with at least one display device 104, and the video processing apparatus 101 transmits the continuous video to the at least one display device 104.
The at least one display device 104 displays continuous video.
The video processing apparatus 101 may be operated in a ground station, a personal computer, a smart phone (such as an Android phone and an iOS phone), a tablet computer, a palm computer, or a Mobile Internet Device (MID) terminal.
Each of the plurality of receivers 102 may include an antenna, a radio frequency front end, baseband processing, and a decoder. Each of the plurality of receivers 102 may receive, through an antenna, a video captured by each of the at least one unmanned aerial vehicle 103, and process, through a radio frequency front end, a baseband processing and decoding device, the video captured by the unmanned aerial vehicle, so as to obtain a video data packet.
Each of the at least one unmanned aerial vehicle 103 may be a crossing machine or an unmanned racing machine, etc.
The display device 104 may be a terminal device configured with a display screen, and the terminal device configured with the display screen may include a wearable device, a personal computer, a smart phone (such as an Android phone, an iOS phone, and the like), a tablet computer, a palmtop computer, and the like. The wearable device may include a head-mounted display device, which may include glasses, a helmet, or a headband, etc., a watch, or a wrist band, etc.
The video processing system can realize digital image transmission, and specifically can be as follows: the video captured by the UAV shot received by the plurality of receivers 102 via the antenna may be encoded video, which may be a digital signal. The plurality of receivers 102 filter and decode the video captured by the unmanned aerial vehicle through the radio frequency front end and the baseband processing and decoding device, and obtain useful information in the video, namely video data packets. The plurality of receivers 102 may encode the video data packets and transmit the encoded video data packets to the video processing apparatus 101. The video processing apparatus 101 generates a continuous video from the video data packets, for example, the video processing apparatus 101 decodes the encoded video data packets, and performs a splicing process on the decoded video data packets to obtain a continuous video. The video processing apparatus 101 transmits the continuous video to the display device 104.
The continuous video may be a temporally continuous video. Taking the schematic diagram of the continuous video shown in fig. 2 as an example, the plurality of receivers 102 includes a first receiver, a second receiver, and a third receiver, where the first receiver receives videos captured by the unmanned aerial vehicle as video 1 and video 2, the second receiver receives videos captured by the unmanned aerial vehicle as video 1, video 2, and video 3, and the third receiver receives videos captured by the unmanned aerial vehicle as video 2, video 3, and video 4, where the video 1 includes a first frame of video captured by the unmanned aerial vehicle, the video 2 includes a second frame of video captured by the unmanned aerial vehicle, the video 3 includes a third frame of video captured by the unmanned aerial vehicle, and the video 4 includes a fourth frame of video captured by the unmanned aerial vehicle. After the video processing device acquires video data packets of videos received by the first receiver, the second receiver and the third receiver respectively, the video processing device selects a video data packet of video 1 from the video data packet of video 1 received by the first receiver and the video data packet of video 1 received by the second receiver, selects a video data packet of video 2 from the video data packet of video 2 received by the first receiver, the video data packet of video 2 received by the second receiver and the video data packet of video 2 received by the third receiver, selects a video data packet of video 3 from the video data packet of video 3 received by the second receiver and the video data packet of video 3 received by the third receiver, acquires a video data packet of video 4 received by the third receiver, and combines the selected video data packet of video 1, the selected video data packet of video 2, the selected video data packet of video 3, the video data packet of video 2, the video data packet of video 3, and the video data packet of video, And sequentially splicing the video data packet of the video 3 and the video data packet of the video 4 to obtain a continuous video, namely, the next frame of the first frame of video in the continuous video is a second frame of video, the next frame of the second frame of video is a third frame of video, and the next frame of the third frame of video is a fourth frame of video.
It should be noted that the video in the embodiment of the present application includes, but is not limited to, at least one frame of video captured by shooting by the unmanned aerial vehicle, for example, video 1 includes a first frame of video, a second frame of video, and a third frame of video captured by shooting by the unmanned aerial vehicle, and video 2 includes a fourth frame of video and a fifth frame of video captured by shooting by the unmanned aerial vehicle.
In the embodiment of the application, the plurality of receivers 102 send the received videos shot and acquired by the unmanned aerial vehicle 103 to the video processing device 101, the video processing device 101 acquires video data packets of the videos received by each of the plurality of receivers 102, the video processing device 101 generates continuous videos according to the video data packets acquired from the plurality of receivers, the video processing device 101 sends the continuous videos to the display device 104, the display device 104 displays the continuous videos, digital image transmission can be achieved, image transmission quality is improved, and it is ensured that the display device still displays the continuous videos shot by the unmanned aerial vehicle to a user even when the unmanned aerial vehicle can fly in various sheltering environments.
In one embodiment, at least one UAV 103 and at least one display device 104 are in a one-to-one correspondence, i.e., one display device for each UAV in at least one UAV 103. For example, the at least one UAV 103 includes a first UAV and a second UAV, and the at least one display device 104 includes a first display device and a second display device, the first UAV corresponding to the first display device, and the second UAV corresponding to the second display device. The video processing apparatus 101 may acquire a video data packet of the first video captured by the first drone and received by each of the plurality of receivers 102, generate a first continuous video from the video data packet of the first video acquired from the plurality of receivers, and transmit the first continuous video to the first display device. The video processing apparatus 101 may further acquire a video data packet of the second video captured and acquired by the second unmanned aerial vehicle received by each of the plurality of receivers 102, generate a second continuous video from the video data packet of the second video acquired from the plurality of receivers, and transmit the second continuous video to the second display device.
In one embodiment, the video processing device 101 may establish a communication connection with the plurality of receivers 102 via a communication cable, which may include an optical fiber or a coaxial cable, among others.
In one embodiment, if the display device is located inside a building or a tunnel, the signal is poor, so that the display device cannot correctly receive the continuous video sent by the video processing apparatus. Illustratively, the antenna port may be a High Definition Multimedia Interface (HDMI), and the rf antenna may extend to the outside of the building or tunnel through a coaxial cable and an rf relay amplifier.
Referring to fig. 3, a schematic flow chart of a video processing method according to an embodiment of the present invention is shown in fig. 3, where the video processing system shown in fig. 1 includes:
s301, the video processing device receives videos shot and obtained by the unmanned aerial vehicle flying at the flying field through a plurality of receivers arranged at the flying field at intervals.
Taking the schematic view of the flight competition scene shown in fig. 4 as an example, the unmanned aerial vehicle can perform flight competition in a flight field, the shooting device is hung on the unmanned aerial vehicle, and the unmanned aerial vehicle can shoot through the shooting device to obtain a video. A plurality of receivers are arranged in the flight field at intervals, and the plurality of receivers can receive videos shot and acquired by the unmanned aerial vehicle through wireless connection. The flight field is also provided with a video processing device, the video processing device can acquire video data packets of videos received by each of the plurality of receivers through a communication line, and continuous videos are generated according to the acquired video data packets. The video processing device may send the continuous video to the display device, and the display device may display the continuous video, so that a user operating the display device may view the continuous video, and may also perform flight control on the unmanned aerial vehicle based on the continuous video, such as adjusting an attitude, a speed, or an altitude of the unmanned aerial vehicle during a flight process, or controlling the unmanned aerial vehicle to hover, return, or land, and the like. The attitude may be used to indicate one or more of a heading angle, a pitch angle, or a roll angle of the unmanned aerial vehicle. The display device may be located within the flight arena or outside the flight arena.
S302, the video processing apparatus acquires video data packets of the video received by each of the plurality of receivers, and generates a continuous video from the video data packets acquired from the plurality of receivers.
In one embodiment, the video processing apparatus may determine a plurality of correctly received video data packets from the video data packets obtained by the plurality of receivers, and generate the continuous video based on the plurality of correctly received video data packets.
In the specific implementation, after the receiver receives the video shot and acquired by the unmanned aerial vehicle through the antenna, the video is processed through the radio frequency front end, the baseband processing and the decoder to obtain the video data packet of the video. If the receiver successfully processes the video through the rf front end, the baseband processing, and the decoder, the video processing device may determine that the receiver correctly received the video data packets of the video. For example, the video processing apparatus can detect whether the video data packet is correctly received through a check bit, which is also called a parity check bit, and is a binary number indicating whether the number of 1's in the binary number of a given bit number is odd or even. For another example, the video processing apparatus may determine whether the receiver successfully decodes the video, and if the decoding is successful, the video processing apparatus may determine that the receiver correctly receives the video data packet of the video; if the decoding fails, the video processing device may determine that the receiver did not correctly receive the video data packets for the video.
Taking fig. 2 as an example, assuming that the video processing apparatus selects the video data packet of video 1 from the video data packet of video 1 received by the first receiver and the video data packet of video 1 received by the second receiver, wherein the first receiver correctly receives the video data packet of video 1 and the second receiver does not correctly receive the video data packet of video 1, the video processing apparatus may select the video data packet of video 1 received by the first receiver as the video data packet of video 1. In addition, assuming that the video processing apparatus correctly receives the video data packet of video 2 at the first receiver, correctly receives the video data packet of video 2 at the second receiver, and incorrectly receives the video data packet of video 2 at the third receiver, the video processing apparatus may select the video data packet of video 2 received at any one of the first receiver and the second receiver as the video data packet of video 2.
In one embodiment, each video data packet corresponds to one identification information, and the video processing apparatus may determine a plurality of target video data packets with different identification information from the plurality of correctly received video data packets, and perform a splicing process on the plurality of target video data packets to obtain a continuous video.
Taking fig. 2 as an example, it is assumed that the video processing apparatus correctly receives the video data packet of video 1 and the video data packet of video 2 at the first receiver, the video data packet of video 2 and the video data packet of video 3 at the second receiver, and the video data packet of video 3 and the video data packet of video 4 at the third receiver. The video processing apparatus may determine the video data packet of the video 1 received by the first receiver, the video data packet of the video 2 received by any one of the first receiver and the second receiver, the video data packet of the video 3 received by any one of the second receiver and the third receiver, and the video data packet of the video 4 received by the third receiver as a target video data packet, and perform a splicing process on the target video data packet to obtain a continuous video.
The identification information may include time information or sequence number information.
Taking fig. 2 as an example, the identification information may include sequence number information, that is, sequence number information corresponding to a video data packet of video n is n, where n is a positive integer. For example, the sequence number information corresponding to the video data packet of video 1 is 1, and the sequence number information corresponding to the video data packet of video 2 is 2.
Taking the schematic diagram of the continuous video shown in fig. 5 as an example, the identification information may include time information, that is, the time information corresponding to the video data packet of the video n is the playing ending time of the video, and n is a positive integer. For example, if the duration of the video 1 is 2 minutes (min), the duration of the video 2 is 1min, the duration of the video 3 is 3min, and the duration of the video 4 is 1min, then the time information corresponding to the video packet of the video 1 is 2min, the time information corresponding to the video packet of the video 2 is 2+ 1-3 min, the time information corresponding to the video packet of the video 3 is 2+1+ 3-6 min, and the time information corresponding to the video packet of the video 4 is 2+1+3+ 1-7 min.
In one embodiment, the video processing apparatus may obtain the video data packets of the video received by each receiver through a communication cable communicatively connected to each receiver.
S303, the video processing apparatus transmits the continuous video to the display device to cause the display device to display the continuous video.
In the embodiment of the invention, the plurality of receivers arranged at the flight field at intervals receive the videos shot by the unmanned aerial vehicle flying at the flight field, the video data packets of the videos received by each receiver are obtained, the continuous videos are generated according to the video data packets obtained from the plurality of receivers, and the continuous videos are sent to the display equipment so that the display equipment can display the continuous videos.
Referring to fig. 6, a schematic flow chart of another video processing method according to an embodiment of the present invention is shown in fig. 6, which is based on the video processing system shown in fig. 1, and the method may include:
s601, receiving videos shot and acquired by the unmanned aerial vehicle and sent by the relay device through a target receiver in a plurality of receivers arranged at intervals on a flight site, wherein the videos shot and acquired by the unmanned aerial vehicle and sent by the relay device are obtained by encoding the decoded videos received by the unmanned aerial vehicle through the relay device according to the communication state between the relay device and the target receiver.
Taking the schematic view of the flight competition scene shown in fig. 4 as an example, the unmanned aerial vehicle can perform flight competition in a flight field, the shooting device is hung on the unmanned aerial vehicle, and the unmanned aerial vehicle can shoot through the shooting device to obtain a video. A plurality of receivers are arranged in the flight field at intervals, and the plurality of receivers can receive videos shot and acquired by the unmanned aerial vehicle through wireless connection. And a relay device is further arranged in the flight field, and when the relay device detects that the communication state between the relay device and the target receiver is good, the relay device can acquire the video obtained by the unmanned aerial vehicle after the video obtained by shooting is coded. The relay device may decode the acquired video and then transmit the video obtained by encoding the decoded video to the target receiver. For example, after the relay device acquires a video captured by the unmanned aerial vehicle, the baseband decoded hard bits may be re-encoded and then sent to the target receiver through the radio frequency amplification module of the relay device, so as to implement relay amplification and extend the transmission distance. When the communication state between the relay device and the other receivers except the target receiver in the plurality of receivers is poor, the other receivers can directly receive the video shot and acquired by the unmanned aerial vehicle. The flight field is also provided with a video processing device, the video processing device can acquire video data packets of videos received by each of the plurality of receivers through a communication line, and continuous videos are generated according to the acquired video data packets. The video processing apparatus may transmit the continuous video to the display device, and the display device may display the continuous video.
Wherein the target receiver may be any one of a plurality of receivers.
Wherein the communication state between the relay device and the target receiver may include one or more of a bandwidth, a bit error rate, or a signal-to-noise ratio.
And S602, receiving the video shot by the unmanned aerial vehicle through the receivers except the target receiver in the plurality of receivers.
It should be noted that the execution order of steps S601 and S602 is not limited in the embodiments of the present application, for example, the video processing apparatus may execute step S601 after executing step S602, or the video processing apparatus may execute step S602 and step S601 at the same time.
S603, obtaining video data packets of the video received by each of the plurality of receivers, and generating a continuous video from the video data packets obtained from the plurality of receivers.
In one embodiment, the video processing apparatus may determine a plurality of correctly received video data packets from the video data packets obtained by the plurality of receivers, and generate the continuous video based on the plurality of correctly received video data packets.
In an embodiment, each video data packet corresponds to one identification information, and the video processing apparatus may determine a plurality of target video data packets with different identification information from the plurality of correctly received video data packets, and perform a splicing process on the plurality of target video data packets to obtain a continuous video.
The identification information includes time information or serial number information.
In one embodiment, the video processing apparatus may obtain the video data packets of the video received by each receiver through a communication cable communicatively connected to each receiver.
S604, sending the continuous video to the display device, so that the display device displays the continuous video.
In the embodiment of the invention, the target receiver among the plurality of receivers arranged at intervals on the flight site receives the video shot and acquired by the unmanned aerial vehicle and sent by the relay device, and the video shot and acquired by the unmanned aerial vehicle and sent by the relay device is obtained by encoding the decoded video received from the unmanned aerial vehicle by the relay device according to the communication state between the relay device and the target receiver, namely, the video shot and acquired by the unmanned aerial vehicle is forwarded to the target receiver by the relay device, so that the video transmission efficiency can be improved.
Referring to fig. 7, a schematic flow chart of another video processing method according to an embodiment of the present invention is shown in fig. 7, where the video processing system shown in fig. 1 includes:
and S701, shooting by the unmanned aerial vehicle to obtain a video.
S702, the unmanned aerial vehicle sends the shot and acquired video to a plurality of receivers.
S703, each of the plurality of receivers transmits the received video data packet of the video to the video processing apparatus.
S704, the video processing apparatus generates a continuous video from the video data packets acquired from the plurality of receivers.
In one embodiment, the video processing apparatus may determine a plurality of correctly received video data packets from the video data packets obtained by the plurality of receivers, and generate the continuous video based on the plurality of correctly received video data packets.
In an embodiment, each video data packet corresponds to one identification information, and the video processing apparatus may determine a plurality of target video data packets with different identification information from the plurality of correctly received video data packets, and perform a splicing process on the plurality of target video data packets to obtain a continuous video.
The identification information includes time information or serial number information.
In one embodiment, the video processing apparatus may obtain the video data packets of the video received by each receiver through a communication cable communicatively connected to each receiver.
S705, the video processing apparatus transmits the continuous video to the display device.
S706, the display device displays the continuous video.
In the embodiment of the invention, the plurality of receivers receive videos shot by the unmanned aerial vehicle, each receiver in the plurality of receivers sends a video data packet of the received video to the video processing device, the video processing device generates continuous videos according to the video data packets obtained from the plurality of receivers, the video processing device sends the continuous videos to the display equipment, and the display equipment displays the continuous videos.
Referring to fig. 8, a schematic flow chart of another video processing method according to an embodiment of the present invention is shown in fig. 8, where the video processing system shown in fig. 1 includes:
and S801, shooting by the unmanned aerial vehicle to acquire a video.
And S802, the relay device receives the video shot and acquired by the unmanned aerial vehicle according to the communication state between the relay device and the target receiver.
And S803, the relay device sends the video shot and acquired by the unmanned aerial vehicle to the target receiver.
And S804, the unmanned aerial vehicle sends the shot and acquired video to other receivers except the target receiver in the plurality of receivers.
S805, each of the plurality of receivers transmits the video data packet of the received video to the video processing apparatus.
S806, the video processing apparatus generates a continuous video from the video data packets acquired from the plurality of receivers.
In one embodiment, the video processing apparatus may determine a plurality of correctly received video data packets from the video data packets obtained by the plurality of receivers, and generate the continuous video based on the plurality of correctly received video data packets.
In an embodiment, each video data packet corresponds to one identification information, and the video processing apparatus may determine a plurality of target video data packets with different identification information from the plurality of correctly received video data packets, and perform a splicing process on the plurality of target video data packets to obtain a continuous video.
The identification information includes time information or serial number information.
In one embodiment, the video processing apparatus may obtain the video data packets of the video received by each receiver through a communication cable communicatively connected to each receiver.
S807, the video processing apparatus transmits the continuous video to the display device.
And S808, displaying the continuous video by the display equipment.
In the embodiment of the invention, the relay device sends the video received from the unmanned aerial vehicle to the target receiver according to the communication state between the relay device and the target receiver, and the video shot by the unmanned aerial vehicle is forwarded to the target receiver through the relay device, so that the video transmission efficiency can be improved.
Fig. 9 is a structural diagram of a video processing apparatus according to an embodiment of the present invention, and as shown in fig. 9, the video processing apparatus includes a memory 901 and a processor 902, where the memory 902 stores program codes, the processor 902 calls the program codes in the memory, and when the program codes are executed, the processor 902 performs the following operations:
the processor 902, invokes the program code, and when executed, performs the following:
receiving videos shot by an unmanned aerial vehicle flying at a flight site through a plurality of receivers arranged at the flight site at intervals;
acquiring video data packets of the video received by each of the plurality of receivers, and generating a continuous video from the video data packets acquired from the plurality of receivers;
and sending the continuous video to a display device to enable the display device to display the continuous video.
In an embodiment, the display apparatus is a head mounted display device.
In one embodiment, the processor 902, when obtaining the video data packets of the video received by each of the plurality of receivers, performs the following operations:
and acquiring the video data packet of the video received by each receiver through a communication cable which is in communication connection with each receiver.
In an embodiment, the communication cable comprises a coaxial line.
In one embodiment, the unmanned aerial vehicle comprises a first unmanned aerial vehicle and a second unmanned aerial vehicle, wherein,
the processor 902, when acquiring video data packets of the video received by each of the plurality of receivers and generating continuous video from the video data packets acquired from the plurality of receivers, performs the following operations:
acquiring a video data packet of a first video shot and acquired by a first unmanned aerial vehicle and a video data packet of a second video shot and acquired by a second unmanned aerial vehicle, which are received by each of the plurality of receivers;
generating a first continuous video from video data packets of a first video acquired from the plurality of receivers, and generating a second continuous video from video data packets of a second video acquired from the plurality of receivers;
the processor 902 sends the continuous video to a display device, so that when the display device displays the continuous video, the following operations are performed:
sending the first continuous video to a first display device corresponding to the first UAV to cause the first display device to display the first continuous video;
sending the second continuous video to a second display device corresponding to the second unmanned aerial vehicle to enable the second display device to display the second continuous video.
In one embodiment, the processor 902, when generating the continuous video from the video data packets obtained from the plurality of receivers, performs the following operations:
determining a plurality of correctly received video data packets from the video data packets obtained by the plurality of receivers;
and generating the continuous video according to the plurality of correctly received video data packets.
In one embodiment, each video data packet corresponds to an identification information;
the processor 902, when generating the continuous video from the plurality of correctly received video data packets, performs the following operations:
determining a plurality of target video data packets with different identification information from the plurality of correctly received video data packets;
and splicing the target video data packets to obtain the continuous video.
In an embodiment, the identification information includes time information or sequence number information.
In one embodiment, the processor 902 performs the following operations when receiving videos captured by an unmanned aerial vehicle flying at a flight site through a plurality of receivers arranged at intervals at the flight site:
and receiving the video shot and acquired by the unmanned aerial vehicle and sent by a relay device through a target receiver in the plurality of receivers, wherein the video shot and acquired by the unmanned aerial vehicle and sent by the relay device is obtained by encoding the decoded video received from the unmanned aerial vehicle by the relay device according to the communication state between the relay device and the target receiver.
In one embodiment, the communication status includes one or more of communication bandwidth, bit error rate, signal to noise ratio.
The video processing apparatus provided in this embodiment can execute the video processing method shown in fig. 3 to 8 provided in the foregoing embodiments, and the execution manner and the beneficial effects are similar, and are not described again here.
It should be understood that the above-described embodiments are only some of the examples of the present invention, and certainly, the scope of the present invention should not be limited by the above-described embodiments, but the skilled person will understand that all or part of the procedures for implementing the above-described embodiments may be implemented and equivalents thereof may be made thereto without departing from the scope of the present invention as defined by the appended claims.
Claims (31)
1. A video processing method, comprising:
receiving videos shot by an unmanned aerial vehicle flying at a flight site through a plurality of receivers arranged at the flight site at intervals;
acquiring video data packets of the video received by each of the plurality of receivers, and generating a continuous video from the video data packets acquired from the plurality of receivers;
and sending the continuous video to a display device to enable the display device to display the continuous video.
2. The method of claim 1, wherein the display device is a head mounted display apparatus.
3. The method of claim 1 or 2, wherein the obtaining video data packets of the video received by each of the plurality of receivers comprises:
and acquiring the video data packet of the video received by each receiver through a communication cable which is in communication connection with each receiver.
4. The method of claim 3, wherein the communication cable comprises a coaxial cable.
5. The method of any of claims 1-4, wherein the UAVs comprise a first UAV and a second UAV, wherein,
the acquiring video data packets of the video received by each of the plurality of receivers and generating continuous video from the video data packets acquired from the plurality of receivers includes:
acquiring a video data packet of a first video shot and acquired by a first unmanned aerial vehicle and a video data packet of a second video shot and acquired by a second unmanned aerial vehicle, which are received by each of the plurality of receivers;
generating a first continuous video from video data packets of a first video acquired from the plurality of receivers, and generating a second continuous video from video data packets of a second video acquired from the plurality of receivers;
the sending the continuous video to a display device to cause the display device to display the continuous video comprises:
sending the first continuous video to a first display device corresponding to the first UAV to cause the first display device to display the first continuous video;
sending the second continuous video to a second display device corresponding to the second unmanned aerial vehicle to enable the second display device to display the second continuous video.
6. The method of any of claims 1-5, wherein generating the continuous video from the video data packets obtained from the plurality of receivers comprises:
determining a plurality of correctly received video data packets from the video data packets obtained by the plurality of receivers;
and generating the continuous video according to the plurality of correctly received video data packets.
7. The method of claim 6, wherein each video data packet corresponds to an identification information;
said generating said continuous video from said plurality of correctly received video data packets comprises:
determining a plurality of target video data packets with different identification information from the plurality of correctly received video data packets;
and splicing the target video data packets to obtain the continuous video.
8. The method of claim 7, wherein the identification information comprises time information or sequence number information.
9. The method according to any one of claims 1-8, wherein the receiving the video captured by the UAV shooting at the flight site through a plurality of receivers arranged at intervals at the flight site comprises:
and receiving the video shot and acquired by the unmanned aerial vehicle and sent by a relay device through a target receiver in the plurality of receivers, wherein the video shot and acquired by the unmanned aerial vehicle and sent by the relay device is obtained by encoding the decoded video received from the unmanned aerial vehicle by the relay device according to the communication state between the relay device and the target receiver.
10. The method of claim 9, wherein the communication status comprises one or more of a communication bandwidth, a bit error rate, and a signal-to-noise ratio.
11. A video processing apparatus comprising a memory and a processor;
the memory for storing program code;
the processor, invoking the program code, when executed, is configured to:
receiving videos shot by an unmanned aerial vehicle flying at a flight site through a plurality of receivers arranged at the flight site at intervals;
acquiring video data packets of the video received by each of the plurality of receivers, and generating a continuous video from the video data packets acquired from the plurality of receivers;
and sending the continuous video to a display device to enable the display device to display the continuous video.
12. The apparatus of claim 11, wherein the display device is a head-mounted display apparatus.
13. The apparatus according to claim 11 or 12, wherein the processor, when obtaining the video data packets of the video received by each of the plurality of receivers, performs the following operations:
and acquiring the video data packet of the video received by each receiver through a communication cable which is in communication connection with each receiver.
14. The apparatus of claim 13, wherein the communication cable comprises a coaxial cable.
15. The apparatus of any one of claims 11-14, wherein the UAV comprises a first UAV and a second UAV, wherein,
the processor, when acquiring video data packets of the video received by each of the plurality of receivers and generating a continuous video from the video data packets acquired from the plurality of receivers, performs the following operations:
acquiring a video data packet of a first video shot and acquired by a first unmanned aerial vehicle and a video data packet of a second video shot and acquired by a second unmanned aerial vehicle, which are received by each of the plurality of receivers;
generating a first continuous video from video data packets of a first video acquired from the plurality of receivers, and generating a second continuous video from video data packets of a second video acquired from the plurality of receivers;
the processor sends the continuous video to a display device, so that when the display device displays the continuous video, the following operations are executed:
sending the first continuous video to a first display device corresponding to the first UAV to cause the first display device to display the first continuous video;
sending the second continuous video to a second display device corresponding to the second unmanned aerial vehicle to enable the second display device to display the second continuous video.
16. The apparatus according to any of claims 11-15, wherein the processor, when generating the continuous video from the video data packets obtained from the plurality of receivers, performs the following:
determining a plurality of correctly received video data packets from the video data packets obtained by the plurality of receivers;
and generating the continuous video according to the plurality of correctly received video data packets.
17. The apparatus of claim 16, wherein each video data packet corresponds to an identification information;
the processor, when generating the continuous video from the plurality of correctly received video data packets, performs the following operations:
determining a plurality of target video data packets with different identification information from the plurality of correctly received video data packets;
and splicing the target video data packets to obtain the continuous video.
18. The apparatus of claim 17, wherein the identification information comprises time information or sequence number information.
19. The apparatus according to any one of claims 11 to 18, wherein the processor, when receiving the video captured by the unmanned aerial vehicle flying at the flight site through a plurality of receivers spaced apart at the flight site, performs the following operations:
and receiving the video shot and acquired by the unmanned aerial vehicle and sent by a relay device through a target receiver in the plurality of receivers, wherein the video shot and acquired by the unmanned aerial vehicle and sent by the relay device is obtained by encoding the decoded video received from the unmanned aerial vehicle by the relay device according to the communication state between the relay device and the target receiver.
20. The apparatus of claim 19, wherein the communication status comprises one or more of a communication bandwidth, a bit error rate, a signal to noise ratio.
21. A video processing system, comprising a plurality of receivers disposed at intervals at a flight site, an unmanned aerial vehicle flying at the flight site, a video processing apparatus, and a display device, wherein:
the unmanned aerial vehicle is used for shooting videos;
the plurality of receivers are used for receiving videos shot by the unmanned aerial vehicle and sending video data packets of the videos to the video processing device;
the video processing device is configured to acquire a video data packet of the video received by each of the plurality of receivers, generate a continuous video according to the video data packet acquired from the plurality of receivers, and send the continuous video to the display device;
the display device is used for displaying the continuous video.
22. The system of claim 21, wherein the display device is a head mounted display.
23. The system according to claim 21 or 22, wherein the video processing device obtains the video data packets of the video received by each of the plurality of receivers, comprising:
the video processing device acquires the video data packets of the video received by each receiver through a communication cable which is in communication connection with each receiver.
24. The system of claim 23, wherein the communication cable comprises a coaxial cable.
25. The system of any one of claims 21-24, wherein the UAV comprises a first UAV and a second UAV, wherein,
the video processing apparatus acquiring video data packets of the video received by each of the plurality of receivers and generating a continuous video from the video data packets acquired from the plurality of receivers, includes:
the video processing device acquires a video data packet of a first video shot and acquired by a first unmanned aerial vehicle and a video data packet of a second video shot and acquired by a second unmanned aerial vehicle, which are received by each of the plurality of receivers;
the video processing apparatus generates a first continuous video from video data packets of a first video acquired from the plurality of receivers and generates a second continuous video from video data packets of a second video acquired from the plurality of receivers;
the video processing apparatus sends the continuous video to a display device, and includes:
the video processing device sends the first continuous video to a first display device corresponding to the first unmanned aerial vehicle, and sends the second continuous video to a second display device corresponding to the second unmanned aerial vehicle;
the display device displays the continuous video, including:
the first display device displays the first continuous video;
the second display device displays the second continuous video.
26. The system according to any of claims 21-25, wherein said video processing means generates continuous video from video data packets obtained from said plurality of receivers, comprising:
the video processing device determines a plurality of correctly received video data packets from the video data packets acquired by the plurality of receivers;
the video processing device generates the continuous video according to the plurality of correctly received video data packets.
27. The system of claim 26, wherein each video data packet corresponds to an identification information;
the video processing apparatus generating the continuous video from the plurality of correctly received video data packets, comprising:
the video processing device determines a plurality of target video data packets with different identification information from the plurality of correctly received video data packets;
and the video processing device splices the target video data packets to acquire the continuous video.
28. The system of claim 27, wherein the identification information comprises time information or sequence number information.
29. The system according to any one of claims 21-28, wherein the plurality of receivers receive video captured by the UAV filming, comprising:
and a target receiver in the plurality of receivers receives the video shot by the unmanned aerial vehicle and sent by a relay device, wherein the video shot by the unmanned aerial vehicle and sent by the relay device is obtained by encoding the decoded video received from the unmanned aerial vehicle by the relay device according to the communication state between the relay device and the target receiver.
30. The system of claim 29, wherein the communication status comprises one or more of a communication bandwidth, a bit error rate, a signal to noise ratio.
31. A computer storage medium having computer program instructions stored therein, which when executed by a processor, are adapted to perform a video processing method according to any of claims 1-10.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2019/093666 WO2020258243A1 (en) | 2019-06-28 | 2019-06-28 | Video processing method, apparatus and system, and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111615826A true CN111615826A (en) | 2020-09-01 |
Family
ID=72199176
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201980007974.3A Pending CN111615826A (en) | 2019-06-28 | 2019-06-28 | Video processing method, device, system and medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111615826A (en) |
| WO (1) | WO2020258243A1 (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110080425A1 (en) * | 2009-10-05 | 2011-04-07 | Electronics And Telecommunications Research Institute | System for providing multi-angle broadcasting service |
| CN104168455A (en) * | 2014-08-08 | 2014-11-26 | 北京航天控制仪器研究所 | Air-based large-scene photographing system and method |
| CN105100733A (en) * | 2015-08-27 | 2015-11-25 | 广东威创视讯科技股份有限公司 | Video playing method and system of mosaic display device |
| CN105511488A (en) * | 2015-12-03 | 2016-04-20 | 北京奇虎科技有限公司 | Unmanned aircraft-based continuous shooting method and unmanned aircraft |
| CN106131479A (en) * | 2016-06-21 | 2016-11-16 | 深圳市高巨创新科技开发有限公司 | It is applied to many equipment display packing and the system of aircraft |
| WO2017096546A1 (en) * | 2015-12-09 | 2017-06-15 | SZ DJI Technology Co., Ltd. | Imaging system and method for unmanned vehicles |
| CN107121987A (en) * | 2017-06-08 | 2017-09-01 | 广东容祺智能科技有限公司 | A kind of unmanned plane multiterminal remotely continue the chain-circuit system of control |
| CN107211078A (en) * | 2015-01-23 | 2017-09-26 | 瑞典爱立信有限公司 | Video frame synchronization based on VLC |
| CN108702487A (en) * | 2017-11-20 | 2018-10-23 | 深圳市大疆创新科技有限公司 | The image transfer method and device of unmanned plane |
| CN108702511A (en) * | 2017-07-28 | 2018-10-23 | 深圳市大疆创新科技有限公司 | Method, equipment and the system of transmission of video |
| CN108769603A (en) * | 2018-06-13 | 2018-11-06 | 武汉朗视软件有限公司 | Unmanned plane is around flight image automated processing system |
| CN109041591A (en) * | 2017-09-12 | 2018-12-18 | 深圳市大疆创新科技有限公司 | Image transfer method, equipment, moveable platform, monitoring device and system |
| CN109842785A (en) * | 2018-12-25 | 2019-06-04 | 江苏恒澄交科信息科技股份有限公司 | Full visual field unmanned ship tele-control system |
-
2019
- 2019-06-28 CN CN201980007974.3A patent/CN111615826A/en active Pending
- 2019-06-28 WO PCT/CN2019/093666 patent/WO2020258243A1/en active Application Filing
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110080425A1 (en) * | 2009-10-05 | 2011-04-07 | Electronics And Telecommunications Research Institute | System for providing multi-angle broadcasting service |
| CN104168455A (en) * | 2014-08-08 | 2014-11-26 | 北京航天控制仪器研究所 | Air-based large-scene photographing system and method |
| CN107211078A (en) * | 2015-01-23 | 2017-09-26 | 瑞典爱立信有限公司 | Video frame synchronization based on VLC |
| CN105100733A (en) * | 2015-08-27 | 2015-11-25 | 广东威创视讯科技股份有限公司 | Video playing method and system of mosaic display device |
| CN105511488A (en) * | 2015-12-03 | 2016-04-20 | 北京奇虎科技有限公司 | Unmanned aircraft-based continuous shooting method and unmanned aircraft |
| WO2017096546A1 (en) * | 2015-12-09 | 2017-06-15 | SZ DJI Technology Co., Ltd. | Imaging system and method for unmanned vehicles |
| CN106131479A (en) * | 2016-06-21 | 2016-11-16 | 深圳市高巨创新科技开发有限公司 | It is applied to many equipment display packing and the system of aircraft |
| CN107121987A (en) * | 2017-06-08 | 2017-09-01 | 广东容祺智能科技有限公司 | A kind of unmanned plane multiterminal remotely continue the chain-circuit system of control |
| CN108702511A (en) * | 2017-07-28 | 2018-10-23 | 深圳市大疆创新科技有限公司 | Method, equipment and the system of transmission of video |
| CN109041591A (en) * | 2017-09-12 | 2018-12-18 | 深圳市大疆创新科技有限公司 | Image transfer method, equipment, moveable platform, monitoring device and system |
| CN108702487A (en) * | 2017-11-20 | 2018-10-23 | 深圳市大疆创新科技有限公司 | The image transfer method and device of unmanned plane |
| CN108769603A (en) * | 2018-06-13 | 2018-11-06 | 武汉朗视软件有限公司 | Unmanned plane is around flight image automated processing system |
| CN109842785A (en) * | 2018-12-25 | 2019-06-04 | 江苏恒澄交科信息科技股份有限公司 | Full visual field unmanned ship tele-control system |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020258243A1 (en) | 2020-12-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019242620A1 (en) | Data transmission control method, information sending end, receiving end and aircraft image transmission system | |
| EP3729809B1 (en) | Video codec data recovery techniques for lossy wireless links | |
| US10708009B2 (en) | Efficient automatic repeat request for free space optical communication | |
| CN108702487A (en) | The image transfer method and device of unmanned plane | |
| CN110784740A (en) | Video processing method, device, server and readable storage medium | |
| CN105472477A (en) | Data transmission method, device and equipment | |
| GB2583228A (en) | Method of encoding and decoding data transferred via a communications link | |
| CN205510277U (en) | Unmanned aerial vehicle panoramic picture transmission equipment | |
| CN108200394A (en) | A kind of UAV system that multiway images is supported to transmit | |
| US20190246127A1 (en) | Wireless transmission method and device for vitrual reality, terminal and head-mounted display device | |
| US10931913B2 (en) | Reception apparatus, transmission apparatus, control method, transmission method, and program | |
| CN111263192A (en) | Video processing method and related equipment | |
| CN107079101A (en) | A kind of processing method of flight view data, system and ground end equipment | |
| CN114902676A (en) | Reducing latency in wireless virtual and augmented reality systems | |
| CN111615826A (en) | Video processing method, device, system and medium | |
| CN111381787A (en) | Screen projection method and equipment | |
| EP2960864B1 (en) | Device and method for processing a stream of video data | |
| CN107911194A (en) | For the method and apparatus utilized to the maximum of dynamic change digital data channel | |
| US20180270507A1 (en) | Method for encoding streams of video data based on groups of pictures (gop) | |
| CN105872523A (en) | Three-dimensional video data obtaining method, device and system | |
| KR101670767B1 (en) | Method for duplicated streaming transmission to provide image stabilization service, recording medium, device and sysytem for performing the method | |
| CN108667795B (en) | Virtual reality video multi-person sharing system and virtual reality equipment | |
| US11051058B2 (en) | Real-time wireless video delivery system using a multi-channel communications link | |
| CN111684813A (en) | Data processing method, system, mobile platform, terminal and storage medium | |
| WO2020153130A1 (en) | Information processing device and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200901 |