CN113973212A - Online unmanned aerial vehicle live broadcast method and device, storage medium and electronic equipment - Google Patents
Online unmanned aerial vehicle live broadcast method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN113973212A CN113973212A CN202111061239.6A CN202111061239A CN113973212A CN 113973212 A CN113973212 A CN 113973212A CN 202111061239 A CN202111061239 A CN 202111061239A CN 113973212 A CN113973212 A CN 113973212A
- Authority
- CN
- China
- Prior art keywords
- unmanned aerial
- aerial vehicle
- video
- video data
- mobile terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 32
- 238000004891 communication Methods 0.000 claims abstract description 38
- 230000005540 biological transmission Effects 0.000 claims abstract description 31
- 238000004590 computer program Methods 0.000 claims description 8
- 238000009877 rendering Methods 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 5
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000007123 defense Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- RZVHIXYEVGDQDX-UHFFFAOYSA-N 9,10-anthraquinone Chemical compound C1=CC=C2C(=O)C3=CC=CC=C3C(=O)C2=C1 RZVHIXYEVGDQDX-UHFFFAOYSA-N 0.000 description 1
- 206010034432 Performance fear Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/164—Adaptation or special uses of UDP protocol
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to an online unmanned aerial vehicle live broadcast method, an online unmanned aerial vehicle live broadcast device, a storage medium and electronic equipment, wherein the method comprises the following steps: the method comprises the steps that an unmanned aerial vehicle collects video data streams and returns the video data streams to an unmanned aerial vehicle nest through a special communication link, the special communication link is a communication link for image transmission between the unmanned aerial vehicle and the unmanned aerial vehicle nest, the unmanned aerial vehicle nest receives the video data streams, encodes the video data streams into target video streams, transmits the target video streams to an RTC server through a UDP (user Datagram protocol) transmission protocol, the RTC server sends the target video streams to at least one mobile terminal through a CDN (content delivery network) for live broadcast, and the mobile terminal communicates with the RTC server according to a domain name of the RTC server distributed by the CDN. According to the invention, through the UDP transmission protocol, the RTC server and the CDN content distribution, the time delay of the live video of the unmanned aerial vehicle is reduced, and the real-time performance of the live video of the unmanned aerial vehicle is improved.
Description
Technical Field
The invention relates to the technical field of unmanned aerial vehicles, in particular to an online unmanned aerial vehicle live broadcast method, an online unmanned aerial vehicle live broadcast device, a storage medium and electronic equipment.
Background
Along with the development of unmanned aerial vehicle technique, unmanned aerial vehicle's application scene is more and more extensive, for example is applied to in scenes such as electric power patrol line, traffic rescue and customs frontier defense, therefore, watch the video that unmanned aerial vehicle shot in real time and played key effect to discovering electric power safety problem, taking rescue action in time etc..
At present, the live broadcast of the unmanned aerial vehicle video is transmitted through an internet streaming media protocol, and one end of the live broadcast is uploaded, and the live broadcast is played at multiple ends. However, the traditional streaming media protocol has poor transmission real-time performance and high time delay. For example, for an RTMP streaming media protocol of Adobe corporation, a streaming media packet is transmitted in a TCP manner, and the delay is generally about 2s to 5s, so that the experience of watching live broadcast in real time by a user is poor.
Disclosure of Invention
Based on this, the invention aims to provide an online unmanned aerial vehicle live broadcast method, an online unmanned aerial vehicle live broadcast device, a storage medium and electronic equipment, which have the advantages of reducing the time delay of unmanned aerial vehicle live broadcast video and improving the live broadcast real-time performance.
According to a first aspect of an embodiment of the present application, there is provided an online unmanned aerial vehicle live broadcast method, including the following steps:
the unmanned aerial vehicle collects a video data stream and transmits the video data stream back to the unmanned aerial vehicle nest through a special communication link; the dedicated communication link is a communication link for image transmission between the unmanned aerial vehicle and the unmanned aerial vehicle nest;
the unmanned aerial vehicle nest receives the video data stream, encodes the video data stream into a target video stream, and transmits the target video stream to the RTC server through a UDP transmission protocol;
the RTC server transmits the target video stream to at least one mobile terminal for live broadcast through the CDN; and the mobile terminal communicates with the RTC server according to the RTC server IP address returned by the CDN.
According to a second aspect of the embodiments of the present application, an online unmanned aerial vehicle live broadcast device is provided, including:
the video data stream acquisition module is used for the unmanned aerial vehicle to acquire a video data stream and transmit the video data stream back to the unmanned aerial vehicle nest through a special communication link; the dedicated communication link is a communication link for image transmission between the unmanned aerial vehicle and the unmanned aerial vehicle nest;
the video data stream coding module is used for receiving the video data stream by the unmanned aerial vehicle nest, coding the video data stream into a target video stream and transmitting the target video stream to the RTC server through a UDP transmission protocol;
the video data stream distribution module is used for the RTC server to distribute the target video stream to at least one mobile terminal for live broadcast through the CDN; and the mobile terminal communicates with the RTC server according to the RTC server IP address returned by the CDN.
According to a third aspect of embodiments of the present application, there is provided an electronic apparatus, including: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the online drone live method as defined in any one of the above.
According to a fourth aspect of embodiments of the present application, there is provided a computer-readable storage medium, on which a computer program is stored, the computer program, when executed by a processor, implementing the online unmanned aerial vehicle live broadcasting method as described in any one of the above.
According to the embodiment of the invention, an unmanned aerial vehicle acquires a video data stream, and the video data stream is transmitted back to an unmanned aerial vehicle nest through a special communication link, the special communication link is a communication link for image transmission between the unmanned aerial vehicle and the unmanned aerial vehicle nest, the unmanned aerial vehicle nest receives the video data stream, encodes the video data stream into a target video stream, and transmits the target video stream to an RTC server through a UDP transmission protocol, the RTC server transmits the target video stream to at least one mobile terminal through a CDN for live broadcast, and the mobile terminal communicates with the RTC server according to a domain name of the RTC server distributed by the CDN. According to the invention, through the UDP transmission protocol, the RTC server and the CDN content distribution, the time delay of the live video of the unmanned aerial vehicle is reduced, and the real-time performance of the live video of the unmanned aerial vehicle is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
For a better understanding and practice, the invention is described in detail below with reference to the accompanying drawings.
Drawings
FIG. 1 is a schematic flow chart of an online unmanned aerial vehicle live broadcast method of the present invention;
fig. 2 is a schematic flow diagram of S10 in the online unmanned aerial vehicle live broadcast method of the present invention;
fig. 3 is a schematic flow diagram of S30 in the online unmanned aerial vehicle live broadcast method of the present invention;
FIG. 4 is a block diagram of the online unmanned aerial vehicle live broadcast device of the present invention;
fig. 5 is a block diagram of a video data stream acquisition module 41 of the online unmanned aerial vehicle live broadcast device of the present invention;
fig. 6 is a block diagram of a video data stream distribution module 45 of the online unmanned aerial vehicle live broadcast device of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
It should be understood that the embodiments described are only a few embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terminology used in the embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the embodiments of the present application. As used in the examples of this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the application, as detailed in the appended claims. In the description of the present application, it is to be understood that the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not necessarily used to describe a particular order or sequence, nor are they to be construed as indicating or implying relative importance. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.
Further, in the description of the present application, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
Referring to fig. 1, an embodiment of the present invention provides an online unmanned aerial vehicle live broadcast method, including the following steps:
s10, an unmanned aerial vehicle collects a video data stream and transmits the video data stream back to an unmanned aerial vehicle nest through a special communication link; the special communication link is a communication link for image transmission between the unmanned aerial vehicle and the unmanned aerial vehicle nest.
The camera device is carried on the unmanned aerial vehicle, and the camera device can be a high-definition camera, a high-definition camera and the like. Unmanned aerial vehicle is at the flight in-process, through opening camera device gathers the video data flow.
Unmanned aerial vehicle machine nest is unmanned on duty machine nest, and it is the automation equipment that need not artificial control, can realize the flight control to unmanned aerial vehicle, receives the image of unmanned aerial vehicle passback etc. and it sets up places such as power plant, customs frontier defense generally. The unmanned aerial vehicle nest includes android device and ground remote controller, android device is the cell-phone, ground remote controller is a handheld device, uses radio and unmanned aerial vehicle to communicate to reach the control to unmanned aerial vehicle, receive the video data stream that unmanned aerial vehicle gathered simultaneously, android device be used for with the video data stream that ground remote controller received carries out the coding and handles.
The dedicated communication link is a communication link for image transmission between the unmanned aerial vehicle and the ground remote controller, and is different from a mode for image transmission through WiFi or 4g, and the mode for image transmission through WiFi requires that a link between the unmanned aerial vehicle and a signal receiving end (such as a mobile device) is established in advance, and image data is transmitted on the link. Due to the fact that the wifi signal and the 4g signal are easily interfered by the external environment, the link is disconnected, and timeliness of graph transmission is affected.
The special communication link between the unmanned aerial vehicle and the ground remote controller is a link which is established by the ground remote controller and the unmanned aerial vehicle through msdk for carrying out radio communication, so that the data returned by the unmanned aerial vehicle can be received in a far range, and the interference of external signals is not easy to receive.
And S20, receiving the video data stream by the unmanned aerial vehicle nest, encoding the video data stream into a target video stream, and transmitting the target video stream to the RTC server through a UDP transmission protocol.
And the ground remote controller sends the video data stream to an android device of an unmanned aerial vehicle nest through wired connection, the format of the video data stream is YUV420, and the android device encodes the video data stream to obtain a target video stream. Specifically, the target video stream is an H264 video stream. The H264 is a video compression encoding format, and can ensure the compression ratio and the recovery quality, and has the advantages of easy implementation, low cost and reliability.
User Datagram Protocol (UDP) is a transport layer Protocol. In a TCP/IP network, it is a connectionless protocol that is used to process packets as is the TCP protocol. The TCP protocol needs to establish a connection when data is transmitted, and each transmitted data needs to be confirmed. When no more data is to be transmitted, the connection also needs to be disconnected. This is safe, but inefficient. The UDP protocol, which avoids these procedures, is a connectionless communication service protocol that provides no control. The RTC (Real Time Communication) server is a Real-Time Communication server, and the android device transmits the encoded H264 video stream to the RTC server through a UDP (user Datagram protocol) transmission protocol, so that the data transmission efficiency is improved.
S30, the RTC server transmits the target video stream to at least one mobile terminal through the CDN for live broadcast; and the mobile terminal communicates with the RTC server according to the RTC server IP address returned by the CDN.
The CDN is called a Content Delivery Network, i.e., a Content Delivery Network. By placing node servers at various positions of the network to form a layer of intelligent virtual network on the basis of the existing internet, the CDN system can redirect the request of a user to a service node closest to the user in real time according to network flow, connection of each node, load condition, distance to the user, response time and other comprehensive information. The RTC server distributes the H264 video to a plurality of mobile terminals for live broadcasting through the CDN, wherein the mobile terminals communicate with the RTC server according to the IP address of the RTC server returned by the CDN. Specifically, the CDN establishes a cache server, copies and caches content of the RTC server at a remote end, including a domain name and a corresponding IP address. The mobile terminal sends an access request to the CDN, the CDN searches an IP address corresponding to the domain name according to the domain name in the access request and returns the IP address to the mobile terminal, and the mobile terminal communicates with the RTC server according to the IP address. The RTC server sends the H264 video to the mobile terminal, so that the video transmission efficiency is improved, and the real-time performance of video live broadcast is improved.
By applying the embodiment of the invention, the unmanned aerial vehicle acquires the video data stream and transmits the video data stream back to the unmanned aerial vehicle nest through the special communication link, the special communication link is a communication link for image transmission between the unmanned aerial vehicle and the unmanned aerial vehicle nest, the unmanned aerial vehicle nest receives the video data stream, encodes the video data stream into the target video stream, transmits the target video stream to the RTC server through the UDP transmission protocol, the RTC server transmits the target video stream to at least one mobile terminal through the CDN for live broadcast, and the mobile terminal communicates with the RTC server according to the domain name of the RTC server distributed by the CDN. According to the invention, through the UDP transmission protocol, the RTC server and the CDN content distribution, the time delay of the live video of the unmanned aerial vehicle is reduced, and the real-time performance of the live video of the unmanned aerial vehicle is improved.
In an alternative embodiment, referring to fig. 2, the step S10 includes steps S11-S12, which are as follows:
s11, receiving a video acquisition instruction sent by a mobile terminal by an unmanned aerial vehicle, wherein the video acquisition instruction comprises an instruction for starting a camera device;
and S12, the unmanned aerial vehicle moves to a specified position to start the camera device based on the camera device starting instruction, and collects a video data stream.
In this application embodiment, mobile terminal and unmanned aerial vehicle establish wireless communication and are connected, by the manual operation of unmanned aerial vehicle operator on mobile terminal, mobile terminal will send to unmanned aerial vehicle based on the video acquisition instruction that manual operation triggered, and unmanned aerial vehicle is based on the video acquisition instruction moves to the assigned position and opens camera device, gathers the video data flow.
In an alternative embodiment, referring to fig. 3, the step S30 includes steps S31-S33, which are as follows:
s31, the mobile terminal decodes the received target video stream to obtain a video frame;
s32, the mobile terminal performs MediaCodeC off-screen rendering on the video frame to obtain a rendered video;
and S33, the mobile terminal plays and displays the rendered video.
Android provides MediaCodec to handle the codec of audio-video, which has access to the underlying media codec framework (StageFright or openMAX), i.e. the encoder/decoder components. In the embodiment of the application, the mobile terminal decodes the received H264 video stream, and then performs off-screen rendering through MediaCodeC, so that the real-time performance of live video is ensured, and the live video presents a clear effect.
In an optional embodiment, the RTC server is an SRS streaming server. The SRS streaming media server provides rich access schemes for accessing RTMP streams into the SRS, and the rich access schemes comprise pushing RTMP to the SRS, pushing RTSP/UDP/FLV to the SRS and pulling streams to the SRS. And the method also supports various transformations of the accessed RTMP stream, such as transcoding the RTMP stream, screenshot the stream, forwarding the RTMP stream to other servers, transcoding and encapsulating the RTMP stream into an HTTP-FLV stream, transcoding and encapsulating the RTMP stream into an HLS, transcoding and encapsulating the RTMP stream into an HDS and recording the HDS into an FLV. And the SRS streaming media server is used, so that the time delay of live video is reduced.
In an optional embodiment, before the step of decoding, by the mobile terminal, the received target video stream to obtain a video frame, the method further includes:
and the mobile terminal carries out caching processing on the received target video stream.
The target video stream received by the mobile terminal from the RTC server is large in data volume, and the target video stream is cached, so that subsequent decoding is facilitated.
Corresponding to the above method embodiment, please refer to fig. 4, an embodiment of the present invention provides an online unmanned aerial vehicle live broadcast device 4, including:
the video data stream acquisition module 41 is used for acquiring a video data stream by the unmanned aerial vehicle and transmitting the video data stream back to the unmanned aerial vehicle nest through a special communication link; the dedicated communication link is a communication link for image transmission between the unmanned aerial vehicle and the unmanned aerial vehicle nest;
the video data stream coding module 42 is configured to receive the video data stream by the drone nest, code the video data stream into a target video stream, and transmit the target video stream to the RTC server through a UDP transport protocol;
a video data stream distribution module 43, configured to send the target video stream to at least one mobile terminal for live broadcast by the RTC server through the CDN; and the mobile terminal communicates with the RTC server according to the RTC server IP address returned by the CDN.
Optionally, referring to fig. 5, the video data stream collecting module 41 includes:
the command receiving unit 412 is used for receiving a video acquisition command sent by the mobile terminal by the unmanned aerial vehicle, wherein the video acquisition command comprises a command for starting the camera device;
and the video data stream acquisition unit 414 is used for the unmanned aerial vehicle to move to a specified position to start the camera based on the camera starting instruction, and acquire a video data stream.
Optionally, referring to fig. 6, the video data stream distribution module 45 includes:
a video stream decoding unit 452, configured to decode the received target video stream by the mobile terminal to obtain a video frame;
a video frame rendering unit 454, configured to perform, by the mobile terminal, MediaCodeC off-screen rendering on the video frame to obtain a rendered video;
a video playing unit 456, configured to play and display the rendered video by the mobile terminal.
By applying the embodiment of the invention, the unmanned aerial vehicle acquires the video data stream and transmits the video data stream back to the unmanned aerial vehicle nest through the special communication link, the special communication link is a communication link for image transmission between the unmanned aerial vehicle and the unmanned aerial vehicle nest, the unmanned aerial vehicle nest receives the video data stream, encodes the video data stream into the target video stream, transmits the target video stream to the RTC server through the UDP transmission protocol, the RTC server transmits the target video stream to at least one mobile terminal through the CDN for live broadcast, and the mobile terminal communicates with the RTC server according to the domain name of the RTC server distributed by the CDN. According to the invention, through the UDP transmission protocol, the RTC server and the CDN content distribution, the time delay of the live video of the unmanned aerial vehicle is reduced, and the real-time performance of the live video of the unmanned aerial vehicle is improved.
The present application further provides an electronic device, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of the above embodiments.
The present application also provides a computer-readable storage medium, on which a computer program is stored, which is characterized in that the computer program, when being executed by a processor, performs the method steps of the above-mentioned embodiments.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, to those skilled in the art, changes and modifications may be made without departing from the spirit of the present invention, and it is intended that the present invention encompass such changes and modifications.
Claims (10)
1. An online unmanned aerial vehicle live broadcast method is characterized by comprising the following steps:
the unmanned aerial vehicle collects a video data stream and transmits the video data stream back to the unmanned aerial vehicle nest through a special communication link; the dedicated communication link is a communication link for image transmission between the unmanned aerial vehicle and the unmanned aerial vehicle nest;
the unmanned aerial vehicle nest receives the video data stream, encodes the video data stream into a target video stream, and transmits the target video stream to the RTC server through a UDP transmission protocol;
the RTC server transmits the target video stream to at least one mobile terminal for live broadcast through the CDN; and the mobile terminal communicates with the RTC server according to the RTC server IP address returned by the CDN.
2. The online unmanned aerial vehicle live broadcast method according to claim 1, wherein the step of the unmanned aerial vehicle collecting the video data stream comprises:
the unmanned aerial vehicle receives a video acquisition instruction sent by the mobile terminal, wherein the video acquisition instruction comprises an instruction for starting a camera device;
the unmanned aerial vehicle moves to a specified position to start the camera device based on the camera device starting instruction, and collects video data streams.
3. The online unmanned aerial vehicle live broadcast method of claim 1, wherein the RTC server is an SRS streaming media server.
4. The online unmanned aerial vehicle live broadcast method according to claim 1, wherein the RTC server distributes the target video stream to at least one mobile terminal for live broadcast through the CDN; the step that the mobile terminal communicates with the RTC server according to the domain name of the RTC server distributed by the CDN comprises the following steps:
the mobile terminal decodes the received target video stream to obtain a video frame;
the mobile terminal performs MediaCodeC off-screen rendering on the video frame to obtain a rendered video;
and the mobile terminal plays and displays the rendered video.
5. The online unmanned aerial vehicle live broadcasting method of claim 4, wherein before the step of decoding the received target video stream by the mobile terminal to obtain the video frame, the method further comprises:
and the mobile terminal carries out caching processing on the received target video stream.
6. The utility model provides a live device of online unmanned aerial vehicle which characterized in that includes:
the video data stream acquisition module is used for the unmanned aerial vehicle to acquire a video data stream and transmit the video data stream back to the unmanned aerial vehicle nest through a special communication link; the dedicated communication link is a communication link for image transmission between the unmanned aerial vehicle and the unmanned aerial vehicle nest;
the video data stream coding module is used for receiving the video data stream by the unmanned aerial vehicle nest, coding the video data stream into a target video stream and transmitting the target video stream to the RTC server through a UDP transmission protocol;
the video data stream distribution module is used for the RTC server to distribute the target video stream to at least one mobile terminal for live broadcast through the CDN; and the mobile terminal communicates with the RTC server according to the RTC server IP address returned by the CDN.
7. The online unmanned aerial vehicle live device of claim 5, wherein the video data stream acquisition module comprises:
the command receiving unit is used for receiving a video acquisition command sent by the mobile terminal by the unmanned aerial vehicle, wherein the video acquisition command comprises a command for starting the camera device;
and the video data stream acquisition unit is used for enabling the unmanned aerial vehicle to move to a specified position to start the camera device based on the camera device opening instruction, and acquiring a video data stream.
8. The online unmanned aerial vehicle live device of claim 5, wherein the video data stream distribution module comprises:
a video stream decoding unit, configured to decode, by the mobile terminal, the received target video stream to obtain a video frame;
a video frame rendering unit, configured to perform MediaCodeC off-screen rendering on the video frame by the mobile terminal to obtain a rendered video;
and the video playing unit is used for playing and displaying the rendered video by the mobile terminal.
9. An electronic device, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the online drone live method of any one of claims 1 to 5.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements an online drone live method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111061239.6A CN113973212A (en) | 2021-09-10 | 2021-09-10 | Online unmanned aerial vehicle live broadcast method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111061239.6A CN113973212A (en) | 2021-09-10 | 2021-09-10 | Online unmanned aerial vehicle live broadcast method and device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113973212A true CN113973212A (en) | 2022-01-25 |
Family
ID=79586467
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111061239.6A Pending CN113973212A (en) | 2021-09-10 | 2021-09-10 | Online unmanned aerial vehicle live broadcast method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113973212A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114584561A (en) * | 2022-03-15 | 2022-06-03 | 联想(北京)有限公司 | Information processing method and device and electronic equipment |
| CN115022204A (en) * | 2022-05-26 | 2022-09-06 | 阿里巴巴（中国）有限公司 | RTC transmission delay detection method, device and equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108650232A (en) * | 2018-04-12 | 2018-10-12 | 上海扩博智能技术有限公司 | Unmanned plane media data real-time transmission system and method |
| WO2019015662A1 (en) * | 2017-07-20 | 2019-01-24 | 深圳市道通智能航空技术有限公司 | Method and device for implementing network live broadcast |
| WO2019019370A1 (en) * | 2017-07-24 | 2019-01-31 | 平安科技（深圳）有限公司 | Processing method for live broadcast of audio and video, storage medium and mobile terminal |
| CN111565319A (en) * | 2020-03-31 | 2020-08-21 | 广州中科云图智能科技有限公司 | Live broadcast method and device for unmanned aerial vehicle video and unmanned aerial vehicle nest |
| CN111596674A (en) * | 2020-03-31 | 2020-08-28 | 广州中科云图智能科技有限公司 | Landing positioning method and device for unmanned aerial vehicle and unmanned aerial vehicle nest |
| CN113158116A (en) * | 2021-04-20 | 2021-07-23 | 联通(广东)产业互联网有限公司 | Unmanned aerial vehicle control platform based on mobile internet |
-
2021
- 2021-09-10 CN CN202111061239.6A patent/CN113973212A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019015662A1 (en) * | 2017-07-20 | 2019-01-24 | 深圳市道通智能航空技术有限公司 | Method and device for implementing network live broadcast |
| WO2019019370A1 (en) * | 2017-07-24 | 2019-01-31 | 平安科技（深圳）有限公司 | Processing method for live broadcast of audio and video, storage medium and mobile terminal |
| CN108650232A (en) * | 2018-04-12 | 2018-10-12 | 上海扩博智能技术有限公司 | Unmanned plane media data real-time transmission system and method |
| CN111565319A (en) * | 2020-03-31 | 2020-08-21 | 广州中科云图智能科技有限公司 | Live broadcast method and device for unmanned aerial vehicle video and unmanned aerial vehicle nest |
| CN111596674A (en) * | 2020-03-31 | 2020-08-28 | 广州中科云图智能科技有限公司 | Landing positioning method and device for unmanned aerial vehicle and unmanned aerial vehicle nest |
| CN113158116A (en) * | 2021-04-20 | 2021-07-23 | 联通(广东)产业互联网有限公司 | Unmanned aerial vehicle control platform based on mobile internet |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114584561A (en) * | 2022-03-15 | 2022-06-03 | 联想(北京)有限公司 | Information processing method and device and electronic equipment |
| CN115022204A (en) * | 2022-05-26 | 2022-09-06 | 阿里巴巴（中国）有限公司 | RTC transmission delay detection method, device and equipment |
| CN115022204B (en) * | 2022-05-26 | 2023-12-05 | 阿里巴巴（中国）有限公司 | RTC transmission delay detection method, device and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101945096B (en) | Video live broadcast system facing to set-top box and PC of mobile phone and working method thereof | |
| US20120297423A1 (en) | Method and system for program and stream control of video to target device | |
| CN113973212A (en) | Online unmanned aerial vehicle live broadcast method and device, storage medium and electronic equipment | |
| CN101309393B (en) | Method and system for inter-cut video monitoring in interactive network television | |
| CN108347436A (en) | A kind of unmanned plane long-distance video method for pushing based on high in the clouds | |
| CN104270646A (en) | Self-adaption transmission method and system based on mobile streaming media | |
| CN103501392A (en) | Method for performing real-time audio and video shooting and live broadcast by using mobile phone | |
| CN107819809B (en) | Method and device for synchronizing content | |
| CN101778285B (en) | A kind of audio-video signal wireless transmitting system and method thereof | |
| CN103581699A (en) | Video playing method, streaming media server and streaming media playing system | |
| CN101686391A (en) | Video coding/decoding method and device as well as video playing method, device and system | |
| CN101917428A (en) | Method and system for playing home media videos and mobile communication terminal | |
| CN104506793A (en) | Safe video conference system and method based on internet | |
| CN105791884A (en) | Streaming media live broadcast method and streaming media live broadcast system | |
| CN104639900B (en) | RTMP turns M3U8 video segment system and method | |
| CN103607557A (en) | System and method for displaying monitoring videos in TV picture-in-picture | |
| CN105681817A (en) | Intelligent terminal video and audio collection, transmission and playing system and method | |
| KR20170141677A (en) | Receiving device, transmitting device and data processing method | |
| CN104902344A (en) | System and method of obtaining television program short videos and sharing through network | |
| CN106791860A (en) | A kind of adaptive video coding control system and method | |
| CN107396134A (en) | Recorded broadcast equipment and remote teaching apparatus | |
| CN115348422A (en) | Unmanned aerial vehicle image transmission method, system and computer readable storage medium | |
| CN104349218A (en) | Bidirectional interactive video-on-demand playing system of terrestrial digital television | |
| CN104581234A (en) | Set-top box and method and system for realizing data transcoding of media based on set-top box | |
| CN106790030B (en) | Multi-screen cooperative audio transmission server, client, system and processing method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220125 |