Disclosure of Invention
The invention mainly aims to provide an unmanned aerial vehicle video conferencing method, an unmanned aerial vehicle router, unmanned aerial vehicle gateway equipment and a storage medium, and aims to improve the command efficiency and the task execution efficiency of the unmanned aerial vehicle when the unmanned aerial vehicle executes a task.
In order to achieve the purpose, the invention provides an unmanned aerial vehicle video conference method which is applied to gateway equipment of an unmanned aerial vehicle, and the unmanned aerial vehicle video conference method comprises the following steps:
acquiring real-time video data of a target unmanned aerial vehicle on a media platform, wherein the real-time video data is acquired from the target unmanned aerial vehicle by a router of the unmanned aerial vehicle and uploaded to the media platform;
and sending the real-time video data to conference equipment so as to enable the conference equipment to output the real-time video data in a video conference.
Optionally, the step of obtaining real-time video data of the target drone on the media platform includes:
acquiring a target address of the media platform;
and acquiring the real-time video data from the target address based on a real-time streaming protocol.
Optionally, before the step of obtaining real-time video data of the target drone on the media platform, the method further includes:
receiving a conference invitation sent by the conference equipment, and determining a conference identifier corresponding to a video conference and address information of the conference equipment;
and initiating an anonymous call to the conference equipment according to the conference identifier and the address information, so that the conference equipment adds the target unmanned aerial vehicle to the video conference according to the anonymous call.
Optionally, after the step of sending the real-time video data to the conference device, the method further includes:
when an ending instruction of the video conference is received, stopping acquiring the real-time video data from the media platform;
and/or the media platform is a streaming media platform built based on public cloud service.
In addition, in order to achieve the above object, the present application further provides a video conferencing method for an unmanned aerial vehicle, which is applied to a router of the unmanned aerial vehicle, and the method includes the following steps:
acquiring real-time video data acquired by a target unmanned aerial vehicle;
and uploading the real-time video data to a media platform, wherein the media platform is used for sending the real-time video data to gateway equipment so as to output the real-time video data in a video conference.
Optionally, the step of uploading the real-time video data to a media platform includes:
acquiring a target address of the media platform;
and sending the real-time video data to the target address based on a real-time message transmission protocol and storing the real-time video data in the target address of the media platform.
Optionally, the step of acquiring real-time video data collected by the target drone includes:
and acquiring the real-time video data from the remote control equipment of the target unmanned aerial vehicle, wherein the remote control equipment is used for receiving the real-time video data acquired by the target unmanned aerial vehicle through wireless communication and transmitting the real-time video data to the router through wired connection.
Furthermore, in order to realize the above-mentioned purpose, this application still proposes a gateway equipment of unmanned aerial vehicle, the gateway equipment of unmanned aerial vehicle includes: a memory, a processor, and a drone video conferencing program stored on the memory and executable on the processor, the drone video conferencing program configured to implement the steps of the drone video conferencing method as described in any one of the above.
Furthermore, in order to achieve the above object, the present application also provides a router of a drone, the router of the drone includes: a memory, a processor, and a drone video conferencing program stored on the memory and executable on the processor, the drone video conferencing program configured to implement the steps of the drone video conferencing method as described in any of the above.
In addition, in order to achieve the above object, the present application also provides a storage medium, where the storage medium stores a drone video participation program, and the drone video participation program, when executed by a processor, implements the steps of the drone video participation method described in any one of the above.
The invention provides an unmanned aerial vehicle video conferencing method, which is characterized in that real-time video data of a target unmanned aerial vehicle on a media platform are obtained by utilizing gateway equipment, the real-time video data are obtained from the target unmanned aerial vehicle by a router of the unmanned aerial vehicle and are uploaded to the media platform, so that the real-time video data collected by the target unmanned aerial vehicle are obtained, then the gateway equipment sends the real-time video data to conference equipment, so that the conference equipment outputs the real-time video data in a video conference, and the real-time video data collected by the unmanned aerial vehicle is added in the video conference. Compare in traditional scheme unmanned aerial vehicle can't pass back the video of gathering to national standard platform, utilize unmanned aerial vehicle's router to upload and save to the media platform with the real-time video data that unmanned aerial vehicle gathered, avoid the restriction of national standard, and join unmanned aerial vehicle in the video conference through gateway equipment and meeting equipment, output real-time video data, realize unmanned aerial vehicle's video meeting, thereby let the staff beyond the field operation personnel also can participate in real time monitoring and make the instruction, thereby commander efficiency and task execution efficiency when improving unmanned aerial vehicle execution task.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The embodiment of the invention provides gateway equipment of an unmanned aerial vehicle. As shown in fig. 1, the gateway device of the drone may include: a processor 1001 such as a Central Processing Unit (CPU), a communication bus 1002, a network interface 1003, and a memory 1004. Wherein a communication bus 1002 is used to enable connective communication between these components. The network interface 1003 may optionally include a standard wired interface, a WIreless interface (e.g., a WIreless-FIdelity (WI-FI) interface). The Memory 1004 may be a Random Access Memory (RAM) Memory, or may be a Non-Volatile Memory (NVM), such as a disk Memory. The memory 1004 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the configuration shown in fig. 1 does not constitute a limitation of the gateway device and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, the storage 1004, which is a storage medium, may include therein a drone video conferencing program. In the gateway device of the drone shown in fig. 1, the network interface 1003 is mainly used for data communication with other devices; the processor 1001 may be configured to invoke the drone video conferencing program stored in the memory 1004 and perform the operations associated with the drone video conferencing method in the following embodiments.
The embodiment of the invention also provides an unmanned aerial vehicle video conferencing method. Referring to fig. 2, an embodiment of the video conferencing method for the unmanned aerial vehicle is provided. In this embodiment, a gateway device whose main body is an unmanned aerial vehicle is executed, and the video conference method for the unmanned aerial vehicle includes:
step S10, acquiring real-time video data of a target unmanned aerial vehicle on a media platform, wherein the real-time video data is acquired from the target unmanned aerial vehicle by a router of the unmanned aerial vehicle and uploaded to the media platform;
the real-time video data is video data collected by the target unmanned aerial vehicle, further can be video data collected in real time in a current flight task of the target unmanned aerial vehicle, and the real-time situation of the current flight task of the target unmanned aerial vehicle can be confirmed based on the real-time video data.
The router of the unmanned aerial vehicle acquires real-time video data through communication with the target unmanned aerial vehicle and uploads the real-time video data to the media platform, and the media platform can be used for storing the uploaded real-time video data so that the gateway equipment can acquire the real-time video data from the media platform according to actual needs.
It should be noted that the router of the drone may be associated with more than one drone, that is, may obtain real-time video data of multiple drones simultaneously, and upload the corresponding real-time video data to the media platform for independent storage according to the respective identifier of each drone. Meanwhile, the gateway equipment can determine a target unmanned aerial vehicle according to the actual needs of the video conference, the target unmanned aerial vehicle is one or more than one of the unmanned aerial vehicles associated with the router and is appointed by participating users of the video conference, and the gateway equipment acquires corresponding real-time video data from the media platform according to the determined target unmanned aerial vehicle.
Further, the gateway device may be configured to process requests related to a plurality of video conferences at the same time, and different video conferences may correspond to different target drones, i.e., obtain real-time video data of corresponding target drones for different video conferences at the same time.
Optionally, before or during the video conference, the participating user may designate the target drone, that is, invite the target drone to participate in the video conference, the conference device requests the gateway device for real-time video data of the target drone of the video conference, and the gateway device obtains the matched real-time video data of the drone from the media platform according to the request.
And step S20, sending the real-time video data to conference equipment so that the conference equipment outputs the real-time video data in a video conference.
The conference device is a server for processing the video conference, and the management and control of the video conference and the related data transmission are all performed through the conference device. It should be noted that the conference device is not a device used by the participating user, but a device for managing and controlling the video conference, and the device of each participating user performs authentication and management through the conference device, and shares data of each participating user device with other devices in the conference through the conference device, thereby implementing the video conference.
In addition, the conference device is a device composed of an MCU (Multi Control Unit), an SC (Switch Center, call Control and firewall traversal server), and/or an SMC (Switch manager Center), so as to implement management and Control of the video conference.
Optionally, the gateway device sends the real-time video data to the conference device, and the conference device processes the real-time video data and shares the real-time video data with a device used by a participating user of the video conference; on the equipment used by the participatory user, the target unmanned aerial vehicle can be seen to be added to the video conference as a new member of the conference, and the content shared by the video of the target unmanned aerial vehicle is real-time video data of the target unmanned aerial vehicle, so that the participatory user can participate in monitoring of the unmanned aerial vehicle through the video conference.
According to the video conferencing method for the unmanned aerial vehicle, the real-time video data of the target unmanned aerial vehicle on the media platform is obtained through the gateway device, the real-time video data are obtained from the target unmanned aerial vehicle through the router of the unmanned aerial vehicle and are uploaded to the media platform, so that the real-time video data collected by the target unmanned aerial vehicle are obtained, then the gateway device sends the real-time video data to the conference device, the conference device outputs the real-time video data in the video conference, and the fact that the real-time video data collected by the unmanned aerial vehicle are added in the video conference is achieved. Compare in traditional scheme unmanned aerial vehicle can't pass back the video of gathering to national standard platform, utilize unmanned aerial vehicle's router to upload and save to the media platform with the real-time video data that unmanned aerial vehicle gathered, avoid the restriction of national standard, and join unmanned aerial vehicle in the video conference through gateway equipment and meeting equipment, output real-time video data, realize unmanned aerial vehicle's video meeting, thereby let the staff beyond the field operation personnel also can participate in real time monitoring and make the instruction, thereby commander efficiency and task execution efficiency when improving unmanned aerial vehicle execution task.
Further, based on the above embodiment, another embodiment of the unmanned aerial vehicle video conference method is provided. In this embodiment, referring to fig. 3, before the step of acquiring real-time video data of a target drone on a media platform, the method further includes:
step S11, receiving a conference invitation sent by the conference equipment, and determining a conference identifier corresponding to a video conference and address information of the conference equipment;
and S12, initiating an anonymous call to the conference equipment according to the conference identifier and the address information, so that the conference equipment adds the target unmanned aerial vehicle to the video conference according to the anonymous call.
The conference invitation is an invitation for inviting the gateway equipment to join the video conference, and through the invitation, the gateway equipment can determine that the video conference has the requirement for acquiring real-time video data of the unmanned aerial vehicle, and after the video conference is joined, the target unmanned aerial vehicle of the video conference is determined through the association with the conference.
The conference invitation comprises a conference identifier (conference number) of the corresponding video conference and address information (SC parameter) of conference equipment, and the gateway equipment can initiate a call to the corresponding video conference according to the conference identifier and the address information; in this embodiment, the calling mode is an anonymous calling, and for the conference device, the calling based on the transmitted conference invitation feedback does not require confirmation of the opposite terminal, and in other embodiments, other calling modes may be used. In addition, the call initiated by the gateway device to the corresponding videoconference is based on the SIP (Session Initiation Protocol).
Optionally, before the gateway device acquires the real-time video data of the target unmanned aerial vehicle, the gateway device needs to be added into the video conference first to support the gateway device to share the acquired real-time video data of the unmanned aerial vehicle; after the video conference is developed and when a participant specifies that a target unmanned aerial vehicle joins the conference, the conference equipment sends a conference identifier of the video conference and address information of the conference equipment to the gateway equipment, and the gateway equipment initiates a call to the video conference and joins the conference so as to execute the following steps of acquiring real-time video data of the target unmanned aerial vehicle and sharing the real-time video data to the conference equipment.
The conference invitation is sent to the gateway equipment through the conference equipment, the gateway equipment feeds back the conference invitation to call the corresponding video conference, the gateway equipment is added into the video conference, the follow-up step of acquiring real-time video data of the target unmanned aerial vehicle through the gateway equipment is supported, and therefore the video of the target unmanned aerial vehicle participates.
Further, in the present embodiment, the step S10 includes:
step S13, acquiring a target address of the media platform;
and S14, acquiring the real-time video data from the target address based on a real-time streaming protocol.
The target address is an address of real-time video data of the target unmanned aerial vehicle stored on the media platform, and the target address can be set in the gateway device by a worker in advance.
The Real-Time Streaming Protocol is RTSP (Real Time Streaming Protocol), which is a Protocol for controlling multimedia Streaming based on TCP/IP Protocol system. Based on a real-time streaming protocol, the gateway device can acquire real-time video data of the target unmanned aerial vehicle and send the real-time video data to the conference device on the premise of guaranteeing real-time performance of the video data, and real-time sharing of the video data is achieved.
In addition, the gateway equipment acquires real-time video data from the media platform and operates as pull stream, and the target address is the address of the pull stream; based on the service flow of the pull stream, the gateway device can perform pull stream on the target address only through the verification of a preset account and a secret key so as to ensure the safety of the real-time video data of the unmanned aerial vehicle stored on the media platform.
Further, in this embodiment, after step S20, the method further includes:
and S21, when the ending instruction of the video conference is received, stopping acquiring the real-time video data from the media platform.
Optionally, after the participant selects to end the video conference, the conference device cancels the video conference and sends an end instruction of the video conference to the gateway device to notify the gateway device that the video conference is ended; and after receiving the ending instruction, the gateway equipment stops continuously acquiring the real-time video data of the target unmanned aerial vehicle from the media platform.
It should be noted that, after the gateway device stops obtaining the real-time video data of the unmanned aerial vehicle from the media platform, it will not affect the corresponding unmanned aerial vehicle to continue returning the real-time video data and upload the real-time video data to the media platform through the router, the unmanned aerial vehicle will continue returning the real-time video data according to the flight task in execution, and the gateway device can continue obtaining the real-time video data of the unmanned aerial vehicle from the media platform according to the requirements of other video conferences.
And after the video conference is finished, the corresponding real-time video data acquisition from the media platform is stopped, so that the waste of gateway equipment resources can be reduced, and the working efficiency of the gateway equipment is improved.
Further, in this embodiment, the media platform is a streaming media platform built based on public cloud services.
Public cloud services are cloud services provided by third party providers that are made available to users over an open public network (typically the Internet). In addition, the streaming media platform is a platform for providing video services by streaming media technology, and real-time transmission of video or sound data on a network can be realized based on streaming media.
The public cloud streaming media platform is used as a media platform for storing real-time video data of the unmanned aerial vehicle, real-time video data of a remote target unmanned aerial vehicle can be shared to a video conference in real time by using a streaming media technology, the real-time video effect during remote monitoring is improved, and therefore the effect of the remote real-time monitoring unmanned aerial vehicle is improved.
The embodiment of the invention provides a router of an unmanned aerial vehicle. As shown in fig. 4, the router of the drone may include: a processor 2001, such as a Central Processing Unit (CPU), a communication bus 2002, a network interface 2003, and a memory 2004. The communication bus 2002 is used to implement connection communication between these components. The network interface 2003 may optionally include a standard wired interface, a WIreless interface (e.g., a WIreless-FIdelity (WI-FI) interface). The Memory 2004 may be a Random Access Memory (RAM) Memory or a Non-Volatile Memory (NVM), such as a disk Memory. The memory 2004 may alternatively be a storage device separate from the processor 2001 described previously.
Those skilled in the art will appreciate that the architecture shown in fig. 4 does not constitute a limitation of a router, and may include more or fewer components than shown, or some components in combination, or a different arrangement of components.
As shown in fig. 4, the memory 2004, which is a storage medium, may include a drone video conferencing program. In the router of the drone shown in fig. 4, the network interface 2003 is mainly used for data communication with other devices; the processor 2001 may be configured to invoke the drone video conferencing program stored in the memory 2004 and perform operations associated with the drone video conferencing method of the following embodiments.
Further, based on the above embodiment, another embodiment of the video conference method for the unmanned aerial vehicle is provided. In this embodiment, referring to fig. 5, a router whose main body is an unmanned aerial vehicle is executed, where the unmanned aerial vehicle video conferencing method includes:
step S100, acquiring real-time video data acquired by a target unmanned aerial vehicle;
step S200, uploading the real-time video data to a media platform, wherein the media platform is used for sending the real-time video data to gateway equipment so as to output the real-time video data in a video conference.
Optionally, the target drone may include more than one drone, and the router may acquire real-time video data of the more than one drone at the same time, and upload real-time video data of different drones to the media platform for storage respectively.
In this embodiment, the router is an aggregation router, and combines multiple communication lines of multiple communication carriers by using a multilink aggregation method, thereby providing network connection with high capacity and high availability. Based on this, the aggregation router can realize the task of uploading real-time video data of more than one unmanned aerial vehicle at the same time.
Optionally, the target unmanned aerial vehicle has a corresponding operator on the site where the target unmanned aerial vehicle executes the flight mission, and the operator can control the router to acquire and upload the real-time video data of the unmanned aerial vehicle. Furthermore, the router can be configured with corresponding management application software, and an operator can operate the management application software through the terminal to realize management and control of the router.
Utilize the router to acquire the real-time video data of target unmanned aerial vehicle collection and upload to the media platform, the accessible router carries out unified real-time video data management and uploads, improves the arrangement effect to the real-time video data who gathers, is favorable to the videoconference to transfer. Simultaneously, be different from directly uploading real-time video data through unmanned aerial vehicle, can provide the better communication line of speed better quality based on the router, reduce the loss and the delay of data transmission process, improve real-time effect of real-time video data.
Further, in this embodiment, step S200 includes:
step S201, acquiring a target address of the media platform;
step S202, sending the real-time video data to the target address based on a real-time message transmission protocol and storing the real-time video data in the target address of the media platform.
Alternatively, the destination address may be set in the router by an operator through the router's management application.
The Real-Time Messaging Protocol is an RTMP (Real Time Messaging Protocol) Protocol, which is a network Protocol for Real-Time data communication based on the TCP Protocol. Based on a real-time message transmission protocol, the router uploads real-time video data to the media platform on the premise of guaranteeing real-time performance, so that the real-time video data acquired by the gateway equipment has real-time performance, and real-time sharing of the video data is achieved.
In addition, the operation that the router uploads the real-time video data to the media platform is a stream pushing operation, a target address is an address of the stream pushing operation, and the router pushes the real-time video data to the media platform according to the target address.
Further, in this embodiment, step S100 includes:
step S101, acquiring the real-time video data from a remote control device of the target unmanned aerial vehicle, wherein the remote control device is used for receiving the real-time video data acquired by the target unmanned aerial vehicle through wireless communication and transmitting the real-time video data to the router through wired connection.
The remote control equipment is the corresponding flight control console of the target unmanned aerial vehicle, and the on-site operator can operate the unmanned aerial vehicle to execute flight tasks through operating the flight control console in a remote control mode. In addition, the flight control console is connected with the unmanned aerial vehicle through wireless communication so as to carry out communication transmission of operation commands and other data; simultaneously, the real-time video data that unmanned aerial vehicle gathered also can be based on with fly the radio communication between the control cabinet and pass back to flying the control cabinet, and operating personnel accessible flies the control cabinet and looks over the real-time video data that unmanned aerial vehicle gathered in real time.
Furthermore, the remote control device (i.e. the flight control console) and the router can be in wired connection through an HDMI high-definition line, so that the router can acquire real-time video data returned by the target unmanned aerial vehicle on the remote control device according to the wired connection, and the speed and the quality of data transmission are ensured.
Real-time video data that the wireless communication through remote control equipment and unmanned aerial vehicle gathered unmanned aerial vehicle passes back to remote control equipment, then through router and remote control equipment's wired connection transmission real-time video data to router, can be under the prerequisite of the flexibility of guaranteeing remote control equipment operation unmanned aerial vehicle, improve the speed and the quality of real-time video data transmission to router, thereby reduce real-time video data and share delay and the loss to the video conference in-process, improve the effect of the real-time video data of remote monitoring unmanned aerial vehicle.
In addition, an embodiment of the present invention further provides a storage medium, where an unmanned aerial vehicle video conference program is stored on the storage medium, and when executed by a processor, the unmanned aerial vehicle video conference program implements relevant steps of any embodiment of the above unmanned aerial vehicle video conference method.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the description of the foregoing embodiments, it is clear to those skilled in the art that the method of the foregoing embodiments may be implemented by software plus a necessary general hardware platform, and certainly may also be implemented by hardware, but in many cases, the former is a better implementation. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.