CN114937376A - Unmanned aerial vehicle and intelligent device's wisdom synthesis command management information system and device - Google Patents
Unmanned aerial vehicle and intelligent device's wisdom synthesis command management information system and device Download PDFInfo
- Publication number
- CN114937376A CN114937376A CN202210508313.2A CN202210508313A CN114937376A CN 114937376 A CN114937376 A CN 114937376A CN 202210508313 A CN202210508313 A CN 202210508313A CN 114937376 A CN114937376 A CN 114937376A
- Authority
- CN
- China
- Prior art keywords
- unmanned aerial
- aerial vehicle
- media data
- service module
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/0047—Navigation or guidance aids for a single aircraft
- G08G5/0069—Navigation or guidance aids for a single aircraft specially adapted for an unmanned aircraft
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/06—Traffic control systems for aircraft, e.g. air-traffic control [ATC] for control when on the ground
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides an intelligent comprehensive command management information system and device capable of covering unmanned aerial vehicles and intelligent equipment, comprising: the system comprises a service center service module, a media service module, a signaling service module and a front-end web page module, and is characterized in that: the service center service module is used for providing a service data access interface for the media service module and the signaling service module; the signaling service module is used for establishing communication connection with a ground station or unmanned aerial vehicle equipment and acquiring streaming media data; the media service module is used for acquiring the streaming media data according to the access request and sending the streaming media data to the client for display; the front-end webpage module is used for calling a third-party electronic map to the client, generating a map interface and map information, and adding a multi-layer interface on the map interface, wherein the multi-layer interface is used for acquiring streaming media data according to a user request and executing scheduling management on the map interface according to the streaming media data, so that the management efficiency and the use convenience of the unmanned aerial vehicle device are improved.
Description
Technical Field
The invention relates to the technical field of unmanned aerial vehicles, intelligent equipment and computers, in particular to an intelligent comprehensive command and management information system and device for the unmanned aerial vehicles and the intelligent equipment
Background
When the existing unmanned aerial vehicle, load equipment, three-party equipment and the like are used in industries, the industries cannot be normally used, and when various unmanned aerial vehicles exist, the unmanned aerial vehicle commands and dispatches and seamlessly connects equipment data information and other service systems into an organic whole, so that the technical problem that the unmanned aerial vehicle equipment is applied in various fields is solved.
Disclosure of Invention
The embodiment of the invention mainly aims to provide an intelligent comprehensive command management information system and device for unmanned aerial vehicles and intelligent equipment, so that the management efficiency and the single terminal of the use convenience degree of the unmanned aerial vehicle equipment and the intelligent equipment are improved, and the problem that information cannot be returned to the rear end in real time is solved; the scheduling management coordination of equipment and personnel is insufficient, and the efficiency of cooperative scheduling is not high; the data type is single, an 'information island' is easy to form, and the mining processing capacity of the data is insufficient; the interconnection and intercommunication mode among the communication elements is easily restricted by terrain, and communication networking with communication distance restriction is difficult to effectively develop; traditional work often appears inefficiency, with high costs, not lasting etc..
The technical scheme of the invention comprises an intelligent comprehensive command management information system of an unmanned aerial vehicle and intelligent equipment, which comprises a service center service module, a media service module, a signaling service module and a front-end webpage module, and is characterized in that:
the service center service module is used for providing a service data access interface for the media service module and the signaling service module;
the signaling service module is used for establishing communication connection with a ground station or unmanned aerial vehicle equipment and acquiring streaming media data;
the media service module is used for acquiring the streaming media data according to the access request and sending the streaming media data to the client for displaying;
the front-end webpage module is used for calling a third-party electronic map to the client, generating a map interface and map information, and adding a multi-layer interface to the map interface, wherein the multi-layer interface is used for acquiring the streaming media data according to the request of a user and executing scheduling management on the map interface according to the streaming media data.
According to unmanned aerial vehicle and smart machine's wisdom comprehensive command management information system, wherein the service center service module includes:
adopting a remote process call service to execute at least one of map display, unmanned aerial vehicle position real-time refreshing, longitude and latitude display, satellite map, 3D map switching, map distance measurement, self-defined layer display, route planning, unmanned aerial vehicle information and video picture superposition according to the signaling service module, the media service module and the service data access request of the client;
and executing at least one of weather data and flight preparation approval through a third-party platform interface by adopting a webpage service.
According to unmanned aerial vehicle and smart machine's wisdom comprehensive command management information system, wherein signaling service module includes: the ground station or the unmanned aerial vehicle equipment establishes communication connection with the signaling service module based on an SDK of GB28181 protocol communication, wherein the signaling service module is used as a service end of the GB28181 protocol communication, and the ground station or the unmanned aerial vehicle equipment is used as a client end of the GB28181 protocol communication; or, the signaling service module is used as a client of GB28181 protocol communication, and registers with a third party platform of GB28181 protocol communication, so that the unmanned aerial vehicle device sends video data to the third platform, where the transmission format of the video data is PS-RTP.
According to unmanned aerial vehicle and smart machine's wisdom comprehensive command management information system, wherein the media service module includes: the video stream receiving sub-module is configured to receive all the streaming media data sent by the ground station or the drone device, and receive the streaming media data by creating a socket, where the video stream receiving sub-module uses at least one of a UDP streaming mode of a GB28181 protocol, a TCP streaming mode of the GB28181 protocol, and other protocol accesses; the stream processing submodule is used for acquiring the stream media data received by the video stream receiving submodule and converting the stream media data into a target media format; and the stream distribution submodule distributes the stream media data processed by the stream processing submodule.
According to unmanned aerial vehicle and smart machine's wisdom comprehensive command management information system, wherein flow handles the submodule and still includes: and storing the multiple mapping relation between the storage format of the streaming media data and the target media format, and respectively converting the same path of data source with a plurality of targets and the target media format by adopting multiplexing logic.
According to unmanned aerial vehicle and smart machine's wisdom comprehensive command management information system, wherein the flow distribution submodule still includes: and for the same path of video requested by a plurality of same destination terminals, keeping multiple relation mapping from the streaming media data to the destination terminals, and sequentially sending the streaming media data of the same path and the target media format according to the request sequence.
According to unmanned aerial vehicle and smart machine's wisdom comprehensive command management information system, wherein media service module still includes: and summarizing and sending the streaming media data through a WebRTC protocol stack and an RTSP protocol stack.
According to unmanned aerial vehicle and smart machine's wisdom comprehensive command management information system, wherein media service module still includes: storing the acquired streaming media data into a file comprising RTP information MP4 format; according to the recording request of the user at the front end webpage module, the stream processing submodule acquires the stream media data and converts the stream media data into MP4 file data, the stream distribution submodule receives and stores the data, and the storage result and the storage event are stored in the service center service module.
According to unmanned aerial vehicle and smart machine's wisdom comprehensive command management information system, wherein media service module still includes: and the video playing sub-module is used for processing at least one of playing, recording and replaying the video by the client and the front end webpage module.
The technical scheme of the invention also comprises an intelligent comprehensive command management information device for realizing the unmanned aerial vehicle and the intelligent equipment of any system, which comprises an unmanned dispatching system server, a ground station, a client and unmanned aerial vehicle equipment, wherein the unmanned dispatching system server is communicated with the ground station and the client, and the unmanned aerial vehicle equipment is connected with the ground station; the unmanned dispatching system server is used for providing a service data access interface, establishing communication connection with a ground station or unmanned aerial vehicle equipment according to the client request, acquiring streaming media data, acquiring the streaming media data and sending the streaming media data to the client for display; calling a third-party electronic map according to a client request, generating a map interface and map information at the client, and adding a multi-layer interface at the map interface, wherein the multi-layer interface is used for acquiring the streaming media data according to a user request, and performing at least one of playing or scheduling management at the map interface according to the streaming media data; the unmanned aerial vehicle equipment user acquires and sends self state data, wherein the self state data comprises at least one of unmanned aerial vehicle position information, airframe information, flight direction information and flight speed information; and the ground station sends the acquired streaming media data according to the unmanned dispatching system server.
The invention has the beneficial effects that: the technical scheme of the invention provides multiple application scenes for the client, such as map display, unmanned aerial vehicle position real-time refreshing, longitude and latitude display, satellite maps, 3D map switching, map ranging, user-defined layer display, air route planning, unmanned aerial vehicle information and video picture overlapping and the like, and improves the management efficiency of the unmanned aerial vehicle equipment.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a system block diagram of a method of an embodiment of the invention.
Fig. 2 is a system architecture diagram of another embodiment of the present invention.
Fig. 3 is a schematic diagram of a media service module according to an embodiment of the present invention.
Fig. 4 is a sequence diagram of live and recorded programs at the Web site according to an embodiment of the present invention.
Fig. 5 is a sequence diagram of a video played and recorded by a PC client according to an embodiment of the present invention.
Fig. 6 is a sequence diagram of Web-end video playback and playback control according to an embodiment of the present invention.
Fig. 7 is a diagram of an apparatus according to an embodiment of the present invention.
Fig. 8 is a schematic diagram of a scheduling function of an intelligent integrated command and management information system of an unmanned aerial vehicle and an intelligent device according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. In the following description, suffixes such as "module", "part", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no peculiar meaning in itself. Thus, "module", "component" or "unit" may be used mixedly. "first", "second", etc. are used for the purpose of distinguishing technical features only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features or implicitly indicating the precedence of the indicated technical features. In the following description, the method steps are labeled continuously for convenience of examination and understanding, and the implementation sequence of the steps is adjusted without affecting the technical effect achieved by the technical scheme of the invention in combination with the overall technical scheme of the invention and the logical relationship among the steps. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.
The terms of the present invention are explained:
the GRPC is used for remote procedure call and can be used for connecting, calling, operating and debugging the distributed heterogeneous application program;
the GB28181 protocol refers to the national standard GB/T28181-2016, specifies the interconnection structure of a public safety video monitoring networking system, the basic requirements and the safety requirements of transmission, exchange and control, and the technical requirements of control, transmission flow, protocol interfaces and the like, and is the national standard in the field of video monitoring.
RTSP, Real-Time Streaming Protocol, is a text-based application layer Protocol, and is an application layer Protocol in a TCP/IP Protocol system.
WebRTC, Web Real-Time Communication, i.e., Web page Real-Time Communication.
SRTP, Secure Real-time Transport Protocol, which is a Protocol defined on the basis of the Real-time Transport Protocol (RTP).
The RESTFul API, which is REST, Representational State Transfer, refers to a set of architectural constraints and principles.
FIG. 1 is a system block diagram of a method of an embodiment of the invention. Referring to fig. 1, it includes: the system comprises a service center service module, a media service module, a signaling service module and a front-end webpage module, wherein the service center service module is used for providing a service data access interface for the media service module and the signaling service module; the signaling service module is used for establishing communication connection with a ground station or unmanned aerial vehicle equipment and acquiring streaming media data; the media service module is used for acquiring the streaming media data according to the access request and sending the streaming media data to the client for display; the front-end webpage module is used for calling a third-party electronic map to the client, generating a map interface and map information, and adding a multi-layer interface on the map interface, wherein the multi-layer interface is used for acquiring streaming media data according to a user request and executing scheduling management on the map interface according to the streaming media data.
Fig. 2 is a system architecture diagram of another embodiment of the present invention. The system consists of a service center service (TCS), a media service (MDS), a signaling service (PTS) and a front end Web. The TCS, MDS and PTS all run in an independent process mode, and can be deployed uniformly or in a distributed deployment mode. The Web is used as an interface of front-end user interaction, and service pages of the unmanned dispatching and big data platform system are presented in a browser. The modules are described in detail below.
The TCS is used as a service center of the system, is a general inlet of all service interfaces, realizes various protocol stacks including a Web Server and a Grpc Server, and can meet two application architecture schemes of B/S and C/S. Meanwhile, the TCS is also the only access gateway of the system persistence service data, so the TCS can be used as a data support center of a signaling service (PTS) and a media service (MDS), the TCS and the media service (MDS) are connected to the TCS by the identity of a Grpc client, and the service data is accessed through a Grpc API (application program interface), so that the self service function is completed. In addition, the TCS is also responsible for acquiring weather data from a WebAPI provided by the China weather bureau and completing processes of submission, approval and the like of the flight plan from the WebAPI provided by the China air traffic control organization.
The PTS is a signaling center of the system and is responsible for accessing a ground station or unmanned aerial vehicle equipment controlled by an airborne terminal. The ground station calls the SDK to be connected with the PTS, the SDK selects GB28181 protocol communication (the PTS is used as GB28181Server, the ground station is used as GB28181 Agent), and the video data selects PS-RTP transmission format. In addition, PTS can be used as GB28181 Agent to be registered to GB28181Server of a third-party platform, and the unmanned aerial vehicle video is forwarded to the third-party platform, so that the multi-stage streaming media architecture based on the GB28181 protocol is completed.
The MDS is a media center of the system, and realizes a plurality of streaming media protocol stacks including WebRTC and RTSP. The WebRTC is used for playing web page videos, and the RTSP is used for playing desktop client videos. Functionally, the MDS supports the live service of the unmanned aerial vehicle to complete video playing under B/S and C/S architectures, the videos are stored in a linkage mode, and the recorded broadcast service of the unmanned aerial vehicle is supported to complete video playback and video playback operations (pause, start, fast forward, fast backward and the like). In addition, the MDS and the PTS adopt UDP-based private protocol communication and are used for negotiating a video playing process with a ground station.
The Web is used as a UI interface for users to access the system, takes the map as a core, and provides visual elements for all services for the users to operate. The map display adopts a JS API framework provided by Gaode, so that map operations such as map display, longitude and latitude information display, map ranging, user-defined map layer, user-defined air route planning, regional drawing of a no-fly zone/a flight-limiting zone and the like are realized; weather data queries WebAPI provided by TCS; the unmanned aerial vehicle video calls a WebRTC interface to request data from the MDS; and receiving the information reported by the Websocket interface provided by the TCS in real time by the unmanned aerial vehicle through latitude, longitude, position, speed information and the like.
Fig. 3 is a schematic diagram of a media service module according to an embodiment of the present invention. The TCS sends a play request to the MDS, and then the TCS forwards the play request to the PTS through a private protocol, the PTS sends an Invite request of a GB28181 protocol to the ground station, and the ground station starts to send video data to the MDS after completing Invite negotiation. A brief description of the video stream processing scheme within the MDS will now be provided.
Service center services (TCS), media services (MDS), signaling services (PTS), and front end Web.
StreamReceiver
And the video stream receiving module is used for completing all network receiving of the streaming media data. Since the PTS and the MDS are different processes running on the same machine, in order to reduce the transmission times of video data, reduce time delay and optimize data transmission efficiency, a network socket for receiving data is created by the module, so that the video data can directly enter the MDS. Currently, StreamReceiver supports UDP mode streaming of GB28181 protocol, TCP streaming mode of reserved GB28181 module, and other protocol access, such as RTSP or third party SDK.
StreamHandler
The stream processing module, after passing through the StreamReceiver module, the stream media data will be passed to the process, and because the final format required by the destination of the request data is different, the possible processing flows include PS-RTP data to H264/H265 frame, frame data to SRTP, frame data to MP4, etc. Multiple relation mapping of a source-target format (one-to-many) can be stored in the module, multiplexing logic of the same path of source data is achieved, one path of source data is guaranteed to be requested only once, and minimum flow communication with the butt joint device is achieved. The using scene is that one Web end and one desktop end request the video picture of the same unmanned aerial vehicle, and at the moment, one path of PS-RTP needs to be converted into RTP and SRTP respectively.
StreamDistribute
And the stream distribution module distributes the final media data through different modules after the StreamHandler processes the media data. In order to implement the media data multiplexing process as in StreamHandler, for the same path of video requested by a plurality of same destination terminals, the inside of the module will keep multiple relation mapping of the destination terminal (one-to-many). The using scene is that a plurality of Web terminals request the video picture of the same unmanned aerial vehicle, and at the moment, the same path of SRTP data needs to be sent in sequence.
WebRTC Stack and RTSP Stack
The two protocol stacks respectively realize signaling and data transmission of WebRTC and RTSP, and the media stream distributed by the StreamDistribute is transferred out through the two protocol stacks.
Video storage and playback
The MP4 file supports mainstream video coding formats such as H264/H265 and the like and audio coding formats such as ACC and the like, and for a service scene needing to be stored in a sub-file for recording for a long time, the file independence of the MP4 greatly simplifies the file storage control flow. Additionally, the RTSP protocol and the Video tag of JS naturally support playback of MP4 files, and playback control commands. Therefore, storing the video file in MP4 format with RTP information is a first solution that is compatible with the current technological options.
The TCS informs the MDS to start a real-time recording command of the video of the related unmanned aerial vehicle after the unmanned aerial vehicle triggers an event or the user actively clicks a recording button. The StreamHandler module converts the received video data of the unmanned aerial vehicle into MP4 file data, the MP4 file data is stored on a hard disk of the server by a streamdistribution, the storage result of the time is fed back to the TCS, the TCS binds the storage result with the triggered event, and the event and media data information items are added to a database record list.
Fig. 4 is a sequence diagram of live and recorded programs at the Web site according to an embodiment of the present invention. The flows of playing and recording the unmanned aerial vehicle video in the browser webpage by the user are as follows:
the Web calls a WebAPI to send the playing request to the TCS;
the TCS successfully replies the Web request and simultaneously returns the room number;
web negotiates video playing by using a room number and an MDS through a WebRTC protocol;
if the MDS does not establish a stream link with the ground station, a private protocol is required to send a request to the PTS, the PTS sends an Invite request to the ground station through a GB28181 protocol, the ground station returns 200OK, and PS-RTP video media data are sent to the MDS;
the MDS replies that the negotiation is successful;
the MDS converts the received PS-RTP stream into SRTP and sends the SRTP to the Web;
the Web displays video screens.
The recording operation flow of the user in video playing is as follows:
the Web calls the WebAPI to send the recording operation to the TCS;
the TCS forwards the recording operation to the MDS;
the MDS replies that the TCS operation request is successful;
the TCS successfully replies the Web operation request;
the MDS converts the PS stream into an MP4 file with RTPINfo and stores the MP4 file locally;
reporting MP4 file information to the TCS after MDS finishes recording;
the TCS stores the recorded MP4 file information in a database.
Fig. 5 is a sequence diagram of a video played and recorded by a PC client according to an embodiment of the present invention. The process comprises the following steps:
the process of playing and recording the unmanned aerial vehicle video at the client by the user is as follows:
the client calls the GRPCAPI to send the play request to the TCS;
the TCS replies that the client request is successful and returns the RTSPURL;
the client negotiates video playing with MDS through the RTSP protocol;
if the MDS does not establish a stream link with the ground station, a private protocol is required to send a request to the PTS, the PTS sends an Invite request to the ground station through a GB28181 protocol, the ground station returns 200OK, and PS-RTP video media data are sent to the MDS;
the MDS replies that the negotiation is successful;
the MDS converts the received PS-RTP stream into RTP and sends the RTP to the client;
the client displays the video pictures.
The recording operation flow of the user in video playing is as follows:
the client calls GRPCAPI to send the recording operation to TCS;
the TCS forwards the recording operation to the MDS;
the MDS successfully replies the TCS operation request;
the TCS replies that the client operation request is successful;
the MDS converts the PS stream into an MP4 file with RTPINfo and stores the MP4 file locally;
reporting MP4 file information to the TCS after MDS finishes recording;
the TCS stores the recorded MP4 file information in a database.
Fig. 6 is a sequence diagram of Web-side video playback and playback control according to an embodiment of the present invention. The process comprises the following steps:
the user plays back and controls the video playback flow in the browser webpage as follows:
the Web requests a playback resource URL from the TCS through a Web API;
the TCS returns a playback resource URL;
filling URL into a user browser through a Video tag of JS to initiate a Video playback request to Web;
the Web returns that the negotiation is successful;
downloading an MP4 file by a JS Video tag of a user browser, and playing a Video;
a user operating playback control on a browser;
the browser makes a corresponding control response;
and the browser returns a control operation result.
Fig. 7 is a diagram of an apparatus according to an embodiment of the present invention. It includes: the device comprises an unmanned dispatching system server, a ground station, a client and unmanned aerial vehicle equipment, wherein the unmanned dispatching system server is connected with the ground station and the client, and the unmanned aerial vehicle equipment is connected with the ground station; the unmanned dispatching system server is used for providing a service data access interface, establishing communication connection with a ground station or unmanned aerial vehicle equipment according to a client request, acquiring streaming media data, and transmitting the streaming media data to the client for display; according to the request of the client, calling a third-party electronic map, generating a map interface and map information at the client, and adding a multi-layer interface at the map interface, wherein the multi-layer interface is used for acquiring streaming media data according to the request of a user, and performing at least one of playing or scheduling management at the map interface according to the streaming media data; the method comprises the steps that an unmanned aerial vehicle device user obtains self state data and sends the self state data, wherein the self state data comprise unmanned aerial vehicle position information, airframe information, flight direction information, flight speed information and the like; and the ground station sends the acquired streaming media data according to the unmanned dispatching system server. The unmanned command scheduling and big data platform system is deployed in a cloud server in the Internet, and a MySQL database is used as a data storage server; unmanned aerial vehicle equipment managed by the ground station is accessed into the unmanned command dispatching and big data platform system through the Ethernet and is uniformly managed by the unmanned command dispatching and big data platform system; the unmanned command scheduling and big data platform system supports two architecture schemes of B/S and C/S, so that both the Web browser end and the client can interact with the unmanned command scheduling and big data platform system through a network, and multiple use application scenes are provided; the unmanned command scheduling and big data platform system deployed in the Internet can conveniently interface map service and weather service to acquire map and weather data.
The unmanned dispatching and big data platform system packs a publishing packet when a new version is released, and the upgrading mode is to update the files in the publishing packet to the server of the unmanned dispatching and big data platform system.
The server of the unmanned command scheduling and big data platform system can independently run the WatchDog process, periodically keep alive with all running processes in the unmanned command scheduling and big data platform system, and can be timely pulled up when service is stopped unexpectedly.
The unmanned command scheduling and big data platform system relates to a password interaction service protocol, and data is transmitted after being encrypted by MD 5;
GB28181 adopts a www-authentication mode to realize a registration flow, and simultaneously, the authentication method is used for encrypting during customized data transmission of Message interaction;
WebRTC supports the use of SRTP to encrypt the original RTP data, thereby ensuring the security of the data.
The unmanned command scheduling and big data platform system adopts an HTTPS protocol to ensure the security of server data.
The unmanned dispatching and big data platform system only allows legal users to access and operate authorized system functions, and performs log management on the operation of the system functions.
Fig. 8 is a functional schematic diagram of an intelligent integrated command and management information system of an unmanned aerial vehicle and an intelligent device according to an embodiment of the present invention. Referring to fig. 8, the system comprises an airplane searching service module, a user/equipment management module, a problem feedback module, an account module, a login module, a data billboard module and a flight service module.
The searching module is used for displaying an amplification/reduction map, a module map and a switching device name, and processing such as referring to black box sequence numbers, accident device lists, longitude and latitude, accident device position tracking, device position displaying devices and the like.
The user/equipment management module is used for editing and processing the user, the unmanned aerial vehicle team, the unmanned aerial vehicle equipment and the pod of the unmanned aerial vehicle.
The data billboard module is used for displaying the real-time map position, equipment/users, operation, flight distribution, flight duration and the like of the unmanned aerial vehicle.
The flight service module is used for performing visual operation on monitoring, command scheduling, air route planning, flight recording and operation management of the unmanned aerial vehicle.
It should be noted that the functional module of this embodiment is an implementation manner of the foregoing embodiment through an unmanned command scheduling and big data platform system, and is visually displayed through a client.
Furthermore, although the present invention is described in the context of functional modules, it should be understood that, unless otherwise stated to the contrary, one or more of the described functions and/or features may be integrated in a single physical device and/or software module, or one or more functions and/or features may be implemented in a separate physical device or software module. It will also be appreciated that a detailed discussion of the actual implementation of each module is not necessary for an understanding of the present invention. Rather, the actual implementation of the various functional modules in the apparatus disclosed herein will be understood within the ordinary skill of an engineer, given the nature, function, and internal relationship of the modules. Accordingly, those skilled in the art can, using ordinary skill, practice the invention as set forth in the claims without undue experimentation. It is also to be understood that the specific concepts disclosed are merely illustrative of and not intended to limit the scope of the invention, which is defined by the appended claims and their full scope of equivalents.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, and various media capable of storing program codes.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the invention have been shown and described, it will be understood by those of ordinary skill in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.
While the preferred embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. The utility model provides a command management information system is synthesized to wisdom of unmanned aerial vehicle and smart machine, includes service center service module, media service module, signaling service module and front end webpage module, its characterized in that:
the service center service module is used for providing a service data access interface for the media service module and the signaling service module;
the signaling service module is used for establishing communication connection with a ground station or unmanned aerial vehicle equipment and acquiring streaming media data;
the media service module is used for acquiring the streaming media data according to the access request and sending the streaming media data to the client for displaying;
the front-end webpage module is used for calling a third-party electronic map to the client, generating a map interface and map information, and adding a multi-layer interface to the map interface, wherein the multi-layer interface is used for acquiring the streaming media data according to the request of a user and executing scheduling management on the map interface according to the streaming media data.
2. The intelligent integrated command and management information system for unmanned aerial vehicles and intelligent devices as claimed in claim 1, wherein the service center module comprises:
adopting a remote process call service to execute at least one of map display, unmanned aerial vehicle position real-time refreshing, longitude and latitude display, satellite map, 3D map switching, map ranging, self-defined layer display, route planning, unmanned aerial vehicle information and video picture superposition according to the signaling service module, the media service module and the service data access request of the client;
and executing at least one of weather data and flight preparation approval through a third-party platform interface by adopting a webpage service.
3. The intelligent integrated command and management information system for unmanned aerial vehicle and smart device as claimed in claim 1, wherein the signaling service module comprises:
the ground station or the unmanned aerial vehicle equipment establishes communication connection with the signaling service module based on an SDK of GB28181 protocol communication, wherein the signaling service module is used as a service end of the GB28181 protocol communication, and the ground station or the unmanned aerial vehicle equipment is used as a client end of the GB28181 protocol communication;
or, the signaling service module is used as a client of GB28181 protocol communication, and registers with a third party platform of GB28181 protocol communication, so that the unmanned aerial vehicle device sends video data to the third platform, where the transmission format of the video data is PS-RTP.
4. The intelligent integrated command and management information system for unmanned aerial vehicle and smart device as claimed in claim 1, wherein the media service module comprises:
the video stream receiving sub-module is configured to receive all the streaming media data sent by the ground station or the drone device, and receive the streaming media data by creating a socket, where the video stream receiving sub-module uses at least one of a UDP streaming mode of a GB28181 protocol, a TCP streaming mode of the GB28181 protocol, and other protocol accesses;
the stream processing submodule is used for acquiring the stream media data received by the video stream receiving submodule and converting the stream media data into a target media format;
and the stream distribution submodule distributes the stream media data processed by the stream processing submodule.
5. The intelligent integrated command and management information system for unmanned aerial vehicles and intelligent devices as claimed in claim 4, wherein the stream processing sub-module further comprises:
and storing the multiple mapping relation between the storage format of the streaming media data and the target media format, and respectively converting the same path of data source with a plurality of targets and the target media format by adopting multiplexing logic.
6. The intelligent integrated command and management information system for unmanned aerial vehicles and intelligent devices according to claim 4, wherein the stream distribution sub-module further comprises:
and for the same path of video requested by a plurality of same destination terminals, keeping multiple relation mapping from the streaming media data to the destination terminals, and sequentially sending the streaming media data of the same path and the target media format according to the request sequence.
7. The intelligent integrated command and management information system for unmanned aerial vehicle and intelligent device as claimed in claim 4, wherein the media service module further comprises:
and summarizing and sending the streaming media data through a WebRTC protocol stack and an RTSP protocol stack.
8. The intelligent integrated command and management information system for unmanned aerial vehicle and intelligent device as claimed in claim 4, wherein the media service module further comprises:
storing the acquired streaming media data into a file comprising RTP information MP4 format;
according to the recording request of the user at the front end webpage module, the stream processing submodule acquires the stream media data and converts the stream media data into MP4 file data, the stream distribution submodule receives and stores the data, and the storage result and the storage event are stored in the service center service module.
9. The intelligent integrated command and management information system for unmanned aerial vehicle and intelligent device as claimed in claim 4, wherein the media service module further comprises:
and the video playing sub-module is used for processing at least one of playing, recording and replaying the video by the client and the front end webpage module.
10. An intelligent integrated command management information device for unmanned aerial vehicles and intelligent equipment for realizing the system of any one of claims 1-9, comprising an unmanned dispatching system server, a ground station, a client and unmanned aerial vehicle equipment, wherein the unmanned dispatching system server is connected with the ground station and the client, and the unmanned aerial vehicle equipment is connected with the ground station;
the unmanned dispatching system server is used for providing a service data access interface, establishing communication connection with a ground station or unmanned aerial vehicle equipment according to the request of the client, acquiring streaming media data, and transmitting the streaming media data to the client for displaying; calling a third-party electronic map according to a client request, generating a map interface and map information at the client, and adding a multi-layer interface at the map interface, wherein the multi-layer interface is used for acquiring the streaming media data according to a user request, and performing at least one of playing or scheduling management at the map interface according to the streaming media data;
the unmanned aerial vehicle equipment user acquires and sends self state data, wherein the self state data comprises at least one of unmanned aerial vehicle position information, airframe information, flight direction information and flight speed information;
and the ground station sends the collected streaming media data according to the unmanned dispatching system server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210508313.2A CN114937376A (en) | 2022-05-11 | 2022-05-11 | Unmanned aerial vehicle and intelligent device's wisdom synthesis command management information system and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210508313.2A CN114937376A (en) | 2022-05-11 | 2022-05-11 | Unmanned aerial vehicle and intelligent device's wisdom synthesis command management information system and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114937376A true CN114937376A (en) | 2022-08-23 |
Family
ID=82864057
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210508313.2A Pending CN114937376A (en) | 2022-05-11 | 2022-05-11 | Unmanned aerial vehicle and intelligent device's wisdom synthesis command management information system and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114937376A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105450994A (en) * | 2015-12-03 | 2016-03-30 | 河北远东通信系统工程有限公司 | Video commanding and dispatching system and method based on RTSP |
| US10073449B1 (en) * | 2014-11-18 | 2018-09-11 | Amazon Technologies, Inc. | Unmanned aerial vehicle data services |
| CN110766983A (en) * | 2019-11-01 | 2020-02-07 | 深圳市科卫泰实业发展有限公司 | Distributed unmanned aerial vehicle system command and control system |
| CN113691775A (en) * | 2021-08-16 | 2021-11-23 | 成都民航空管科技发展有限公司 | Intelligent aircraft tracking system and method |
-
2022
- 2022-05-11 CN CN202210508313.2A patent/CN114937376A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10073449B1 (en) * | 2014-11-18 | 2018-09-11 | Amazon Technologies, Inc. | Unmanned aerial vehicle data services |
| CN105450994A (en) * | 2015-12-03 | 2016-03-30 | 河北远东通信系统工程有限公司 | Video commanding and dispatching system and method based on RTSP |
| CN110766983A (en) * | 2019-11-01 | 2020-02-07 | 深圳市科卫泰实业发展有限公司 | Distributed unmanned aerial vehicle system command and control system |
| CN113691775A (en) * | 2021-08-16 | 2021-11-23 | 成都民航空管科技发展有限公司 | Intelligent aircraft tracking system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111934919B (en) | Network convergence and networking method, equipment and storage medium thereof | |
| US8762465B2 (en) | Method for providing a content-sharing service, and device therefor | |
| US7802261B2 (en) | Method and system for displaying content using message communications | |
| US8429263B2 (en) | File content distribution method, device, and system for an interactive network television system | |
| CN109120946B (en) | Method and device for watching live broadcast | |
| CN102571979B (en) | Multi-screen interactive equipment and its binding method | |
| CN110121059B (en) | Monitoring video processing method, device and storage medium | |
| US8869203B2 (en) | Multimedia content fusion | |
| US20040199578A1 (en) | System and method for providing a digital media supply chain operation system and suite of applications | |
| EP2377313B1 (en) | Digital broadcast receiver and method for processing emergency alert system data in digital broadcast receiver | |
| CN102739779A (en) | DLNA (Digital Living Network Alliance)-based digital family interaction method and system and corresponding device | |
| CN105765984B (en) | Emit equipment, launching technique, receiving device and method of reseptance | |
| US9178924B1 (en) | IPv6 to web architecture | |
| WO2016054835A1 (en) | Multimedia cloud intelligent system for transportation vehicle | |
| CN102196314A (en) | System and method for realizing streaming media transmission by using peer-to-peer (P2P) set-top box | |
| CN106331203A (en) | User access control method, device, relay device and server | |
| US20200404033A1 (en) | Software defined network orchestration to manage media flows for broadcast with public cloud networks | |
| CN103945277A (en) | Method, system and device for realizing mobile terminal video sharing | |
| CN110460366A (en) | A kind of Unmanned Aerial Vehicle Data interconnection method, system, electronic equipment and storage medium | |
| CN108965370B (en) | Method for inserting text message, video network server and system | |
| CN103414885A (en) | Communication method of network audio-video monitoring system | |
| CN107438201B (en) | Message processing system, method and device | |
| CN112584103A (en) | Method and system for transcoding and clouding large-scale monitoring video | |
| CN110113558B (en) | Data processing method, device, system and computer readable storage medium | |
| CN202713535U (en) | Video and audio monitoring network system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |