CN114915647A - Front-edge equipment remote interactive experience system based on micro-service - Google Patents
Front-edge equipment remote interactive experience system based on micro-service Download PDFInfo
- Publication number
- CN114915647A CN114915647A CN202110115429.5A CN202110115429A CN114915647A CN 114915647 A CN114915647 A CN 114915647A CN 202110115429 A CN202110115429 A CN 202110115429A CN 114915647 A CN114915647 A CN 114915647A
- Authority
- CN
- China
- Prior art keywords
- equipment
- service
- micro
- edge equipment
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Medical Informatics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Manipulator (AREA)
Abstract
The invention provides a microservice-based remote interactive experience system for leading-edge equipment teaching training and scientific tourism, which is used for innovating and replacing the existing teaching training system and scientific tourism system, so that a user can remotely operate leading-edge equipment with high price, high updating speed, high deployment requirement and more operation limitation, the problem that the existing virtual simulation and augmented reality system has impression and no actual effect due to the fact that no actual equipment is connected is solved, and simultaneously leading-edge equipment owners can realize higher benefit by sharing resources of the leading-edge equipment The system comprises a remote interactive interface module and a terminal side communication module.
Description
Technical Field
The invention belongs to the field of remote teaching, and particularly relates to a front-edge equipment remote interactive experience system based on micro-services.
Background
In the real field of instructing of teaching and science and technology tourism field, often can demonstrate the leading edge equipment of newly developing among the various science and technology fields, let student or visitor know these science and technology fields's development condition. At present, in the display site of the leading edge equipment, some leading edge equipment is deployed as experiment or display resources, but the leading edge equipment which is expensive, quick to update, high in deployment requirement and high in operation limitation is difficult to deploy, so that students or tourists cannot understand and watch the leading edge equipment.
To avoid such problems, some display venues employ virtual simulated sand tables and virtual reality, augmented reality, and mixed reality systems to assist in the display of leading edge equipment by these devices. However, the display method can cause the appearance to be ineffective, and the interest of students or tourists is not easy to arouse.
In addition, because various leading-edge equipment is often developed by different organizations, and the related interfaces, software and models are proprietary, standard and not open, access between the leading-edge equipment and a system in a display place is often very difficult, and special development and maintenance are required, so that the development, integration and sharing efficiency related to the leading-edge equipment access is low.
Disclosure of Invention
In order to solve the problems, the invention provides a remote interactive experience system of the leading-edge equipment, which designs, develops and integrates activities related to release, deployment, control, video, operation and interface of different leading-edge equipment in a micro-service mode, and adopts the following technical scheme:
the invention provides a microservice-based front-edge equipment remote interactive experience system, which is used for enabling a user to carry out remote interactive operation on a plurality of types of front-edge equipment and is characterized by comprising the following steps: the system comprises at least one interactive terminal, a front-edge device and a front-edge device, wherein the interactive terminal is used for enabling a user to remotely control the front-edge device; and a cloud server, which is respectively connected with the leading edge equipment and the interactive terminal in a communication way, wherein the cloud server is provided with an equipment service operation and maintenance environment module, a terminal service environment operation and maintenance module, a retrieval acquisition module and a service operation module, the interactive terminal is provided with a configuration service storage module, a remote interactive interface module and a terminal side communication module, the equipment service operation and maintenance environment module at least stores an equipment control micro-service unit and an equipment identification number corresponding to each leading edge equipment, the terminal service operation and maintenance environment module at least stores an equipment operation micro-service unit and a terminal service identification number corresponding to each leading edge equipment and adapted to the interactive terminal, the configuration service storage module stores a pre-configured equipment identification number and a terminal service identification number, and the terminal side communication part is used for sending the equipment identification number and the terminal service identification number to the cloud server in a way of corresponding to the terminal identification number of the interactive terminal, the retrieval acquisition module retrieves and acquires a corresponding equipment control micro-service unit from the equipment service operation and maintenance environment module according to the equipment identification number, retrieves and acquires the corresponding equipment operation micro-service unit according to the terminal service identification number, and the service operation module operates the equipment operation module acquired by retrieval and communicates with the interactive terminal according to the terminal identification number, so that the remote interactive interface module displays an equipment operation picture corresponding to the equipment operation module to enable a user to input equipment operation parameters, and the equipment control module is operated to control leading-edge equipment to execute corresponding operation according to the equipment operation parameters.
The microservice-based leading edge equipment remote interactive experience system provided by the invention can also have the technical characteristics that each leading edge equipment is provided with a camera for shooting the leading edge equipment, the equipment service operation and maintenance environment module also stores a video shooting microservice unit corresponding to each leading edge equipment, the terminal service operation and maintenance environment module also stores a video analysis microservice unit corresponding to each leading edge equipment and adapted to the interactive terminal and an operation evaluation microservice unit, the retrieval and acquisition module is used for retrieving and acquiring the video shooting module, the video analysis microservice unit and the operation evaluation microservice unit when retrieving and acquiring, the service operation module is also used for operating the video shooting module to control the camera to shoot the operation video of the leading edge equipment when a user remotely operates the leading edge equipment, and operating the video analysis microservice unit to analyze the operation video to obtain a video analysis result, and further operating the operation evaluation micro-service unit to call the video analysis result and a leading-edge equipment operation plan designed in advance by the user to compare and evaluate the operation of the user, judging that the operation is successful if the matching degree of the video analysis result and the leading-edge equipment operation plan is greater than a preset threshold value, judging that the operability is weak if the matching degree is smaller than the preset threshold value, judging to deduct a mark if the leading-edge equipment operation plan violates the related operation principle or rule, and displaying an operation evaluation picture by the remote interaction interface module to ensure that the user confirms the comparison and evaluation result.
The microservice-based leading-edge equipment remote interactive experience system provided by the invention can also have the technical characteristics that an equipment service operation and maintenance environment module also stores an equipment state microservice unit corresponding to each leading-edge equipment, the retrieval acquisition module also retrieves and acquires the equipment state microservice unit when retrieving and acquiring, the service operation module is also used for operating the equipment state microservice unit so as to acquire the equipment state defined by the leading-edge equipment self controller when a user remotely operates the leading-edge equipment, and the remote interactive interface module is also used for displaying a video analysis picture so as to provide the user with an operation video and a feedback of a video analysis result and the equipment state, wherein the equipment state comprises a position coordinate, an equipment state and an execution state.
The microservice-based leading-edge equipment remote interactive experience system provided by the invention can also have the technical characteristics that the video analysis result comprises the source and time sequence of the operation video, the execution state, the activity track and the audio and video content of the leading-edge equipment in the operation video, and the microservice interface of the video analysis microservice unit comprises: operating the source of the video, the time sequence, the execution state of the leading edge equipment in the video, the activity track and the parameters of the audio-video content, and operating the functions of the parameters.
The microservice-based front-edge equipment remote interactive experience system provided by the invention can also have the technical characteristics that: and the block chain evidence storage subsystem is used for storing the micro service basic information, the micro service interface information, the use condition and the state generated during the operation of the micro service.
The microservice-based front-edge equipment remote interactive experience system provided by the invention can also have the technical characteristics that the blockchain evidence storing subsystem adopts a alliance chain form, corresponding participants at least comprise a front-edge equipment provider, a microservice provider and an interactive terminal provider, and the blockchain evidence storing subsystem also stores the participant basic information of the participants.
The microservice-based front-edge equipment remote interactive experience system provided by the invention can also have the technical characteristics that the equipment control microservice unit converts the equipment operation parameters into the instruction parameters defined by the front-edge equipment controller through the predefined parameter conversion rules, and remotely controls the front-edge equipment according to the instruction parameters, wherein the equipment operation parameters comprise variables, activities, execution rules and exception handling, the microservice interface of the equipment control microservice unit defines the equipment operation parameters, and the functions of calling, transmitting, converting, controlling, state and responding the parameters are realized.
The microservice-based leading edge equipment remote interactive experience system provided by the invention can also have the technical characteristics that the equipment operation microservice unit is used for designing and defining the activities, execution rules and exception handling of leading edge equipment and supporting a user to design and edit a leading edge equipment operation plan, and the microservice interface of the equipment operation microservice unit comprises: user-designed leading-edge equipment variables, activities, execution rules, exception handling parameters, and functions that operate on these parameters.
The microservice-based leading-edge equipment remote interactive experience system provided by the invention can also have the technical characteristics that the equipment identification number and the terminal service identification number stored in the configuration service storage module are configured and stored in advance by an administrator of the interactive terminal, or the equipment identification number and the terminal service identification number stored in the configuration service storage module are input by a user through the remote interactive interface module and are configured and stored.
The microservice-based front-edge equipment remote interactive experience system can also have the technical characteristics that the interactive terminal is a computer arranged on the site of a remote display place of the front-edge equipment or an intelligent terminal held by a user.
Action and Effect of the invention
According to the microservice-based front-edge equipment remote interactive experience system, due to the fact that the microservice architecture is adopted, microservice units corresponding to various front-edge equipment are issued to the equipment service operation and maintenance environment module and the terminal service operation and maintenance environment module, standardization of front-edge equipment service interfaces is achieved, control services corresponding to various front-edge equipment can be stored in the operation and maintenance environment in a microservice mode in a unified mode, and the problem that development, integration and sharing efficiency related to the front-edge equipment remote interactive experience system is low is solved. The corresponding micro-service units are retrieved and acquired when the equipment identification number and the terminal service identification number sent by the interactive terminal are received through the retrieval acquisition module, and the micro-service units are further operated through the service operation module, so that the interactive terminal can call the corresponding micro-service units according to preset configuration, a user can remotely control corresponding leading-edge equipment, the problem that the traditional equipment is not effective in appearance is solved, and the interest of students or tourists is aroused. Through the remote interactive experience system of leading edge equipment of this embodiment, can realize the resource sharing that the leading edge was equipped, solve teaching real standard and scientific and technological tourism field lack the leading edge equipment resource acquisition problem that the price is expensive, it is fast to update, the deployment requires highly, the operation restriction is many to alleviate the leading edge and equip the acquisition of resources problem, upgrade, the operational difficulties, help teaching real standard field and scientific and technological tourism field application and let more students or visitor know, study the development and the operation that the leading edge was equipped.
Drawings
FIG. 1 is a block diagram of a microservice-based front-edge equipment remote interactive experience system according to an embodiment of the present invention;
FIG. 2 is a block diagram of a cloud server in an embodiment of the invention;
FIG. 3 is a schematic structural diagram of a front-edge equipment remote interactive experience system in an embodiment of the present invention;
FIG. 4 is a block diagram of an interactive terminal according to an embodiment of the present invention; and
FIG. 5 is an integrated diagram of a front-end equipment remote interactive experience system in an embodiment of the present invention.
Detailed Description
In order to make the technical means, the creation features, the achievement purposes and the effects of the invention easy to understand, the following describes the microservice-based front-edge equipment remote interactive experience system of the invention in detail with reference to the embodiments and the accompanying drawings.
< example >
FIG. 1 is a block diagram of a microservice-based front-edge equipment remote interactive experience system according to an embodiment of the present invention.
As shown in fig. 1, the microservice-based leading edge equipment remote interactive experience system 100 has various leading edge equipment 11, a cloud server 12, an interactive terminal 13, a blockchain credentialing subsystem 14, and a communication network 15 and a communication network 16.
The cloud server 12 is in communication connection with various leading edge equipment 11 through a communication network 15, and is in communication connection with the interactive terminal 13 through a communication network 16. In this embodiment, the communication network 15 and the communication network 16 are the internet.
The leading edge equipment 11 is various new-type and leading-edge scientific and technological equipment, such as a robot, a new-type equipment, an unmanned aerial vehicle, etc., and the present embodiment will be described in detail below by taking the unmanned aerial vehicle and a controller thereof as the leading edge equipment.
In this embodiment, each leading edge equipment 11 is correspondingly provided with at least one camera 17, and the camera 17 is configured to shoot the leading edge equipment 11 so as to obtain an operation video of the leading edge equipment 11 when being remotely operated by a user, and send the operation video to the cloud server 12.
Fig. 2 is a block diagram of a cloud server in an embodiment of the present invention, and fig. 3 is a schematic structural diagram of a front-edge equipment remote interactive experience system in an embodiment of the present invention.
As shown in fig. 2 and 3, the cloud server 12 includes an equipment service operation and maintenance environment module 21, a terminal service environment operation and maintenance module 22, a search acquisition module 23, a service operation module 24, a service side communication module 25, and a service side control module 26 for controlling the above modules.
The equipment service operation and maintenance environment module 21 is configured to provide an operation and maintenance environment for the micro-service of the corresponding leading-edge equipment, and specifically store the equipment identification number, the equipment control micro-service unit, the video shooting micro-service unit, and the equipment state micro-service unit of each leading-edge equipment 11.
Each leading-edge equipment 11 is correspondingly provided with an equipment control micro-service unit, a video shooting micro-service unit and an equipment state micro-service unit, the micro-service units and the equipment identification number of the leading-edge equipment 11 are correspondingly stored in the equipment service operation and maintenance environment module, and the retrieval and acquisition module can retrieve the corresponding micro-service unit according to the equipment identification number.
The equipment control micro-service unit is used for interacting with the controller of the leading edge equipment 11 and converting the equipment operation parameters input by the user into instruction parameters which can be understood by the leading edge equipment controller through a predefined parameter conversion rule, so that the controller controls the leading edge equipment 11 to execute corresponding operations according to the instruction parameters.
The device operation parameters comprise variables, activities, execution rules and exception handling. The micro service interface of the device control micro service unit is defined as the operation parameter of the device, and realizes the corresponding functions of parameter calling, transmission, conversion, control, state and response.
The video shooting micro-service unit is used for shooting an operation video of the leading edge equipment 11 through the camera 17 and transmitting the video to the cloud server 12 and the interactive terminal 13 through a video transmission protocol supported by the camera 17. The micro-service interface of the video shooting micro-service unit comprises: video data object parameters, video object transfer functions, and video manipulation functions defined by the video transfer protocol supported by camera 17.
In this embodiment, the video shooting microservice unit performs push streaming and pull streaming of a video through a camera on the drone and based on an ftmp protocol.
The device state micro-service unit is used for acquiring states defined by the controller of the leading edge device 11, including position coordinates, a device state and an execution state, and calling the device control micro-service unit and the service operation module. The micro-service interface of the device state micro-service unit comprises: the front edge is provided with state parameters defined by the controller of the controller, and functions corresponding to parameter calling, transmission and conversion are realized.
In this embodiment, the state parameters acquired by the device state microserver unit are flight parameters of the unmanned aerial vehicle, such as longitude and latitude, coordinate flight states, and the like.
The terminal service operation and maintenance environment module 22 stores a terminal service identification number, a device operation micro-service unit, a video analysis micro-service unit and an operation evaluation micro-service unit.
Each leading edge equipment 11 is corresponding to a device operation micro-service unit, a video analysis micro-service unit and an operation evaluation micro-service unit, and the micro-service units are matched with the interactive terminal 13. In other embodiments of the present invention, when there are n types of interactive terminals, the number of the micro service units may also be adapted to be n correspondingly, so that there are n device operation micro service units, n video analysis micro service units, and n operation evaluation micro service units corresponding to each type of leading edge equipment 11.
The device operation micro-service unit is used for supporting a user to design and edit an operation plan (such as an operation program) of leading-edge equipment and enabling the user to design and define the activity, the execution rule and the exception handling of the leading-edge equipment. The micro-service interface of the device operating micro-service unit comprises: user-designed leading-edge equipment variables, activities, execution rules, exception handling parameters, and functions that operate on these parameters.
In this embodiment, after the user inputs parameters such as variables and activities through the device operation micro-service unit as device operation parameters, the device control micro-service unit receives the device operation parameters through the webSocket and interacts with the unmanned aerial vehicle controller, and converts the operation content into a control instruction that can be understood by the unmanned aerial vehicle controller to enable the remote execution of the control instruction, so that the user can control various functions of the unmanned aerial vehicle through the device operation micro-service unit.
The video analysis micro-service unit is used for calling the micro-service of the video analysis micro-service unit so as to acquire, display and analyze the operation video of the front-edge equipment. In this embodiment, the video analysis microservice unit can extract the source, time sequence, execution state of leading edge equipment in the video, activity track and audio/video content of the analyzed video object. The microservice interface of the video analysis microservice unit comprises: the source of the video object, the time sequence, the execution state of the leading edge equipment within the video, the activity track, and the parameters of the audiovisual content, and functions that operate on these parameters.
The operation evaluation microservice unit is used for calling and comparing the video analysis result and the operation plan of the video analysis microservice unit so as to evaluate the feasibility, the reasonability and the specialty of the user operation, if the matching degree of the operation plan and the execution result is greater than the user-defined threshold value, the operation is considered to be successful, and if the matching degree is less than the user-defined threshold value, the operability is considered to be weak; a credit is determined if the operating plan violates the operating principle or rule involved. The micro-service interface of the operation evaluation micro-service unit comprises: and the self-defined parameters corresponding to the operation plan of the leading-edge equipment comprise feasibility, rationality, professional parameters and functions.
In addition, in this embodiment, when the operation evaluation microservice unit determines that the operability is weak, corresponding operation reminding information is generated in real time and sent to the interactive terminal 13, so as to remind the user that the operation has a problem and needs to be adjusted in time.
In this embodiment, the micro service operation and maintenance environment equipped with the service operation and maintenance environment module 21 and the terminal service environment operation and maintenance module 22 may use a virtual machine and a container to support micro service operation.
The retrieval obtaining module 23 is configured to, when the service-side communication module 25 receives the equipment identification number and the terminal service identification number from the interactive terminal 13, retrieve and obtain a corresponding device control micro-service unit, a video shooting micro-service unit, and a device state micro-service unit from the equipment service operation and maintenance environment module according to the equipment identification number, and retrieve and obtain a corresponding device operation micro-service unit, a video analysis micro-service unit, and an operation evaluation micro-service unit according to the terminal service identification number.
The service operation module 24 is configured to operate each micro service unit retrieved by the retrieval obtaining module 23, so as to execute a corresponding function.
In this embodiment, the retrieval obtaining module 23 and the service running module 24 serve as a front-edge equipment remote interaction integrated module, which is a middleware between the cloud server 12 and the front-edge equipment micro-service, and are used for calling the front-edge equipment and the remote interaction micro-service thereof in the form of a micro-service client according to the user requirement input in the remote interaction interface displayed by the interaction terminal 13, so as to implement dynamic construction of the front-edge equipment remote interaction experience system.
The service side communication module 25 is used for performing data communication between the cloud server 12 and the leading edge equipment 11, the interactive terminal 13 and the block chaining evidence storage subsystem 14.
The interactive terminal 13 is a computer provided on site at a remote display site of the leading edge equipment, and a user can remotely operate the leading edge equipment 11 through the computer.
Fig. 4 is a block diagram of an interactive terminal according to an embodiment of the present invention.
As shown in fig. 4, the interactive terminal 13 has a configuration service storage module 31, a remote interactive interface module 32, a terminal side communication module 33, and a terminal side control module 34 for controlling the above modules.
The configuration service storage module 31 stores a pre-configured equipment identification number and a terminal service identification number. In this embodiment, the interactive terminal 13 is a computer in the display place, the equipment identification number and the terminal service identification number are configured in advance by a manager in the display place, and once the interactive terminal 13 is started, the terminal-side communication module 33 sends the equipment identification number and the terminal service identification number to the cloud server 12, so as to start the corresponding micro-service and wait for the user to use.
The remote interactive interface module 32 is used for providing a human-computer interactive interface for the micro-service. In this embodiment, the remote interactive interface module 32 displays three basic interfaces through a display screen of the computer: a device operation screen, a video analysis screen, and an operation evaluation screen.
The device operation screen is used for providing a selectable operation plan and an editable operation template based on operation parameters for a user,
the video analysis picture is used for providing feedback of operation video and video analysis results and equipment states for a user
The operation evaluation screen is used for displaying the comparison evaluation result generated by the operation evaluation micro-service unit, so that the user can confirm the operation result.
The terminal-side communication module 33 is configured to perform data communication between the interactive terminal 13 and the cloud server 12.
FIG. 5 is an integrated diagram of a front-edge equipment remote interactive experience system in an embodiment of the present invention.
When the retrieval obtaining module 23 retrieves the corresponding micro service unit and lets the service operation module 24 operate, the leading edge equipment remote interaction integration composed of the micro services is as shown in fig. 5. Unmanned aerial vehicle (leading edge equipment) and long-range interactive microservice are called to the module, this long-range interactive microservice has packaged the little service of live broadcast correlation (live broadcast microservice and video transmission microservice, correspond little service unit of video analysis microservice unit and video shooting respectively) and the little service of remote control correlation (operation evaluation promptly, remote control, equipment parameter and equipment operation microservice), the user just can use the live broadcast automatically and control microservice without the whole principle of perception, promote experience and feel.
Firstly, the remote interactive microservice establishes two long connections with a server, one long connection ensures the transmission of live pictures, and the other long connection ensures the transmission of control signals and equipment parameters. When the connection is established, an initialization function of the inheritance module is called, and a terminal id (namely a terminal service identification number) and an equipment id (namely an equipment identification number) of a user are carried, after the cloud server receives information, mutual exclusion verification is firstly carried out, if the connection exists, the connection of the user is refused, if the connection does not exist, a video shooting micro-service and an equipment control micro-service are called to match the interactive terminal connection with the leading-edge equipment connection, and then only forwarding work is carried out on the established connection.
The user can actively send a control signal when the connection is kept, and the signal can be decoded into an internal unified operation control code by the equipment control micro-service and transmitted to leading-edge equipment. If the user transmits a complex path, the path cruise micro-service is called, the complex path is disassembled into a plurality of specific control signals, and the control signals are transmitted to the unmanned aerial vehicle controller once again, so that the cruise function of the unmanned aerial vehicle is realized.
In the aspect of live broadcast, live broadcast micro-service can verify the correctness of connection, and can ensure that the other party is informed when any party of front equipment or an interactive terminal is disconnected, so that the connection can be safely exited; the video transmission micro-service encapsulates video transmission logic, including video decoding, format conversion and the like, the leading-edge equipment end can select a supported transmission protocol and push stream by using a corresponding interface, and the interactive terminal can perform normal pulling.
The block chain evidence storing subsystem 14 is used for storing the basic information, the use condition and the state of the micro service. In this embodiment, the blockchain evidence storage subsystem 14 adopts a coalition chain form, the system development environment adopts an open source blockchain software, the transmission is performed based on a point-to-point protocol established by the hypertext transfer protocol 2.0, and the data structure is optimized to effectively maintain the repeated overall state of the participants. A different consensus algorithm or will be embedded in each configuration to ensure a high degree of consistency. The participants comprise unmanned aerial vehicle providers, micro service providers and remote interactive experience system providers, the data of the stored certificates are the basic information, the interface information, the use condition and the state of the participants, and the size of the blocks is not limited.
Examples effects and effects
According to the microservice-based front-edge equipment remote interactive experience system provided by the embodiment, due to the fact that the microservice architecture is adopted, microservice units corresponding to various front-edge equipment are issued to the equipment service operation and maintenance environment module and the terminal service operation and maintenance environment module, standardization of a front-edge equipment service interface is achieved, control services corresponding to various front-edge equipment can be uniformly stored in an operation and maintenance environment in the form of microservice, and the problem that development, integration and sharing efficiency of the front-edge equipment remote interactive experience system is low is solved. The corresponding micro-service units are retrieved and acquired when the equipment identification number and the terminal service identification number which are sent by the interactive terminal are received through the retrieval acquisition module, and the micro-service units are further operated through the service operation module, so that the interactive terminal can call the corresponding micro-service units according to preset configuration, a user can remotely control corresponding leading-edge equipment, the problem that the traditional equipment is not effective in view and effect is solved, and interest of students or tourists is aroused. Through the remote interactive experience system of leading edge equipment of this embodiment, can realize the resource sharing that the leading edge was equipped, solve teaching and instruct real and scientific and technological tourism field to lack the leading edge equipment resource acquisition problem that the price is expensive, update soon, the deployment requires highly, the operation restriction is many to alleviate leading edge equipment and purchase, upgrade, the operational difficulty, help teaching and instruct real field and scientific and technological tourism field to use and let more students or visitor know, study the development and the operation that the leading edge was equipped.
In the above embodiment, the device control microservice unit, the video shooting microservice unit, the device state microservice unit, and the device operation microservice unit, the video analysis microservice unit, and the operation evaluation microservice unit related to the remote interaction of the leading-edge equipment are all designed, developed, and released in the form of microservice, thereby realizing the standardization of release, integration, and interaction of the leading-edge equipment, and the remote interaction experience system deploys and runs in the microservice operation and maintenance environment, calls microservice through the integration module, and supports the user to remotely operate the leading-edge equipment through the human-computer interface, so as to obtain the evaluation of the interaction operation level, which is beneficial to the remote operation of the leading-edge equipment by the human-computer interface
In the embodiment, the micro service provides a container-based cloud operation and maintenance environment, so that the problems of safety and reliability of operation and maintenance of the micro service are solved.
In the embodiment, the video shooting micro-service unit is arranged and is used for shooting and transmitting the front-edge equipment operation video, so that a basis can be provided for a remote interaction experience system user to remotely observe the response condition and operation evaluation of the equipment, and the vision of the user can be extended.
Furthermore, the device state micro-service unit and the video analysis micro-service unit are arranged to acquire and analyze the field video and the device state of the leading-edge equipment, so that the accuracy of the operation process of the leading-edge equipment can be evaluated and analyzed, and the algorithm and the calculation power of user operation evaluation are improved.
In the embodiment, the related information of the micro-service is certified by the block chain certification storage subsystem, so that a non-tamper and non-repudiation credible certification storage facility can be provided for the front-edge equipment and the basic information, the use condition and the running state of the micro-service related to the remote interaction of the front-edge equipment, the full life cycle traceability and management of the micro-service can be realized, and the ownership of data and the information safety are guaranteed.
The above-described embodiments are merely illustrative of specific embodiments of the present invention, and the present invention is not limited to the description of the above-described embodiments.
For example, in the above embodiments, the leading edge equipment is a drone and a drone controller, and in other aspects of the present invention, the leading edge equipment may also be other leading edge equipment such as a robotic arm, a robot, and the like.
For example, in the above embodiment, the interactive terminal is a computer disposed at a display site, and the configuration service storage module of the interactive terminal is configured in advance by a manager. In other schemes of the invention, the interactive terminal can also be a tablet, a smart phone or other terminals.
Furthermore, the interactive terminal can also be a computer or a tablet held by a user, and the equipment identification number and the terminal service identification number in the configuration service storage module are input by the user through the remote interactive interface module to complete configuration storage.
Claims (10)
1. A remote interactive experience system of leading edge equipment based on micro-service is used for leading edge equipment of a plurality of types to be remotely and interactively operated by a user, and is characterized by comprising:
the at least one interactive terminal is used for enabling a user to remotely control the leading-edge equipment; and
the cloud server is respectively in communication connection with the leading-edge equipment and the interactive terminal,
wherein the cloud server is provided with an equipment service operation and maintenance environment module, a terminal service environment operation and maintenance module, a retrieval acquisition module and a service operation module,
the interactive terminal is provided with a configuration service storage module, a remote interactive interface module and a terminal side communication module,
the equipment service operation and maintenance environment module at least stores a device control micro-service unit corresponding to each leading-edge equipment and an equipment identification number,
the terminal service operation and maintenance environment module at least stores equipment operation micro-service units corresponding to each front-edge equipment and adapted to the interactive terminal and a terminal service identification number,
the configuration service storage module stores a pre-configured equipment identification number and a terminal service identification number,
the terminal side communication part is used for correspondingly sending the equipment identification number and the terminal service identification number to the cloud server together with the terminal identification number of the interactive terminal,
the retrieval acquisition module retrieves and acquires the corresponding equipment control micro-service unit from the equipment service operation and maintenance environment module according to the equipment identification number and retrieves and acquires the corresponding equipment operation micro-service unit according to the terminal service identification number,
and the service operation module operates the equipment operation module obtained by retrieval and communicates with the interactive terminal according to the terminal identification number, so that the remote interactive interface module displays an equipment operation picture corresponding to the equipment operation module to allow a user to input equipment operation parameters, and operates the equipment control module to control the leading-edge equipment to execute corresponding operation according to the equipment operation parameters.
2. The microservice-based leading edge equipment remote interactive experience system of claim 1, wherein:
wherein each leading edge equipment is provided with a camera for shooting the leading edge equipment,
the equipment service operation and maintenance environment module is also stored with a video shooting micro-service unit corresponding to each leading-edge equipment,
the terminal service operation and maintenance environment module is also stored with a video analysis micro-service unit and an operation evaluation micro-service unit which correspond to each front-edge equipment and are matched with the interactive terminal,
the retrieval acquisition module is used for retrieving and acquiring the video shooting module, the video analysis micro-service unit and the operation evaluation micro-service unit when retrieving and acquiring,
the service operation module is also used for operating the video shooting module to control the camera to shoot an operation video of the leading-edge equipment when the user remotely operates the leading-edge equipment, operating the video analysis micro-service unit to analyze the operation video to obtain a video analysis result, further operating the operation evaluation micro-service unit to call the video analysis result and a leading-edge equipment operation plan designed by the user in advance to compare and evaluate the operation of the user,
if the matching degree of the video analysis result and the leading-edge equipment operation plan is larger than a preset threshold value, the operation is judged to be successful,
if the matching degree is less than the predetermined threshold value, determining that the operability is weak,
a deduction is determined if the leading edge equipment operating plan violates the operating principle or rule involved,
and the remote interactive interface module is also used for displaying an operation evaluation picture to ensure that the user confirms the comparison evaluation result.
3. The microservice-based leading edge equipment remote interactive experience system of claim 2, wherein:
wherein the equipment service operation and maintenance environment module further stores a device state micro-service unit corresponding to each leading-edge equipment,
the retrieval acquisition module also retrieves and acquires the equipment state micro-service unit when the retrieval acquisition module carries out the retrieval acquisition,
the service operation module is also used for operating the equipment state micro-service unit so as to acquire the equipment state defined by the leading-edge equipment self controller when the user remotely operates the leading-edge equipment,
the remote interactive interface module is also used for displaying a video analysis picture so as to provide the user with the operation video and the feedback of the video analysis result and the equipment state,
the equipment state includes location coordinates, a device state, and an execution state.
4. The microservice-based leading edge equipment remote interactive experience system of claim 2, wherein:
wherein the video analysis result is the source and time sequence of the operation video, the execution state, the activity track and the audio-video content of the leading edge equipment in the operation video,
the micro-service interface of the video analysis micro-service unit comprises: the source of the operating video, the time sequence, the execution state of the leading edge equipment in the video, the activity track and the parameters of the audio-video content, and the functions of the operating parameters.
5. The microservice-based leading edge equipment remote interactive experience system of claim 1, further comprising:
the block chain storage subsystem is used for storing the certificate,
wherein the equipment service operation and maintenance environment module and the terminal service environment operation and maintenance module support micro service operation by using a virtual machine and a container,
and the block chain evidence storage subsystem is used for storing the basic information of the micro service, the interface information of the micro service, the use condition and the state generated during the running of the micro service.
6. The microservice-based leading edge equipment remote interactive experience system of claim 5, wherein:
wherein the blockchain credentialing subsystem takes the form of a alliance chain, and the corresponding participants at least comprise the provider of the leading edge equipment, the provider of the micro-service and the provider of the interactive terminal,
the block chain evidence storing subsystem also stores and verifies the participant basic information of the participant.
7. The microservice-based leading edge equipment remote interactive experience system of claim 1, wherein:
wherein the equipment control micro-service unit converts equipment operation parameters into instruction parameters defined by the leading edge equipment controller through a predefined parameter conversion rule and remotely controls the leading edge equipment according to the instruction parameters,
the device operating parameters include variables, activities, execution rules, and exception handling,
the micro service interface of the equipment control micro service unit defines the equipment operation parameters and realizes the corresponding functions of parameter calling, transmission, conversion, control, state and response.
8. The microservice-based leading edge equipment remote interactive experience system of claim 1, wherein:
wherein the device operation micro-service unit is used for designing and defining the activities, execution rules and exception handling of the leading-edge equipment and is used for supporting the user to design and edit a leading-edge equipment operation plan,
the micro-service interface of the device operation micro-service unit comprises: user-designed variables, activities, execution rules, exception handling parameters of the leading edge equipment, and functions that operate on these parameters.
9. The microservice-based leading edge equipment remote interactive experience system of claim 1, wherein:
wherein the equipment identification number and the terminal service identification number stored in the configuration service storage module are pre-configured and stored by an administrator of the interactive terminal,
or
The equipment identification number and the terminal service identification number stored in the configuration service storage module are input by the user through the remote interaction interface module to complete configuration storage.
10. The microservice-based leading edge equipment remote interactive experience system of claim 1, wherein:
the interactive terminal is a computer arranged on the front-edge equipment in a remote display place or an intelligent terminal held by the user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110115429.5A CN114915647B (en) | 2021-01-28 | 2021-01-28 | Front edge equipment remote interaction experience system based on micro-service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110115429.5A CN114915647B (en) | 2021-01-28 | 2021-01-28 | Front edge equipment remote interaction experience system based on micro-service |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114915647A true CN114915647A (en) | 2022-08-16 |
| CN114915647B CN114915647B (en) | 2023-08-29 |
Family
ID=82761906
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110115429.5A Active CN114915647B (en) | 2021-01-28 | 2021-01-28 | Front edge equipment remote interaction experience system based on micro-service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114915647B (en) |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002218572A (en) * | 2001-01-24 | 2002-08-02 | Index:Kk | Remote control system and micro-server |
| KR20030054796A (en) * | 2001-12-26 | 2003-07-02 | 엘지전자 주식회사 | remote control service system for imagination experience of electric home appliances and service method thereof |
| CN101866215A (en) * | 2010-04-20 | 2010-10-20 | 复旦大学 | Human-computer interaction device and method adopting eye tracking in video monitoring |
| WO2016062187A1 (en) * | 2014-10-24 | 2016-04-28 | 杭州大穿越旅游策划有限公司 | Matching method and intelligent interactive experiencing system |
| WO2017045193A1 (en) * | 2015-09-18 | 2017-03-23 | 深圳市赛亿科技开发有限公司 | Method and system for remotely accessing electrical appliance |
| CN106817431A (en) * | 2017-03-30 | 2017-06-09 | 王元 | Internet of Things video remote control method and system |
| CN107330774A (en) * | 2017-08-23 | 2017-11-07 | 周益安 | Interactive Experience system and its experiential method for stay-at-home children |
| CN107888676A (en) * | 2017-11-07 | 2018-04-06 | 上海电机学院 | A kind of high in the clouds self-study environmental device based on micro services |
| CN108880887A (en) * | 2018-06-20 | 2018-11-23 | 山东大学 | Accompany and attend to robot cloud service system and method based on micro services |
| CN108898905A (en) * | 2018-08-29 | 2018-11-27 | 华南理工大学 | A kind of unmanned plane interactive teaching live streaming platform |
| CN208337616U (en) * | 2018-07-16 | 2019-01-04 | 广州奇艺果信息科技有限公司 | A kind of recreational machine remote control sports system |
| CN110148318A (en) * | 2019-03-07 | 2019-08-20 | 上海晨鸟信息科技有限公司 | A kind of number assiatant system, information interacting method and information processing method |
| CN110535902A (en) * | 2019-07-16 | 2019-12-03 | 平安普惠企业管理有限公司 | The processing method and electronic device of monitoring intelligent are realized based on micro services |
| CN111124699A (en) * | 2018-10-31 | 2020-05-08 | 南京智能仿真技术研究院有限公司 | Unmanned aerial vehicle cloud data exchange system and method |
| CN111443659A (en) * | 2020-06-02 | 2020-07-24 | 湖北理工学院 | Remote monitoring control system for numerical control machine tool |
| CN111475373A (en) * | 2020-03-10 | 2020-07-31 | 中国平安人寿保险股份有限公司 | Service control method and device under micro service, computer equipment and storage medium |
-
2021
- 2021-01-28 CN CN202110115429.5A patent/CN114915647B/en active Active
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002218572A (en) * | 2001-01-24 | 2002-08-02 | Index:Kk | Remote control system and micro-server |
| KR20030054796A (en) * | 2001-12-26 | 2003-07-02 | 엘지전자 주식회사 | remote control service system for imagination experience of electric home appliances and service method thereof |
| CN101866215A (en) * | 2010-04-20 | 2010-10-20 | 复旦大学 | Human-computer interaction device and method adopting eye tracking in video monitoring |
| WO2016062187A1 (en) * | 2014-10-24 | 2016-04-28 | 杭州大穿越旅游策划有限公司 | Matching method and intelligent interactive experiencing system |
| WO2017045193A1 (en) * | 2015-09-18 | 2017-03-23 | 深圳市赛亿科技开发有限公司 | Method and system for remotely accessing electrical appliance |
| CN106817431A (en) * | 2017-03-30 | 2017-06-09 | 王元 | Internet of Things video remote control method and system |
| CN107330774A (en) * | 2017-08-23 | 2017-11-07 | 周益安 | Interactive Experience system and its experiential method for stay-at-home children |
| CN107888676A (en) * | 2017-11-07 | 2018-04-06 | 上海电机学院 | A kind of high in the clouds self-study environmental device based on micro services |
| CN108880887A (en) * | 2018-06-20 | 2018-11-23 | 山东大学 | Accompany and attend to robot cloud service system and method based on micro services |
| CN208337616U (en) * | 2018-07-16 | 2019-01-04 | 广州奇艺果信息科技有限公司 | A kind of recreational machine remote control sports system |
| CN108898905A (en) * | 2018-08-29 | 2018-11-27 | 华南理工大学 | A kind of unmanned plane interactive teaching live streaming platform |
| CN111124699A (en) * | 2018-10-31 | 2020-05-08 | 南京智能仿真技术研究院有限公司 | Unmanned aerial vehicle cloud data exchange system and method |
| CN110148318A (en) * | 2019-03-07 | 2019-08-20 | 上海晨鸟信息科技有限公司 | A kind of number assiatant system, information interacting method and information processing method |
| CN110535902A (en) * | 2019-07-16 | 2019-12-03 | 平安普惠企业管理有限公司 | The processing method and electronic device of monitoring intelligent are realized based on micro services |
| CN111475373A (en) * | 2020-03-10 | 2020-07-31 | 中国平安人寿保险股份有限公司 | Service control method and device under micro service, computer equipment and storage medium |
| CN111443659A (en) * | 2020-06-02 | 2020-07-24 | 湖北理工学院 | Remote monitoring control system for numerical control machine tool |
Non-Patent Citations (3)
| Title |
|---|
| 杨成荣;刘峻松;孙新杰;吴超;: "基于微服务架构的数据一致性方法研究", 电脑知识与技术, no. 08 * |
| 王一超;王玉玫;: "基于微服务架构的智能化装备维护与管理平台", 计算机与现代化, no. 10 * |
| 陆潇华;李银胜;: "智能Web服务及其元模型驱动的开发环境", 计算机应用与软件, no. 12 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114915647B (en) | 2023-08-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210310826A1 (en) | Method, device and system for processing a flight task | |
| Bohus et al. | Running control engineering experiments over the Internet | |
| US20190317490A1 (en) | Control method, device, and remote control for vr apparatus | |
| WO2014113509A2 (en) | Appliance control system and method | |
| CN113158116A (en) | Unmanned aerial vehicle control platform based on mobile internet | |
| CN109587536A (en) | A kind of long-distance remote-control method, equipment, server and system | |
| US10921796B2 (en) | Component information retrieval device, component information retrieval method, and program | |
| CN111352600A (en) | Large screen control system, method and device and electronic equipment | |
| CN108810049A (en) | Control method, device, system and the Virtual Reality equipment of equipment | |
| CN110210793A (en) | A kind of project sites construction remote monitoring platform, system and method | |
| CN113608812A (en) | Remote control method, device, system and storage medium | |
| CN106060528B (en) | Augmented reality method and system based on mobile phone terminal and electronic whiteboard | |
| KR102290951B1 (en) | Remote robot coding education system | |
| US20150140540A1 (en) | Information processing system, information processing method, information processing apparatus, portable terminal, and control method and control program thereof | |
| KR101994899B1 (en) | Based on web, e-training control station system | |
| CN110111523A (en) | A kind of fire-fighting Internet of Things signal imitation Transmission system | |
| CN114915647A (en) | Front-edge equipment remote interactive experience system based on micro-service | |
| CN104123009A (en) | System for controlling virtual reality display end through touch screen of handheld communication equipment | |
| CN108737337B (en) | Equipment processing method, device, server and system | |
| CN113617020B (en) | Game control method, game control device, storage medium, server and terminal | |
| KR101496899B1 (en) | System and method for servicing remote help using virtual device simulation and tutorial service apparatus and method | |
| CN101794543A (en) | Self-adaption interactive video terminal | |
| CN115941876A (en) | Audio and video conference implementation method and device, storage medium and computer equipment | |
| Lee et al. | Novel Architecture of OneM2M-Based Convergence Platform for Mixed Reality and IoT | |
| WO2019165580A1 (en) | Method for controlling mobile device and control terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |