CN114915647B - Front edge equipment remote interaction experience system based on micro-service - Google Patents
Front edge equipment remote interaction experience system based on micro-service Download PDFInfo
- Publication number
- CN114915647B CN114915647B CN202110115429.5A CN202110115429A CN114915647B CN 114915647 B CN114915647 B CN 114915647B CN 202110115429 A CN202110115429 A CN 202110115429A CN 114915647 B CN114915647 B CN 114915647B
- Authority
- CN
- China
- Prior art keywords
- service
- equipment
- micro
- module
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Medical Informatics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Manipulator (AREA)
Abstract
The invention provides a front-end equipment remote interactive experience system based on micro-service, which is used for teaching practical training and scientific tourism facing the front-end equipment, and is innovative and used for replacing the existing teaching practical training system and scientific tourism system, so that a user can remotely operate the front-end equipment with high price, quick updating, high deployment requirement and more operation limit, the problem that the existing virtual simulation and augmented reality system has a sense of sight and no effect caused by no access to practical equipment is solved, and simultaneously, a front-end equipment owner can realize higher benefit by sharing resources of the front-end equipment.
Description
Technical Field
The invention belongs to the field of remote teaching, and particularly relates to a front edge equipment remote interaction experience system based on micro-services.
Background
In the teaching and practical training field and the technical and tourism field, newly developed leading edge equipment in various technical fields is often displayed, so that students or tourists can know the development conditions of the technical fields. At present, in the display place of the front edge equipment, although some front edge equipment is deployed as experiment or display resources, the front edge equipment with high price, quick updating, high deployment requirement and more operation limitation is difficult to deploy, so that students or tourists cannot know and watch.
There are some display sites to avoid such problems, virtual simulated sand tables and virtual reality, augmented reality and mixed reality systems are employed, whereby the display of the leading edge equipment is aided by these devices. However, the display method also causes the appearance to be ineffective, and the interest of students or tourists is not easy to be stimulated.
In addition, since various front edge equipment is often developed by different institutions, the interfaces, software, models, standards and the like are involved, and the front edge equipment is not open, the access of the front edge equipment and a system of a display place is often difficult, and special development and maintenance are required, so that the development, integration and sharing efficiency involved in the front edge equipment access are low.
Disclosure of Invention
In order to solve the problems, the invention provides a remote interactive experience system of the front-end equipment, which designs, develops and integrates activities related to release, deployment, control, video, operation and interfaces of different front-end equipment in a micro-service mode, and adopts the following technical scheme:
the invention provides a remote interactive experience system of front-end equipment based on micro-service, which is used for enabling a user to carry out remote interactive operation on a plurality of front-end equipment, and is characterized by comprising the following steps: the at least one interactive terminal is used for enabling a user to remotely control the front edge equipment; and the cloud server is respectively in communication connection with the front equipment and the interactive terminal, the cloud server is provided with an equipment service operation environment module, a terminal service environment operation module, a retrieval acquisition module and a service operation module, the interactive terminal is provided with a configuration service storage module, a remote interaction interface module and a terminal side communication module, the equipment service operation environment module is at least provided with equipment control micro-service units and equipment identification numbers corresponding to each front equipment, the terminal service operation environment module is at least provided with equipment operation micro-service units and terminal service identification numbers corresponding to each front equipment and matched with the interactive terminal, the configuration service storage module is provided with the equipment identification numbers and the terminal service identification numbers which are configured in advance, the terminal side communication part is used for correspondingly transmitting the equipment identification numbers and the terminal identification numbers of the interactive terminal to the cloud server, the retrieval acquisition module retrieves the corresponding equipment control micro-service units from the equipment service operation environment module according to the equipment identification numbers, retrieves the corresponding equipment operation micro-service units according to the terminal service identification numbers, the service operation module operates the retrieved equipment operation micro-service units and the terminal operation modules correspondingly operates the equipment operation interface control parameters corresponding to the terminal equipment operation modules and the terminal operation parameters corresponding to the terminal operation interface operation parameters, and the interactive terminal operation modules are correspondingly operated by the terminal operation modules.
The remote interactive experience system of the front equipment based on the micro service provided by the invention can be further provided with the technical characteristics that each front equipment is provided with a camera used for shooting the front equipment, the equipment service operation and maintenance environment module is further provided with a video shooting micro service unit corresponding to each front equipment, the terminal service operation and maintenance environment module is further provided with a video analysis micro service unit corresponding to each front equipment and matched with an interactive terminal and an operation evaluation micro service unit, the retrieval acquisition module is further used for retrieving and acquiring the video shooting module, the video analysis micro service unit and the operation evaluation micro service unit when retrieving and acquiring the video, the service operation module is further used for controlling the camera to shoot an operation video of the front equipment when a user remotely operates the front equipment, and operating the video analysis micro service unit to analyze the operation video so as to obtain a video analysis result, further operating the operation evaluation micro service unit to call the video analysis result and the front equipment operation plan designed in advance by the user to perform comparison and evaluation on the operation of the user, if the video analysis result is matched with the front equipment operation plan, and if the preset degree of the front equipment operation plan is greater than the preset, the operation plan is matched with a preset operation rule or the operation evaluation rule is judged to be smaller if the front equipment is in comparison with the preset operation rule, and the operation rule is used for confirming that the operation is in a preset to be matched with the front operation rule.
The remote interactive experience system of the front equipment based on the micro service can also have the technical characteristics that the equipment service operation and maintenance environment module is further provided with an equipment state micro service unit corresponding to each front equipment, the equipment state micro service unit is also retrieved and obtained when the retrieval and obtaining module is used for retrieving and obtaining the equipment state defined by the front equipment self controller when a user remotely operates the front equipment, and the remote interactive interface module is also used for displaying a video analysis picture so as to provide operation videos and feedback of video analysis results and equipment states for the user, wherein the equipment states comprise position coordinates, equipment states and execution states.
The micro-service-based front-end equipment remote interactive experience system provided by the invention can also have the technical characteristics that the video analysis result is the source, time sequence, execution state, activity track and audio/video content of the operation video, and the micro-service interface of the video analysis micro-service unit comprises: the source of the operating video, the time series, the execution state of the leading edge equipment within the video, the activity trajectory, and the parameters of the audiovisual content, as well as the functions of operating these parameters.
The front equipment remote interactive experience system based on the micro-service provided by the invention can also have the technical characteristics that the system further comprises: the system comprises a block chain certification storage subsystem, wherein the equipment service operation and maintenance environment module and the terminal service environment operation and maintenance module support micro service operation by using a virtual machine and a container, and the block chain certification storage subsystem is used for storing micro service basic information, micro service interface information, service conditions and states generated by the micro service in operation.
The front equipment remote interactive experience system based on the micro-service provided by the invention can also have the technical characteristics that the blockchain certification subsystem adopts a alliance chain form, and the corresponding participants at least comprise a front equipment provider, a micro-service provider and an interactive terminal provider, and the blockchain certification subsystem also stores the participant basic information of the participants.
The micro-service-based remote interactive experience system of the front-end equipment provided by the invention can also have the technical characteristics that the equipment control micro-service unit converts the equipment operation parameters into instruction parameters defined by the front-end equipment controller through the predefined parameter conversion rules, and remotely controls the front-end equipment according to the instruction parameters, wherein the equipment operation parameters comprise variables, activities, execution rules and exception handling, and the micro-service interface of the equipment control micro-service unit defines the equipment operation parameters and realizes functions corresponding to parameter calling, transmission, conversion, control, state and response.
The invention provides a micro-service-based front-end equipment remote interactive experience system, which can also have the technical characteristics that a device operation micro-service unit is used for designing and defining the activities, execution rules and exception handling of the front-end equipment, and supporting the user to design and edit the front-end equipment operation plan, and a micro-service interface of the device operation micro-service unit comprises: the variables, activities, execution rules, exception handling parameters of the user-designed leading edge equipment, and functions to operate on these parameters.
The remote interactive experience system of the front equipment based on the micro-service can also have the technical characteristics that the equipment identification number and the terminal service identification number stored in the configuration service storage module are pre-configured and stored by an administrator of the interactive terminal, or the equipment identification number and the terminal service identification number stored in the configuration service storage module are input by a user through the remote interactive interface module and are configured and stored.
The remote interactive experience system of the front equipment based on the micro-service provided by the invention can also have the technical characteristics that the interactive terminal is a computer arranged on the site of a remote display place of the front equipment or an intelligent terminal held by a user.
The actions and effects of the invention
According to the micro-service-based front-end equipment remote interactive experience system, as the micro-service architecture is adopted, the micro-service units corresponding to various front-end equipment are distributed to the equipment service operation and maintenance environment module and the terminal service operation and maintenance environment module, the standardization of the front-end equipment service interface is realized, the control services corresponding to various front-end equipment can be uniformly stored in the operation and maintenance environment in the form of micro-service, and the problems of low development, integration and sharing efficiency related to the front-end equipment remote interactive experience system are solved. And when the equipment identification number and the terminal service identification number sent by the interactive terminal are received through the retrieval acquisition module, the corresponding micro service unit is retrieved and acquired, and the micro service unit is further operated through the service operation module, so that the interactive terminal can call the corresponding micro service unit according to the preset configuration, further a user can remotely control the corresponding front edge equipment, the problem that the conventional equipment has no effect in displaying the sense of sight is solved, and the interest of students or tourists is stimulated. Through the remote interactive experience system of the front edge equipment, the resource sharing of the front edge equipment can be realized, the problems that the front edge equipment resources are high in price, quick in updating, high in deployment requirement and high in operation limit in the fields of teaching practical training and scientific tourism are lack, the front edge equipment acquisition is relieved, the front edge equipment acquisition, upgrading and operation are difficult, the application in the fields of teaching practical training and scientific tourism is facilitated, and more students or tourists can learn the development and operation of the front edge equipment are learned.
Drawings
FIG. 1 is a block diagram of a microservice-based front-end equipment remote interactive experience system in accordance with an embodiment of the present invention;
FIG. 2 is a block diagram of a cloud server in an embodiment of the invention;
FIG. 3 is a schematic diagram of a front-end equipment remote interactive experience system according to an embodiment of the present invention;
FIG. 4 is a block diagram of an interactive terminal according to an embodiment of the present invention; and
fig. 5 is an integrated diagram of a front-end equipped remote interactive experience system in an embodiment of the invention.
Detailed Description
In order to make the technical means, creation characteristics, achievement purposes and effects achieved by the present invention easy to understand, the micro-service-based front-end equipment remote interactive experience system of the present invention is specifically described below with reference to the embodiments and the accompanying drawings.
< example >
FIG. 1 is a block diagram of a microservice-based front-end equipment remote interactive experience system in accordance with an embodiment of the present invention.
As shown in fig. 1, the microservice-based front-end equipment remote interactive experience system 100 has a variety of front-end equipment 11, cloud servers 12, interactive terminals 13, blockchain certification subsystem 14, and communication networks 15 and 16.
The cloud server 12 is respectively in communication connection with the various front edge devices 11 through a communication network 15, and is in communication connection with the interaction terminal 13 through a communication network 16. In this embodiment, the communication network 15 and the communication network 16 are the internet.
The front edge equipment 11 is various new and front edge technological equipment, such as robots, new equipment, unmanned aerial vehicles, etc., and the present embodiment will be described in detail below taking unmanned aerial vehicles and controllers thereof as front edge equipment.
In this embodiment, each front edge device 11 is correspondingly provided with at least one camera 17, and the camera 17 is used for shooting the front edge device 11 to obtain an operation video of the front edge device 11 when the front edge device 11 is remotely operated by a user, and sending the operation video to the cloud server 12.
Fig. 2 is a block diagram of a cloud server according to an embodiment of the present invention, and fig. 3 is a schematic structural diagram of a remote interactive experience system with front-end equipment according to an embodiment of the present invention.
As shown in fig. 2 and 3, the cloud server 12 includes an equipment service operation and maintenance environment module 21, a terminal service environment operation and maintenance module 22, a search acquisition module 23, a service operation module 24, a service side communication module 25, and a service side control module 26 for controlling the above-described respective modules.
The equipment service operation and maintenance environment module 21 is configured to provide an operation and maintenance environment for the micro-service corresponding to the front-edge equipment, and specifically stores an equipment identifier, an equipment control micro-service unit, a video capturing micro-service unit, and an equipment status micro-service unit of each front-edge equipment 11.
Each front-end equipment 11 corresponds to an equipment control micro-service unit, a video shooting micro-service unit and an equipment status micro-service unit, and these micro-service units are stored in the equipment service operation and maintenance environment module corresponding to the equipment identification number of the front-end equipment 11, and the retrieval and acquisition module can retrieve the corresponding micro-service unit according to the equipment identification number.
The device control micro-service unit is configured to interact with a controller of the front-end equipment 11 itself, and convert device operation parameters input by a user into instruction parameters that can be understood by the front-end equipment controller through predefined parameter conversion rules, so that the controller controls the front-end equipment 11 to execute corresponding operations according to the instruction parameters.
The device operation parameters comprise variables, activities, execution rules and exception handling. The micro service interface of the device control micro service unit is defined as the operation parameter of the device, and the functions corresponding to parameter calling, transmission, conversion, control, state and response are realized.
The video capturing micro service unit is configured to capture an operation video of the front edge equipment 11 through the camera 17, and transmit the video to the cloud server 12 and the interaction terminal 13 through a video transmission protocol supported by the camera 17. The micro service interface of the video shooting micro service unit comprises: video data object parameters, video object transfer functions, and video operation functions defined by the video transfer protocol supported by the camera 17.
In this embodiment, the video capturing micro service unit performs push and pull of the video through a camera on the unmanned aerial vehicle and based on the ftmp protocol.
The device state micro-service unit is used for collecting states defined by the controller of the front edge equipment 11, including position coordinates, device states and execution states, and is used for the device control micro-service unit and the service operation module to call. The micro service interface of the device state micro service unit comprises: the leading edge equipment is provided with state parameters defined by a controller thereof and functions corresponding to parameter calling, transmission and conversion are realized.
In this embodiment, the state parameters collected by the device state microservice unit are flight parameters of the unmanned aerial vehicle, such as longitude and latitude, coordinate flight states, and the like.
The terminal service operation and maintenance environment module 22 stores a terminal service identification number, a device operation micro service unit, a video analysis micro service unit, and an operation evaluation micro service unit.
Each front edge device 11 corresponds to a device operation micro-service unit, a video analysis micro-service unit and an operation evaluation micro-service unit, and these micro-service units are adapted to the interaction terminal 13. In other aspects of the present invention, when n interaction terminals also exist, the micro service units may be correspondingly adapted with n, so that each front edge device 11 corresponds to n device operation micro service units, n video analysis micro service units, and n operation evaluation micro service units.
The device operation micro service unit is used for supporting user design, editing operation plans (such as operation programs) of the front equipment, and enabling the user to design, define activities, execution rules and exception handling of the front equipment. The micro service interface of the micro service unit is operated by the device, and comprises: the user-designed leading edge equipment variables, activities, execution rules, exception handling parameters, and functions to manipulate these parameters.
In this embodiment, after a user inputs parameters such as a variable and an activity as an operation parameter of the device through the device operation micro service unit, the device control micro service unit receives the operation parameter of the device through the webSocket and interacts with the unmanned aerial vehicle controller, converts the operation content into a control instruction which can be understood by the unmanned aerial vehicle controller to enable the unmanned aerial vehicle controller to remotely execute, so that the user can control various functions of the unmanned aerial vehicle through the device operation micro service unit.
The video analysis micro-service unit is used for calling micro-service of the video analysis micro-service unit so as to acquire, display and analyze operation videos of the front edge equipment. In this embodiment, the video analysis microservice unit is capable of extracting the source, time sequence, execution state of the leading edge equipment in the video, activity track and audio/video content of the analyzed video object. The micro service interface of the video analysis micro service unit comprises: the source of the video object, the time series, the execution state of the leading edge equipment within the video, the activity trajectory, and the parameters of the audiovisual content, as well as the functions of operating these parameters.
The operation evaluation micro-service unit is used for calling the video analysis result of the video analysis micro-service unit and the operation plan and comparing the video analysis result and the operation plan, so as to evaluate the feasibility, the rationality and the specialty of the user operation, if the matching degree of the operation plan and the execution result is greater than the user self-defined threshold value, the operation is considered to be successful, and if the matching degree is less than the user self-defined threshold value, the operability is considered to be weak; deduction is determined if the operation plan violates the operation principle or rule involved. The micro service interface of the operation evaluation micro service unit includes: custom parameters corresponding to the leading edge equipment operation plan include feasibility, rationality, expertise parameters, and functions.
In addition, in this embodiment, when the operation evaluation micro-service unit determines that the operability is weak, corresponding operation reminding information is generated in real time and sent to the interactive terminal 13, so as to remind the user that the operation has a problem and needs to be adjusted in time.
In this embodiment, the micro service operation and maintenance environment of the equipment service operation and maintenance environment module 21 and the terminal service environment operation and maintenance module 22 can support micro service operation by using a virtual machine and a container, and in this embodiment, the micro service operation and maintenance environment adopts a mainstream market open source environment to operate micro services in the container.
The retrieval obtaining module 23 is configured to retrieve and obtain a corresponding device control micro-service unit, a video capturing micro-service unit, and a device status micro-service unit from the equipment service operation and maintenance environment module according to the equipment identifier when the service side communication module 25 receives the equipment identifier and the terminal service identifier from the interactive terminal 13, and retrieve and obtain a corresponding device operation micro-service unit, a video analysis micro-service unit, and an operation evaluation micro-service unit according to the terminal service identifier.
The service operation module 24 is configured to operate each micro service unit retrieved by the retrieval obtaining module 23, thereby performing a corresponding function.
In this embodiment, the above-mentioned retrieving and obtaining module 23 and the service running module 24 are used as a front-end equipment remote interaction integrated module, and are middleware between the cloud server 12 and the front-end equipment micro-service, and are used for calling the front-end equipment and the remote interaction micro-service thereof according to the user requirement input in the remote interaction interface displayed by the interaction terminal 13 in the form of a micro-service client, so as to implement dynamic construction of the front-end equipment remote interaction experience system.
The service side communication module 25 is used for performing data communication between the cloud server 12 and the front edge equipment 11, the interaction terminal 13 and the blockchain certification subsystem 14.
The interactive terminal 13 is a computer provided at a site of a remote presentation site of the front-end equipment, through which a user can remotely operate the front-end equipment 11.
Fig. 4 is a block diagram of an interactive terminal according to an embodiment of the present invention.
As shown in fig. 4, the interactive terminal 13 has a configuration service storage module 31, a remote interactive interface module 32, a terminal-side communication module 33, and a terminal-side control module 34 for controlling the above-mentioned respective modules.
The configuration service storage module 31 stores a pre-configured equipment identification number and a terminal service identification number. In this embodiment, the interactive terminal 13 is a computer at the display location, the equipment identifier and the terminal service identifier of which are preconfigured by a manager at the display location, and once the interactive terminal 13 is started up, the terminal-side communication module 33 sends the equipment identifier and the terminal service identifier to the cloud server 12 so as to start up the corresponding micro service and wait for the user to use.
The remote interactive interface module 32 is used to provide a human-machine interactive interface for the microservice. In this embodiment, the remote interactive interface module 32 displays three basic interfaces through the display screen of the computer: a device operation screen, a video analysis screen, and an operation evaluation screen.
The device operation screen is used for providing a selectable operation plan and an editable operation template based on operation parameters for a user,
the video analysis picture is used for providing operation video and feedback of video analysis results and equipment states for users
The operation evaluation screen is used for displaying the comparison evaluation result generated by the operation evaluation micro-service unit, so that the user confirms the operation result.
The terminal-side communication module 33 is configured to perform data communication between the interaction terminal 13 and the cloud server 12.
Fig. 5 is an integrated diagram of a front-end equipped remote interactive experience system in an embodiment of the invention.
When the retrieval obtaining module 23 retrieves the corresponding micro service unit and enables the service running module 24 to run, the remote interaction integration of the front equipment composed of each micro service is shown in fig. 5. The module calls unmanned plane (front edge equipment) and remote interaction micro-service, the remote interaction micro-service encapsulates live broadcast related micro-service (namely live broadcast micro-service and video transmission micro-service respectively corresponding to a video analysis micro-service unit and a video shooting micro-service unit) and remote control related micro-service (namely operation evaluation, remote control, equipment parameters and equipment operation micro-service), and a user can automatically use live broadcast and control micro-service without sensing the whole principle, so that experience is improved.
Firstly, the remote interactive micro-service establishes two long connections with the server, one ensures the transmission of live pictures, and the other ensures the transmission of control signals and equipment parameters. When a connection is established, an initialization function of an inheritance module is called, and a terminal id (i.e. a terminal service identification number) and an equipment id (i.e. an equipment identification number) of a user are carried, after the cloud server receives information, mutual exclusion verification is firstly carried out, if the connection exists, the connection of the user is refused, if the connection exists, a video shooting micro-service and an equipment control micro-service are called to match the connection of the interactive terminal with the connection of leading equipment, and then only forwarding work is carried out on the connection which is already established.
The user can actively send control signals when the connection is maintained, and the signals are decoded into an internal unified operation control code by the device control micro-service and transmitted to the front-end equipment. If the user transmits a complex path, the path cruising micro-service is called, the complex path is disassembled into a plurality of specific control signals, and the specific control signals are transmitted to the unmanned aerial vehicle controller again, so that the cruising function of the unmanned aerial vehicle is realized.
In the aspect of live broadcasting, the live broadcasting micro-service can check the correctness of connection, and ensure to inform the other party when any party of the front edge equipment or the interactive terminal is disconnected, so that the connection can be safely withdrawn; the video transmission micro-service encapsulates the logic of video transmission, including video decoding, format conversion and the like, the front-end equipment end can select a supported transmission protocol and push the stream by using a corresponding interface, and the interactive terminal can pull the video normally.
The blockchain certification subsystem 14 is used for certifying basic information, use conditions and states of the micro services. In this embodiment, the blockchain storage subsystem 14 adopts a form of a alliance chain, the system development environment adopts open source blockchain software, the transmission is performed based on the point-to-point protocol established by the hypertext transfer protocol 2.0, and the data structure is optimized to effectively maintain the repeated overall state of the participants. Different consensus algorithms are or will be embedded in each configuration to ensure a high degree of consistency. The participants comprise unmanned aerial vehicle providers, micro-service providers and remote interactive experience system providers, the data of the stored certificate is participant basic information, micro-service interface information, service conditions and states, and the size of the block is not limited.
Example operation and Effect
According to the micro-service-based remote interactive experience system for the front edge equipment, which is provided by the embodiment, due to the adoption of the micro-service architecture, the micro-service units corresponding to various front edge equipment are distributed to the equipment service operation and maintenance environment module and the terminal service operation and maintenance environment module, so that the standardization of the service interface of the front edge equipment is realized, the control services corresponding to various front edge equipment can be uniformly stored in the operation and maintenance environment in a micro-service mode, and the problems of low development, integration and sharing efficiency related to the remote interactive experience system for the front edge equipment are solved. And when the equipment identification number and the terminal service identification number sent by the interactive terminal are received through the retrieval acquisition module, the corresponding micro service unit is retrieved and acquired, and the micro service unit is further operated through the service operation module, so that the interactive terminal can call the corresponding micro service unit according to the preset configuration, further a user can remotely control the corresponding front edge equipment, the problem that the conventional equipment has no effect in displaying the sense of sight is solved, and the interest of students or tourists is stimulated. Through the remote interactive experience system of the front edge equipment, the resource sharing of the front edge equipment can be realized, the problems that the front edge equipment resources are high in price, quick in updating, high in deployment requirement and high in operation limit in the fields of teaching practical training and scientific tourism are lack, the front edge equipment acquisition is relieved, the front edge equipment acquisition, upgrading and operation are difficult, the application in the fields of teaching practical training and scientific tourism is facilitated, and more students or tourists can learn the development and operation of the front edge equipment are learned.
In the above embodiment, the device control micro-service unit, the video shooting micro-service unit, the device status micro-service unit, and the device operation micro-service unit, the video analysis micro-service unit, and the operation evaluation micro-service unit related to the remote interaction of the front edge equipment are all designed, developed, and distributed in the form of micro-service, so as to realize the standardization of front edge equipment distribution, integration, and interaction, and deploy and operate in the micro-service operation environment, and the remote interaction experience system invokes the micro-service through the integration module, supports the remote operation of the front edge equipment by the user through the human-computer interface, and obtains the interactive operation level evaluation, thereby being beneficial to the remote interaction experience system
In the embodiment, the micro-service provides cloud operation and maintenance environment based on the container, so that the problem of safety and reliability of operation and maintenance of the micro-service is solved.
In the embodiment, the video shooting micro-service unit is provided for shooting and transmitting the operation video of the front equipment, so that a basis can be provided for remote observation of the response condition and operation evaluation of the equipment by a user of the remote interaction experience system, and the eyesight of the user can be extended.
Furthermore, the device state micro-service unit and the video analysis micro-service unit are further provided for acquiring and analyzing the field video and the device state of the front edge equipment, so that the correctness of the operation process of the front edge equipment can be evaluated and analyzed, and the operation evaluation algorithm and calculation force of a user are improved.
In the embodiment, the related information of the micro-service is stored through the blockchain storage subsystem, so that a tamper-proof and non-repudiation trusted storage facility can be provided for the front edge equipment and the micro-service basic information, the service condition and the running state related to the remote interaction of the front edge equipment, the full life cycle tracing and management of the micro-service can be realized, and the ownership and the information safety of the data are ensured.
The above examples are only for illustrating the specific embodiments of the present invention, and the present invention is not limited to the description scope of the above examples.
For example, in the above embodiment, the leading edge equipment is a unmanned aerial vehicle and a unmanned aerial vehicle controller, and in other aspects of the present invention, the leading edge equipment may also be other leading edge equipment such as a mechanical arm, a robot, and the like.
For example, in the above embodiment, the interactive terminal is a computer disposed at the display site, and the configuration service storage module of the interactive terminal is preconfigured by a manager. In other schemes of the invention, the interactive terminal can also be a terminal such as a tablet, a smart phone and the like.
Furthermore, the interactive terminal can also be a personal computer or tablet of the user, and the equipment identification number and the terminal service identification number in the configuration service storage module are input by the user through the remote interactive interface module to complete configuration storage.
Claims (10)
1. A microservice-based remote interactive experience system for enabling a user to remotely interact with a plurality of types of front-end equipment, comprising:
the at least one interactive terminal is used for enabling a user to remotely control the front edge equipment; and
the cloud server is respectively communicated with the front edge equipment and the interactive terminal,
wherein the cloud server is provided with an equipment service operation and maintenance environment module, a terminal service environment operation and maintenance module, a retrieval acquisition module and a service operation module,
the interactive terminal is provided with a configuration service storage module, a remote interactive interface module and a terminal side communication module,
the equipment service operation and maintenance environment module at least stores equipment control micro-service units corresponding to each front-end equipment and equipment identification numbers,
the terminal service operation and maintenance environment module at least stores a device operation micro-service unit and a terminal service identification number which correspond to each front edge device and are matched with the interactive terminal,
the configuration service storage module stores a pre-configured equipment identification number and a terminal service identification number,
the terminal side communication part is used for correspondingly transmitting the equipment identification number and the terminal service identification number to the cloud server with the terminal identification number of the interactive terminal,
the retrieval and acquisition module retrieves and acquires the corresponding equipment control micro-service unit from the equipment service operation and maintenance environment module according to the equipment identification number, retrieves and acquires the corresponding equipment operation micro-service unit according to the terminal service identification number,
the service operation module operates the device operation module obtained through retrieval and communicates with the interactive terminal according to the terminal identification number, so that the remote interactive interface module displays a device operation picture corresponding to the device operation module to enable the user to input device operation parameters, and operates the device control module to control the front equipment to execute corresponding operation according to the device operation parameters.
2. The microservice-based front-end equipment remote interactive experience system of claim 1 wherein:
wherein each of the front edge equipments is provided with a camera for photographing the front edge equipment,
the equipment service operation and maintenance environment module also stores video shooting micro-service units corresponding to each front-end equipment,
the terminal service operation and maintenance environment module also stores a video analysis micro-service unit and an operation evaluation micro-service unit which correspond to each front edge device and are matched with the interactive terminal,
the retrieval and acquisition module also retrieves and acquires the video shooting module, the video analysis micro-service unit and the operation evaluation micro-service unit when performing the retrieval and acquisition,
the service operation module is also used for operating the video shooting module to control the camera to shoot the operation video of the front equipment when the user remotely operates the front equipment, operating the video analysis micro-service unit to analyze the operation video to obtain a video analysis result, further operating the operation evaluation micro-service unit to call the video analysis result and a front equipment operation plan designed in advance by the user to compare and evaluate the operation of the user,
if the matching degree of the video analysis result and the front edge equipment operation plan is larger than a preset threshold value, judging that the operation is successful,
if the degree of matching is smaller than the predetermined threshold value, judging that the operability is weak,
if the leading edge equipment operation plan violates the operational principles or rules involved to determine a deduction,
the remote interactive interface module is also used for displaying an operation evaluation picture to enable a user to confirm the comparison evaluation result.
3. The microservice-based front-end equipment remote interactive experience system of claim 2 wherein:
wherein the equipment service operation and maintenance environment module also stores an equipment state micro-service unit corresponding to each front-end equipment,
the retrieval and acquisition module also retrieves and acquires the equipment state micro-service unit when the retrieval and acquisition are carried out,
the service execution module is further configured to execute the device status micro-service unit to obtain an equipment status defined by the front-end equipment own controller when the user remotely operates the front-end equipment,
the remote interactive interface module is further configured to display a video analysis screen to provide the user with feedback of the operation video and the video analysis result and the equipment status,
the equipment status includes location coordinates, device status, and execution status.
4. The microservice-based front-end equipment remote interactive experience system of claim 2 wherein:
wherein the video analysis result is the source, time sequence, execution state, activity track and audio-video content of the operation video, the front edge equipment in the operation video,
the micro service interface of the video analysis micro service unit comprises: the source of the operating video, the time sequence, the execution state of the leading edge equipment within the video, the activity trajectory, and the parameters of the audiovisual content, and the functions of operating these parameters.
5. The microservice-based front-end equipment remote interactive experience system of claim 1 further comprising:
a blockchain certification subsystem,
wherein the equipment service operation and maintenance module and the terminal service environment operation and maintenance module support micro service operation by using a virtual machine and a container,
the blockchain certification storing subsystem is used for storing micro-service basic information, micro-service interface information, service conditions and states generated by the micro-service in running.
6. The microservice-based front-end equipment remote interactive experience system of claim 5 wherein:
wherein the blockchain certification subsystem takes the form of a coalition chain, and the corresponding participants at least comprise the provider of the front-end equipment, the provider of the micro-service and the provider of the interactive terminal,
the blockchain certification subsystem also certifies participant basic information of the participant.
7. The microservice-based front-end equipment remote interactive experience system of claim 1 wherein:
wherein the equipment control micro-service unit converts equipment operation parameters into instruction parameters defined by a controller of the front-end equipment itself through predefined parameter conversion rules, and remotely controls the front-end equipment according to the instruction parameters,
the device operating parameters include variables, activities, execution rules and exception handling,
the micro service interface of the device control micro service unit defines the operation parameters of the device and realizes functions corresponding to parameter calling, transmission, conversion, control, state and response.
8. The microservice-based front-end equipment remote interactive experience system of claim 1 wherein:
wherein the equipment operation micro-service unit is used for designing and defining the activities, execution rules and exception handling of the front-end equipment, supporting the user to design and edit the front-end equipment operation plan,
the micro service interface of the micro service unit operated by the device comprises: variables, activities, execution rules, exception handling parameters of the leading edge equipment designed by the user, and functions to operate on these parameters.
9. The microservice-based front-end equipment remote interactive experience system of claim 1 wherein:
wherein the equipment identification number and the terminal service identification number stored in the configuration service storage module are pre-configured and stored by an administrator of the interactive terminal,
or (b)
And the equipment identification number and the terminal service identification number stored in the configuration service storage module are input by the user through the remote interactive interface module and the configuration storage is completed.
10. The microservice-based front-end equipment remote interactive experience system of claim 1 wherein:
the interactive terminal is a computer arranged on the site of a remote display place of the front edge equipment or an intelligent terminal held by the user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110115429.5A CN114915647B (en) | 2021-01-28 | 2021-01-28 | Front edge equipment remote interaction experience system based on micro-service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110115429.5A CN114915647B (en) | 2021-01-28 | 2021-01-28 | Front edge equipment remote interaction experience system based on micro-service |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114915647A CN114915647A (en) | 2022-08-16 |
| CN114915647B true CN114915647B (en) | 2023-08-29 |
Family
ID=82761906
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110115429.5A Active CN114915647B (en) | 2021-01-28 | 2021-01-28 | Front edge equipment remote interaction experience system based on micro-service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114915647B (en) |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002218572A (en) * | 2001-01-24 | 2002-08-02 | Index:Kk | Remote control system and micro-server |
| KR20030054796A (en) * | 2001-12-26 | 2003-07-02 | 엘지전자 주식회사 | remote control service system for imagination experience of electric home appliances and service method thereof |
| CN101866215A (en) * | 2010-04-20 | 2010-10-20 | 复旦大学 | Human-computer interaction device and method adopting eye tracking in video monitoring |
| WO2016062187A1 (en) * | 2014-10-24 | 2016-04-28 | 杭州大穿越旅游策划有限公司 | Matching method and intelligent interactive experiencing system |
| WO2017045193A1 (en) * | 2015-09-18 | 2017-03-23 | 深圳市赛亿科技开发有限公司 | Method and system for remotely accessing electrical appliance |
| CN106817431A (en) * | 2017-03-30 | 2017-06-09 | 王元 | Internet of Things video remote control method and system |
| CN107330774A (en) * | 2017-08-23 | 2017-11-07 | 周益安 | Interactive Experience system and its experiential method for stay-at-home children |
| CN107888676A (en) * | 2017-11-07 | 2018-04-06 | 上海电机学院 | A kind of high in the clouds self-study environmental device based on micro services |
| CN108880887A (en) * | 2018-06-20 | 2018-11-23 | 山东大学 | Accompany and attend to robot cloud service system and method based on micro services |
| CN108898905A (en) * | 2018-08-29 | 2018-11-27 | 华南理工大学 | A kind of unmanned plane interactive teaching live streaming platform |
| CN208337616U (en) * | 2018-07-16 | 2019-01-04 | 广州奇艺果信息科技有限公司 | A kind of recreational machine remote control sports system |
| CN110148318A (en) * | 2019-03-07 | 2019-08-20 | 上海晨鸟信息科技有限公司 | A kind of number assiatant system, information interacting method and information processing method |
| CN110535902A (en) * | 2019-07-16 | 2019-12-03 | 平安普惠企业管理有限公司 | The processing method and electronic device of monitoring intelligent are realized based on micro services |
| CN111124699A (en) * | 2018-10-31 | 2020-05-08 | 南京智能仿真技术研究院有限公司 | Unmanned aerial vehicle cloud data exchange system and method |
| CN111443659A (en) * | 2020-06-02 | 2020-07-24 | 湖北理工学院 | Remote monitoring control system for numerical control machine tool |
| CN111475373A (en) * | 2020-03-10 | 2020-07-31 | 中国平安人寿保险股份有限公司 | Service control method and device under micro service, computer equipment and storage medium |
-
2021
- 2021-01-28 CN CN202110115429.5A patent/CN114915647B/en active Active
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002218572A (en) * | 2001-01-24 | 2002-08-02 | Index:Kk | Remote control system and micro-server |
| KR20030054796A (en) * | 2001-12-26 | 2003-07-02 | 엘지전자 주식회사 | remote control service system for imagination experience of electric home appliances and service method thereof |
| CN101866215A (en) * | 2010-04-20 | 2010-10-20 | 复旦大学 | Human-computer interaction device and method adopting eye tracking in video monitoring |
| WO2016062187A1 (en) * | 2014-10-24 | 2016-04-28 | 杭州大穿越旅游策划有限公司 | Matching method and intelligent interactive experiencing system |
| WO2017045193A1 (en) * | 2015-09-18 | 2017-03-23 | 深圳市赛亿科技开发有限公司 | Method and system for remotely accessing electrical appliance |
| CN106817431A (en) * | 2017-03-30 | 2017-06-09 | 王元 | Internet of Things video remote control method and system |
| CN107330774A (en) * | 2017-08-23 | 2017-11-07 | 周益安 | Interactive Experience system and its experiential method for stay-at-home children |
| CN107888676A (en) * | 2017-11-07 | 2018-04-06 | 上海电机学院 | A kind of high in the clouds self-study environmental device based on micro services |
| CN108880887A (en) * | 2018-06-20 | 2018-11-23 | 山东大学 | Accompany and attend to robot cloud service system and method based on micro services |
| CN208337616U (en) * | 2018-07-16 | 2019-01-04 | 广州奇艺果信息科技有限公司 | A kind of recreational machine remote control sports system |
| CN108898905A (en) * | 2018-08-29 | 2018-11-27 | 华南理工大学 | A kind of unmanned plane interactive teaching live streaming platform |
| CN111124699A (en) * | 2018-10-31 | 2020-05-08 | 南京智能仿真技术研究院有限公司 | Unmanned aerial vehicle cloud data exchange system and method |
| CN110148318A (en) * | 2019-03-07 | 2019-08-20 | 上海晨鸟信息科技有限公司 | A kind of number assiatant system, information interacting method and information processing method |
| CN110535902A (en) * | 2019-07-16 | 2019-12-03 | 平安普惠企业管理有限公司 | The processing method and electronic device of monitoring intelligent are realized based on micro services |
| CN111475373A (en) * | 2020-03-10 | 2020-07-31 | 中国平安人寿保险股份有限公司 | Service control method and device under micro service, computer equipment and storage medium |
| CN111443659A (en) * | 2020-06-02 | 2020-07-24 | 湖北理工学院 | Remote monitoring control system for numerical control machine tool |
Non-Patent Citations (1)
| Title |
|---|
| 智能Web服务及其元模型驱动的开发环境;陆潇华;李银胜;;计算机应用与软件(12);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114915647A (en) | 2022-08-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9600301B2 (en) | Method and apparatus for interactive mobile device guidance | |
| JP6294487B2 (en) | Flight mission processing method, apparatus and system | |
| CN102571396B (en) | Communication network system and routing inspection subsystem and routing inspection method of communication equipment | |
| CN105493501A (en) | Virtual video camera | |
| CN102438173A (en) | Method and system for remotely controlling set top box (STB) | |
| CN110855680B (en) | Internet of things equipment docking method and device | |
| CN110995859A (en) | Intelligent transformer substation supporting platform system based on ubiquitous Internet of things | |
| CN110007950A (en) | A kind of management method of application programming interfaces, device and server | |
| CN115525302B (en) | Deployment method and device for large-scale digital object warehouse cluster | |
| CN111159047A (en) | Android equipment auxiliary debugging device with visual interface and operation method thereof | |
| CN113608812A (en) | Remote control method, device, system and storage medium | |
| CN110989842A (en) | Training method and system based on virtual reality and electronic equipment | |
| US20040044513A1 (en) | Distributed simulation system | |
| CN114915647B (en) | Front edge equipment remote interaction experience system based on micro-service | |
| CN115314535B (en) | Control method and device of Internet of things equipment, storage medium and computer equipment | |
| Yan et al. | Intergrating UAV development technology with augmented reality toward landscape tele-simulation | |
| CN110928526A (en) | Processing device for Internet of things | |
| CN115984481A (en) | Visual industrial digital simulation management system | |
| CN105282520A (en) | Chip for augmented reality explanation device, and augmented reality information transmission and interaction method | |
| CN113436320B (en) | 3D model generation system and method based on IFC model file | |
| Lee et al. | Novel Architecture of OneM2M-Based Convergence Platform for Mixed Reality and IoT | |
| CN115941876A (en) | Audio and video conference implementation method and device, storage medium and computer equipment | |
| CN112558968A (en) | Resource tree view generation method, device, equipment and storage medium | |
| KR20160140009A (en) | Remote control apparatus having integrated remote control program and method for remote control | |
| CN112215587B (en) | Method, device and system for automatically executing business process interaction tasks by multiple devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |