CN116009857A

CN116009857A - Rapid human-computer interaction application system and application method and device thereof

Info

Publication number: CN116009857A
Application number: CN202211625645.5A
Authority: CN
Inventors: 曾凡伟; 罗涛; 陈军
Original assignee: Chengdu Hermes Technology Co ltd; Chengdu Zirui Qingyun Aeronautical And Astronautical Technology Co ltd
Current assignee: Chengdu Hermes Technology Co ltd; Chengdu Zirui Qingyun Aeronautical And Astronautical Technology Co ltd
Priority date: 2022-12-16
Filing date: 2022-12-16
Publication date: 2023-04-25

Abstract

The invention discloses a rapid man-machine interaction application system and a using method and a device thereof, wherein the system comprises an IO module, a DDM module and a UI module, the DDM module comprises a data analysis module, an independent variable module, a data recombination module and a data forwarding module, and the method comprises the following steps: s1, an IO module receives a data packet of an external communication system and forwards the data packet to a DDM module for analysis processing; s2, the DDM module analyzes and processes the data packet from the IO module and forwards the data packet to the UI module; s3, after the UI module receives the data sent by the DDM module, the data is visually displayed on an operation interface of the UI module; s4, the user checks the information in the UI module, and the UI module sends the information data of the operation to the DDM module for processing; s5, the DDM module sends the processed information data to the IO module; s6, the IO module sends the received data to an external communication system. The invention solves the problem that the user needs to learn the complex programming language to realize man-machine interaction in the prior art.

Description

Rapid human-computer interaction application system and application method and device thereof

Technical Field

The invention relates to the field of man-machine interaction, in particular to a rapid man-machine interaction application system and a using method and device thereof.

Background

Development of current graphical interface applications is often accomplished using programming languages to invoke the application program interface of the operating system. There are two distinct limitations to this approach: firstly, although the programming language is flexible, the learning and use cost is higher, and the programming language is not directly visual as the interface operation; secondly, most programming languages at present depend on compilers, so different application programs need to be customized and developed according to different requirements, and recompilation and deployment are needed after any modification is carried out on the application programs. Some tools implement interface generation based on control drag and drop, but cannot flexibly configure communication with other systems, and are difficult to interact with external systems.

On the other hand, in many cases, the data communication system has the reasons of security and confidentiality of data, so that software developers cannot know the data content actually used for communication, but people with data access rights want to flexibly display corresponding data in a visual manner, and the communication content can be modified and adjusted at any time.

Disclosure of Invention

The invention aims to solve the problem that a user needs to learn a complex programming language to realize man-machine interaction in the prior art, and provides a rapid man-machine interaction application system, and a using method and a device thereof.

In order to achieve the above object, the present invention provides the following technical solutions:

the quick man-machine interaction application system comprises an IO module, a DDM module and a UI module, wherein the IO module is used for receiving a data packet from an external communication system and sending the data packet to the DDM module, and receiving the data packet from the DDM module and sending the data packet to the external communication system, the data packet of the external communication system comprises a field for explaining the type of the data packet, I in the IO module represents Input and is used for Input, O represents Output and is used for Output;

the UI module is used for displaying data and realizing man-machine interaction, adding a UI operation event and a data packet needing to be sent, sending the data packet needing to be sent to a data reorganization module in the DDM module, and sending an ID of the UI operation event and an ID of the data packet needing to be sent to a data forwarding module in the DDM module, wherein UI in the UI module is an abbreviation of user interface, meaning user interface design, meaning man-machine interaction, operation logic and integral design with attractive interface of software;

the DDM module comprises a data analysis module, a data reorganization module and a data forwarding module, wherein the data analysis module is used for receiving a data packet of an external communication system sent from the IO module, finding a field for explaining the type of the data packet according to an analysis table, analyzing the data packet of the external communication system, and then sending the analyzed data to the UI module for display, wherein DDM in the DDM module is an abbreviation of dynamic data management, which means dynamic data management;

the data reorganization module is used for receiving the data packet to be sent from the UI module and storing the data packet to be sent in the data reorganization module, wherein the data packet to be sent comprises a field for explaining the type of the character data packet;

the data forwarding module comprises a data forwarding table, wherein each table entry comprises an ID of a UI operation event, an ID of a data packet to be sent and an IO communication plug-in unit used for sending the data packet in an IO module, the UI module sends operation information of an operation interface of the UI module to the data forwarding module, the data forwarding module inquires whether the ID of the data packet to be sent in the data forwarding table is bound with a control operated by the operation interface of the UI module, if so, the data forwarding module acquires the data packet to be sent stored in the data reorganizing module and sends the data packet to be sent to the IO communication plug-in unit used for sending the data packet in the IO module.

Preferably, the IO module comprises an IO communication plug-in interface, an IO communication plug-in, a TCP server module, a TCP client module, a UDP network communication module, a DDS network communication module and a serial port communication module, wherein the IO communication plug-in interface is used for calling the TCP server module, the TCP client module, the DDM module, the UDP network communication module, the DDS network communication module and the serial port communication module in the form of plug-ins.

Preferably, the DDM module further includes an argument module for defining a constant and converting data, the defining the constant means that the argument module is operated on an operation interface of the UI module to complete the definition of the constant, the constant is not defined when the data parsing module parses a data packet of the external communication system, the converting of the data means that the data parsed by the data parsing module is converted according to operation information of the operation interface of the UI module,

the independent variable module judges whether to convert data according to the operation information of the operation interface of the UI module, and if necessary, the data analysis module sends the analyzed data to the independent variable module for data conversion and sends the converted data to the UI module for display; and if not, the data analysis module sends the analyzed data to the UI module for display.

Preferably, the DDM module further comprises a data monitoring module for displaying the names, types and values of the data parsing module, the data reorganizing module and the independent variable module in form of tables and curves in real time.

Preferably, the parsing table in the data parsing module is imported through a data table or added in an operation interface of the UI module, the data packet to be sent in the data reorganizing module is added through the data table or in the operation interface of the UI module, and the data forwarding table in the data forwarding module is added in the operation interface of the UI module.

Preferably, the UI module comprises a plug-in module, an engineering module,

the plug-in module is used for providing controls for the system in the form of plug-ins, and comprises a system plug-in, an input plug-in, an output plug-in and an expansion plug-in,

the engineering module is used for creating an interface control container and laying out the controls, and comprises a layout_1 module and a layout_2 module, wherein the layout_1 is responsible for the outermost Layout, and the layout_2 is responsible for the nested Layout.

The application method of the rapid man-machine interaction application system comprises the following steps:

s1, an IO module receives a data packet of an external communication system and forwards the data packet to a DDM module for analysis processing;

s2, the DDM module analyzes and processes the data packet from the IO module and forwards the data packet to the UI module;

s3, after receiving the data sent by the DDM module, the UI module performs visual display of the data in the form of a chart, a text or a control color change on an operation interface of the UI module;

s4, the user checks the operation on the operation interface of the UI module, and the UI module sends information data operated on the operation interface to the DDM module for processing;

s5, the DDM module sends the processed information data to the IO module;

s6, the IO module sends the received data to an external communication system.

Preferably, in step S2, the data parsing process refers to splitting data received from an external communication system into specific data structures according to fields thereof, and assigning a corresponding value to each field of the structures.

Preferably, in step S2, the data after the DDM module parsing process is stored in the MySql database.

A fast human-machine interaction application device comprising at least one processor and a memory communicatively coupled to the at least one processor, the memory storing instructions executable by the at least one processor to enable the at least one processor to perform any of the operations or steps of the fast human-machine interaction application system and method of use thereof.

Compared with the prior art, the invention has the beneficial effects that:

1. the quick man-machine interaction application system is established, a user can complete configuration of the needed interaction application according to the requirement, only corresponding modules and controls are needed to be added to an interface, corresponding data are imported or added, the corresponding controls and the data are bound, complex programming languages do not need to be learned, and learning cost is reduced;

2. the flexible configuration of interfaces and data as well as the separation of development and use personnel are realized, so that the application of conveniently creating the graphical user interface can be used, and the communication with an external communication system can be carried out safely.

Drawings

FIG. 1 is an overall framework diagram of an interactive system;

FIG. 2 is a flow chart of receiving data;

FIG. 3 is a flow chart of receiving transmit data;

FIG. 4 is a diagram of the creation operation of an IO module;

FIG. 5 is a diagram of IO module name setup operations;

FIG. 6 is a diagram of UDP module input setup operations;

FIG. 7 is an IO module output setup operation diagram;

FIG. 8 is a diagram of a DDM parser creation operation;

FIG. 9 is a diagram of DDM parser setup operations;

FIG. 10 is a diagram of a DDM combiner creation operation;

FIG. 11 is a diagram of DDM combiner setup operations;

FIG. 12 is a page creation operation diagram;

FIG. 13 is an add control operational diagram;

FIG. 14 is a diagram of a control property setup operation;

FIG. 15 is a diagram of an input data binding operation;

FIG. 16 is a diagram of an output data binding operation;

FIG. 17 is a diagram of create forwarding event operations;

FIG. 18 is a forwarding event setup operation diagram;

FIG. 19 is an event binding operation diagram;

FIG. 20 is a diagram of a chat software operating interface;

FIG. 21 is a diagram of chat software operation effects;

fig. 22 is a diagram of a communication tool transceiving data interface.

Detailed Description

The present invention will be described in further detail with reference to test examples and specific embodiments. It should not be construed that the scope of the above subject matter of the present invention is limited to the following embodiments, and all techniques realized based on the present invention are within the scope of the present invention.

Example 1

As shown in fig. 1, the system in this embodiment includes an IO module, a DDM module, and a UI module, where the IO module is configured to implement communication between the rapid human-computer interaction application system and an external communication system, and provide a unified data transceiver Interface for the DDM module, the DDM module is configured to receive data from the IO module, parse the data and send the parsed data to the UI module for display, and receive operations of the UI Interface to generate corresponding data and send the corresponding data to the external communication system by using the IO module, the UI module is matched with the IO module and the DDM module, for visual display and human-computer interaction of the data, I in the IO module represents Input, for Input, O represents Output, for Output, UI in the UI module is abbreviated as User Interface, meaning User Interface design refers to man-computer interaction, operation logic, and integral design with attractive Interface of software, and DDM in the DDM module is abbreviated as Dynamic Data Management, meaning dynamic data management. The embodiment is a rapid graphical user interface application generating tool, english is called RPA for short, an external communication system refers to a system which is except for the rapid human-computer interaction application system and is used for carrying out data communication with the rapid human-computer interaction application system, and communication modes among the data systems are various, so that an IO module comprises various corresponding modules to cope with various communication modes, and each sub-module supports one communication mode.

Further, the IO module comprises an IO communication plug-in interface, an IO communication plug-in, a TCP server side module, a TCP client side module, a UDP network communication module, a DDS network communication module and a serial port communication module, wherein the interface in the IO communication plug-in interface refers to a pure virtual function in C++ language and comprises a pure virtual function required by the processes of initializing, saving to engineering, loading, opening, closing, sending data and receiving data, the IO communication plug-in interface is used for calling the TCP server side module, the TCP client side module, the DDM module, the UDP network communication module, the DDS network communication module and the serial port communication module in the form of plug-in to realize the processes of initializing, saving to engineering, loading, opening, closing, sending data and receiving data of the system, the IO communication plug-in is a dynamic link library for realizing the interfaces necessary in the IO module, the calling of an IO communication plug-in interface is realized through an IO communication plug-in, a TCP server module is used for taking the quick man-machine interaction application system as a TCP server, an external system group is used as a mode of a client to carry out intersystem communication, a TCP client module is used for carrying out intersystem communication on the quick man-machine interaction application system and other TCP server systems, a UDP network communication module is used for carrying out UDP network communication on the quick man-machine interaction application system, a DDS network communication module is used for carrying out DDS network communication on the quick man-machine interaction application system, a serial port communication module is used for carrying out serial port communication on the quick man-machine interaction application system and the external system, the IO module confirms a calling interface (comprising acquisition version number, name, function description and configuration interface) which each submodule needs to realize, the interfaces are realized in the form of plug-ins, the IO module corresponding to the IO communication plug-in interface can be loaded to work, the plug-ins are called by an RPA program in the form of a dynamic link library, the IO module supports inter-system communication in a mode of taking RPA as a TCP server and an external communication system as a client, the IO module also supports the mode of taking the RPA as a TCP client, the IO module is connected to other TCP server systems to carry out inter-system communication, the UDP network communication module of the IO module can carry out UDP network and simultaneously supports broadcast, multicast and point-to-point communication modes under UDP, the DDS module in the RPA accords with DDS specifications, thereby supporting DDS communication, and the serial port communication module can support RS232 and RS422 communication.

As shown in fig. 2 and fig. 3, further, the DDM module is an intermediate layer of the UI module and the IO module, and is responsible for analyzing a data packet received from the IO module and then sending the data packet to the UI module for display, and meanwhile, receiving the operation of the UI module to generate corresponding data and sending the data by using the IO module, where the DDM module includes a data analysis module, an argument module, a data reorganization module, a data forwarding module and a data monitoring module; the data analysis module is used for receiving the data packet of the external communication system sent from the IO module, finding out a field for explaining the type of the data packet according to the analysis table, analyzing the data packet of the external communication system, sending the analyzed data to the data monitoring module and the UI module for display when the data conversion is not carried out, sending the analyzed data to the independent variable module for conversion when the data conversion is required, and introducing the analysis table through the data table or adding the analysis table to the operation interface of the UI module to describe the data type, the size and the meaning of each field of the received data; the independent variable module is used for defining constants or converting data analyzed in the data analysis module, the constant is defined by operating the independent variable module on an operation interface of the UI module, the constant is not defined when the data analysis module analyzes a data packet of an external communication system, when the data analyzed in the data analysis module needs to be converted, the type to be converted is input on the operation interface of the UI module, the operation information is sent to the independent variable module, after the independent variable module receives the operation information, the data analyzed in the data analysis module is converted and sent to the UI module for display, a more complex variable can be defined by using a python script, for example, the data analysis module has a length field len=1000 m, and when the data analyzed in the data analysis module needs to be converted into units, kmlen=len/1000 can be defined. Each time the value of len is changed, kmlen is changed, and the module can perform very flexible conversion according to the existing data, so that corresponding data of the data monitoring sub-module and the UI module are given; the data reconstruction module is used for configuring a data packet to be transmitted in a data table leading-in or adding form in an operation interface according to the operation interface information of the UI module, storing the configured data in the data reconstruction module, wherein the data packet to be transmitted comprises a field for explaining the type of the character data packet, and managing the data; the data forwarding module comprises a data forwarding table, wherein each table item comprises an ID of a UI operation event, an ID of a data packet to be sent and an IO communication plug-in for sending the data packet in the IO module, receives operation information about data sending of an operation interface of the UI module, inquires whether the ID of the data packet to be sent in the forwarding table is bound with a control operated by the operation interface of the UI module, if so, the data forwarding module acquires the data packet to be sent stored in the data reorganization module, and sends the data packet to be sent to the IO communication plug-in for sending the data packet in the IO module, and the data forwarding table is added through the operation interface of the UI module and is used for displaying deletion and addition of input information in the UI operation interface.

Further, the UI module comprises a plug-in module engineering module, wherein the plug-in module is used for providing various controls for the system in the form of plug-ins, including a system plug-in, an input plug-in, an output plug-in and an expansion plug-in; the system plugins provide commonly used controls, such as buttons; the expansion plug-in provides relatively more responsible controls including command line controls, clock controls, chart controls; the engineering module is used for creating an interface control container and laying out the controls, and the interface control container is divided into two sub-modules Layout_1 and Layout_2.Layout_1 is responsible for the outermost Layout and Layout_2 is responsible for the nested Layout.

As shown in fig. 2, the implementation further includes a use method adopting the rapid man-machine interaction application system, and the method includes:

s5, the DDM module sends the processed information data to the IO module;

s6, the IO module sends the received data to an external communication system.

The communication data refers to data received and transmitted by the external system and the embodiment through TCP, UDP, DDS or serial communication protocol.

Further, the data parsing in step S2 specifically means splitting the original data packet into specific data structures according to its fields, and assigning a corresponding value to each field of the structure, for example, the original data packet has a length field len=1000m, and it needs to be converted into units of km now, so kmlen=len/1000 can be defined, and each time the value of len changes, kmlen will change accordingly; and a special processing flow (such as transmission and calculation of longitude and latitude, and general use of integer shift for representing in order to maintain higher data accuracy) can be specified for the field, but when the field is displayed, the conversion back to the decimal form is more visual, and the DDM module can set the processing and automatically complete the conversion).

Further, in step S2, the data received by the DDM module is stored in the MySql database.

Further, the embodiment further includes a processor and a memory communicatively connected to the processor, where the memory stores instructions executable by the processor, where the instructions are executable by the processor to enable at least one processor to perform any operation or step of the rapid human-computer interaction application system and a method for using the same, where the common instructions, such as store, load and remove instructions, may store, load and remove corresponding pages, and preferably, the processor of the system employs a Corei7-12700 processor, and the memory employs a solid state disk of samsung 980PRO 1T.

Example 2

Embodiments of the present invention are described in connection with a UI configuration of chat software as follows:

IO creation and setting: as shown in fig. 4, an engineering is created in RPA software, a new IO button is clicked in a toolbar, a new IO dialog box simple chat tool is popped up, UDP is used for communication, a UDP plug-in is selected here, the next step is clicked, and an IO name setting dialog box is entered; as shown in fig. 5, inputting an IO name in the pop-up dialog box, clicking a completion button, and completing creation of the IO; as shown in fig. 6, selecting the newly created IO in the IO list, clicking the output setting button to set the IO for transmitting data, where an IP address and a port number for receiving data are set, and adding a data packet, where the data packet includes a type field for distinguishing the data content, and includes a message field for storing the message content, where the receiving and transmitting of the data packet are set in the following setting; as shown in fig. 7, the newly created IO is selected from the IO list, the output setting button is clicked, and the IO for transmitting data is set, and the output setting and the input setting are similar.

DMM parser, combiner creation and setup: as shown in fig. 8, clicking a new DDM parser button in a toolbar, inputting a DDM data parser name in a pop-up dialog box, clicking to determine that creation of a DDM parser is completed, the DDM parser being used for parsing received data, and converting an original data packet into a specific data structure; as shown in fig. 9, double-clicking the newly built DDM resolver in the left scene tree, automatically adjusting the scene to the DDM resolver page, and setting the resolver on the page; selecting IO for receiving data at an IO device, inputting a data packet name, clicking a storage button, associating a parser with the IO (after receiving the data, the IO module can forward the data to an associated DDM parsing module for data parsing), inputting a name in a variable name input box, selecting a data type and a byte order, clicking an addition button at the lower part, namely adding a corresponding data field, wherein a message number field and a content field are added, the number field is used for distinguishing the data packet, and the content field is used for storing chat messages; as shown in fig. 10, clicking a newly built DDM combiner in a toolbar, inputting a DDM combiner name in a pop-up dialog box, and clicking to determine that creation of the DDM combiner is completed; the DDM combiner is configured similarly to the parser as shown in fig. 11.

Interface creation and setting: as shown in fig. 12, the simple chat software includes two edit boxes, one for displaying a received message and the other for inputting a message to be transmitted, and further includes a send data button; clicking a new creation in the page management of the main interface toolbar, inputting a page name in a new creation page dialog box, clicking a determination button, and completing the creation of an interface; as shown in fig. 13, the created page node is double-clicked in the left scene tree, opening the page. Selecting a corresponding control in the right control list, dragging the corresponding control into a middle scene panel, and adding the corresponding control, wherein two editing frames and one button are added; as shown in fig. 14, a corresponding control is selected in the middle scene, the mouse is clicked right, an attribute is selected in the pop-up menu, and the color, text, size and the like of the control are set.

Binding of data and events: as shown in fig. 15, when the DDM parser and the combiner are created, the data table and the IO are bound, and the data table and the interface are also bound; opening a main interface, selecting an upper editing frame in the main interface, automatically filling an input port in a table by a data binding boundary surface, allowing an input value to be set by the editing frame, inputting msg in data, clicking a binding button, binding an msg field of a received message with the editing frame, and automatically displaying corresponding data by the editing frame when the value of the msg field is changed (the msg field is in a data analysis table and added); as shown in fig. 16, the output data binding is similar to the input data binding, the lower edit box is selected, and the output data binding is added in the data binding window; as shown in fig. 17, after the output data binding is completed, a forwarding event needs to be added, because the output data is only sent when the event triggers (for example, a sending button is clicked), a new creation is clicked in a DDM forwarding event page, an event name is input, and the creation of the event is completed; as shown in fig. 18, after the creation is completed, an event is set, so that the event and data to be transmitted are bound; finally, as shown in FIG. 19, the event needs to be bound to the UI control. Opening a main page, selecting a sending button, adding a binding in a lower event binding interface, and setting; and (3) finishing the operation, saving engineering and completing the configuration of chat software.

And (3) running: as shown in fig. 20, clicking an operation button in the toolbar operates chat software; as shown in fig. 21, a data transceiver (such as a UDP debug assistant) is used to communicate with the configured chat software, and the data transceiver is used to send messages, and the chat software receives and displays the data; as shown in fig. 22, a message is input in the lower input box, the send button is clicked, and the data transceiver tool receives the corresponding message.

The foregoing description of the preferred embodiments of the invention is not intended to be limiting, but rather is intended to cover all modifications, equivalents, and alternatives falling within the spirit and principles of the invention.

Claims

1. The rapid man-machine interaction application system comprises an IO module, and is characterized by also comprising a DDM module and a UI module,

the IO module is used for receiving a data packet from an external communication system and sending the data packet to the DDM module, and receiving the data packet from the DDM module and sending the data packet to the external communication system, wherein the data packet of the external communication system comprises a field for explaining the type of the data packet;

the UI module is used for displaying data and realizing man-machine interaction, adding a UI operation event and a data packet needing to be sent, sending the data packet needing to be sent to a data reorganization module in the DDM module, and sending the ID of the UI operation event and the ID of the data packet needing to be sent to a data forwarding module in the DDM module;

the DDM module comprises a data analysis module, a data reorganization module and a data forwarding module, wherein the data analysis module is used for receiving a data packet of an external communication system sent from the IO module, finding a field for explaining the type of the data packet according to an analysis table, analyzing the data packet of the external communication system, and then sending the analyzed data to the UI module for display;

2. The rapid human-computer interaction application system of claim 1, wherein the IO module comprises an IO communication plug-in interface, an IO communication plug-in, a TCP server module, a TCP client module, a UDP network communication module, a DDS network communication module, a serial port communication module,

the IO communication plug-in interface is used for calling the TCP server side module, the TCP client side module, the DDM module, the UDP network communication module, the DDS network communication module and the serial port communication module in a plug-in mode.

3. The rapid human-computer interaction application system of claim 1, wherein the DDM module further comprises an argument module for defining a constant and a conversion of data,

the definition constant is operated on the independent variable module at the operation interface of the UI module to finish the definition of the constant, the constant is not defined any more when the data analysis module analyzes the data packet of the external communication system, the data conversion is the data conversion after the analysis of the data analysis module according to the operation information of the operation interface of the UI module,

4. The rapid human-computer interaction application system of claim 1, wherein the DDM module further comprises a data monitoring module for displaying the names, types, and values of the data parsing module, the data reorganizing module, and the argument module in form of tables and curves in real time.

5. The rapid human-computer interaction application system according to claim 1, wherein the parsing table in the data parsing module is imported through a data table or added in an operation interface of the UI module, the data packet to be sent in the data reassembling module is added through the data table or in the operation interface of the UI module, and the data forwarding table in the data forwarding module is added in the operation interface of the UI module.

6. The rapid human-computer interaction application system of claim 1, wherein the UI module comprises a plug-in module and an engineering module,

7. A method for using the rapid human-computer interaction application system according to claim 1 to claim 6, comprising the steps of:

s5, the DDM module sends the processed information data to the IO module;

s6, the IO module sends the received data to an external communication system.

8. The method according to claim 7, wherein in step S2, the data parsing process refers to splitting the data received from the external communication system into specific data structures according to the fields thereof, and assigning corresponding values to each field of the structure.

9. The method according to claim 7 or 8, wherein in step S2, the DDM module parses the processed data and stores the parsed data in the MySql database.

10. A fast human-machine interaction application device comprising at least one processor and a memory communicatively coupled to the at least one processor, the memory storing instructions executable by the at least one processor to enable the at least one processor to perform any of the operations or steps of the system and method of use of the system of claims 1 to 9.