Detailed Description
The main and inventive features used in the present invention are described in detail below.
Intelligent identification
The identification is an object operated using a mouse or a keyboard. Including Windows, input boxes, pictures, buttons, etc., wherein the Windows can be divided into Windows and WEB controls.
The unit of the action parameter configuration is a program object operated by a mouse or a keyboard.
The smart token consists of a readable string containing index information for computer information objects such as mouse or keyboard operable information objects. Alternatively, the smart identification may be encrypted in the form of an unreadable string to facilitate protection of important, sensitive, confidential information.
Preferably, as shown in fig. 4, the smart tag at least includes a software program tag 11, an information object tag 12, and an information data tag 13. Preferably, the smart identification also includes random encoding or timing logic 14. Exe, the software program identifier 11 may be a name of a program, for example, Notepad, the information object identifier 12 may be a title and a type, for example, Edit11Notepad no-title-Notepad, the information data identifier 13 may be an attribute name or a main object name Notepad, the main object may be a parent object of a control, the timing logic 14 is, for example, T3R0Y, and is used for marking a time sequence of smart identifier generation, may be randomly generated, and has a timestamp function. Advantageously, the indicia are spaced apart by a connector character, such as a "+," space, "-" and combinations thereof. Similar component structures of the smart labels are also shown in fig. 5 and 6. FIG. 6 illustrates an intelligent identification of a WEB control, wherein the software program identification 11 is, for example, the name of a program main frame; the information object identification 12 is for example an ID of the object, possibly empty, and an object type, for example txtComb; the information data identifier 13 may be a web page object tag such as httpsearcnipr commarchaction.
More preferably, the intelligent identifier includes a software program identifier 11, an information object identifier 12, and an information data identifier 13, wherein the software program identifier 11 corresponds to an instantiated program file name, the information object identifier 12 corresponds to a control type of an instantiated program object, and the information data identifier 13 corresponds to control data of the instantiated program object. Further, the intelligent identifier further includes a parent control identifier, a control creating order, a control displaying order, and a control state of the instantiated program object, where the control state is, for example, a control size, an idle state, and the like.
It will be appreciated that the smart tag may take other forms, and as the internet of things and blockchain technology rapidly develop, more and more new information objects will appear in the computer system, and the smart tag composition specification used will likely differ from the above-described specification, with the point that the data objects can be conveniently indexed in the computer system.
As shown in fig. 3, one of the user interfaces of the intelligent motion configuration tool is used for the recognition of WINDOWS controls. The following is a brief description of the functionality of the user interface of the smart action configuration tool.
Compile button
This button is used to copy and release the contents in the configuration template (EXCEL file) to the database (MDB) of the official system. The configuration template and the system database file of each system are different.
Hand-shaped icon
Identification target determination: the mouse is moved over the hand icon. The left key is pressed and not loosened, and the mark target is moved. The range of the identified target is determined by the "blinking rectangular box".
Identify Range and Focus: the identification range is the granularity and accuracy of the identification. Moving the hand icon to the content that is desired to be identified, two flashing red boxes appear. Outside, the large red frame is the extent of the logo. The middle, small red frame is the focus of the logo. When the mouse and keyboard operation needs to be simulated through the interface, the focus has a particularly important meaning. Is the accepting place for inputting characters and mouse actions.
Coordinates are as follows: the horizontal and vertical coordinate values of the position of the mouse are indicated (the specific numerical value is displayed in the coordinate X value and the coordinate Y value). And the coordinate value of the upper left corner of the control is (0, 0). The coordinates are based on the magnitude of the distance marking range boundary (large red flashing rectangular box).
Interface integrated configuration:
and (3) main window: the first control which needs to enter the integrated interface is in the integrated platform. Right-clicking means that the composite frame is integrated.
And (4) sub-window: are other controls that make up the interface. Right-clicking means that the composite frame is integrated.
And (3) storage: all control parameters of the integrated interface are put into a system clipboard.
Suspension: the designated window is always hovered in front of the screen.
Not suspending: and canceling the floating state of the screen floating window.
Not shown are: the specified control is hidden.
Coordinates are as follows: the mouse position parameter is put into the system clipboard.
Area: by right clicking on the "end" button, a designated identification area (defined by the start and end points, note the web page identification, should have the web page process not maximized) can be pulled into the unified interface.
Business coordination configuration[ COMBINED FAST KEY ]
Fetching data: the data sources to be synchronized.
Collecting: and collecting characters at the designated position of the hand-shaped identification.
Copying: a keyboard copy action [ CTRL + C ] of the hand shape designation is performed.
Sticking: and according to the acquisition sequence, sequentially taking out the acquired data and placing the data on an interface at the position specified by the hand-shaped identifier.
Emptying: the collected data is emptied.
Universal configuration
Marking: a pass-through button. And putting the mouse position and the control identification data into a system clipboard.
Fingerprint: fingerprinting process of identifying focus. Two marking actions are required to complete the acquisition. The first time is to determine the command focus of the specified identity. The second time is to collect the characteristic values of the markers. A token may have multiple fingerprints. And collecting the color value of the specified position by right clicking.
Window: identification data of the top-level window is specified. Primarily in "automated integration" configurations. Right-clicking just sets the frame of the specified logo to the same size as the screen in width and height.
Encryption: and encrypting the control data, and putting the encrypted result into a system clipboard.
Screenshot: the interface specifying the window is intercepted (placed in the clipboard).
Environment: automated actions to prepare the environment for the system. [ in the basic edition, this function is absent ]. And right-clicking starts the system screen amplification function. The amplification function is turned on as CTRL + 4. CTRL + UP is amplification. CTRL + DOWN is small function.
An exit button: the configuration tool is exited.
Control information
The window type is as follows: the unique type identification of the window.
Window data: the title name of the window.
The window state is as follows: status data of the window.
Coordinate X value: the abscissa of the mouse click.
Coordinate Y value: ordinate of mouse click.
Program path: and the name of the file where the window is located.
Encryption processing: and carrying out encryption processing on the window data.
Intelligent action instruction
The smart action instruction is capable of extracting information data of the information object based on the smart identification of the information object, and the smart action instruction comprises an action instruction name 21 and an action instruction parameter 22, the action instruction parameter 22 comprising at least the smart identification 221.
Fig. 9 shows a window click command, the name 21 of the action command is "window click", the parameter 22 of the action command includes a smart identifier 221, preferably, the parameter 22 of the action command further includes a control coordinate 222 and a control state 223, and the control state 223 describes the size of the control, whether it is stable, such as whether it is loading or not, and whether it is maximized; where the first two numbers are control size, width and height, the last number is maximized, 0 is not maximized, 1 is maximized, and the corresponding action is to be performed in this state. The information object is a function object-a decision button, and the extracted corresponding information data is a "mouse click" function.
Fig. 10 shows a fetch instruction, the action instruction name 21 of which is "fetch", and the action instruction parameter 22 includes a smart identification 221. The information object is a data object-CPU usage, and the extracted corresponding information data is a "CPU usage percentage" value.
Fig. 11 shows a form integration instruction, that is, an interface integration action instruction, which can integrate forms from two different programs together and includes a main form instruction and a sub-form instruction, where the action instruction name 21 of the main form instruction is "main form", and the action instruction parameter 22 includes an intelligent identifier 221, a control coordinate 222, and a control state 223, where two control coordinates 222 have an upper left corner and a lower right corner determined as a control, respectively. The information object is an interface object, namely a WPS document editing window, and the extracted corresponding information data has all functions of the WPS document editing window. The action command name 21 of the sub-window command is 'sub-window', the information object is an interface object-CHROME network browser window, and the extracted corresponding information data is all functions of the 'CHROME network browser window'.
Fig. 12 shows a mouse click instruction, the name 21 of which is "mouse command", the parameter 22 of which includes the smart identifier 221, and also includes the coordinates 222 of the control, the state 223 of the control, the specific instruction 224, and the comment 225, the information object is the function object- "open" button, and the corresponding information data extracted is the "mouse click" function.
It will be appreciated that depending on the different types and functions of the smart action instruction, the action instruction parameters 22 may include specific parameters, such as the specific instructions 224 and comments 225 of fig. 12, in addition to the smart identification 221.
Heterogeneous information fusion and deduction device
The heterogeneous information fusion deduction device at least comprises a system data constant, a memory variable, a check value, an assignment statement, a condition statement, a cycle statement and a plurality of intelligent action statements; each intelligent action statement comprises an intelligent action name and an intelligent action parameter; the intelligent action instruction corresponds to an intelligent action statement in the heterogeneous information fusion deduction device, the action instruction name of the intelligent action instruction corresponds to the intelligent action name of the corresponding intelligent action statement, and the action instruction parameter of the intelligent action instruction corresponds to the intelligent action parameter of the corresponding intelligent action statement.
System variable assignment
In system action, there are three system variables that can be used.
1. System data constants. Except for the condition and the loop statement, the system can automatically put the identified data into the system data constant.
For example, system data constants are overridden. That is, the next system data constant value will be assigned to the last system data constant value.
The system also provides three system data constants: a first system data constant, a second system data constant, and a third system data constant. Can be used to save values in the memory variables.
The name of a system data constant is a system reserved word. Three system data constants are open for use by the user.
Table 1: example of assignment of System data constants
The externally configured characters: and 120, putting the system data constant into the system.
2. The memory variable, i.e. the temporary class variable, may put the identification value and the system data constant into the memory variable. The memory variable is overriding. That is, the value of the next memorized variable will be added to the value of the last memorized variable.
Table 2: memory variable assignments are shown in the following table:
table 3: another example of remembering variable assignments
3. And the check value can be used for amplifying the identification value and the system data constant to the check value. The check values are accumulated. The "clear check value" command is used before use.
Table 4: check value assignment examples
Preferably, the heterogeneous information fusion deduction further comprises the following system variables:
4. data pick-up variables
A set of data cache variables.
5. Accumulated data variables
A set of data cache variables. Mainly for the formation of one record.
6. Counter with a memory
A counter variable.
7. Merging variables
A set of merging variables. One of the data record set forming commands
8. Web page memory variable
The web page objects are memorized, and the total number of the web page objects is three, namely, the web page object 1_ memory, the web page object 2_ memory and the web page object 3_ memory.
The action command of 'WEB _ memory identification data' is also to store data into a memory variable.
Examples of assignments of the above system variables are not described in detail.
Loop execution statements
1. Counting loop statements
Count cycle start, cycle specified number of times from 0:
table 5: programming code examples for counting loop statements
|
|
Start of counting cycle |
20 |
|
Note that: starting with 1 (counter clear) and looping to 20, the step size is 1. |
Obtaining characters |
1234 |
|
|
End of cycle |
End of cycle |
2. Conventional loop statements
The system executes from "loop start" to "loop end". The exit loop command is processed at the end of the loop. A total of 20 nested loops are supported.
The conditional predicate statements also support less than 20 levels of nesting predicate.
Table 6: conventional Loop statements example
Even when the loop is entered for the first time, "start execution [ system data constant equal ]", i.e., system data constant equal to "REC _ END", is met. The following will still be performed.
Table 7: executed statement
The reason is that the "exit loop" command is only valid at the "end of loop".
Conditional execution statement
1. Identifying the presence of a begin execution statement
May be performed without the interface being visible. When the mark is designatedExist ofUntil the parameter area between the "end of condition" commands is executed. If the specified identity is not present, the parameter area between up to the "end of condition" command is ignored.
The action parameter formed by two buttons of 'identification' and 'fingerprint' in the identification configuration program is referred to herein. Identification refers primarily to elements in a window application. Or may be a web page that acts as a window. Table 8: program code examples for conditional execution statements
2. Identifying absence of a begin execution statement
May be performed without the interface being visible. When the mark is designatedIs absent fromUntil the parameter area between the "end of condition" commands is executed. If the specified identity exists, the parameter area between up to the "end of condition" command is ignored.
The action parameter formed by two buttons of 'identification' and 'fingerprint' in the identification configuration program is referred to herein.
Table 9: program code examples for conditional execution statements
3. Starting execution of a [ data value equals ] statement
May be performed without the interface being visible. When the data value of the specified identity is equal to the configuration value, the parameter area between up to the "end of condition" command is executed.
As shown in FIG. 3, the data values of the specified identifiers are displayed in the "window data" of the configuration tool at configuration time.
The program code thereof is shown in the following table, for example.
The data values are arranged in the fourth identified row.
Table 10: program code examples for conditional execution statements
4. Begin execution of [ data value not equal ] statement
May be performed without the interface being visible. When the specified identified data value is not equal to the configuration value, the parameter region between up to the "end of condition" command is executed. If the specified identification data value is equal to the configuration value, the parameter area up to the "end of condition" command is ignored.
Table 11: program code examples for conditional execution statements
Preferably, the heterogeneous information fusion deduction further comprises the following conditional execution statements.
5. Begin execution of [ data value greater than ] statement
May be performed without the interface being visible. When the specified identified data value is greater than the configuration value, the parameter region between up to the "end of condition" command is executed. If the specified identification data value is not greater than the configuration value, the parameter area up to the "end of condition" command is ignored.
6. Begin execution of [ data value less ] statement
May be performed without the interface being visible. When the data value of the specified identity is less than the configuration value, the parameter area between up to the "end of condition" command is executed. If the specified identification data value is not less than the configuration value, the parameter area up to the "end of condition" command is ignored.
7. Begin execution of [ system data constant greater than ] statement
May be performed without the interface being visible. When the system data constant is greater than the configuration value, the parameter region between up to the "end of condition" command is executed.
8. Begin execution of [ system data constant less ] statement
May be performed without the interface being visible. When the system data constant is less than the configuration value, the parameter region between the commands up to the 'end of condition' is executed.
9. Starting to execute [ system data constant contains no words ] statement
May be performed without the interface being visible. When the system data constants do not contain configuration values, the parameter region between up to the "end of condition" command is executed.
10. Begin execution of [ system data constant contains words ] statement
May be performed without the interface being visible. When the system data constants contain configuration values, the parameter region between up to the "end of condition" command is executed.
The following is a conditional execution statement related to memory identification data
May be performed without the interface being visible. The specified identification data is memorized.
Mainly used in cyclic action.
11. Starting execution of [ memory identification data equals ] statement
May be performed without the interface being visible. When the memorized identification data value is equal to the configuration value, the parameter area up to the "end of condition" command is executed.
Mainly used in cyclic action.
12. Starting execution of [ memory identification data not equal ] statement
May be performed without the interface being visible. When the remembered identification data value is not equal to the configuration value, the parameter region between up to the "end of condition" command is executed.
Mainly used in cyclic action.
13. Begin execution of [ memory check value equals ] statement
May be performed without the interface being visible. When the memorized check data value is equal to the configuration value, the parameter area up to the "end of condition" command is executed.
Mainly used in cyclic action.
14. Begin execution of [ memory check value not equal ] statement
May be performed without the interface being visible. When the memorized check data value is not equal to the configuration value, the parameter area up to the "end of condition" command is executed.
Mainly used in cyclic action.
15. Begin execution of [ memory color not equal ] statement
May be performed without the interface being visible. When the remembered identification color value is not equal to the configuration value, the parameter region between up to the "end of condition" command is executed.
Mainly used in cyclic action.
16. Begin execution of [ memory color equals ] statement
May be performed without the interface being visible. When the remembered identification color value is equal to the configuration value, the parameter region between up to the "end of condition" command is executed.
Mainly used in cyclic action.
17. Begin execution of [ memory system data constant equals ] statement
May be performed without the interface being visible. When the memorized constant value of system data is equal to the configuration value, the parameter region between up to the "end of condition" command is executed.
Mainly used in cyclic action.
18. Begin execution of [ memory system data constant not equal ] statement
May be performed without the interface being visible. When the memorized constant value of the system data is not equal to the configuration value, the parameter region between the commands up to the "end of condition" is executed.
Mainly used in cyclic action.
19. Begin execution [ record key field equals ] statement
May be performed without the interface being visible. When the recording key field data value is equal to the configuration value, the parameter area up to the "conditional end" command is executed.
20. Start execution of [ record key field not equal ] statement
May be performed without the interface being visible. When the record key field data value is not equal to the configuration value, a parameter area up to the "conditional end" command is executed.
21. Start execution of [ record key field greater ] statement
May be performed without the interface being visible. When the recording key field data value is greater than the configuration value, the parameter area up to the "conditional end" command is executed.
22. Start execution [ record key field less ] statement
May be performed without the interface being visible. When the recording key field data value is smaller than the configuration value, the parameter area up to the "conditional end" command is executed.
Action instruction configuration file
The content recorded in the action instruction configuration file is a computer program source code text written according to the language specification of the heterogeneous information fusion encoder, and can be stored in a permanent storage medium, such as a mechanical hard disk, a solid state disk SSD, a DVD optical disk, a Blu-ray optical disk and the like.
The action instruction profile may be modified in a text editor, such as a notepad in the Windows operating system, or WORD WORD processing software. Preferably, the action instruction configuration file is saved as a document format of an EXCEL spreadsheet.
Example source code samples for an action Command Profile the following table downloads bibliographic information from the patent information service platform (http:// search. CNIPR. com/pages! advsearch. action) for three patent documents CN201410353876.4, CN200520061009.X, CN200520104819.9 and displays or pushes this information data to a third party website.
Table 12: source code example sample of action instruction profile
Wherein, lines 1-7: intelligent action instruction: and opening a high-level retrieval webpage of the patent retrieval website. A conditional statement is used, [ identify there is no start execution ] … … [ conditional end ]. And intelligent action statements and WEB _ new windows are also used. The execution of the smart action instruction is such that: if the CHROME browser does not open the high-level retrieval webpage, executing a WEB _ new window and opening the high-level retrieval webpage; if so, the "WEB _ New Window" is not executed.
Code line 8: the empty row, the action name column and the action parameter column are all empty rows, indicating that the statement is finished. Thus, two columns of code that are simultaneously empty correspond to a statement separator, e.g., a semicolon in C language "; ", is used to identify the end of the statement.
Lines of code 9-10: intelligent action instruction: information object positioning mode setting, buttons, data.
Lines of code 12-20: intelligent action instruction: and clicking the determined button to operate.
Code line 22: intelligent action instruction: and acquiring intelligent identification of the webpage elements.
Lines of code 24-70: intelligent action instruction: the user logs in and enters the advanced search web page.
Line of code 72: intelligent action instruction: and acquiring intelligent identification of the webpage elements.
Lines of code 74-75: intelligent action instruction: the search expression is set, see fig. 22.
Code line 77: intelligent action instruction: and acquiring intelligent identification of the webpage elements.
Code line 79: intelligent action instruction: the full search data range is selected, see FIG. 22.
Code line 81: intelligent action instruction: click the search button.
Code line 83: intelligent action instruction: wait 10000 time units.
Code line 85: intelligent action instruction: and acquiring intelligent identification of the webpage elements.
Lines of code 87-102: intelligent action instruction: taking information: acquiring the retrieved patent bibliographic project information; integrating information: and displayed in the operating system or pushed to the instantiated converged end software program for use, e.g.http:// 192.168.3.19/cyipr/service/paten。
Line of code 104: intelligent action instruction: and closing the current window, and finishing information acquisition and information integration.
Action instruction deduction document
The action instruction deduction file is an intermediate code or an executable file generated by the action instruction configuration file through the heterogeneous information fusion deduction device in a deduction mode, and the speed of data acquisition and data integration is improved. The action instruction deduction file in the intermediate code form can be used for explaining and executing the action series in the action instruction deduction file in the operating system by an explaining and executing module of the heterogeneous information fusion system. The action instruction deduction file in the form of an executable file may be run directly in the computer operating system.
The action instruction deduction file can be saved in a permanent storage medium, such as a mechanical hard disk, a Solid State Disk (SSD), a DVD optical disk, a Blu-ray optical disk and the like.
Based on the above technical design ideas and technical implementation, according to a first specific embodiment of the information collection system of the present invention, the information collection system is configured to collect source information data of a source information object in an instantiated source-side software program, and the source information data can be used by an instantiated fusion-side software program, wherein the instantiated source-side software program is a computer operating system or a third-party application program, the source information object is one of a source data object, a source interface object, and a source function object corresponding to one of hardware resources of the operating system, software resources of the operating system, hardware resources of the third-party application program, or software resources of the third-party application program, and the source information data is a data value of the source data object, an interface identifier of the source interface object, and a data value of the source information object, Or the function identifier of the source function object, wherein the instantiated fusion end software program is a computer operating system, the information acquisition system or a third-party application program.
The source-side software program refers to an instantiated computer operating system or a third-party application program for collecting information, and as shown in fig. 15 and 16, the Window task manager is an instantiated source-side software program, which is a system program belonging to the computer operating system. The EXCEL spreadsheet program may also be a source-side software program, belonging to a third party application.
In this document, the computer operating system is the first party, the specific embodiment of the information collecting system of the present invention is the second party, and other software programs not belonging to the computer operating system are third party application programs.
The source information object refers to an instantiated program object for collecting information in an instantiated source software program, and can be divided into three types: data objects, interface objects, function objects.
The data object refers to a program object capable of providing digital, text and binary data, for example, the CPU utilization of the Window task manager shown in fig. 15 and 16 is the data object, the value attribute is the source information data to be collected, for example, 33% shown in fig. 16, and the form in the EXCEL spreadsheet program can also become the data object. Documents in WORD processing software may also be data objects.
The interface object refers to a program object which has a visual interface and can show program functions through the interface, for example, fig. 14 shows that the WORD program interface and the CHROME browser program interface are integrated together, wherein, the main form of the WORD program is the interface object which has all functions of the WORD program; the main window of the CHROME browser is also an interface object.
The function object refers to a program object that can realize a specific function in an application program, and for example, a button in a WINDOWS program is a typical function object.
Accordingly, the source data object, the source interface object, and the source function object refer to information objects to be acquired by information.
The information data refers to data to be extracted from the information object, for example, the value attribute of the CPU utilization rate of the Window task manager is the information data, and the information data is the information data of the data object; the window handle of the main window of the WORD program is information data which is information data of an interface object, and the main window of the WORD program can be operated through the window handle; the event identifier or event name of the menu item or button of the WORD program is information data, and is information data of the function object, and the event action can be triggered by the event identifier or event name.
Accordingly, the source information data refers to information data of an instantiated source information object of an instantiated source-side software program that is collected, which can be used for an instantiated convergence-side software program.
Program objects may be understood in an object oriented programming language such as C + +, which is where a software program has properties and method classes or structures, and where the software program is running, of course, where the program object is an instantiated class object or structure object.
It is understood that the hardware resources of the operating system, the software resources of the operating system, the hardware resources of the third party application, or the software resources of the third party application correspond to a specific program object, i.e., information object, in the computer. Such a correspondence is clearly shown in the Net Framework library from microsoft corporation. Io namespace contains types with the following functions: hardware devices that support input and output, such as serial ports, which are hardware resources; and the system io compression namespace contains classes that provide basic stream compression and decompression services, which belong to software resources.
The resources of the software program are divided into four classes, each of which has three information objects, for a total of twelve information objects, shown in the following list.
Table 13: primary source information objects operable with the information acquisition system of the present invention
However, unlike the way in which information objects are manipulated by programs written in a general-purpose computer language, in programs written in a general-purpose computer language, program objects need to be declared and instantiated in the program. In the invention, the intelligent action instruction directly manipulates the program object which is already instantiated by the operating system or the third-party application program, and the program object or the information object does not need to be declared and instantiated in the action instruction configuration file of the invention. Furthermore, the present invention identifies instantiated program objects by mouse and keyboard, which is different from the programming of mouse and keyboard operations in programs written in general computer languages and requires a higher knowledge of the inherent business logic of the software program being manipulated. The information acquisition system can identify and extract instantiated program objects in the manipulated software program through a mouse and a keyboard without the cooperation of related providers of the manipulated software program and knowing the internal structure of the manipulated software program.
Therefore, the information acquisition system comprises an intelligent action configuration tool, an action instruction configuration file, a heterogeneous information fusion deduction device and an action instruction deduction file. It will be appreciated that figures 3, 7, 8 show user operated interfaces of the intelligent action configuration tool. Table 12 above shows the complete action instruction profile. The "deduction" button in fig. 3 may activate the heterogeneous information fusion deduction to deduct the action instruction configuration file into an action instruction deduction file.
The intelligent action configuration tool can configure corresponding intelligent action instructions for the source information data, and the intelligent action configuration tool comprises: the intelligent action system comprises an information object marking module, an intelligent identification generating module and an intelligent action instruction compiling module.
And the information object marking module marks the instantiated source information object in a mouse click or keyboard input mode. It will be appreciated that, as shown in FIG. 15, clicking the "identify" button on the user interface of the smart motion configuration tool with the mouse and then selecting the "CPU usage" data object with the mouse causes the associated attribute information to be identified on the user interface of the smart motion configuration tool, including, for example and without limitation, window data, window state, coordinate values, and the like.
It will be appreciated that one skilled in the art can implement the marking of the instantiated source information object by way of mouse click or keyboard entry in accordance with the prior art. For example, the C # source code that obtains the handle to the form by mouse clicking is as follows:
as another example, the following code can capture mouse and keyboard actions of a control to facilitate identification of the control.
It can be understood that the information object marking module may also be a technical solution disclosed in another patent application by the applicant. Alternatively, the information object marking module may be a technical solution disclosed in another patent application by another applicant in the future. The key point is that the technical scheme of the existing or future information object marking module can be used in the information acquisition system or the heterogeneous information fusion system.
Further, it will be apparent to those skilled in the art that by obtaining a handle to a form control, all properties, methods, and events of the form control can be obtained accordingly. Thus, it is possible to label program control objects such as data objects, interface objects, function objects. It will be appreciated that the smart label of the control object is typically a combination of various property values of the control object, and thus, one skilled in the art can generate a unique smart identification for the control object accordingly.
The intelligent identification generation module can generate an intelligent identification of the information object, wherein the intelligent identification at least comprises a mark of the source-side software program, a mark of the source information object and a mark of the source information data. As shown in fig. 15, clicking the "id" button on the user interface of the smart motion configuration tool with the mouse, and then selecting the "CPU utilization" data object with the mouse, the smart id of the information data of the data object can be generated and copied to the clipboard. As shown in fig. 16, the smart identification is copied to row 3, column 2 of the action instruction profile. FIG. 3 illustrates one of the user interfaces of the intelligent motion configuration tool for the identification of WINDOWS controls; fig. 7 shows a second user interface of the intelligent action configuration tool for WEB control identification. As described above, those skilled in the art can combine the attribute values of the instantiated source software program and the instantiated source information object to generate the corresponding intelligent identifier through computer programming.
It can be understood that the intelligent identification generation module may also be a technical solution disclosed in another patent application by the applicant. Alternatively, the intelligent identification generation module may also be a technical solution disclosed in another patent application by another applicant in the future. The key point is that the technical scheme of the existing or future intelligent identification generation module can be used in the information acquisition system or the heterogeneous information fusion system.
The intelligent action instruction compiling module can compile intelligent action instructions according to the language specification of the heterogeneous information fusion deduction device, the intelligent action instructions comprise action instruction names and action instruction parameters, and the action instruction parameters at least comprise the intelligent identification; the smart action instructions can be saved to the action instruction profile. It will be appreciated that the third user interface of the intelligent action configuration tool shown in fig. 8 is used to generate code templates of statements of various intelligent action instructions or heterogeneous information fusion deductiors, and then to copy the code templates to the action instruction configuration file, which is beneficial to improve the accuracy and speed of writing intelligent action instructions. With reference to the intelligent auxiliary programming functionality implemented by the Visual Studio 2015 computing programming environment, one skilled in the art can program the intelligent action instruction writing module.
It can be understood that the intelligent action command writing module can also be a technical solution disclosed in another patent application by the applicant. Alternatively, the intelligent action instruction writing module can also be a technical solution disclosed in another patent application by another applicant in the future. The key point is that the technical scheme of the existing or future intelligent action instruction writing module can be used in the information acquisition system or the heterogeneous information fusion system.
The action instruction configuration file is in the form of a data list and at least comprises two data columns: action name, and action parameters; the action command name of the intelligent action command is stored in an action name data column of the command configuration file, and the action command parameter used by the intelligent action command is stored in an action parameter data column of the command configuration file; the content format of the action instruction configuration file conforms to the language specification of the heterogeneous information fusion deduction device. Preferably, the action instruction profile is saved as an EXCEL spreadsheet document in WPS or Microsoft Office. Optionally, the action instruction configuration file is saved in a tabular form in a Word document in WPS or Microsoft Office. A sample of the action instruction profile is shown in table 12, which may also include an annotation column or a row number column.
The heterogeneous information fusion deduction device at least comprises variables, assignment statements, conditional statements, loop statements and a plurality of intelligent action statements; the intelligent action statement comprises an intelligent action name and an intelligent action parameter; the intelligent action instruction corresponds to an intelligent action statement in the heterogeneous information fusion deduction device, the action instruction name of the intelligent action instruction corresponds to the corresponding intelligent action statement name, and the action instruction parameter of the intelligent action instruction corresponds to the corresponding intelligent action statement parameter. The details of the heterogeneous information fusion deduction device are referred to above, or referred to a user manual and a programming guide of the heterogeneous information fusion system. It is understood that the smart action command and the smart action statement may have a one-to-one correspondence relationship, for example, a "window click" smart action command shown in fig. 9, and also a smart action statement of a heterogeneous information fusion deduction device, where action command names correspond to action statement names one to one, and action command parameters correspond to action statement parameters one to one. Such one-to-one correspondence of action instructions and action statements is also shown in fig. 10-13. The smart action instructions may include a plurality of smart action statements, i.e., a set of smart action statements, in table 12, lines 1-7 of code are the smart action instructions executed on a condition: and opening a high-level retrieval webpage of the patent retrieval website. It includes conditional statements, [ identify no start execution exists ] … … [ condition end ], and intelligent action statements, WEB _ New Window. Because, it can be considered or set as follows: the name of the intelligent action instruction corresponds to the name of a key intelligent action statement in the intelligent action statement group, the parameter of the intelligent action instruction corresponds to the parameter of the key intelligent action statement in the intelligent action statement group, and the key intelligent action statement in this example is a WEB _ new window. It will be appreciated that, as described above, the variables of the heterogeneous information fusion deduction have many kinds, such as system data constants, memory variables, and check values, which are instantiated variables that need not be declared in the action instruction deduction file, but may be used directly as assignments. For example, the get literal assignment statement in table 1 assigns 120 a value to a system data constant. The heterogeneous information fusion deduction can be implemented by a person skilled in the art with reference to prior art computer C + +, C #, or implemented according to the technical solution described below.
The action instruction deduction file is formed by deducting the action instruction configuration file by the heterogeneous information fusion deduction device. It will be appreciated that the action instruction deduction file may be in the form of readable text, or in the form of unreadable intermediate code or machine code or binary data, the format of which is not within the scope of the present invention and therefore not described in detail herein.
The information acquisition system acquires information in the following way:
marking the instantiated source information object with the aid of an information object marking module of the smart action configuration tool. As shown in FIG. 15, the instantiated source information object "CPU usage" is marked "
Generating a smart identification of the instantiated source information object by means of a smart identification generation module of the smart action configuration tool. As shown in fig. 16, a smart token 22 of the instantiated source information object "CPU usage" is generated.
Writing a smart collection action instruction of the instantiated source information object by means of a smart action instruction writing module of the smart action configuration tool, wherein the smart collection action instruction is capable of extracting source information data of the instantiated source information object based on the smart identification of the instantiated source information object. As shown in fig. 16, the complete smart collection action instruction 122 consists of four statements: and opening a data engine, fetching data, displaying a system data constant and closing the data engine. The smart collection action instruction 122 corresponds to the key statement "fetch data".
And saving the intelligent action instruction into an action instruction configuration file. As shown in FIG. 16, the smart action instructions are saved in the EXCEL spreadsheet document.
And deducing the action instruction configuration file into an action instruction deduction file by means of the heterogeneous information fusion deduction device. It will be appreciated that the action instruction deduction file may be in the form of a Microsoft Access database document, facilitating interpretation by the information collection system of execution of the action instruction deduction file. The action instruction deduction file may also be in the form of intermediate code, for example, executed under control of a computer operating system.
And executing the action instruction deduction file, and extracting the source information data of the instantiated source information object. As shown in fig. 16, the action instruction deduction file is interpreted and executed by the information collection system, and the source information data is displayed in a pop-up window "configuration tool" 124 of the information collection system by a "display system data constant" action statement.
The technical scheme of the information acquisition system realizes the technical effect of acquiring the source information data without knowing the basic architecture and the internal details of the information source terminal software program, and can be repeatedly used after the action instruction configuration file is written, thereby greatly improving the information acquisition efficiency.
Preferably, the variables include system data constants, memory variables, check values, as described above. They are instantiated variables that can be used directly in value assignment in the action instruction configuration file without declaration, as shown in table 1.
Preferably, as shown in fig. 4 and 5, the smart label also includes random encoding or timing logic 14. The configuration can ensure the uniqueness of the intelligent identification and is beneficial to an information acquisition system to quickly search the intelligent identification.
Based on the first embodiment and its modifications, according to the second embodiment of the information collection system, the information collection system can collect multiple source information data of the same instantiated source information object in the same instantiated source software program in a manner of replacing the collected information of the first embodiment with the following collected information:
writing an I _ J _ K intelligent source acquisition action instruction of Kth source information data of a J-th source information object in an I-th source-end software program by means of the intelligent action configuration tool, wherein I, J, K are positive integers which are more than or equal to 1,
writing an I _ J _ L intelligent source acquisition action instruction of the L-th source information data of the J-th source information object in the I-th source end software program by means of the intelligent action configuration tool, wherein L is a positive integer greater than or equal to 1, and K is not equal to L, and the L-th source information data is used for acquiring the L-th source information data of the J-th source information object in the I-th source end software program;
all the intelligent source acquisition action instructions are stored in the action instruction configuration file;
deducting the action instruction configuration file into the action instruction deduction file by means of the heterogeneous information fusion deduction device;
and executing the action instruction deduction file to complete all the source information data acquisition.
It can be understood that, by means of the intelligent action configuration tool, an I _ J _ K intelligent source collection action instruction of a kth source information data of a jth source information object in an ith source-side software program is written, which is specifically referred to the first embodiment, and the jth source information object is marked by means of an information object marking module of the intelligent action configuration tool; generating a smart identification of the jth source information object by means of a smart identification generation module of the smart action configuration tool; and writing an I _ J _ K intelligent source acquisition action instruction of the Kth source information data of the J-th source information object by means of an intelligent action instruction writing module of the intelligent action configuration tool.
For example, the 1 st source information data of the 1 st source information object in the 1 st source-side software program is collected, where I is 1, J is 1, and K is 1, where the 1 st source-side software program is, for example, an EXCEL application, the 1 st source information object is Worksheet1, and the 1 st source information data is Worksheet1.cell (1,1), and according to the information collection system of the present invention, a code corresponding to the 1 st _1_1 intelligent source collection action instruction can be conveniently written.
The method comprises the steps of collecting 2 nd source information data of a 1 st source information object in a 1 st information source terminal software program, wherein L is 2, and the 2 nd source information data is Worksheet1.cell (1, 2).
And storing the code corresponding to the 1 st _1 st intelligent source acquisition action instruction and the code corresponding to the 1 st _2 st intelligent source acquisition action instruction in an action instruction deduction file, and executing after deduction so as to acquire the two source information data.
To sum up, the 3 rd source information data is Worksheet1.cell (1,3), and the 1 st _3 rd intelligent source collects codes corresponding to the action instructions; … …, respectively; the L source information data is Worksheet1.cell (1, L), and the 1_1_ L intelligent source collects codes corresponding to action instructions, wherein L is more than 3; and storing codes corresponding to all the intelligent energy collection action instructions in an action instruction deduction file, and executing after deduction so as to collect the multiple source information data.
Based on the first embodiment and its modifications, according to the third embodiment of the information acquisition system, the information acquisition system can acquire different source information data of different instantiated source information objects in the same instantiated source software program by replacing the information acquisition mode of the first embodiment with the following information acquisition mode:
writing an I _ J _ K intelligent source acquisition action instruction of Kth source information data of a J-th source information object in an I-th source-end software program by means of the intelligent action configuration tool, wherein I, J, K are positive integers which are more than or equal to 1,
writing an I _ M _ N intelligent source acquisition action instruction of Kth source information data of an Mth source information object in an I source end software program by means of the intelligent action configuration tool, wherein M, N are positive integers which are more than or equal to 1, and M is not equal to J, and collecting the Nth source information data of the Mth source information object in the I source end software program,
all the intelligent source acquisition action instructions are stored in the action instruction configuration file;
deducting the action instruction configuration file into the action instruction deduction file by means of the heterogeneous information fusion deduction device;
and executing the action instruction deduction file to complete all the source information data acquisition.
As shown in fig. 15 and 16, the 1 st source information data of the 1 st source information object in the 1 st source software program is collected, where I is 1, J is 1, and K is 1, the 1 st source software program is, for example, a Windows task manager, the 1 st source information object is a CPU usage window object, and the 1 st source information data is an attribute value, namely, a CPU usage percentage value, according to the information collection system of the present invention, a code corresponding to the 1 st _1_1 smart source collection action instruction can be conveniently written.
The method comprises the steps of collecting 1 st source information data of a 2 nd source information object in a 1 st source end software program, wherein M is 2, L is 1, the 2 nd source information object is a memory window object for example, and the 1 st source information data is an attribute value memory usage amount numerical value.
And storing the code corresponding to the 1 st _1 st intelligent source acquisition action instruction and the code corresponding to the 1 st _2 st _1 st intelligent source acquisition action instruction in an action instruction deduction file, and executing after deduction so as to acquire the two source information data.
In an expanded way, the 1 st _3 st _1 st intelligent source collects codes corresponding to the action instructions; … …, respectively; collecting a code corresponding to the action instruction by a 1_ M _ N intelligent source, wherein M is greater than 3, and N is greater than 1; and storing codes corresponding to all the intelligent energy collection action instructions in an action instruction deduction file, and executing after deduction so as to collect the multiple source information data.
Based on the first specific embodiment and its modifications, according to the fourth specific embodiment of the information acquisition system, the information acquisition system can acquire different source information data of different instantiated source information objects in different instantiated source-side software programs in a manner of replacing the acquisition information of the first specific embodiment with the following acquisition information manner:
writing an I _ J _ K intelligent source acquisition action instruction of Kth source information data of a J-th source information object in an I-th source-end software program by means of the intelligent action configuration tool, wherein I, J, K are positive integers which are more than or equal to 1,
writing an O _ P _ Q intelligent source acquisition action instruction of Q < th > source information data of a P < th > source information object in an O < th > source-end software program by means of the intelligent action configuration tool, for acquiring the Q < th > source information data of the P < th > source information object in the O < th > source-end software program, wherein O, P, Q are positive integers which are all greater than or equal to 1, and O is not equal to I,
all the intelligent source acquisition action instructions are stored in the action instruction configuration file;
deducting the action instruction configuration file into the action instruction deduction file by means of the heterogeneous information fusion deduction device;
and executing the action instruction deduction file to complete all the source information data acquisition.
As shown in fig. 15 and 16, the 1 st source information data of the 1 st source information object in the 1 st source software program is collected, where I is 1, J is 1, and K is 1, the 1 st source software program is, for example, a Windows task manager, the 1 st source information object is a CPU usage window object, and the 1 st source information data is an attribute value, namely, a CPU usage percentage value, according to the information collection system of the present invention, the code 122 corresponding to the 1 st _1_1 smart source collection action instruction can be conveniently written.
Referring to table 12, the 1 st source information data of the 1 st source information object in the 2 nd source-side software program is collected, where O is 2, P is 1, and L is 1, the 2 nd source-side software program is a CHROME browser, the 1 st source information object is, for example, a patent bibliographic information WEB control object as shown in fig. 28, and the 1 st source information data is bibliographic item information of 3 patents, according to the information collection system of the present invention, a code corresponding to the 2 nd _1 st intelligent source collection action command can be easily written, as shown in table 12, and there are 104 lines in total.
FIGS. 17-27 illustrate this code writing process, wherein FIG. 17 shows the third user interface of the intelligent action configuration tool-visual quick configuration form, which is used to help write WEB _ New Window action statements;
FIG. 18 illustrates the writing process of a conditional statement;
FIG. 19 shows a writing process of a conditional statement;
FIG. 20 illustrates a authoring process for a WEB _ click Smart action instruction;
FIG. 21 shows a authoring process of a WEB _ Set intelligent action instruction;
FIG. 22 illustrates a second user interface of the intelligent action configuration tool-heterogeneous system integration-WEB plug-in that facilitates identification and generation of an intelligent identifier that displays the source information data "search expression";
FIG. 23 illustrates the intelligent identification of "search expressions" in an action instruction profile;
FIG. 24 illustrates an example of a smart identification of "retrieve button";
FIG. 25 illustrates the intelligent identification of a "retrieve button" in an action instruction profile;
FIG. 26 illustrates a authoring process for a pick data purge smart action instruction;
fig. 27 shows an identification button of a second user interface of the intelligent action configuration tool for performing the generation and display of the intelligent identification.
And storing the code corresponding to the 1 st _1 st intelligent source acquisition action instruction and the code corresponding to the 2 nd _1 st intelligent source acquisition action instruction in an action instruction deduction file, and executing after deduction so as to acquire the two source information data.
In an extension, the 3_1_1 st intelligent source collects codes corresponding to the action instructions; … …, respectively; acquiring a code corresponding to the action instruction by an O _ P _ Q intelligent source, wherein O > is 3, P > is 1, and Q > is 1; and storing codes corresponding to all the intelligent energy collection action instructions in an action instruction deduction file, and executing after deduction so as to collect the multiple source information data.
Based on the first embodiment and its modifications, according to a fifth embodiment of the information acquisition system, the source information data is acquired cyclically in a manner of replacing the acquisition information of the first embodiment with the acquisition information as follows;
the basic specification of the loop statement of the heterogeneous information fusion deduction device is as follows:
where N is an integer greater than or equal to 1, the loop starts from 1 (counter empty), loops to N, e.g. 20, with a step size of 1;
the information acquisition system can circularly acquire information:
configuring, by means of the smart action configuration tool, first smart action instructions of source information data of instantiated source information objects of the instantiated source-side software program;
inserting the first intelligent action instruction which accords with the specification of the intelligent action statement between the 'cycle start' and the 'cycle end' of the cycle statement, and calling the first intelligent action instruction as a cycle intelligent action instruction;
saving the loop intelligent action instruction to the action instruction configuration file;
deducting the action instruction configuration file into an action instruction deduction file;
and executing the action instruction deduction file, and circularly extracting the source information data of the instantiated source information object.
It will be appreciated that the loop statements may be written in a variety of languages, supporting 20 levels of nested loops, and may have "loop interrupt" statements, cooperating with conditional statements to terminate the loop, as shown in tables 5 and 6 above. The first smart action instruction may be a complex combination of statements, such as all of the statements in table 12.
The technical scheme realizes that the same information acquisition action is executed at any cycle number.
Based on the first embodiment and its modifications, according to a sixth embodiment of the information acquisition system, the source information data is acquired by conditions in a manner of replacing the acquisition information of the first embodiment with the acquisition information of the following acquisition information manner;
the basic specification of the conditional statement of the heterogeneous information fusion deduction device is as follows:
begin execution of conditional logic expression] |
…… |
|
…… |
|
Second Smart action statement |
|
…… |
End of condition |
End of condition |
The information acquisition system can acquire information by conditions in a manner of replacing the acquisition information as follows:
configuring, by means of the smart action configuration tool, second smart action instructions of source information data of instantiated source information objects of the instantiated source-side software program;
inserting the second intelligent action instruction which accords with the intelligent action statement specification between the 'starting execution' and the 'conditional end' of the conditional statement, and calling the second intelligent action instruction as a conditional intelligent action instruction;
saving the conditional intelligent action instruction to the action instruction configuration file;
deducting the action instruction configuration file into an action instruction deduction file;
and executing the action instruction deduction file, and extracting the source information data of the instantiated source information object according to conditions.
As examples shown in tables 9 to 11, the conditional statement may have a variety of grammatical formats. Conditional statements may be nested. Referring to table 12, code lines 24-70 are smart action instructions: the user logs in and enters an advanced search web page, which includes two layers of conditional statement nesting.
The technical scheme realizes the execution of the same information acquisition action according to the set conditions.
Preferably, referring to fig. 25, the smart action statements include at least:
determining data, identification, replication and WEB _ identification;
the method comprises the steps of opening interface amplification, closing interface amplification, integrating a main window on the interface, integrating a sub window on the interface, executing a file, closing a process, opening a data engine, closing the data engine, opening a region engine and closing the region engine.
Preferably, the heterogeneous information fusion deduction is a Chinese grammar-based computer language deduction. As can be seen from the above, the assignment statement, the loop statement and the conditional statement of the heterogeneous information fusion deduction are all written in Chinese, and English words such as for, while, next, if, then and else in general computer languages are not used.
It will be appreciated that the heterogeneous information fusion deduction is an deduction that handles instantiated computer information objects. That is, instantiated information objects in an already running software program are information objects operated on by smart action instructions, rather than instantiating information objects in the code that the heterogeneous information fusion deduction has been made.
Preferably, as shown in table 12, for the heterogeneous information fusion deduction device, the same row of the two data columns of the action name and the action parameter in the action instruction configuration file is simultaneously a null row, and the deduction interpretation is that the intelligent action statement is finished. This is different from the use of semicolons in general computer programming languages such as C/C + +; "come separate statement, for the source code of data tabulation form, the empty line is more intuitive and succinct as the mark of separating the statement.
Advantageously, according to the syntax specification of the heterogeneous information fusion deduction device, an information collection computer program consisting of assignment statements, conditional statements, loop statements and intelligent action statements is written to collect multi-source information data. Therefore, the information acquisition system can compile a complex information acquisition instruction series, realize various instantiated information objects on the computer on the complex scale of a computer language program, and extract various information data.
Preferably, the heterogeneous information fusion deduction is a two-dimensional deduction, the source code file of which can include N parallel action name and action parameter data column groups, where N is an integer greater than or equal to 1. It will be appreciated that unlike a conventional linear one-dimensional deduction, the heterogeneous information fusion deduction can be written and expanded in two-dimensional rows and columns in a plane, for example, inserting the contents of rows 1 and 2 of table 11 in rows 5 and 6 of table 12, the newly formed 2 nd action instruction profile is a two-dimensional N-2 source code file, and the 1-2, 5-6 instruction series of the 2 nd action instruction profile can be executed simultaneously by two parallel processes after deduction. Similarly, the contents of the 1 st and 2 nd rows of table 10 are inserted into the 7 th and 8 th rows in the 2 nd action instruction configuration file to form a 3 rd action instruction configuration file, which is a two-dimensional source code file with N ═ 3, and after deduction, the 1-2, 5-6 and 7-8 instruction series of the 3 rd action instruction configuration file can be executed simultaneously by three parallel processes. The contents of the 1 st and 2 nd rows of the table 9 are inserted into the 9 th and 10 th rows in the 3 rd action instruction configuration file to form a 4 th action instruction configuration file, which is a two-dimensional source code file with N being 4, and after deduction, the 1-2, 5-6, 7-8 and 9-10 th instruction series of the 4 th action instruction configuration file can be executed simultaneously by four parallel processes. Thus, the heterogeneous information fusion deduction is more suitable for parallel computing. If a large amount of heterogeneous data is processed simultaneously, for example data collected from ten different software programs, such a two-dimensional deduction is very suitable, and ten concurrent calculations can be performed clearly and quickly.
Preferably, the instantiated source information object is a text box of one of Windows form controls, the text box is a data object, the source information data of the text box is the content in the text box, and the instantiated fusion software program can use the content of the text box of the instantiated source software program based on the extracted content in the text box.
Preferably, the instantiated source information object is a video player window, the video player window is an interface object, the source information data of the video player window is the video player window handle, and the instantiated fusion end software program can share all functions of the video player window based on the extracted video player window handle.
Preferably, the instantiated source information object is a button of one of Windows form controls, the button is a function object, the source information data of the button is a name of a left mouse click event, and the instantiated fusion-side software program can execute a click action of the button based on the extracted name of the left mouse click event.
Three information object textboxes, forms and buttons which are common in computer programs are instantiable and visual, can be identified by a mouse, the control right of the instantized source information objects is obtained by the information acquisition system of the invention, and the instantized source information objects are controlled by the instantized fusion end software program. As shown in FIG. 14, the instantiated source software program is a WPS WORD processing program, and the instantiated fusion software program is a CHROME browser, so that the extraction of the characters in the WORD document can be realized very conveniently by using the information acquisition system of the present invention, and the characters can be used by the hundred-degree search input box.
In order to realize the integrated use of instantiated information objects in different application programs in a computer, according to a first embodiment of the heterogeneous information fusion system of the present invention, the heterogeneous information fusion system is configured to collect source information data of instantiated source information objects in different instantiated source-side software programs and integrate the source information data with target information data of instantiated target information objects in different instantiated fusion-side software programs, wherein,
the source software program is a computer operating system or a third party application program, the instantiated source information object is one of a source data object, a source interface object or a source function object corresponding to one of the hardware resource of the operating system, the software resource of the operating system, the hardware resource of the third party application program or the software resource of the third party application program, and the source information data is one of a data value of the source data object, an interface identifier of the source interface object or a function identifier of the source function object,
the fusion end software program is a computer operating system, the heterogeneous information fusion system or a third party application program, the target information object is one of a target data object, a target interface object or a target function object corresponding to one of hardware resources or software resources of the operating system, the heterogeneous information fusion system or the third party application program, and the target information data is one of data value of the target data object, interface identification of the target interface object or function identification of the target function object.
The heterogeneous information fusion system comprises an intelligent action configuration tool, an action instruction configuration file, a heterogeneous information fusion deduction device and an action instruction deduction file;
the intelligent action configuration tool can configure corresponding intelligent action instructions for each different information data, and comprises the following steps:
an information object marking module that marks the instantiated source information object by way of a mouse click or keyboard input,
a smart identification generation module that generates a smart identification of the information object, wherein the smart identification includes at least a marker of the software program, a marker of the information object, and a marker of the information data, an
The intelligent action instruction compiling module is used for compiling intelligent action instructions according to the language specification of the heterogeneous information fusion deduction device, the intelligent action instructions comprise action instruction names and action instruction parameters, and the action instruction parameters at least comprise the intelligent identification; the smart action instructions can be saved to the action instruction profile;
the action instruction configuration file is in the form of a data list and at least comprises two data columns: action name, and action parameters; the action command name of the intelligent action command is stored in an action name data column of the command configuration file, and the action command parameter used by the intelligent action command is stored in an action parameter data column of the command configuration file; the content format of the action instruction configuration file conforms to the language specification of the heterogeneous information fusion deduction device;
the heterogeneous information fusion deduction device at least comprises variables, assignment statements, conditional statements, loop statements and a plurality of intelligent action statements; the intelligent action statement comprises an intelligent action name and an intelligent action parameter; the intelligent action instruction corresponds to an intelligent action statement in the heterogeneous information fusion deduction device, the action instruction name of the intelligent action instruction corresponds to the intelligent action name of the corresponding intelligent action statement, and the action instruction parameter of the intelligent action instruction corresponds to the intelligent action parameter of the corresponding intelligent action statement;
the action instruction deduction file is formed by deducting the action instruction configuration file by the heterogeneous information fusion deduction device;
the heterogeneous information fusion system integrates information in the following way:
writing an intelligent source acquisition action instruction of source information data of an instantiated source information object in the instantiated source-side software program by means of the intelligent action configuration tool, wherein the intelligent source acquisition action instruction is used for acquiring the source information data;
writing an intelligent target acquisition action instruction of target information data of an instantiated target information object in the instantiated fusion end software program by means of the intelligent action configuration tool, and acquiring the target information data;
writing intelligent integrated action instructions of the source information data and the target information data by means of the intelligent action configuration tool, and integrating the source information data and the target information data together;
storing the intelligent source acquisition action instruction, the intelligent target acquisition action instruction and the intelligent integrated action instruction into the action instruction configuration file;
deducting the action instruction configuration file into the action instruction deduction file by means of the heterogeneous information fusion deduction device;
and executing the action instruction deduction file to complete the integration of the source information data and the target information data.
It is to be understood that reference is made above with respect to the definition and explanation of instantiated source software programs, instantiated source information objects, source information data.
The fusion side software program refers to an instantiated computer operating system, the heterogeneous information fusion system, or a third-party application program for integrating information, and it should be noted that the background database of the heterogeneous information fusion system may also be used for collecting and integrating source information data, and therefore, the heterogeneous information fusion system may be used as an instantiated fusion side software program. As shown in FIG. 14, the CHROME browser may use the text in the WORD document from the instantiated source-side software program as an instantiated converged-side software program.
The target information object refers to an instantiated program object for integrating information in an instantiated fusion end software program, and can be divided into three types: data objects, interface objects, function objects.
Accordingly, the target data object, the target interface object, and the target function object refer to information objects to be information-integrated.
The resources of the software program at the fusion end are divided into six types, each type has three information objects, and eighteen information objects are shown in the following list.
Table 13: main target information object capable of operating by heterogeneous information fusion system of the invention
According to the same inventive concept, the intelligent action configuration tool, the action instruction configuration file, the heterogeneous information fusion deduction device and the action instruction deduction file of the heterogeneous information fusion system are the same as the components of the information acquisition system described above, and the description thereof is not repeated.
It can be understood that the information acquisition mode of the information acquisition system is different from the information integration mode of the heterogeneous information fusion system, in the information integration mode, both the source information data and the target information data can be acquired according to the information acquisition mode of the information acquisition system, the heterogeneous information fusion system obtains the control right of the instantiated source information object and the instantiated target information object, and writes an intelligent integration action instruction through the related integration action statements to implement information integration.
As shown in FIG. 14, the instantiated source side software program is the WORD processing WORD program of WPS, and the instantiated convergence side software program is the CHROME browser, which integrates the two interface objects together by the heterogeneous information convergence system of the present invention. The code on the left side of fig. 13 is an action instruction profile that implements the interface integration of fig. 14. The source interface object is a WORD main form, the source information data can be a handle of the WORD main form, and with the handle, the heterogeneous information fusion system or the instantiated fusion end software program can obtain all functions of the WORD program; the target interface object can be a window handle of the Baidu search homepage, and all functions of the Baidu search homepage can be obtained by the window handle heterogeneous information fusion system or the information source terminal software program. The main window action statement shown in fig. 13 corresponds to the intelligent source acquisition action instruction, the sub-window action statement corresponds to the intelligent target acquisition action instruction, and meanwhile, the main window action statement and the sub-window action statement together form the intelligent integration action instruction.
Deductive execution of the action instruction profile of fig. 13 results in the integrated effect of fig. 14.
It can be understood that, following the programming specification of the heterogeneous information fusion deduction device, the heterogeneous information fusion system of the present invention can implement the above-mentioned complex information integration of 12 source information objects and 18 target information objects, achieving the technical effect of manipulating and integrating all instantiated information objects in the computer.
Preferably, the variables of the heterogeneous information fusion deduction device at least include system data constants, memory variables, and check values.
Preferably, the intelligent identifier further comprises random coding or sequential logic.
Based on the first embodiment and its modifications, according to the second embodiment of the heterogeneous information fusion system, the heterogeneous information fusion system can integrate a plurality of source information data with one target information data in a manner of integrating information in a manner of replacing the integrated information of the first embodiment as follows:
writing an I _ J _ K intelligent source acquisition action instruction of Kth source information data of a J-th source information object in an I-th source-end software program by means of the intelligent action configuration tool, wherein I, J, K are positive integers which are more than or equal to 1,
writing an I _ J _ L intelligent source acquisition action instruction of the L-th source information data of the J-th source information object in the I-th source end software program by means of the intelligent action configuration tool, wherein L is a positive integer greater than or equal to 1, and K is not equal to L, and the L-th source information data is used for acquiring the L-th source information data of the J-th source information object in the I-th source end software program;
writing an intelligent target acquisition action instruction of target information data of an instantiated target information object in the instantiated fusion end software program by means of the intelligent action configuration tool, and acquiring the target information data;
writing intelligent integrated action instructions of the source information data and the target information data by means of the intelligent action configuration tool, and integrating all the source information data and the target information data together;
all the intelligent energy collection action instructions, the intelligent target collection action instructions and the intelligent integrated action instructions are stored in the action instruction configuration file;
deducting the action instruction configuration file into the action instruction deduction file by means of the heterogeneous information fusion deduction device;
and executing the action instruction deduction file to complete the integration of all the source information data and the target information data.
It is to be understood that in the heterogeneous information fusion deduction, the syntax of the collection source information data and the collection target information data is consistent, and a description thereof will not be repeated.
For example, the 1 st source information data of the 1 st source information object in the 1 st source-side software program is collected, where I is 1, J is 1, and K is 1, where the 1 st source-side software program is, for example, an EXCEL application, the 1 st source information object is Worksheet1, and the 1 st source information data is Worksheet1.cell (1,1), and according to the information collection system of the present invention, a code corresponding to the 1 st _1_1 intelligent source collection action instruction can be conveniently written.
The method comprises the steps of collecting 2 nd source information data of a 1 st source information object in a 1 st information source terminal software program, wherein L is 2, and the 2 nd source information data is Worksheet1.cell (1, 2).
And acquiring target information data of an instantiated target information object in the instantiated converged end software program, wherein the instantiated converged end software program is a WORD WORD processing program for example, the target object is a WORD document form for example, and the target data is a WORD document form handle for example. And compiling a corresponding intelligent target acquisition action instruction according to the above.
Then, the two source information data are written into the instantiated target information object, that is, the data in the works hetet 1.cell (1,1) and the works hetet 1.cell (1,2) are written into the WORD document, and accordingly, the intelligent integrated action instruction is written.
And storing all the intelligent energy collection action instructions, the intelligent target collection action instructions and the intelligent integrated action instructions into the action instruction configuration file. Deduction and execution are carried out, and the information integration is realized.
By the technical scheme, different source information data of the same instantiated source information object in the same instantiated source-side software program are integrated into the instantiated target information object of the same instantiated fusion-side software program.
Based on the first embodiment and its modifications, according to a third embodiment of the heterogeneous information fusion system, the heterogeneous information fusion system can integrate one source information data and a plurality of target information data together in a manner of integrating information instead of the integrated information of the first embodiment as follows:
writing an I _ J _ K intelligent target acquisition action instruction of Kth target information data of a J-th target information object in an I-th fusion-end software program by means of the intelligent action configuration tool, wherein I, J, K are positive integers which are more than or equal to 1,
writing an I _ M _ N intelligent target acquisition action instruction of Nth target information data of an Mth target information object in an I-th fusion-end software program by means of the intelligent action configuration tool, wherein the I _ M _ N intelligent target acquisition action instruction is used for acquiring the Nth target information data of the Mth target information object in the I-th fusion-end software program, M, N are positive integers which are greater than or equal to 1, and M is not equal to J;
writing an intelligent target acquisition action instruction of target information data of a target information object in the fusion terminal software program by means of the intelligent action configuration tool, wherein the intelligent target acquisition action instruction is used for acquiring the target information data;
writing intelligent integrated action instructions of the source information data and the target information data by means of the intelligent action configuration tool, and integrating the source information data and all the target information data together;
storing the intelligent source acquisition action instruction, all the intelligent target acquisition action instructions and the intelligent integrated action instruction into the action instruction configuration file;
deducting the action instruction configuration file into the action instruction deduction file by means of the heterogeneous information fusion deduction device;
and executing the action instruction deduction file to complete the integration of all the source information data and the target information data.
By the technical scheme, different source information data of different instantiated source information objects in the same instantiated source-side software program are integrated into the instantiated target information object of the same instantiated fusion-side software program.
Based on the first embodiment and its modifications, according to a fourth embodiment of the heterogeneous information fusion system, the heterogeneous information fusion system can integrate a plurality of source information data with one target information data in a manner of integrating information in a manner of replacing the integrated information of the first embodiment as follows:
writing an I _ J _ K intelligent source acquisition action instruction of Kth source information data of a J-th source information object in an I-th source-end software program by means of the intelligent action configuration tool, wherein I, J, K are positive integers which are more than or equal to 1,
writing an O _ P _ Q intelligent source acquisition action instruction of Q < th > source information data of a P < th > source information object in an O < th > source-end software program by means of the intelligent action configuration tool, for acquiring the Q < th > source information data of the P < th > source information object in the O < th > source-end software program, wherein O, P, Q are positive integers which are all greater than or equal to 1, and O is not equal to I,
writing an intelligent target acquisition action instruction of target information data of an instantiated target information object in the instantiated fusion end software program by means of the intelligent action configuration tool, and acquiring the target information data;
writing intelligent integrated action instructions of the source information data and the target information data by means of the intelligent action configuration tool, and integrating all the source information data and the target information data together;
all the intelligent energy collection action instructions, the intelligent target collection action instructions and the intelligent integrated action instructions are stored in the action instruction configuration file;
deducting the action instruction configuration file into the action instruction deduction file by means of the heterogeneous information fusion deduction device;
and executing the action instruction deduction file to complete the integration of all the source information data and the target information data.
By the technical scheme, different source information data of different instantiated source information objects in different instantiated source-side software programs are integrated into the instantiated target information object of the same instantiated fusion-side software program.
Based on the first embodiment and its modifications, according to a fifth embodiment of the heterogeneous information fusion system, the basic specification of the loop statement of the heterogeneous information fusion deduction device is as follows:
start of counting cycle |
N |
|
…… |
|
Intelligent action statements |
|
…… |
End of cycle |
End of cycle |
Where N is an integer greater than or equal to 1, the loop starts from 1 (counter empty), loops to N, e.g. 20, with a step size of 1
The heterogeneous information fusion system can cyclically integrate information in a manner of replacing the integrated information of the first embodiment as follows:
writing an intelligent source acquisition action instruction of source information data of an instantiated source information object in the instantiated source-side software program by means of the intelligent action configuration tool, wherein the intelligent source acquisition action instruction is used for acquiring the source information data;
writing an intelligent target acquisition action instruction of target information data of an instantiated target information object in the instantiated fusion end software program by means of the intelligent action configuration tool, and acquiring the target information data;
writing intelligent integrated action instructions of the source information data and the target information data by means of the intelligent action configuration tool, and integrating the source information data and the target information data together;
writing a loop statement in the action instruction configuration file;
writing the intelligent source acquisition action instruction, the intelligent target acquisition action instruction and the intelligent integration action instruction into the loop statement of the action instruction configuration file;
deducting the action instruction configuration file into the action instruction deduction file by means of the heterogeneous information fusion deduction device;
and executing the action instruction deduction file to complete the cycle integration of the source information data and the target information data.
Such a technical solution enables the same information integration action to be performed at any number of cycles.
Based on the first embodiment and its modifications, according to a sixth embodiment of the heterogeneous information fusion system, the conditional statement basic specification of the heterogeneous information fusion deduction device is as follows:
begin execution of conditional logic expression] |
…… |
|
…… |
|
Intelligent action statements |
|
…… |
End of condition |
End of condition |
The heterogeneous information fusion system can integrate information according to conditions in a manner of replacing the integrated information of the first embodiment as follows:
writing an intelligent source acquisition action instruction of source information data of an instantiated source information object in the instantiated source-side software program by means of the intelligent action configuration tool, wherein the intelligent source acquisition action instruction is used for acquiring the source information data;
writing an intelligent target acquisition action instruction of target information data of an instantiated target information object in the instantiated fusion end software program by means of the intelligent action configuration tool, and acquiring the target information data;
writing intelligent integrated action instructions of the source information data and the target information data by means of the intelligent action configuration tool, and integrating the source information data and the target information data together;
writing a conditional statement in the action instruction configuration file;
writing the intelligent source acquisition action instruction, the intelligent target acquisition action instruction and the intelligent integration action instruction into the conditional statement of the action instruction configuration file;
deducting the action instruction configuration file into the action instruction deduction file by means of the heterogeneous information fusion deduction device;
and executing the action instruction deduction file, and finishing the integration of the source information data and the target information data according to conditions.
According to the technical scheme, the same information integration action is executed according to the set conditions.
Preferably, referring to fig. 25, the smart action statements include at least:
determining data, identification, replication and WEB _ identification;
the method comprises the steps of opening interface amplification, closing interface amplification, integrating a main window on the interface, integrating a sub window on the interface, executing a file, closing a process, opening a data engine, closing the data engine, opening a region engine and closing the region engine.
Preferably, the heterogeneous information fusion deduction is a Chinese grammar-based computer language deduction.
Preferably, according to the grammar specification of the heterogeneous information fusion and deduction device, an information integration computer program consisting of assignment statements, conditional statements, loop statements and intelligent action statements is written, and multiple items of source information data and multiple items of target information data are integrated.
Preferably, the instantiated target information object is a textbox of one of Windows form controls, the textbox is a data object, the target information data of the textbox is the content in the textbox, and the content can be used by the source-end software program or the heterogeneous information fusion system based on the extracted content in the textbox.
Preferably, the instantiated target information object is a video player window, the video player window is an interface object, the target information data of the video player window is the video player window handle, and the source-side software program or the heterogeneous information fusion system can use the window handle based on the extracted video player window handle.
Preferably, the instantiated target information object is a button of one of Windows form controls, the button is a function object, the target information data of the button is a name of a left mouse click event, and the source-side software program or the heterogeneous information fusion system can use the name of the event based on the extracted name of the left mouse click event.
It is understood that the computer operating system is a first party, the heterogeneous information fusion system is a second party, and the other application programs are third parties. The computer refers to a computing device with a CPU processing function, such as a desktop computer, a notebook computer, a mobile phone, and the like.
The action instruction configuration file is in a Microsoft Excel file format, and the action instruction deduction file is in a Microsoft Access database file format;
the foregoing detailed description of preferred or specific embodiments of the invention has been presented. It should be understood that numerous modifications and variations can be devised by those skilled in the art in light of the present teachings without departing from the spirit and scope of the invention. Therefore, the technical solutions available to those skilled in the art through logic analysis, reasoning and limited experiments based on the design concept of the present invention should be within the scope of the present invention and/or the protection scope defined by the claims.