CN112347177A - Data docking equipment based on human-computer interaction behavior - Google Patents
Data docking equipment based on human-computer interaction behavior Download PDFInfo
- Publication number
- CN112347177A CN112347177A CN202011254957.0A CN202011254957A CN112347177A CN 112347177 A CN112347177 A CN 112347177A CN 202011254957 A CN202011254957 A CN 202011254957A CN 112347177 A CN112347177 A CN 112347177A
- Authority
- CN
- China
- Prior art keywords
- data
- script
- unit
- order
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 96
- 238000003032 molecular docking Methods 0.000 title claims abstract description 18
- 238000013515 script Methods 0.000 claims abstract description 112
- 230000002452 interceptive effect Effects 0.000 claims abstract description 36
- 230000009471 action Effects 0.000 claims description 33
- 238000000034 method Methods 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 15
- 238000013479 data entry Methods 0.000 claims description 14
- 238000006243 chemical reaction Methods 0.000 claims description 10
- 230000008569 process Effects 0.000 claims description 8
- 230000006399 behavior Effects 0.000 abstract description 36
- 230000010354 integration Effects 0.000 abstract description 5
- 230000003044 adaptive effect Effects 0.000 abstract description 4
- 230000007547 defect Effects 0.000 abstract description 3
- 230000000875 corresponding effect Effects 0.000 description 54
- 238000010586 diagram Methods 0.000 description 8
- 238000011161 development Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 3
- 229910052500 inorganic mineral Inorganic materials 0.000 description 3
- 239000011707 mineral Substances 0.000 description 3
- 238000012216 screening Methods 0.000 description 3
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 3
- 235000013618 yogurt Nutrition 0.000 description 3
- 230000001276 controlling effect Effects 0.000 description 2
- 230000009191 jumping Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000011144 upstream manufacturing Methods 0.000 description 2
- 235000013162 Cocos nucifera Nutrition 0.000 description 1
- 244000060011 Cocos nucifera Species 0.000 description 1
- 241000196324 Embryophyta Species 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
Abstract
The application discloses data docking equipment based on human-computer interaction behaviors, which comprises a system configuration module, a script generation module, a control module and an execution module; a second order system is configured in the system configuration module; the script generation module is used for acquiring interaction event information when a man-machine interaction event occurs in the second order system; generating a behavior script corresponding to the second order system according to the interactive event information; the control module is used for receiving a user instruction, generating a control instruction for the execution module according to the user instruction, and sending the control instruction and the locally pre-stored order data of the first order system to the execution module; the execution module is used for executing the behavior script on the order data according to the control instruction so as to record the order data into the second order system. The equipment replaces a manual input mode, is adaptive to any second order system, and overcomes the defect of the conventional EDI integration technology in the application of data docking between different systems.
Description
Technical Field
The application relates to the technical field of data processing, in particular to data docking equipment based on human-computer interaction behaviors.
Background
In the practical application of internet technology, it is often involved in acquiring data from one system and inputting it into another system. For example, in the field of electronic commerce, an enterprise or a dealer opens a shop on an e-commerce platform, and registered users purchase goods through the e-commerce platform to generate order data on the e-commerce platform. At this time, order data generated by the merchant platform needs to be acquired and input into an ERP (Enterprise Resource Planning) system or a purchase-sale-stock system of the Enterprise or the dealer, so that the Enterprise or the dealer can manage data of inventory, products, finance and the like.
The Data transmission process between the ERP system or the purchase-sale-storage system and the e-commerce platform can be theoretically realized by an EDI (Electronic Data exchange) integration technology, that is, the system and the system transmit and exchange structured Data through a specific Data interface, adopting a standardized format and utilizing a computer network. However, in the process of developing the interface, the docking code or the business rule needs to be formulated through negotiation according to the development characteristics of the systems of the two parties, so that the development of the specific data interface needs a long time and corresponding technical support, and the development efficiency is low. Especially when the systems involved have different kinds or versions, a specific interface needs to be developed for each system, which further takes a lot of time, thereby further reducing the development efficiency. For example, the number of different types or versions of ERP systems is up to 1500-. In addition, many developers of ERP or purchase-sale-storage systems used by small enterprises do not exist, or the system version is old, and the data interface cannot be supported by root pressing, so that the interface development of the system is difficult.
Therefore, it is unrealistic to rely on the EDI integration technology to solve the data interfacing problem between any different systems. In fact, currently, data interfacing among many systems is still completed by means of manual entry. For example, the dealer manually enters order data generated by the e-commerce platform into its own ERP system. Therefore, how to implement data interfacing between systems with different data structures to replace a manual entry manner remains a technical problem to be solved by those skilled in the art.
Disclosure of Invention
The application provides data docking equipment based on human-computer interaction behaviors, so that data docking between systems with different data structures is achieved.
The application provides a data docking equipment based on man-machine interaction action includes: the system comprises a system configuration module, a script generation module, a control module and an execution module;
a second order system is configured in the system configuration module;
the script generation module is used for acquiring interaction event information when a human-computer interaction event occurs in the second order system; generating a behavior script corresponding to a second order system according to the interaction event information; the behavior script is used for executing preset data operation;
the control module is used for receiving a user instruction, generating a control instruction for the execution module according to the user instruction, and sending the control instruction and locally pre-stored order data of the first order system to the execution module;
and the execution module is used for executing the behavior script on the order data according to the control instruction so as to record the order data into a second order system.
Further, the apparatus further comprises: a data processing module;
the data processing module is configured to, before the control module sends the order data of the first order system pre-stored locally to the execution module, process the order data of the first order system pre-stored locally according to the standard data of the second order system to generate normalized order data, so that the data sent by the control module is the normalized order data.
Further, the data processing module comprises: the system comprises a data matching unit, an account set splitting unit and a data conversion unit;
the data matching unit is used for establishing a matching relation between the fields in the order data and the standard fields of the second order system;
the account set splitting unit is used for splitting the account set for the order data to obtain a plurality of bills;
and the data conversion unit is used for converting the bill through a preset conversion script, determining the data type of the bill, and adding the converted data into a queue to form normalized order data.
Further, the data matching unit is specifically configured to:
analyzing fields contained in the order data;
determining non-standard fields in the order data according to the standard fields of the second order system;
judging whether a standard field having a matching relation with the non-standard field exists or not;
if the standard field having the matching relation with the non-standard field does not exist, searching the standard field matched with the non-standard field, and establishing the matching relation between the non-standard field and the standard field.
Further, the script generation module comprises an information acquisition unit, an identification determination unit, a sub-script establishment unit and a behavior script generation unit:
the information acquisition unit is used for acquiring interaction event information when a human-computer interaction event to the second order system occurs; the interactive event information comprises a current operation interface frame associated with the interactive event and interactive position information of the interactive event in the operation interface frame;
the identification determining unit is used for determining a unique identification image of the operation interface frame;
the sub-script establishing unit is used for determining operation positioning information according to the unique identification image and the interactive position information; generating interactive action information corresponding to the operation interface frame according to the operation positioning information and the action type of the interactive event; establishing a sub-script corresponding to the interaction event based on the operation interface frame and the interaction action information;
and the behavior script generating unit is used for generating the behavior script comprising the sub-scripts and the execution sequence of the sub-scripts according to the logic relation among the sub-scripts corresponding to the plurality of interaction events.
Further, the identifier determining unit is specifically configured to:
selecting one or more rectangular areas related through position layout in a preset area of the interaction position;
judging whether the image corresponding to the selected rectangular area or the plurality of rectangular areas related through the position layout has uniqueness relative to the operation interface frame through pixel comparison;
if the image corresponding to the selected one or the plurality of rectangular areas associated through the position layout has uniqueness relative to the operation interface frame, determining the image corresponding to the one or the plurality of rectangular areas associated through the position layout as a unique identification image of the operation interface frame;
if the image corresponding to the selected rectangular area or the rectangular areas related through the position layout does not have uniqueness relative to the operation interface frame, the step of selecting another rectangular area in the preset area of the interaction position is executed, and the other rectangular area is related to the selected rectangular area or rectangular areas through the position layout.
Further, the device further comprises an input module;
the input module is used for receiving input information of a user, generating a user instruction according to the input information and sending the user instruction to the control module; the user instructions include a data entry start instruction and a data entry stop instruction.
Further, the execution module includes:
the to-be-executed sub-script determining unit is used for determining the to-be-executed sub-script in the behavior script; each item to be input in the normalized order data corresponds to at least one sub-script in the behavior script respectively; acquiring an operation interface frame image and interactive action information corresponding to the to-be-executed sub-script; the interactive action information comprises operation positioning information and action types;
the judging unit is used for judging whether the operation interface frame image is matched with the current interface image of the second order system;
and the operation unit is used for determining a target operation position of the current interface of the second order system according to the operation positioning information and executing the action of the action type at the target operation position if the operation interface frame image is matched with the current interface image of the second order system so as to write the to-be-input item corresponding to the to-be-executed sub-script in the normalized order data into the second order system.
Further, the operation unit is specifically configured to:
performing an action at the target operating location to activate the data population location;
directly inputting the item to be input at the data fill location;
or searching a specified input item matched with the item to be input in a preset area of the target operation position;
and executing an action on the specified input item to input the item to be input.
Further, the execution module is further configured to:
when the operation of the sub-script with the execution sequence positioned at the last in the behavior script is finished, generating and recording write-in feedback; sending the write feedback to a control module;
the control module is further used for generating a data entry log according to the write-in feedback.
The equipment replaces a manual input mode, is adaptive to any second order system, and overcomes the defect of the conventional EDI integration technology in the application of data docking between different systems.
Drawings
In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.
FIG. 1 is a schematic diagram of an embodiment of a data docking device based on human-computer interaction behavior provided in the present application;
FIG. 2 is a schematic diagram of one embodiment of a script generation module 200 in the device of FIG. 1;
FIG. 3(a) is a schematic diagram of an application scenario according to an embodiment of the present application;
FIG. 3(b) is a schematic diagram of an application scenario according to an embodiment of the present application;
FIG. 4 is a schematic diagram of an application scenario according to an embodiment of the present application;
FIG. 5 is a diagram illustrating one embodiment of an execution module 400 in the device of FIG. 1;
FIG. 6 is a schematic diagram of another embodiment of a data docking device based on human-computer interaction behavior provided in the present application;
fig. 7 is a schematic diagram of an embodiment of a data processing module 600 in the device shown in fig. 6.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The data docking equipment based on the man-machine interaction behaviors provided by the application is applied to technical scenes of acquiring data in one system and inputting the data into another system, and can also be applied to other technical scenes of repeated man-machine interaction operation with regularity so as to solve the technical problems of frequent operation and low efficiency of users.
Fig. 1 is an embodiment of a data docking device based on human-computer interaction behavior according to the present application. As shown in fig. 1, the apparatus of the present embodiment includes: a system configuration module 100, a script generation module 200, a control module 300, and an execution module 400;
the system configuration module 100 is configured with a second order system;
the second order system represents a party that accepts the data, such as an ERP system of a dealer.
The script generating module 200 is configured to obtain interaction event information when a human-computer interaction event occurs in the second order system; generating a behavior script corresponding to a second order system according to the interaction event information; the behavior script is used for executing preset data operation; root of herbaceous plant
The script generating module 200 of the device may provide a function of customizing the script in a personalized manner for the user of the device based on the actual situation of the second order system, for example, the version, the category, and the like of the dealer ERP system, so that the device may meet the needs of more users.
Specifically, as shown in fig. 2, the script generating module 200 includes an information obtaining unit 210, an identifier determining unit 220, a sub-script establishing unit 230, and an action script generating unit 240;
when a human-computer interaction event for the second order system occurs, the information obtaining unit 210 obtains interaction event information and transmits the interaction event information to the identification determining unit 220. The interactive event information comprises a current operation interface frame associated with the interactive event and interactive position information of the interactive event in the operation interface frame;
the man-machine interaction means that information interaction between a user and a computer is realized through computer input equipment and computer output equipment. In the present application, an interactive event may be understood as an event in which a user inputs information on a machine through a corresponding interactive action. The type of interaction that triggers an interaction event varies depending on the input mode, e.g., mouse click type (mouse input), keyboard input type, etc.
In this embodiment, when a human-computer interaction event occurs, a current operation interface frame is acquired. And binding the acquired operation interface frame with the corresponding interaction event to enable the interaction event to be associated with the specific operation interface frame. The operation interface frame can carry a time stamp or sequence coding which is added to the operation interface frame and corresponds to the time stamp, and is used for distinguishing the operation interface frames corresponding to different interaction events and determining the sequence among the operation interface frames.
In this embodiment, when a human-computer interaction event occurs, the occurrence position or area of a user response action triggering the interaction event in an operation interface frame, that is, interaction position information of the interaction event in the operation interface frame, such as a mouse click position, a keyboard input area, and the like, is recorded. It is to be understood that "interaction location information" is quantitative information for characterizing an interaction location or region, and should contain "location coordinates". That is, if the "position coordinates" is one index, the interactive position information is a set of indexes. For example, the position coordinates of the mouse click position in the operation interface frame, or the set of point coordinates of the boundary of the keyboard input area in the operation interface frame, or the like.
The identification determining unit 220 is configured to determine a unique identification image of the operation interface frame;
in the present embodiment, the unique identification image is a part of the image of the operation interface frame. In a more specific implementation manner, the unique identification image may include an image corresponding to a rectangular area in a preset area of the interaction location, for example, an image corresponding to an area B shown in fig. 3 (a); it is also possible to include images corresponding to a plurality of rectangular regions within a preset region of the interaction location, in which case the unique identification image can be understood as a collection of several small image regions, such as the images corresponding to regions B1, B2, and B3 shown in fig. 3 (B).
In the technical scheme of the application, the unique identification image mainly plays two roles, one is that the unique identification image is used for representing a complete operation interface frame to which the unique identification image belongs, the unique identification image of the operation interface frame is stored in a processor cache to replace the complete operation interface frame, data processing amount and storage amount can be reduced, and the other is that the unique identification image is used for positioning an interaction position when the finally obtained human-computer interaction information is operated so as to execute corresponding action at the interaction position.
Specifically, the identification determining unit 220 may select one or more rectangular areas associated by position layout within a preset area of the interaction position;
it should be noted that the interaction location corresponds to a preset area, and the preset area may be understood as a vicinity of the interaction location. In a specific implementation, an image corresponding to a preset region of an interaction position is scanned to obtain pixel distribution data of the preset region, and one or more rectangular regions with relatively more characteristics are selected by analyzing and processing the pixel distribution data.
When a plurality of rectangular regions are selected, the positional layout or relative positional relationship of the rectangular regions is deterministic, that is, the plurality of rectangular regions are associated with each other by the deterministic positional layout. When the position of any one rectangular area is determined, the positions of the rest rectangular areas are determined accordingly.
It should be noted that, the size of the rectangular area is not limited in the present application, and in a specific implementation, the size data may be preset, or may be dynamically adjusted according to the pixel distribution data.
The identifier determining unit 220 further determines whether the image corresponding to the selected one or more rectangular regions associated with each other through the position layout has uniqueness with respect to the operation interface frame through pixel comparison;
and comparing the pixel sequence contained in the image corresponding to the selected one or more rectangular areas with the rest pixel areas (excluding the parts corresponding to the rectangular areas) of the operation interface frame to judge whether the image pixels corresponding to the rectangular areas are distributed in a consistent manner in the operation interface frame.
For a single rectangular area, if an area consistent with a pixel part of the rectangular area exists in the rest pixel areas of the operation interface frame, the image corresponding to the rectangular area does not have uniqueness relative to the operation interface frame; otherwise, it has uniqueness.
For a plurality of rectangular areas related through position layout, if the rest pixel areas of the operation interface frame have the same position layout as the rectangular areas and the pixel distribution of the areas corresponding to the positions is also consistent, the images corresponding to the rectangular areas do not have uniqueness relative to the operation interface frame; otherwise, it has uniqueness.
For example, performing pixel comparison on an image corresponding to the selected rectangular area or the plurality of rectangular areas associated through the position layout and images corresponding to the rest areas of the operation interface frame;
and if the same region as the image pixel corresponding to the selected rectangular region exists in the rest regions of the operation interface frame, or the same region as the image pixel corresponding to the plurality of rectangular regions associated with the selected position layout exists in the rest regions of the operation interface frame, and the position layout among the same regions is the same as the position layout of the plurality of rectangular regions, determining that the image corresponding to the selected rectangular region or the plurality of rectangular regions associated with the position layout has uniqueness relative to the operation interface frame.
Referring to fig. 4, the selected rectangular region includes C1, C2, and C3 associated by a position layout, and in other regions in the operation interface shown in fig. 4, there are C11, C22, and C33 that are consistent with the pixels of C1, C2, and C3 and also have the same position layout, which indicates that C1, C2, and C3 do not have uniqueness with respect to the operation interface frame. Otherwise, the method has uniqueness.
If the image corresponding to the selected one or the plurality of rectangular areas associated through the position layout has uniqueness relative to the operation interface frame, determining the image corresponding to the one or the plurality of rectangular areas associated through the position layout as a unique identification image of the operation interface frame;
if the image corresponding to the selected rectangular area or the rectangular areas related through the position layout does not have uniqueness relative to the operation interface frame, the step of selecting another rectangular area in the preset area of the interaction position is executed, and the other rectangular area is related to the selected rectangular area or rectangular areas through the position layout.
The sub-script establishing unit 230 determines operation positioning information according to the unique identification image and the interaction position information; generating interactive action information corresponding to the operation interface frame according to the operation positioning information and the action type of the interactive event; establishing a sub-script corresponding to the interaction event based on the operation interface frame and the interaction action information;
the operation positioning information is used for positioning the interaction position so as to execute corresponding action at the interaction position, and manual operation is replaced.
Specifically, the sub-script creating unit 230 first obtains the current position coordinates of the unique identifier image in the operation interface frame.
The application establishes a two-dimensional coordinate system where the operation interface frame is located in advance, and discusses any position or position relation described in the application with the two-dimensional coordinate system as a reference standard. In addition, since the unique identification image is a part or a plurality of regions of the operation interface frame and is a set of innumerable points, the coordinates of a certain boundary point or the coordinates of a center point of the unique identification image can be taken as the current position coordinates of the unique identification image. Because the actual sizes of the operation interface frame and the identification image can change under different scaling ratios, the values of the position coordinates of the interaction position or the identification image are relative values adaptive to the scaling ratio, but not absolute values.
Secondly, analyzing the interactive position information to obtain an interactive position coordinate;
and then determining the relative position relationship between the interaction position and the position of the unique identification image according to the current position coordinate and the interaction position coordinate of the unique identification image in the operation interface frame, and taking the unique identification image and the relative position relationship as operation positioning information.
If the unique identification image comprises an image corresponding to a rectangular area, determining the relative position relationship between the interaction position and the image corresponding to the rectangular area according to the current position coordinate and the interaction position coordinate of the rectangular area in the operation interface frame;
and if the identification image comprises a plurality of rectangular areas, determining the relative position relation between the interaction position and the corresponding image of each rectangular area according to the current position coordinate and the interaction position coordinate of each rectangular area in the operation interface frame.
It should be noted that, in the present application, the relative position relationship between the interaction position and the position of the unique identification image is used as the operation positioning information, and even if the position (position coordinate) of the unique identification image on the execution interface changes, since the relative position relationship between the unique identification and the interaction position cannot change, the interaction position can still be positioned through the actual position of the unique identification image.
In this embodiment, the interactive action information corresponding to the operation interface frame may be understood as information including an action type of the interactive event and the operation positioning information. The interaction action information is used for simulating man-machine interaction behaviors, positioning interaction positions and executing actions of corresponding action types at the interaction positions to replace manual operation.
The behavior script generating unit 240 is configured to generate a behavior script including a sub-script and an execution sequence of the sub-script according to a logical relationship between the sub-scripts corresponding to the plurality of interaction events.
If a script is a combination of commands for controlling a functional entity to perform an action, the sub-script described herein can be understood as a command in the combination for controlling the functional entity to perform an action. It should be noted that, in the embodiment of the present application, each operation interface frame corresponds to a specific interaction event, and meanwhile, a sub-script generated according to the operation interface frame and the corresponding interaction action information also corresponds to the specific interaction event. Based on this, the behavior script described in this application may be understood as a complete execution script formed by a plurality of sub-scripts after logic processing. When the script is executed, each sub-script is executed according to the determined logical relationship, so that the interaction event corresponding to each sub-script is automatically realized.
In this embodiment, the logical relationship between each sub-script includes judgment, jump, branch processing, and the like. For example, when the screen pop contains two prompts of "yes" and "no", the screen to which the point "yes" or "no" jumps belongs to two branches. When the screen pops up the login page, the current login may need to be logged in again when overtime happens, and the logic relationship between the login screen and the sub-script corresponding to the screen before jumping is jumping.
The control module 300 is configured to receive a user instruction, generate a control instruction for the execution module according to the user instruction, and send the control instruction and locally pre-stored order data of the first order system to the execution module;
in this embodiment, the order data of the first order system, for example, the order data of the upstream e-commerce system, is pre-imported into the device and stored in the local disk of the device, so that the device does not need to communicate with the upstream e-commerce system to implement the process of obtaining the order data, thereby saving device resources and simplifying a hardware scheme and a software scheme of the device.
In another embodiment, the apparatus further comprises: an input module 500; such as a visualization input area.
The input module 500 is configured to receive input information of a user, generate a user instruction according to the input information, and send the user instruction to the control module; the user instructions include a data entry start instruction and a data entry stop instruction.
The execution module 400 is configured to execute the behavior script on the order data according to the control instruction, so as to enter the order data into a second order system.
As shown in fig. 5, the execution module 400 may include: a to-be-executed sub-script determining unit 410, a judging unit 420 and an operating unit 430;
the to-be-executed sub-script determining unit 410 is configured to determine, after receiving a data entry start instruction, a to-be-executed sub-script in the behavior script; each item to be input in the normalized order data corresponds to at least one sub-script in the behavior script respectively; acquiring an operation interface frame image and interactive action information corresponding to the to-be-executed sub-script; the interactive action information comprises operation positioning information and action types;
in this embodiment, the to-be-executed sub-script is a sub-script corresponding to the data entry step to be executed at present. The normalized order data includes a plurality of items to be entered, such as store names, commodity names, etc., and at least one specific step is required to be performed to enter one item to be entered into the second order system.
The behavior script comprises a plurality of sub scripts, and each sub script is generated by the server according to the operation interface frame image and the interaction action information when the interaction event corresponding to the sub script occurs, wherein the interaction action information further comprises operation positioning information and an action type. The operation positioning information is used for positioning the execution position of the interactive action.
The judging unit 420 is configured to judge whether the operation interface frame image matches a current interface image of a second order system;
in this embodiment, the interface image represents an operation interface image when the terminal device enters data into the second order system by running the behavior script, and the current interface image is the operation interface image when executing the current sub-script.
And in the process of running the script, determining whether the current interface is consistent with the step to be executed by judging whether the frame image of the operation interface is matched with the current interface image. If they match, correct execution of the step can be guaranteed.
Specifically, firstly, a unique identifier of the operation interface image is obtained;
then, judging whether the unique identifier has uniqueness relative to the current interface image or not through pixel comparison;
and if the unique identifier has uniqueness relative to the current interface image, matching the operation interface frame image with the current interface image of the second order system.
Because the uniqueness identifier uniquely represents the operation interface frame image, if the same uniqueness identifier also has uniqueness relative to the current interface image, the operation interface frame image and the current interface image are the same image, namely are matched.
The operation unit 430 is configured to determine a target operation position of the current interface of the second order system according to the operation positioning information if the operation interface frame image matches with the current interface image of the second order system, and execute an action of the action type at the target operation position, so as to write an item to be input corresponding to the sub-script to be executed in the normalized order data into the second order system.
Specifically, because the operation positioning information includes the unique identifier and the relative position relationship between the interaction position and the position of the unique identifier image, the position of the operation positioning information in the current interface image is determined according to the position of the unique identifier in the operation interface frame image to which the operation positioning information belongs; and determining the target operation position of the current interface of the second order system according to the position of the unique identifier in the current interface image and the relative position relation.
[ claim 9 ] the operation unit is specifically configured to:
performing an action at the target operating location to activate the data population location;
directly inputting the item to be input at the data fill location;
or searching a specified input item matched with the item to be input in a preset area of the target operation position;
specifically, an image area matched with the item to be input is searched for as a designated input item in a preset area of the target operation position through pixel comparison.
And executing an action on the specified input item to input the item to be input.
In another embodiment, the operation unit further includes an input checking subunit, configured to check, after the to-be-input item is input at the data filling position, the input content, specifically, obtain the current input item; comparing the input item with the item to be input; if the comparison result is consistent, executing the step of determining the next to-be-executed sub-script; and if the comparison result is not consistent, clearing the input items and inputting again. The input result is checked in real time, so that the input accuracy can be improved.
In another embodiment, the execution module 400 is further configured to generate and record a write feedback when the execution sequence of the sub-script in the behavior script located at the last is completed; sending the write feedback to a control module;
the control module 300 is further configured to generate a data entry log according to the write feedback.
In the operation process of the device, if the user instruction received by the control module 300 is a data entry stop instruction, after generating and recording a piece of write feedback, the control module and the execution module 400 stop operating. The method and the device ensure that the device can be stopped after the current order is completely written and the feedback is successful, and avoid the problems of data entry errors or feedback failure caused by unexpected stop.
Fig. 6 is another embodiment of the device of the present application, as shown in fig. 6, based on the above embodiment, in the embodiment, the data docking device based on human-computer interaction behavior further includes: a data processing module 600;
the data processing module 600 is configured to, before the control module 300 sends the locally pre-stored order data of the first order system to the execution module 400, process the locally pre-stored order data of the first order system according to the standard data of the second order system, and generate normalized order data, so that the data sent by the control module 300 is the normalized order data.
As shown in fig. 7, the data processing module 600 may include: a data matching unit 610, an account set splitting unit 620 and a data conversion unit 630;
the data matching unit 610 is configured to establish a matching relationship between fields in the order data and standard fields of a second order system;
in this embodiment, the field includes a field name and field content, and a relationship between the field name and the field content is equivalent to a key and a key value. Field name-field contents such as distributor name-Yibao, shop name-Hui supermarket, size-300 ml, quantity-10, commodity name-mineral water, etc. The second order system, which is the side that accepts the data, has a specific field, namely a standard field. In order to make the fields in the order data of the first order system correspond to the standard fields of the second order system, a matching relationship between the two is established in step S210. The fields to be matched comprise field names and field contents under specific field names, such as pure coconut yogurt of commodity names.
Specifically, the data matching unit 610 may first parse fields contained in the order data; for example, the fields parsed from the order data include the dealer name-Yibao dealer A, the store name-Huifei Supermarket, the Specification-350 ml, the quantity, the product name-Yibao mineral water, the product number-0001, the selling unit price, and so forth.
Then according to the standard field of the second order system, determining a non-standard field in the order data; for example, assuming that the standard fields of the second order system include a dealer name-Yibao dealer A1, a shop-Hui supermarket, a size-350, a quantity, a product name-Yibao mineral water, it can be determined by comparison that the non-standard fields included in the order data of step S211 include: yibao distributor A (against the standard Yibao distributor A1), store name (against the standard store), 350ml (against the standard 350), and product name (against the standard product name).
Judging whether a standard field having a matching relation with the non-standard field exists or not;
in practice, the non-standard fields and standard fields in the order data may have been matched, for example, in the past data entry process, Yibao dealer A has been matched to Yibao dealer A1.
If the standard field having the matching relation with the non-standard field does not exist, searching the standard field matched with the non-standard field, and establishing the matching relation between the non-standard field and the standard field. For example, the "store" is matched to the "store name", the "350 ml" is matched to the "350", and the "product name" is matched to the "product name".
The account set splitting unit 620 is configured to split an account set for the order data to obtain a plurality of documents;
in this embodiment, according to actual needs, one piece of order data is split into a plurality of specified account sets, and a plurality of documents corresponding to different account set types are obtained. For example, the "change" type bill is converted into the "in-stock" bill and the "out-stock" bill by a preset conversion script.
The data conversion unit 630 is configured to convert the document through a preset conversion script, determine a data type of the document, and add the converted data to a queue to form normalized order data.
In another embodiment, the data matching unit 610 is further configured to set an equivalent field for one or more standard fields in the second order system and the standard data; the equivalent fields are used to compare with fields contained in the order data to determine non-standard fields in the order data.
For example, the standard fields included in the second order system, such as "pure screening yogurt", "product name", "product number", and "unit price", are set, in step S250, the equivalent field "pure screening" is set as "pure screening yogurt", the equivalent field "product name" is set as "product name", the equivalent field "product number" is set as "product number", and the equivalent field "sales unit price" is set as "unit price".
The data docking equipment based on the man-machine interaction behavior comprises a system configuration module, a script generation module, a control module and an execution module; a second order system is configured in the system configuration module; the script generation module is used for acquiring interaction event information when a man-machine interaction event occurs in the second order system; generating a behavior script corresponding to the second order system according to the interactive event information; the behavior script is used for executing preset data operation; the control module is used for receiving a user instruction, generating a control instruction for the execution module according to the user instruction, and sending the control instruction and the locally pre-stored order data of the first order system to the execution module; the execution module is used for executing the behavior script on the order data according to the control instruction so as to record the order data into the second order system. The equipment replaces a manual input mode, is adaptive to any second order system, and overcomes the defect of the conventional EDI integration technology in the application of data docking between different systems.
In specific implementation, the present invention further provides a computer storage medium, wherein the computer storage medium may store a program, and the program may include some or all of the steps in the embodiments of the method performed by the apparatus provided by the present invention when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).
Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.
The same and similar parts in the various embodiments in this specification may be referred to each other. In particular, for the embodiments, since they are substantially similar to the method embodiments, the description is simple, and the relevant points can be referred to the description in the method embodiments.
The above-described embodiments of the present invention should not be construed as limiting the scope of the present invention.
Claims (10)
1. The data docking equipment based on the human-computer interaction behavior is characterized by comprising a system configuration module, a script generation module, a control module and an execution module;
a second order system is configured in the system configuration module;
the script generation module is used for acquiring interaction event information when a human-computer interaction event occurs in the second order system; generating a behavior script corresponding to a second order system according to the interaction event information; the behavior script is used for executing preset data operation;
the control module is used for receiving a user instruction, generating a control instruction for the execution module according to the user instruction, and sending the control instruction and locally pre-stored order data of the first order system to the execution module;
and the execution module is used for executing the behavior script on the order data according to the control instruction so as to record the order data into a second order system.
2. The apparatus of claim 1, further comprising: a data processing module;
the data processing module is configured to, before the control module sends the order data of the first order system pre-stored locally to the execution module, process the order data of the first order system pre-stored locally according to the standard data of the second order system to generate normalized order data, so that the data sent by the control module is the normalized order data.
3. The apparatus of claim 2, wherein the data processing module comprises: the system comprises a data matching unit, an account set splitting unit and a data conversion unit;
the data matching unit is used for establishing a matching relation between the fields in the order data and the standard fields of the second order system;
the account set splitting unit is used for splitting the account set for the order data to obtain a plurality of bills;
and the data conversion unit is used for converting the bill through a preset conversion script, determining the data type of the bill, and adding the converted data into a queue to form normalized order data.
4. The device according to claim 3, wherein the data matching unit is specifically configured to:
analyzing fields contained in the order data;
determining non-standard fields in the order data according to the standard fields of the second order system;
judging whether a standard field having a matching relation with the non-standard field exists or not;
if the standard field having the matching relation with the non-standard field does not exist, searching the standard field matched with the non-standard field, and establishing the matching relation between the non-standard field and the standard field.
5. The apparatus according to claim 1, wherein the script generation module includes an information acquisition unit, an identification determination unit, a sub-script creation unit, and a behavior script generation unit:
the information acquisition unit is used for acquiring interaction event information when a human-computer interaction event to the second order system occurs; the interactive event information comprises a current operation interface frame associated with the interactive event and interactive position information of the interactive event in the operation interface frame;
the identification determining unit is used for determining a unique identification image of the operation interface frame;
the sub-script establishing unit is used for determining operation positioning information according to the unique identification image and the interactive position information; generating interactive action information corresponding to the operation interface frame according to the operation positioning information and the action type of the interactive event; establishing a sub-script corresponding to the interaction event based on the operation interface frame and the interaction action information;
and the behavior script generating unit is used for generating the behavior script comprising the sub-scripts and the execution sequence of the sub-scripts according to the logic relation among the sub-scripts corresponding to the plurality of interaction events.
6. The device according to claim 5, wherein the identity determination unit is specifically configured to:
selecting one or more rectangular areas related through position layout in a preset area of the interaction position;
judging whether the image corresponding to the selected rectangular area or the plurality of rectangular areas related through the position layout has uniqueness relative to the operation interface frame through pixel comparison;
if the image corresponding to the selected one or the plurality of rectangular areas associated through the position layout has uniqueness relative to the operation interface frame, determining the image corresponding to the one or the plurality of rectangular areas associated through the position layout as a unique identification image of the operation interface frame;
if the image corresponding to the selected rectangular area or the rectangular areas related through the position layout does not have uniqueness relative to the operation interface frame, the step of selecting another rectangular area in the preset area of the interaction position is executed, and the other rectangular area is related to the selected rectangular area or rectangular areas through the position layout.
7. The apparatus of claim 2, further comprising an input module;
the input module is used for receiving input information of a user, generating a user instruction according to the input information and sending the user instruction to the control module; the user instructions include a data entry start instruction and a data entry stop instruction.
8. The apparatus of claim 7, wherein the execution module comprises: the device comprises a to-be-executed sub-script determining unit, a judging unit and an operating unit;
the to-be-executed sub-script determining unit is used for determining the to-be-executed sub-script in the behavior script; each item to be input in the normalized order data corresponds to at least one sub-script in the behavior script respectively; acquiring an operation interface frame image and interactive action information corresponding to the to-be-executed sub-script; the interactive action information comprises operation positioning information and action types;
the judging unit is used for judging whether the operation interface frame image is matched with the current interface image of the second order system;
and the operation unit is used for determining a target operation position of the current interface of the second order system according to the operation positioning information and executing the action of the action type at the target operation position if the operation interface frame image is matched with the current interface image of the second order system, so as to write the to-be-input item corresponding to the to-be-executed sub-script in the normalized order data into the second order system.
9. The device according to claim 8, characterized in that the operating unit is specifically configured to:
performing an action at the target operating location to activate the data population location;
directly inputting the item to be input at the data fill location;
or searching a specified input item matched with the item to be input in a preset area of the target operation position;
and executing an action on the specified input item to input the item to be input.
10. The apparatus of claim 8, wherein the execution module is further configured to:
when the operation of the sub-script with the execution sequence positioned at the last in the behavior script is finished, generating and recording write-in feedback; sending the write feedback to a control module;
the control module is further used for generating a data entry log according to the write-in feedback.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011254957.0A CN112347177A (en) | 2020-11-11 | 2020-11-11 | Data docking equipment based on human-computer interaction behavior |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011254957.0A CN112347177A (en) | 2020-11-11 | 2020-11-11 | Data docking equipment based on human-computer interaction behavior |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112347177A true CN112347177A (en) | 2021-02-09 |
Family
ID=74363386
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011254957.0A Pending CN112347177A (en) | 2020-11-11 | 2020-11-11 | Data docking equipment based on human-computer interaction behavior |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112347177A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109194604A (en) * | 2018-06-05 | 2019-01-11 | 平安科技（深圳）有限公司 | Interface automatic method, system, computer equipment and storage medium |
| CN109324864A (en) * | 2018-10-24 | 2019-02-12 | 北京赢销通软件技术有限公司 | A kind of acquisition methods and device of man-machine interactive operation information |
| CN109360065A (en) * | 2018-10-24 | 2019-02-19 | 北京赢销通软件技术有限公司 | A kind of script execution and device |
| CN110363423A (en) * | 2019-07-12 | 2019-10-22 | 海南云端信息技术有限公司 | A kind of travel information management method, server and system |
| CN110955715A (en) * | 2019-12-03 | 2020-04-03 | 望海康信(北京)科技股份公司 | ERP system, data conversion method and device of target platform and electronic equipment |
-
2020
- 2020-11-11 CN CN202011254957.0A patent/CN112347177A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109194604A (en) * | 2018-06-05 | 2019-01-11 | 平安科技（深圳）有限公司 | Interface automatic method, system, computer equipment and storage medium |
| CN109324864A (en) * | 2018-10-24 | 2019-02-12 | 北京赢销通软件技术有限公司 | A kind of acquisition methods and device of man-machine interactive operation information |
| CN109360065A (en) * | 2018-10-24 | 2019-02-19 | 北京赢销通软件技术有限公司 | A kind of script execution and device |
| CN110363423A (en) * | 2019-07-12 | 2019-10-22 | 海南云端信息技术有限公司 | A kind of travel information management method, server and system |
| CN110955715A (en) * | 2019-12-03 | 2020-04-03 | 望海康信(北京)科技股份公司 | ERP system, data conversion method and device of target platform and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108334387B (en) | Dynamic interface rendering method and device | |
| CN112099768B (en) | Business process processing method and device and computer readable storage medium | |
| US8056057B2 (en) | System and method for generating business process test elements | |
| CN101661512A (en) | System and method for identifying traditional form information and establishing corresponding Web form | |
| US7072061B2 (en) | Method and system for extracting information from RFQ documents and compressing RFQ files into a common RFQ file type | |
| CN109324864B (en) | Method and device for acquiring man-machine interaction operation information | |
| US6223180B1 (en) | System and computer-implemented method for transforming existing host-based screen applications into components useful in developing integrated business-centric applications | |
| US9043232B1 (en) | Associating item images with item catalog data | |
| US20050055236A1 (en) | System and method for determining printing needs and implementing printing solutions | |
| CN112416328A (en) | Multi-platform small program mall construction method, device, equipment and medium | |
| CN111435367A (en) | Knowledge graph construction method, system, equipment and storage medium | |
| CN113703785A (en) | Component-based platform deployment method, device, equipment and storage medium | |
| CN114416056A (en) | Page generation method, system, computer equipment and readable storage medium | |
| CN113360737A (en) | Page content acquisition method and device, electronic equipment and readable medium | |
| US20070233818A1 (en) | Recording medium storing input/output screen generation program, and method for suppressing an unreasonable screen shift | |
| CN111931475A (en) | Dynamic subscription book generation method, system, computer equipment and storage medium | |
| CN112347177A (en) | Data docking equipment based on human-computer interaction behavior | |
| JP7029557B1 (en) | Judgment device, judgment method and judgment program | |
| JP2001125855A (en) | Dynamic web page generation program | |
| US6609250B1 (en) | Software generating device | |
| CN109343852B (en) | Method and device for displaying frame pictures of operation interface | |
| CN112347176A (en) | Data docking method and device based on human-computer interaction behavior | |
| CN112181407B (en) | Service realization processing method, device, system, electronic equipment and storage medium | |
| CN112347178A (en) | Data docking method and device based on human-computer interaction behavior, terminal and server | |
| CN113296912A (en) | Task processing method, device and system, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210209 |
|
| RJ01 | Rejection of invention patent application after publication |