CN109324864A - A kind of acquisition methods and device of man-machine interactive operation information - Google Patents
A kind of acquisition methods and device of man-machine interactive operation information Download PDFInfo
- Publication number
- CN109324864A CN109324864A CN201811244256.1A CN201811244256A CN109324864A CN 109324864 A CN109324864 A CN 109324864A CN 201811244256 A CN201811244256 A CN 201811244256A CN 109324864 A CN109324864 A CN 109324864A
- Authority
- CN
- China
- Prior art keywords
- operation interface
- interface frame
- image
- information
- piece
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses the acquisition methods and device of a kind of man-machine interactive operation information, wherein, the method is when occurring human-computer interaction event, obtain alternative events occur when with the associated operation interface frame of alternative events, and determine unique identification's image of operation interface frame, operation location information is determined in the interaction locations information of operation interface frame according to unique identification's image and alternative events, and interactive action information corresponding with the operation interface frame is generated according to the type of action of operation location information and alternative events, and then sub- script corresponding with alternative events is generated based on operation interface frame and interactive action information, obtain man-machine interactive operation information.By corresponding functional entity run the application method and device acquisition man-machine interactive operation information, can automatic imitation human-computer interaction behavior, realize have different data structures system between data docking.
Description
Technical field
This application involves technical field of data processing more particularly to a kind of acquisition methods and dress of man-machine interactive operation information
It sets.
Background technique
In the practical application of Internet technology, frequently refers to the data obtained in a system and be entered into another
In one system.For example, enterprise or dealer open up shop on electric business platform, and registration user is logical in e-commerce field
Electric business platform purchase commodity are crossed to generate order data in electric business platform.At this point, just needing to obtain ordering for electric business platform generation
Forms data is simultaneously input to enterprise or ERP (Enterprise Resource Planning, Enterprise Resources Plan) system of dealer
In system or JXC System, so that enterprise or dealer are managed the data such as its inventory, product and finance.
Data transfer between above-mentioned ERP system or JXC System and electric business platform can theoretically pass through
EDI (Electronic Data Interchange, electronic data interchange) integrated technology is realized, i.e., between system and system
The transmission and exchange of structural data are carried out using computer network using standardized format by specific data-interface.
However, need the Development characteristics according to both sides' system due to during development interface, formulate through consultation docking code or
Person's business rule, therefore, the exploitation of specific data interface take a long time with corresponding technical support, development efficiency is low.
Especially when the system being related to has variety classes or multiple versions, needs to develop one for each system and specifically connect
Mouthful, this just more requires a great deal of time, thus more reduces development efficiency.For example, current variety classes or version
ERP system quantity be up to 1500-2000, interface needed for each ERP system and the docking of electric business platform all may be different.
In addition, the developer of ERP or JXC System that many small enterprises use have not existed already or system version is old,
Data-interface cannot be supported at all, thus it is even more extremely difficult for the interface exploitation of this kind of system.
It can be seen that relying on EDI integrated technology solves the problems, such as that the data docking between any not homologous ray is unpractical.It is real
On border, the data docking between current many systems is completed still through the mode of manual entry.Manually will for example, dealer utilizes
The order data that electric business platform generates is entered into the ERP system of oneself.Therefore, how to realize with different data structures
Data docking between system, is still those skilled in the art's technical problem urgently to be resolved to replace the mode of manual entry.
Summary of the invention
The application provides the acquisition methods and device of a kind of man-machine interactive operation information, has different data knots to realize
Data docking between the system of structure, to replace the mode of manual entry.
In a first aspect, this application provides a kind of acquisition methods of man-machine interactive operation information, this method comprises:
When human-computer interaction event occurs, alternative events information is obtained；The alternative events information includes and alternative events
The interaction locations information of associated current operation interface frame and alternative events in the operation interface frame；
Determine unique identification's image of the operation interface frame；
Operation location information is determined according to unique identification's image and interaction locations information；
It is dynamic that interaction corresponding with the operation interface frame is generated according to the type of action of operation location information and alternative events
Make information；
Sub- script corresponding with the alternative events is established based on the operation interface frame and the interactive action information；
According to the logical relation between the corresponding sub- script of multiple alternative events, generating includes sub- script and sub- script execution
The man-machine interactive operation information of sequence.
With reference to first aspect, in a first possible implementation of that first aspect, unique identification's image includes
The corresponding image in one or more rectangular area in the predeterminable area of the interaction locations.
With reference to first aspect or first aspect the first possible implementation, in second of first aspect possible realization
In mode, unique identification's image of the determining operation interface frame, comprising:
One piece is selected in the predeterminable area of the interaction locations or passes through the associated muti-piece rectangular area of location layout；
By pixel contrast judgement selected one piece or pass through the corresponding figure in the associated muti-piece rectangular area of location layout
As whether there is uniqueness relative to the operation interface frame；
If selected one piece or by the corresponding image in the associated muti-piece rectangular area of location layout relative to described
Operation interface frame has uniqueness, determines described one piece or is by the corresponding image in the associated muti-piece rectangular area of location layout
Unique identification's image of the operation interface frame；
If selected one piece or by the corresponding image in the associated muti-piece rectangular area of location layout relative to described
Operation interface frame does not have uniqueness, then executes the step that another piece of rectangular area is selected in the predeterminable area of the interaction locations
Suddenly, another piece of rectangular area with described one or more selected rectangular area there is location layout to be associated with.
With reference to first aspect or second of first aspect possible implementation, the third possible realization in first aspect
In mode, it is described by pixel contrast judgement selected one piece or by the associated muti-piece rectangular area of location layout it is corresponding
Whether image has uniqueness relative to the operation interface frame, comprising:
By selected one piece or pass through the corresponding image in the associated muti-piece rectangular area of location layout and operation circle
The corresponding image in remaining region of face frame carries out pixel ratio pair；
If there are image slices corresponding with one piece of selected rectangular area in remaining region of the operation interface frame
The identical region of element, alternatively, exist in remaining region of the operation interface frame with it is selected associated by location layout
The identical region of the corresponding image pixel in muti-piece rectangular area, and the identical interregional location layout and the muti-piece
The location layout of rectangular area is identical, determines selected one piece or corresponding by the associated muti-piece rectangular area of location layout
Image has uniqueness relative to the operation interface frame.
With reference to first aspect or the possible implementation of first aspect first three, in the 4th kind of possible realization of first aspect
It is described that operation location information is determined according to unique identification's image and interaction locations information in mode, comprising:
Unique identification's image is obtained in the current position coordinates of the operation interface frame；
The interaction locations information is parsed, interaction locations coordinate is obtained；
According to unique identification's image the operation interface frame current position coordinates and interaction locations coordinate, really
The relative positional relationship of interaction locations Yu unique identification's image position is determined, with unique identification's image and the phase
It is operation location information to positional relationship.
With reference to first aspect or the 4th kind of possible implementation of first aspect, in the 5th kind of possible realization of first aspect
In mode, it is described according to unique identification's image the operation interface frame current position coordinates and interaction locations coordinate, really
Determine the relative positional relationship of interaction locations Yu unique identification's image position, comprising:
If unique identification's image includes the corresponding image in one piece of rectangular area, existed according to the rectangular area
The current position coordinates and interaction locations coordinate of the operation interface frame, determine that the interaction locations are corresponding with the rectangular area
The relative positional relationship of image；
If the mark image includes muti-piece rectangular area, respectively according to every piece of rectangular area in the operation interface
The current position coordinates and interaction locations coordinate of frame, determine the opposite position of the interaction locations Yu every piece of rectangular area correspondence image
Set relationship.
With reference to first aspect, in the 6th kind of possible implementation of first aspect, based on the operation interface frame and
The interactive action information is established after sub- script corresponding with the alternative events, the method also includes:
Check for the sub- script of mistake or redundancy；
If it does, deleting the sub- script of the mistake or redundancy.
With reference to first aspect or the 6th kind of possible implementation of first aspect, in the 7th kind of possible realization of first aspect
In mode, after the deletion error or the sub- script of redundancy, the method also includes:
Judge whether the alternative events occurred constitute preset event complete or collected works；
If the alternative events occurred do not constitute preset event complete or collected works, thing does not occur in trigger event complete or collected works
Part, and execute the step of obtaining alternative events information.
With reference to first aspect, in the 8th kind of possible implementation of first aspect, described when generation human-computer interaction thing
When part, after obtaining alternative events information, the method also includes:
According to the time of origin of alternative events sequence, for the operation interface frame addition associated with alternative events
Sequential encoding.
Second aspect, the embodiment of the present application provide a kind of acquisition device of man-machine interactive operation information, which includes:
Acquiring unit, for obtaining alternative events information when human-computer interaction event occurs；The alternative events packet
Include the interaction locations information with the associated current operation interface frame of alternative events and alternative events in the operation interface frame；
First determination unit, for determining unique identification's image of the operation interface frame；
Second determination unit, for determining operation positioning letter according to unique identification's image and interaction locations information
Breath；
First generation unit, for being generated and operation circle according to the type of action of operation location information and alternative events
The corresponding interactive action information of face frame；
Unit is established, for establishing and the alternative events pair based on the operation interface frame and the interactive action information
The sub- script answered；
Second generation unit, for according to the logical relation between the corresponding sub- script of multiple alternative events, generation includes
The man-machine interactive operation information of sub- script and sub- script execution sequence.
The application provides the acquisition methods and device of a kind of man-machine interactive operation information, when human-computer interaction event occurs,
Obtain alternative events occur when with the associated operation interface frame of alternative events, and determine operation interface frame unique identification figure
Picture determines operation location information in the interaction locations information of operation interface frame according to unique identification's image and alternative events, and
Interactive action information corresponding with the operation interface frame is generated according to the type of action of operation location information and alternative events, into
And sub- script corresponding with alternative events is generated based on operation interface frame and interactive action information, obtain man-machine interactive operation letter
Breath.The man-machine interactive operation information that the application method and device obtains is operated in into corresponding functional entity, it can automatic mold
The behavior of quasi- human-computer interaction realizes the data docking between the arbitrarily system with different data structures, instead of manual operation.
Detailed description of the invention
In order to illustrate more clearly of the technical solution of the application, letter will be made to attached drawing needed in the embodiment below
Singly introduce, it should be apparent that, for those of ordinary skills, without any creative labor,
It is also possible to obtain other drawings based on these drawings.
Fig. 1 is a kind of the application acquisition methods process of man-machine interactive operation information shown according to an exemplary embodiment
Figure；
Fig. 2 is the application scenarios schematic diagram of the application one embodiment；
Fig. 3 (a) is the application scenarios schematic diagram of the application one embodiment；
Fig. 3 (b) is the application scenarios schematic diagram of the application one embodiment；
Fig. 4 (a) is the application scenarios schematic diagram of the application one embodiment；
Fig. 4 (b) is the application scenarios schematic diagram of the application one embodiment；
Fig. 5 is the side of unique identification's image of the application determining operation interface frame shown according to an exemplary embodiment
Method flow chart；
Fig. 6 is the application scenarios schematic diagram of the application one embodiment；
Fig. 7 is the method flow diagram of the application determining operation location information shown according to an exemplary embodiment；
Fig. 8 is the acquisition methods stream of the application another man-machine interactive operation information shown according to an exemplary embodiment
Cheng Tu；
Fig. 9 is the acquisition methods stream of the application another man-machine interactive operation information shown according to an exemplary embodiment
Cheng Tu；
Figure 10 is a kind of the application acquisition device frame of man-machine interactive operation information shown according to an exemplary embodiment
Figure；
Figure 11 is the acquisition device of the application another man-machine interactive operation information shown according to an exemplary embodiment
Block diagram.
Specific embodiment
Technical solution in order to enable those skilled in the art to better understand the present invention, below in conjunction with of the invention real
The attached drawing in example is applied, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described implementation
Example is only a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, this field is common
Technical staff's every other embodiment obtained without making creative work, all should belong to protection of the present invention
Range.
The acquisition methods and device of man-machine interactive operation information provided by the present application include but is not limited to apply be related to obtaining
It takes the data in a system and is entered into the technology scene of another system, be equally applicable to other and be related to that there are rule
In the technology scene of the repetition man-machine interactive operation of rule property, the technical issues of to solve user's frequent operation, low efficiency.
The embodiment of the present application provides the acquisition methods and device of a kind of man-machine interactive operation information, utilizes corresponding function reality
The running body man-machine interactive operation information, may be implemented by a large amount of data automatic input into specific system, such as above-mentioned
In ERP system, without developing specific mating interface, saves while exploit natural resources, replace manual operation, solve tool
There is the problem of data docking between the system of different data structures.
Embodiment one
Refering to fig. 1, the acquisition methods of man-machine interactive operation information provided by the present application include the following steps:
Step S110 obtains alternative events information when human-computer interaction event occurs；The alternative events information include with
The interaction locations information of the associated current operation interface frame of alternative events and alternative events in the operation interface frame；
Human-computer interaction, which refers to, realizes that the information between user and computer is handed over by computer input device and output equipment
Mutually.User according to the output of machine or display equipment provide it is a large amount of for information about and prompt is asked for instructions, by corresponding on machine
Interactive action (response action) input information.In the application, alternative events can be understood as user on machine by corresponding
Interactive action input information event.According to the difference of input mode, the type of the interactive action of alternative events has been triggered
Difference, for example, mouse clicks type (mouse input), keyboard input type etc..
In the present embodiment, when human-computer interaction event occurs, alternative events information is obtained, which includes handing over
Operation interface frame when mutual event occurs, i.e. the current operation interface frame when human-computer interaction event occurs；For example, monitoring
While having the generation of man-machine alternative events, the image frame of current man machine operation interface is captured.In general, the man machine operation interface frame is
Picture after the full frameization displaying of action pane, Auto-CAD action pane as shown in Figure 2.The application passes through the behaviour that will acquire
Make the corresponding alternative events of interface frame to be bound, keeps alternative events associated with specific operation interface frame.It is described
The sequential encoding corresponding with timestamp that operation interface frame can carry timestamp or separately add to it, for distinguishing difference
The corresponding operation interface frame of alternative events, and the sequence for determining operation interface interframe.
Above-mentioned alternative events information further includes interaction locations information of the alternative events in the operation interface frame.This implementation
In example, the user response that interaction locations can be understood as triggering alternative events is acted in the generation position of operation interface frame or area
Domain, such as mouse click location, key entry area domain etc..It is understood that " interaction locations information " is for characterizing interaction
The quantitative information of position or region should include " position coordinates ".That is, if " position coordinates " are an indexs
Words, then, interaction locations information is the set of an index.For example, position of the mouse click location in operation interface frame is sat
The set etc. of putting coordinate of the boundary in mark or key entry area domain in operation interface frame.
Step S120 determines unique identification's image of the operation interface frame；
In the present embodiment, unique identification's image is a part of image of operation interface frame.More specifically realizing
In mode, unique identification's image may include the corresponding image in one piece of rectangular area in the predeterminable area of interaction locations, example
The corresponding image of region B as shown in Fig. 3 (a)；It may also include the muti-piece rectangular area pair in the predeterminable area of interaction locations
The image answered, at this point, unique identification's image can be understood as the set of several pieces of small image-regions, such as area shown in Fig. 3 (b)
The corresponding image of domain B1, B2 and B3.
It should be noted that interaction locations described in the present embodiment are corresponding with a predeterminable area, which can be with
It is interpreted as region near interaction locations.The predeterminable area can be the position coordinates based on interaction locations in operation interface frame
And/or size (width, length, area or radius etc.) the dynamic delimitation of the predeterminable area.For example, being grasped shown in Fig. 4 (a)
Make in the frame of interface, the position coordinates of interaction locations are L1(l11, l12), L1Corresponding predeterminable area is A1；For another example the behaviour of Fig. 4 (b)
Make in the frame of interface, the position coordinates of interaction locations are L2(l21, l22), L2Corresponding predeterminable area is A2.
In technical scheme, unique identification's image primarily serves two aspect effects, one is, for representing it
Affiliated complete operation interface frame is replaced by the way that unique identification's image of operation interface frame to be stored in processor cache
Store complete operation interface frame, it is possible to reduce data processing amount and amount of storage, the second is, in operation, the application is finally obtained
When human-machine interactive information, it is used for positioning interaction position, to execute corresponding movement at interaction locations.
Based on above-mentioned two aspects effect, in the present embodiment, the uniqueness of operation interface frame is determined using step shown in Fig. 5
Identify image:
In step S121, one piece or associated more by location layout is selected in the predeterminable area of the interaction locations
Block rectangular area；
In the concrete realization, the corresponding image of the predeterminable area of interaction locations is scanned, obtains the picture of predeterminable area
Plain distributed data selects one or more relatively large number of square of feature by being analyzed and processed to the pixel distribution data
Shape region.
Wherein, when having selected muti-piece rectangular area, the location layout of these block rectangular areas relative position in other words
Relationship is deterministic, that is to say, that muti-piece rectangular area is mutually related by deterministic location layout.When wherein appointing
The position of one piece of rectangular area anticipate when determining, the position of remaining rectangular area determines therewith.
It should be noted that the application to the size of above-mentioned rectangular area without limitation, in the specific implementation, can be pre-
If dimension data, dynamic adjustment can also be carried out to it according to pixel distribution data.
In step S122, by pixel contrast judgement selected one piece or pass through the associated muti-piece rectangle of location layout
Whether the corresponding image in region has uniqueness relative to the operation interface frame；
The pixel sequence and operation interface frame for including by the corresponding image in one or more rectangular area that will be selected
Rest of pixels region (not including the corresponding part in the rectangular area) be compared, come judge in operation interface frame whether
Consistent region is distributed in the presence of image pixel corresponding with rectangular area.
For rectangular area individual for one piece, if existed and the rectangle in the rest of pixels region of operation interface frame
It is unique to illustrate that the corresponding image in the rectangular area does not have relative to operation interface frame for the consistent region of the pixel portion in region
Property；Otherwise, there is uniqueness.
For through the associated muti-piece rectangular area of location layout, if the rest of pixels region of operation interface frame is deposited
It is also consistent in pixel distribution identical as the location layout of aforementioned muti-piece rectangular area and the corresponding region in position, illustrate the muti-piece
The corresponding image in rectangular area does not have uniqueness relative to operation interface frame；Otherwise, there is uniqueness.
Based on this, the present embodiment judges one piece selected by following step or passes through the associated muti-piece square of location layout
Whether the corresponding image in shape region has uniqueness relative to the operation interface frame:
By selected one piece or pass through the corresponding image in the associated muti-piece rectangular area of location layout and operation circle
The corresponding image in remaining region of face frame carries out pixel ratio pair；
If there are image slices corresponding with one piece of selected rectangular area in remaining region of the operation interface frame
The identical region of element, alternatively, exist in remaining region of the operation interface frame with it is selected associated by location layout
The identical region of the corresponding image pixel in muti-piece rectangular area, and the identical interregional location layout and the muti-piece
The location layout of rectangular area is identical, determines selected one piece or corresponding by the associated muti-piece rectangular area of location layout
Image has uniqueness relative to the operation interface frame.
For example, selected rectangular area includes being shown by location layout associated C1, C2 and C3 in Fig. 6 refering to Fig. 6
In other regions in operation interface out, there is and location layout consistent with the pixel of C1, C2 and C3 also identical C11, C22
And C33, illustrate that C1, C2 and C3 do not have uniqueness relative to operation interface frame.Conversely, having uniqueness.
In step S123, if selected one piece or passing through the corresponding figure in the associated muti-piece rectangular area of location layout
As there is uniqueness relative to the operation interface frame, described one piece is determined or by the associated muti-piece rectangular area of location layout
Corresponding image is unique identification's image of the operation interface frame；Otherwise, step S121 is executed, i.e., in the interaction locations
Predeterminable area in another piece of rectangular area of selection the step of, another piece of rectangular area and one or more selected square
Shape region is associated with location layout.
It in some preferred embodiments, further include step S120 before above-mentioned steps S121: to the operation interface frame
It is pre-processed；
In the present embodiment, the pretreatment may include the gray proces and binary conversion treatment to operation interface frame, from
And the calculation amount of later pixel comparison process is reduced, while reducing or eliminating the error of pixel comparison result.
The embodiment of the present application in advance pre-processes operation interface frame image, reduces later pixel comparison process and calculates
Amount, reduces or eliminates the error of pixel comparison result.Using relative to operation interface frame image with uniqueness as uniqueness mark
Know image, the complete picture frame belonging to it is represented using the mark image, on the one hand, reduces data processing amount and amount of storage, separately
On the one hand, it when executing man-machine interactive operation information, according to the mark image stored in man-machine interactive operation information and can hand over
Connection between mutual position, the interaction locations at positioning operation interface, to execute corresponding movement at interaction locations.
Step S130 determines operation location information according to unique identification's image and interaction locations information；
When running man-machine interactive operation information by functional entity, operation location information is for simulating human-computer interaction row
For positioning interaction position, to execute corresponding movement at interaction locations, instead of manual operation.
The present embodiment determines operation location information by step shown in Fig. 7:
Step S131 obtains unique identification's image in the current position coordinates of the operation interface frame；
It should be noted that the application pre-establishes two-dimensional coordinate system locating for operation interface frame, and with the two-dimensional coordinate
System is reference standard to discuss any position described herein or positional relationship.In addition, since unique identification's image is behaviour
Make interface frame a part or a few partial regions, be therefore the set of numerous point can take some of unique identification's image
The current position coordinates of the coordinate of boundary point or the coordinate of central point as unique identification's image.Wherein, due to different contractings
It puts under ratio, the actual size of operation interface frame and mark image can change, interaction locations or mark described herein
The value of the position coordinates of image is adaptable to the relative value of scaling, and not absolute terms.
Step S132 parses the interaction locations information, obtains interaction locations coordinate；
Step S133, according to unique identification's image in the current position coordinates of the operation interface frame and interaction position
Coordinate is set, determines the relative positional relationship of interaction locations Yu unique identification's image position, with unique identification figure
Picture and the relative positional relationship are operation location information.
Wherein, if unique identification's image includes the corresponding image in one piece of rectangular area, according to the rectangle
Region determines the interaction locations and the rectangle region in the current position coordinates and interaction locations coordinate of the operation interface frame
The relative positional relationship of domain correspondence image；
If the mark image includes muti-piece rectangular area, respectively according to every piece of rectangular area in the operation interface
The current position coordinates and interaction locations coordinate of frame, determine the opposite position of the interaction locations Yu every piece of rectangular area correspondence image
Set relationship.
It should be noted that the application is with interaction locations and the relative positional relationship of unique identification's image position
Location information is operated, when running man-machine interactive operation information by functional entity, searches uniqueness on executing interface first
The position for identifying image, navigates to interaction locations further according to the relative positional relationship of unique identification's image and interaction locations, from
And simulate human-computer interaction behavior and execute corresponding movement at interaction locations, instead of manual operation.
It should be noted that being that operation is fixed with interaction locations and the relative positional relationship of unique identification's image position
Position information, even if unique identification's image changes in the position (position coordinates) executed on interface, due to uniqueness mark
Knowing can not change with the relative positional relationship of interaction locations, therefore, can still pass through the reality of unique identification's image
Position navigates to interaction locations.
In step S140, generated and the operation interface frame according to the type of action of operation location information and alternative events
Corresponding interactive action information；
In the present embodiment, the corresponding interactive action information of operation interface frame is it is to be understood that the movement comprising alternative events
The information of type and the operation location information.When running man-machine interactive operation information by functional entity, the interaction is dynamic
Make information for simulating human-computer interaction behavior, positioning interaction position, and the movement of corresponding actions type is executed at interaction locations,
Instead of manual operation.
In step S150, established and the alternative events pair based on the operation interface frame and the interactive action information
The sub- script answered；And in step S160, according to the logical relation between the corresponding sub- script of multiple alternative events, packet is generated
Man-machine interactive operation information containing sub- script and sub- script execution sequence.
If script is the combination of a rule order, these orders act one by one for the execution of control function entity,
Sub- script so described herein can be understood as an order in combination, execute a movement for control function entity.
It should be noted that every width operation interface frame is corresponding with a specific alternative events in the embodiment of the present application, meanwhile, according to
Operation interface frame and and corresponding interactive action information generate sub- script it is also corresponding with aforementioned specific alternative events.It is based on
This, herein described man-machine interactive operation information can be understood as the complete execution that multiple sub- scripts after logical process are formed
Script.When running the script by functional entity, each sub- script will be performed according to determining logical relation, thus make with
The corresponding alternative events of each sub- script are realized automatically.
In the present embodiment, the logical relation between every sub- script include judge, jump, branch process etc..For example, working as
When picture pop-up is comprising two prompts of "Yes" and "No", the picture that point "Yes" or "No" jumps belongs to Liang Ge branch.When picture bullet
Out when login page, illustrate that currently logging in possible time-out need to log in again, the login screen is corresponding with the picture before jumping
Logical relation between sub- script is to jump.
As can be seen from the above embodiments, the acquisition methods of man-machine interactive operation information provided by the present application, when the man-machine friendship of generation
When mutual event, obtain alternative events occur when with the associated operation interface frame of alternative events, and determine operation interface frame only
One property identifies image, determines that operation is fixed in the interaction locations information of operation interface frame according to unique identification's image and alternative events
Position information, and interaction corresponding with the operation interface frame is generated according to the type of action of operation location information and alternative events and is moved
Make information, and then sub- script corresponding with alternative events is generated based on operation interface frame and interactive action information, obtains man-machine friendship
Interoperate information.The man-machine interactive operation information that the application method and device obtains is operated in into corresponding functional entity,
With the behavior of automatic imitation human-computer interaction, the data docking between the system with different data structures is realized, instead of manually grasping
Make.
Embodiment two
Refering to Fig. 8, the present embodiment provides the acquisition methods of another man-machine interactive operation information, this method includes following steps
It is rapid:
Step S210 obtains alternative events information when human-computer interaction event occurs；The alternative events information include with
The interaction locations information of the associated current operation interface frame of alternative events and alternative events in the operation interface frame；
Step S220 determines unique identification's image of the operation interface frame；
Step S230 determines operation location information according to unique identification's image and interaction locations information；
Step S240 is generated corresponding with the operation interface frame according to the type of action of operation location information and alternative events
Interactive action information；
Step S250 is established corresponding with the alternative events based on the operation interface frame and the interactive action information
Sub- script；
Step S260 checks for the sub- script of mistake or redundancy；If it does, step S270 is jumped to, otherwise,
Jump to step S280；
Step S270 deletes the sub- script of the mistake or redundancy；
Step S280, according to the logical relation between the corresponding sub- script of multiple alternative events, generate comprising sub- script and
The man-machine interactive operation information of sub- script execution sequence.
Embodiment two and the difference of above-described embodiment one are only that, further include deleting after the step S150 of embodiment one
The step of except the sub- script of mistake or redundancy.
In some practical application scenes, the operation interface frame of acquisition is it is possible that mistake or redundancy, in the present embodiment
The sub- script that the operation interface frame based on these mistakes or redundancy is established is deleted, the man-machine interactive operation ultimately generated can be made to believe
It is more accurate to cease, more enforceability.
Embodiment three
Refering to Fig. 9, the present embodiment provides the acquisition methods of another man-machine interactive operation information, this method includes following steps
It is rapid:
Step S310 obtains alternative events information when human-computer interaction event occurs；The alternative events information include with
The interaction locations information of the associated current operation interface frame of alternative events and alternative events in the operation interface frame；
Step S320 determines unique identification's image of the operation interface frame；
Step S330 determines operation location information according to unique identification's image and interaction locations information；
Step S340 is generated corresponding with the operation interface frame according to the type of action of operation location information and alternative events
Interactive action information；
Step S350 is established corresponding with the alternative events based on the operation interface frame and the interactive action information
Sub- script；
Step S360 checks for the sub- script of mistake or redundancy；If it does, step S370 is jumped to, otherwise,
Jump to step S380；
Step S370 deletes the sub- script of the mistake or redundancy；
Step S380, judges whether the alternative events occurred constitute preset event complete or collected works；If the interaction occurred
Event does not constitute preset event complete or collected works, then jumps to step S390；If the alternative events occurred constitute preset event
Complete or collected works then jump to step S400；
Event does not occur in trigger event complete or collected works, and jumps to step S310 by step S390；
Step S400, according to the logical relation between the corresponding sub- script of multiple alternative events, generate comprising sub- script and
The man-machine interactive operation information of sub- script execution sequence.
Embodiment three and the difference of above-described embodiment two are only that, further include passing through after two step S270 of embodiment
The step of triggering nonevent alternative events complement operation interface frame.
In the present embodiment, a specific item is completed based on a certain specific computer software application or system, such as will order
Forms data is entered into the operation item of ERP system, and all alternative events being likely to occur included by these specific items are
It can know.The embodiment of the present application alternative events according to known to whole preset an event complete or collected works, in event complete or collected works
Each alternative events can be saved by way of its corresponding operation interface frame.
The present embodiment (has been occurred after deletion error or the sub- script of redundancy by comparing the operation interface frame obtained
Alternative events) with the operation interface frame in event complete or collected works, it is complete to judge whether the alternative events that have occurred constitute preset event
Collection, if the alternative events occurred can constitute preset event complete or collected works, illustrates that the operation interface frame currently obtained is complete
Face, without supplement.If the alternative events occurred do not constitute preset event complete or collected works, pass through in trigger event complete or collected works not
The operation interface frame lacked is supplemented in by generation event.
In some practical application scenes, it is possible that some logic branches, can not trigger multiple branches simultaneously at this time
Event, but one of branch can only be selected, therefore the incomplete situation of operation interface frame obtained just occur.For this
Situation, the operation interface frame of missing, targetedly can be supplemented in by method through this embodiment, so that most throughout one's life
At man-machine interactive operation information it is more complete.
The acquisition methods of man-machine interactive operation information provided by the present application obtain interaction when human-computer interaction event occurs
Event occur when with the associated operation interface frame of alternative events, and determine operation interface frame unique identification's image, according to
Unique identification's image and alternative events are determined in the interaction locations information of operation interface frame operates location information, and according to operation
The type of action of location information and alternative events generates interactive action information corresponding with the operation interface frame, and then based on behaviour
Make interface frame and interactive action information generates sub- script corresponding with alternative events, obtains man-machine interactive operation information.By this Shen
Please method and device obtain man-machine interactive operation information operate in corresponding functional entity, can automatic imitation human-computer interaction
Behavior, realize have different data structures system between data docking, instead of manual operation.
Example IV
According to the acquisition methods of man-machine interactive operation information provided by the above embodiment, example IV provides a kind of man-machine friendship
The acquisition device for the information that interoperates, refering to fig. 10, which includes:
Acquiring unit U100, for obtaining alternative events information when human-computer interaction event occurs；The alternative events letter
Breath includes believing with the interaction locations of the associated current operation interface frame of alternative events and alternative events in the operation interface frame
Breath；
First determination unit U200, for determining unique identification's image of the operation interface frame；
Second determination unit U300, for determining operation positioning according to unique identification's image and interaction locations information
Information；
First generation unit U400, for being generated and the behaviour according to the type of action of operation location information and alternative events
Make the corresponding interactive action information of interface frame；
Unit U500 is established, interacts thing with described for establishing based on the operation interface frame and the interactive action information
The corresponding sub- script of part；
Second generation unit U600, for generating according to the logical relation between the corresponding sub- script of multiple alternative events
Man-machine interactive operation information comprising sub- script and sub- script execution sequence.
Preferably, unique identification's image includes one or more square in the predeterminable area of the interaction locations
The corresponding image in shape region.
Preferably, the first determination unit U200 determines unique identification's figure of operation interface frame as steps described below
Picture:
One piece is selected in the predeterminable area of the interaction locations or passes through the associated muti-piece rectangular area of location layout；
By pixel contrast judgement selected one piece or pass through the corresponding figure in the associated muti-piece rectangular area of location layout
As whether there is uniqueness relative to the operation interface frame；
If selected one piece or by the corresponding image in the associated muti-piece rectangular area of location layout relative to described
Operation interface frame has uniqueness, determines described one piece or is by the corresponding image in the associated muti-piece rectangular area of location layout
Unique identification's image of the operation interface frame；
If selected one piece or by the corresponding image in the associated muti-piece rectangular area of location layout relative to described
Operation interface frame does not have uniqueness, then executes the step that another piece of rectangular area is selected in the predeterminable area of the interaction locations
Suddenly, another piece of rectangular area and one or more selected rectangular area have the associated rectangular area of location layout.
Preferably, the first determination unit U200, as steps described below, one piece selected by pixel contrast judgement
Or whether there is uniqueness relative to the operation interface frame by the corresponding image in the associated muti-piece rectangular area of location layout:
By selected one piece or pass through the corresponding image in the associated muti-piece rectangular area of location layout and operation circle
The corresponding image in remaining region of face frame carries out pixel ratio pair；
If there are image slices corresponding with one piece of selected rectangular area in remaining region of the operation interface frame
The identical region of element, alternatively, exist in remaining region of the operation interface frame with it is selected associated by location layout
The identical region of the corresponding image pixel in muti-piece rectangular area, and the identical interregional location layout and the muti-piece
The location layout of rectangular area is identical, determines selected one piece or corresponding by the associated muti-piece rectangular area of location layout
Image has uniqueness relative to the operation interface frame.
Preferably, the second determination unit U300 determines operation location information as steps described below:
Unique identification's image is obtained in the current position coordinates of the operation interface frame；
The interaction locations information is parsed, interaction locations coordinate is obtained；
According to unique identification's image the operation interface frame current position coordinates and interaction locations coordinate, really
The relative positional relationship of interaction locations Yu unique identification's image position is determined, with unique identification's image and the phase
It is operation location information to positional relationship.
It is preferable that the second determination unit U300 determines interaction locations and unique identification's image as steps described below
The relative positional relationship of position:
If unique identification's image includes the corresponding image in one piece of rectangular area, existed according to the rectangular area
The current position coordinates and interaction locations coordinate of the operation interface frame, determine that the interaction locations are corresponding with the rectangular area
The relative positional relationship of image；
If the mark image includes muti-piece rectangular area, respectively according to every piece of rectangular area in the operation interface
The current position coordinates and interaction locations coordinate of frame, determine the opposite position of the interaction locations Yu every piece of rectangular area correspondence image
Set relationship.
Preferably, refering to fig. 11, described device further include:
Unit U700 is deleted, for checking for the sub- script of mistake or redundancy；
If it does, deleting the sub- script of the mistake or redundancy.
Preferably, described device further include:
Trigger unit U800, for judging whether the alternative events occurred constitute preset event complete or collected works；
If the alternative events occurred do not constitute preset event complete or collected works, thing does not occur in trigger event complete or collected works
Part, and execute the step of obtaining alternative events information.
Preferably, the acquiring unit U100 is also used to: according to the sequence of the time of origin of the alternative events, to obtain
Associated with the alternative events operation interface frame order of addition coding.
The application provides the acquisition methods and device of a kind of man-machine interactive operation information, when human-computer interaction event occurs,
Obtain alternative events occur when with the associated operation interface frame of alternative events, and determine operation interface frame unique identification figure
Picture determines operation location information in the interaction locations information of operation interface frame according to unique identification's image and alternative events, and
Interactive action information corresponding with the operation interface frame is generated according to the type of action of operation location information and alternative events, into
And sub- script corresponding with alternative events is generated based on operation interface frame and interactive action information, obtain man-machine interactive operation letter
Breath.The man-machine interactive operation information that the application method and device obtains is operated in into corresponding functional entity, it can automatic mold
The data docking between the system with different data structures is realized in the behavior of quasi- human-computer interaction, instead of manual operation.
In the specific implementation, the present invention also provides a kind of computer storage mediums, wherein the computer storage medium can store
There is program, which may include step some or all of in each embodiment of acquisition methods provided by the invention when executing.Institute
The storage medium stated can for magnetic disk, CD, read-only memory (English: read-only memory, referred to as: ROM) or with
Machine storage memory (English: random access memory, referred to as: RAM) etc..
It is required that those skilled in the art can be understood that the technology in the embodiment of the present invention can add by software
The mode of general hardware platform realize.Based on this understanding, the technical solution in the embodiment of the present invention substantially or
Say that the part that contributes to existing technology can be embodied in the form of software products, which can deposit
Storage is in storage medium, such as ROM/RAM, magnetic disk, CD, including some instructions are used so that computer equipment (can be with
It is personal computer, server or the network equipment etc.) execute certain part institutes of each embodiment of the present invention or embodiment
The method stated.
Same and similar part may refer to each other between each embodiment in this specification.Implement especially for device
For example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring in embodiment of the method
Explanation.
Invention described above embodiment is not intended to limit the scope of the present invention..
Claims (10)
1. a kind of acquisition methods of man-machine interactive operation information, which is characterized in that the described method includes:
When human-computer interaction event occurs, alternative events information is obtained；The alternative events information includes being associated with alternative events
Interaction locations information in the operation interface frame of current operation interface frame and alternative events；
Determine unique identification's image of the operation interface frame；
Operation location information is determined according to unique identification's image and interaction locations information；
Interactive action letter corresponding with the operation interface frame is generated according to the type of action of operation location information and alternative events
Breath；
Sub- script corresponding with the alternative events is established based on the operation interface frame and the interactive action information；
According to the logical relation between the corresponding sub- script of multiple alternative events, generate comprising sub- script and sub- script execution sequence
Man-machine interactive operation information.
2. the method according to claim 1, wherein unique identification's image is included in the interaction locations
Predeterminable area in the corresponding image in one or more rectangular area.
3. according to the method described in claim 2, it is characterized in that, unique identification's image of the determining operation interface frame,
Include:
One piece is selected in the predeterminable area of the interaction locations or passes through the associated muti-piece rectangular area of location layout；
By pixel contrast judgement selected one piece or pass through the corresponding image phase in the associated muti-piece rectangular area of location layout
Whether there is uniqueness for the operation interface frame；
If selected one piece or by the corresponding image in the associated muti-piece rectangular area of location layout relative to the operation
Interface frame has uniqueness, and it is described for determining described one piece or passing through the corresponding image in the associated muti-piece rectangular area of location layout
Unique identification's image of operation interface frame；
If selected one piece or by the corresponding image in the associated muti-piece rectangular area of location layout relative to the operation
Interface frame does not have uniqueness, then executes the step of another piece of rectangular area is selected in the predeterminable area of the interaction locations,
Another piece of rectangular area with described one or more selected rectangular area there is location layout to be associated with.
4. according to the method described in claim 3, it is characterized in that, one piece or logical selected by pixel contrast judgement
Whether relative to the operation interface frame have uniqueness, packet if crossing the corresponding image in the associated muti-piece rectangular area of location layout
It includes:
By selected one piece or pass through the corresponding image in the associated muti-piece rectangular area of location layout and the operation interface frame
The corresponding image in remaining region carry out pixel ratio pair；
If there is image pixel phase corresponding with one piece of selected rectangular area in remaining region of the operation interface frame
Same region passes through the associated muti-piece of location layout with selected alternatively, existing in remaining region of the operation interface frame
The identical region of the corresponding image pixel in rectangular area, and the identical interregional location layout and the muti-piece rectangle
The location layout in region is identical, determines one piece for selected or passes through the corresponding image in the associated muti-piece rectangular area of location layout
There is uniqueness relative to the operation interface frame.
5. method according to claim 1-4, which is characterized in that described according to unique identification's image and interaction
Location information determines operation location information, comprising:
Unique identification's image is obtained in the current position coordinates of the operation interface frame；
The interaction locations information is parsed, interaction locations coordinate is obtained；
According to unique identification's image in the current position coordinates and interaction locations coordinate of the operation interface frame, determines and hand over
The relative positional relationship of mutual position and unique identification's image position, with unique identification's image and the opposite position
Relationship is set as operation location information.
6. according to the method described in claim 5, it is characterized in that, it is described according to unique identification's image in the operation interface
The current position coordinates and interaction locations coordinate of frame, determine the relative position of interaction locations Yu unique identification's image position
Relationship, comprising:
If unique identification's image includes the corresponding image in one piece of rectangular area, according to the rectangular area described
The current position coordinates and interaction locations coordinate of operation interface frame, determine the interaction locations and the rectangular area correspondence image
Relative positional relationship；
If the mark image includes muti-piece rectangular area, respectively according to every piece of rectangular area in the operation interface frame
Current position coordinates and interaction locations coordinate determine that the interaction locations and the relative position of every piece of rectangular area correspondence image are closed
System.
7. the method according to claim 1, wherein believing based on the operation interface frame and the interactive action
Breath is established after sub- script corresponding with the alternative events, the method also includes:
Check for the sub- script of mistake or redundancy；
If it does, deleting the sub- script of the mistake or redundancy.
8. the method according to the description of claim 7 is characterized in that after the deletion error or the sub- script of redundancy, institute
State method further include:
Judge whether the alternative events occurred constitute preset event complete or collected works；
If the alternative events occurred do not constitute preset event complete or collected works, do not occur event in trigger event complete or collected works, and
Execute the step of obtaining alternative events information.
9. the method according to claim 1, wherein obtaining interaction described when human-computer interaction event occurs
After event information, the method also includes:
According to the time of origin of alternative events sequence, for the operation interface frame order of addition associated with alternative events
Coding.
10. a kind of acquisition device of man-machine interactive operation information, which is characterized in that described device includes:
Acquiring unit, for obtaining alternative events information when human-computer interaction event occurs；The alternative events information include with
The interaction locations information of the associated current operation interface frame of alternative events and alternative events in the operation interface frame；
First determination unit, for determining unique identification's image of the operation interface frame；
Second determination unit, for determining operation location information according to unique identification's image and interaction locations information；
First generation unit, for being generated and the operation interface frame according to the type of action of operation location information and alternative events
Corresponding interactive action information；
Unit is established, it is corresponding with the alternative events for being established based on the operation interface frame and the interactive action information
Sub- script；
Second generation unit, for according to the logical relation between the corresponding sub- script of multiple alternative events, generating to include sub- foot
The man-machine interactive operation information of this and sub- script execution sequence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811244256.1A CN109324864B (en) | 2018-10-24 | 2018-10-24 | Method and device for acquiring man-machine interaction operation information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811244256.1A CN109324864B (en) | 2018-10-24 | 2018-10-24 | Method and device for acquiring man-machine interaction operation information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109324864A true CN109324864A (en) | 2019-02-12 |
| CN109324864B CN109324864B (en) | 2021-09-21 |
Family
ID=65263269
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811244256.1A Active CN109324864B (en) | 2018-10-24 | 2018-10-24 | Method and device for acquiring man-machine interaction operation information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109324864B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111459837A (en) * | 2020-04-16 | 2020-07-28 | 大连即时智能科技有限公司 | Conversation strategy configuration method and conversation system |
| CN112347176A (en) * | 2020-11-11 | 2021-02-09 | 天津汇商共达科技有限责任公司 | Data docking method and device based on human-computer interaction behavior |
| CN112347178A (en) * | 2020-11-11 | 2021-02-09 | 天津汇商共达科技有限责任公司 | Data docking method and device based on human-computer interaction behavior, terminal and server |
| CN112347177A (en) * | 2020-11-11 | 2021-02-09 | 天津汇商共达科技有限责任公司 | Data docking equipment based on human-computer interaction behavior |
| WO2021087818A1 (en) * | 2019-11-06 | 2021-05-14 | 西门子股份公司 | Method, apparatus and system for capturing knowledge in software |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104951393A (en) * | 2014-03-25 | 2015-09-30 | 中国电信股份有限公司 | Testing method and device |
| US20180196742A1 (en) * | 2016-03-30 | 2018-07-12 | Open Text Corporation | System and method for end to end performance response time measurement based on graphic recognition |
| CN108459848A (en) * | 2017-02-20 | 2018-08-28 | 深圳市北斗智研科技有限公司 | A kind of script acquisition methods and system applied to Excel softwares |
| CN108579094A (en) * | 2018-05-11 | 2018-09-28 | 深圳市腾讯网络信息技术有限公司 | A kind of user interface detection method and relevant apparatus, system and storage medium |
-
2018
- 2018-10-24 CN CN201811244256.1A patent/CN109324864B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104951393A (en) * | 2014-03-25 | 2015-09-30 | 中国电信股份有限公司 | Testing method and device |
| US20180196742A1 (en) * | 2016-03-30 | 2018-07-12 | Open Text Corporation | System and method for end to end performance response time measurement based on graphic recognition |
| CN108459848A (en) * | 2017-02-20 | 2018-08-28 | 深圳市北斗智研科技有限公司 | A kind of script acquisition methods and system applied to Excel softwares |
| CN108579094A (en) * | 2018-05-11 | 2018-09-28 | 深圳市腾讯网络信息技术有限公司 | A kind of user interface detection method and relevant apparatus, system and storage medium |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021087818A1 (en) * | 2019-11-06 | 2021-05-14 | 西门子股份公司 | Method, apparatus and system for capturing knowledge in software |
| CN114430823A (en) * | 2019-11-06 | 2022-05-03 | 西门子股份公司 | Software knowledge capturing method, device and system |
| CN111459837A (en) * | 2020-04-16 | 2020-07-28 | 大连即时智能科技有限公司 | Conversation strategy configuration method and conversation system |
| CN112347176A (en) * | 2020-11-11 | 2021-02-09 | 天津汇商共达科技有限责任公司 | Data docking method and device based on human-computer interaction behavior |
| CN112347178A (en) * | 2020-11-11 | 2021-02-09 | 天津汇商共达科技有限责任公司 | Data docking method and device based on human-computer interaction behavior, terminal and server |
| CN112347177A (en) * | 2020-11-11 | 2021-02-09 | 天津汇商共达科技有限责任公司 | Data docking equipment based on human-computer interaction behavior |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109324864B (en) | 2021-09-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109324864A (en) | A kind of acquisition methods and device of man-machine interactive operation information | |
| US20200356350A1 (en) | Methods and Systems for Visual Programming using Polymorphic, Dynamic Multi-Dimensional Structures | |
| CN110045953B (en) | Method and computing device for generating business rule expression | |
| CN107992427B (en) | Method, device and equipment for creating service test scene and storage medium thereof | |
| US20170192638A1 (en) | Machine learning based webinterface production and deployment system | |
| CN108572823B (en) | Front-end and back-end development management method and system based on interface engine | |
| AU2017280904B2 (en) | Automation of image validation | |
| US20190244110A1 (en) | Enhancing Evolutionary Optimization in Uncertain Environments By Allocating Evaluations Via Multi-Armed Bandit Algorithms | |
| CN109739855B (en) | Method and system for realizing data sheet splicing and automatically training machine learning model | |
| CN100568808C (en) | Method and apparatus to a plurality of webserver parallel work-flows | |
| CN111538774B (en) | Data storage and display method, system, equipment and storage medium | |
| CN109445893A (en) | A kind of method and device of the unique identification of determining operation interface frame | |
| CN113018870B (en) | Data processing method, device and computer readable storage medium | |
| Feng et al. | Gallery dc: Auto-created gui component gallery for design search and knowledge discovery | |
| Zaman et al. | MACE: a new Interface for comparing and editing of multiple alternative documents for generative design | |
| US10289613B2 (en) | Element identifier generation | |
| AU2021204470A1 (en) | Benefit surrender prediction | |
| CN116795377A (en) | Code data processing method and device | |
| Taesiri et al. | A video game testing method utilizing deep learning | |
| CN108334798A (en) | Barcode scanning processing method, device, equipment and computer readable storage medium | |
| Rukshan et al. | Automated usability testing: Analysing asia web sites | |
| CN115048302A (en) | Front-end compatibility testing method and device, storage medium and electronic equipment | |
| Hossain et al. | NCCollab: collaborative behavior tree authoring in game development | |
| CN109343852A (en) | A kind of display methods and device of operation interface frame picture | |
| Chan et al. | PAT: A pattern classification approach to automatic reference oracles for the testing of mesh simplification programs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |