CN112799656B - Script file configuration method, device, equipment and storage medium for automation operation - Google Patents
Script file configuration method, device, equipment and storage medium for automation operation Download PDFInfo
- Publication number
- CN112799656B CN112799656B CN202110403345.1A CN202110403345A CN112799656B CN 112799656 B CN112799656 B CN 112799656B CN 202110403345 A CN202110403345 A CN 202110403345A CN 112799656 B CN112799656 B CN 112799656B
- Authority
- CN
- China
- Prior art keywords
- node object
- node
- interface
- operated
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/34—Graphical or visual programming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a script file configuration method, a script file configuration device, equipment and a storage medium for automatic operation, wherein the automatic operation is used for executing a customizable preset operation flow at a terminal, the preset operation flow at least comprises preset operation parameters, and the method comprises the following steps: acquiring a plurality of node objects established in an interface to be operated, wherein the node objects are visualized based on the interface to be operated; matching in the plurality of node objects according to the preset operation flow to obtain node object operation on each node object; determining an execution relation between each node object according to the preset operation flow; and configuring to obtain a script file of automatic operation according to the preset operation parameters, the node object operation and the execution relation. The invention can generate the automatic operation skill with high accuracy and strong functionality meeting the requirements of users.
Description
Technical Field
The invention relates to the technical field of terminal automatic operation, in particular to a script file configuration method, a script file configuration device, a script file configuration equipment and a storage medium for automatic operation.
Background
In the use process of the intelligent terminal, automatic operation is needed to replace the operation of clicking a screen by a person under certain scenes (such as handicapped persons, special operation and driving).
If a script file for automation operation is generated, the accuracy rate is low. In addition, some scenarios requiring conditional judgment or cyclic execution of operations cannot be satisfied when generating a script file.
Aiming at the problem of low accuracy rate of automatically operated script files in the related technology, no effective solution is provided at present.
Disclosure of Invention
The invention provides a method, a device, equipment and a storage medium for automatically operating script files, which are used for solving the defect of low accuracy rate of automatically operating script files in the prior art.
The invention provides a script file configuration method for automatic operation, wherein the automatic operation is used for executing a customizable preset operation flow at a terminal, the preset operation flow at least comprises preset operation parameters, and the method comprises the following steps:
acquiring a plurality of node objects created in an interface to be operated, wherein the node objects are visual to the interface to be operated;
matching in the plurality of node objects according to the preset operation flow to obtain node object operation on each node object;
determining an execution relation between each node object according to the preset operation flow;
and configuring to obtain a script file of automatic operation according to the preset operation parameters, the node object operation and the execution relation.
According to the script file configuration method for automation operation provided by the invention, the execution relation between each node object comprises at least one of sequential execution, conditional execution and cyclic execution.
According to the script file configuration method for automation operation provided by the invention, the step of acquiring a plurality of node objects created in an interface to be operated comprises the following steps:
acquiring a user click position in the interface to be operated;
displaying the user click position on the interface to be operated;
if the finger sliding operation is detected, determining a first node object matching range according to the finger sliding operation information;
and creating a first node object according to the first node object matching range.
The method for configuring the script file of the automation operation, which is provided by the invention, determines the matching range of the first node object according to the finger sliding operation information, and comprises the following steps:
displaying a node object matching range corresponding to finger sliding operation in real time;
and when receiving the node object confirmation operation, taking the current node object matching range as the first node object matching range.
According to the script file configuration method for automation operation provided by the invention, the step of acquiring a plurality of node objects created in an interface to be operated comprises the following steps:
acquiring a user click position in the interface to be operated;
displaying the user click position on the interface to be operated;
and creating a second node object according to the user click position.
According to the script file configuration method for automation operation, provided by the invention, the node object operation comprises at least one of single click, double click, input, reading, single-finger sliding and multi-finger sliding.
According to the script file configuration method for automation operation, the preset operation parameters comprise at least one of operation delay, timeout time, feedback text and input parameters.
The invention also provides a script file configuration device for automatic operation, wherein the automatic operation is used for executing a customizable preset operation flow at a terminal, the preset operation flow at least comprises preset operation parameters, and the device comprises:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a plurality of node objects established in an interface to be operated, and the node objects are visual to the interface to be operated;
the control processing module is used for matching the node objects in the plurality of node objects according to the preset operation flow to obtain node object operation on each node object; the control processing module is also used for determining the execution relation between each node object according to the preset operation flow; and the control processing module is also used for configuring and obtaining a script file of automatic operation according to the preset operation parameters, the node object operation and the execution relation.
According to the script file configuration device for automation operation provided by the invention, the execution relation between each node object comprises at least one of sequential execution, conditional execution and cyclic execution.
According to the script file configuration device for automatic operation provided by the invention, the acquisition module is used for acquiring a user click position in the interface to be operated; the control processing module is used for controlling the terminal to display the user click position on the interface to be operated; the control processing module is further used for determining a first node object matching range according to the finger sliding operation information if the finger sliding operation is detected; the control processing module is further configured to create a first node object according to the first node object matching range.
According to the script file configuration device for automatic operation provided by the invention, the control processing module is used for controlling the terminal to display the node object matching range corresponding to the finger sliding operation in real time; the control processing module is further configured to use the current node object matching range as the first node object matching range when receiving the node object confirmation operation.
According to the script file configuration device for automatic operation provided by the invention, the acquisition module is used for acquiring a user click position in the interface to be operated; the control processing module is used for controlling the terminal to display the user click position on the interface to be operated; and the control processing module is also used for creating a second node object according to the user click position.
According to the script file configuration device for automation operation, the node object operation comprises at least one of single click, double click, input, reading, single-finger sliding and multi-finger sliding.
According to the script file configuration device for automation operation provided by the invention, the preset operation parameters comprise at least one of operation delay, timeout time, feedback text and input parameters.
The invention also provides an electronic device, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the steps of the script file configuration method for automation operation.
The present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the method for script file configuration for automation as described in any one of the above.
The invention provides a script file configuration method of automation operation, which is used for executing a self-defined preset operation flow at a terminal, wherein the preset operation flow at least comprises preset operation parameters, a plurality of visualized node objects are created in an interface to be operated by obtaining, and the node object operation of each node object is obtained by matching in the node objects according to the preset operation flow, the execution relation between each node object is determined according to the preset operation flow, and then a script file of the automation operation is configured and obtained according to the preset operation parameters, the node object operation and the execution relation. The invention can carry out corresponding automatic operation according to the requirements of users, has high accuracy, supports complex object execution logic and has good user experience.
Drawings
In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a flow chart of a script file configuration method for automation provided by the present invention;
FIG. 2 is a flow diagram illustrating the generation of an automation operation script file in one example of the invention;
FIG. 3 is a block diagram of an apparatus for configuring script files for automation provided by the present invention;
fig. 4 is a schematic structural diagram of an electronic device provided in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The technical terms involved in the embodiments of the present invention are as follows:
node object: the user selects an object on the interface to be operated by touching or the like, and the object can be a position point or a frame.
Script files: a program that can run automatically.
Accessitivyservice: an Android auxiliary service is used for helping special personnel to perform user operations, such as clicking, returning, long-time pressing and screen information acquisition.
In the process of implementing the invention, the inventor finds that when the screen recording interface is the Tab 1 sub-page of the A page, the operation content is the node object of the Tab 1 sub-interface. However, when the execution starts, if the screen recording interface is the Tab 2 sub-interface of the a page, a certain button needs to be clicked to switch to the Tab 1 interface, but the operation is not recorded, so that the automatic operation cannot be executed correctly.
The operation sequence generated by screen recording can be executed only according to the sequence of user operation. Some scenarios requiring condition judgment or cyclic execution of operations cannot be met, i.e., the implemented functions are limited.
By the automatic operation script file configuration method, a plurality of node objects established in the interface to be operated are obtained, wherein the node objects are visual based on the interface to be operated; matching the node objects according to a preset operation flow to obtain node object operation on each node object; determining an execution relation between each node object according to a preset operation flow; and configuring to obtain a script file of the automatic operation according to the preset operation parameters, the node object operation and the execution relation.
In specific implementation, an accessitivyservice interface may be selected, so that a user selects a node object to be operated by himself, and then selects a corresponding node object operation (such as clicking, sliding, and the like) for each node object, thereby improving the execution accuracy. More importantly, the invention uses three flow structures executed by the program for reference: the sequence, the selection and the circulation also enable the three flow structures to be supported among the operation of the plurality of node objects, and theoretically, a user can realize all operation requirements according to the three flow structures.
The method of generating the automatic operation script of the present invention is described below with reference to fig. 1.
As shown in fig. 1, the method for configuring a script file of an automation operation provided by the present invention, where the automation operation is used to execute a customizable preset operation flow at a terminal, and the preset operation flow at least includes preset operation parameters, includes:
s1: and acquiring a plurality of node objects created in the interface to be operated, wherein the node objects are visual to the interface to be operated.
Specifically, a layout file is set in a background of the terminal, and a visual interface to be operated, preferably a transparent interface to be operated, is covered on a screen interface of the terminal through the layout file, so that a user can see an original application interface on the screen, and when the user operates on the interface to be operated, the operation information of the user can be acquired through the layout file. Wherein the operation information may include a single click, a double click, a slide, and the like.
In a specific embodiment, acquiring a plurality of node objects created in an interface to be operated includes:
and acquiring the user click position in the interface to be operated. Specifically, when a user clicks a certain position of a currently displayed application interface on the to-be-operated interface, the layout file acquires the user click position.
And displaying the click position of the user on the interface to be operated. Specifically, the layout file controls the real-time display of the user click position on the interface to be operated.
If the finger sliding operation is detected, the first end point object matching range is determined according to the finger sliding operation information. And creating a first node object according to the first node object matching range. Specifically, the layout file scans the current application interface according to the user click position to obtain the node object that best matches the user click position, and highlights the current node object, for example, highlighting the current node object or magnifying the current node object. If the current node object is not the node object that the user wants to select, for example, the user wants to select a certain box instead of a certain point, the user can click a certain position on the interface to be operated first, and then select a box as the first node object matching range by finger sliding. The embodiment expands or reduces the matching range of the current node object by calculating the distance difference between the current touch position and the initial click position, and ensures that the user can select the node object to be selected by displaying in real time.
And creating a first node object according to the first node object matching range. Specifically, when the current matching range of the first node object displayed on the interface to be operated is the range that the user wants to select, after the user clicks the confirmation option on the interface to be operated, the layout file creates the first node object according to the first node object matching range.
In a specific embodiment, acquiring a plurality of node objects created in an interface to be operated includes:
and acquiring the user click position in the interface to be operated. Specifically, when a user clicks a certain position of a currently displayed application interface on the to-be-operated interface, the layout file acquires the user click position.
And displaying the click position of the user on the interface to be operated. Specifically, the layout file controls the real-time display of the user click position on the interface to be operated.
And creating a second node object according to the click position of the user. Specifically, the layout file scans the current application interface according to the user click position to obtain the node object that best matches the user click position, and highlights the current node object, for example, highlighting the current node object or magnifying the current node object. And if the current node object is the node object which the user wants to select, the user can use the current node object as a second node object through a confirmation option on the interface to be operated.
S2: and matching the node objects according to a preset operation flow to obtain the node object operation of each node object.
Specifically, after the user selects the node object, the layout file displays the node object operation options available for the user to select through the interface to be operated. For example, the user selects the node object corresponding to each node object to operate in a manner of a drop-down box or a manner of displaying a button for the user to select in front of different node object operation options. The node object operation options include, but are not limited to, single click, double click, input, read, single-finger slide, and multi-finger slide.
After the user sets the corresponding node object operation for each node object, the script file may generate information about the node object operation corresponding to the node object settings in the preset operation flow. And matching the layout file in the plurality of node objects through a preset operation flow to obtain the node object operation of each node object.
S3: and determining the execution relation between each node object according to a preset operation flow.
Specifically, after the user selects the node object, the layout file displays the execution relationship that can be set between the plurality of node objects through the interface to be operated. Wherein, the execution relation between each node object comprises at least one of sequential execution, conditional execution and cyclic execution.
After the user sets the execution relationship among the plurality of node objects, the script file may generate information about the execution relationship among the plurality of nodes in the preset operation flow. Then, the layout file determines the execution relation between each node object according to a preset operation flow.
In a specific embodiment, the node object of the automatic operation includes a node object a, a node object B, and a node object C, and the node object operations corresponding to the node object a, the node object B, and the node object C are a node object operation X, a node object operation Y, and a node object operation Z in this order. The execution relationship among the node object a, the node object B, and the node object C may be:
1. and sequentially executing the node object operation X, the node object operation Y and the node object operation Z.
2. The node object operation X is executed first, and then the node object operation Y is executed. When the node object operation Y is executed, it is determined whether a preset condition is met, for example, the node object operation Y is to detect whether a user performs finger sliding on the interface to be operated, and the distance of the finger sliding is greater than a preset distance, if the preset condition is met, the node object operation Y is completed, and then the node object operation Z is executed.
3. Executing the node object operation X, then executing the node object operation Y- > the node object operation Z- > the node object operation Y- > the node object operation Z and … …, and executing the node object operation Y- > the node object operation Z circularly for N times according to the mode. Wherein N is an integer greater than zero.
In this embodiment, a plurality of node object operations may be combined into one branch, and the branch is provided with a branch id as a unique identifier. The last node object operation in the branch is corresponding to the id for jumping to the next branch or the ending mark, and the sequential execution logic is realized by the mode. In addition, the last node object operation of the branch can be provided with a branch id of a special mark, and the backtracking execution logic is realized, so that the circulation logic is realized. In addition, if the node object operation in the branch executes the first node object operation according to the sequence, then judges whether the information of the current interface and the like meets the preset standard, and determines the node object operation executed next according to the judgment result whether the information meets the preset standard, thereby realizing the selection of the execution logic.
S4: and configuring to obtain a script file of the automatic operation according to the preset operation parameters, the node object operation and the execution relation.
In one embodiment, the preset operation parameter includes at least one of an operation delay, a timeout time, a feedback text, and an input parameter. The operation delay is a delay operation caused by waiting delay after the object is executed and compatible with interface jump, animation, network request and other conditions. The timeout time specifies the condition that the skill execution cycle is overtime or the node object cannot be found, and the like, so that the time is too long. The feedback text is prompt information of the automatic control script during execution, after execution is completed and when execution fails. The input parameter is an operation for possibly inputting text in some cases.
And the layout file is configured to obtain an automatically operated script file according to the preset operation parameters, the node object operation and the execution relation, so that the terminal can automatically operate according to the automatically operated script file. In addition, the script file of the automation operation can be synchronized to the server, the script file of the automation operation can be saved by the server, and then the requirement of the user for the automation operation can be analyzed by the server according to the script file of the automation operation.
FIG. 2 is a flow diagram of generating an automation operation script file in one example of the invention. As shown in fig. 2, when a user wants to generate a script file for automation operation meeting the requirement, an algorithm operation flow needs to be designed first. The number of the node objects required to be selected and the node object operation corresponding to each node object are specified in the algorithm operation flow. After the algorithm operation flow is designed, a node object is selected according to the algorithm operation flow, then the node object operation of the node object is edited, then the logical relation between the node objects is set according to the algorithm operation flow, and then the operation parameters of the node objects are set. If all node objects are not set according to the algorithm operation flow, selecting one node object for editing; and if all the node objects are set according to the algorithm operation flow, generating an automatically operated script file according to the set all the node objects and the node object operation corresponding to each node object.
The following describes the script file configuration device for automation operation provided by the present invention, and the script file configuration device for automation operation described below and the script file configuration method for automation operation described above may be referred to correspondingly.
Fig. 3 is a block diagram of an apparatus for configuring a script file for automation provided by the present invention. As shown in fig. 3, the script file configuring apparatus for automation operation provided by the present invention includes: an acquisition module 310 and a control processing module 320.
The obtaining module 310 is configured to obtain a plurality of node objects created in the interface to be operated, where the node objects are visualized based on the interface to be operated. The control processing module 320 is configured to match the node objects according to a preset operation flow to obtain a node object operation on each node object. The control processing module 320 is further configured to determine an execution relationship between each node object according to a preset operation flow. The control processing module 320 is further configured to obtain a script file for automation operation according to the preset operation parameters, the node object operation, and the execution relationship.
According to the script file configuration device for automation operation provided by the invention, the execution relation between each node object comprises at least one of sequential execution, conditional execution and cyclic execution.
According to the device for configuring the script file for automation operation provided by the present invention, the obtaining module 310 is configured to obtain a user click position in the interface to be operated. The control processing module 320 is used for controlling the terminal to display the user click position on the interface to be operated. The control processing module 320 is further configured to determine the first end point object matching range according to the finger sliding operation information if the finger sliding operation is detected. The control processing module 320 is further configured to create a first node object according to the first node object matching range.
According to the device for configuring the script file for automation operation provided by the present invention, the control processing module 320 is configured to control the terminal to display the node object matching range corresponding to the finger sliding operation in real time. The control processing module 320 is further configured to take the current node object matching range as the first node object matching range when the node object confirmation operation is received.
According to the device for configuring the script file for automation operation provided by the present invention, the obtaining module 310 is configured to obtain a user click position in the interface to be operated. The control processing module 320 is used for controlling the terminal to display the user click position on the interface to be operated. The control processing module 320 is further configured to create a second node object according to the user click position.
According to the script file configuration device for automation operation provided by the invention, the node object operation comprises at least one of single click, double click, input, reading, single-finger sliding and multi-finger sliding.
According to the script file configuration device for automation operation provided by the invention, the preset operation parameters comprise at least one of operation delay, timeout time, feedback text and input parameters.
It should be noted that the specific implementation of the automatic operation script generation apparatus according to the embodiment of the present invention is similar to the specific implementation of the automatic operation script generation method according to the embodiment of the present invention, and specific reference is specifically made to the description of the automatic operation script generation method portion, and details are not repeated for reducing redundancy.
In addition, other configurations and functions of the terminal automatic operation script generating device according to the embodiment of the present invention are known to those skilled in the art, and are not described in detail in order to reduce redundancy.
Fig. 4 illustrates a physical structure diagram of an electronic device, which may include, as shown in fig. 4: a processor 410, a communication interface 420, a memory 430, and a communication bus 440. The processor 410, the communication interface 420, and the memory 430 are configured to communicate with each other via a communication bus 440. The processor 410 may call logic instructions in the memory 430 to perform a script file configuration method of an automated operation for executing a customizable preset operation flow at a terminal, the preset operation flow at least comprising preset operation parameters, the method comprising: acquiring a plurality of node objects established in an interface to be operated, wherein the node objects are visualized based on the interface to be operated; matching in the plurality of node objects according to the preset operation flow to obtain node object operation on each node object; determining an execution relation between each node object according to the preset operation flow; and configuring to obtain a script file of automatic operation according to the preset operation parameters, the node object operation and the execution relation.
In addition, the logic instructions in the memory 430 may be implemented in the form of software functional units and stored in a computer readable storage medium when the software functional units are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In still another aspect, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored, the computer program, when executed by a processor, implementing a script file configuration method for performing the above-mentioned automation operation, the automation operation being used for executing a customizable preset operation flow at a terminal, the preset operation flow at least including preset operation parameters, the method including: acquiring a plurality of node objects created in an interface to be operated, wherein the node objects are visual to the interface to be operated; matching in the plurality of node objects according to the preset operation flow to obtain node object operation on each node object; determining an execution relation between each node object according to the preset operation flow; and configuring to obtain a script file of automatic operation according to the preset operation parameters, the node object operation and the execution relation.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (8)
1. A script file configuration method of automation operation is characterized in that the automation operation is used for executing a preset operation flow which can be defined by a user at a terminal, the preset operation flow at least comprises preset operation parameters, and the method comprises the following steps:
acquiring a plurality of node objects established in an interface to be operated, wherein the node objects are visualized based on the interface to be operated;
the acquiring of the plurality of node objects created in the interface to be operated, wherein the node objects are visualized based on the interface to be operated include:
setting a layout file in a background of the terminal, and covering a visual interface to be operated on a screen interface of the terminal through the layout file, so that when a user operates on the interface to be operated, the operation information of the user can be acquired through the layout file;
when a user clicks a certain position of a currently displayed application interface on an interface to be operated, the layout file acquires the clicking position of the user;
the layout file controls the user click position to be displayed on the interface to be operated in real time, scans the current application interface according to the user click position to obtain the node object which is most consistent with the user click position, and highlights the current node object;
if the finger sliding operation is detected, determining a first node object matching range according to the finger sliding operation information, and when the current matching range of the first node object displayed on the interface to be operated is the range which the user wants to select, and the user clicks a confirmation option on the interface to be operated, creating the first node object by the layout file according to the first node object matching range;
creating a second node object according to the user click position, scanning the current application interface according to the user click position by the layout file to obtain a node object which is most consistent with the user click position, and highlighting the current node object;
matching in the plurality of node objects according to the preset operation flow to obtain node object operation on each node object;
the matching of the node objects according to the preset operation flow to obtain the node object operation of each node object comprises:
after the user selects the node object, displaying node object operation options which can be selected by the user on the interface to be operated through the layout file;
after a user sets corresponding node object operation for each node object, generating information about the node object operation corresponding to the node object setting in the preset operation process through a script file, and matching the layout file in the plurality of node objects through the preset operation process to obtain the node object operation for each node object;
determining an execution relation between each node object according to the preset operation flow;
the determining the execution relationship between each node object according to the preset operation flow comprises:
after a user selects the node objects, the layout file displays the settable execution relation among the plurality of node objects on the interface to be operated;
the layout file determines the execution relation between each node object according to a preset operation process;
configuring a script file for obtaining automatic operation according to the preset operation parameters, the node object operation and the execution relation;
the configuring the script file of the automatic operation according to the preset operation parameters, the node object operation and the execution relation comprises:
and the layout file is configured to obtain a script file of automatic operation according to the preset operation parameters, the node object operation and the execution relation.
2. The method of claim 1, wherein the execution relationship between each of the node objects comprises at least one of sequential execution, conditional execution, and loop execution.
3. The method according to claim 1, wherein the determining the first end point object matching range according to the finger sliding operation information includes:
displaying a node object matching range corresponding to finger sliding operation in real time;
and when receiving the node object confirmation operation, taking the current node object matching range as the first node object matching range.
4. The method of claim 1, wherein the node object manipulation comprises at least one of a single click, a double click, an input, a read, a single-finger swipe, and a multi-finger swipe.
5. The method of claim 1, wherein the preset operational parameters include at least one of operational delays, timeout times, feedback text, and input parameters.
6. An automatically-operated script file configuration device, wherein the automatic operation is used for executing a customizable preset operation flow at a terminal, the preset operation flow at least comprises preset operation parameters, and the device comprises:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a plurality of node objects established in an interface to be operated, and the node objects are visualized based on the interface to be operated;
the obtaining module is specifically configured to set a layout file in a background of the terminal, and cover a visual interface to be operated on a screen interface of the terminal through the layout file, so that when a user operates on the interface to be operated, operation information of the user can be obtained through the layout file;
when a user clicks a certain position of a currently displayed application interface on an interface to be operated, the layout file acquires the clicking position of the user;
the layout file controls the user click position to be displayed on the interface to be operated in real time, scans the current application interface according to the user click position to obtain the node object which is most consistent with the user click position, and highlights the current node object;
if the finger sliding operation is detected, determining a first node object matching range according to the finger sliding operation information, and when the current matching range of the first node object displayed on the interface to be operated is the range which the user wants to select, and the user clicks a confirmation option on the interface to be operated, creating the first node object by the layout file according to the first node object matching range;
creating a second node object according to the user click position, scanning the current application interface according to the user click position by the layout file to obtain a node object which is most consistent with the user click position, and highlighting the current node object;
the control processing module is used for matching the node objects in the plurality of node objects according to the preset operation flow to obtain node object operation on each node object;
the control processing module is specifically used for displaying node object operation options which can be selected by a user on the interface to be operated through the layout file after the user selects the node object;
after a user sets corresponding node object operation for each node object, generating information about the node object operation corresponding to the node object setting in the preset operation process through a script file, and matching the layout file in the plurality of node objects through the preset operation process to obtain the node object operation for each node object;
the control processing module is also used for determining the execution relation between each node object according to the preset operation flow; the control processing module is further used for configuring a script file for obtaining automatic operation according to the preset operation parameters, the node object operation and the execution relation;
the control processing module is also used for displaying the settable execution relation between the plurality of node objects by the layout file through the interface to be operated after the user selects the node objects;
the layout file determines the execution relation between each node object according to a preset operation process;
and the layout file is configured to obtain a script file of automatic operation according to the preset operation parameters, the node object operation and the execution relation.
7. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor, when executing the program, carries out the steps of a script file configuration method for automation as claimed in any one of claims 1 to 5.
8. A non-transitory computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method for configuring a script file for automation as claimed in any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110403345.1A CN112799656B (en) | 2021-04-15 | 2021-04-15 | Script file configuration method, device, equipment and storage medium for automation operation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110403345.1A CN112799656B (en) | 2021-04-15 | 2021-04-15 | Script file configuration method, device, equipment and storage medium for automation operation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112799656A CN112799656A (en) | 2021-05-14 |
| CN112799656B true CN112799656B (en) | 2021-11-05 |
Family
ID=75811441
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110403345.1A Active CN112799656B (en) | 2021-04-15 | 2021-04-15 | Script file configuration method, device, equipment and storage medium for automation operation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112799656B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023115397A1 (en) * | 2021-12-22 | 2023-06-29 | 华为技术有限公司 | Method and apparatus for generating automated script |
| CN116192672A (en) * | 2022-12-16 | 2023-05-30 | 中国联合网络通信集团有限公司 | Script viewing method and related equipment |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102135947B1 (en) * | 2013-08-26 | 2020-07-21 | 삼성전자주식회사 | Method for resizing window area and electronic device for the same |
| CN104142793B (en) * | 2014-07-26 | 2017-05-10 | 珠海市君天电子科技有限公司 | Method and device for simulating click on terminal control |
| WO2016179752A1 (en) * | 2015-05-08 | 2016-11-17 | 上海欧拉网络技术有限公司 | User interface implementation method and apparatus for mobile device |
| CN110727436A (en) * | 2019-10-24 | 2020-01-24 | 深圳前海微众银行股份有限公司 | Operation interface script execution method and device, terminal equipment and storage medium |
| CN112559112B (en) * | 2021-02-25 | 2021-05-14 | 智道网联科技(北京)有限公司 | Interface node positioning method and device |
-
2021
- 2021-04-15 CN CN202110403345.1A patent/CN112799656B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN112799656A (en) | 2021-05-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6916167B2 (en) | Interactive control methods and devices for voice and video calls | |
| CN112799656B (en) | Script file configuration method, device, equipment and storage medium for automation operation | |
| CN108228288A (en) | A kind of component system and its call method and device | |
| CN111143004A (en) | Scene guide method and device, electronic equipment and storage medium | |
| CN114185465B (en) | Information processing method, information processing device, storage medium and electronic equipment | |
| CN110049368A (en) | A kind of display methods and relevant device | |
| CN113535541A (en) | Test method, test device, storage medium and computer equipment | |
| US20220050562A1 (en) | Methods and apparatuses for generating a hosted application | |
| CN107239202B (en) | Control instruction identification method and device | |
| CN112597066B (en) | Page testing method and device | |
| CN107491311B (en) | Method and system for generating page file and computer equipment | |
| CN114286167A (en) | Cross-device interaction method and device, electronic device and storage medium | |
| CN113552988A (en) | Interface focus control method and device, electronic equipment and storage medium | |
| CN112698772A (en) | Document template processing method and device and document creating method and device | |
| JP2017062555A (en) | Electronic apparatus, apparatus control program, and apparatus control method | |
| CN114035729B (en) | Electronic voting method and device and terminal equipment | |
| CN113282268B (en) | Sound effect configuration method and device, storage medium and electronic equipment | |
| CN109782925B (en) | Processing method and device and electronic equipment | |
| CN112632444A (en) | Visual website theme configuration method and device | |
| CN111124387A (en) | Modeling system, method, computer device and storage medium for machine learning platform | |
| CN112579144A (en) | Data processing method and device | |
| CN113162840B (en) | Display method, display device, electronic apparatus, and readable storage medium | |
| CN109542312B (en) | Signal processing method and device and touch equipment applying same | |
| CN113064533B (en) | Control method and control device for electronic equipment | |
| CN112394855B (en) | Menu creation method, device, storage medium and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |