CN114637448A - Data processing method and device, electronic equipment and storage medium - Google Patents
Data processing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114637448A CN114637448A CN202210207275.7A CN202210207275A CN114637448A CN 114637448 A CN114637448 A CN 114637448A CN 202210207275 A CN202210207275 A CN 202210207275A CN 114637448 A CN114637448 A CN 114637448A
- Authority
- CN
- China
- Prior art keywords
- interface
- interface element
- app
- acquired
- entered
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/543—User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The application provides a data processing method, a data processing device, an electronic device and a storage medium. The method comprises the following steps: acquiring configuration information, wherein the configuration information comprises acquired interface associated information and input interface associated information; associating the acquired interface according to the acquired interface association information so as to acquire interface elements of the acquired interface; and associating the entered interface according to the associated information of the entered interface so as to enter the acquired interface elements into the entered interface. Therefore, the interface elements can be input into the input interface from the acquired interface, and the problems in the prior art are solved.
Description
Technical Field
The present application relates to the field of internet technologies, and in particular, to a data processing method, an apparatus, an electronic device, and a storage medium.
Background
With the rapid development of internet technology, data is generally required to be input from an interface of one Application (APP) to an interface of another APP. Therefore, how to implement the data entry process is a problem to be solved by the application.
Disclosure of Invention
An object of the embodiments of the present application is to provide a data processing method, an apparatus, an electronic device, and a storage medium, which are used to solve the problems in the prior art.
A first aspect of an embodiment of the present application provides a data processing method, including:
acquiring configuration information, wherein the configuration information comprises acquired interface associated information and input interface associated information;
associating the acquired interface according to the acquired interface association information so as to acquire interface elements of the acquired interface;
and associating the entered interface according to the associated information of the entered interface so as to be used for entering the acquired interface elements into the entered interface.
In an embodiment, the collected interface association information specifically includes: the method comprises the steps of identifying APP identification of a data source APP and interface identification of an acquired interface in the data source APP; and/or the presence of a gas in the gas,
the entered interface associated information specifically includes: the data receiving and recording APP comprises an APP mark of the data receiving and recording APP and an interface mark of an interface to be recorded in the data receiving and recording APP.
In an embodiment, before obtaining the configuration information, the method further includes: obtaining authorization of barrier-free service in an operating system; and (c) a second step of,
acquiring configuration information, specifically comprising:
based on the obtained authorization of the barrier-free service, obtaining the configuration information under the condition that an event callback notification is received, wherein the event callback notification is used for representing that the collected interface as an active interface has changed.
In an embodiment, the method is applied to a process automation robot RPA provided to an actuator APP.
In one embodiment, the operation interface of the actuator APP is provided with a plurality of interface element input controls, wherein each interface element input control corresponds to a different interface element; and the number of the first and second groups,
collecting interface elements of the collected interface, specifically comprising:
acquiring an input instruction input by touching an interface element input control in the operation interface;
according to the input instruction, determining an interface element identifier of a specified target interface element corresponding to the touch interface element input control;
and acquiring the appointed target interface element of the acquired interface by using the interface element identification of the appointed target interface element.
In one embodiment, the interface elements in the collected interface are arranged in a tree structure; and acquiring the appointed target interface element of the acquired interface by using the interface element identifier of the appointed target interface element, wherein the acquisition specifically comprises the following steps:
determining a root node of the tree structure;
traversing the tree structure based on the root node, and comparing the interface element identifier of the interface element corresponding to each node in the tree structure with the interface element identifier of the specified target interface element to search and obtain the specified target interface element.
In an embodiment, the configuration information further includes an interface element identifier of a preset target interface element; and collecting interface elements of the collected interface, specifically comprising:
and acquiring the preset target interface element for the acquired interface by using the interface element identification of the preset target interface element.
In an embodiment, entering the collected interface elements into the entered interface specifically includes:
and recording the collected interface elements into the recorded interface by calling a function UiObject.action (AccessabilityNodeInfo. ACTION _ SET _ TEXT, bundle) in the system architecture of the android operating system.
In an embodiment, the configuration information further includes position information of a position where the interface element is entered in the entered interface; and the number of the first and second groups,
inputting the collected interface elements into the input interface, which specifically comprises:
and according to the position information, inputting the interface element to a corresponding position in the input interface.
A second aspect of embodiments of the present application provides an electronic device, including:
a memory to store a computer program;
a processor configured to perform the method of any of the method embodiments of the present application.
The data processing method comprises the steps of obtaining configuration information, wherein the configuration information comprises acquired interface associated information and input interface associated information, associating the acquired interface according to the acquired interface associated information to acquire interface elements of the acquired interface, associating the input interface according to the input interface associated information to input the acquired interface elements into the input interface, and inputting the interface elements from the acquired interface to the input interface.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of an electronic device provided with a process automation robot RPA according to an embodiment of the present application;
fig. 3 is a schematic flowchart of a data processing method according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the present application, terms such as "first," "second," "third," and the like are used solely to distinguish one from another and are not to be construed as indicating or implying a relative importance or order.
As mentioned above, with the rapid development of internet technology, data is usually required to be entered from an interface of one Application (APP) to an interface of another APP. Therefore, how to implement the data entry process is a problem to be solved by the application.
For example, in the field of electronic commerce, a merchant usually sells goods on a plurality of different electronic commerce APPs, and at this time, data recorded on an interface of one electronic commerce APP needs to be recorded on an interface of another electronic commerce APP.
Based on this, the embodiment of the present application provides an electronic device 1, and as shown in fig. 1, a specific structural schematic diagram of the electronic device 1 is provided. The electronic device 1 includes: at least one processor 11 and a memory 12, one processor being exemplified in fig. 1. The processor 11 and the memory 12 may be connected by a bus 10, and the memory 12 stores instructions executable by the processor 11, the instructions being executed by the processor 11 to cause the electronic device 1 to perform all or part of the flow of the method in the embodiments described below.
In practical applications, the electronic device 1 may be a mobile phone, a tablet computer, a notebook computer, a desktop computer, or a large server or a server cluster formed by the mobile phone, the tablet computer, the notebook computer, the desktop computer, or the like.
The electronic device 1 is provided with an actuator APP, and for example, an installation package of the actuator APP may be downloaded from an application Store such as APP Store, and the actuator APP is installed on the electronic device 1 by using the installation package. The executor APP can implement a data transfer function between APPs, and specifically, for example, one or more Process automation robots RPA (robotic Process automation) may be further installed on the executor APP, so that data transfer between APPs is performed by the Process automation robots RPA.
For example, as shown in fig. 2, the electronic device 1 is provided with an executor APP, which is provided with 3 process automation robots RPA, respectively a process automation robot RPA1, a process automation robot RPA2 and a process automation robot RPA3, wherein the process automation robot RPA1 executes an interface for entering data from an interface of the APP1 into the APP2, the process automation robot RPA2 executes an interface for entering data from an interface of the APP3 into the APP4, and the process automation robot RPA3 executes an interface for entering data from an interface of the APP5 into the APP 6.
In practical application, for a process automation robot RPA on an actuator APP, a js (java script) script tool may be specifically used, and a specific workflow of data transfer between APPs is realized through the js script tool.
Fig. 3 is a flowchart illustrating a data processing method according to an embodiment of the present application, and some or all of the steps of the method may be performed by the electronic device 1 shown in fig. 1. In the method, data (interface elements) of an acquired interface in a data source APP are acquired and input to an input interface of a data recording APP. The method comprises the following steps:
step S21: and acquiring configuration information, wherein the configuration information comprises the acquired interface associated information and the input interface associated information.
Wherein the collected interface can be associated by utilizing the collected interface association information. In practical applications, the collected interface association information may be a Uniform Resource Locator (URL) of the collected interface, so that the collected interface may be associated by the URL; of course, the acquired interface association information may also be an APP identifier of the data source APP and an interface identifier of the acquired interface in the data source APP, so that the acquired interface in the data source APP may be associated through the APP identifier and the interface identifier.
The entered interface can be associated with the entered interface using the entered interface association information. In practical application, the entered interface association information may be a URL of the entered interface, so that the entered interface is associated by the URL; of course, the interface associated information to be entered may also be an APP identifier of the data recording APP and an interface identifier of an interface to be entered in the data recording APP, so that the interface to be entered in the data recording APP may be associated through the APP identifier and the interface identifier.
The APP identification can be used for uniquely identifying the corresponding APP, for example, the APP identification of the data source APP can uniquely identify the data source APP, and the APP identification of the data receiving and recording APP can uniquely identify the data receiving and recording APP. In practical applications, the APP identifier may be a name, a version number, a download address of the corresponding APP, or an identifier formed by a number, a character string, and the like capable of uniquely identifying the APP.
The APP generally includes multiple interfaces, for example, in an e-commerce APP, since a plurality of different commodities need to be displayed and sold, different commodity display interfaces need to be provided for each commodity, and the commodity display interfaces may include commodity names, commodity inventory quantities, commodity description information, commodity pictures, commodity prices, and the like, so as to display information related to the commodities, so as to facilitate commodity purchasers to select and purchase the commodities; for example, in the instant messaging APP, since information transmission and reception with a plurality of different friends or groups may be involved, a plurality of interfaces also need to be provided.
For each interface in the APP, a corresponding interface identifier may be generally set, so that the corresponding interface in the APP is uniquely identified by the interface identifier. For example, for each interface in the data source APP, a corresponding interface identifier may be set; and for each interface in the data recording APP, corresponding interface identifiers can be set respectively. In practical applications, the interface identifier of the interface may be a name, a number or an identifier capable of uniquely identifying the interface.
According to actual needs, any one of the interfaces of the data source APP can be used as a collected interface, each interface can be used as a collected interface in sequence, and a certain specified interface can be used as the collected interface. For example, when data of each interface of the data source APP needs to be entered into the data recording APP, each interface of the data source APP may be sequentially used as an acquired interface, or when data of a certain interface needs to be entered into the data recording APP, the interface may be used as an acquired interface.
Correspondingly, any one of the interfaces of the data recording APP can be used as an interface to be recorded, each interface can be used as an interface to be recorded in sequence, and a certain specified interface can be used as the interface to be recorded. For example, when data needs to be entered into each interface of the data recording APP, each interface in the data recording APP may be sequentially used as an interface to be entered, or when data needs to be entered into a certain interface, the interface may be used as an interface to be entered.
For example, the data source APP and the data recording APP are both e-commerce APPs, where the data source APP is e-commerce APP1, the data recording APP is e-commerce APP2, the e-commerce APP1 includes 3 commodity display interfaces, which are a1, a2, and A3, respectively, and the e-commerce APP2 includes 4 commodity display interfaces, which are B1, B2, B3, and B4, respectively; data of an A1 commodity display interface in an e-commerce APP1 needs to be recorded into a B1 commodity display interface in an e-commerce APP2, at this time, the A1 commodity display interface can be used as an acquired interface, and the B1 commodity display interface can be used as a recorded interface; or, the data of the commodity display interfaces a1, a2 and A3 in the e-commerce APP1 need to be respectively recorded into the commodity display interfaces B2, B3 and B4 in the e-commerce APP2, at this time, the commodity display interfaces a1, a2 and A3 may be sequentially used as the acquired interfaces, and the commodity display interfaces B2, B3 and B4 are correspondingly respectively used as the recorded interfaces.
Step S22: and associating the acquired interface according to the acquired interface association information so as to acquire the interface elements of the acquired interface.
Step S23: and associating the entered interface according to the associated information of the entered interface so as to enter the acquired interface elements into the entered interface.
Here, the step S22 and the step S23 can be collectively explained. The interface element is data which needs to be collected from the collected interface and is input into the input interface. For example, when the collected interface is a commodity display interface in the data source APP of the e-commerce type, the interface element may specifically include any one or more of the following elements: a name of the commodity; the quantity of the inventory of the goods; commodity description information; a commodity picture; the price of the goods. For example, the interface element may be a commodity name and a commodity price.
In practical application, because the acquired interface association information is different, there may be a plurality of ways to associate the acquired interface according to the acquired interface association information, for example, when the acquired interface association information is the URL of the acquired interface, the acquired interface may be determined according to the URL, and then the acquired interface may be acquired by the interface element; or, when the acquired interface associated information is the APP identifier of the data source APP and the interface identifier of the acquired interface in the data source APP, the acquired interface in the data source APP can be determined according to the APP identifier and the interface identifier, and then the acquired interface is used for acquiring the interface element of the acquired interface.
After the interface elements are collected, the entered interface can be associated according to the entered interface association information. In practical application, due to the difference of the associated information of the interface to be entered, there may be a plurality of ways to associate the interface to be entered according to the associated information of the interface to be entered. For example, when the associated information of the entered interface is a URL of the entered interface, the entered interface may be determined according to the URL, and is further used to enter the acquired interface element into the entered interface; or, when the interface associated information to be entered is the APP identifier of the data recording APP and the interface identifier of the interface to be entered in the data recording APP, the interface to be entered in the data recording APP can be determined according to the APP identifier and the interface identifier, and then the interface element is entered into the interface to be entered of the data recording APP.
In practical application, the data source APP and the data recording APP may be the same type of APP, such as both e-commerce type APPs and both instant messaging type APPs; and the interface layouts of the collected interface and the input interface can be the same or similar, so that the interface elements can be conveniently input into the input interface after the collected interface is collected.
For example, the acquired interface and the input interface are both commodity display interfaces, and the interface layout of the commodity display interface includes corresponding areas for displaying the commodity name, the commodity inventory quantity, the commodity description information, the commodity picture and the commodity price, so that the commodity name, the commodity inventory quantity, the commodity description information, the commodity picture and the commodity price are conveniently input to the input interface after being acquired from the acquired interface.
The data processing method comprises the steps of obtaining configuration information, wherein the configuration information comprises acquired interface associated information and input interface associated information, associating the acquired interface according to the acquired interface associated information to acquire interface elements of the acquired interface, associating the input interface according to the input interface associated information to input the acquired interface elements into the input interface, and inputting the interface elements from the acquired interface to the input interface.
In practical applications, after the collected interface elements are entered into the entered interface through the step S23, the method may further include presenting the entered interface after the interface elements are entered.
The interface elements are input into the interface, and the interface elements are input into the interface after being input into the interface, so that the interface elements are displayed before being issued, manual inspection or machine identification can be carried out on the displayed interface, whether the input missing or input mistakenly interface elements exist or not is determined, or whether the displayed interface is attractive or not is determined. The display may also be a publishing display, for example, after the interface element is entered into the entered interface, the entered interface is published on the client, so that the client can display the entered interface.
It should be noted that, when the acquired interface associated information is specifically an APP identifier of the data source APP and an interface identifier of an acquired interface in the data source APP, and the entered interface associated information is specifically an APP identifier of the data recording APP and an interface identifier of an entered interface in the data recording APP. At this moment, data are collected from the collected interface and are recorded into the recorded interface, data operation needs to be performed on third-party APPs (such as a data source APP and a data recording APP), and it is considered that data between the third-party APPs are isolated in the operating system, so that the data cannot be directly obtained, authorization of barrier-free service needs to be obtained first, namely, the authorization executor APP can operate on the data of the third-party APPs, including obtaining the data from the data source APP and recording the data recording APP.
Therefore, the method provided in this embodiment of the present application, before the obtaining the configuration information in step S21, the method may further include: authorization for barrier-free services in an operating system is obtained. The accessibility service (accessibility service) generally runs in the background of an operating system such as an android, so that an APP (e.g., an actuator APP) that acquires the authorization can receive an event callback notification sent by the operating system, for example, the APP that acquires the authorization can receive an event callback notification sent by the android operating system based on a method in an accessibility event (accessibility events), and the event callback notification is used for notifying the APP that receives the event callback notification that an active interface has changed. The method in the accessitivyevents may include TYPE _ WINDOW _ CONTENT _ CHANGED for notifying that the CONTENT of the WINDOW changes.
After obtaining authorization for the barrier-free service, a listening event corresponding to listening to an active interface of the electronic device is registered with the operating system. When the acquired interface in the data source APP is used as the active interface of the electronic device, after any change occurs to the active interface, the accessibiliteevents sends an event callback notification for the change of the active interface, so that the executor APP which acquires barrier-free service authorization can receive the event callback notification, and the event callback notification can notify the executor APP that the acquired interface which is the active interface has changed, so that the event callback notification can be used for representing that the acquired interface which is the active interface has changed.
At this time, when the executor APP receives the event callback notification, it is described that the active interface changes, and the method of the present application needs to be executed to enter the interface element of the acquired interface in the data source APP into the entered interface of the data recording APP. Therefore, the acquiring the configuration information in step S21 may specifically include: based on the obtained authorization of the barrier-free service, the executor APP obtains the configuration information when receiving the event callback notification, and then executes step S22 and step S23 to enter the interface element of the acquired interface in the data source APP into the entered interface of the data recording APP.
It should be further described that, the acquiring, by the executor APP, the interface element of the acquired interface of the data source APP may specifically include: the collected interface is obtained first, because the interface elements of the collected interface are usually arranged in a tree structure (that is, the interface elements of the collected interface are in a tree structure, and nodes in the tree structure and the interface elements in the collected interface can be in one-to-one correspondence), after the collected interface is obtained, a root node of the tree structure of the collected interface can be determined first by using the tree structure, and then the whole tree structure can be further traversed based on the root node, for example, the root node can be started, and extension search is sequentially performed on each leaf node, so that the interface elements required to be collected are searched and obtained, that is, the collection of the interface elements is performed.
Of course, after the interface element is collected, the attributes of the interface element, including the content Text of the interface element, the Id of the interface element, and the like, may be obtained.
Certainly, under the Android operating system, in order to implement the transfer of the interface element from the collected interface of the data source APP to the entered interface of the data recording APP, the process automation robot RPA generally needs to call a function in a system architecture (Android frame) of the Android operating system, for example, needs to call a function uiobject. And after the ui object TEXT collects an interface element, the ui object action (access availability nodeinfo, action _ SET _ TEXT, bundle) may be further called, and then the interface element may be transferred to the ui object action (access availability nodeinfo, action _ SET _ TEXT, bundle) through data transfer between functions, and the interface element may be entered into the entered interface through the ui object action (access availability nodeinfo, action _ SET _ TEXT, bundle).
The specific way to obtain the authorization of the barrier-free service in the operating system may be to first display an interface for requesting the authorization of the barrier-free service, and obtain the authorization of the barrier-free service in the operating system according to the operation of the user on the interface.
In addition, before obtaining the authorization of the barrier-free service in the operating system, it may be detected whether the authorization of the barrier-free service in the operating system is obtained, if not, the authorization of the barrier-free service in the operating system is obtained, and then step S21 is executed; if yes, go directly to step S21.
It should be further noted that, in the step S22, as to a specific manner of acquiring interface elements of the acquired interface of the data source APP, the interface elements may be acquired for all interface elements in the acquired interface, and at this time, all interface elements in the acquired interface are taken as an acquisition target; of course, the interface elements may also be collected from part of the interface elements in the collected interface, and only part of the interface elements in the collected interface is used as the collection target at this time.
For example, the collected interface is a product display interface including a product name, a product inventory quantity, product description information, a product picture, and a product price, and the product name, the product inventory quantity, the product description information, the product picture, and the product price may all be taken as the collection target, or only a part of them may be taken as the collection target.
There are generally many ways how to determine the acquisition target, and several of them can be listed here for illustration.
In a first mode, the acquisition target is preset, for example, the acquisition target may be preset in the configuration information. At this time, the configuration information may further include an interface element identifier of a preset target interface element (as a collection target).
Correspondingly, the interface element of the collected interface is collected, and specifically, the interface element identifier of the preset target interface element is used to collect the preset target interface element of the collected interface. Of course, the preset target interface element may also be all or part of the interface elements in the acquired interface.
For each interface element in the collected interface, the interface element can be distinguished through a corresponding interface element identifier, and in practical application, the interface element identifier may be position information, a unique identifier, a name, and the like of the corresponding interface element in the collected interface.
And in the second mode, the acquisition target is acquired through man-machine interaction. For example, a process automation robot RPA is arranged on the actuator APP, and data transfer between APPs is performed through the process automation robot RPA. In this way, a plurality of interface element input controls can be set on the operation interface of the actuator APP, wherein each interface element input control corresponds to a different interface element, a user can perform touch operations such as clicking, dragging, long-pressing and the like on each or some interface element input controls in the operation interface, and accordingly generate an input instruction, and the interface element pointed by the input instruction is an acquisition target.
Correspondingly, the interface element of the collected interface is collected, specifically, an input instruction input by touching a corresponding interface element input control in the operation interface is obtained, then according to the input instruction, an interface element identifier of a specified target interface element (as a collection target) corresponding to the touched interface element input control is determined, and then the interface element identifier of the specified target interface element is used for collecting the specified target interface element of the collected interface.
For example, a user inputs a control through a certain interface element in an operation interface of the touch actuator APP, at this time, the process automation robot RPA first acquires an input instruction input through the interface element input control by touch, then determines a specified target interface element corresponding to the interface element input control, and further performs collection of the specified target interface element on the collected interface.
In practical application, interface element input controls can be set on an operation interface of the actuator APP through arrangement and combination among instructions in an instruction set, after a user touches a certain interface element input control, manual operation is simulated through the instructions in the instruction set to generate a corresponding input instruction, wherein the instruction set can be stored in a json script mode, and therefore quick calling is facilitated.
It should be further explained that, the above mentioned acquiring, by the executor APP, the interface element of the acquired interface of the data source APP may specifically include: the method comprises the steps of firstly obtaining the collected interface, then determining a root node of a tree structure by utilizing the tree structure of the interface element of the collected interface, and then traversing the whole tree structure based on the root node so as to search and obtain the interface element required to be collected. The collection target determined in the first mode and the second mode is combined, that is, the collection target determined in the first mode and/or the second mode can be firstly utilized, then the tree structure of the collected interface elements is determined to determine the root node of the tree structure, then the whole tree structure is traversed based on the root node, and the interface element identifications of the interface elements corresponding to all the nodes in the tree structure are compared with the interface element identification of the collection target, so that the collection target is searched and obtained.
For example, traversing the tree structure based on the root node, and comparing the interface element identifier of the interface element corresponding to each node in the tree structure with the interface element identifier of the designated target interface element in the second way to search and obtain the designated target interface element; or, the interface element identifier of the interface element corresponding to each node in the tree structure may be compared with the interface element identifier of the preset target interface element in the first method, so as to search for and obtain the preset target interface element.
In addition, as mentioned in the above step S23, the collected interface elements are entered into an interface to be entered, and in practical applications, when the interface elements are entered into the interface to be entered, the process automation robot RPA may perform the following actions: the position information of the position of the interface element in the entered interface can be preset in the configuration information, so that the interface element can be entered into the corresponding position in the entered interface according to the position information because the configuration information comprises the position information. In practical application, the position information of the entered position in the entered interface may be a specific position of the entered position in the entered interface, or may be a certain page module of the entered position in the entered interface, or the like.
Based on the same inventive concept as the data processing method provided by the embodiment of the present application, the embodiment of the present application also provides a data processing apparatus, and for the embodiment of the apparatus, if it is unclear, the corresponding content of the embodiment of the method can be referred to. As shown in fig. 4, which is a specific structural diagram of the apparatus 30, the apparatus 30 includes: an acquisition unit 301, a collection unit 302 and an entry unit 303, wherein:
the acquiring unit 301 is configured to acquire configuration information, where the configuration information includes acquired interface association information and interface association information to be entered;
the acquisition unit 302 is configured to associate an acquired interface according to the acquired interface association information, so as to acquire interface elements of the acquired interface;
the entry unit 303 is configured to associate an entered interface according to the entered interface association information, so as to enter the acquired interface element into the entered interface.
With the device 30 provided in the embodiment of the present application, since the device 30 adopts the same inventive concept as the data processing method provided in the embodiment of the present application, on the premise that the data processing method can solve the technical problem, the device 30 can also solve the technical problem, and details thereof are not repeated here.
In addition, in practical applications, the technical effect obtained by combining the apparatus 30 with specific hardware devices, cloud technology, and the like is also within the scope of the present application, for example, different units in the apparatus 30 are distributed in different nodes in a distributed cluster by using a distributed cluster manner, so as to improve efficiency and the like.
In practical application, the collected interface association information specifically includes: the method comprises the steps of identifying APP identification of a data source APP and interface identification of an acquired interface in the data source APP; and/or the entered interface associated information specifically comprises: the data receiving and recording APP comprises an APP mark of the data receiving and recording APP and an interface mark of an interface to be recorded in the data receiving and recording APP.
Before the obtaining unit 301, the apparatus 30 may further include an authorization obtaining unit, configured to obtain authorization of barrier-free services in the operating system; then the process of the first step is carried out,
the obtaining unit 301 may specifically include an obtaining subunit, configured to obtain the configuration information, when receiving an event callback notification based on the obtained barrier-free service authorization, where the event callback notification is used to indicate that a collected interface serving as an active interface has changed.
The acquiring unit 302 may specifically include a root node determining subunit and an interface element acquiring subunit, where:
the root node determining subunit is used for determining a root node of the tree structure of the acquired interface; and the interface element acquisition subunit is used for traversing the tree structure by utilizing the root node so as to acquire the interface element.
In practical applications, the device 30 may be applied to a process automation robot RPA provided to the actuator APP.
The operating interface of the actuator APP is provided with a plurality of interface element input controls, wherein each interface element input control corresponds to different interface elements; and the number of the first and second groups,
the acquisition unit 302 may specifically include an input instruction acquisition subunit, a specified target interface element determination subunit, and a specified target interface element acquisition subunit, where:
the input instruction acquisition subunit is used for acquiring an input instruction input by touching an interface element input control in the operation interface; the specified target interface element determining subunit is used for determining the interface element identifier of the specified target interface element corresponding to the touch interface element input control according to the input instruction; and the appointed target interface element acquisition subunit is used for acquiring the appointed target interface element of the acquired interface by using the interface element identifier of the appointed target interface element.
In practical application, interface elements in the collected interface are usually arranged in a tree structure; and, the designated target interface element collection subunit may include a root node determination submodule and a designated target interface element collection submodule, wherein:
a root node determining submodule for determining a root node of the tree structure; a designated target interface element acquisition submodule, configured to traverse the tree structure based on the root node, and compare interface element identifiers of interface elements corresponding to each node in the tree structure with the interface element identifier of the designated target interface element, so as to search for and acquire the designated target interface element
The configuration information also comprises position information of the position of the interface element in the input interface; and the entry unit 303 may further include a first entry subunit, configured to enter the interface element to a corresponding position in the entered interface according to the position information.
Of course, the configuration information acquired by the acquiring unit 301 may further include an interface element identifier of a preset target interface element; and the acquisition unit 302 may further include a preset target interface element acquisition subunit, configured to acquire the preset target interface element for the acquired interface by using the interface element identifier of the preset target interface element.
After the entry unit 303, the apparatus 30 may further include a display unit, configured to display the entered interface after the interface element is entered.
The entry unit 303 may include an entry subunit, configured to enter the collected interface element into the entered interface by calling a function uiobject (action) in a system architecture of the android operating system.
An embodiment of the present invention further provides a storage medium, including: a program that, when run on an electronic device, causes the electronic device to perform all or part of the procedures of the methods in the above-described embodiments. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD), a Solid State Drive (SSD), or the like. The storage medium may also comprise a combination of memories of the kind described above.
Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope defined by the appended claims.
Claims (10)
1. A data processing method, comprising:
acquiring configuration information, wherein the configuration information comprises acquired interface associated information and input interface associated information;
associating the acquired interface according to the acquired interface association information so as to acquire interface elements of the acquired interface;
and associating the entered interface according to the associated information of the entered interface so as to enter the acquired interface elements into the entered interface.
2. The method of claim 1,
the collected interface association information specifically includes: the method comprises the steps of identifying APP identification of a data source APP and interface identification of an acquired interface in the data source APP; and/or the presence of a gas in the atmosphere,
the entered interface association information specifically includes: the data include APP's APP sign and the interface sign of being input the interface in the data include APP.
3. The method of claim 1, wherein prior to obtaining configuration information, the method further comprises: obtaining authorization of barrier-free service in an operating system; and the number of the first and second groups,
acquiring configuration information, specifically comprising:
based on the obtained authorization of the barrier-free service, obtaining the configuration information under the condition that an event callback notification is received, wherein the event callback notification is used for representing that the collected interface as an active interface has changed.
4. The method according to claim 1, characterized in that it is applied to a process automation robot RPA provided to an actuator APP.
5. The method according to claim 4, characterized in that the operation interface of the actuator APP is provided with a plurality of interface element input controls, wherein each interface element input control corresponds to a different interface element; and (c) a second step of,
collecting interface elements of the collected interface, specifically comprising:
acquiring an input instruction input by touching an interface element input control in the operation interface;
according to the input instruction, determining an interface element identifier of a specified target interface element corresponding to the touch interface element input control;
and acquiring the appointed target interface element of the acquired interface by using the interface element identifier of the appointed target interface element.
6. The method of claim 5, wherein the interface elements in the collected interface are arranged in a tree structure; and the number of the first and second groups,
acquiring the specified target interface element of the acquired interface by using the interface element identifier of the specified target interface element, wherein the acquisition specifically comprises the following steps:
determining a root node of the tree structure;
traversing the tree structure based on the root node, and comparing the interface element identifier of the interface element corresponding to each node in the tree structure with the interface element identifier of the specified target interface element to search and obtain the specified target interface element.
7. The method of claim 1, wherein the configuration information further comprises an interface element identifier of a preset target interface element; and (c) a second step of,
collecting interface elements of the collected interface, specifically comprising:
and acquiring the preset target interface element for the acquired interface by using the interface element identification of the preset target interface element.
8. The method according to claim 1, wherein entering the collected interface elements into the entered interface includes:
and recording the collected interface elements into the recorded interface by calling a function UiObject.action (Access availability NodeInfo. action _ SET _ TEXT, bundle) in a system architecture of the android operating system.
9. The method of claim 1, wherein the configuration information further comprises location information of a location in the entered interface where the interface element is entered; and the number of the first and second groups,
entering the collected interface elements into the entered interface, specifically including:
and according to the position information, inputting the interface element to a corresponding position in the input interface.
10. An electronic device, comprising:
a memory to store a computer program;
a processor to perform the method of any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210207275.7A CN114637448B (en) | 2022-03-04 | 2022-03-04 | Data processing method, device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210207275.7A CN114637448B (en) | 2022-03-04 | 2022-03-04 | Data processing method, device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114637448A true CN114637448A (en) | 2022-06-17 |
| CN114637448B CN114637448B (en) | 2023-04-21 |
Family
ID=81947879
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210207275.7A Active CN114637448B (en) | 2022-03-04 | 2022-03-04 | Data processing method, device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114637448B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115269107A (en) * | 2022-09-30 | 2022-11-01 | 北京弘玑信息技术有限公司 | Method, medium and electronic device for processing interface image |
| CN115686540A (en) * | 2023-01-03 | 2023-02-03 | 杭州实在智能科技有限公司 | RPA control method and system based on Hongmong system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105607799A (en) * | 2015-12-15 | 2016-05-25 | 深圳市永兴元科技有限公司 | Data processing method and apparatus |
| US20180341380A1 (en) * | 2015-12-09 | 2018-11-29 | Alibaba Group Holding Limited | System, method, and apparatus for configuring attributes of interface elements |
| CN112199562A (en) * | 2020-10-23 | 2021-01-08 | 上海意略明数字科技股份有限公司 | Method and device for acquiring and processing operation information of terminal, storage medium and computer equipment |
| CN112231663A (en) * | 2020-03-31 | 2021-01-15 | 北京来也网络科技有限公司 | Data acquisition method, device, equipment and storage medium combining RPA and AI |
| CN112765165A (en) * | 2020-12-30 | 2021-05-07 | 未鲲(上海)科技服务有限公司 | Data entry method and device, equipment and computer readable storage medium |
| CN113505228A (en) * | 2021-07-22 | 2021-10-15 | 上海弘玑信息技术有限公司 | Multi-dimensional text data classification method, training method and device |
-
2022
- 2022-03-04 CN CN202210207275.7A patent/CN114637448B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180341380A1 (en) * | 2015-12-09 | 2018-11-29 | Alibaba Group Holding Limited | System, method, and apparatus for configuring attributes of interface elements |
| CN105607799A (en) * | 2015-12-15 | 2016-05-25 | 深圳市永兴元科技有限公司 | Data processing method and apparatus |
| CN112231663A (en) * | 2020-03-31 | 2021-01-15 | 北京来也网络科技有限公司 | Data acquisition method, device, equipment and storage medium combining RPA and AI |
| CN112199562A (en) * | 2020-10-23 | 2021-01-08 | 上海意略明数字科技股份有限公司 | Method and device for acquiring and processing operation information of terminal, storage medium and computer equipment |
| CN112765165A (en) * | 2020-12-30 | 2021-05-07 | 未鲲(上海)科技服务有限公司 | Data entry method and device, equipment and computer readable storage medium |
| CN113505228A (en) * | 2021-07-22 | 2021-10-15 | 上海弘玑信息技术有限公司 | Multi-dimensional text data classification method, training method and device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115269107A (en) * | 2022-09-30 | 2022-11-01 | 北京弘玑信息技术有限公司 | Method, medium and electronic device for processing interface image |
| CN115686540A (en) * | 2023-01-03 | 2023-02-03 | 杭州实在智能科技有限公司 | RPA control method and system based on Hongmong system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114637448B (en) | 2023-04-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11474926B2 (en) | Method and system for measuring user engagement with content items | |
| CN110708346B (en) | Information processing system and method | |
| CN114637448B (en) | Data processing method, device, electronic equipment and storage medium | |
| CA2861616C (en) | Method and system to provide a scroll map | |
| US8799796B2 (en) | System and method for generating graphical dashboards with drill down navigation | |
| US9176726B2 (en) | Method and apparatus for developing, distributing and executing applications | |
| US20110231819A1 (en) | Content Availability Determination, Representation And Acquisition System | |
| US20140249935A1 (en) | Systems and methods for forwarding users to merchant websites | |
| US20200050540A1 (en) | Interactive automation test | |
| CN109408754B (en) | Webpage operation data processing method and device, electronic equipment and storage medium | |
| CN107797918A (en) | Method of testing and test device | |
| CN111428131A (en) | Information pushing method, device and system | |
| JP2002149854A (en) | Information collection system | |
| CN112817817B (en) | Buried point information query method, buried point information query device, computer equipment and storage medium | |
| JP5853828B2 (en) | Workflow creation method, program | |
| US20090055770A1 (en) | Navigation systems with event notification | |
| CN111402000B (en) | Service page generation method, device and system and computer system | |
| US20230153179A1 (en) | Visitor stitching with data science notebooks | |
| JP4681673B1 (en) | Operation verification apparatus, operation verification method, and operation verification program | |
| US8479222B2 (en) | Simplifying interaction with multiple applications when using forms via a common interface | |
| CN112083982A (en) | Information processing method and device | |
| CN115860877A (en) | Product marketing method, device, equipment and medium | |
| CN111310093B (en) | Information processing method and device, electronic equipment and storage medium | |
| CN113079046A (en) | Data access method and device, electronic equipment and medium | |
| CN111222067B (en) | Information generation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |