CN114637448B - Data processing method, device, electronic equipment and storage medium - Google Patents

Data processing method, device, electronic equipment and storage medium Download PDF

Info

Publication number
CN114637448B
CN114637448B CN202210207275.7A CN202210207275A CN114637448B CN 114637448 B CN114637448 B CN 114637448B CN 202210207275 A CN202210207275 A CN 202210207275A CN 114637448 B CN114637448 B CN 114637448B
Authority
CN
China
Prior art keywords
interface
app
acquired
interface element
entered
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210207275.7A
Other languages
Chinese (zh)
Other versions
CN114637448A (en
Inventor
王玉玲
郑凌厉
肖建博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Hongji Information Technology Co Ltd
Original Assignee
Shanghai Hongji Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Hongji Information Technology Co Ltd filed Critical Shanghai Hongji Information Technology Co Ltd
Priority to CN202210207275.7A priority Critical patent/CN114637448B/en
Publication of CN114637448A publication Critical patent/CN114637448A/en
Application granted granted Critical
Publication of CN114637448B publication Critical patent/CN114637448B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/543—User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE]
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

The application provides a data processing method, a data processing device, electronic equipment and a storage medium. The method comprises the following steps: acquiring configuration information, wherein the configuration information comprises collected interface association information and entered interface association information; associating the acquired interface according to the acquired interface association information, so as to acquire interface elements of the acquired interface; and associating the entered interface according to the entered interface association information, so as to be used for entering the acquired interface elements into the entered interface. Therefore, the interface elements can be input from the acquired interface to the input interface, and the problems in the prior art are solved.

Description

Data processing method, device, electronic equipment and storage medium
Technical Field
The present application relates to the field of internet technologies, and in particular, to a data processing method, apparatus, electronic device, and storage medium.
Background
With the rapid development of internet technology, it is often necessary to enter data from the interface of one Application (APP) to the interface of another APP. Thus, how to implement this data entry process is a problem that needs to be addressed by the present application.
Disclosure of Invention
An embodiment of the application aims to provide a data processing method, a data processing device, electronic equipment and a storage medium, which are used for solving the problems in the prior art.
An embodiment of the present application provides a data processing method, including:
acquiring configuration information, wherein the configuration information comprises collected interface association information and entered interface association information;
associating the acquired interface according to the acquired interface association information, so as to acquire interface elements of the acquired interface;
and associating the entered interface according to the entered interface association information, so as to be used for entering the acquired interface elements into the entered interface.
In one embodiment, the collected interface association information specifically includes: APP identification of the data source APP and interface identification of the acquired interface in the data source APP; and/or the number of the groups of groups,
the entered interface association information specifically comprises: APP identification of the data listing APP and interface identification of the entered interface in the data listing APP.
In an embodiment, before acquiring the configuration information, the method further comprises: acquiring authorization of barrier-free service in an operating system; the method comprises the steps of,
the method for acquiring the configuration information specifically comprises the following steps:
and acquiring the configuration information under the condition of receiving an event callback notification based on the acquired authorization of the barrier-free service, wherein the event callback notification is used for representing that the acquired interface serving as the active interface has changed.
In one embodiment, the method is applied to a process automation robot RPA provided to an actuator APP.
In an embodiment, the operation interface of the executor APP is provided with a plurality of interface element input controls, where each interface element input control corresponds to a different interface element respectively; the method comprises the steps of,
the interface element collection of the collected interface specifically comprises the following steps:
acquiring an input instruction input by touching an interface element input control in the operation interface;
according to the input instruction, determining an interface element identifier of a specified target interface element corresponding to the interface element input control;
and acquiring the designated target interface element of the acquired interface by utilizing the interface element identification of the designated target interface element.
In an embodiment, the interface elements in the collected interface are arranged in a tree structure; and acquiring the designated target interface element of the acquired interface by utilizing the interface element identifier of the designated target interface element, and specifically comprises the following steps:
determining a root node of the tree structure;
traversing the tree structure based on the root node, and comparing interface element identifiers of interface elements corresponding to nodes in the tree structure with the interface element identifiers of the specified target interface elements to find and acquire the specified target interface elements.
In an embodiment, the configuration information further includes an interface element identifier of a preset target interface element; and collecting interface elements of the collected interface, which specifically comprises:
and acquiring the preset target interface element of the acquired interface by utilizing the interface element identification of the preset target interface element.
In one embodiment, the step of inputting the collected interface element into the input interface specifically includes:
the acquired interface elements are entered into the entered interface by calling a function uiobject.action (accessibilitynodeinfo.action_set_text, bundle) in the system architecture of the android operating system.
In an embodiment, the configuration information further includes location information of a entered location of the interface element in the entered interface; the method comprises the steps of,
entering the acquired interface elements into the entered interface specifically comprises:
and according to the position information, inputting the interface element to a corresponding position in the input interface.
A second aspect of an embodiment of the present application provides an electronic device, including:
a memory for storing a computer program;
a processor configured to perform a method according to any one of the method embodiments of the present application.
By adopting the data processing method provided by the embodiment of the application, the configuration information comprises the acquired interface association information and the recorded interface association information, then the acquired interface is associated according to the acquired interface association information so as to be used for acquiring the interface element of the acquired interface, and then the recorded interface is associated according to the recorded interface association information so as to be used for recording the acquired interface element into the recorded interface, so that the interface element can be recorded from the acquired interface to the recorded interface, and the problem in the prior art is solved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and should not be considered as limiting the scope, and other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of an electronic device provided with a process automation robot RPA according to an embodiment of the present application;
FIG. 3 is a schematic flow chart of a data processing method according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram of a specific structure of a data processing apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the present application, terms such as "first," "second," "third," and the like are used merely to distinguish between descriptions and are not to be construed as indicating or implying relative importance or order.
As previously mentioned, with the rapid development of internet technology, it is often necessary to enter data from the interface of one Application (APP) to the interface of another APP. Thus, how to implement this data entry process is a problem that needs to be addressed by the present application.
For example, in the field of electronic commerce, a merchant typically sells goods on a plurality of different electronic commerce APP, and at this time, data entered on an interface of one electronic commerce APP needs to be entered on an interface of another electronic commerce APP.
Based on this, an embodiment of the present application provides an electronic device 1, and as shown in fig. 1, a specific structural schematic diagram of the electronic device 1 is shown. The electronic device 1 includes: at least one processor 11 and a memory 12, one processor being exemplified in fig. 1. The processor 11 and the memory 12 may be connected by a bus 10, the memory 12 storing instructions executable by the processor 11, the instructions being executable by the processor 11 to cause the electronic device 1 to perform all or part of the flow of the method in the embodiments described below.
In practical applications, the electronic device 1 may be a mobile phone, a tablet computer, a notebook computer, a desktop computer, or a large server or a server cluster formed by the same.
The electronic device 1 is provided with an actuator APP, for example, an installation package of the actuator APP can be downloaded from an application Store such as an APP Store, and the actuator APP can be installed on the electronic device 1 by using the installation package. The executor APP can realize the inter-APP data transfer function, and specifically, for example, one or more process automation robots RPA (Robotic Process Automation) may be further installed on the executor APP, so that the inter-APP data transfer is performed by the process automation robots RPA.
For example, as shown in fig. 2, the electronic device 1 is provided with an executor APP, 3 process automation robots RPA are provided on the executor APP, and are respectively a process automation robot RPA1, a process automation robot RPA2 and a process automation robot RPA3, wherein the process automation robot RPA1 performs an interface for inputting data from an interface of APP1 to an interface of APP2, the process automation robot RPA2 performs an interface for inputting data from an interface of APP3 to an interface of APP4, and the process automation robot RPA3 performs an interface for inputting data from an interface of APP5 to an interface of APP 6.
In practical applications, the process automation robot RPA on the executor APP may be generally specifically a js (java script) scripting tool, through which a specific workflow for data transfer between APPs is implemented.
Fig. 3 is a schematic flow chart of a data processing method according to an embodiment of the present application, and some or all steps of the method may be performed by the electronic device 1 shown in fig. 1. In the method, data (interface elements) of a collected interface in a data source APP are collected and are input to an input interface of a data recording APP. The method comprises the following steps:
step S21: configuration information is acquired, wherein the configuration information comprises collected interface association information and entered interface association information.
Wherein the collected interface association information can be utilized to associate the collected interface. In practical applications, the collected interface association information may be a uniform resource locator (Uniform Resource Locator, URL) of the collected interface, so that the collected interface may be associated by the URL; of course, the collected interface association information may also be an APP identifier of the data source APP and an interface identifier of a collected interface in the data source APP, so that the collected interface in the data source APP may be associated by the APP identifier and the interface identifier.
The entered interface can be associated with the entered interface association information. In practical applications, the entered interface association information may be a URL of the entered interface, so that the entered interface is associated by the URL; of course, the entered interface association information may also be an APP identifier of the data listing APP and an interface identifier of an entered interface in the data listing APP, so that the entered interface in the data listing APP may be associated by the APP identifier and the interface identifier.
The APP identifier can be used for uniquely identifying a corresponding APP, for example, the APP identifier of the data source APP can uniquely identify the data source APP, and the APP identifier of the data record APP can uniquely identify the data record APP. In practical applications, the APP identifier may be a name, version number, download address of the corresponding APP, or an identifier configured by a number, a character string, or the like capable of uniquely identifying the APP.
In APP, for example, in APP of electronic commerce, since a plurality of different commodities need to be displayed and sold, different commodity display interfaces need to be provided for the various commodities respectively, and the commodity display interfaces can include commodity names, commodity inventory numbers, commodity description information, commodity pictures, commodity prices and the like, so that information related to the commodities is displayed, and a commodity purchaser can conveniently select and purchase the commodities; for example, in the instant messaging APP, since information may be transmitted and received between a plurality of different friends or groups, a plurality of interfaces need to be provided.
For each interface in an APP, a corresponding interface identifier may typically be provided, such that the corresponding interface in the APP is uniquely identified by the interface identifier. For example, for each interface in the data source APP, a corresponding interface identifier may be set respectively; for each interface in the data recording APP, corresponding interface identifiers can be respectively set. In practical applications, the interface identifier of the interface may be a name, a number, or an identifier capable of uniquely identifying the interface.
According to actual needs, any one of the interfaces of the data source APP can be used as a collected interface, the interfaces can be sequentially used as collected interfaces, and a certain designated interface can be used as the collected interface. For example, when data of each interface of the data source APP is required to be recorded into the data recording APP, each interface in the data source APP can be sequentially used as a collected interface respectively, or when data of a certain interface is required to be recorded into the data recording APP, the interface can be used as a collected interface.
Accordingly, any one of the interfaces of the data recording APP can be used as an input interface, each of the interfaces can be sequentially used as input interfaces, or a specific interface can be used as the input interface. For example, when data is required to be input to each interface of the data recording APP, each interface in the data recording APP may be sequentially used as an input interface, or when data is required to be input to a certain interface, the interface may be used as an input interface.
For example, the data source APP and the data recording APP are both electronic commerce APP, wherein the data source APP is electronic commerce APP1, the data recording APP is electronic commerce APP2, the electronic commerce APP1 comprises 3 commodity display interfaces, namely A1, A2 and A3, and the electronic commerce APP2 comprises 4 commodity display interfaces, namely B1, B2, B3 and B4; the data of the A1 commodity display interface in the electronic commerce APP1 is required to be input into the B1 commodity display interface in the electronic commerce APP2, and at the moment, the A1 commodity display interface can be used as a collected interface, and the B1 commodity display interface can be used as an input interface; or, the data of the commodity display interfaces A1, A2 and A3 in the electronic commerce APP1 are required to be respectively input into the commodity display interfaces B2, B3 and B4 in the electronic commerce APP2, and at the moment, the commodity display interfaces A1, A2 and A3 can be sequentially used as acquired interfaces, and the commodity display interfaces B2, B3 and B4 can be correspondingly used as input interfaces.
Step S22: and associating the acquired interface according to the acquired interface association information so as to acquire interface elements of the acquired interface.
Step S23: associating the entered interface according to the entered interface association information for entering the acquired interface element into the entered interface.
Here, step S22 and step S23 can be collectively described. The interface element is the data which needs to be collected from the collected interface and is input to the input interface. For example, when the collected interface is a merchandise display interface in the data source APP of the e-commerce class, the interface element may specifically include any one or more of the following elements: a commodity name; commodity stock quantity; commodity description information; commodity pictures; commodity price. For example, the interface element may be a commodity name and a commodity price.
In practical application, because of different collected interface association information, a collected interface can be associated according to the collected interface association information in a plurality of modes, for example, when the collected interface association information is a URL of the collected interface, the collected interface can be determined according to the URL, so as to be further used for collecting interface elements of the collected interface; or when the collected interface association information is the APP identifier of the data source APP and the interface identifier of the collected interface in the data source APP, the collected interface in the data source APP can be determined according to the APP identifier and the interface identifier, and then the collected interface is used for collecting interface elements of the collected interface.
After the interface elements are collected, the entered interfaces may be associated according to entered interface association information. In practical applications, due to the difference of the input interface association information, there may also be multiple ways to associate the input interface according to the input interface association information. For example, when the information related to the entered interface is a URL of the entered interface, the entered interface may be determined according to the URL, so as to be used for entering the acquired interface element into the entered interface; or when the recorded interface association information is the APP identifier of the data recording APP and the interface identifier of the recorded interface in the data recording APP, the recorded interface in the data recording APP can be determined according to the APP identifier and the interface identifier, and then the interface element is recorded into the recorded interface of the data recording APP.
In practical application, the data source APP and the data recording APP can be the same type of APP, such as e-commerce APP, or instant messaging APP; and the interface layout of the acquired interface and the input interface can be the same or similar, so that the input of the interface element to the input interface is facilitated after the acquired interface is acquired.
For example, the collected interface and the input interface are both commodity display interfaces, and the interface layout of the commodity display interfaces comprises corresponding areas for displaying commodity names, commodity inventory numbers, commodity description information, commodity pictures and commodity prices, so that the input interface is convenient to input after the commodity names, the commodity inventory numbers, the commodity description information, the commodity pictures and the commodity prices are collected from the collected interface.
By adopting the data processing method provided by the embodiment of the application, the configuration information comprises the acquired interface association information and the recorded interface association information, then the acquired interface is associated according to the acquired interface association information so as to be used for acquiring the interface element of the acquired interface, and then the recorded interface is associated according to the recorded interface association information so as to be used for recording the acquired interface element into the recorded interface, so that the interface element can be recorded from the acquired interface to the recorded interface, and the problem in the prior art is solved.
In practical application, after the collected interface elements are input to the input interface through step S23, the method may further include displaying the input interface after the input interface elements are input.
Before release, the input interface after inputting the interface element is displayed, so that manual inspection, machine identification and the like can be performed on the displayed interface, whether the interface element which is missed to be input or wrongly recorded is determined, whether the displayed interface is attractive or not is determined, and the like. The presentation may also be a release presentation, for example, after the interface element is entered into the entered interface, the entered interface is released at the client, so that the client can present the entered interface.
The method is characterized in that the collected interface association information is specifically an APP identifier of a data source APP and an interface identifier of a collected interface in the data source APP, and the input interface association information is specifically an APP identifier of a data recording APP and an interface identifier of an input interface in the data recording APP. At this time, data are collected from the collected interface and are input to the input interface, data operation is required to be performed on the third party APP (such as a data source APP and a data recording APP), the data cannot be directly obtained due to the fact that the data between the third party APP are isolated in the operating system layer, authorization of barrier-free service is required to be obtained first, namely an authorization executor APP can operate on the data of the third party APP, the data are obtained from the data source APP, and the data are input into the data recording APP.
Therefore, the method provided in the embodiment of the present application, before the configuration information is acquired in step S21, the method may further include: and obtaining authorization of the barrier-free service in the operating system. The barrier-free service (AccessibilityService) generally runs in the background of an operating system such as android, so that an APP (such as an executor APP) that acquires the authorization can receive an event callback notification sent by the operating system, for example, the APP that acquires the authorization can receive an event callback notification sent by the android operating system based on a method in an accessibility event (AccessibilityEvents), and the event callback notification is used for notifying the APP that receives the event callback notification, and the active interface has changed. Wherein the method in the AccessibilityEvents may include type_window_content_changed for notifying that the WINDOW CONTENT is CHANGED.
After the authorization of the barrier-free service is obtained, a listening event is registered with the operating system, wherein the listening event is aimed at the active interface of the electronic device. When the acquired interface in the data source APP is used as an active interface of the electronic equipment, after any change occurs in the active interface, the accessibilitiyEvents can send event callback notification aiming at the change of the active interface, so that the executor APP which acquires barrier-free service authorization can receive the event callback notification, the event callback notification can inform the executor APP that the acquired interface serving as the active interface has changed, and therefore the event callback notification can be used for representing that the acquired interface serving as the active interface has changed.
At this time, the executor APP indicates that the active interface is changed when receiving the event callback notification, and the method of the application needs to be executed, and the interface element of the acquired interface in the data source APP is input to the input interface of the data recording APP. Thus, the acquiring configuration information in step S21 may specifically include: based on the obtained authorization of the barrier-free service, the executor APP obtains the configuration information under the condition of receiving the event callback notification, and further executes step S22 and step S23, and the interface elements of the acquired interface in the data source APP are input to the input interface of the data receiving APP.
It should be further described that, the collection of interface elements by the executor APP on the collected interface of the data source APP may specifically include: the acquired interface is acquired firstly, and because the interface elements of the acquired interface are generally arranged in a tree structure (i.e. the interface elements of the acquired interface are in a tree structure, and nodes in the tree structure and the interface elements in the acquired interface can be in one-to-one correspondence), after the acquired interface is acquired, the root node of the tree structure of the acquired interface can be determined firstly by using the tree structure, then the whole tree structure can be traversed based on the root node, for example, the tree structure can be sequentially extended and searched from the root node to each leaf node, and then the interface elements needing to be acquired are searched and acquired, namely the acquisition of the interface elements is performed.
Of course, after the interface element is collected, each attribute of the interface element may be obtained, including the content Text of the interface element, the Id of the interface element, and so on.
Of course, under the android operating system, in order to transfer interface elements from the acquired interface of the data source APP to the input interface of the data recording APP, the process automation robot RPA generally needs to call functions in a system architecture (Android framework) of the android operating system, such as a function uiobject.text and a function uiobject.action (accessibilitynodeinfo.action_set_text, bundle), where the interface elements in the acquired interface may be acquired by calling uiobject.text, so as to acquire the interface elements of the acquired interface; and after the UiObject. TEXT collects the interface element, may further call UiObject. Action (Access ibilyinodeinfo. Action_SET_TEXT, bundle), then pass the interface element to UiObject. Action (Access ibilyinodeinfo. Action_SET_TEXT, bundle) through data transfer between functions, and enter the interface element to the entered interface through UiObject. Action (Access ibilyinodeinfo. Action_SET_TEXT, bundle).
The specific way to obtain the authorization of the barrier-free service in the operating system may be to first display an interface for requesting the authorization of the barrier-free service, and obtain the authorization of the barrier-free service in the operating system according to the operation of the user on the interface.
In addition, before the authorization of the barrier-free service in the operating system is obtained, whether the authorization of the barrier-free service in the operating system is obtained can be detected, if not, the authorization of the barrier-free service in the operating system is obtained, and then the step S21 is executed; if yes, step S21 is directly performed.
It should be further noted that, in the step S22, a specific manner of collecting the interface elements of the collected interface of the data source APP may be to collect all the interface elements of the collected interface, where all the interface elements of the collected interface are taken as the collection targets; of course, the collection of the interface elements may be performed on a part of the interface elements in the collected interface, and only the part of the interface elements in the collected interface is used as the collection target.
For example, the collected interface is a commodity display interface including commodity names, commodity inventory numbers, commodity description information, commodity pictures and commodity prices, and the commodity names, the commodity inventory numbers, the commodity description information, the commodity pictures and the commodity prices can be all used as collection targets, or only parts of the collected interfaces can be used as collection targets.
There are generally a number of ways to determine the acquisition targets, and several are described herein.
In one mode, an acquisition target is preset, for example, the acquisition target may be preset in the configuration information. At this time, the configuration information may further include an interface element identifier of a preset target interface element (as a collection target).
Correspondingly, the interface element collection is performed on the collected interface, which may specifically be that the interface element identification of the preset target interface element is utilized to collect the preset target interface element on the collected interface. Of course, the preset target interface element may also be all or part of the interface elements in the acquired interface.
For each interface element in the collected interface, the interface element identification can be distinguished through the corresponding interface element identification, and in practical application, the interface element identification can be position information, a unique identifier, a name and the like of the corresponding interface element in the collected interface.
And in a second mode, acquiring the acquisition target through man-machine interaction. For example, the executor APP is provided with a process automation robot RPA, and data transfer between APPs is executed by the process automation robot RPA. In this way, a plurality of interface element input controls can be set on the operation interface of the executor APP, where each interface element input control corresponds to a different interface element, and a user can perform touch operations such as clicking, dragging, long-press and the like on each or part of the interface element input controls in the operation interface, so as to correspondingly generate an input instruction, and an interface element pointed by the input instruction is an acquisition target.
Correspondingly, the interface element of the collected interface is collected, which comprises the steps of firstly obtaining an input instruction input by touching a corresponding interface element input control in the operation interface, then determining an interface element identifier of a designated target interface element (serving as a collection target) corresponding to the touched interface element input control according to the input instruction, and then collecting the designated target interface element of the collected interface by utilizing the interface element identifier of the designated target interface element.
For example, a user inputs a control through a certain interface element in an operation interface of the touch actuator APP, at this time, the process automation robot RPA firstly acquires the input instruction input by touching the interface element input control, then determines a designated target interface element corresponding to the interface element input control, and further acquires the designated target interface element from the acquired interface.
In practical application, interface element input controls can be set through arrangement and combination among all instructions in an instruction set, after a user touches a certain interface element input control, manual operation is simulated through the instructions in the instruction set and instructions to generate corresponding input instructions, wherein the instruction set can be stored in a json script mode, and therefore quick calling is facilitated.
It should be further noted that, the above mentioned collection of interface elements by the executor APP on the collected interface of the data source APP may specifically include: firstly acquiring the acquired interface, then determining a root node of the tree structure by utilizing the tree structure of the acquired interface elements, and then traversing the whole tree structure based on the root node, so as to find and acquire the interface elements required to be acquired. The collection targets determined in the first and second modes are combined, that is, the collection targets determined in the first and/or second modes can be firstly utilized, then the tree structure of the interface elements to be collected is determined to determine the root node of the tree structure, then the whole tree structure is traversed based on the root node, and the interface element identifiers of the interface elements corresponding to the nodes in the tree structure are compared with the interface element identifiers of the collection targets, so that the collection targets are searched and obtained.
For example, traversing the tree structure based on the root node, and comparing the interface element identifiers of the interface elements corresponding to each node in the tree structure with the interface element identifiers of the specified target interface elements in the second mode to find and acquire the specified target interface elements; or, the interface element identifiers of the interface elements corresponding to the nodes in the tree structure can be compared with the interface element identifiers of the preset target interface elements in the first mode to find and obtain the preset target interface elements.
In addition, referring to the above-mentioned step S23, when the collected interface element is entered into the entered interface, in practical application, the process automation robot RPA may perform the following actions: the location information of the entered location of the interface element in the entered interface may be preset in the configuration information, so that since the configuration information includes the location information, the interface element may be entered into the corresponding location in the entered interface according to the location information. In practical application, the position information of the entered position in the entered interface may be a specific azimuth of the entered position in the entered interface, or may be a page module of the entered position in the entered interface, etc.
Based on the same inventive concept as the data processing method provided in the embodiments of the present application, the embodiments of the present application also provide a data processing apparatus, for which, if not clear, reference may be made to the corresponding content of the method embodiments. As shown in fig. 4, which is a schematic structural diagram of the apparatus 30, the apparatus 30 includes: an acquisition unit 301, an acquisition unit 302 and an entry unit 303, wherein:
the acquiring unit 301 is configured to acquire configuration information, where the configuration information includes acquired interface association information and entered interface association information;
the collection unit 302 is configured to associate a collected interface according to the collected interface association information, so as to collect interface elements of the collected interface;
the input unit 303 is configured to associate an input interface according to the input interface association information, so as to input the acquired interface element into the input interface.
By adopting the device 30 provided in the embodiment of the present application, since the device 30 adopts the same inventive concept as the data processing method provided in the embodiment of the present application, on the premise that the data processing method can solve the technical problem, the device 30 can also solve the technical problem, which is not described herein again.
In addition, in practical application, the technical effects obtained by combining the device 30 with specific hardware devices, cloud technology and the like are also within the protection scope of the application, for example, different units in the device 30 are distributed in different nodes in the distributed cluster in a distributed cluster mode, so that the efficiency and the like are improved.
In practical application, the collected interface association information specifically includes: APP identification of the data source APP and interface identification of the acquired interface in the data source APP; and/or, the entered interface association information specifically includes: APP identification of the data listing APP and interface identification of the entered interface in the data listing APP.
The apparatus 30 may further comprise, prior to the acquisition unit 301, an authorization acquisition unit for acquiring authorization of the barrier-free service in the operating system; then the first time period of the first time period,
the obtaining unit 301 may specifically include an obtaining subunit, configured to obtain the configuration information based on the obtained authorization of the barrier-free service, where the configuration information is obtained when an event callback notification is received, where the event callback notification is used to indicate that an acquired interface serving as an active interface has changed.
The collection unit 302 may specifically include a root node determination subunit and an interface element collection subunit, where:
a root node determining subunit, configured to determine a root node of a tree structure of the collected interface; and the interface element acquisition subunit is used for traversing the tree structure by utilizing the root node and acquiring the interface element.
In practical applications, the apparatus 30 may be applied to a process automation robot RPA provided to an actuator APP.
The operation interface of the executor APP is provided with a plurality of interface element input controls, wherein each interface element input control corresponds to different interface elements respectively; the method comprises the steps of,
acquisition unit 302 may specifically include an input instruction acquisition subunit, a specified target interface element determination subunit, and a specified target interface element acquisition subunit, where:
the input instruction acquisition subunit is used for acquiring an input instruction input by touching an interface element input control in the operation interface; a designated target interface element determining subunit, configured to determine, according to the input instruction, an interface element identifier of a designated target interface element corresponding to the interface element input control that is touched; and the designated target interface element acquisition subunit is used for acquiring the designated target interface element from the acquired interface by utilizing the interface element identifier of the designated target interface element.
In practical application, the interface elements in the collected interface are generally arranged in a tree structure; and, the specified target interface element acquisition sub-unit may include a root node determination sub-module and a specified target interface element acquisition sub-module, wherein:
a root node determination submodule for determining a root node of the tree structure; a designated target interface element acquisition sub-module, configured to traverse the tree structure based on the root node, and compare interface element identifiers of interface elements corresponding to nodes in the tree structure with the interface element identifiers of the designated target interface elements, so as to find and acquire the designated target interface elements
The configuration information also comprises position information of the entered position of the interface element in the entered interface; and, the input unit 303 may further comprise a first input subunit for inputting an interface element to a corresponding location in the input interface according to the location information.
Of course, the configuration information acquired by the acquiring unit 301 may further include an interface element identifier of a preset target interface element; and, the collection unit 302 may further include a preset target interface element collection subunit, configured to collect the preset target interface element from the collected interface by using an interface element identifier of the preset target interface element.
After the entering unit 303, the apparatus 30 may further comprise a presentation unit for presenting the entered interface after entering the interface element.
The logging unit 303 may comprise a logging subunit for logging the acquired interface elements into the logged interface by calling a function uiobject.
The embodiment of the invention also provides a storage medium, which comprises: a program which, when run on an electronic device, causes the electronic device to perform all or part of the flow of the method in the above-described embodiments. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a Flash Memory (Flash Memory), a Hard Disk (HDD), or a Solid State Drive (SSD), etc. The storage medium may also comprise a combination of memories of the kind described above.
Although embodiments of the present invention have been described in connection with the accompanying drawings, various modifications and variations may be made by those skilled in the art without departing from the spirit and scope of the invention, and such modifications and variations are within the scope of the invention as defined by the appended claims.

Claims (8)

1. The data processing method is characterized in that the method is applied to a process automation robot RPA arranged on an executor APP, an operation interface of the executor APP is provided with a plurality of interface element input controls, and each interface element input control corresponds to different interface elements respectively and comprises the following steps:
acquiring configuration information, wherein the configuration information comprises collected interface association information and entered interface association information;
associating the acquired interface according to the acquired interface association information, so as to acquire interface elements of the acquired interface;
associating the entered interface according to the entered interface association information for entering the acquired interface elements into the entered interface;
the method for collecting the interface elements of the collected interface specifically comprises the following steps:
acquiring an input instruction input by touching an interface element input control in the operation interface;
according to the input instruction, determining an interface element identifier of a specified target interface element corresponding to the interface element input control;
and acquiring the designated target interface element of the acquired interface by utilizing the interface element identification of the designated target interface element.
2. The method of claim 1, wherein the step of determining the position of the substrate comprises,
the collected interface association information specifically comprises: APP identification of the data source APP and interface identification of the acquired interface in the data source APP; and/or the number of the groups of groups,
the entered interface association information specifically comprises: APP identification of the data listing APP and interface identification of the entered interface in the data listing APP.
3. The method of claim 1, wherein prior to obtaining the configuration information, the method further comprises: acquiring authorization of barrier-free service in an operating system; the method comprises the steps of,
the method for acquiring the configuration information specifically comprises the following steps:
and acquiring the configuration information under the condition of receiving an event callback notification based on the acquired authorization of the barrier-free service, wherein the event callback notification is used for representing that the acquired interface serving as the active interface has changed.
4. The method of claim 1, wherein the interface elements in the collected interface are arranged in a tree structure; the method comprises the steps of,
acquiring the designated target interface element of the acquired interface by utilizing the interface element identification of the designated target interface element, wherein the method specifically comprises the following steps:
determining a root node of the tree structure;
traversing the tree structure based on the root node, and comparing interface element identifiers of interface elements corresponding to nodes in the tree structure with the interface element identifiers of the specified target interface elements to find and acquire the specified target interface elements.
5. The method of claim 1, wherein the configuration information further comprises an interface element identification of a preset target interface element; the method comprises the steps of,
the interface element collection of the collected interface specifically comprises the following steps:
and acquiring the preset target interface element of the acquired interface by utilizing the interface element identification of the preset target interface element.
6. The method according to claim 1, characterized in that entering the acquired interface element into the entered interface, in particular comprises:
the acquired interface elements are entered into the entered interface by calling a function uiobject.action (accessibilitynodeinfo.action_set_text, bundle) in the system architecture of the android operating system.
7. The method of claim 1, wherein the configuration information further comprises location information of a entered location of an interface element in the entered interface; the method comprises the steps of,
entering the acquired interface elements into the entered interface specifically comprises:
and according to the position information, inputting the interface element to a corresponding position in the input interface.
8. An electronic device, comprising:
a memory for storing a computer program;
a processor configured to perform the method of any one of claims 1 to 7.
CN202210207275.7A 2022-03-04 2022-03-04 Data processing method, device, electronic equipment and storage medium Active CN114637448B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210207275.7A CN114637448B (en) 2022-03-04 2022-03-04 Data processing method, device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210207275.7A CN114637448B (en) 2022-03-04 2022-03-04 Data processing method, device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN114637448A CN114637448A (en) 2022-06-17
CN114637448B true CN114637448B (en) 2023-04-21

Family

ID=81947879

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210207275.7A Active CN114637448B (en) 2022-03-04 2022-03-04 Data processing method, device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114637448B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115269107B (en) * 2022-09-30 2022-12-27 北京弘玑信息技术有限公司 Method, medium and electronic device for processing interface image
CN115686540B (en) * 2023-01-03 2023-04-11 杭州实在智能科技有限公司 RPA control method and system based on Hongmong system

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113505228A (en) * 2021-07-22 2021-10-15 上海弘玑信息技术有限公司 Multi-dimensional text data classification method, training method and device

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106855798A (en) * 2015-12-09 2017-06-16 阿里巴巴集团控股有限公司 A kind of method to set up of interface element property value, device and smart machine
CN105607799B (en) * 2015-12-15 2019-09-13 深圳市永兴元科技股份有限公司 Data processing method and device
CN112231663A (en) * 2020-03-31 2021-01-15 北京来也网络科技有限公司 Data acquisition method, device, equipment and storage medium combining RPA and AI
CN112199562A (en) * 2020-10-23 2021-01-08 上海意略明数字科技股份有限公司 Method and device for acquiring and processing operation information of terminal, storage medium and computer equipment
CN112765165A (en) * 2020-12-30 2021-05-07 未鲲(上海)科技服务有限公司 Data entry method and device, equipment and computer readable storage medium

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113505228A (en) * 2021-07-22 2021-10-15 上海弘玑信息技术有限公司 Multi-dimensional text data classification method, training method and device

Also Published As

Publication number Publication date
CN114637448A (en) 2022-06-17

Similar Documents

Publication Publication Date Title
CN114637448B (en) Data processing method, device, electronic equipment and storage medium
US11474926B2 (en) Method and system for measuring user engagement with content items
US10789304B2 (en) Method and system for measuring user engagement with content items
US9804821B2 (en) Interaction history management device, interaction device and interaction history management method
US8799796B2 (en) System and method for generating graphical dashboards with drill down navigation
WO2015147878A1 (en) Systems and methods for providing an information technology interface
JP2004139440A5 (en)
US20200050540A1 (en) Interactive automation test
US9804915B2 (en) Integrated production support
CN113014445B (en) Operation and maintenance method, device and platform for server and electronic equipment
US20140351408A1 (en) Utilizing augmented reality for locating computer hardware associated to a reported incident
US20090055770A1 (en) Navigation systems with event notification
US9501378B2 (en) Client events monitoring
US10637722B2 (en) Automated remote message management
US8479222B2 (en) Simplifying interaction with multiple applications when using forms via a common interface
US9818143B2 (en) Ensuring appearance of merchant offering in network sites
CN115358873A (en) Business scene configuration system, method, electronic equipment and storage medium
JP5978008B2 (en) Transaction management system, transaction management method, and transaction management program
CN111459475A (en) Interface calling method, interface docking configuration method, device, equipment and medium
US10097399B1 (en) Distributed computing management links
US20220309452A1 (en) Tracking consolidated shipment orders
CN111737149B (en) Real machine platform, test method and test script processing method
US20210318791A1 (en) Process map navigation tool
JP2021077239A (en) Information processing system, identification information application module and information management method
CN116841853A (en) Test case generation method and device, electronic equipment and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant