CN112597012A

CN112597012A - Traversal method and device of application program, electronic equipment and storage medium

Info

Publication number: CN112597012A
Application number: CN202011487763.5A
Authority: CN
Inventors: 侯柳平
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Baidu Online Network Technology Beijing Co Ltd; Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2020-12-16
Filing date: 2020-12-16
Publication date: 2021-04-02

Abstract

The disclosure discloses a traversal method and a traversal device for an application program, electronic equipment and a storage medium, and relates to the field of artificial intelligence and application program detection. The specific implementation scheme is as follows: identifying a page to be processed of a target application program to obtain functional information of the page to be processed; detecting the page to be processed under the condition that the function of the page to be processed is determined not to belong to the traversed function based on the function information; and in response to the completion of the detection of the page to be processed, marking the function of the page to be processed as a traversed function, traversing at least one sub-page of the page to be processed, and determining the traversed sub-page as a new page to be processed. The embodiment of the disclosure can improve the traversal efficiency.

Description

Traversal method and device of application program, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of computer technology, and more particularly, to the field of artificial intelligence and application detection.

Background

In the process of detecting an Application program (App), it is necessary to traverse pages of the Application program as much as possible to detect the pages. In general, traversal of an App page is performed comprehensively and recursively with page coverage as a traversal target.

Disclosure of Invention

The disclosure provides a traversal method and a traversal device for an application program, an electronic device and a storage medium.

According to an aspect of the present disclosure, there is provided an application traversal method, including:

identifying a page to be processed of a target application program to obtain functional information of the page to be processed;

detecting the page to be processed under the condition that the function of the page to be processed is determined not to belong to the traversed function based on the function information;

and in response to the completion of the detection of the page to be processed, marking the function of the page to be processed as a traversed function, traversing at least one sub-page of the page to be processed, and determining the traversed sub-page as a new page to be processed.

According to another aspect of the present disclosure, there is provided a traversing apparatus of an application, including:

the first identification module is used for identifying a page to be processed of a target application program to obtain functional information of the page to be processed;

the detection module is used for detecting the page to be processed under the condition that the function of the page to be processed is determined not to belong to the traversed function based on the function information;

and the recursion traversal module is used for marking the function of the page to be processed as a traversed function in response to the completion of the detection of the page to be processed, traversing at least one sub-page of the page to be processed, and determining the traversed sub-page as a new page to be processed.

According to another aspect of the present disclosure, there is provided an electronic device including:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform methods provided by embodiments of the present disclosure.

According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium storing computer instructions for causing a computer to perform a method provided by an embodiment of the present disclosure.

Embodiments of the present disclosure also provide a computer program product comprising a computer program which, when executed by a processor, implements the method as described above.

According to the technical scheme of the disclosure, for the detected page in the application program, the function of the detected page is marked to be a traversed function; and identifying the traversed page to be processed, determining the function of the page, and continuously traversing the sub-page of the page under the condition that the function does not belong to the traversed function. Based on the method, the function coverage rate can be ensured in the traversal detection process of the application program, the traversal times of pages with the same function are reduced, and the traversal efficiency is improved.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

FIG. 1 is a diagram illustrating a traversal method for an application according to an embodiment of the present disclosure;

FIG. 2 is a schematic diagram of traversal in an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of control identification in an embodiment of the present disclosure;

FIG. 4 is a schematic diagram of an application example of the traversal method of the application of the present disclosure;

FIG. 5 is a schematic diagram of a recognition engine in an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of a traversing apparatus for an application provided by an embodiment of the present disclosure;

FIG. 7 is a schematic diagram of a traversing apparatus for an application according to another embodiment of the present disclosure;

fig. 8 is a block diagram of an electronic device for implementing a traversal method for an application program of an embodiment of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

Fig. 1 is a schematic diagram illustrating a traversal method for an application according to an embodiment of the present disclosure. As shown in fig. 1, the method may include:

step S11, identifying the page to be processed of the target application program to obtain the function information of the page to be processed;

step S12, detecting the page to be processed under the condition that the function of the page to be processed is determined not to belong to the traversed function based on the function information;

step S13, when the detection of the page to be processed is completed, marking the function of the page to be processed as a traversed function, traversing at least one sub-page of the page to be processed, and determining the traversed sub-page as a new page to be processed.

The target application program is an application program (App) to be detected, such as a social App, a shopping App, a video App and the like.

Illustratively, an AI (Artificial Intelligence) technology can be utilized to obtain a recognition engine, based on which a to-be-processed page is recognized. The recognition engine may be configured to output corresponding function information for the inputted page.

Illustratively, the function information may include identification information such as a code, a name, etc. of the function. In practical application, a traversed function list may be created, and when a certain function is marked as a traversed function, corresponding function information is added to the traversed function list. For the identified function information, whether the function belongs to the traversed function can be determined by judging whether the function information is in the traversed function list.

In the embodiment of the disclosure, the page to be processed is detected when the function of the page to be processed does not belong to the traversed function, and the sub-page of the page to be processed is traversed when the detection is completed. Correspondingly, under the condition that the function of the page to be processed belongs to the traversed function, the page to be processed is not detected, and the traversal of the page to be processed is finished. That is, the traversal method of the application program may further include: and under the condition that the page to be processed is not detected and the function of the page to be processed belongs to the traversed function, ending the processing of the page to be processed.

Based on the method, in the traversal detection process of the application program, the detection and the sub-page traversal are only performed once for the page with the same function. Thus, meaningless multiple detections and sub-page traversals of pages of the same function can be avoided. For example, the pages with the same mass functions, such as mass commodity browsing pages in a shopping App or mass video pages in a video App, are prevented from being detected one by one and sub-page traversal is avoided. As another example, an unlimited number of detections and sub-page traversals of a page that is capable of automatic dynamic refresh are avoided.

Moreover, since the sub-pages of the page to be processed are traversed after the page to be processed is detected, the method according to the embodiment of the disclosure can fully traverse the pages with different functions, and ensure the function coverage rate of traversal detection of the application program.

By way of example, the target application may be a social App. As shown in fig. 2, first, the main page of the social App is determined as a to-be-processed page, and since the main page does not belong to the traversed function at this time, after the detection processing is performed on the main page, a plurality of sub-pages under the main page are traversed, including a first dialogue page, a second dialogue page, a setting page, and the like.

And when the first dialogue page is traversed, taking the first dialogue page as a page to be processed, wherein the page to be processed has the function of dialogue. Because the dialog function does not belong to the traversed function, after the detection processing is performed on the first dialog page, a plurality of sub-pages of the first dialog page are traversed, including the first sub-page and the second sub-page. If the functions of the first sub-page and the second sub-page do not belong to the traversed function and do not have the sub-page, completing the traversal processing of the first sub-page when the detection of the first sub-page is completed, and then traversing to the second sub-page; and when the detection of the second sub-page is finished, the traversal processing of the second sub-page is finished. At this point, the traversal processing of the first dialog page is completed.

Then, traverse to the second dialogue page. Because the function of the second dialogue page is dialogue and belongs to the traversed function, the second dialogue page is not detected, the sub-page of the second dialogue page is not traversed, the processing of the second dialogue page is finished, and the setting page is traversed.

When the set page is traversed, the set page is detected and sub-pages of the set page are traversed because the function of the set page is set and does not belong to the traversed function.

By analogy, deep recursive traversal can be made to various functionally different pages in the social App.

Therefore, according to the technical scheme disclosed by the invention, the functions of the detected pages in the application program are marked to be traversed; and identifying the traversed page to be processed, determining the function of the page, and continuously traversing the sub-page of the page under the condition that the function does not belong to the traversed function. Based on the method, the function coverage rate can be ensured in the traversal detection process of the application program, the traversal times of pages with the same function are reduced, and the traversal efficiency is improved.

For example, in step S11, the identifying the to-be-processed page of the target application to obtain the function information of the to-be-processed page may include:

identifying image information in a page to be processed based on an image identification module in an identification engine to obtain an image identification result of the page to be processed;

identifying text information in a page to be processed based on a natural language understanding module in an identification engine to obtain a semantic identification result of the page to be processed;

and obtaining the function information of the page to be processed based on the image recognition result and the semantic recognition result of the page to be processed.

According to the above embodiment, the recognition engine includes an image recognition module and a natural language understanding module therein. Therefore, the function information of the page to be processed can be accurately determined by combining image recognition and semantic recognition. Wherein, the image recognition module and the natural language processing module can be deep learning models.

For example, an automated testing framework such as uiautomation 2 may be adopted to obtain image information such as a screenshot of a page to be processed, a control icon, and text information such as text in a control.

The image recognition module can obtain information such as the function category of the page to be processed and the functions possibly possessed by the sub-pages thereof through recognition of the whole screenshot of the page to be processed and recognition of the control icon, and outputs an image recognition result based on the information.

The natural language understanding module can understand the semantics of the text in the control through the recognition of the text in the control, for example, understand the control function described by the text in the control, and output a semantic recognition result based on the understanding.

Illustratively, the image recognition result may include at least one candidate function and its corresponding probability score, etc.; the semantic recognition result may also include at least one candidate function and its corresponding probability score, etc. Based on the image recognition result, the semantic recognition result, and the preconfigured information such as weight or priority, one of the at least one candidate function can be selected as the final recognition result, that is, the function information of the page to be processed is obtained.

Due to the fact that the capabilities of image recognition, natural language understanding and the like in the AI technology are utilized, the functions of the page to be processed can be accurately recognized, information of the traversed functions is accurately maintained, the non-traversed functions are accurately recognized, the corresponding pages are detected, and the function coverage rate of traversal detection of the application program is guaranteed.

In some embodiments, the traversing method of the application program may further include:

identifying at least one control in a page to be processed to obtain the priority order of the at least one control;

and obtaining the traversal order of at least one sub-page corresponding to at least one control of the page to be processed based on the priority order of the at least one control.

Correspondingly, the at least one sub-page is traversed according to the traversal order.

Illustratively, the at least one control in the page to be processed may also be identified using an identification engine having image recognition capabilities and natural language understanding capabilities. For example, the control icons shown in fig. 3 are recognized by the image recognition module, and the functions represented by them are "home page", "favorite", "browse", "message" and "personal setting", respectively, and the image recognition module may sort the functions based on the information such as the frequency of use, the duration of use, and the like of the functions, and output the result of the sort, that is, the priority order of the controls. And determining the priority order of the control as the traversal order of the corresponding sub-page. For example, the priority order of the controls in FIG. 3 is determined as: the method comprises the steps of 'homepage', 'message', 'browsing', 'personal setting' and 'collection', on the basis of which, sub-pages corresponding to the 'homepage' of the control are traversed, sub-pages corresponding to the 'message' of the control are traversed, and by analogy, sub-pages corresponding to each space are traversed.

According to the mode, the important sub-pages can be traversed preferentially by identifying the control, so that important detection information can be obtained as soon as possible, and a traversing program and an traversing effect are optimized.

In practical application, after the traversal order of at least one sub-page is determined, the sub-pages with the order being the first N bits can be traversed one by one, and the traversal of the sub-pages with the order not being the first N bits is abandoned. Wherein N is an integer of 1 or more. Based on this, the efficiency of traversal detection can be improved.

As an exemplary embodiment, the traversing method of the application program may further include:

and under the condition that the popup appears in the page to be processed, identifying the popup to obtain an operation mode for closing the popup, and closing the popup by adopting the operation mode.

Illustratively, the pop-up window may include advertisements, reminders, and dialog boxes, among others. Since the application program is generally connected to the internet during the detection process and needs to enter the page to be processed to detect the application program, a pop-up window may occur. In the embodiment of the disclosure, the pop-up window may be identified to determine an operation mode for closing the pop-up window. For example, the type of pop-up window, such as an advertisement, a prompt message, or a dialog box, may be identified; if the type of pop-up is an advertisement, a full screen advertisement or a countdown advertisement, etc. may be identified. Based on the different popup types, different modes of operation may be determined and implemented, such as clicking a close button in a popup page, clicking an "agree" option in a dialog box, waiting for a countdown, and so forth.

Illustratively, the pop-up window can also be identified by using the above-mentioned identification engine. For example, dialog boxes that pop up at App runtime often contain a large amount of textual information, including, for example, the dialog text "please peruse and agree to" App clause of service "before using the App and the option text" agree "and" disagree ". The natural language understanding module in the recognition engine can understand the semantics and determine that the page to be processed is continuously displayed only when clicking 'agree', so that the processing mode of closing the popup window is determined to be clicking 'agree' option.

Because the popup is automatically identified and processed, the situation that the popup interrupts the traversal detection process of the application program can be avoided, and the traversal detection efficiency is improved.

For example, in some embodiments, detecting the page to be processed may include:

and triggering the privacy behaviors in the page to be processed, and carrying out compliance detection on the privacy behaviors.

For example, entering a to-be-processed page causes the application program to perform a privacy action in the to-be-processed page, such as calling a camera to take a picture or scan a code, connecting to a network and calling the camera to live, calling a GPS (Global Positioning System) to perform map navigation or reserve a taxi, calling payment software to perform network payment, and the like.

In the embodiment of the disclosure, the privacy behavior can be subjected to compliance detection by triggering the privacy behavior in the page to be processed. Because the function coverage of traversal detection of the application program is high, the coverage rate of the type of the privacy behaviors is also high, comprehensive compliance detection can be performed, and personal privacy information in the App is protected.

Fig. 4 is a schematic diagram illustrating an application example of the traversal method of the application program of the present disclosure. As shown in fig. 4, the executing agent first acquires the recognition object of the recognition engine. The identification object can be a to-be-processed page or a popup in the App. Then, a screenshot of the recognition object is extracted, and a control image and text in the recognition object are extracted. The screenshot of the recognition object, as well as the aerial image and text, are input to the recognition engine. The recognition engine comprises an image recognition module and a natural language understanding module, and is used for respectively carrying out image recognition and semantic understanding on input information and outputting a recognition result.

And if the identification object is the page to be processed, identifying the function of the page to be processed. And in the case that the function is the traversed function, ending the processing of the page to be processed. And under the condition that the function is a non-traversal function, acquiring the priority sequence of each control in the page to be processed, determining the traversal sequence of each sub-page based on the priority sequence, and traversing each sub-page based on the traversal sequence.

And if the identification object is a popup, finding an operation mode for closing the popup, and processing the popup by adopting the operation mode.

FIG. 5 shows a functional schematic of a recognition engine. As shown in fig. 5, the recognition object of the recognition engine may include a to-be-processed page and a popup. The pages to be processed may include an App homepage and/or a business function page that may invoke privacy behaviors. The pop-up window may include a dialog box and an advertisement.

For the App homepage, various business function types contained by the App and main function entries in the homepage can be identified, and the importance of the function entries is ranked. And sorting according to various service function types and the importance of the function entries contained in the App to obtain a sorted function entry list, and outputting the function entry list as an identification result. Here, the representation of the functionality portal may be a control in a page.

For a business function page calling the privacy behaviors, function entries related to the privacy behaviors in the page can be identified, such as a photographing or code scanning function, a live broadcasting function, a map navigation function, a taxi reservation function, a network payment function and the like, and the functions are sequenced to obtain a function sequence and output as an identification result.

For the dialog box, the type of the dialog box can be identified, such as a permission application dialog box, a usage term display box, an App upgrade dialog box, an App login dialog box, and the like. And determining different operation modes and information required for executing the operation modes for different dialog boxes, and outputting the information as a recognition result. The operation mode corresponding to the permission application dialog box and the use term display box can be that an agreement button is clicked, and the identification result can comprise position information of the agreement button; the operating mode corresponding to the App upgrading dialog box can be that an agreement button or a cancel button is clicked, and the identification result can comprise position information of the agreement button or the cancel button; the App login dialog box may correspond to an operation mode of clicking a login button, and the recognition result may include position information of the login button.

For advertisements, the type of advertisement may be identified, such as full screen advertisements, countdown advertisements, pop-up advertisements, embedded advertisements, and native advertisements. And determining different operation modes and information required for executing the operation modes according to different advertisement types, and outputting the information as a recognition result. The operation mode corresponding to the full-screen advertisement can be sliding and closing to the right; the operation mode corresponding to the countdown advertisement can be automatically closed when waiting for overtime; the operation mode corresponding to the pop-up window advertisement can be that a closing button is clicked, and the identification result can comprise position information of the closing button; the embedded advertisements and the native advertisements do not influence the operation of the page to be processed, and the advertisement area range can be marked as an identification result.

Therefore, the identification engine is beneficial to determining the traversal order of the sub-pages of the page to be processed and timely processing the popup, and therefore, the traversal efficiency of the application program is improved.

In summary, according to the technical solution of the embodiment of the present disclosure, for a detected page in an application, a function of the detected page is marked as a traversed function; and identifying the traversed page to be processed, determining the function of the page, and continuously traversing the sub-page of the page under the condition that the function does not belong to the traversed function. Based on the method, the function coverage rate can be ensured in the traversal detection process of the application program, the traversal times of pages with the same function are reduced, and the traversal efficiency is improved.

As an implementation manner of the foregoing method, an embodiment of the present disclosure further provides a traversing apparatus for an application, as shown in fig. 6, the apparatus includes:

the first identification module 610 is configured to identify a to-be-processed page of a target application program, so as to obtain function information of the to-be-processed page;

the detection module 620 is configured to detect the page to be processed when determining, based on the function information, that the function of the page to be processed does not belong to the traversed function;

the recursive traversal module 630 is configured to mark the function of the page to be processed as a traversed function, traverse at least one sub-page of the page to be processed, and determine the traversed sub-page as a new page to be processed, when the detection of the page to be processed is completed.

Illustratively, as shown in fig. 7, the first identifying module 610 may include:

the image recognition unit 611 is configured to recognize image information in the page to be processed based on an image recognition module in the recognition engine, so as to obtain an image recognition result of the page to be processed;

a semantic recognition unit 612, configured to recognize text information in the page to be processed based on a natural language understanding module in the recognition engine, and obtain a semantic recognition result of the page to be processed;

a function identifying unit 613, configured to obtain function information of the page to be processed based on the image identification result and the semantic identification result of the page to be processed.

Illustratively, as shown in fig. 7, the apparatus may further include:

the second identifying module 710 is configured to identify at least one control in the page to be processed, so as to obtain a priority order of the at least one control;

and the sorting module 720 is configured to obtain a traversal order of at least one sub-page of the to-be-processed page corresponding to the at least one control based on the priority order of the at least one control.

Illustratively, as shown in fig. 7, the apparatus may further include:

the pop-up window processing module 730 identifies the pop-up window under the condition that the pop-up window appears in the page to be processed, obtains the operation mode of closing the pop-up window, and closes the pop-up window by adopting the operation mode.

Illustratively, as shown in fig. 7, the apparatus may further include:

and an ending processing module 740, configured to end the processing of the page to be processed when the page to be processed is not detected and the function of the page to be processed belongs to the traversed function.

For example, the detection module 620 may be configured to trigger a privacy action in the pending page, and perform compliance detection on the privacy action.

The device provided by the embodiment of the disclosure can realize the method provided by the embodiment of the disclosure, and has corresponding beneficial effects.

The present disclosure also provides an electronic device and a readable storage medium and a computer program product according to embodiments of the present disclosure.

FIG. 8 illustrates a schematic block diagram of an example electronic device 800 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 8, the apparatus 800 includes a computing unit 801 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM)802 or a computer program loaded from a storage unit 808 into a Random Access Memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the device 800 can also be stored. The calculation unit 801, the ROM 802, and the RAM 803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.

A number of components in the device 800 are connected to the I/O interface 805, including: an input unit 806, such as a keyboard, a mouse, or the like; an output unit 807 such as various types of displays, speakers, and the like; a storage unit 808, such as a magnetic disk, optical disk, or the like; and a communication unit 809 such as a network card, modem, wireless communication transceiver, etc. The communication unit 809 allows the device 800 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.

Computing unit 801 may be a variety of general and/or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and the like. The calculation unit 801 executes the respective methods and processes described above, such as the traversal method of the application program. For example, in some embodiments, the traversal method of the application program may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 808. In some embodiments, part or all of the computer program can be loaded and/or installed onto device 800 via ROM 802 and/or communications unit 809. When the computer program is loaded into RAM 803 and executed by the computing unit 801, one or more steps of the traversal method of the application described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the traversal method of the application program in any other suitable manner (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel or sequentially or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.

The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.

Claims

1. A traversal method of an application, comprising:

and under the condition that the detection of the page to be processed is finished, marking the function of the page to be processed as a traversed function, traversing at least one sub-page of the page to be processed, and determining the traversed sub-page as a new page to be processed.

2. The method according to claim 1, wherein the identifying the page to be processed of the target application program to obtain the function information of the page to be processed comprises:

identifying the image information in the page to be processed based on an image identification module in an identification engine to obtain an image identification result of the page to be processed;

identifying text information in the page to be processed based on a natural language understanding module in the identification engine to obtain a semantic identification result of the page to be processed;

3. The method of claim 1 or2, further comprising:

identifying at least one control in the page to be processed to obtain the priority order of the at least one control;

and obtaining the traversal order of at least one sub-page of the to-be-processed page corresponding to the at least one control based on the priority order of the at least one control.

4. The method of claim 1 or2, further comprising:

5. The method of claim 1 or2, further comprising:

and under the condition that the page to be processed is not detected and the function of the page to be processed belongs to the traversed function, ending the processing of the page to be processed.

6. The method according to claim 1 or2, wherein the detecting the page to be processed comprises:

7. A traversing apparatus of an application, comprising:

and the recursion traversal module is used for marking the function of the page to be processed as a traversed function, traversing at least one sub-page of the page to be processed and determining the traversed sub-page as a new page to be processed under the condition that the detection of the page to be processed is finished.

8. The apparatus of claim 7, wherein the first identifying module comprises:

the image identification unit is used for identifying the image information in the page to be processed based on an image identification module in an identification engine to obtain an image identification result of the page to be processed;

the semantic recognition unit is used for recognizing the text information in the page to be processed based on a natural language understanding module in the recognition engine to obtain a semantic recognition result of the page to be processed;

and the function identification unit is used for obtaining the function information of the page to be processed based on the image identification result and the semantic identification result of the page to be processed.

9. The apparatus of claim 7 or 8, further comprising:

the second identification module is used for identifying at least one control in the page to be processed to obtain the priority order of the at least one control;

and the sequencing module is used for obtaining the traversal order of at least one sub-page of the to-be-processed page corresponding to the at least one control based on the priority order of the at least one control.

10. The apparatus of claim 7 or 8, further comprising:

and the popup window processing module is used for identifying the popup window under the condition that the popup window appears in the page to be processed to obtain an operation mode for closing the popup window, and closing the popup window by adopting the operation mode.

11. The apparatus of claim 7 or 8, further comprising:

and the ending processing module is used for ending the processing of the page to be processed under the condition that the page to be processed is not detected and the function of the page to be processed belongs to the traversed function.

12. The device according to claim 7 or 8, wherein the detection module is configured to trigger a privacy action in the page to be processed, and perform compliance detection on the privacy action.

13. An electronic device, comprising:

at least one processor; and

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-6.

14. A non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-6.

15. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-6.