CN113495764A - Automatic data extraction method and device, computer equipment and storage medium - Google Patents
Automatic data extraction method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN113495764A CN113495764A CN202111039872.5A CN202111039872A CN113495764A CN 113495764 A CN113495764 A CN 113495764A CN 202111039872 A CN202111039872 A CN 202111039872A CN 113495764 A CN113495764 A CN 113495764A
- Authority
- CN
- China
- Prior art keywords
- manual operation
- extracted
- interface
- data extraction
- plug
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
- G06F9/44526—Plug-ins; Add-ons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3438—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment monitoring of user actions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Telephone Function (AREA)
Abstract
The application relates to an automatic data extraction method, an automatic data extraction device, computer equipment and a storage medium, wherein the method comprises the following steps: identifying a manual operation node in a data extraction process of the equipment to be extracted, wherein the manual operation node is a flow node which needs manual operation to extract data of the equipment to be extracted; acquiring a plug-in, wherein the plug-in is generated based on an automatic strategy corresponding to the manual operation behavior of the manual operation node; implanting the plug-in into the equipment to be extracted; and simulating manual operation behaviors at the manual operation nodes through the plug-in to extract data of the equipment to be extracted. The method can simulate manual operation to realize automatic extraction of the data in the equipment to be extracted, so that the probability of data extraction failure or data extraction loss is reduced.
Description
Technical Field
The present application relates to the field of electronic data extraction technologies, and in particular, to an automated data extraction method, apparatus, computer device, and storage medium.
Background
For the way of collecting and extracting electronic data in the terminal device, the common practice in the current industry is as follows: and the professional equipment is connected with the terminal equipment and finishes the extraction of the electronic data in a mode of manually assisting to operate the terminal equipment. Due to the fact that the terminal devices are various in types and different in operation modes and functions, even many functions cannot be distinguished and identified by professional technicians. Therefore, in the process of data acquisition and extraction of the terminal equipment, an operator often makes an operation mistake or omits operation steps, and particularly when a plurality of terminal equipment simultaneously performs data extraction, the operation steps are more likely to be wrong and missed; eventually leading to data extraction failures or data extraction misses. For example, when the terminal device is a mobile phone, a data extraction process is performed on the mobile phone, and data extraction failure or data extraction loss is easily caused by manual operation.
Disclosure of Invention
Based on this, it is necessary to provide an automated data extraction method, an apparatus, a computer device and a storage medium, which can simulate manual operations to achieve automatic extraction of data in a device to be extracted, thereby reducing the probability of data extraction failure or data extraction loss.
An automated data extraction method, comprising: identifying a manual operation node in a data extraction process of the equipment to be extracted, wherein the manual operation node is a flow node which needs manual operation to extract data of the equipment to be extracted; acquiring a plug-in, wherein the plug-in is generated based on an automatic strategy corresponding to the manual operation behavior of the manual operation node; implanting the plug-in into the equipment to be extracted; and simulating manual operation behaviors at the manual operation nodes through the plug-in to extract data of the equipment to be extracted.
In one embodiment, an automated data extraction method further comprises: acquiring manual operation behavior information of a manual operation node and interface change information of equipment to be extracted; generating an automation strategy according to the manual operation behavior information and the interface change information of the manual operation node; a plug-in is generated based on an automation policy.
In one embodiment, generating a plug-in based on an automation policy comprises: and generating the plug-in according to an automation strategy by adopting an automation test framework technology UiAutomator.
In one embodiment, the plug-in is an application program which runs on the device to be extracted in an installation manner, or the plug-in is a program file which does not need to run on the device to be extracted in an installation manner.
In one embodiment, the device to be extracted is a mobile phone, and the manual operation node is determined based on a mobile phone interface data extraction node set in a pre-configured data extraction flow.
In one embodiment, an automated data extraction method further comprises: acquiring interface element characteristics of each interface under the interface change of equipment to be extracted in the manual operation node; acquiring the sequence of each interface in the manual operation node; acquiring manual operation behavior information in each interface in a manual operation node; generating interface change information according to the interface element characteristics and the sequence of each interface; and generating the manual operation behavior information of the manual operation nodes according to the manual operation behavior information in each interface.
In one embodiment, an automated data extraction method further comprises: acquiring interface element characteristics of a device to be extracted in an initialization state in a manual operation node; acquiring interface element characteristics after manual operation in the manual operation nodes is finished; generating interface change information according to the interface element characteristics and the sequence of each interface, wherein the interface change information comprises the following steps: and generating interface change information according to the interface element characteristics in the initialization state, the interface element characteristics and the sequence of each interface and the interface element characteristics after the manual operation is finished.
An automated data extraction apparatus, comprising: the identification module is used for identifying a manual operation node in the data extraction process of the equipment to be extracted, wherein the manual operation node is a process node which needs manual operation to extract data of the equipment to be extracted; the acquisition module is used for acquiring a plug-in, and the plug-in is generated based on an automatic strategy corresponding to the manual operation behavior of the manual operation node; the implantation module is used for implanting the plug-in unit into the equipment to be extracted; and the data extraction module is used for simulating manual operation behaviors at the manual operation nodes through the plug-in so as to extract data of the equipment to be extracted.
A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method of any of the above embodiments when executing the computer program.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any of the above embodiments.
According to the automatic data extraction method, the automatic data extraction device, the computer equipment and the storage medium, during the data extraction process of the equipment to be extracted, the manual operation node is identified, the manual operation node is a flow node which needs manual operation to extract data of the equipment to be extracted, the plug-in is obtained, the plug-in is generated based on an automatic strategy corresponding to the manual operation behavior of the manual operation node, the plug-in is implanted into the equipment to be extracted, and the manual operation behavior is simulated at the manual operation node through the plug-in to extract the data of the equipment to be extracted. Therefore, when data extraction is carried out on the equipment to be extracted, the manual operation behavior is simulated to carry out data extraction in a mode that the plug-in generated by the automatic strategy corresponding to the manual operation behavior based on the manual operation node is implanted into the equipment to be extracted, and the automatic data extraction of the equipment to be extracted can be realized without manual intervention, so that the probability of data extraction failure or data extraction loss is reduced.
Drawings
FIG. 1 is a diagram of an application environment for an automated data extraction method in one embodiment;
FIG. 2 is a schematic flow diagram illustrating an automated data extraction method in accordance with one embodiment;
FIG. 3 is a flow diagram that illustrates the logic implemented within the plug-in for one embodiment;
FIG. 4 is a schematic diagram illustrating interaction of a process of extracting data from an android phone by a professional collection device in one embodiment;
FIG. 5 is a block diagram of an automated data extraction apparatus according to one embodiment;
FIG. 6 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The application provides an automatic data extraction method, which is applied to an application environment shown in fig. 1. As shown in fig. 1, the data extraction device 104 is used to implement an automated data extraction method of the present application. Specifically, the data extraction device 104 identifies a manual operation node in the data extraction process of the device to be extracted 102, where the manual operation node is a flow node that needs manual operation to extract data of the device to be extracted 102, obtains a plug-in, generates an automation policy corresponding to a manual operation behavior of the manual operation node based on the plug-in, implants the plug-in into the device to be extracted 102, and simulates the manual operation behavior at the manual operation node through the plug-in to extract data of the device to be extracted 102. The device 102 to be extracted may be a device related to case data, such as a mobile phone or a notebook computer. The data extraction device 104 may be a forensic device for forensic extraction of electronic data relating to criminal acts such as destruction, fraud, attack, etc. in case-involved data devices.
In one embodiment, as shown in fig. 2, an automated data extraction method is provided, which is illustrated by way of example as applied to the data extraction device 104 in fig. 1, and includes the following steps:
s102, identifying a manual operation node in the data extraction process of the equipment to be extracted, wherein the manual operation node is a process node which needs manual operation to extract data of the equipment to be extracted.
In this embodiment, the data extraction device establishes data connection with the device to be extracted, and initiates a data extraction request to the device to be extracted. And after the equipment to be extracted responds to the data extraction request of the data extraction equipment, the data extraction equipment enters a data extraction flow for extracting data of the equipment to be extracted. The device to be extracted can be a mobile phone, and the mobile phone comprises an android mobile phone and an apple mobile phone.
When data extraction is carried out on the equipment to be extracted, some data extraction nodes need manual intervention, and data extraction is carried out by the data extraction equipment assisted by manual operation behaviors. For example, during the collection process of data extraction of a mobile phone, some nodes need manual intervention. Therefore, the data extraction equipment identifies the manual operation node in the data extraction process of the equipment to be extracted. The manual operation node is a process node which needs manual operation to extract data of the equipment to be extracted. For example, the manual operation node may be a node corresponding to a certain interface set by the mobile phone data backup process. The node requires manual intervention for data extraction, and this interface is manually operated to assist the data extraction device in data extraction of the handset. When the data extraction equipment extracts data of the mobile phone and recognizes that the current node is the data extraction of a certain interface set by the data backup process of the mobile phone, the current node is determined as a manual operation node.
And S104, acquiring a plug-in, wherein the plug-in is generated based on an automatic strategy corresponding to the manual operation behavior of the manual operation node.
In this embodiment, the data extraction device stores a plug-in advance. And the plug-in is generated based on an automatic strategy corresponding to the manual operation behavior of the manual operation node. That is, before the plug-in is generated, the manual operation behavior of the manual operation node is collected when the data extraction device extracts data from the device to be extracted, and then the corresponding automation policy is set based on the collected manual operation behavior. The automatic strategy is used for indicating the plug-in to carry out operation control on the equipment to be extracted according to the manual operation behavior, so that the effect of simulating the manual operation behavior on the equipment to be extracted is obtained.
And S106, implanting the plug-in into the equipment to be extracted.
In this embodiment, the data extraction device pushes the plug-in to the device to be extracted, so as to implant the plug-in into the device to be extracted. For example, the data extraction device pushes the installation plug-in to the device to be extracted when the node is manually operated. And after the plug-in is installed on the data extraction equipment, the information of successful installation is pushed to the data extraction equipment. And when the data extraction equipment receives the information, determining that the plug-in is successfully implanted.
And S108, simulating manual operation behaviors at the manual operation nodes through the plug-in to extract data of the equipment to be extracted.
In this embodiment, after the data extraction device determines that the plug-in is implanted in the device to be extracted, when data extraction is performed on the device to be extracted, a manual operation behavior is simulated on the device to be extracted through the plug-in at a manual operation node, so that the data extraction device can perform data extraction on the device to be extracted.
According to the automatic data extraction method, during the data extraction process of the equipment to be extracted, the manual operation node is identified, the manual operation node is a flow node which needs manual operation to extract data of the equipment to be extracted, a plug-in is obtained, the plug-in is generated based on an automatic strategy corresponding to the manual operation behavior of the manual operation node, the plug-in is implanted into the equipment to be extracted, and the manual operation behavior is simulated at the manual operation node through the plug-in to extract the data of the equipment to be extracted. Therefore, when data extraction is carried out on the equipment to be extracted, the manual operation behavior is simulated to carry out data extraction in a mode that the plug-in generated by the automatic strategy corresponding to the manual operation behavior based on the manual operation node is implanted into the equipment to be extracted, and the automatic data extraction of the equipment to be extracted can be realized without manual intervention, so that the probability of data extraction failure or data extraction loss is reduced.
In an embodiment, before the step of obtaining the plug-in, the method further includes: acquiring manual operation behavior information of a manual operation node and interface change information of equipment to be extracted; generating an automation strategy according to the manual operation behavior information and the interface change information of the manual operation node; a plug-in is generated based on an automation policy.
In the embodiment, the manual operation behavior information of the manual operation node and the interface change information of the device to be extracted of the manual operation node are collected, and an automation strategy is obtained according to the two information. And the manual operation behavior information of the manual operation node is correspondingly associated with the interface change information. That is, the interface change information is change information of an interface change of the device to be extracted generated under a manual operation behavior, and the manual operation behavior information is behavior information obtained under the same manual operation behavior.
The manual operation behavior information of the manual operation nodes is a behavior information set obtained by each manual operation of the manual operation nodes when data extraction is carried out on the equipment to be extracted. The interface change information is an information set of each interface change obtained by each manual operation. For example, when the device to be extracted is a mobile phone, each manual operation includes clicking a certain button or picture on a mobile phone interface, scrolling a certain pull-down list, sliding a mobile phone screen, and the like. The interface change information includes change information on the mobile phone interface when a certain button or picture on the mobile phone interface is clicked, change information on the mobile phone interface when a certain drop-down list is scrolled, change information on the mobile phone interface when the mobile phone screen is slid, and the like. And forming an automatic strategy by combining the interface change of the mobile phone and the manual operation direction. Further, a plug-in is generated according to the automation policy. Therefore, the obtained plug-in can be suitable for the automatic data extraction flow of the data extraction equipment to-be-extracted equipment.
In an embodiment, the generating of the plug-in based on the automation policy includes: and generating the plug-in according to an automation strategy by adopting an automation test framework technology UiAutomator.
In this embodiment, the device to be extracted is an android system, and if the device to be extracted is an android mobile phone. At the moment, according to an automation strategy, a plug-in capable of being implanted into an android mobile phone is realized by utilizing an android application automation testing framework technology UiAutomator provided by Google. The automated testing framework technology UiAutomator is provided by Google to an android application developer to test real-time feedback of the developed android application to external responses. Therefore, the obtained plug-in can be suitable for the automatic data extraction flow of the data extraction equipment to-be-extracted equipment.
In one embodiment, the plug-in is an application program which runs on the device to be extracted in an installation manner, or the plug-in is a program file which does not need to run on the device to be extracted in an installation manner.
In this embodiment, when the device to be extracted is a mobile phone, the plug-in is an application APP that can be run on the mobile phone in an installation manner, or a program file that can be directly run on the mobile phone without installation, such as a jar file. Therefore, various forms of plug-ins can be provided to accommodate more application scenarios.
In one embodiment, the device to be extracted is a mobile phone, and the manual operation node is determined based on a mobile phone interface data extraction node set in a preconfigured data extraction flow.
In this embodiment, the device to be extracted is a mobile phone. Can be a mobile phone of android system or a mobile phone of apple system. The data extraction device stores a pre-configured data extraction flow. And each mobile phone interface data extraction node is set in the data extraction process. When data in a mobile phone interface data extraction node of a mobile phone needs to be extracted, manual operation assistance is needed. Therefore, the mobile phone interface data extraction node can be set as a manual operation node.
For example, as shown in FIG. 3, FIG. 3 is the internal implementation logic of a plug-in. After being implanted into a mobile phone, the plug-in enters a backup initial interface, namely a data extraction interface. When the actual screen display content of the mobile phone is captured, the plug-in further judges whether the current screen is in a certain interface set by the backup process of data extraction. Here, the data extraction process is a backup process of data extraction of the mobile phone, and the mobile phone interface data extraction node is a node where a certain interface set for the backup process of data extraction is located, and the node is also a set manual operation node. If so, the process of carrying out mobile phone screen operation according to the interface preset action is realized through the plug-in, and then the process of outputting the result is entered. If not, directly entering a result output flow through the plug-in. Therefore, automatic data extraction of the mobile phone can be realized.
In an embodiment, before the step of obtaining the manual operation behavior information of the manual operation node and the interface change information of the device to be extracted, the method further includes: acquiring interface element characteristics of each interface under the interface change of equipment to be extracted in the manual operation node; acquiring the sequence of each interface in the manual operation node; acquiring manual operation behavior information in each interface in a manual operation node; generating interface change information according to the interface element characteristics and the sequence of each interface; and generating the manual operation behavior information of the manual operation nodes according to the manual operation behavior information in each interface.
In this embodiment, the manual operation behavior information of the manual operation node includes manual operation behavior information in each interface of the device to be extracted in the manual operation node. And generating interface change information of the equipment to be extracted of the manual operation node according to the interface element characteristics of each interface under the interface change of the equipment to be extracted in the manual operation node and the appearance sequence of each interface. For example, when the device to be extracted is a mobile phone, the element features of each interface and the appearance sequence of each interface under the change of the mobile phone interface in the manual operation intervention process are recorded, and the direction of the manual operation intervention under each interface is recorded, that is, the specific operation mode is as follows: clicking on a certain button or picture, scrolling through a certain drop-down list, sliding the screen, etc. And forming an automatic strategy by combining the element characteristics of each interface under the interface change, the appearance sequence of each interface and manual operation. Therefore, the manual operation behavior information in each interface in the manual operation node and the interface information of each interface can be collected, so that the obtained automation strategy better meets the requirement of automatic data extraction of the equipment to be extracted.
In an embodiment, before the step of generating the interface change information according to the interface element characteristics and the sequence of each interface, the method further includes: acquiring interface element characteristics of a device to be extracted in an initialization state in a manual operation node; and acquiring the interface element characteristics after the manual operation in the manual operation nodes is finished. The generating of the interface change information according to the interface element characteristics and the sequence of each interface includes: and generating interface change information according to the interface element characteristics in the initialization state, the interface element characteristics and the sequence of each interface and the interface element characteristics after the manual operation is finished.
In this embodiment, the interface change information is generated by the interface element characteristics of the manual operation node when the device to be extracted is in the initialization state, the interface element characteristics and the sequence of each interface, and the interface element characteristics of the manual operation node after the manual operation is completed. For example, interface element features of an initial interface of the mobile phone to be subjected to evidence obtaining, which require manual intervention in the evidence obtaining process, are recorded, for example, the interface element features include text, keys, pictures, scroll bars, and the like. Recording interface element characteristics of each interface under the condition of mobile phone interface change in the manual operation intervention process, wherein the interface element characteristics comprise texts, keys, pictures, scroll bars and the like. And recording the appearance sequence of each interface. Recording the direction of manual operation intervention under each interface, namely a specific operation mode, such as: clicking on a certain button or picture, scrolling through a certain drop-down list, sliding the screen, etc. And recording interface element characteristics of the termination interface when the manual operation intervention is completed, wherein the interface element characteristics comprise texts, keys, pictures, scroll bars and the like. And finally, forming an automatic strategy by combining interface change and manual operation direction. The interface change comprises interface element characteristics of the manual operation nodes when the equipment to be extracted is in the initialization state, interface element characteristics and sequence of each interface, and interface element characteristics of the manual operation nodes after manual operation is finished. Therefore, the manual operation behavior information in each interface in the manual operation node and the interface information of each interface can be collected, so that the obtained automation strategy better meets the requirement of automatic data extraction of the equipment to be extracted.
In an embodiment, as shown in fig. 4, the device to be extracted is an android mobile phone, the data extraction device is a professional acquisition device, and a flow of data extraction of the android mobile phone by the professional acquisition device is shown in fig. 4. In the prior art, the process in the dashed box of fig. 4 is basically completed in a manual operation manner, which is inefficient and error-prone. In this embodiment, for the process in the dashed line frame of fig. 4, in the process of collecting and extracting data of an android mobile phone by professional equipment, a plug-in for implementing an automation policy is implanted into the android mobile phone, at a certain node requiring manual intervention in the android mobile phone collection process, an automatic plug-in is started, and the automatic plug-in replaces the manual operation of completing a series of mobile phone interfaces and returns an operation result.
Therefore, in the whole mobile phone data acquisition process, the manual intervention behavior of the mobile phone end is reduced to the minimum, and the convenience of data acquisition is improved. In addition, the technology has the advantages that the selection of the data of the mobile phone end and the control of the operation are set accurate processes, no deviation or omission exists, and the product performance, namely the data quality, is effectively improved.
The automatic data extraction method in the embodiments can provide a definite target and accurate steps for complex manual operation and possible mistakes and omissions in the mobile phone data extraction process, accurately simulate manual operation behaviors, achieve the purpose of accurately backing up data required for evidence collection, eliminate uncertainty of the manual operation behaviors, automatically complete the backup process, and improve the data extraction efficiency.
It should be understood that, although the steps in the flowchart are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.
The present application further provides an automated data extraction apparatus, as shown in fig. 5, comprising an identification module 502, an acquisition module 504, an implantation module 506, and a data extraction module 508. The identification module 502 is configured to identify a manual operation node in a data extraction process of the device to be extracted, where the manual operation node is a process node that needs manual operation to extract data of the device to be extracted; an obtaining module 504, configured to obtain a plug-in, where the plug-in is generated based on an automation policy corresponding to a manual operation behavior of a manual operation node; an implanting module 506 for implanting the plug-in into the device to be extracted; and the data extraction module 508 is configured to simulate manual operation behavior at the manual operation node through a plug-in to extract data of the device to be extracted.
In one embodiment, the automated data extraction apparatus further comprises a plug-in generation module. The plug-in generating module is used for acquiring the manual operation behavior information of the manual operation node and the interface change information of the equipment to be extracted; generating an automation strategy according to the manual operation behavior information and the interface change information of the manual operation node; a plug-in is generated based on an automation policy.
In one embodiment, generating a plug-in based on an automation policy comprises: and generating the plug-in according to an automation strategy by adopting an automation test framework technology UiAutomator.
In one embodiment, the plug-in is an application program which runs on the device to be extracted in an installation manner, or the plug-in is a program file which does not need to run on the device to be extracted in an installation manner.
In one embodiment, the device to be extracted is a mobile phone, and the manual operation node is determined based on a mobile phone interface data extraction node set in a pre-configured data extraction flow.
In one embodiment, an automated data extraction apparatus further comprises a generation module. The generation module is used for acquiring interface element characteristics of each interface under the interface change of the equipment to be extracted in the manual operation node; acquiring the sequence of each interface in the manual operation node; acquiring manual operation behavior information in each interface in a manual operation node; generating interface change information according to the interface element characteristics and the sequence of each interface; and generating the manual operation behavior information of the manual operation nodes according to the manual operation behavior information in each interface.
In one embodiment, the automated data extraction apparatus further comprises an interface element acquisition module. The interface element obtaining module is used for obtaining interface element characteristics of the manual operation node when the equipment to be extracted is in the initialization state; and acquiring the interface element characteristics after the manual operation in the manual operation nodes is finished. The generating of the interface change information according to the interface element characteristics and the sequence of each interface includes: and generating interface change information according to the interface element characteristics in the initialization state, the interface element characteristics and the sequence of each interface and the interface element characteristics after the manual operation is finished.
For specific limitations of the automated data extraction device, reference may be made to the above limitations of the automated data extraction method, which are not described herein again. The various modules in the automated data extraction apparatus described above may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 6. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement an automated data extraction method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 6 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program: identifying a manual operation node in a data extraction process of the equipment to be extracted, wherein the manual operation node is a flow node which needs manual operation to extract data of the equipment to be extracted; acquiring a plug-in, wherein the plug-in is generated based on an automatic strategy corresponding to the manual operation behavior of the manual operation node; implanting the plug-in into the equipment to be extracted; and simulating manual operation behaviors at the manual operation nodes through the plug-in to extract data of the equipment to be extracted.
In one embodiment, the processor, when executing the computer program, further performs the steps of: acquiring manual operation behavior information of a manual operation node and interface change information of equipment to be extracted; generating an automation strategy according to the manual operation behavior information and the interface change information of the manual operation node; a plug-in is generated based on an automation policy.
In one embodiment, when the processor executes the computer program to implement the step of generating the plug-in based on the automation policy, the following steps are specifically implemented: and generating the plug-in according to an automation strategy by adopting an automation test framework technology UiAutomator.
In one embodiment, the plug-in is an application program which runs on the device to be extracted in an installation manner, or the plug-in is a program file which does not need to run on the device to be extracted in an installation manner.
In one embodiment, the device to be extracted is a mobile phone, and the manual operation node is determined based on a mobile phone interface data extraction node set in a pre-configured data extraction flow.
In one embodiment, the processor, when executing the computer program, further performs the steps of: acquiring interface element characteristics of each interface under the interface change of equipment to be extracted in the manual operation node; acquiring the sequence of each interface in the manual operation node; acquiring manual operation behavior information in each interface in a manual operation node; generating interface change information according to the interface element characteristics and the sequence of each interface; and generating the manual operation behavior information of the manual operation nodes according to the manual operation behavior information in each interface.
In one embodiment, the processor, when executing the computer program, further performs the steps of: acquiring interface element characteristics of a device to be extracted in an initialization state in a manual operation node; and acquiring the interface element characteristics after the manual operation in the manual operation nodes is finished. When the processor executes the computer program to realize the step of generating the interface change information according to the interface element characteristics and the sequence of each interface, the following steps are specifically realized: and generating interface change information according to the interface element characteristics in the initialization state, the interface element characteristics and the sequence of each interface and the interface element characteristics after the manual operation is finished.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of: identifying a manual operation node in a data extraction process of the equipment to be extracted, wherein the manual operation node is a flow node which needs manual operation to extract data of the equipment to be extracted; acquiring a plug-in, wherein the plug-in is generated based on an automatic strategy corresponding to the manual operation behavior of the manual operation node; implanting the plug-in into the equipment to be extracted; and simulating manual operation behaviors at the manual operation nodes through the plug-in to extract data of the equipment to be extracted.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring manual operation behavior information of a manual operation node and interface change information of equipment to be extracted; generating an automation strategy according to the manual operation behavior information and the interface change information of the manual operation node; a plug-in is generated based on an automation policy.
In one embodiment, when the computer program is executed by the processor to implement the step of generating the plug-in based on the automation policy, the following steps are specifically implemented: and generating the plug-in according to an automation strategy by adopting an automation test framework technology UiAutomator.
In one embodiment, the plug-in is an application program which runs on the device to be extracted in an installation manner, or the plug-in is a program file which does not need to run on the device to be extracted in an installation manner.
In one embodiment, the device to be extracted is a mobile phone, and the manual operation node is determined based on a mobile phone interface data extraction node set in a pre-configured data extraction flow.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring interface element characteristics of each interface under the interface change of equipment to be extracted in the manual operation node; acquiring the sequence of each interface in the manual operation node; acquiring manual operation behavior information in each interface in a manual operation node; generating interface change information according to the interface element characteristics and the sequence of each interface; and generating the manual operation behavior information of the manual operation nodes according to the manual operation behavior information in each interface.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring interface element characteristics of a device to be extracted in an initialization state in a manual operation node; and acquiring the interface element characteristics after the manual operation in the manual operation nodes is finished. When the computer program is executed by the processor to realize the step of generating the interface change information according to the interface element characteristics and the sequence of each interface, the following steps are specifically realized: and generating interface change information according to the interface element characteristics in the initialization state, the interface element characteristics and the sequence of each interface and the interface element characteristics after the manual operation is finished.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. An automated data extraction method, the method comprising:
identifying a manual operation node in a data extraction process of equipment to be extracted, wherein the manual operation node is a process node which needs manual operation to extract data of the equipment to be extracted;
acquiring a plug-in, wherein the plug-in is generated based on an automation strategy corresponding to the manual operation behavior of the manual operation node;
implanting the inserter into the device to be extracted;
and simulating manual operation behavior at the manual operation node through the plug-in unit so as to extract data of the equipment to be extracted.
2. The method of claim 1, further comprising:
acquiring manual operation behavior information of the manual operation node and interface change information of the equipment to be extracted;
generating the automation strategy according to the manual operation behavior information of the manual operation node and the interface change information;
generating the plug-in based on the automation policy.
3. The method of claim 2, wherein the generating the plug-in based on the automation policy comprises:
and generating the plug-in by adopting an automatic test framework technology UiAutomator according to the automatic strategy.
4. The method according to claim 3, wherein the plug-in is an application program running on the device to be extracted by means of installation, or the plug-in is a program file running on the device to be extracted without installation.
5. The method according to claim 2, wherein the device to be extracted is a mobile phone, and the manually operated node is determined based on a mobile phone interface data extraction node set in a preconfigured data extraction process.
6. The method of claim 2, further comprising:
acquiring interface element characteristics of each interface under the interface change of the equipment to be extracted in the manual operation node;
acquiring the sequence of the interfaces in the manual operation node;
acquiring manual operation behavior information in each interface in the manual operation node;
generating the interface change information according to the interface element characteristics and the sequence of each interface;
and generating the manual operation behavior information of the manual operation nodes according to the manual operation behavior information in each interface.
7. The method of claim 6, further comprising:
acquiring interface element characteristics of the to-be-extracted equipment in the manual operation node in the initialization state;
acquiring interface element characteristics after manual operation in the manual operation nodes is finished;
the generating the interface change information according to the interface element characteristics and the sequence of each interface comprises:
and generating the interface change information according to the interface element characteristics in the initialization state, the interface element characteristics of each interface, the sequence and the interface element characteristics after the manual operation is finished.
8. An automated data extraction apparatus, the apparatus comprising:
the system comprises an identification module, a data extraction module and a data extraction module, wherein the identification module is used for identifying a manual operation node in the data extraction process of equipment to be extracted, and the manual operation node is a process node which needs manual operation to extract data of the equipment to be extracted;
the acquisition module is used for acquiring a plug-in which is generated based on an automation strategy corresponding to the manual operation behavior of the manual operation node;
the implantation module is used for implanting the plug-in unit into the equipment to be extracted;
and the data extraction module is used for simulating manual operation behaviors at the manual operation nodes through the plug-in unit so as to extract data of the equipment to be extracted.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 7 are implemented when the computer program is executed by the processor.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111039872.5A CN113495764B (en) | 2021-09-06 | 2021-09-06 | Automatic data extraction method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111039872.5A CN113495764B (en) | 2021-09-06 | 2021-09-06 | Automatic data extraction method and device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113495764A true CN113495764A (en) | 2021-10-12 |
| CN113495764B CN113495764B (en) | 2021-12-14 |
Family
ID=77997147
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111039872.5A Active CN113495764B (en) | 2021-09-06 | 2021-09-06 | Automatic data extraction method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113495764B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114020359A (en) * | 2021-11-08 | 2022-02-08 | 中国电子科技集团公司第二十八研究所 | Distributed platform integration method based on plug-in |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030182283A1 (en) * | 2002-03-22 | 2003-09-25 | Ncr Corporation | Data extraction system and method |
| CN105005474A (en) * | 2015-07-02 | 2015-10-28 | 盘石软件（上海）有限公司 | Microdevice for secretly extracting information of Android mobile phone and extraction method |
| CN109542788A (en) * | 2018-11-26 | 2019-03-29 | 南京烽火星空通信发展有限公司 | A kind of internal storage data evidence collecting method based on Android platform automated test tool |
| CN109766725A (en) * | 2018-12-19 | 2019-05-17 | 重庆华龙艾迪信息技术有限公司 | A kind of data processing method, equipment, intelligent terminal and computer-readable medium |
| CN110909229A (en) * | 2019-11-27 | 2020-03-24 | 佛山科学技术学院 | Webpage data acquisition and storage system based on simulated browser access |
| CN111061593A (en) * | 2018-10-17 | 2020-04-24 | 上海越钰信息技术有限公司 | Electronic evidence obtaining system and method |
| CN111639000A (en) * | 2020-06-03 | 2020-09-08 | 公安部第三研究所 | Method for quickly extracting backup data of android mobile terminal and automatic backup system |
| CN111859370A (en) * | 2020-06-30 | 2020-10-30 | 百度在线网络技术（北京）有限公司 | Method, apparatus, electronic device and computer-readable storage medium for identifying service |
| CN112597377A (en) * | 2020-12-25 | 2021-04-02 | 北京百度网讯科技有限公司 | Information extraction module generation method, information extraction method and device |
| CN112911003A (en) * | 2021-02-03 | 2021-06-04 | 广州市高奈特网络科技有限公司 | Electronic data extraction method, computer device, and storage medium |
-
2021
- 2021-09-06 CN CN202111039872.5A patent/CN113495764B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030182283A1 (en) * | 2002-03-22 | 2003-09-25 | Ncr Corporation | Data extraction system and method |
| CN105005474A (en) * | 2015-07-02 | 2015-10-28 | 盘石软件（上海）有限公司 | Microdevice for secretly extracting information of Android mobile phone and extraction method |
| CN111061593A (en) * | 2018-10-17 | 2020-04-24 | 上海越钰信息技术有限公司 | Electronic evidence obtaining system and method |
| CN109542788A (en) * | 2018-11-26 | 2019-03-29 | 南京烽火星空通信发展有限公司 | A kind of internal storage data evidence collecting method based on Android platform automated test tool |
| CN109766725A (en) * | 2018-12-19 | 2019-05-17 | 重庆华龙艾迪信息技术有限公司 | A kind of data processing method, equipment, intelligent terminal and computer-readable medium |
| CN110909229A (en) * | 2019-11-27 | 2020-03-24 | 佛山科学技术学院 | Webpage data acquisition and storage system based on simulated browser access |
| CN111639000A (en) * | 2020-06-03 | 2020-09-08 | 公安部第三研究所 | Method for quickly extracting backup data of android mobile terminal and automatic backup system |
| CN111859370A (en) * | 2020-06-30 | 2020-10-30 | 百度在线网络技术（北京）有限公司 | Method, apparatus, electronic device and computer-readable storage medium for identifying service |
| CN112597377A (en) * | 2020-12-25 | 2021-04-02 | 北京百度网讯科技有限公司 | Information extraction module generation method, information extraction method and device |
| CN112911003A (en) * | 2021-02-03 | 2021-06-04 | 广州市高奈特网络科技有限公司 | Electronic data extraction method, computer device, and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 曹敏: "计算机取证技术及其发展趋势研究", 《无线互联科技》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114020359A (en) * | 2021-11-08 | 2022-02-08 | 中国电子科技集团公司第二十八研究所 | Distributed platform integration method based on plug-in |
| CN114020359B (en) * | 2021-11-08 | 2024-04-16 | 中国电子科技集团公司第二十八研究所 | Distributed platform integration method based on plug-in |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113495764B (en) | 2021-12-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111061526B (en) | Automatic test method, device, computer equipment and storage medium | |
| CN111078339B (en) | Interface element positioning method and device, computer equipment and storage medium | |
| CN110941555B (en) | Test case recommendation method and device, computer equipment and storage medium | |
| CN110209652A (en) | Tables of data moving method, device, computer equipment and storage medium | |
| CN111414309B (en) | Automatic test method of application program, computer equipment and storage medium | |
| CN111552633A (en) | Interface abnormal call testing method and device, computer equipment and storage medium | |
| CN108874661B (en) | Test mapping relation library generation method and device, computer equipment and storage medium | |
| CN110162453B (en) | Test method, test device, computer readable storage medium and computer equipment | |
| CN110888709A (en) | Intelligent operation method and device of monitoring screen, computer equipment and storage medium | |
| CN109783365A (en) | Automated testing method, device, computer equipment and storage medium | |
| CN111782505A (en) | Train system simulation test method and device, computer equipment and storage medium | |
| CN113495764B (en) | Automatic data extraction method and device, computer equipment and storage medium | |
| CN110659435A (en) | Page data acquisition processing method and device, computer equipment and storage medium | |
| CN110968510A (en) | SSD automatic online upgrading firmware test method and device and computer equipment | |
| CN110874295B (en) | Test method and system for boot verification after abnormal shutdown | |
| CN112817816B (en) | Embedded point processing method and device, computer equipment and storage medium | |
| CN117914737A (en) | Mirror image resource testing method and device for network target range | |
| CN111277476A (en) | Gateway controller function verification method, gateway controller function verification device, computer equipment and storage medium | |
| CN112486838A (en) | Interface testing method and device, computer equipment and storage medium | |
| CN112612706A (en) | Automated testing method, computer device and storage medium | |
| CN110704218B (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN111786991B (en) | Block chain-based platform authentication login method and related device | |
| CN111159027B (en) | Automatic testing method and device, computer equipment and readable storage medium | |
| CN115033481A (en) | Method and device for automatic test code generation based on browser access and computer equipment | |
| CN114978360A (en) | Automatic testing method and device for communication equipment, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |