CN112597368A - Data processing method and related device - Google Patents
Data processing method and related device Download PDFInfo
- Publication number
- CN112597368A CN112597368A CN202011505790.0A CN202011505790A CN112597368A CN 112597368 A CN112597368 A CN 112597368A CN 202011505790 A CN202011505790 A CN 202011505790A CN 112597368 A CN112597368 A CN 112597368A
- Authority
- CN
- China
- Prior art keywords
- data
- interactive data
- unit
- abnormal condition
- interactive
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title abstract description 16
- 230000002452 interceptive effect Effects 0.000 claims abstract description 99
- 230000002159 abnormal effect Effects 0.000 claims abstract description 74
- 238000000034 method Methods 0.000 claims abstract description 71
- 238000012545 processing Methods 0.000 claims abstract description 67
- 230000006399 behavior Effects 0.000 claims abstract description 52
- 230000005540 biological transmission Effects 0.000 claims description 18
- 230000003993 interaction Effects 0.000 claims description 18
- 238000006243 chemical reaction Methods 0.000 claims description 8
- 238000012795 verification Methods 0.000 claims description 4
- 241000282414 Homo sapiens Species 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000013480 data collection Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000004801 process automation Methods 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0242—Determining effectiveness of advertisements
Abstract
The embodiment of the application discloses a data processing method, which comprises the following steps: determining update interactive data of a target website; acquiring the interactive data; if an abnormal condition occurs in the interactive data acquisition process, determining historical operation behaviors corresponding to the abnormal condition; and executing the historical operation behavior. By the method, the processing equipment can automatically acquire the changed data after determining that the interactive data of the target website is updated, detect the data acquisition process, and automatically and repeatedly execute the historical operation behavior corresponding to the abnormal situation if the abnormal situation occurs, so that data acquisition is retried, the success rate and efficiency of data processing are improved, and the consumption of human resources is reduced.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a data processing method and a related apparatus.
Background
In the network era, data collection and analysis are the main ways for relevant personnel to obtain information, for example, after advertisement delivery, advertisement delivery effect can be analyzed by collecting information such as advertisement conversion rate and click rate.
In the related art, data collection and analysis are mainly completed manually by related personnel, and when the data volume is large, a large amount of human resources are consumed by the processing mode, and the data processing efficiency is low.
Disclosure of Invention
In order to solve the technical problem, the application provides a data processing method, after determining that a target website updates interactive data, a processing device can automatically acquire the data, detect a data acquisition process, and automatically and repeatedly execute a historical operation behavior corresponding to an abnormal situation if the abnormal situation occurs, so that data acquisition is retried, the success rate and efficiency of data processing are improved, and the consumption of human resources is reduced.
The embodiment of the application discloses the following technical scheme:
in a first aspect, an embodiment of the present application provides a data processing method, where the method includes:
determining update interactive data of a target website;
acquiring the interactive data;
if an abnormal condition occurs in the interactive data acquisition process, determining historical operation behaviors corresponding to the abnormal condition;
and executing the historical operation behavior.
In one possible implementation, the historical operating behavior is the historical operating behavior associated with the abnormal situation and having the smallest time interval with the time node generating the abnormal situation.
In one possible implementation, the method further includes:
checking whether the interactive data meet data acquisition requirements, wherein the data acquisition requirements comprise any one or more combinations of whether the quantity of the interactive data meets a first preset value and whether the accuracy of the interactive data meets a second preset value;
and if not, sending first alarm information to a user, wherein the first alarm information is used for indicating the user to check the interactive data.
In one possible implementation, the method further includes:
and if the abnormal condition is detected in the interactive data acquisition process, sending second alarm information to the user.
In one possible implementation, the method further includes:
if an abnormal condition is detected and the abnormal condition does not occur in the process of acquiring the interactive data, executing the step of determining the target website to update the interactive data;
and sending third alarm information to the user.
In one possible implementation, the method further includes:
converting the data format of the interactive data into a preset format;
and transmitting the interactive data to an application party through a data interface corresponding to the preset format.
In one possible implementation, the method further includes:
and if the interactive data transmission is determined to be finished, sending data transmission finishing information to the user.
In one possible implementation, the method is implemented based on RPA technology.
In a second aspect, an embodiment of the present application provides a data processing apparatus, where the apparatus includes a first determining unit, an obtaining unit, a second determining unit, and a first executing unit:
the first determining unit is used for determining the update interactive data of the target website;
the acquisition unit is used for acquiring the interactive data;
the second determining unit is configured to determine, if an abnormal condition occurs in the interactive data acquisition process, a historical operation behavior corresponding to the abnormal condition;
the first execution unit is used for executing the historical operation behaviors.
In one possible implementation, the historical operating behavior is the historical operating behavior associated with the abnormal situation and having the smallest time interval with the time node generating the abnormal situation.
In a possible implementation manner, the apparatus further includes a verification unit and a first alarm unit:
the verification unit is used for verifying whether the interactive data meet data acquisition requirements, wherein the data acquisition requirements comprise any one or more combinations of whether the quantity of the interactive data meet a first preset value and whether the accuracy of the interactive data meet a second preset value;
and the first alarm unit is used for sending first alarm information to a user if the first alarm information is not satisfied, and the first alarm information is used for indicating the user to check the interactive data.
In a possible implementation, the apparatus further includes a second alarm unit:
and the second alarm unit is used for sending second alarm information to a user if the abnormal condition is detected in the interactive data acquisition process.
In a possible implementation manner, the apparatus further includes a second execution unit and a third alarm unit:
the second execution unit is configured to execute the step of determining that the target website updates the interactive data if an abnormal condition is detected and the abnormal condition does not occur in the process of acquiring the interactive data;
and the third alarm unit is used for sending third alarm information to the user.
In one possible implementation manner, the apparatus further includes a conversion unit and a transmission unit:
the conversion unit is used for converting the data format of the interactive data into a preset format;
and the transmission unit is used for transmitting the interactive data to an application party through a data interface corresponding to the preset format.
In one possible implementation, the apparatus further includes a transmitting unit:
and the sending unit is used for sending data transmission completion information to the user if the interactive data transmission is determined to be completed.
In one possible implementation, the apparatus is implemented based on RPA technology.
According to the technical scheme, the data processing method is provided, and processing equipment replaces manual work to process data. First, the processing device may determine that the target website updates the interaction data and then automatically obtain the interaction data. In the process of obtaining the interactive data, the processing device can perform real-time monitoring, and if an abnormal condition occurs in the process of obtaining the interactive data, the historical operation behavior corresponding to the abnormal condition can be determined, and the historical operation behavior can be executed. The historical operation behavior is the operation behavior which causes the abnormal condition to occur, so that the processing equipment can continuously and repeatedly try the historical operation behavior to try to successfully acquire data without manual re-operation, the data processing success rate is ensured, the processing efficiency is improved, and the consumption of human resources is saved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a data processing method according to an embodiment of the present application;
fig. 2 is a schematic diagram of a data processing method in an actual application scenario according to an embodiment of the present application;
fig. 3 is a block diagram of a data processing apparatus according to an embodiment of the present application;
fig. 4 is a block diagram of a data processing apparatus according to an embodiment of the present application;
fig. 5 is a block diagram of a data processing apparatus according to an embodiment of the present application;
fig. 6 is a block diagram of a data processing apparatus according to an embodiment of the present application;
fig. 7 is a block diagram of a data processing apparatus according to an embodiment of the present application;
fig. 8 is a block diagram of a data processing apparatus according to an embodiment of the present application.
Detailed Description
Embodiments of the present application are described below with reference to the accompanying drawings.
In order to process and analyze data, in the related art, it is usually necessary to manually collect and analyze relevant data from relevant web pages. However, in the internet era, the number of internet users increases exponentially, which results in that various websites or software contain a large amount of data to be processed, and it is difficult to rapidly and accurately process the data only by manual power.
In order to solve the technical problem, the application provides a data processing method, after determining that a target website updates interactive data, a processing device can automatically acquire the data, detect a data acquisition process, and automatically and repeatedly execute a historical operation behavior corresponding to an abnormal situation if the abnormal situation occurs, so that data acquisition is retried, the success rate and efficiency of data processing are improved, and the consumption of human resources is reduced.
It is understood that the method may be applied to a processing device having a data processing function, for example, a terminal device or a server having a data processing function. The method can be applied to a network scene of communication between the terminal equipment and the server, and the terminal equipment and the server are matched for operation. The terminal device may be a mobile phone, a desktop computer, a Personal Digital Assistant (PDA for short), a tablet computer, or the like. The server may be understood as an application server, or may also be a Web server, and in actual deployment, the server may be an independent physical server, or may be a server cluster or a distributed system formed by a plurality of physical servers. The terminal and the server may be directly or indirectly connected through wired or wireless communication, and the application is not limited herein.
Next, a data processing method provided by an embodiment of the present application will be described with reference to the drawings.
Referring to fig. 1, fig. 1 is a flowchart of a data processing method provided in an embodiment of the present application, where the method includes:
s101: and determining the update interaction data of the target website.
For example, after an advertisement is delivered to a certain website, the website can provide data such as a conversion rate, a click rate, a browsing volume and the like related to the advertisement, and related personnel need to judge the delivery effect of the advertisement according to the data, and in this case, the website can be set as a target website.
The processing equipment can log in the target website in a mode of corresponding account number and password of the target website and the like, and monitors the data state on the target website in real time. If it is determined that the target website updates the interaction data, the subsequent steps may be performed. The interactive data refers to data generated when the user browses the target website.
S102: and acquiring interactive data.
After determining that the target website has the interaction data, the processing device may automatically obtain the interaction data from the website.
The method for enabling the processing device to automatically acquire the interactive data may include various methods. In one possible implementation, the associated person may design program code that causes the processing device to simulate the manner in which data is manually acquired, such as by clicking on an associated location in a website to download the associated data, etc. By the method, the processing equipment can reasonably acquire data from the target website, and the success rate of data acquisition is improved.
S103: and if an abnormal condition occurs in the process of detecting and acquiring the interactive data, determining the historical operation behavior corresponding to the abnormal condition.
In order to reduce the failure rate in the data acquisition process, the processing device may monitor the process of acquiring the interactive data in real time. It can be understood that, during the process of acquiring data, network abnormality, code error, etc. may occur, and there is a probability that the data acquisition action will fail. At this time, in order to eliminate the abnormal situation, the processing device may determine a historical operation behavior corresponding to the abnormal situation, where the historical operation behavior refers to an operation behavior, such as clicking, copying, pasting, pulling, and the like, performed by the processing device in the process of acquiring the interactive data before the abnormal situation occurs. The processing device may record operation behaviors made by the processing device itself, and when an abnormal situation occurs, may obtain a historical operation behavior corresponding to the abnormal situation from the record.
It is understood that the abnormal situation may be caused by an occasional problem, for example, when the abnormal situation is due to network fluctuation and a certain data cannot be successfully downloaded, if the downloading action is repeated, the data acquisition may be successfully performed after the problem disappears. Therefore, the analysis of the historical operation behaviors is beneficial to the processing equipment to solve the abnormal condition in the process.
S104: and executing historical operation behaviors.
After determining the historical operation behavior, in order to be able to eliminate the abnormal situation and successfully acquire the interaction data, the processing device may execute the historical operation behavior. In the execution process, if the abnormal condition still occurs, the steps of determining the historical operation behavior and executing are repeated, so that the purpose of repeatedly executing the historical operation behavior before the abnormal condition is eliminated is achieved.
In order to improve the data processing efficiency, the historical operation behavior can be set more accurately. For example, in one possible implementation, the historical operating behavior may be the one associated with the abnormal situation and having the smallest time interval with the time node at which the abnormal situation occurred, because the more closely the historical operating behavior is to the time at which the abnormal situation occurred, the less time it takes to perform repeatedly.
In the course of executing the historical operation behavior, a reasonable execution stop condition may also be set in order to improve the efficiency of data processing. For example, in one possible implementation, the execution of the historical operation behavior may be stopped after the interactive data is successfully acquired or the historical operation behavior is executed for a preset number of times, so as to avoid wasting data processing time in some abnormal situations that cannot be solved by repeatedly executing operations.
According to the technical scheme, the data processing method is provided, and processing equipment replaces manual work to process data. First, the processing device may determine that the target website updates the interaction data and then automatically obtain the interaction data. In the process of obtaining the interactive data, the processing device can perform real-time monitoring, and if an abnormal condition occurs in the process of obtaining the interactive data, the historical operation behavior corresponding to the abnormal condition can be determined, and the historical operation behavior can be executed. The historical operation behavior is the operation behavior which causes the abnormal condition to occur, so that the processing equipment can continuously and repeatedly try the historical operation behavior to try to successfully acquire data without manual re-operation, the data processing success rate is ensured, the processing efficiency is improved, and the consumption of human resources is saved.
In order to improve the data quality of the acquired interactive data, in one possible implementation, the processing device may further check whether the interactive data meets a data acquisition requirement, where the data acquisition requirement is used to determine the data quality of the acquired interactive data. The data acquisition requirement may include any one or a combination of more of whether the quantity of the interactive data meets a first preset value and whether the accuracy of the interactive data meets a second preset value, so that the integrity and the accuracy of the data can be improved to a certain extent.
For example, when the interaction data is data related to a certain advertisement, the interaction data may relate to a plurality of data of a plurality of cities. At this time, the processing device may analyze the acquired interactive data, and determine whether the city number and the category number of the interactive data meet requirements; the number of categories of data can be determined by the number of tables, the number of rows of tables, and the like.
If the data is not satisfied, the processing device may further send first alarm information to the user, where the first alarm information is used to instruct the user to check the interactive data, so as to further improve the validity of the interactive data.
It can be understood that, in addition to sending alarm information when the interactive data is abnormal, in a possible implementation manner, in order to enable a relevant user to know an abnormal condition in the data acquisition process at the first time, if it is detected that the abnormal condition occurs in the interactive data acquisition process, the processing device may also send second alarm information to the user.
In addition, it can be understood that an abnormal situation may occur not only in the process of acquiring the interaction data, but also in other processes of determining that the target website updates the interaction data, performs historical operation behaviors, and the like. Therefore, in order to further improve the success rate of data processing, in a possible implementation manner, if an abnormal condition is detected and the abnormal condition does not occur in the process of acquiring the interactive data, the processing device may further execute the step of determining the target website to update the interactive data, so that when a problem occurs in other processes, the processing device may rerun the entire data processing process, thereby improving the success rate of data processing.
Meanwhile, the processing equipment can also send third alarm information to the user, and because the third alarm information, the second alarm information and the first alarm information are different alarm information, the related user can also know the specific type of the abnormal condition according to the type of the alarm information.
In addition, after the related data is successfully acquired, in order to enable the related data to be transmitted through some specific interfaces, the processing device may further convert the data format of the interactive data into a preset format, and transmit the interactive data to the application party through a data interface corresponding to the preset format, where the preset format may be a format corresponding to the API interface, or the like. Therefore, specific sending of data can be completed without data processing by related users, and the efficiency of data processing is further improved.
After the data transmission is completed, in order to enable the relevant user to know the information that the data transmission is completed in the first time, in one possible implementation manner, if it is determined that the interactive data transmission is completed, the processing device may further send data transmission completion information to the user.
It will be appreciated that in the above-described embodiments, the automatic execution of the processing device may be implemented in a variety of ways. In one possible implementation, the method may be implemented based on RPA technology, for example, the processing device may be some RPA robot. The feature of RPA robot process automation (robot process automation) is that it can replace or assist human to complete repetitive work and tasks in computer, RPA mobile phone and other digital devices.
As long as the use rule is designed in advance, the RPA can simulate manual work, and carry out operations such as copying, pasting, clicking, inputting and the like, thereby assisting human beings to complete a large amount of work of 'rule is relatively fixed, repeatability is relatively high, and added value is relatively low'. The RPA technology has two characteristics of non-invasiveness and flexible configuration: when the RPA is deployed by an enterprise, the existing information system of the enterprise does not need to be changed, so that the iceberg of a legacy system can be avoided; the RPA technology has very strong flexible configuration, can be very close to the own business of an enterprise, and realizes seamless combination. The two characteristics can lead the RPA technology to land from small to large in an enterprise.
In order to facilitate understanding of the technical solution provided by the present application, a data processing method provided by the embodiment of the present application will be introduced in combination with an actual application scenario.
Referring to fig. 2, fig. 2 is a schematic diagram of a data processing method in an actual application scenario provided in the embodiment of the present application, where a processing device is an RPA robot.
After the process is initiated, the RPA bot may first determine whether a third-party website, such as an advertising website or the like, updates interaction data, which may be a conversion rate, click-through rate, view volume, etc., for a particular advertisement. If not, sending alarm information to related personnel; if the data is updated, the RPA robot can acquire the required interactive data and judge whether the data acquisition has abnormal conditions. If yes, re-executing the action of acquiring the interactive data; if not, it may be checked whether the data is completely acquired. If the interactive data or the codes are not completely acquired, alarm information can be sent to related personnel to prompt the related personnel to check the interactive data or the codes and the like; if the data is completely acquired, the data format can be converted, and the data is compressed and then sent to the application party. Meanwhile, in order to meet the requirements of other related personnel on data, the RPA robot can also send the compressed data to the related personnel through mails and send notification information to the related personnel.
Based on the data processing method provided in the foregoing embodiment, an embodiment of the present application further provides a data processing apparatus, referring to fig. 3, fig. 3 is a block diagram of a structure of a data processing apparatus 300 provided in the present application, where the apparatus 300 includes a first determining unit 301, an obtaining unit 302, a second determining unit 303, and a first executing unit 304:
the first determining unit 301 is configured to determine update interaction data of a target website;
the obtaining unit 302 is configured to obtain the interactive data;
the second determining unit 303 is configured to determine, if an abnormal condition occurs in the interactive data acquiring process, a historical operation behavior corresponding to the abnormal condition;
the first execution unit 304 is configured to execute the historical operation behavior.
In one possible implementation, the historical operating behavior is the historical operating behavior associated with the abnormal situation and having the smallest time interval with the time node generating the abnormal situation.
In one possible implementation, referring to fig. 4, the apparatus 300 further includes a verification unit 305 and a first alarm unit 306:
the checking unit 305 is configured to check whether the interactive data meets a data acquisition requirement, where the data acquisition requirement includes any one or a combination of more of whether the number of the interactive data meets a first preset value and whether the accuracy of the interactive data meets a second preset value;
the first alarm unit 306 is configured to send first alarm information to a user if the first alarm information is not satisfied, where the first alarm information is used to instruct the user to check the interaction data.
In one possible implementation, referring to fig. 5, the apparatus 300 further comprises a second alarm unit 307:
the second alarm unit 307 is configured to send second alarm information to the user if it is detected that an abnormal condition occurs in the interactive data acquisition process.
In one possible implementation, referring to fig. 6, the apparatus 300 further includes a second execution unit 308 and a third alarm unit 309:
the second executing unit 308 is configured to execute the step of determining that the target website updates the interactive data if an abnormal condition is detected and the abnormal condition does not occur in the process of acquiring the interactive data;
and the third alarm unit 309 is configured to send third alarm information to the user.
In one possible implementation, referring to fig. 7, the apparatus 300 further includes a conversion unit 310 and a transmission unit 311:
the converting unit 310 is configured to convert a data format of the interactive data into a preset format;
the transmission unit 311 is configured to transmit the interactive data to an application party through a data interface corresponding to the preset format.
In one possible implementation, referring to fig. 8, the apparatus 300 further includes a sending unit 312:
the sending unit 321 is configured to send data transmission completion information to the user if it is determined that the interactive data transmission is completed.
In one possible implementation, the method is implemented based on RPA technology.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium may be at least one of the following media: various media that can store program codes, such as read-only memory (ROM), RAM, magnetic disk, or optical disk.
It should be noted that, in the present specification, all the embodiments are described in a progressive manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus and system embodiments, since they are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for related points. The above-described embodiments of the apparatus and system are merely illustrative, and the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
The above description is only one specific embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A method of data processing, the method comprising:
determining update interactive data of a target website;
acquiring the interactive data;
checking whether the interactive data meet data acquisition requirements, wherein the data acquisition requirements comprise any one or more combinations of whether the quantity of the interactive data meets a first preset value and whether the accuracy of the interactive data meets a second preset value;
if the interactive data is not met, sending first alarm information to a user, wherein the first alarm information is used for indicating the user to check the interactive data;
if an abnormal condition occurs in the interactive data acquisition process, determining a historical operation behavior corresponding to the abnormal condition, wherein the historical operation behavior is related to the abnormal condition and has the minimum time interval with a time node generating the abnormal condition;
and executing the historical operation behavior.
2. The method of claim 1, further comprising:
and if the abnormal condition is detected in the interactive data acquisition process, sending second alarm information to the user.
3. The method of claim 1, further comprising:
if an abnormal condition is detected and the abnormal condition does not occur in the process of acquiring the interactive data, executing the step of determining the target website to update the interactive data;
and sending third alarm information to the user.
4. The method of claim 1, further comprising:
converting the data format of the interactive data into a preset format;
and transmitting the interactive data to an application party through a data interface corresponding to the preset format.
5. The method of claim 4, further comprising:
and if the interactive data transmission is determined to be finished, sending data transmission finishing information to the user.
6. The method according to any of claims 1-5, wherein the method is implemented based on RPA techniques.
7. A data processing device is characterized by comprising a first determining unit, an obtaining unit, a verifying unit, a first alarming unit, a second determining unit and a first executing unit:
the first determining unit is used for determining the update interactive data of the target website;
the acquisition unit is used for acquiring the interactive data;
the verification unit is used for verifying whether the interactive data meet data acquisition requirements, wherein the data acquisition requirements comprise any one or more combinations of whether the quantity of the interactive data meet a first preset value and whether the accuracy of the interactive data meet a second preset value;
the first alarm unit is used for sending first alarm information to a user if the interaction data does not meet the requirement, and the first alarm information is used for indicating the user to check the interaction data;
the second determining unit is configured to determine, if an abnormal condition occurs in the interactive data acquisition process, a historical operation behavior corresponding to the abnormal condition, where the historical operation behavior is related to the abnormal condition and has a minimum time interval with a time node at which the abnormal condition occurs;
the first execution unit is used for executing the historical operation behaviors.
8. The apparatus of claim 7, further comprising a second alarm unit:
and the second alarm unit is used for sending second alarm information to a user if the abnormal condition is detected in the interactive data acquisition process.
9. The apparatus of claim 7, further comprising a second execution unit and a third alarm unit:
the second execution unit is configured to execute the step of determining that the target website updates the interactive data if an abnormal condition is detected and the abnormal condition does not occur in the process of acquiring the interactive data;
and the third alarm unit is used for sending third alarm information to the user.
10. The apparatus of claim 7, further comprising a conversion unit and a transmission unit:
the conversion unit is used for converting the data format of the interactive data into a preset format;
and the transmission unit is used for transmitting the interactive data to an application party through a data interface corresponding to the preset format.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011505790.0A CN112597368A (en) | 2020-12-18 | 2020-12-18 | Data processing method and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011505790.0A CN112597368A (en) | 2020-12-18 | 2020-12-18 | Data processing method and related device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112597368A true CN112597368A (en) | 2021-04-02 |
Family
ID=75199411
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011505790.0A Pending CN112597368A (en) | 2020-12-18 | 2020-12-18 | Data processing method and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112597368A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104636933A (en) * | 2015-02-11 | 2015-05-20 | 广州唯品会信息科技有限公司 | Method and device for positioning oversell reasons of e-commerce website |
| CN110471821A (en) * | 2019-08-07 | 2019-11-19 | 深圳市腾讯计算机系统有限公司 | Abnormal alteration detection method, server and computer readable storage medium |
| CN110569282A (en) * | 2019-09-04 | 2019-12-13 | 中国工商银行股份有限公司 | Data processing method, data processing device, computing equipment and computer readable storage medium |
-
2020
- 2020-12-18 CN CN202011505790.0A patent/CN112597368A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104636933A (en) * | 2015-02-11 | 2015-05-20 | 广州唯品会信息科技有限公司 | Method and device for positioning oversell reasons of e-commerce website |
| CN110471821A (en) * | 2019-08-07 | 2019-11-19 | 深圳市腾讯计算机系统有限公司 | Abnormal alteration detection method, server and computer readable storage medium |
| CN110569282A (en) * | 2019-09-04 | 2019-12-13 | 中国工商银行股份有限公司 | Data processing method, data processing device, computing equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10210036B2 (en) | Time series metric data modeling and prediction | |
| CN107832428B (en) | Webpage method for monitoring state based on Website page and system | |
| CN104461903A (en) | Method and device for testing client side based on browser | |
| CN110784374A (en) | Method, device, equipment and system for monitoring operation state of service system | |
| CN103902446A (en) | Network server automated testing method and device | |
| WO2023168926A1 (en) | Method and apparatus for determining software anomaly, storage medium, and electronic apparatus | |
| CN109299124B (en) | Method and apparatus for updating a model | |
| CN110737548A (en) | Data request method and server | |
| US11874728B2 (en) | Software application diagnostic aid | |
| CN110674045B (en) | Information tracking detection method and device, electronic equipment and storage medium | |
| CN112256470A (en) | Fault server positioning method and device, storage medium and electronic equipment | |
| CN112235358A (en) | Data acquisition method and device, electronic equipment and computer readable storage medium | |
| CN112597368A (en) | Data processing method and related device | |
| CN116107589A (en) | Automatic compiling method, device and equipment of software codes and storage medium | |
| CN110875832A (en) | Abnormal service monitoring method, device and system and computer readable storage medium | |
| CN114693116A (en) | Method and device for detecting code review validity and electronic equipment | |
| CN114546799A (en) | Point burying log checking method and device, electronic equipment, storage medium and product | |
| CN110362464B (en) | Software analysis method and equipment | |
| CN112799957A (en) | User behavior based fault handling method, system, device and medium | |
| CN113672497A (en) | Method, device and equipment for generating non-buried point event and storage medium | |
| CN112328473A (en) | Code automation integration test method and device and electronic equipment | |
| CN111311014A (en) | Service data processing method and device, computer equipment and storage medium | |
| CN111639249A (en) | Automatic monitoring method, device and equipment for user feedback error reporting | |
| CN111176982A (en) | Test interface generation method and device | |
| CN113141366B (en) | Message submitting method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |