CN114819889A

CN114819889A - RPA and AI combined e-commerce data acquisition method and device and electronic equipment

Info

Publication number: CN114819889A
Application number: CN202210387298.0A
Authority: CN
Inventors: 李晓萌
Original assignee: Beijing Laiye Network Technology Co Ltd; Laiye Technology Beijing Co Ltd
Current assignee: Beijing Laiye Network Technology Co Ltd; Laiye Technology Beijing Co Ltd
Priority date: 2022-04-13
Filing date: 2022-04-13
Publication date: 2022-07-29

Abstract

The application relates to a method, a device and electronic equipment for acquiring E-commerce data by combining RPA and AI, relating to the technical field of RPA and AI, wherein the method comprises the following steps: logging in an e-commerce data platform; according to an access path of a target data page of the e-commerce data platform, accessing the target data page by simulating mouse click operation; downloading target e-commerce data in a target data page; and writing the downloaded target e-commerce data into a database. Therefore, the RPA robot is combined with the AI to replace manual automatic login of the e-commerce data platform, downloading of the target e-commerce data and database writing are performed, automatic acquisition and storage of the e-commerce data are achieved, and labor cost and time cost required for acquiring the e-commerce data are greatly reduced.

Description

RPA and AI combined e-commerce data acquisition method and device and electronic equipment

Technical Field

The application relates to the technical field of robot process automation and artificial intelligence, in particular to a method and a device for acquiring E-commerce data by combining RPA and AI and electronic equipment.

Background

Robot Process Automation (RPA) is a Process task automatically executed according to rules by simulating human operations on a computer through specific robot software.

Artificial Intelligence (AI) is a technical science that studies and develops theories, methods, techniques and application systems for simulating, extending and expanding human Intelligence.

Currently, many cumbersome and repetitive services require manual handling. For example, in order to produce a better product, data analysis of e-commerce data is often required, wherein the e-commerce data includes, for example, sales volume of a certain product in a period of time, sales volume ranking of various products in a period of time, prices of similar products on various e-commerce websites, and the like. In the related art, a manual method is usually adopted to log in a platform for providing e-commerce data to download data, and this method wastes a lot of labor cost and time cost when downloading massive data. How to obtain the commercial data with lower cost has become an urgent problem to be solved.

Disclosure of Invention

The application provides a method and a device for acquiring e-commerce data by combining RPA and AI and electronic equipment, so as to solve the technical problems of high labor cost and high time cost of the e-commerce data acquisition method in the related technology.

The embodiment of the first aspect of the present application provides a method for acquiring e-commerce data in combination with an RPA and an AI, which is performed by an RPA robot, and the method includes: logging in an e-commerce data platform; according to an access path of a target data page of the e-commerce data platform, accessing the target data page by simulating mouse click operation; downloading target e-commerce data in a target data page; and writing the downloaded target e-commerce data into a database.

In some embodiments, the e-commerce data platform includes a login page; log in the e-commerce data platform, including: accessing the e-commerce data platform according to the website information of the e-commerce data platform; accessing the login page according to the access path of the login page; calling a password manager, and inputting account information and corresponding password information on a login page in a virtual keyboard mode to log in an e-commerce data platform; the password manager stores account information and encrypted password information.

In some embodiments, after accessing the login page according to the access path of the login page, the method further includes: under the condition that short message verification code verification is required, a verification code cooperation task is issued to a man-machine cooperation platform; and inputting the target short message verification code on the login page in response to the target short message verification code which is obtained and sent after the man-machine cooperation platform processes the verification code cooperation task.

In some embodiments, after accessing the login page according to the access path of the login page, the method further includes: and dragging the slider by simulating the dragging operation of the mouse under the condition that the slider verification code is required to be verified.

In some embodiments, after accessing the login page according to the access path of the login page, the method further includes: identifying the verification code on the verification code picture by adopting an Optical Character Recognition (OCR) technology under the condition that the verification code of the picture needs to be verified; enter the verification code on the login page.

In some embodiments, the number of target data pages is multiple; according to an access path of a target data page of an e-commerce data platform, accessing the target data page by simulating mouse click operation, wherein the access path comprises the following steps: and aiming at each target data page, accessing the corresponding target data page by simulating mouse click operation according to the corresponding access path.

In some embodiments, before downloading the target e-commerce data in the target data page, the method further includes: and inputting the query conditions into a target data page to query the target e-commerce data meeting the query conditions.

The embodiment of the second aspect of the present application provides an acquiring apparatus for e-commerce data combining RPA and AI, which is applied to an RPA robot, and the apparatus includes: the login module is used for logging in the e-commerce data platform; the access module is used for accessing a target data page by simulating mouse click operation according to an access path of the target data page of the e-commerce data platform; the downloading module is used for downloading the target e-commerce data in the target data page; and the writing module is used for writing the downloaded target e-commerce data into a database.

In some embodiments, the e-commerce data platform includes a login page; a login module comprising: the first access unit is used for accessing the e-commerce data platform according to the website information of the e-commerce data platform; the second access unit is used for accessing the login page of the e-commerce data platform according to the access path of the login page; the first processing unit is used for calling the password manager, inputting account information and corresponding password information on a login page in a virtual keyboard mode, and logging in an e-commerce data platform; the password manager stores account information and encrypted password information.

In some embodiments, the login module further comprises: the sending unit is used for issuing a verification code cooperation task to the man-machine cooperation platform under the condition that short message verification code verification is required; and the second processing unit is used for responding to the acquired target short message verification code sent after the man-machine cooperation platform processes the verification code cooperation task and inputting the target short message verification code on the login page.

In some embodiments, the login module further comprises: and the third processing unit is used for dragging the slider by simulating mouse dragging operation under the condition that the slider verification code is required to be verified.

In some embodiments, the login module further comprises: the identification unit is used for identifying the verification code on the verification code picture by adopting an Optical Character Recognition (OCR) technology under the condition that the verification code of the picture needs to be verified; and the fourth processing unit is used for inputting the verification code on the login page.

In some embodiments, the number of target data pages is multiple; an access module, comprising: and the third access unit is used for accessing the corresponding target data page by simulating mouse click operation according to the corresponding access path aiming at each target data page.

In some embodiments, the device for acquiring e-commerce data further includes: and the query module is used for inputting the query conditions into the target data page so as to query the target e-commerce data meeting the query conditions.

An embodiment of the third aspect of the present application provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the method according to the embodiment of the first aspect of the present application is implemented.

An embodiment of a fourth aspect of the present application provides a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the method according to the embodiment of the first aspect of the present application.

An embodiment of the fifth aspect of the present application provides a computer program product, which includes a computer program, and the computer program, when executed by a processor, implements the method according to the embodiment of the first aspect of the present application.

The technical scheme provided by the embodiment of the application can have the following beneficial effects:

the RPA robot is combined with the AI to replace manual automatic login of the e-commerce data platform, downloading of the target e-commerce data and database writing are performed, automatic acquisition and storage of the e-commerce data are achieved, and labor cost and time cost required for acquiring the e-commerce data are greatly reduced.

Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.

Drawings

In the drawings, like reference numerals refer to the same or similar parts or elements throughout the several views unless otherwise specified. The figures are not necessarily to scale. It is appreciated that these drawings depict only some embodiments in accordance with the disclosure and are therefore not to be considered limiting of its scope.

Fig. 1 is a schematic flow chart of a method for acquiring e-commerce data in combination with an RPA and an AI according to a first embodiment of the present application;

fig. 2 is a schematic flow chart of a method for acquiring e-commerce data in combination with an RPA and an AI according to a second embodiment of the present application;

FIG. 3 is a partial illustration of a landing page of an e-commerce data platform according to a second embodiment of the present application;

FIG. 4 is an exemplary diagram of a target data page of the e-commerce data platform according to a second embodiment of the present application;

FIG. 5 is an exemplary diagram of another target data page of the e-commerce data platform according to a second embodiment of the present application;

FIG. 6 is an exemplary diagram of another target data page of the e-commerce data platform according to a second embodiment of the present application;

fig. 7 is a schematic structural diagram of an apparatus for acquiring e-commerce data in combination with an RPA and an AI according to a third embodiment of the present application;

fig. 8 is a block diagram of an electronic device for implementing the method for acquiring e-commerce data in combination with RPA and AI according to the embodiment of the present application.

Detailed Description

Reference will now be made in detail to the embodiments of the present application/disclosure, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application/disclosure, and should not be construed as limiting the present application/disclosure.

These and other aspects of the embodiments of the present application/disclosure will be apparent with reference to the following description and attached drawings. In the description and drawings, particular embodiments of the present application/disclosed embodiments are disclosed in detail as being indicative of some of the ways in which the principles of the present application/disclosed embodiments may be practiced, but it is understood that the scope of the present application/disclosed embodiments is not limited thereby. Rather, the embodiments of the application/disclosure include all changes, modifications and equivalents coming within the spirit and terms of the claims appended hereto.

It should be noted that, in the technical solution of the present disclosure, the acquisition, storage, application, and the like of the personal information of the related user all conform to the regulations of the related laws and regulations, and do not violate the customs of the public order.

In the description of the present application/disclosure, the term "plurality" means two or more.

The utility model provides a mode through RPA robot and AI combination replaces artifical automatic train of thinking that acquires the electricity merchant data. The RPA robot can log in an e-commerce data platform, access a target data page by simulating mouse click operation according to an access path of the target data page of the e-commerce data platform, download the target e-commerce data in the target data page, and write the downloaded target e-commerce data into a database. Therefore, the RPA robot is combined with the AI to replace manual automatic login of the e-commerce data platform, downloading of the target e-commerce data and database writing are performed, automatic acquisition and storage of the e-commerce data are achieved, and labor cost and time cost required for acquiring the e-commerce data are greatly reduced.

For the purpose of clearly explaining the embodiments of the present invention, terms related to the embodiments of the present invention will be explained first.

In the description of the present application, the "RPA robot" refers to a software robot that can automatically acquire e-commerce data in combination with the AI technology and the RPA technology. The RPA robot has two characteristics of 'connector' and 'non-invasion', and extracts, integrates and communicates data of different systems in a non-invasive mode on the premise of not changing an information system by simulating an operation method of a human.

In the description of the present application, the "e-commerce data platform" refers to a platform for providing e-commerce data, such as some merchant-oriented operation data open platforms, which can provide real-time brand category data, real-time sales data, traffic data, industry trends and e-commerce data of concerns, purchases, abnormal goods, and the like. The e-commerce data platform in the embodiment of the application can be any platform for providing e-commerce data, and the application does not limit the platform. The e-commerce data platform includes, but is not limited to, a "login page" and a "target data page". The target data page refers to a webpage containing e-commerce data, and the e-commerce data can be inquired and/or downloaded in the webpage; the "login page" refers to a web page for allowing a user to log in a user account, and the user account can be logged in by inputting information such as an account and a password into the web page.

In the description of the present application, the "slider verification code" is a common behavior verification code, and a user only needs to slide the slider slightly to fill the puzzle, so that the security verification can be completed.

In the description of the present application, the "query condition" refers to a condition that is preset and needs to be met by target e-commerce data that needs to be downloaded, and may include dimensions such as date, category, and the like.

In the description of the present application, a "password manager" is a hardware product for solving the problem of password storage and input, and may be connected to an electronic device through, for example, a USB (Universal Serial Bus) interface, so that the electronic device may be recognized as a USB keyboard by an operating system of the electronic device, and may also store multiple sets of encrypted passwords, and when input is required, the passwords may be directly input into the operating system by means of a virtual keyboard.

In the description of the application, the human-computer cooperation platform refers to a platform for connecting the cooperation of an artificial and a robot, tasks needing manual judgment and decision can be distributed to the artificial in an automatic process by using the human-computer cooperation platform, and the artificial provides accurate input for the robot through operations such as form information input and information secondary check and confirmation, so that more and safer automatic opportunities are created.

In the description of the application, the verification code cooperation task refers to a verification code input task which needs to be finished by cooperation with the RPA robot by using a human-computer cooperation platform.

In the description of the present application, "OCR (Optical Character Recognition)", specifically refers to a process in which an electronic device checks a Character printed on paper, determines its shape by detecting dark and light patterns, and then translates the shape into a computer text by a Character Recognition method; the method is characterized in that characters in a paper document are converted into an image file with a black-and-white dot matrix in an optical mode aiming at printed characters, and the characters in the image are converted into a text format through recognition software for further editing and processing by word processing software.

In the description of the present application, "data cleansing" refers to a process of finding and correcting an identifiable error in target e-commerce data or modifying a storage format, and the like, and is a pre-processing performed on the target e-commerce data before writing the downloaded target e-commerce data into a database, for example, including deleting the repeatedly downloaded target e-commerce data, detecting the integrity of the target e-commerce data, modifying the storage format of the target e-commerce data, and the like.

A method, an apparatus, an electronic device, and a storage medium for acquiring e-commerce data in conjunction with RPA and AI according to the present application/disclosure are described below with reference to the accompanying drawings.

First, a method for acquiring e-commerce data combining RPA and AI applied to an RPA robot in the embodiment of the present application will be described with reference to the drawings.

Fig. 1 is a flowchart of a method for acquiring e-commerce data in combination with RPA and AI according to a first embodiment of the present application. As shown in fig. 1, the method may include the steps of:

step 101, logging in an e-commerce data platform.

It should be noted that the method for acquiring the e-commerce data combining the RPA and the AI according to the embodiment of the present application may be performed by an apparatus for acquiring the e-commerce data combining the RPA and the AI, and hereinafter, the apparatus for acquiring the e-commerce data combining the RPA and the AI is simply referred to as an apparatus for acquiring the e-commerce data. The device for acquiring e-commerce data may be implemented by an RPA robot, for example, the device for acquiring e-commerce data may be an RPA robot, or the device for acquiring e-commerce data may be configured in an RPA robot, which is not limited in this application.

The RPA robot may be configured in an electronic device, and the electronic device may include, but is not limited to, a terminal device, a server, and the like. In the embodiment of the present application, an example in which an apparatus for acquiring e-commerce data is an RPA robot installed in a terminal device is described.

The RPA robot in this embodiment may execute the method in real time in a specific time period or all day, which is not limited in this application. Wherein the specific time period can be set as desired.

Alternatively, the RPA robot may be started at regular time or based on the reception of a start instruction. For example, the worker may trigger the above-mentioned start instruction for the RPA robot by means of a dialog. The triggering of the start instruction for the RPA robot may be implemented in various ways, for example, the start instruction for the RPA robot may be triggered in a manner of voice and/or text, and for example, the start instruction for the RPA robot may also be triggered in a manner of triggering a designated control on a human-computer interaction interface, which is not limited in this embodiment of the present application.

In the embodiment of the present application, one or more e-commerce data platforms may be provided, which is not limited in the present application.

And 102, accessing the target data page by simulating mouse click operation according to the access path of the target data page of the e-commerce data platform.

It is understood that the access path to the target data page of the e-commerce data platform may be different for different e-commerce data platforms. In the embodiment of the application, the RPA robot can access a target data page by simulating mouse click operation according to an access path corresponding to the target data page of the e-commerce data platform.

And 103, downloading the target e-commerce data in the target data page.

The target e-commerce data is e-commerce data needing to be downloaded.

In this embodiment of the application, the target data page may provide a download button of the target e-commerce data, so that the RPA robot may click the download button by simulating a mouse click operation to download the target e-commerce data.

And 104, writing the downloaded target e-commerce data into a database.

The database may be an SQL (Structured Query Language) database, or may be other types of databases, which is not limited in this application.

In the embodiment of the application, taking the SQL database as an example, the RPA robot may connect to the SQL database, and write the target e-commerce data into the SQL database through the SQL statement.

Furthermore, the RPA robot can click an exit button of the e-commerce data platform by simulating mouse click operation, and then exits the e-commerce data platform.

It can be understood that, for any e-commerce data platform, the target e-commerce data in the e-commerce data platform can be downloaded and written into the database by using the RPA robot to execute the method, so that abundant e-commerce data can be stored in the database, and a foundation is laid for creating a high-quality product by analyzing product positioning, operation modes and the like based on the e-commerce data.

It should be noted that the process of automatically acquiring e-commerce data by performing the above method through the RPA robot is completely different in nature than the process of automatically acquiring e-commerce data through other automation methods. For example, in a process of reading data from a page, the RPA robot and a web crawler capture all data on the page differently, the RPA robot adopts a processing logic similar to a human, and when the required data is not found on the page, the RPA robot feeds back a result that is not obtained, and does not obtain any data from the page. Moreover, the technical implementation of the RPA robot for the web page needs to open the web page for user interface presentation, and for the website background, the process of the RPA robot for executing the method is basically the same as the process of manually executing the method. In addition, the method can be realized by the RPA robot without designing codes, and compared with other automatic modes, the labor cost for realizing the method by the RPA robot is lower.

To sum up, according to the method for acquiring e-commerce data combining the RPA and the AI provided by the embodiment of the application, the RPA robot logs in the e-commerce data platform, accesses the target data page by simulating mouse click operation according to the access path of the target data page of the e-commerce data platform, downloads the target e-commerce data in the target data page, and further writes the downloaded target e-commerce data into the database. Therefore, the RPA robot is combined with the AI to replace manual automatic login of the e-commerce data platform, downloading of the target e-commerce data and database writing are performed, automatic acquisition and storage of the e-commerce data are achieved, and labor cost and time cost required for acquiring the e-commerce data are greatly reduced.

The method for acquiring the e-commerce data combining the RPA and the AI provided in the embodiment of the present application is further described below with reference to fig. 2. Fig. 2 is a flowchart of a method for acquiring e-commerce data in combination with RPA and AI according to a second embodiment of the present application, as shown in fig. 2, the method including:

step 201, accessing the e-commerce data platform according to the website information of the e-commerce data platform.

In the embodiment of the application, the RPA robot can acquire the website information of the e-commerce data platform and access the e-commerce data platform according to the website information of the e-commerce data platform.

And step 202, accessing the login page of the e-commerce data platform according to the access path of the login page.

It will be appreciated that the access path to the landing page of the e-commerce data platform may be different for different e-commerce data platforms. In the embodiment of the application, the RPA robot can access the login page of the e-commerce data platform according to the access path corresponding to the login page of the e-commerce data platform.

Step 203, calling a password manager, and inputting account information and corresponding password information on a login page in a virtual keyboard mode to log in the e-commerce data platform.

The password manager stores account information and encrypted password information.

In an embodiment of the present application, when logging in to the e-commerce data platform, account information and corresponding password information may need to be input on a login page. In the embodiment of the application, the password manager can be used for inputting the account information and the corresponding password information on the login page so as to log in the e-commerce data platform. Specifically, account information and encrypted password information are stored in the password manager, the password manager can be connected with the terminal device, the RPA robot can call the password manager after accessing a login page of the e-commerce data platform, and the account information and the corresponding password information are input on the login page in a virtual keyboard mode to log in the e-commerce data platform. Therefore, the method and the device realize that the RPA robot is combined with the password manager to automatically input account information and corresponding password information so as to log in the e-commerce data platform.

In a possible implementation form, when logging in the e-commerce data platform, in addition to the account information and the corresponding password information, short message verification code verification may be required.

In the embodiment of the application, the RPA robot can detect whether short message verification code verification is needed, and can issue a verification code cooperation task to the man-machine cooperation platform under the condition that the short message verification code verification is needed.

And after receiving the verification code cooperation task, the man-machine cooperation platform can process the verification code cooperation task to obtain a target short message verification code and return the target short message verification code to the RPA robot. Specifically, the human-computer cooperation platform can send a task notification to the worker after receiving the verification code cooperation task, so that the worker can log in the human-computer cooperation platform to perform task processing, when the worker logs in the human-computer cooperation platform to perform task processing, the human-computer cooperation platform can display a task interface corresponding to the verification code cooperation task, and a verification code input box is displayed in the task interface and used for inputting a target short message verification code. After the target short message verification code received by the terminal equipment such as the mobile phone and the like is manually input in the input box, the man-machine cooperation platform can respond to the detected input information in the input box of the task interface to acquire the target short message verification code and send the target short message verification code to the RPA robot.

Correspondingly, the RPA robot can input the target short message verification code on the login page in response to the target short message verification code which is obtained and sent after the man-machine cooperation platform processes the verification code cooperation task. And then the RPA robot can log in the e-commerce data platform.

That is, after step 202, the method may further include: under the condition that short message verification code verification is required, a verification code cooperation task is issued to a man-machine cooperation platform; and inputting the target short message verification code on the login page in response to the target short message verification code which is obtained and sent after the man-machine cooperation platform processes the verification code cooperation task.

Therefore, the aim of automatically inputting the target short message verification code for verification by combining the RPA robot and the man-machine cooperation platform is realized, and the e-commerce data platform is logged in.

In another possible implementation form, when logging in the e-commerce data platform, in addition to inputting account information and corresponding password information, slider verification code verification may be required.

In the embodiment of the application, the RPA robot can detect whether a slider exists on the login page or not so as to judge whether slider verification code verification is required or not. When a slider exists on a login page, namely, the slider verification code needs to be verified, the RPA robot can drag the slider by simulating mouse dragging operation so as to perform security verification. The dragging direction and the dragging distance can be preset, so that the RPA robot can drag the slider for the preset dragging distance according to the preset dragging direction by simulating the mouse dragging operation, and safety verification is performed.

That is, after step 202, the method may further include: and dragging the slider by simulating the dragging operation of the mouse under the condition that the slider verification code is required to be verified.

Therefore, the slider verification code is verified by automatically dragging the slider through the RPA robot, so that the E-commerce data platform can be logged in.

In another possible implementation form, when logging in the e-commerce data platform, in addition to the account information and the corresponding password information, the picture verification code verification may be required to be performed.

In the embodiment of the application, the RPA robot can detect whether the verification code picture exists on the login page or not so as to judge whether the picture verification code is required to be verified or not. When the verification code picture exists on the login page, namely the picture verification code needs to be verified, the RPA robot can identify the verification code on the verification code picture by adopting an OCR technology, and then input the verification code on the login page to perform safety verification.

That is, after step 202, the method may further include: identifying the verification code on the verification code picture by adopting an Optical Character Recognition (OCR) technology under the condition that the verification code of the picture needs to be verified; enter the verification code on the login page.

Therefore, the picture identifying code is identified by combining the RPA robot with the AI automatic identification picture identifying code so as to log in the e-commerce data platform.

And step 204, accessing the target data page by simulating mouse click operation according to the access path of the target data page of the e-commerce data platform.

In an embodiment of the present application, the number of target data pages may be one or more.

When the number of the target data pages is one, the RPA robot can access the target data pages by simulating mouse click operation according to the access paths corresponding to the target data pages, and then perform subsequent processes of querying, downloading and writing the target e-commerce data into the database.

When the number of the target data pages is multiple, the RPA robot can access the corresponding target data pages by simulating mouse click operation according to the access paths corresponding to the target data pages, and then perform subsequent processes of querying, downloading and writing the target E-commerce data into the database on each target data page. Therefore, the target e-commerce data can be acquired from a plurality of target data pages by using the RPA robot, and the labor cost and the time cost for acquiring the e-commerce data are greatly reduced.

That is, step 204 may include: and aiming at each target data page, accessing the corresponding target data page by simulating mouse click operation according to the corresponding access path.

Step 205, inputting the query condition into the target data page to query the target e-commerce data meeting the query condition.

In an embodiment of the application, for some target data pages, query conditions may be input into the target data pages to query for target e-commerce data that satisfies the query conditions. Therefore, the RPA robot can quickly inquire the target e-commerce data meeting the inquiry condition.

For example, "monthly query (2021-08-01 to 2021-08-31)" may be input in the input box corresponding to the query date in the target data page to query the target e-commerce data in the time range.

And step 206, downloading the target e-commerce data in the target data page.

In an embodiment of the application, the target data page may provide a download button of the target e-commerce data, so that the RPA robot may click the download button by simulating a mouse click operation to download the target e-commerce data.

It should be noted that, for some target data pages, a default storage location may be configured in advance, for example, a cloud disk, and when downloading the target e-commerce data, a download button is clicked, the target e-commerce data may be directly downloaded to the default storage location.

And step 207, writing the downloaded target e-commerce data into a database.

In the embodiment of the application, before the downloaded target e-commerce data is written into the database, the target e-commerce data can be further cleaned.

The data cleaning of the target e-commerce data can include, but is not limited to, the following cleaning modes:

and deleting the repeatedly downloaded target e-commerce data. For example, for the same target e-commerce data, multiple query conditions may be simultaneously met, so that when the target e-commerce data meeting the query conditions are queried and the target e-commerce data is downloaded through different query conditions, the same target e-commerce data is downloaded for multiple times. Therefore, redundant e-commerce data can be prevented from being stored in the database, and the storage space of the database is saved.

Integrity of the target e-commerce data is detected. For example, due to unstable network, the situation that after the downloading operation is executed, actually downloaded target e-commerce data is less than target e-commerce data to be downloaded may occur. Therefore, missing of target e-commerce data needing to be downloaded can be avoided.

And modifying the storage format of the target e-commerce data. For example, the target e-commerce data downloaded from the target data page may be a compressed packet, and in this embodiment of the application, the RPA robot may decompress the downloaded compressed packet of the target e-commerce data. Therefore, when the e-commerce data stored in the database is subjected to data analysis subsequently, the data in the compressed packet format is prevented from being decompressed again, and the time required by the data analysis is reduced.

In addition, the condition of advertisement pop-up windows may occur on the e-commerce data platform, so that the click operation of the RPA robot may be disabled. Therefore, the RPA robot can automatically process abnormal conditions.

It should be noted that, when the number of the target data pages is multiple, the RPA robot may clean the target e-commerce data after downloading the target e-commerce data from one target data page each time, write the processed target e-commerce data into the database, download the target e-commerce data from the next target data page, or clean the target e-commerce data after downloading the target e-commerce data from all the target data pages, and finally write all the processed target e-commerce data into the database, which is not limited in this application.

The method for acquiring e-commerce data in the embodiment of the present application is further described below with reference to fig. 3 to 6, taking an actual scene as an example.

The RPA robot can firstly obtain the website information of the e-commerce data platform from a preset storage position, and access the e-commerce data platform according to the website information. A login button for entering a login page can be provided on the e-commerce data platform, so that the RPA robot can access the login page of the e-commerce data platform by simulating mouse click operation and clicking the login button.

Referring to fig. 3, a popup window shown in fig. 3 may appear on the login page, so that the RPA robot may invoke the password manager to input account information and corresponding password information on the login page in the manner of a virtual keyboard. In addition, under the condition that short message verification code verification is needed, the RPA robot can issue a verification code cooperation task to the man-machine cooperation platform, and in response to the target short message verification code sent after the man-machine cooperation platform processes the verification code cooperation task, the target short message verification code is input on a login page so as to log in the e-commerce data platform. Or, under the condition that the slider verification code is required to be verified, the RPA robot can drag the slider by simulating mouse dragging operation so as to log in the e-commerce data platform. Or, under the condition that the picture verification code needs to be verified, the RPA robot can recognize the verification code on the verification code picture by adopting an Optical Character Recognition (OCR) technology, and then input the verification code on the login page to log in the e-commerce data platform. After logging in the e-commerce data platform, the RPA robot can access the default home page of the e-commerce data platform.

Further, referring to the target data page shown in fig. 4, the default home page of the e-commerce data platform may also include the titles "report" 401 and "recommended report" 402 shown in fig. 4, and the RPA robot may sequentially click the titles "report" 401 and "recommended report" 402 on the default home page of the e-commerce data platform by simulating a mouse click operation, so as to access the target data page shown in fig. 4. On the target data page, an input box 403 of query conditions may be provided, wherein the query conditions may include three dimensions of analysis dimension, report type, and statistical date. The RPA robot may analyze the query condition "dimension: shop "" report type: monthly report "" statistical date: 2021-08-01 to 2021-08-31 "is input into the input box 403 to inquire the target electricity merchant data satisfying the inquiry condition. After the target e-commerce data shown in fig. 4 is queried according to the query conditions, the RPA robot can click the "download data" 404 indicated by an arrow in fig. 4 by simulating a mouse click operation, download the target e-commerce data to a storage location specified by a user, further perform data cleaning on the downloaded target e-commerce data, and then write the processed target e-commerce data into a database.

Further, referring to the target data page shown in fig. 5, the default home page of the e-commerce data platform may also include the titles "industry" 501 and "industry large disc" 502 shown in fig. 5, and the RPA robot may sequentially click the titles "industry" 501 and "industry large disc" 502 on the default home page of the e-commerce data platform by simulating a mouse click operation, so as to access the target data page shown in fig. 5. On the target data page, an input box 503 of query conditions may be provided, wherein the query conditions may include three dimensions of category, channel and query date. The RPA robot may query the query condition "category: domestic electrical appliance > electric fan "", channel: all channels "" date of inquiry: a monthly query (2021-08-01 to 2021-08-31) "is input into the input box 503 to query the target e-commerce data satisfying the query condition. After the target e-commerce data shown in fig. 5 is queried according to the query conditions, the RPA robot can click a "download data" button 504 in fig. 5 by simulating a mouse click operation, download the target e-commerce data to a storage location specified by a user, further perform data cleaning on the downloaded target e-commerce data, and then write the processed target e-commerce data into a database.

Further, referring to the target data page shown in fig. 6, the default home page of the e-commerce data platform may also include the titles "service" 601 and "reception response" 602 shown in fig. 6, and the RPA robot may sequentially click the titles "service" 601 and "reception response" 602 on the default home page of the e-commerce data platform by simulating a mouse click operation, so as to access the target data page shown in fig. 6. On the target data page, an input box 603 of query conditions, which may include two dimensions of query date and comparison dimension, and "year of year" and "ring of month" options may be provided. The RPA robot may query the query condition "query date: a monthly query (2021-08-01 to 2021-08-31) "is entered into the input box 603, and a comparison dimension of" year of year "604 is selected to query for target e-commerce data satisfying the query conditions. After the target e-commerce data shown in fig. 6 is queried according to the query conditions, the RPA robot can click a "download data" button 605 in fig. 6 by simulating a mouse click operation, download the target e-commerce data to a storage location specified by a user, further perform data cleaning on the downloaded target e-commerce data, and then write the processed target e-commerce data into a database.

To sum up, through the above-mentioned process, can realize combining the AI to replace artifical automatic login e-commerce data platform through the RPA robot to with the target e-commerce data download in a plurality of target data pages on the e-commerce data platform to user's appointed memory location, and then write in the database, realize the automatic acquisition and the storage of e-commerce data, greatly reduced acquires the required human cost and the time cost of e-commerce data.

In order to implement the above embodiments, the present application further provides an apparatus for acquiring e-commerce data in combination with RPA and AI. Fig. 7 is a schematic structural diagram of an apparatus for acquiring e-commerce data in combination with RPA and AI according to a third embodiment of the present application.

As shown in fig. 7, the apparatus 700 for acquiring e-commerce data of a combination of RPA and AI, applied to an RPA robot, includes: a login module 701, an access module 702, a download module 703 and a write module 704.

The login module 701 is used for logging in an e-commerce data platform;

the access module 702 is configured to access a target data page by simulating a mouse click operation according to an access path of the target data page of the e-commerce data platform;

a downloading module 703, configured to download the target e-commerce data in the target data page;

and a writing module 704, configured to write the downloaded target e-commerce data into a database.

It should be noted that the acquiring apparatus 700 of e-commerce data combining RPA and AI according to the embodiment of the present application may perform the method for acquiring e-commerce data combining RPA and AI provided in the foregoing embodiment. The acquiring device 700 of the e-commerce data combining the RPA and the AI may be implemented by an RPA robot, for example, the acquiring device 700 of the e-commerce data combining the RPA and the AI may be an RPA robot, or the acquiring device of the e-commerce data may be configured in an RPA robot, which is not limited in this application.

The RPA robot may be configured in an electronic device, and the electronic device may include, but is not limited to, a terminal device, a server, and the like.

In one embodiment of the present application, the e-commerce data platform includes a login page; the login module 701 includes:

the first access unit is used for accessing the e-commerce data platform according to the website information of the e-commerce data platform;

the second access unit is used for accessing the login page of the e-commerce data platform according to the access path of the login page;

the first processing unit is used for calling the password manager, inputting account information and corresponding password information on a login page in a virtual keyboard mode, and logging in an e-commerce data platform;

In an embodiment of the present application, the login module 701 further includes:

the sending unit is used for issuing a verification code cooperation task to the man-machine cooperation platform under the condition that short message verification code verification is required;

and the second processing unit is used for responding to the acquired target short message verification code sent after the man-machine cooperation platform processes the verification code cooperation task and inputting the target short message verification code on the login page.

and the third processing unit is used for dragging the slider by simulating mouse dragging operation under the condition that the slider verification code is required to be verified.

the identification unit is used for identifying the verification code on the verification code picture by adopting an Optical Character Recognition (OCR) technology under the condition that the verification code of the picture needs to be verified;

and the fourth processing unit is used for inputting the verification code on the login page.

In one embodiment of the present application, the number of target data pages is plural;

an access module 702, comprising:

and the third access unit is used for accessing the corresponding target data page by simulating mouse click operation according to the corresponding access path aiming at each target data page.

In an embodiment of the present application, the device 700 for acquiring e-commerce data further includes:

and the query module is used for inputting the query conditions into the target data page so as to query the target e-commerce data meeting the query conditions.

It should be noted that the foregoing explanation of the embodiment of the method for acquiring e-commerce data in combination with RPA and AI also applies to the apparatus for acquiring e-commerce data in combination with RPA and AI of this embodiment, and details that are not published in the embodiment of the apparatus for acquiring e-commerce data in combination with RPA and AI of this application are not repeated here.

To sum up, the acquiring device of the e-commerce data combining the RPA and the AI of the embodiment of the application logs in the e-commerce data platform, accesses the target data page by simulating mouse click operation according to the access path of the target data page of the e-commerce data platform, downloads the target e-commerce data in the target data page, and then writes the downloaded target e-commerce data into the database. Therefore, the RPA robot is combined with the AI to replace manual automatic login of the e-commerce data platform, downloading of the target e-commerce data and database writing are performed, automatic acquisition and storage of the e-commerce data are achieved, and labor cost and time cost required for acquiring the e-commerce data are greatly reduced.

In order to implement the foregoing embodiments, an electronic device is further provided in an embodiment of the present application, and includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the method for acquiring e-commerce data in combination with RPA and AI according to any one of the foregoing method embodiments.

In order to implement the foregoing embodiments, the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method for acquiring e-commerce data by combining RPA and AI according to any one of the foregoing method embodiments.

In order to implement the foregoing embodiments, the present application further provides a computer program product, wherein when being executed by an instruction processor in the computer program product, the method for acquiring e-commerce data in combination with RPA and AI according to any one of the foregoing method embodiments is implemented.

FIG. 8 illustrates a block diagram of an exemplary electronic device suitable for use in implementing embodiments of the present application. The electronic device 12 shown in fig. 8 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.

As shown in FIG. 8, electronic device 12 is embodied in the form of a general purpose computing device. The components of electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the memory 28 and the processing unit 16.

Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. These architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus, to name a few.

Electronic device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by electronic device 12 and includes both volatile and nonvolatile media, removable and non-removable media.

Memory 28 may include computer system readable media in the form of volatile Memory, such as Random Access Memory (RAM) 30 and/or cache Memory 32. The electronic device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 8, and commonly referred to as a "hard drive"). Although not shown in FIG. 8, a disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a Compact disk Read Only Memory (CD-ROM), a Digital versatile disk Read Only Memory (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the application.

A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally perform the functions and/or methodologies of the embodiments described herein.

Electronic device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with electronic device 12, and/or with any devices (e.g., network card, modem, etc.) that enable electronic device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, the electronic device 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public Network such as the Internet) via the Network adapter 20. As shown in FIG. 8, the network adapter 20 communicates with the other modules of the electronic device 12 via the bus 18. It should be appreciated that although not shown in FIG. 8, other hardware and/or software modules may be used in conjunction with electronic device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

The processing unit 16 executes various functional applications and data processing by executing programs stored in the memory 28, for example, implementing the methods mentioned in the foregoing embodiments.

In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.

The logic and/or steps represented in the flowcharts or otherwise described herein, such as an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.

It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.

In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims

1. A method of acquiring e-commerce data in conjunction with an RPA and an AI, performed by an RPA robot, the method comprising:

logging in an e-commerce data platform;

according to an access path of a target data page of the e-commerce data platform, accessing the target data page by simulating mouse click operation;

downloading target e-commerce data in the target data page;

and writing the downloaded target e-commerce data into a database.

2. The method of claim 1, wherein the e-commerce data platform comprises a login page; the login e-commerce data platform comprises:

accessing the e-commerce data platform according to the website information of the e-commerce data platform;

accessing the login page according to the access path of the login page;

calling a password manager, and inputting account information and corresponding password information on the login page in a virtual keyboard mode to log in the e-commerce data platform;

the account information and the encrypted password information are stored in the password manager.

3. The method according to claim 2, wherein after accessing the landing page according to the access path of the landing page, further comprising:

under the condition that short message verification code verification is required, a verification code cooperation task is issued to a man-machine cooperation platform;

and in response to the target short message verification code which is sent after the man-machine cooperation platform processes the verification code cooperation task, inputting the target short message verification code on the login page.

4. The method according to claim 2, wherein after accessing the landing page according to the access path of the landing page, further comprising:

and dragging the slider by simulating mouse dragging operation under the condition that the slider verification code is required to be verified.

5. The method according to claim 2, wherein after accessing the landing page according to the access path of the landing page, further comprising:

identifying the verification code on the verification code picture by adopting an Optical Character Recognition (OCR) technology under the condition that the picture verification code is required to be verified;

and inputting the verification code on the login page.

6. The method according to any one of claims 1-5, wherein the number of target data pages is plural;

the accessing the target data page by simulating mouse click operation according to the access path of the target data page of the e-commerce data platform comprises:

and aiming at each target data page, accessing the corresponding target data page by simulating mouse click operation according to the corresponding access path.

7. The method according to any one of claims 1-5, wherein before downloading the target e-commerce data in the target data page, the method further comprises:

and inputting query conditions into the target data page to query the target e-commerce data meeting the query conditions.

8. An acquiring device of E-commerce data combining RPA and AI, which is applied to an RPA robot, and comprises:

the login module is used for logging in the e-commerce data platform;

the access module is used for accessing the target data page by simulating mouse click operation according to the access path of the target data page of the e-commerce data platform;

the downloading module is used for downloading the target e-commerce data in the target data page;

and the writing module is used for writing the downloaded target e-commerce data into a database.

9. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the method of any one of claims 1-7 when executing the computer program.

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-7.