CN110188257B - Mobile application data acquisition method and device - Google Patents
Mobile application data acquisition method and device Download PDFInfo
- Publication number
- CN110188257B CN110188257B CN201910304216.XA CN201910304216A CN110188257B CN 110188257 B CN110188257 B CN 110188257B CN 201910304216 A CN201910304216 A CN 201910304216A CN 110188257 B CN110188257 B CN 110188257B
- Authority
- CN
- China
- Prior art keywords
- application
- public number
- interface
- script
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a mobile application data acquisition method and a device, wherein the method comprises the following steps: recording a script of the application operation process of the user; loading the script, indicating the application client to send a request to the application server according to keywords in a pre-stored search keyword list, and acquiring historical information sent by the application server, so that the proxy server intercepts the historical information sent by the application server and writes the historical information into a database; and analyzing the history information written into the database, and extracting the article data of the application. By adopting the invention, the mobile application data can be comprehensively and automatically acquired.
Description
Technical Field
The invention relates to the technical field of networks, in particular to a mobile application data acquisition method and device.
Background
At present, the collection of the content of the WeChat public number mainly comprises the following two technical schemes, one is a web crawler, and the other is based on a proxy server.
Web crawler
Most of the existing WeChat public number collection is based on dog searching portal collection, such as a simple data collection platform and an octopus platform, and the method is simple to implement. However, the verification code appears when the collection is too frequent due to the anti-crawler mechanism of the little trust of the dog hunting. The problem of low acquisition efficiency is solved by adopting a butt joint code printing platform or switching a proxy server, and acquisition is interrupted when the verification code cannot be identified. On the other hand, the acquisition of the articles of the public number based on the dog searching WeChat can only acquire the top ten contents of the public number and can not acquire important dimension data such as praise number, user comments and the like. Taking a keyword 'people daily newspaper' search as an example, 30 records are searched by the dog WeChat search, and 34 actually related public numbers of the WeChat are found.
Based on proxy server
An HTTPS agent is set up between the mobile phone WeChat and the WeChat server, network data flow between the mobile phone WeChat and the server is intercepted, and the information of the articles of the public numbers is obtained by analyzing the network data flow. The method can acquire article evaluation information such as all historical articles, praise number, reading number and the like of the public number. However, the Web loading is difficult to control, is greatly influenced by the local network environment, and is unstable in acquisition. On the other hand, in the acquisition process, the click simulation request needs to be continuously performed at the mobile terminal by manpower.
Through the analysis of the prior art, the following three difficulties are found to be faced in the mass acquisition of the content of the WeChat public number:
1) the data collected by the dog WeChat is not complete.
2) The proxy server is greatly influenced by the network and the collection is unstable.
3) The collection needs manual participation and the collection cost is high.
Disclosure of Invention
In view of this, the invention aims to: the mobile application data can be comprehensively and automatically acquired.
In order to achieve the purpose, the technical scheme of the invention is realized as follows:
the invention discloses a mobile application data acquisition method, which comprises the following steps:
recording a script of the application operation process of the user;
loading the script, indicating the application client to send a request to the application server according to keywords in a pre-stored search keyword list, and acquiring historical information sent by the application server, so that the proxy server intercepts the historical information sent by the application server and writes the historical information into a database;
and analyzing the history information written into the database, and extracting the article data of the application.
The invention also discloses a mobile application data acquisition device, which comprises:
the recording module is used for recording the script of the application operation process of the user;
the driving module is used for loading the script, indicating the application client to send a request to the application server according to keywords in a pre-stored search keyword list, and acquiring historical information sent by the application server so that the proxy server intercepts the historical information sent by the application server and writes the historical information into a database;
and the analysis module is used for analyzing the historical information written into the database and extracting the article data of the application.
According to the technical scheme, the invention relates to a mobile application data acquisition method and device, and the application article data including reading amount, praise amount, comments, article text and the like can be automatically acquired in batches by combining an automatic test technology and a proxy server and analyzing network data streams. Taking WeChat application as an example, the problem of incomplete WeChat crawler resisting mechanism and dog searching WeChat data is solved through the proxy server, and a more comprehensive data set is provided; by introducing an automatic testing technology, analyzing the structural characteristics of the WeChat interface, automatically searching and adding the public numbers and automatically browsing the articles of the public numbers according to preset keywords, the driving process is fully automatic.
Drawings
Fig. 1 is a schematic flow chart of a mobile application data acquisition method according to the present invention.
Fig. 2 is a schematic structural diagram of a mobile application data acquisition device according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to the accompanying drawings and examples.
The mobile application data comprises data in various applications such as WeChat public account, today's headline, small red book and the like, and the collection of the content of the WeChat public account is one of the mobile application data collection. In order to realize the comprehensive automatic acquisition of mobile application data, the invention provides a mobile application data acquisition method, the flow diagram of which is shown in fig. 1, and the method comprises the following steps:
specifically, the method comprises the following steps: according to the operation flow of the user to the application, the interface control in each step in the flow is checked, the control text information and the coordinate information corresponding to the control are recorded, the recorded control text information and the coordinate information corresponding to the control are added into each step of the operation flow, and the script of the user to the application operation flow is generated.
The operation flow of the application is different for different applications. When a user opens an application to carry out operation of each step, the method and the device utilize the UIAutomator Viewer control information viewing tool to view the interface control of each step in the process, and acquire control text information and the coordinate information corresponding to the control. Controls refer to click, return, etc. controls.
The Android platform has a plurality of testing frames, including testing frames Instrumentation and UIAutomator of the Android SDK (software development kit), and integrated frames Robotium and Apium which are easier to use after packaging the bottom testing frame, and the like, and all of the testing frames contain rich interfaces, so that most of the requirements of automatic testing can be met. And each test frame has respective characteristics and is suitable for different scenes. For example, MonkeyRunner is commonly used for function testing, and the application realizes native and mixed mobile terminal application automatic testing by calling a UiAutomator command by using Bootstrap. The method selects the UIAutomator testing frame which is provided by the Android official and supports cross-application, and checks the interface control of each step in the application flow by combining the UIAutomator Viewer control information checking tool, and records the control text information and the coordinate information corresponding to the control.
In the invention, the recorded control text information and the coordinate information corresponding to the control are added into each step of the operation flow, and the script of the user for the application operation flow is generated. May be an xml script. A wechat.
in this step, after the script is loaded, the script is analyzed, and a manual request can be simulated to instruct the interaction between the application client and the application server to obtain all historical messages sent by the application server.
Because the UIAutomator dump interface structure has the problem of instability, control text information can not be acquired possibly, and the method intervenes in the communication between the application client and the application server through the AnyProxy proxy server. The AnyProxy proxy server is an HTTP/HTTPS proxy server which is based on NodeJS and can be configured by the plug-in, and automatic skipping and information acquisition are realized by adding processing on a response message sent by an application server side when a JS code is injected. And writing the collected information into a database for subsequent application data content analysis and behavior analysis.
And step 13, analyzing the history information written into the database, and extracting the article data of the application.
According to the step, the collected data can be preprocessed according to the requirement of the collected data, and data of required dimensions such as article release time, article content, praise number, user comments and the like can be extracted.
Thus, the mobile application data acquisition method of the invention is completed.
Preferably, the method further comprises: when the history information sent by the application server side cannot be obtained, the request of the application client side is cached, and the re-request is supported. The scheme realizes the processing of various exceptions. The method mainly processes the caching of the request when the request has no response under the weak network environment of the mobile phone, supports the follow-up re-request and improves the acquisition rate.
Preferably, the method further comprises: and monitoring the application process to be acquired in a polling mode, and restarting the application when the application is closed and crashed. Thereby realizing automatic restart of the application.
For the purpose of clearly illustrating the invention, specific examples are set forth below.
Example one (when the application is WeChat public)
And S21, recording the script of the user operation flow of the WeChat public number.
According to the operation flows of opening WeChat, searching for a public number, adding the public number, entering the public number and browsing a public number article by a user, by combining with an UIAutomator Viewer control information viewing tool, viewing an interface control in each step in the flow, recording control text information and coordinate information corresponding to the control, and generating a script. The script records the operation flow of the user to the WeChat public number, and records the control text information and the coordinate information corresponding to the control in the operation flow of each step.
In each step of the script, if the control text information and the coordinate information corresponding to the control are recorded, an operation (action) on the control, such as a click operation, is also correspondingly included.
And S22, loading the script, and according to the keywords in the pre-stored search keyword list, indicating the WeChat client to send a request to the WeChat server to obtain the historical information sent by the WeChat server.
S221, loading the script, indicating the WeChat client to open a WeChat interface, checking whether the WeChat interface has the public number search text information, if so, sending a request to the WeChat server end according to the operation of the script on the public number search text information, and opening the public number search interface;
and if the user does not check that the search public number text information exists in the WeChat interface, sending a request to the WeChat server according to the operation of searching the public number coordinates in the script, and opening the search public number interface.
Due to the fact that UIAutomator extraction is unstable, whether the WeChat interface has public number text information for searching or not can not be checked sometimes. If the WeChat interface is found to have the search public number text information, clicking the search public number text according to the clicking operation corresponding to the search public number text information in the script, and opening the search public number interface; and if the searching public number text information is not found in the WeChat interface, clicking the coordinates of the searching public number control according to the clicking operation corresponding to the coordinates of the searching public number control in the script, and opening the searching public number interface.
S222, indicating the WeChat client to search the public number categories according to keywords in the search keyword list on a search public number interface; opening a public number adding interface aiming at each public number category, adding all public numbers, and simultaneously acquiring public number description corresponding to each public number; and storing the public numbers and the affiliated keywords in the public number description corresponding database corresponding to each public number.
The search keyword list is pre-stored in a database, such as a "student | homework" search keyword list. And the searched keywords are recorded, so that repeated acquisition of data is avoided. The search keyword list comprises a plurality of keywords, and each keyword is searched, a related public number category can appear, and each public number category corresponds to a plurality of public numbers.
And S223, indicating the WeChat client to open the access public number interface, checking whether historical message text information exists in the access public number interface, and if so, sending a request to the WeChat server according to the operation on the historical message text information in the script to acquire the historical message.
And if the historical message text information is not found in the public number interface, sending a request to the WeChat server side according to the operation of the historical message coordinates in the script to obtain the historical message.
Similarly, because the UIAutomator is unstable in extraction, whether the text information of the historical message exists in the public number interface or not can not be checked sometimes. If the history message text information is found in the public number interface, clicking the history message text according to the clicking operation corresponding to the history message text information in the script, opening the history message, and browsing the article; if the historical message text information is not found in the public number interface, clicking the control coordinate of the historical message according to the clicking operation corresponding to the control coordinate of the historical message in the script, opening the historical message, and browsing the article.
Meanwhile, after browsing an article, the history message can be returned according to the click operation corresponding to the history message in the script, and browsing other history messages is performed.
And S23, the proxy server intercepts the history information sent by the WeChat server side and writes the history information into the database.
When the history message is opened, the UIAutomator can extract the article content, but the UIAutomator is unstable in extraction and sometimes cannot extract the article content, so that the response carrying the history message sent by the WeChat server side is directly intercepted by the proxy server to browse the article content, and the condition that the article interface content cannot be extracted (dump) by the UIAutomator is overcome.
And S26, analyzing the history information written into the database, and extracting article data including article release time, article content, praise number, user comments and the like.
In the second embodiment (when the application is a news message application such as today's headline or small red book), the following description will be made by taking the today's headline application as an example.
And S31, recording the script of the operation flow of browsing the top news of the present day by the user.
According to the operation flow of opening a today's headline, subscribing a channel, entering the channel, browsing news and switching the next news by a user, by combining with an UIAutomator Viewer control information viewing tool, viewing an interface control in each step of the flow, recording control text information and coordinate information corresponding to the control, and generating a script. The script records the operation flow of browsing news by the user, and records the control text information and the coordinate information corresponding to the control in the operation flow of each step.
In each step of the script, if the control text information and the coordinate information corresponding to the control are recorded, an operation (action) on the control, such as a click operation, is also correspondingly included.
And S32, loading the script, and according to the keywords in the pre-stored search keyword list, indicating the today ' S top client to send a request to the today ' S top server to obtain the news message sent by the today ' S top server. Here, the news message is one of history messages.
S321, loading the script, indicating the today ' S top client to open the today ' S top interface, clicking a channel subscription button, checking whether the interface has channel text information to be subscribed according to keywords in a prestored channel subscription keyword list, and if so, sending a request to the today ' S top server according to the operation of subscribing the channel text information in the script to subscribe the channel;
and if the text information of the channel to be subscribed is not checked, sending a request to the current top server according to the operation of the channel coordinate in the script to subscribe the channel.
Due to unstable UIAutomator extraction, whether channel information exists in the current top application interface cannot be checked sometimes. If the channel text information exists in the current interface, clicking to subscribe the channel according to the clicking operation corresponding to the channel text information in the script; and if the text information of the reserved channel is not found in the current headline interface, clicking the coordinates of the reserved channel control according to the clicking operation corresponding to the coordinates of the channel control in the script to subscribe the channel.
And S322, indicating the current top client to browse the news on the specified channel interface, returning, and switching to browse the next news. And simultaneously, after browsing one channel, entering the next channel according to the control text information to browse the news.
S33, the proxy server intercepts the news information sent by the top server end of the day and writes the news information into the database.
When the user enters a designated channel to browse news, the UIAutomator can extract article contents, but the UIAutomator is unstable in extraction and sometimes cannot extract the article contents, so that the method directly adopts the proxy server to intercept the response carrying the news message sent by the headline server end of the person, browses the article contents, and further overcomes the condition that the UIAutomator cannot extract (dump) the article interface contents.
And S34, analyzing news written in the database, and extracting article data including article release time, article content, praise number, user comments and the like.
EXAMPLE III
Based on the same inventive concept, the invention discloses a mobile application data acquisition device, the structural schematic diagram is shown in fig. 2, and the device comprises:
a recording module 201, configured to record a script of the application operation process performed by the user;
the driving module 202 is configured to load the script, instruct the application client to send a request to the application server according to a keyword in a pre-stored search keyword list, and obtain a history message sent by the application server, so that the proxy server intercepts the history message sent by the application server and writes the history message into a database;
the analysis module 203 analyzes the history messages written in the database and extracts the article data of the application.
Preferably, the apparatus further comprises: the monitoring module 204 monitors the application process to be collected in a polling manner, and restarts the application when the application is closed and crashes. Wherein, the polling mode refers to listening to the application at predetermined time intervals.
Preferably, the apparatus further comprises: and the exception handling module 205 is configured to cache the request of the application client when the history message sent by the application server cannot be acquired, and support a re-request. That is, for the request of the application client, the application server does not respond, and therefore, the exception handling module 205 caches the request that does not receive the response, and caches the request in the database for subsequent re-request initiation.
In summary, the method and the device for acquiring mobile application data provided by the invention record the script of the user on the application operation process; loading the script, indicating the application client to send a request to the application server according to keywords in a pre-stored search keyword list, and acquiring historical information sent by the application server, so that the proxy server intercepts the historical information sent by the application server and writes the historical information into a database; and analyzing the history information written into the database, and extracting the article data of the application. The method and the device automatically acquire the article data of the application by simulating the manual request according to the pre-stored keywords and the pre-recorded script.
The invention has the beneficial effects that:
automation of collection process
The invention utilizes the driving module and combines with an automatic testing framework to design the xml and compile the script. The collection process is highly integrated and is automatically executed by one key. By taking the WeChat public account as an example, the public accounts can be automatically added in batches according to preset keywords, and all historical messages can be browsed aiming at the specified public accounts.
Secondly, collecting all data
Compared with other technologies, the method can collect all historical information of the WeChat public number, including public number description, article release time, article content, praise number and user comments.
Thirdly, stable collection
Aiming at the characteristic that the Uiautomator is unstable, the stability of the request driving module is guaranteed in a mode of combining coordinates with control texts. On the other hand, the main article content is extracted by a proxy server to overcome the condition that the article interface content cannot be extracted by UIAutomator (dump).
Fourthly, the collection rate is high
Aiming at the problem of no response of an unstable request in a mobile phone network environment, the subsequent request again is supported by adding exception processing, such as adding cache to the request without response. On the other hand, by adding a daemon process, the application is automatically restarted when the application crashes. The collection rate is improved by combining the two modes.
Fifthly, the acquisition cost is low
The device has the advantages that the strategies of overcoming the micro-letter crawler such as the addition of a dynamic IP and the butt joint coding platform are relatively increased, the device obtains data by simulating manual requests at the mobile terminal, and the data acquisition cost is low.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (9)
1. A method for mobile application data acquisition, the method comprising:
recording a script of the application operation process of the user;
loading the script, indicating the application client to send a request to the application server according to keywords in a pre-stored search keyword list, and acquiring historical information sent by the application server, so that the proxy server intercepts the historical information sent by the application server and writes the historical information into a database;
analyzing the history information written into the database, and extracting the article data of the application;
when the application is WeChat, the step of instructing the application client to send a request to the application server according to keywords in a pre-stored search keyword list to obtain the historical information sent by the application server specifically comprises the following steps:
instructing the WeChat client to open a WeChat interface, checking whether the WeChat interface has the public number search text information, if so, sending a request to the WeChat server end according to the operation of searching the public number text information in the script, and opening the public number search interface;
indicating the WeChat client to search the public number category according to the keywords in the search keyword list on a public number search interface; opening a public number adding interface aiming at each public number category, adding all public numbers, and simultaneously acquiring public number description corresponding to each public number; storing the public numbers and the affiliated keywords in the public number description corresponding database corresponding to each public number;
and indicating the WeChat client to open a public access interface, checking whether historical message text information exists in the public access interface, and if so, sending a request to the WeChat server to acquire the historical message according to the operation on the historical message text information in the script.
2. The method of claim 1, wherein the article data of the application includes publication time, publication author, article content, number of likes, user comments.
3. The method of claim 1, further comprising:
and monitoring the application process to be acquired in a polling mode, and restarting the application when the application is closed and crashed.
4. The method of claim 1, further comprising:
when the history information sent by the application server side cannot be obtained, the request of the application client side is cached, and the re-request is supported.
5. The method of claim 1, wherein recording the script of the application operation flow of the user comprises:
according to the operation flow of the user to the application, the interface control in each step in the flow is checked, the control text information and the coordinate information corresponding to the control are recorded, the recorded control text information and the coordinate information corresponding to the control are added into each step of the operation flow, and the script of the user to the application operation flow is generated.
6. The method of claim 1,
if the search public number text information is not found in the WeChat interface, a request is sent to the WeChat server side according to the operation of searching the public number coordinates in the script, and the search public number interface is opened;
and if the historical message text information is not found in the public number interface, sending a request to the WeChat server side according to the operation of the historical message coordinates in the script to obtain the historical message.
7. A mobile application data collection apparatus, the apparatus comprising:
the recording module is used for recording the script of the application operation process of the user;
the driving module is used for loading the script, indicating the application client to send a request to the application server according to keywords in a pre-stored search keyword list, and acquiring historical information sent by the application server so that the proxy server intercepts the historical information sent by the application server and writes the historical information into a database;
the analysis module is used for analyzing the historical information written into the database and extracting the article data of the application;
when the application is WeChat, the driving module is specifically configured to: instructing the WeChat client to open a WeChat interface, checking whether the WeChat interface has the public number search text information, if so, sending a request to the WeChat server end according to the operation of searching the public number text information in the script, and opening the public number search interface;
indicating the WeChat client to search the public number category according to the keywords in the search keyword list on a public number search interface; opening a public number adding interface aiming at each public number category, adding all public numbers, and simultaneously acquiring public number description corresponding to each public number; storing the public numbers and the affiliated keywords in the public number description corresponding database corresponding to each public number;
and indicating the WeChat client to open a public access interface, checking whether historical message text information exists in the public access interface, and if so, sending a request to the WeChat server to acquire the historical message according to the operation on the historical message text information in the script.
8. The apparatus of claim 7, further comprising:
and the monitoring module monitors the application process to be acquired in a polling mode and realizes restart when the application is closed and crashed.
9. The apparatus of claim 7, further comprising:
and the exception handling module caches the request of the application client when the historical information sent by the application server cannot be acquired, and supports the re-request.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910304216.XA CN110188257B (en) | 2019-04-16 | 2019-04-16 | Mobile application data acquisition method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910304216.XA CN110188257B (en) | 2019-04-16 | 2019-04-16 | Mobile application data acquisition method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110188257A CN110188257A (en) | 2019-08-30 |
| CN110188257B true CN110188257B (en) | 2021-12-31 |
Family
ID=67714563
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910304216.XA Active CN110188257B (en) | 2019-04-16 | 2019-04-16 | Mobile application data acquisition method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110188257B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110865851B (en) * | 2019-11-18 | 2023-12-01 | 中国民航信息网络股份有限公司 | Automatic Android application data acquisition method and system |
| CN111488499A (en) * | 2020-03-06 | 2020-08-04 | 北京健康之家科技有限公司 | Public opinion data processing method and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105320740A (en) * | 2015-09-22 | 2016-02-10 | 清华大学 | WeChat article and official account acquisition method and acquisition system |
| CN105577528A (en) * | 2015-12-31 | 2016-05-11 | 深圳中泓在线股份有限公司 | Wechat official account data collection method and device based on virtual machine |
| CN105718587A (en) * | 2016-01-26 | 2016-06-29 | 王薇 | Network content resource evaluation method and evaluation system |
| CN107948052A (en) * | 2017-11-14 | 2018-04-20 | 福建中金在线信息科技有限公司 | Information crawler method, apparatus, electronic equipment and system |
| CN109284431A (en) * | 2018-08-09 | 2019-01-29 | 国家计算机网络与信息安全管理中心 | A method of finding specific area wechat public platform from wechat |
| CN109388735A (en) * | 2018-09-13 | 2019-02-26 | 广州丰石科技有限公司 | A method of crawling wechat public platform information |
| CN109543086A (en) * | 2018-11-23 | 2019-03-29 | 北京信息科技大学 | A kind of network data acquisition and methods of exhibiting towards multi-data source |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105162676B (en) * | 2015-04-03 | 2017-08-11 | 中国科学院信息工程研究所 | A kind of wechat data capture method and system |
| CN106354482A (en) * | 2015-07-13 | 2017-01-25 | 西安中兴新软件有限责任公司 | Method and device for acquiring automated scripts and application method and device of automated scripts |
-
2019
- 2019-04-16 CN CN201910304216.XA patent/CN110188257B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105320740A (en) * | 2015-09-22 | 2016-02-10 | 清华大学 | WeChat article and official account acquisition method and acquisition system |
| CN105577528A (en) * | 2015-12-31 | 2016-05-11 | 深圳中泓在线股份有限公司 | Wechat official account data collection method and device based on virtual machine |
| CN105718587A (en) * | 2016-01-26 | 2016-06-29 | 王薇 | Network content resource evaluation method and evaluation system |
| CN107948052A (en) * | 2017-11-14 | 2018-04-20 | 福建中金在线信息科技有限公司 | Information crawler method, apparatus, electronic equipment and system |
| CN109284431A (en) * | 2018-08-09 | 2019-01-29 | 国家计算机网络与信息安全管理中心 | A method of finding specific area wechat public platform from wechat |
| CN109388735A (en) * | 2018-09-13 | 2019-02-26 | 广州丰石科技有限公司 | A method of crawling wechat public platform information |
| CN109543086A (en) * | 2018-11-23 | 2019-03-29 | 北京信息科技大学 | A kind of network data acquisition and methods of exhibiting towards multi-data source |
Non-Patent Citations (2)
| Title |
|---|
| 基于网络爬虫的网络资源评价研究;胡博;《中国优秀硕士学位论文全文数据库信息科技辑》;20161115;论文第三章 * |
| 微信公众号检索与监测系统的设计与实现;庞倩;《中国优秀硕士学位论文全文数据库信息科技辑》;20190115;论文第三章 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110188257A (en) | 2019-08-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111949822B (en) | Intelligent education video service system based on cloud computing and mobile terminal and operation method thereof | |
| CN102385615B (en) | Information collection and presentation | |
| EP1582995A2 (en) | Information sharing device and information sharing method | |
| US20150012612A1 (en) | Prompt method for adding quick link in browser, device and system thereof | |
| CN110188257B (en) | Mobile application data acquisition method and device | |
| CN111163054B (en) | Method and device for detecting malicious behavior of webpage | |
| CN105955593B (en) | Method and device for presenting discussion information | |
| CN110826002B (en) | Information sharing method, device, terminal and storage medium | |
| CN106776318A (en) | A kind of test script method for recording and system | |
| CN107124477A (en) | Processing method, terminal and the server of web site contents | |
| CN104881774A (en) | Method and apparatus for automatically establishing schedule | |
| CN101354706A (en) | Method and apparatus for collecting web page information | |
| CN112329403A (en) | Live broadcast document processing method and device | |
| CN111177623A (en) | Information processing method and device | |
| CN112052420A (en) | Page sharing picture generation method and device and page sharing method and device | |
| CN114692049A (en) | Browser-based screen recording method and device, electronic equipment and storage medium | |
| CN113704590A (en) | Webpage data acquisition method and device, electronic equipment and storage medium | |
| CN103885878A (en) | Method and device for generating browser testing script | |
| CN112579092B (en) | Multifunctional small program multi-end updating and publishing system | |
| US20210165846A1 (en) | Information processing apparatus, information processing system, and method of processing information | |
| CN111882368B (en) | On-line advertisement DPI encryption buried point and transparent transmission tracking method | |
| CN107770377A (en) | A kind of method of the establishment interactive voice mobile phone news client based on HTML5 | |
| CN103458134A (en) | Computer assisted telephone interview system and method for operating same | |
| KR100680034B1 (en) | Context cognizance enhancing message transform system, and method for the same | |
| CN105338091A (en) | High-transmission-efficiency personalized information interface display method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |