CN111428117B - Application program data acquisition method and device - Google Patents

Application program data acquisition method and device Download PDF

Info

Publication number
CN111428117B
CN111428117B CN201910020223.7A CN201910020223A CN111428117B CN 111428117 B CN111428117 B CN 111428117B CN 201910020223 A CN201910020223 A CN 201910020223A CN 111428117 B CN111428117 B CN 111428117B
Authority
CN
China
Prior art keywords
data
application program
management platform
application
statistical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910020223.7A
Other languages
Chinese (zh)
Other versions
CN111428117A (en
Inventor
马立
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201910020223.7A priority Critical patent/CN111428117B/en
Publication of CN111428117A publication Critical patent/CN111428117A/en
Application granted granted Critical
Publication of CN111428117B publication Critical patent/CN111428117B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The application provides a data acquisition method and device for an application program, wherein the method comprises the following steps: and the terminal equipment with equipment attributes matched with the data query conditions is determined according to the data query conditions by acquiring the data query conditions, and the application program management platform is accessed through the terminal equipment to obtain the application program data which is counted by the application program management platform and accords with the data query conditions. According to the method, the application management platform is accessed in the terminal equipment matched with the data query condition to obtain the application program data conforming to the data query condition, so that the technical problems of low working efficiency, high error rate, long data updating period and the like caused by manually acquiring the application program data counted by the application management platform in the prior art are solved, a large amount of labor cost is reduced, and the working efficiency is greatly improved.

Description

Application program data acquisition method and device
Technical Field
The present disclosure relates to the field of internet technologies, and in particular, to a method and an apparatus for acquiring data of an application program.
Background
With the development of intelligent terminal technology, the use of mobile terminal devices (such as smartphones, tablet computers, etc.) is becoming more and more popular. More and more users perform entertainment activities, learning, life and the like by downloading Application programs (APP) through an Application management platform of a mobile terminal device. Therefore, when the company operator performs marketing and release of the application program, the company operator needs to master various data of each application program in the application management platform, such as a ranking list, a downloading list, a search ranking and the like.
Currently, in application program management platforms, when an operator views application program data, each application program management platform needs to be installed first, each application program management platform is opened in sequence, each list, search ranking and the like are viewed, the operation steps of the whole process are complex, and a great deal of time and energy are consumed.
Disclosure of Invention
The application program data acquisition method and device are used for solving the technical problems of low working efficiency, high error rate, long data updating period and the like caused by manually acquiring application program data counted by an application management platform in the prior art, and realizing automatic acquisition of the application program data, so that the labor cost is reduced, and the working efficiency is improved.
An embodiment of a first aspect of the present application provides a method for acquiring data of an application program, including:
acquiring a data query condition;
determining terminal equipment with equipment attributes matched with the data query conditions according to the data query conditions; the equipment attribute comprises at least one of a region where equipment is located, an equipment operating system type and an equipment operating system version;
and accessing an application program management platform through the terminal equipment to obtain application program data which accords with the data query condition and is counted by the application program management platform.
As a first possible implementation manner of the present application, the accessing, by the terminal device, the application management platform to obtain the application data that meets the data query condition and is counted by the application management platform includes:
accessing the application program management platform through the terminal equipment to obtain a management page;
according to the data query conditions, performing simulated clicking on the management page so that the application management platform provides a statistical page matched with the data query conditions; the statistical page is obtained by performing behavior statistics on all user terminals with the same equipment attribute as the currently accessed terminal equipment by the application program management platform;
and performing statistical data crawling on the statistical page to obtain the application program data.
As a second possible implementation manner of the present application, after the crawling of the statistical data on the statistical page to obtain the application data, the method further includes:
filtering the application program data according to preset screening conditions; and the screening conditions are used for screening out the picture information in the application program data.
As a third possible implementation manner of the present application, after the accessing, by the terminal device, the application management platform to obtain the application data that meets the data query condition and is counted by the application management platform, the method further includes:
and storing the application program data into a database.
As a fourth possible implementation manner of the present application, the storing the application program data in a database includes:
inquiring the priority of each group of statistical data according to the statistical dimension of each group of statistical data in the application program data;
the sets of statistics are stored in a database according to a priority order.
As a fifth possible implementation manner of the present application, the storing, according to the priority order, each set of statistical data into a database includes:
storing the statistics with low priority into a temporary repository;
storing the statistics with high priority into a database;
and in the gap of data processing on the database, synchronizing the statistical data stored in the temporary resource library to the database.
As a sixth possible implementation manner of the present application, after the storing the application program data in the database, the method further includes:
And carrying out predictive analysis on the application program data stored in the database according to a time sequence analysis method.
As a seventh possible implementation manner of the present application, the application data includes ranking and/or comment information of each application on the application management platform.
According to the data acquisition method of the application program, through acquiring the data query conditions, terminal equipment with equipment attributes matched with the data query conditions is determined according to the data query conditions; the equipment attribute comprises at least one of a region where equipment is located, an equipment operating system type and an equipment operating system version; and accessing the application program management platform through the terminal equipment to obtain the application program data which is counted by the application program management platform and accords with the data query condition. According to the method, the application management platform is accessed in the terminal equipment matched with the data query condition to obtain the application program data conforming to the data query condition, so that the technical problems of low working efficiency, high error rate, long data updating period and the like caused by manually acquiring the application program data counted by the application management platform in the prior art are solved, a large amount of labor cost is reduced, and the working efficiency is greatly improved.
An embodiment of a second aspect of the present application provides a data acquisition device for an application program, including:
the acquisition module is used for acquiring data query conditions;
the determining module is used for determining terminal equipment with equipment attributes matched with the data query conditions according to the data query conditions; the equipment attribute comprises at least one of a region where equipment is located, an equipment operating system type and an equipment operating system version;
and the processing module is used for accessing the application program management platform through the terminal equipment to obtain the application program data which is counted by the application program management platform and accords with the data query condition.
According to the data acquisition device of the application program, through acquiring the data query conditions, terminal equipment with equipment attributes matched with the data query conditions is determined according to the data query conditions; the equipment attribute comprises at least one of a region where equipment is located, an equipment operating system type and an equipment operating system version; and accessing the application program management platform through the terminal equipment to obtain the application program data which is counted by the application program management platform and accords with the data query condition. According to the method, the application management platform is accessed in the terminal equipment matched with the data query condition to obtain the application program data conforming to the data query condition, so that the technical problems of low working efficiency, high error rate, long data updating period and the like caused by manually acquiring the application program data counted by the application management platform in the prior art are solved, a large amount of labor cost is reduced, and the working efficiency is greatly improved.
An embodiment of a third aspect of the present application proposes a computer device comprising: the method comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor realizes the data acquisition method according to the embodiment of the application when executing the program.
An embodiment of the fourth aspect of the present application proposes a non-transitory computer-readable storage medium, on which a computer program is stored, characterized in that the program, when executed by a processor, implements a data acquisition method as proposed in the above-mentioned embodiment of the present application.
Additional aspects and advantages of the application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:
fig. 1 is a flowchart of a data acquisition method of an application provided in an embodiment of the present application;
FIG. 2 is a flowchart illustrating another method for acquiring data of an application according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a data acquisition device of an application according to an embodiment of the present application;
Fig. 4 is a schematic structural diagram of a data acquisition device of another application according to an embodiment of the present application;
fig. 5 illustrates a block diagram of an exemplary computer device suitable for use in implementing embodiments of the present application.
Detailed Description
Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary and intended for the purpose of explaining the present application and are not to be construed as limiting the present application.
In the prior art, a company operator acquires various information of each application management platform, such as ranking list, recommendation list, search ranking and the like of application programs, is in a stage of manual acquisition, and sequentially opens each application management platform by preparing a plurality of machines or installing a plurality of application management platforms to check each list and search ranking, then manually enters a database, and sends the information to a popularization person in the form of mail after finishing.
Aiming at the technical problems in the prior art, the embodiment of the application provides a data acquisition method and a data acquisition device of an application program, wherein the terminal equipment with equipment attribute matched with the data query condition is determined according to the data query condition by acquiring the data query condition; the equipment attribute comprises at least one of a region where equipment is located, an equipment operating system type and an equipment operating system version; and accessing the application program management platform through the terminal equipment to obtain the application program data which is counted by the application program management platform and accords with the data query condition.
The following describes a data acquisition method and apparatus for an application program according to an embodiment of the present application with reference to the accompanying drawings.
Fig. 1 is a flowchart of a data acquisition method of an application provided in an embodiment of the present application.
As shown in fig. 1, the data acquisition method of the application program may include the steps of:
and step 101, acquiring data query conditions.
The data query condition is set according to the requirement of the operator, for example, the downloading ranking, searching ranking, etc. of each application program in the application program management platform and the statistical range of the corresponding ranking can be set.
In the embodiment of the application, after the computer equipment detects the data query condition input by the user, the operation of acquiring the data query condition is triggered, so that the data query condition is acquired.
Step 102, determining terminal equipment with equipment attribute matched with the data query condition according to the data query condition; the equipment attribute comprises at least one of a region where equipment is located, an equipment operating system type and an equipment operating system version.
The terminal device may be a personal computer (Personal Computer, abbreviated as PC), a cloud device, a mobile device, etc., and the mobile device may be a mobile phone, a tablet computer, a personal digital assistant, a wearable device, a vehicle-mounted device, etc. with various hardware devices including an operating system, a touch screen, and/or a display screen.
In this embodiment of the present invention, because the heat of using each application program by the user in different regions is different, the data of the application program required by the operator is also different, but because the application program management platform often returns corresponding statistical data according to the region or the system condition where the terminal device accessing the platform is located, for example, when the terminal device in Shanghai accesses, the statistical data in Shanghai range is returned to the terminal device in Shanghai. In order to meet the comprehensiveness of the statistical data, the operator has differences in the set data query conditions during different queries. Accordingly, a plurality of terminal devices for accessing the application management platform are provided, specifically, a plurality of terminal devices are set in different regions, and the types and versions of the operating systems configured by the terminal devices are not identical, so that the terminal devices matched with the data query conditions are determined according to the data query conditions.
For example, 20 terminal devices are configured in Beijing and Nanjing respectively, and terminal devices with device attributes matching the data query conditions are determined from the 40 terminal devices according to the acquired data query conditions. For example, the data query condition is a search rank of each application program in the application management platform in the terminal device of brand a querying south kyo. According to the query condition, the terminal equipment with equipment attribute matched with the data query condition can be determined from 20 terminal equipment in Nanj.
And step 103, accessing the application program management platform through the terminal equipment to obtain the application program data which is counted by the application program management platform and accords with the data query condition.
The application management platform refers to a platform for managing each application.
In the embodiment of the application, after the terminal equipment matched with the data query condition is determined, the application management platform is accessed through the terminal equipment, so that a management page of the application management platform is obtained, and further, the application program data which is counted by the application management platform and accords with the data query condition is obtained through the operation of simulating clicking.
The application program data includes ranking and/or comment information of each application program in the application program management platform, and may also include forwarding amount, collection amount, and the like of each application program. The content specifically included in the application data may be determined according to the query conditions set in the data query conditions, and is not limited herein.
As a possible implementation manner, the application program data which is counted by the application management platform and meets the data query condition in the terminal device can be periodically obtained through an automatic simulation system which is deployed in advance in the terminal device so as to simulate the daily operation of operators without the need of real clicking operation. Therefore, labor cost and data updating time period are reduced, and data accuracy is improved.
According to the data acquisition method of the application program, through acquiring the data query conditions, terminal equipment with equipment attributes matched with the data query conditions is determined according to the data query conditions; the equipment attribute comprises at least one of a region where equipment is located, an equipment operating system type and an equipment operating system version; and accessing the application program management platform through the terminal equipment to obtain the application program data which is counted by the application program management platform and accords with the data query condition. According to the method, the application management platform is accessed in the terminal equipment matched with the data query condition to obtain the application program data conforming to the data query condition, so that the technical problems of low working efficiency, high error rate, long data updating period and the like caused by manually acquiring the application program data counted by the application management platform in the prior art are solved, a large amount of labor cost is reduced, and the working efficiency is greatly improved.
In order to clearly illustrate the above embodiment, the present embodiment provides another method for acquiring data of an application, and fig. 2 provides another method for acquiring data of an application in the present embodiment.
As shown in fig. 2, the data acquisition method of the application program may include the steps of:
Step 201, a data query condition is obtained.
Step 202, determining terminal equipment with equipment attribute matched with the data query condition according to the data query condition.
In this embodiment of the present application, the implementation process of step 201 and step 202 may refer to the implementation process described in step 101 and step 102 in the foregoing embodiment, which is not described herein again.
And 203, accessing the application program management platform through the terminal equipment to obtain a management page.
The management page of the application program management platform is used for displaying ranking, hot ranking, search ranking and other information of each application program in the management platform.
In the embodiment of the application, after determining the terminal equipment with the equipment attribute matched with the data query condition according to the data query condition, the application management platform is accessed through the terminal equipment to obtain the management page of the application program.
As an example, if the data query condition is to obtain the downloading amount of the application program C in the B application program management platform of the a region, after determining the terminal device with the device attribute matching the data query condition, the application management platform is accessed through the terminal device to obtain a management page for managing the application program.
And 204, performing simulated clicking on the management page according to the data query condition so that the application management platform provides a statistical page matched with the data query condition.
In the embodiment of the application, the application management platform is accessed through the terminal equipment matched with the data query condition to obtain the management page, the user clicking operation is simulated on the management page continuously according to the data query condition, and the statistical page matched with the data query condition and provided by the application management platform is entered. The statistical page is obtained by performing behavior statistics on all user terminals with the same equipment attribute as the currently accessed terminal equipment by using the application management platform.
The simulated clicking operation is an operation sequence set in the application program management platform according to the data query condition.
Continuing with the above example, if the data query condition is that the downloading amount of the application program C in the B application program management platform of the region a is obtained, after determining that the device attribute matches with the terminal device of the data query condition, accessing the application management platform by the terminal device to obtain a management page for managing the application program, and in the management page of the application program, simulating the operation of clicking and viewing the statistical page by the user to obtain the statistical page of the downloading amount of the application program C provided by the application program management platform.
And 205, performing statistical data crawling on the statistical page to obtain application program data.
The data crawling refers to downloading the content on the page.
In the embodiment of the application program, the data of the application program in the application program management platform is continuously updated, and meanwhile, a developer also continuously uploads a new application program to the application program management platform, so that the data of the application program stored in the database is required to be continuously updated. Therefore, the statistical page can be periodically subjected to data crawling to obtain the application program data.
As a possible implementation manner, the operation path for acquiring the data of the application program can be simulated through a Selenium tool, and the data of all application programs in the application program management platform are periodically grabbed and summarized into the database to realize the timing update of the data in the database.
Among other things, selenium is an automated test tool for web applications. The method can directly run in a browser, simulate clicking operation of a person, extract a document object model (Document Object Model, DOM) in a web page, and perform copying, modification, deletion and other processes. And, it supports multiple browsers, in which only a specific browser driver needs to be installed to run.
And step 206, filtering the application program data according to preset screening conditions.
In the embodiment of the application, the statistical page is crawled to obtain useless information such as icons of each application program and picture information in the basic profile possibly in the application program data, at this time, the application program data crawled from the statistical page is required to be filtered, some useless information is filtered, and only useful data is reserved, so that storage space is saved.
Specifically, according to preset screening conditions, the application program data crawled from the statistical page is filtered by using a filtering tool. The screening conditions may be to screen out information such as pictures and icons in the data, and specific screening conditions are determined according to the needs of the user and are not specifically limited herein.
As an example, the mitxproxy tool may be used to filter application data according to the filtering conditions, thereby filtering out unwanted information, leaving only useful information.
Wherein, mitmproxy is a packet-grabbing tool of open source, provides a console interface for dynamically intercepting and editing HTTP data packets.
Step 207, inquiring the priority of each group of statistical data according to the statistical dimension of each group of statistical data in the application program data.
The statistics dimension refers to application program data based on multi-azimuth statistics, such as load, search ranking, heat ranking and the like.
In the embodiment of the application program, the acquired application program is divided into a plurality of groups of statistical data according to the statistical dimension, and each group of statistical data corresponds to one priority, so that the priority of each group of statistical data can be queried according to the statistical dimension of each group of statistical data in the application program data.
Step 208, storing the statistical data of each group into a database according to the priority order.
The database is used for storing data of each application program of the application program management platform, and summarizing the data for later data query and comparison and the like.
According to the method and the device for obtaining the statistics of the application program data, the statistics with low priority are stored in the temporary resource library according to the priority of each group of statistics obtained through inquiry, so that the performance of the application program data obtaining system is optimized, the system is enabled to be faster, and the running speed of the system is improved. And storing the statistical data with high priority into a database to process the data in the database, and synchronizing the statistical data stored in the temporary resource library into the database in the gap of data processing of the database, thereby saving the data storage time.
For example, the downloading amount and the search ranking of each application program are obtained from the application program management platform statistics page, and if the priority of the downloading amount is higher than the priority of the search ranking, the statistics data corresponding to the downloading amount is stored in the database, the statistics data corresponding to the search ranking is stored in the temporary resource library, and after all the data corresponding to the downloading amount is stored in the database, the statistics data corresponding to the search ranking is stored in the database in a data processing gap.
Further, the application data is stored in the database and then processed, and the application data is dynamically displayed in the form of a report, for example, the application data is dynamically displayed in the form of a table, a histogram, a pie chart and the like. After the application program data is displayed through the data report, the data report is sent to operators according to a preset time period, so that the operators can more intuitively know the change trend of the data, and the delivery work and the delivery strategy of the products are adjusted. For example, it may be sent in the form of mail to present application data to the operator. If the acquired application program data is less, for example, only one histogram exists, the application program data can also be sent in a short message mode.
As a possible scenario, the application data stored in the database may be predictive analyzed according to a time series analysis method. The time sequence analysis method is to arrange application program data stored in a database according to time sequence to form a statistical time sequence, then apply a certain digital method to extend the statistical time sequence outwards, predict the development trend of the market and determine the market predictive value. The main characteristic of the time series analysis method is that the market demand trend is predicted by time-lapse research, and the time series analysis method is not influenced by other external factors.
Further, the result of the predictive analysis on the application program data in the database is displayed in the form of a data report, and the data report is sent to the operator, and the data report can also be sent in the form of mail to display the application program data to the operator.
According to the data acquisition method of the application program, through acquiring the data query conditions, according to the data query conditions, terminal equipment with equipment attributes matched with the data query conditions is determined, a management page is obtained by accessing an application program management platform through the terminal equipment, according to the data query conditions, simulated clicking is conducted on the management page, so that the application program management platform provides a statistical page matched with the data query conditions, statistical data crawling is conducted on the statistical page, application program data are obtained, according to preset screening conditions, the application program data are filtered, according to statistical dimensions of all groups of statistical data in the application program data, priorities of all groups of statistical data are queried, and all groups of statistical data are stored in a database according to priority orders. According to the method, the application program data is obtained by crawling the data in the statistical page matched with the data query condition and provided by the application program management platform, and further, each group of statistical data is stored in the database according to the priority order, so that the accuracy of data acquisition is improved, the data updating period is shortened, and the working efficiency is greatly improved.
In order to implement the above embodiment, the present application further provides a data acquisition device for an application program.
Fig. 3 is a schematic structural diagram of a data acquisition device of an application program according to an embodiment of the present application.
As shown in fig. 3, the data acquisition device 100 of the application program includes: an acquisition module 110, a determination module 120, and a processing module 130.
The acquiring module 110 is configured to acquire a data query condition.
A determining module 120, configured to determine, according to the data query condition, a terminal device whose device attribute matches the data query condition; the equipment attribute comprises at least one of a region where equipment is located, an equipment operating system type and an equipment operating system version.
The processing module 130 is configured to access the application management platform through the terminal device, so as to obtain application data that is counted by the application management platform and meets the data query condition.
As a possible implementation manner, the processing module 130 is specifically configured to access, through the terminal device, the application management platform to obtain a management page, and perform a simulated click on the management page according to the data query condition, so that the application management platform provides a statistics page matched with the data query condition; the statistical page is obtained by performing behavior statistics on each user terminal with the same equipment attribute as the currently accessed terminal equipment by the application program management platform, and performing statistical data crawling on the statistical page to obtain application program data.
As another possible implementation manner, the processing module 130 may be further configured to filter the application data according to a preset filtering condition; and the screening conditions are used for screening out the picture information in the application program data.
As another possible implementation manner, referring to fig. 4, the data acquisition device 100 of the application program may further include:
and the storage module 140 is used for storing the application program data into the database.
As another possible implementation, referring to fig. 4, the storage module 140 may further include:
and the querying unit 141 is configured to query the priorities of the sets of statistics data according to the statistics dimensions of the sets of statistics data in the application data.
A storage unit 142, configured to store the sets of statistical data into the database according to the priority order.
As another possible implementation manner, the storage unit 142 is specifically configured to store the statistics with low priority into the temporary repository, store the statistics with high priority into the database, and synchronize the statistics stored in the temporary repository to the database in a data processing gap of the database.
As another possible implementation manner, referring to fig. 4, the data acquisition device 100 of the application program may further include:
The prediction module 150 is configured to perform predictive analysis on the application data stored in the database according to the time-series analysis method.
As another possible implementation, the application data includes ranking and/or comment information for each application at the application management platform.
According to the data acquisition device of the application program, through acquiring the data query conditions, terminal equipment with equipment attributes matched with the data query conditions is determined according to the data query conditions; the equipment attribute comprises at least one of a region where equipment is located, an equipment operating system type and an equipment operating system version; and accessing the application program management platform through the terminal equipment to obtain the application program data which is counted by the application program management platform and accords with the data query condition. According to the method, the application management platform is accessed in the terminal equipment matched with the data query condition to obtain the application program data conforming to the data query condition, so that the technical problems of low working efficiency, high error rate, long data updating period and the like caused by manually acquiring the application program data counted by the application management platform in the prior art are solved, a large amount of labor cost is reduced, and the working efficiency is greatly improved.
In order to implement the above embodiment, the present application further proposes a computer device, including: the method comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor realizes the data acquisition method of the application program according to the embodiment of the application when executing the program.
In order to achieve the above embodiments, the present application further proposes a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a data acquisition method of an application program as proposed in the above embodiments of the present application.
Fig. 5 illustrates a block diagram of an exemplary computer device suitable for use in implementing embodiments of the present application. The computer device 12 shown in fig. 5 is merely an example and should not be construed as limiting the functionality and scope of use of embodiments of the present application.
As shown in FIG. 5, the computer device 12 is in the form of a general purpose computing device. Components of computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, a bus 18 that connects the various system components, including the system memory 28 and the processing units 16.
Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include industry Standard architecture (Industry Standard Architecture; hereinafter ISA) bus, micro channel architecture (Micro Channel Architecture; hereinafter MAC) bus, enhanced ISA bus, video electronics standards Association (Video Electronics Standards Association; hereinafter VESA) local bus, and peripheral component interconnect (Peripheral Component Interconnection; hereinafter PCI) bus.
Computer device 12 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by computer device 12 and includes both volatile and nonvolatile media, removable and non-removable media.
Memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (Random Access Memory; hereinafter: RAM) 30 and/or cache memory 32. The computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from or write to non-removable, nonvolatile magnetic media (not shown in FIG. 5, commonly referred to as a "hard disk drive"). Although not shown in fig. 5, a magnetic disk drive for reading from and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable non-volatile optical disk (e.g., a compact disk read only memory (Compact Disc Read Only Memory; hereinafter CD-ROM), digital versatile read only optical disk (Digital Video Disc Read Only Memory; hereinafter DVD-ROM), or other optical media) may be provided. In such cases, each drive may be coupled to bus 18 through one or more data medium interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of the embodiments of the present application.
A program/utility 40 having a set (at least one) of program modules 42 may be stored in, for example, memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 42 generally perform the functions and/or methods in the embodiments described herein.
The computer device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), one or more devices that enable a user to interact with the computer device 12, and/or any devices (e.g., network card, modem, etc.) that enable the computer device 12 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 22. Moreover, the computer device 12 may also communicate with one or more networks such as a local area network (Local Area Network; hereinafter LAN), a wide area network (Wide Area Network; hereinafter WAN) and/or a public network such as the Internet via the network adapter 20. As shown, network adapter 20 communicates with other modules of computer device 12 via bus 18. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with computer device 12, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, for example, implementing the data acquisition method of the application program mentioned in the foregoing embodiment.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present application, the meaning of "plurality" is at least two, such as two, three, etc., unless explicitly defined otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and additional implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present application.
Logic and/or steps represented in the flowcharts or otherwise described herein, e.g., a ordered listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program is printed, as the program may be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
It is to be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. As with the other embodiments, if implemented in hardware, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
Those of ordinary skill in the art will appreciate that all or a portion of the steps carried out in the method of the above-described embodiments may be implemented by a program to instruct related hardware, where the program may be stored in a computer readable storage medium, and where the program, when executed, includes one or a combination of the steps of the method embodiments.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing module, or each unit may exist alone physically, or two or more units may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules. The integrated modules may also be stored in a computer readable storage medium if implemented in the form of software functional modules and sold or used as a stand-alone product.
The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, or the like. Although embodiments of the present application have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the application, and that variations, modifications, alternatives, and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the application.

Claims (18)

1. A method for acquiring data of an application program, the method comprising the steps of:
acquiring a data query condition;
determining terminal equipment with equipment attributes matched with the data query conditions according to the data query conditions; the equipment attribute comprises at least one of a region where equipment is located, an equipment operating system type and an equipment operating system version;
and accessing an application program management platform through the terminal equipment to obtain a management page, and obtaining application program data which is counted by the application program management platform and accords with the data query condition through the simulated clicking operation on the management page.
2. The method for acquiring the data of the application program according to claim 1, wherein the accessing the application program management platform through the terminal device to obtain the management page, and obtaining the application program data which is counted by the application program management platform and meets the data query condition through the simulated clicking operation on the management page, includes:
Accessing the application program management platform through the terminal equipment to obtain a management page;
according to the data query conditions, performing simulated clicking on the management page so that the application management platform provides a statistical page matched with the data query conditions; the statistical page is obtained by performing behavior statistics on all user terminals with the same equipment attribute as the currently accessed terminal equipment by the application program management platform;
and performing statistical data crawling on the statistical page to obtain the application program data.
3. The method for acquiring data of an application program according to claim 2, wherein after the step of crawling the statistics page for statistics data to obtain the application program data, further comprises:
filtering the application program data according to preset screening conditions; and the screening conditions are used for screening out the picture information in the application program data.
4. The method for acquiring data of an application program according to claim 1, wherein after the application program management platform is accessed by the terminal device to obtain the application program data which meets the data query condition and is counted by the application program management platform, the method further comprises:
And storing the application program data into a database.
5. The method for acquiring data of an application program according to claim 4, wherein storing the application program data in a database comprises:
inquiring the priority of each group of statistical data according to the statistical dimension of each group of statistical data in the application program data;
the sets of statistics are stored in a database according to a priority order.
6. The method for acquiring data of an application program according to claim 5, wherein storing the sets of statistical data in the database according to the priority order comprises:
storing the statistics with low priority into a temporary repository;
storing the statistics with high priority into a database;
and in the gap of data processing on the database, synchronizing the statistical data stored in the temporary resource library to the database.
7. The method for acquiring data of an application program according to claim 4, further comprising, after storing the application program data in a database:
and carrying out predictive analysis on the application program data stored in the database according to a time sequence analysis method.
8. The method for acquiring data of an application program according to any one of claims 1 to 7, wherein the application program data includes ranking and/or comment information of each application program on an application program management platform.
9. A data acquisition device for an application program, the device comprising:
the acquisition module is used for acquiring data query conditions;
the determining module is used for determining terminal equipment with equipment attributes matched with the data query conditions according to the data query conditions; the equipment attribute comprises at least one of a region where equipment is located, an equipment operating system type and an equipment operating system version;
the processing module is used for accessing the application program management platform through the terminal equipment to obtain a management page, and obtaining the application program data which is counted by the application program management platform and accords with the data query condition through the simulated clicking operation on the management page.
10. The application program data acquisition device according to claim 9, wherein the processing module is specifically configured to:
accessing the application program management platform through the terminal equipment to obtain a management page;
According to the data query conditions, performing simulated clicking on the management page so that the application management platform provides a statistical page matched with the data query conditions; the statistical page is obtained by performing behavior statistics on all user terminals with the same equipment attribute as the currently accessed terminal equipment by the application program management platform;
and performing statistical data crawling on the statistical page to obtain the application program data.
11. The application program data acquisition device according to claim 10, wherein the processing module is further specifically configured to:
filtering the application program data according to preset screening conditions; the screening condition is to screen out the picture information in the application program data.
12. The application program data acquisition device according to claim 9, further comprising:
and the storage module is used for storing the application program data into a database.
13. The application program data acquisition device of claim 12, wherein the memory module further comprises:
the query unit is used for querying the priority of each group of statistical data according to the statistical dimension of each group of statistical data in the application program data;
And the storage unit is used for storing the statistical data of each group into the database according to the priority order.
14. The application program data acquisition device according to claim 13, wherein the storage unit is specifically configured to:
storing the statistics with low priority into a temporary repository;
storing the statistics with high priority into a database;
and in the gap of data processing on the database, synchronizing the statistical data stored in the temporary resource library to the database.
15. The application program data acquisition device according to claim 12, further comprising:
and the prediction module is used for performing prediction analysis on the application program data stored in the database according to a time sequence analysis method.
16. The application data acquisition device according to any one of claims 9 to 15, wherein the application data includes ranking and/or comment information of each application on an application management platform.
17. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the data acquisition method according to any one of claims 1-8 when executing the program.
18. A non-transitory computer readable storage medium having stored thereon a computer program, which when executed by a processor implements a data acquisition method according to any one of claims 1-8.
CN201910020223.7A 2019-01-09 2019-01-09 Application program data acquisition method and device Active CN111428117B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910020223.7A CN111428117B (en) 2019-01-09 2019-01-09 Application program data acquisition method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910020223.7A CN111428117B (en) 2019-01-09 2019-01-09 Application program data acquisition method and device

Publications (2)

Publication Number Publication Date
CN111428117A CN111428117A (en) 2020-07-17
CN111428117B true CN111428117B (en) 2023-05-16

Family

ID=71545645

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910020223.7A Active CN111428117B (en) 2019-01-09 2019-01-09 Application program data acquisition method and device

Country Status (1)

Country Link
CN (1) CN111428117B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111741030B (en) * 2020-08-26 2020-12-04 北京赛宁网安科技有限公司 Website security detection system and method combining Web automation and agent interception
CN113010208B (en) * 2021-04-28 2023-12-19 数字广东网络建设有限公司 Version information generation method, device, equipment and storage medium

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102571160A (en) * 2012-01-16 2012-07-11 华为终端有限公司 Bluetooth searching method and equipment
CN103164505A (en) * 2012-09-20 2013-06-19 深圳市金立通信设备有限公司 System and method for conducting ranking on internet applications based on actual use frequency
CN103605754A (en) * 2013-11-22 2014-02-26 北京飞流九天科技有限公司 Method and device for ranking applications
CN103677899A (en) * 2013-11-15 2014-03-26 小米科技有限责任公司 Method and device for installing application programs
CN104735041A (en) * 2013-12-24 2015-06-24 华为终端有限公司 Method and device for having access to offline resources
CN104966245A (en) * 2015-06-30 2015-10-07 国网天津市电力公司 Visualized power supply scheme auxiliary compilation method based on power grid GIS (Gas Insulated Switchgear)
CN105589873A (en) * 2014-10-22 2016-05-18 腾讯科技(深圳)有限公司 Data searching method, terminal and server
CN106067894A (en) * 2016-05-25 2016-11-02 努比亚技术有限公司 A kind of information getting method and electronic equipment
CN107463578A (en) * 2016-06-06 2017-12-12 工业和信息化部电信研究院 Using download statistics De-weight method, device and terminal device
CN107463581A (en) * 2016-06-02 2017-12-12 广州泰尔智信科技有限公司 Using download acquisition methods, device and terminal device
CN107798028A (en) * 2017-02-16 2018-03-13 平安科技(深圳)有限公司 One kind applies download statistics method and apparatus
CN108280093A (en) * 2017-01-06 2018-07-13 工业和信息化部电信研究院 Application message acquisition methods and device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9176924B2 (en) * 2011-11-16 2015-11-03 Autoconnect Holdings Llc Method and system for vehicle data collection

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102571160A (en) * 2012-01-16 2012-07-11 华为终端有限公司 Bluetooth searching method and equipment
CN103164505A (en) * 2012-09-20 2013-06-19 深圳市金立通信设备有限公司 System and method for conducting ranking on internet applications based on actual use frequency
CN103677899A (en) * 2013-11-15 2014-03-26 小米科技有限责任公司 Method and device for installing application programs
CN103605754A (en) * 2013-11-22 2014-02-26 北京飞流九天科技有限公司 Method and device for ranking applications
CN104735041A (en) * 2013-12-24 2015-06-24 华为终端有限公司 Method and device for having access to offline resources
CN105589873A (en) * 2014-10-22 2016-05-18 腾讯科技(深圳)有限公司 Data searching method, terminal and server
CN104966245A (en) * 2015-06-30 2015-10-07 国网天津市电力公司 Visualized power supply scheme auxiliary compilation method based on power grid GIS (Gas Insulated Switchgear)
CN106067894A (en) * 2016-05-25 2016-11-02 努比亚技术有限公司 A kind of information getting method and electronic equipment
CN107463581A (en) * 2016-06-02 2017-12-12 广州泰尔智信科技有限公司 Using download acquisition methods, device and terminal device
CN107463578A (en) * 2016-06-06 2017-12-12 工业和信息化部电信研究院 Using download statistics De-weight method, device and terminal device
CN108280093A (en) * 2017-01-06 2018-07-13 工业和信息化部电信研究院 Application message acquisition methods and device
CN107798028A (en) * 2017-02-16 2018-03-13 平安科技(深圳)有限公司 One kind applies download statistics method and apparatus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"基于IFIX的铁路客运车站设备管理系统的设计";陈春成,杨懿涵,;《科技与创新》;20170731(第7期);全文 *

Also Published As

Publication number Publication date
CN111428117A (en) 2020-07-17

Similar Documents

Publication Publication Date Title
JP6854041B2 (en) Project management in a content management system
RU2629448C2 (en) System and method of controlling and organizing web-browser cash
RU2608668C2 (en) System and method for control and organisation of web-browser cache for offline browsing
CN108874289B (en) Application history record viewing method and device and electronic equipment
EP3069267A1 (en) Software component recommendation based on multiple trace runs
CN106021449A (en) Searching method and device for mobile terminal and mobile terminal
CN104809224A (en) Method and device for presenting application information
CN103631623A (en) Method and device for allocating application software in trunking system
CN102446171A (en) Method and apparatus for evaluating quality score of promotion key word based on weighted average click-through rate
CN111428117B (en) Application program data acquisition method and device
CN111400361A (en) Data real-time storage method and device, computer equipment and storage medium
CN112000911B (en) Page management method, device, electronic equipment and storage medium
CN112765104A (en) File saving method, device, equipment and storage medium
CN106371706A (en) Method and device for site selection of application shortcuts
CN103699534A (en) Display method and device for data object in system directory
CN107735785B (en) Automatic information retrieval
CN103631796A (en) Website sort management method and electronic device
EP3564833B1 (en) Method and device for identifying main picture in web page
CN103809915B (en) The reading/writing method of a kind of disk file and device
US10241988B2 (en) Prioritizing smart tag creation
CN112364185A (en) Method and device for determining characteristics of multimedia resource, electronic equipment and storage medium
CN110287338B (en) Industry hotspot determination method, device, equipment and medium
CN108520012B (en) Mobile internet user comment mining method based on machine learning
CN107480269B (en) Object display method and system, medium and computing equipment
WO2015068259A1 (en) Information provision method and device, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant