CN105553769B - A kind of data acquisition and analysis system and method - Google Patents

A kind of data acquisition and analysis system and method Download PDF

Info

Publication number
CN105553769B
CN105553769B CN201510938627.6A CN201510938627A CN105553769B CN 105553769 B CN105553769 B CN 105553769B CN 201510938627 A CN201510938627 A CN 201510938627A CN 105553769 B CN105553769 B CN 105553769B
Authority
CN
China
Prior art keywords
information
parameter
acquisition
application
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510938627.6A
Other languages
Chinese (zh)
Other versions
CN105553769A (en
Inventor
王景正
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Qihoo Technology Co Ltd
Original Assignee
Beijing Qihoo Technology Co Ltd
Qizhi Software Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Qihoo Technology Co Ltd, Qizhi Software Beijing Co Ltd filed Critical Beijing Qihoo Technology Co Ltd
Priority to CN201510938627.6A priority Critical patent/CN105553769B/en
Publication of CN105553769A publication Critical patent/CN105553769A/en
Priority to PCT/CN2016/104923 priority patent/WO2017101606A1/en
Application granted granted Critical
Publication of CN105553769B publication Critical patent/CN105553769B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/02Capturing of monitoring data
    • H04L43/022Capturing of monitoring data by sampling
    • H04L43/024Capturing of monitoring data by sampling by adaptive sampling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/04Processing captured monitoring data, e.g. for logfile generation

Abstract

The embodiment of the invention provides a kind of data acquisition and analysis system and method, the system comprises acquisition control server, data analytics server, report generation server and at least one data terminal, sampling instrument is installed in data terminal;Acquisition control server, for configuring acquisition configuration information to data terminal and being handed down to corresponding data terminal;Data terminal is acquired the parameter information of acquisition parameter according to acquisition configuration information for applying run time call sampling instrument;And the parameter information of acquisition is uploaded to data analytics server;Data analytics server is analyzed for corresponding to parameter information to each acquisition parameter of upload, obtains data analysis result;Data analysis result is sent to report generation server;Report generation server, for generating data sheet according to data analysis result;User demand, habit etc. are known by the data sheet, and business is adjusted, user demand is more met.

Description

A kind of data acquisition and analysis system and method
Technical field
The present invention relates to technical field of data processing, adopt more particularly to a kind of data acquisition analysis method and a kind of data Set analysis device.
Background technique
With the fast development of the communication technology, especially with the popularization of mobile Internet, intelligent terminal it is universal more next It is faster, and the function of intelligent terminal is also more and more abundant.Wherein, intelligent terminal realizes its function by installing various applications Can, diversified service is provided.
In order to improve service quality, data acquisition plan acquisition applications that the developer of each service platform needs to be arranged Data, to understand business demand.Wherein, the application data that different business needs to acquire are different.Therefore, the exploitation of service platform Personnel need to be arranged according to different business different application data acquisition plans.
Specifically, the developer of service platform needs the business provided according to service platform, the acquisition of each application is set Parameter carries out data acquisition to each application according to the acquisition parameter of setting, the bordereau of the service platform is generated, to understand industry Business demand.But be mounted on intelligent terminal application it is relatively more, that is, the application data for needing to acquire are relatively more, lead to each clothes The data acquisition format of business platform is difficult to unification.Therefore, the developer of each service platform also needs to define the data of each application Format is acquired, allows each service platform to acquire the data of each application according to the data acquisition format of setting, further increases The workload of developer.
Summary of the invention
In view of the above problems, it proposes on the present invention overcomes the above problem or at least be partially solved in order to provide one kind State the data acquisition analysis method and corresponding data acquisition and analysis system of problem.
According to one aspect of the present invention, a kind of data acquisition and analysis system is provided, comprising: acquisition control server, Data analytics server, report generation server and at least one data terminal are equipped with sampling instrument in the data terminal; The acquisition control server, for configuring the acquisition configuration information to data terminal and being handed down to corresponding data terminal, Wherein, the configuration information is used to control the acquisition of acquisition parameter;The data terminal, for using described in run time call Sampling instrument is acquired the parameter information of acquisition parameter according to acquisition configuration information;And it will be on the parameter information of acquisition It is transmitted to the data analytics server;The data analytics server, for corresponding to parameter information to each acquisition parameter of upload It is analyzed, obtains data analysis result;The data analysis result is sent to the report generation server;The report Server is generated, for generating data sheet according to the data analysis result.
Optionally, stating acquisition control server includes cloud control server;The cloud control server, for according to application type Determine the acquisition parameter of the application, wherein the acquisition parameter includes: dynamic parameter and/or static parameter;It is answered according to described in Acquisition configuration information is configured with terminal where application, wherein the acquisition configuration information is for controlling the acquisition parameter Acquisition and upload;Acquisition parameter and acquisition configuration information are handed down to the data terminal where application.
Optionally, the cloud control server will be uploaded for the upload condition and/or sampling condition of configuration parameter information Condition and/or sampling condition are added in acquisition configuration information;Terminal where configuring the application corresponds to the acquisition threshold value of memory, The acquisition threshold value is added in acquisition configuration information;Between the upload of terminal corresponding network type where configuring the application Every, by the upload interval be added in the acquisition configuration information;Terminal where configuring the application corresponds to cache threshold, will The cache threshold is added in acquisition configuration information;And in the acquisition configuration information configuration protocol upload sequence, adopt The priority of sample rate and sampling parameter.
Optionally, the data terminal, for quiet according to being applied described in acquisition configuration information collection using sampling instrument The parameter information of state parameter;And dynamic parameter to be collected is determined according to acquisition configuration information using the sampling instrument, according to Acquire the parameter information of the dynamic parameter in real time according to the operation of the application.
Optionally, the data terminal, for the interface when detecting the changing interface of the application, before record switching For page up, the interface after record switching is current page, and the page up and current page are added to application interface starting information In;When the button for detecting the application is triggered, the corresponding button number of the button is obtained, the button number is updated Button number and number of clicks are added in button click information by corresponding number of clicks;It is related to acquire the application Runing time as duration information, wherein the duration information includes: interface runing time and using runing time.
Optionally, the parameter information of the static parameter includes at least one of the following: terminal iidentification, version information, channel Information, network type and resolution information;The parameter information of the dynamic parameter includes at least one of the following: that application interface starts Information, button click information, duration information, exception information and session information.
Optionally, the report generation server, the customized pipe for the corresponding customized event of application according to configuration Information is managed, business statistics information is obtained;Customized event report is generated according to the customized management information and business statistics information Table.
Optionally, the report generation server is also used to obtain answering for the application from the service management page The customized event information of customized event is corresponded to path and the application, wherein the customized event packet It includes: event title and event attribute;Customized management information is generated using the application path and customized event information.
Optionally, the report generation server is applied for determining according to the application path;For each customized Event obtains the corresponding logical name of the event title and the corresponding logical attribute of the event attribute;It is patrolled described in lookup It collects title and corresponds to acquisition parameter, determine the corresponding business statistics information of the acquisition parameter according to the logical attribute;And really Determine the corresponding event title of each acquisition parameter, application is generated using the business statistics information of each event title and corresponding acquisition parameter Customized event report.
Optionally, the acquisition control server is also used to configure the test letter that the target application corresponds to test equipment Breath;
The data analytics server is also used to analyze the corresponding parameter information uploaded of the target application;Sentence When the parameter information that breaks belongs to test equipment, the parameter information for belonging to test equipment is analyzed in real time;The report is raw At server, when being also used to judge that the parameter information belongs to test equipment, datagram is generated in real time according to data analysis result Table.
Optionally, the acquisition control server, comprising: exploitation configuration server;The exploitation configuration server, is used for After target application completes registration, the test for configuring at least one test equipment to the target application is identified;For the target Application configuration acquisition parameter to be tested, using test mark and acquisition parameter as test information;The data analysis clothes Business device is also used to obtain the parameter information that target application corresponds to acquisition parameter from the parameter information of upload;Pass through the parameter Terminal parameter counterpart terminal identifies in information;It is identical to judge that the terminal iidentification is identified whether with test in test equipment table, when When the terminal iidentification is identical as test mark any in test equipment table, judge that parameter information belongs to test equipment.
Optionally, the data analytics server is also used to search the corresponding verification of checking parameter from the parameter information Information;The check information analyze and determines abduction check results.
Optionally, the data analytics server, for determining the parameter identification of checking parameter, from the parameter information It searches the parameter identification and corresponds to check information;Detect whether the check information is target information;If the check information is not For target information, determines that flow exists and kidnap exception, record is kidnapped abnormal in the abduction check results;If the verification letter Breath is target information, determines that data transmission is normal, record transmission is normal in the abduction check results.
Optionally, the data analytics server is also used to search the corresponding storage of storage parameter from the parameter information Information;According to the storage infomation detection quality of data, quality indicator result is determined.
Optionally, the data analytics server, for determining the storage mark of storage parameter, from the parameter information Search the corresponding storage information of storage mark;According at least one terminal iidentification of the storage information searching;When the storage Information corresponds to a terminal iidentification, generates up-to-standard quality indicator result;When the storage information corresponds to more than one end End mark, searches the terminal iidentification and corresponds to successfully upload information;The corresponding successful information that uploads of each terminal iidentification is ranked up, Determine that the upload successful information there is no when redundancy, judges data exception, generates the quality of data exception according to ranking results Check results.
According to another aspect of the present invention, the data acquisition analysis method is provided applied to data acquisition and analysis system In, data acquisition and analysis system includes: the acquisition control server, data analytics server, report generation server and extremely Lack a data terminal, sampling instrument is installed in the data terminal;
The method includes: that the acquisition control server configures the acquisition configuration information to data terminal and issues To corresponding data terminal;Data terminal sampling instrument described in application run time call, according to acquisition configuration information pair The parameter information of acquisition parameter is acquired;The parameter information of acquisition is uploaded to the acquisition control service by the data terminal Device;The data analytics server corresponds to parameter information to each acquisition parameter of upload and analyzes, and obtains data analysis result; The data analysis result is sent to the report generation server by the data analytics server;The report generation service Device generates data sheet according to the data analysis result.
Optionally, the acquisition control server configures the acquisition configuration information to data terminal and is handed down to corresponding Data terminal, comprising: the acquisition control server determines the acquisition parameter of the application according to application type, wherein described Acquisition parameter includes: dynamic parameter and/or static parameter;Acquisition configuration letter according to terminal configuration where the application and application Breath, wherein the acquisition configuration information is used to control the acquisition and upload of the acquisition parameter;By acquisition parameter and acquisition configuration Information is handed down to the data terminal where application.
Optionally, according to it is described application and application where terminal configuration acquisition configuration information the step of include it is following at least A kind of: upload condition and/or sampling condition are added to acquisition and matched by the upload condition and/or sampling condition of configuration parameter information In confidence breath;Terminal where configuring the application corresponds to the acquisition threshold value of memory, and the acquisition threshold value is added to acquisition configuration In information;Upload interval is added to described adopt by the upload interval of terminal corresponding network type where configuring the application Collect in configuration information;Terminal where configuring the application corresponds to cache threshold, and the cache threshold is added to acquisition configuration letter In breath;Configuration protocol upload sequence, the priority of sample rate and sampling parameter in the acquisition configuration information.
Optionally, described that the parameter information of acquisition parameter is acquired according to acquisition configuration information, comprising: described in use Parameter information of the sampling instrument according to the static parameter applied described in acquisition configuration information collection;Using the sampling instrument foundation Acquisition configuration information determines dynamic parameter to be collected, acquires the parameter of the dynamic parameter in real time according to the operation of the application Information.
Optionally, the step of acquiring the parameter information of the dynamic parameter in real time according to the operation of the application include with down toward Few one kind: when detecting the changing interface of the application, the interface before record switching is page up, the interface after record switching For current page, the page up and current page are added in application interface starting information;When the button for detecting the application When being triggered, the corresponding button number of the button is obtained, the button is updated and numbers corresponding number of clicks, by the button Number and number of clicks are added in button click information;The relevant runing time of the application is acquired as duration information, In, the duration information includes: interface runing time and using runing time.
Optionally, the parameter information of the static parameter includes at least one of the following: terminal iidentification, version information, channel Information, network type and resolution information;The parameter information of the dynamic parameter includes at least one of the following: that application interface starts Information, button click information, duration information, exception information and session information.
Optionally, the report generation server generates data sheet according to the data analysis result, comprising: the report Table generates customized management information of the server according to the corresponding customized event of application of configuration, obtains business statistics information;According to Customized event report is generated according to the customized management information and business statistics information.
Optionally, further include the steps that configuring customized management information: be answered described in being obtained from the service management page Application path and the application correspond to the customized event information of customized event, wherein the customized event letter Breath includes: event title and event attribute;Customized management information is generated using the application path and customized event information.
Optionally, the customized management information according to the corresponding customized event of the application of configuration, obtains business statistics information; Customized event report is generated according to the customized management information and business statistics information, comprising: applies path according to described Determine application;For each customized event, the corresponding logical name of the event title and the event attribute pair are obtained The logical attribute answered;It searches the logical name and corresponds to acquisition parameter, determine the acquisition parameter pair according to the logical attribute The business statistics information answered;It determines the corresponding event title of each acquisition parameter, using each event title and corresponds to acquisition parameter Business statistics information generates the customized event report of application.
Optionally, the method, further includes: the acquisition control server configures the target application and corresponds to test equipment Test information;The data analytics server analyzes the corresponding parameter information uploaded of the target application;Judge institute When stating parameter information and belonging to test equipment, the parameter information for belonging to test equipment is analyzed in real time;The report generation clothes When business device judges that the parameter information belongs to test equipment, data sheet is generated in real time according to data analysis result.
Optionally, the test information that the target application corresponds to test equipment is configured, comprising: complete to register in target application Afterwards, the test for configuring at least one test equipment to the target application identifies;To be tested adopt is configured for the target application Collect parameter, using test mark and acquisition parameter as test information;
The method further include: it is corresponding that the data analytics server obtains target application from the parameter information of upload The parameter information of acquisition parameter;It is identified by terminal parameter counterpart terminal in the parameter information;Judge the terminal iidentification with Test identifies whether identical in test equipment table, when the terminal iidentification is identical as test mark any in test equipment table, Judge that parameter information belongs to test equipment.
Optionally, the method, further includes: it is corresponding that data analytics server searches checking parameter from the parameter information Check information;The check information analyze and determines abduction check results.
Optionally, checking parameter is searched from the parameter information correspond to check information;The check information is divided Analysis, which determines, kidnaps check results, comprising: the parameter identification for determining checking parameter searches the parameter mark from the parameter information Know corresponding check information;Detect whether the check information is target information;If the check information is not target information, determine Flow, which exists, kidnaps exception, and record is kidnapped abnormal in the abduction check results;If the check information is target information, really Fixed number is normal according to transmission, and record transmission is normal in the abduction check results.
Optionally, the method, further includes: the data analytics server searches storage parameter from the parameter information Corresponding storage information;According to the storage infomation detection quality of data, quality indicator result is determined.
Optionally, the corresponding storage information of storage parameter is searched from the parameter information;According to the storage infomation detection The quality of data determines quality indicator as a result, comprising determining that the storage mark of storage parameter, institute is searched from the parameter information State the corresponding storage information of storage mark;According at least one terminal iidentification of the storage information searching;When the storage information pair A terminal iidentification is answered, up-to-standard quality indicator result is generated;When the storage information corresponds to more than one terminal iidentification, It searches the terminal iidentification and corresponds to successfully upload information;The corresponding successful information that uploads of each terminal iidentification is ranked up, according to row Sequence result determines that the upload successful information there is no when redundancy, judges data exception, generates the quality indicator knot of data exception Fruit.
Using starting and while being initialized calls sampling instrument, data acquisition is carried out to application using the sampling instrument When, sampling instrument can be according to the parameter information of each acquisition parameter in applying described in acquisition configuration information collection.Sampling instrument is adopted Collect in the application after the parameter information of each acquisition parameter, judges whether to meet upload condition, if satisfied, sampling instrument is according to pre- It sets algorithm to compress parameter information, is then uploaded to data analytics server.
Data analytics server corresponds to parameter information to each acquisition parameter of upload and analyzes, such as to each acquisition parameter pair The parameter information answered is counted, to obtain data analysis result, then the data analysis result is sent to the report Server is generated, the report generation server is that the data analysis result of each logic configures according to the data analysis result Readable attribute information generates data sheet, so as to determine the service condition of application based on the data sheet.
To which the parameter information of each acquisition parameter can be acquired in the data terminal of application operation by sampling instrument, After being uploaded to data analytics server, data analysis is carried out according to statistical demand, to generate the data sheet of corresponding service, is led to It crosses the data sheet and knows user demand, habit etc., business is adjusted, user demand is more met.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention, And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 shows data acquisition and analysis system structural block diagram according to an embodiment of the invention;
Fig. 2 shows the step flow charts of data acquisition analysis method according to an embodiment of the invention;
Fig. 3 shows data acquisition and analysis system structural block diagram in accordance with another embodiment of the present invention;
Fig. 4 shows the step flow chart of data acquisition analysis method in accordance with another embodiment of the present invention;
Fig. 5 shows the step flow chart of customized event processing method in accordance with another embodiment of the present invention;
Fig. 6 shows the step flow chart of the test method of target application in accordance with another embodiment of the present invention;
Fig. 7 shows the step flow chart of transfer check method in accordance with another embodiment of the present invention;And
Fig. 8 shows the step flow chart of quality of data method of calibration in accordance with another embodiment of the present invention.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure It is fully disclosed to those skilled in the art.
Embodiment one
In general, the supplier, software developer of some terminals such as mobile phone, tablet computer are installed at the terminal by acquisition It is analyzed using data at runtime, and to the data of acquisition, bordereau is generated, to understand business demand.The present invention Embodiment provides a kind of data acquisition and analysis system, which has versatility, can be various applications acquisition, analysis data And generate different bordereaus.
Referring to Fig.1, data acquisition and analysis system structural block diagram according to an embodiment of the invention is shown.
The data acquisition and analysis system, comprising: acquisition control server 102, data analytics server 104, report generation Server 106 and at least one data terminal 108 are equipped with sampling instrument in the data terminal.
The acquisition control server 102, for configuring the acquisition configuration information to data terminal and being handed down to corresponding Data terminal, wherein the configuration information is used to control the acquisition of acquisition parameter;
The data terminal 108, for the sampling instrument described in application run time call, according to acquisition configuration information to adopting The parameter information of collection parameter is acquired;And the parameter information of acquisition is uploaded to the data analytics server;
The data analytics server 104 is analyzed for corresponding to parameter information to each acquisition parameter of upload, is obtained Data analysis result;The data analysis result is sent to the report generation server;
The report generation server 106, for generating data sheet according to the data analysis result.
Based on above-mentioned data acquisition and analysis system, the step of corresponding data acquisition analysis method, is as follows:
Referring to Fig. 2, the step flow chart of data acquisition analysis method according to an embodiment of the invention is shown.
Step 202, the acquisition control server configures the acquisition configuration information to data terminal and is handed down to corresponding Data terminal.
Step 204, data terminal sampling instrument described in application run time call, according to acquisition configuration information to adopting The parameter information of collection parameter is acquired.
Step 206, the parameter information of acquisition is uploaded to the acquisition control server by the data terminal.
Step 208, the data analytics server corresponds to parameter information to each acquisition parameter of upload and analyzes, and obtains Data analysis result.
Step 210, the data analysis result is sent to the report generation server by the data analytics server.
Step 212, the report generation server generates data sheet according to the data analysis result.
The application of the embodiment of the present invention refers to the application program of installation at the terminal, as mobile phone assistant, browser, safety are defended Scholar, player etc..In order to guarantee to acquire the integrality and accuracy of data, run time call sampling instrument can applied.It adopts Collection tool includes Software Development Kit (SDK, Software Development Kit).
The acquisition parameter of each application can be configured for terminal, acquisition control server where different application and application And acquisition configuration information, generate the control information of sampling instrument.Terminal calls sampling instrument to carry out application where application When data acquire, sampling instrument can be according to the parameter information of each acquisition parameter in applying described in acquisition configuration information collection.Its In, the acquisition configuration information is used to control the acquisition and upload of the acquisition parameter.The acquisition parameter includes static parameter And/or dynamic parameter.The static parameter can be used for acquiring this using corresponding static parameter information;Dynamic parameter can be with For acquiring dynamic parameter information when application operation.
Using starting and while being initialized calls sampling instrument, data acquisition is carried out to application using the sampling instrument When, sampling instrument can be according to the parameter information of each acquisition parameter in applying described in acquisition configuration information collection.Sampling instrument is adopted Collect in the application after the parameter information of each acquisition parameter, judges whether to meet upload condition, if satisfied, sampling instrument is according to pre- It sets algorithm to compress parameter information, is then uploaded to data analytics server.
Data analytics server corresponds to parameter information to each acquisition parameter of upload and analyzes, such as to each acquisition parameter pair The parameter information answered is counted, to obtain data analysis result, then the data analysis result is sent to the report Server is generated, the report generation server is that the data analysis result of each logic configures according to the data analysis result Readable attribute information generates data sheet, so as to determine the service condition of application based on the data sheet.
To which the parameter information of each acquisition parameter can be acquired in the data terminal of application operation by sampling instrument, After being uploaded to data analytics server, data analysis is carried out according to statistical demand, to generate the data sheet of corresponding service, is led to It crosses the data sheet and knows user demand, habit etc., business is adjusted, user demand is more met.
Embodiment two
Referring to Fig. 3, data acquisition and analysis system structural block diagram in accordance with another embodiment of the present invention is shown.
The acquisition control server 102 includes cloud control server 1022;The cloud control server 1022 is answered for foundation The acquisition parameter of the application is determined with type, wherein the acquisition parameter includes: dynamic parameter and/or static parameter;Foundation Terminal where the application and application configures acquisition configuration information, wherein the acquisition configuration information is for controlling the acquisition The acquisition and upload of parameter;Acquisition parameter and acquisition configuration information are handed down to the data terminal where application.
The cloud control server 1022 will upload condition for the upload condition and/or sampling condition of configuration parameter information And/or sampling condition is added in acquisition configuration information;Terminal where configuring the application corresponds to the acquisition threshold value of memory, by institute Acquisition threshold value is stated to be added in acquisition configuration information;The upload interval of terminal corresponding network type where configuring the application, will The upload interval is added in the acquisition configuration information;Terminal where configuring the application corresponds to cache threshold, will be described Cache threshold is added in acquisition configuration information;And configuration protocol upload sequence, sample rate in the acquisition configuration information With the priority of sampling parameter.
The data terminal 108, for being joined using sampling instrument according to the static state applied described in acquisition configuration information collection Several parameter informations;And dynamic parameter to be collected is determined according to acquisition configuration information using the sampling instrument, according to institute The operation for stating application acquires the parameter information of the dynamic parameter in real time.
The data terminal 108, for when detecting the changing interface of the application, the interface before record switching to be upper One page, the interface after record switching are current page, and the page up and current page are added in application interface starting information;When When detecting that the button of the application is triggered, the corresponding button number of the button is obtained, the button number is updated and corresponds to Number of clicks, by the button number and number of clicks be added in button click information;Acquire the relevant fortune of the application The row time is as duration information, wherein the duration information includes: interface runing time and using runing time.
Based on above-mentioned data acquisition and analysis system, can in data terminal using when operation to the acquisition of parameter information, It uploads analysis and generates corresponding report, the specific steps are as follows:
Referring to Fig. 4, the step flow chart of data acquisition analysis method in accordance with another embodiment of the present invention is shown.
Step 402, the acquisition control server determines the acquisition parameter of the application according to application type.
Substantially, for terminal where different application and application, Cloud Server can configure the acquisition ginseng of each application Several and acquisition configuration information, generates the control information of sampling instrument.Terminal is by calling sampling instrument corresponding where application When with carrying out data acquisition, terminal is to each application where Cloud Server can control application by the control information of sampling instrument Data acquisition.Wherein, the acquisition parameter includes: dynamic parameter and/or static parameter.The parameter information of the static parameter Include at least one of the following: terminal iidentification, version information, channel information, network type and resolution information;The dynamic parameter Parameter information include at least one of the following: application interface starting information, button click information, duration information, exception information and Session information.
Static parameter can be used for acquiring this using corresponding static parameter information, and the mark of terminal is believed such as where application Breath, version information, channel information, network type and resolution information etc..Wherein, the identification information of terminal can be used for identifying and answer With place terminal, such as M2 value can be calculated based on the hardware information of terminal, the M2 value can by sequence number, type number, edition This information etc. calculates, which, which can either identify different terminals again, will not reveal the hardware information of terminal, guarantee that user's is hidden Private safety;Version information can be used for recording this using corresponding version, such as the operating system version of terminal, software version or Software Development Kit version etc.;Channel information can be used for identifying the to acquisite approachs of the application;Network type is answered for determination The network type connected with place terminal;The display resolution of terminal, display point where resolution information is used to determine the application Resolution is properly termed as screen resolution again.
Dynamic parameter can be used for acquiring the parameter information that the application generates in the process of running, believe as application interface starts Breath, button click information, duration information, exception information and session information etc..Wherein, application interface starting information is answered for recording The page before switching when changing interface and the interface after switching;Button click information clicks the application for recording user In the corresponding button number of each button and the button number corresponding number of clicks;Duration information is according to starting time point and pass Time point determination is closed, runing time, interface runing time are such as applied;Exception information is used to record the information using being operating abnormally, Such as time point of application starting failure or number;Session information is used to record disappearing for the conversation class that the application generates at runtime Breath.
Step 404, acquisition configuration letter of the acquisition control server according to terminal configuration where the application and application Breath.
It comprises at least one of the following: matching according to the step of acquisition configuration information of the application and the terminal configuration of application place The upload condition and/or sampling condition for setting parameter information, are added to acquisition configuration information for upload condition and/or sampling condition In;Terminal where configuring the application corresponds to the acquisition threshold value of memory, and the acquisition threshold value is added in acquisition configuration information; Upload interval is added to the acquisition configuration and believed by the upload interval of terminal corresponding network type where configuring the application In breath;Terminal where configuring the application corresponds to cache threshold, and the cache threshold is added in acquisition configuration information;Institute State configuration protocol upload sequence, the priority of sample rate and sampling parameter in acquisition configuration information.
Step 406, acquisition parameter and acquisition configuration information are handed down to the number where application by the acquisition control server According to terminal.
Wherein, the acquisition configuration information is used to control the acquisition and upload of the acquisition parameter.
In the concrete realization, terminal where corresponding to and apply according to acquisition configuration information carries out data acquisition, and It needs according to uploading collected data in acquisition configuration information.Therefore, Cloud Server can according to application to be collected and Acquisition configuration information is arranged in terminal where the application, and each terminal applied or applied is believed according to the acquisition configuration Breath acquisition uploads acquisition parameter.
Wherein, the upload condition is used for according to the upload for uploading pass flag position control parameter information, the sampling bar Part is used for the acquisition according to test mark control parameter information.Cloud Server can be by being arranged sampling condition, and by sampling bar Part is added in acquisition configuration information, so that terminal where application carries out application according to the sampling condition in acquisition configuration information Data acquisition.Specifically, can determine whether the data of application meet sampling condition by detection.For example, when using with survey When test-object is known, whole parameter informations of the application meet sampling condition, and sampling instrument obtains the ginseng of each static parameter in the application The parameter information of number information and dynamic parameter.For example, developer during maintenance application, answers according to continuous renewals such as demands Version, some of versions be beta version, that is, Beta editions, after test passes through just can online formal version, for application Beta editions i.e. configurable test marks, so that more or even whole parameters are acquired, with test application operating condition.
After collecting parameter information, collected parameter information can also be buffered in local.Meet in parameter information When sampling the upload condition in configuration information, which is uploaded.For example, Cloud Server can be by being arranged each ginseng The priority or upload interval that number information uploads, are arranged the upload condition of each parameter information, and the upload condition is saved in In acquisition configuration information.It, can be by the ginseng using place terminal when reaching the upload interval time of parameter information at current time After number information is compressed, it is uploaded to Cloud Server, i.e., is uploaded the parameter information for meeting upload condition.Obviously, Cloud Server Upload condition can be set for different parameter informations, and be added in acquisition configuration information, and then the upload can be passed through Condition controls the upload of each parameter information.
Terminal where configuring the application corresponds to the acquisition threshold value of memory, and the acquisition threshold value is added to acquisition configuration letter In breath.Wherein, acquisition threshold value is used to determine the acquisition parameter of acquisition according to the memory information of terminal.In embodiments of the present invention, In view of different types of terminal configures difference, some terminal memories reach 2G compared with as large as memory, and some terminal memories are smaller, In order to reduce influence of the data acquisition to terminal, enable the terminal to operate normally application, Cloud Server can be according to using institute Threshold value is acquired in the memory setting of terminal, and the acquisition threshold value is added in acquisition configuration information, so as to according to terminal Memory information control acquisition acquisition parameter.Such as acquisition threshold value is configured to 50M, then when the memory of terminal is less than 50M, is The use for not influencing terminal can limit the acquisition of acquisition parameter, and if do not acquired dynamic parameter, only acquisition terminal is identified etc. quiet State parameter uploads primary.
It can when the memory information of terminal not up to acquires threshold value where application as a specific example of the invention Not acquire the corresponding parameter information of dynamic parameter for installing the application in the terminal, the corresponding parameter of static parameter can be acquired Information, as acquisition terminal identifies;When the memory information of terminal reaches acquisition threshold value, then according in acquisition configuration information collection application The parameter information of each acquisition parameter, such as the parameter information of the parameter information of static parameter and dynamic parameter in acquisition applications.
Upload interval is added to described adopt by the upload interval of terminal corresponding network type where configuring the application Collect in configuration information.Wherein, the interval that timing uploads, such as 5 minutes, 10 minutes are divided between the upload.Substantially, by not The transmission rate of the transmitted data on network of same type, data is different.Therefore, it can be transmitted according to the corresponding data of network type Rate, the upload interval of terminal corresponding network type where setting application, and the upload interval of different network type is added to In acquisition configuration information.
In embodiments of the present invention, which can be selected according to the network type of terminal connection where application The upload interval answered, so that each application can upload the parameter letter of acquisition parameter according to the message transmission rate of current connection network Breath, so as to take full advantage of Internet resources, and guarantees the uploading rate of parameter information.In the present embodiment, interval is uploaded It can be determined according to the priority of network type and acquisition parameter itself.
Terminal where configuring the application corresponds to cache threshold, and the cache threshold is added in acquisition configuration information. Wherein, cache threshold is for determining the data volume in the parameter information of the caching of terminal.Specifically, the performance of different terminals Difference, therefore the data volume of its parameter information that can be cached is different.It, can according to the data volume that terminal where application can cache The corresponding cache threshold of the terminal is arranged, and the cache threshold is added in acquisition configuration information.When the local of terminal is slow When the parameter information deposited is more than cache threshold, Cloud Server can control the preceding parameter information of terminal deletion cache-time, directly Parameter information to caching is no more than the cache threshold, ensure that the efficiency of data acquisition.Such as setting cache threshold is 2M, Judge that local cache more than 2M, then can be opened according to the tandem of time from front when acquisition parameter information will store Begin to delete parameter information, until being also no more than 2M until storing the acquisition parameter.
Configuration protocol upload sequence, the priority of sample rate and sampling parameter in the acquisition configuration information.Wherein, institute The uploading protocol that agreement upload sequence is used to determine acquisition parameter is stated, the sample rate is described excellent for determining the terminal of sampling First grade is used to determine the times of collection of parameter information and uploads interval.In the concrete realization, Cloud Server can adopt network The network transmission protocol is counted, and determines the priority of each network transmission protocol, generates agreement upload sequence.For example, association View upload sequence can be such that 1, transmission control protocol (Transmission Control Protocol, TCP);2, it wirelessly answers With agreement (Wireless Application Protocol, WAP);3, User Datagram Protocol (User Datagram Protocol,UDP);4, real-time transport protocol (Real-time Transport Protocol, RTP);5, Hyper text transfer is assisted It discusses (HTTP, HyperText Transfer Protocol).Wherein, the corresponding serial number of the network transmission protocol can represent The priority of the network transmission protocol, the smaller priority for representing the network transmission protocol of serial number is higher, and such as 1 represents The highest priority of Transmission Control Protocol.The sequence that agreement uploads is added in acquisition configuration information, so that it may in control parameter information Used network transmission protocol when biography, the agreement upload sequence of such as above-mentioned example, parameter information preferably use highest priority Transmission Control Protocol upload, when that Transmission Control Protocol cannot be used to upload using wap protocol upload, i.e., according to the sequential selection of priority Uploading protocol, avoid due to terminal, using do not support using a certain network transmission protocol and cause parameter information upload failure Problem guarantees the upper transfer efficiency of parameter information and uploads quality.
When terminal is more, Cloud Server can be counted terminal where application, determine sample rate.Pass through Sample rate can determine terminal quantity to be sampled, and application place can be randomly selected according to identified terminal quantity Terminal using the terminal of selection as target terminal, and is determined as the terminal of sampling.As a specific example of the invention, It can be calculated by terminal iidentification of the preset algorithm to each terminal, choose target terminal, such as most by terminal iidentification Latter position or two numbers, determine target terminal.Certainly, Cloud Server can also determine the end of sampling by other means End, such as the terminal by carrying out modulus or the determining sampling of remainder operation to terminal iidentification, the embodiment of the present invention do not make this Limitation.By the way that sample rate to be added in sampling configuration information, Cloud Server can control the terminal quantity of sampling, avoid sampling A large amount of terminal and the problem for causing cloud server data processing pressure big, guarantee the sampling efficiency of data, and then accelerate number According to the progress of acquisition.
Cloud Server can also control the acquisition of the parameter information of acquisition parameter by the priority of each acquisition parameter of setting Number and upload interval.For example, referring to table 1, the terminal where application or application determines the priority of acquisition parameter, so that it may according to The information of the acquisition parameter is acquired according to identified priority corresponding times of collection, and corresponding according to the priority The parameter information that interval uploads the acquisition parameter is uploaded, if the priority of acquisition parameter I is A grades, then the parameter of acquisition parameter I The times of collection of information is 1000 times, and is divided into 20 minutes between uploading, i.e., every 20 minutes, just uploads primary acquisition parameter I Parameter information.
The priority of acquisition parameter The times of collection of parameter information The upload interval of parameter information
A grades 1000 times 20 minutes
B grades 700 times 1 hour
C grades 300 times 3 hours
D grades 10 times 12 hours
F grades 1 time 24 hours
Table 1
In embodiments of the present invention, acquisition parameter can be preset according to business demand or the characteristic of acquisition data Priority and the corresponding parameter information times of collection of each priority and upload interval, allow Cloud Server pass through by The priority of acquisition parameter is added in acquisition configuration information, and terminal is according to the excellent of sampling parameter where control application or application Grade is selected to be acquired and upload parameter information.By the priority of acquisition parameter, each application acquisition can be collected in time The parameter information of parameter, and can also in time upload collected parameter information.
Step 408, the parameter using the sampling instrument according to the static parameter applied described in acquisition configuration information collection Information.
Step 410, dynamic parameter to be collected is determined according to acquisition configuration information using the sampling instrument, according to described in The operation of application acquires the parameter information of the dynamic parameter in real time.
According to the acquisition configuration information that the acquisition control server issues, can in application operation to acquisition parameter into Row acquisition, comprising: according to the priority of each acquisition parameter in the configuration information, determine the parameter information of the acquisition parameter Times of collection and upload interval.The memory information of mobile terminal, judges whether the memory information reaches where obtaining the application To acquisition threshold value;When the memory information not up to acquires threshold value, the acquisition parameter for acquiring the static parameter is uploaded to institute Server is stated, to terminate acquisition step;When the memory information reaches acquisition threshold value, adopted using run time call sampling instrument Collect the parameter information of each acquisition parameter in the application, wherein the acquisition parameter includes static parameter and/or dynamic parameter.
In embodiments of the present invention, it is contemplated that different types of terminal configuration is different, some terminal memories are compared with as large as memory Reach 2G, and some terminal memories are smaller, in order to reduce influence of the data acquisition to terminal, enable the terminal to operate normally and answer With Cloud Server can acquire threshold value according to the memory setting of terminal where application, and the acquisition threshold value is added to acquisition and is matched In confidence breath, so as to the acquisition parameter according to the control acquisition of the memory information of terminal.The memory letter of terminal where application Breath not up to acquisition threshold value when, the corresponding parameter information of dynamic parameter for installing the application in the terminal can not be acquired, can be with The corresponding parameter information of static parameter is acquired, as acquisition terminal identifies;Such as acquisition threshold value is configured to 50M, then when in terminal When depositing less than 50M, in order to not influence only being adopted using the acquisition that can limit acquisition parameter if do not acquired dynamic parameter for terminal Collect the static parameters such as terminal iidentification to upload once.
The step of operation according to the application acquires the parameter information of the dynamic parameter in real time includes following at least one Kind:
When detecting the changing interface of the application, the interface before record switching is page up, the boundary after record switching Face is current page, and the page up and current page are added in application interface starting information.I.e. to user in application interface When middle access records, in order to guarantee the continuous of access, upper access interface can be recorded while recording current interface, thus Each interface record is current page+page up, if homepage certainly, then page up is sky.
When the button for detecting the application is triggered, the corresponding button number of the button is obtained, is pressed described in update Button numbers corresponding number of clicks, and button number and number of clicks are added in button click information.It can be in Including many buttons, it can be numbered to each button to identify different buttons, be pressed to be recorded when button is clicked Button number and number of clicks, i.e. number of clicks are initially 0, and every click is primary to add one.
Using that can be run by multi-process mode, using starting using host process record starting when usual multi-process is run Time point still, is likely to occur host process when the application starting time is too short using the last one process record end time point Then using the problem of being turned off, the runing time recorded at this time may be not negative value, or be started using last time for starting completely Starting time point and this end time point closed calculate duration, then the case where will appear duration overlength, duration is caused to be remembered Record inaccuracy.
To solve the problems, such as above-mentioned inaccuracy, the relevant runing time of the application is acquired as duration information, wherein institute Stating duration information includes: interface runing time and using runing time.Wherein, the relevant runing time of the acquisition application It include: host process record starting time point and the end time point of the application as duration information, according to the starting time Point and end time point record runing time, using the runing time as duration information.I.e. the present embodiment is transported for multi-process Capable application, the record of start and end time are recorded from using host process, i.e., are remembered when application starts using host process Record starting time point is using host process record end time point, to calculate end time point and starting time using closing The difference of point is runing time, it is ensured that accurate recording operation duration.
In addition, the parameter information of acquisition can be buffered in order to save the resources such as customer flow in the embodiment of the present invention It is local, can be with allocating cache threshold value in order to reduce the application to data terminal, the cache threshold is for determining the caching in terminal Parameter information data volume.Specifically, the performance of different terminals is different, therefore the number of its parameter information that can be cached It is different according to amount.According to the data volume that terminal where application can cache, the corresponding cache threshold of the terminal can be set, and should Cache threshold is added in acquisition configuration information.When the parameter information of the local cache of terminal is more than cache threshold, cloud service Device can control the preceding parameter information of terminal deletion cache-time, until the parameter information of caching is no more than the caching threshold Value ensure that the efficiency of data acquisition.Such as setting cache threshold is 2M, is judged when acquisition parameter information will store local slow It deposits more than 2M, then parameter information can be deleted since front, until storing the acquisition parameter according to the tandem of time Also until being no more than 2M.
Step 412, the parameter information of acquisition is uploaded to the acquisition control server by the data terminal.
It when carrying out the upload of parameter information, may first determine whether to reach upload interval, wherein uploading interval processing Except being determined according to parameter priority, it can also be determined according to current network type and upload interval, whether judge current time Meet and uploads interval.
In order to improve the success rate of upload, upload threshold value can also be configured, i.e., uploads the threshold value of data volume every time, detection is worked as Whether the parameter information of preceding caching is greater than upload threshold value.It, will when parameter information meets the upload condition in sampling configuration information The parameter information is uploaded.For example, Cloud Server can be by being arranged between the priority or upload that each parameter information uploads Every the upload condition of each parameter information being arranged, and the upload condition is saved in acquisition configuration information.Reach at current time When the upload interval time of parameter information, detect whether the parameter information is more than upload threshold value.
The embodiment of the present invention to server upload parameter information be to be uploaded by data packet.If the number that a data packet includes It is excessive according to measuring, it be easy to cause upload to fail.The embodiment of the present invention uploads the big of data packet by uploading threshold value, to limit every time It is small.When the parameter information for needing to upload is more than to upload threshold value, the measure of subpackage is just taken, i.e., is divided into the parameter information At least two data packets.Subpackage upload, can to avoid data volume it is excessive caused by upload failure.Such as uploading threshold value is 100k When, when needing the parameter information that uploads to be greater than 100k, parameter information can be divided at least two data packets, such as need The parameter information of biography is 250k, then is segmented into three data packets 100k, 100k and 50k.
Then, the parameter information is subjected to compressed encoding according to Predistribution Algorithm, generates supplemental characteristic packet., according to preset Agreement uploads sequential selection uploading protocol, according to the uploading protocol to server upload parameter information.
In addition, when parameter information is uploaded to server, it is possible that uploading failure.It may need not upload at this time Parameter information continues to upload, and for the ease of the upload situation of differentiation parameter information, can upload successfully according to result configuration is uploaded Marker bit.Upload result is identified by uploading pass flag position.Wherein, match if the parameter information of the caching uploads failure Set upload pass flag position for failure, configured if the parameter information of the caching uploads successfully upload pass flag position at Function.
When mobile terminal where the application unlocks, detected to pass flag position is uploaded.If described upload successfully Labeled as failure, current network type is obtained, judges whether the network type allows to upload data.It is uploaded successfully in determination When labeled as failure, illustrate that parameter information does not upload success, then whether available current network type, judge network type Allow to upload data and is judged as 2G, 3G, 4G or WIFI etc. in the case where having connected if whether network connects.If so, i.e. described When network type allows to upload data, the parameter information not uploaded is uploaded to the server.If it is not, i.e. network type is not permitted Perhaps data are uploaded, detection uploads again after unlock next time.
It is right when the application is run, mobile terminal is unlocked as where in the application next time when in order to save resource It uploads pass flag position to be detected, judges the upload situation of parameter information.If the upload pass flag is failure, acquisition is worked as Preceding network type, judges whether the network type allows to upload data, when the network type allows to upload data, holds The step of parameter information for being about to not upload is uploaded to the server.
Step 414, the data analytics server corresponds to parameter information to each acquisition parameter of upload and analyzes, and obtains Data analysis result.
Step 416, the data analysis result is sent to the report generation server by the data analytics server.
Step 418, the report generation server generates data sheet according to the data analysis result.
Data analytics server corresponds to parameter information to each acquisition parameter of upload and analyzes, such as to each acquisition parameter pair The parameter information answered is counted, to obtain data analysis result, then the data analysis result is sent to the report Server is generated, the report generation server is that the data analysis result of each logic configures according to the data analysis result Readable attribute information generates data sheet, so as to determine the service condition of application based on the data sheet.
By applying run time call sampling instrument;Sampling instrument acquires the parameter letter of each acquisition parameter in the application Breath;It is determined according to current network type and uploads interval, judge whether current time meets upload interval;Reach at current time When the upload is spaced, the parameter information is subjected to compressed encoding according to Predistribution Algorithm, generates supplemental characteristic packet;By the ginseng Number data packet is uploaded to server, so that the server carries out data analysis according to the parameter information.It is each to reduce The workload of the developer of service platform, so reduce employment cost, can be used in various applications, scalability compared with It is good.
In the present embodiment, the report generation server 106, for the corresponding customized event of application according to configuration from Management information is defined, business statistics information is obtained;It is generated according to the customized management information and business statistics information customized Event report.
When being counted to event, general purpose event can only often be counted, general purpose event can only be to shared feature It is counted, and some distinctive features is counted using general purpose event, statistics effect is unobvious.And the present embodiment In, to make report can adapt to the demand of various businesses, each application in terminal carries out certainly the business in requisition for statistics Definition generates customized event, and corresponds to customized event according to each application and configure customized management information.
The report generation server 106, be also used to obtain the application from the service management page applies road Diameter and the application correspond to the customized event information of customized event, wherein the customized event information includes: thing Part title and event attribute;Customized management information is generated using the application path and customized event information.
The report generation server 106 is applied for determining according to the application path;For each customized thing Part obtains the corresponding logical name of the event title and the corresponding logical attribute of the event attribute;Search the logic Title corresponds to acquisition parameter, determines the corresponding business statistics information of the acquisition parameter according to the logical attribute;And it determines The corresponding event title of each acquisition parameter generates application using the business statistics information of each event title and corresponding acquisition parameter Customized event report.
The report generation server generates data sheet according to the data analysis result, comprising: the report generation Customized management information of the server according to the corresponding customized event of application of configuration, obtains business statistics information;According to described in Customized management information and business statistics information generate customized event report.It further include the step for configuring customized management information Rapid: the application path and the application that the application is obtained from the service management page correspond to oneself of customized event Define event information, wherein the customized event information includes: event title and event attribute;Path is applied using described Customized management information is generated with customized event information.The customized management letter of the corresponding customized event of application according to configuration Breath obtains business statistics information;Customized event report, packet are generated according to the customized management information and business statistics information It includes: determining and apply according to the application path;For each customized event, the corresponding logical name of the event title is obtained Title and the corresponding logical attribute of the event attribute;It searches the logical name and corresponds to acquisition parameter, according to the logic category Property determines the corresponding business statistics information of the acquisition parameter;The corresponding event title of each acquisition parameter is determined, using each event The business statistics information of title and corresponding acquisition parameter generates the customized event report of application.
It is specific as follows to generate the step of report for statistics after the above-mentioned configuration and acquisition for making event by oneself:
Referring to Fig. 5, the step flow chart of customized event processing method in accordance with another embodiment of the present invention is shown.
Step 502, according to configuring request feedback traffic administration page.
Step 504, obtain the path of applying of application from business administration page, and the corresponding customized event of application from Define event information.
Step 506, customized management information is generated using application path and customized event information.
It is customized to some peculiar events progress applied in mobile terminal, so as to be realized by customized event to application In some peculiar data counted.
Be first depending on configuring request, will using corresponding customized event carry out processing feedback traffic administration page, and from This is obtained in the service management page using corresponding using path, its which industry belonged to such as determined according to every customized event It is engaged in, then according to the business information determined, determines the corresponding application of the business, according to this, determine that application is corresponding using path, and Obtain the customized event information of the corresponding customized event of application, wherein customized event information includes: event title and event Attribute, customized event comprise at least one of the following: traffic statistics event, chooses event at click event.Event attribute includes: The statistical of customized event.Application path, the event title of customized event and event attribute are generated into customized management Information.
Flow Expenditure Levels in certain time period are such as now counted, traffic statistics event is set as customized event;And it searches Which all applications have in consumed flow in this time;It obtains the corresponding of application and applies path, now find this time Interior only mobile phone assistant and browser are in consumed flow, by mobile phone assistant and browser within this time the case where consumed flow As customized management information.
Step 508, application is determined according to using path.
Step 510, for application, the event title and the corresponding business statistics letter of event attribute of each customized event are obtained Breath.
Application is determined according to the application path in the service management page, is obtained and is corresponded to from the determining application using behind path The event title and the corresponding business statistics information of event attribute of every customized event.
The acquisition parameter and acquisition configuration information that each application can be configured before carrying out business statistics, thus to acquisition Parameter is acquired and uploads.
The acquisition parameter and acquisition configuration information of each application can be configured in initial configuration, Cloud Server can will be adopted Collection parameter and acquisition configuration information are issued to terminal where application.Terminal carries out each application by sampling instrument where application When data acquire, sampling instrument such as calls SDK (Software Development Kit, Software Development Kit) can be right Each application carries out data acquisition, the i.e. parameter information according to each acquisition parameter in acquisition configuration information collection application, wherein acquiring Parameter includes static parameter and dynamic parameter.
After receiving each parameter information of upload, business statistics can be carried out.
Wherein, business statistics information, including following sub-step are obtained according to the customized management information: be directed to each certainly Definition event obtains the corresponding logical name of event title and the corresponding logical attribute of event attribute.Search logical name pair Acquisition parameter is answered, determines the corresponding business statistics information of acquisition parameter according to logical attribute.
Server carries out data processing and data statistics according to customized management information, in every customized event, all There are corresponding event title and corresponding logical name, such as certain button trigger event in the page, first to pressing in the page Button is successively numbered, then button trigger event is defined as button event, such as the entitled button 1 of event, corresponding logical name Referred to as button.Every customized event is all corresponding with logical attribute, is carried out by the way of statistics to every customized event Statistics, it is primary in its triggering if certain page button trigger event is defined as button event 1, it adds up to it, takes it final Value.According to every customized event, obtains the corresponding logical name of every customized event title and event attribute is corresponding Logical attribute, so-called logical name and logical attribute it is practical be customized event in bottom code a kind of form of expression, after Platform server counts data with logical name and logical attribute.
The corresponding business of each application, each business are corresponding with multiple customized events, according to patrolling for every event It collects title and searches the corresponding acquisition parameter of the customized event, according to logical attribute, acquisition parameter is statistically carried out Business statistics obtains the corresponding business statistics information of this customized event;According to this, determine that every customized event is corresponding Business statistics information.Such as, certain page includes three sections of texts, now needs wherein every section of statistics, the number for being selected and being replicated;By its Be defined as a business, re-define three kinds of customized events, as first segment is selected and is replicated event is defined as choosing 1, Second segment is selected and the event that is replicated is defined as choosing 2, third section selected and the event being replicated is defined as choosing 3; The logical name that customized event is chosen is check;Acquisition parameter includes the execution number that customized event is chosen, i.e. every section of text Word is selected and the number of duplication.
For another example in certain period, first segment text is selected and the number of duplication is 0, and second segment text is selected and replicates Number be 1, third section text is selected and the number of duplication is 6.The 1, logical name is chosen to be correspondingly, event is entitled The corresponding business statistics information of check1, acquisition parameter is 0;Event is entitled to choose 2, logical name check2, acquisition ginseng The corresponding business statistics information of number is 1;Event is entitled to choose the corresponding business system of 3, logical name check3, acquisition parameter Counting information is 6.
Corresponding logical name is determined according to event title, determines consistent corresponding logic category according to event attribute Property;Again according to logical name and logical attribute, corresponding acquisition parameter and business statistics information are determined;It can clearly determine every The corresponding business statistics information of customized event.
Step 512, the corresponding event title of each acquisition parameter is determined, using the industry of each event title and corresponding acquisition parameter Statistical information of being engaged in generates the customized event report of application.
Data analytics server receives parameter information, and determines that each application corresponds to customized event according to parameter information The corresponding business statistics information of event title, logical name, acquisition parameter;And by the event title of customized event, logical name Claim, the corresponding business statistics information of acquisition parameter is sent to report generation server;Report generation server is according to each business It determines the corresponding a plurality of customized event of the business, then according to this definition event, determines the corresponding event of the customized event The corresponding business statistics information of title, logical name, acquisition parameter;According to the corresponding event title of every customized event and adopt Collect the customized event report that the corresponding business statistics information of parameter generates application, wherein business statistics information, that is, acquisition parameter pair The data of the acquisition data answered, acquisition are counted in a manner of cumulative.
Step 514, the corresponding business statistics information of general purpose event information is obtained, general purpose event is corresponded into business statistics information It is added in customized event report.
A kind of alternative embodiment of the invention, only need to be according to the corresponding event name acquiring of general purpose event for general purpose event Its corresponding business statistics information, by the corresponding business statistics information of the event title and general purpose event of general purpose event, addition Into customized event report.
The embodiment of the present invention from business administration interface by obtaining the customized using path, and application correspondence of application The customized event information of event;Application is determined according to using path, for application, obtains the event title of each customized event Business statistics information corresponding with event attribute generates customized event report according to business statistics information, and each application is corresponding One business, a business include a plurality of customized event, and according to the corresponding business statistics of every customized event, generation is made by oneself Adopted event report;The corresponding business statistics number of every customized event can be intuitively represented in customized event report According to such statistical is more representative, can more count some peculiar events, enhance statistics effect;The present invention General purpose event can also be added in customized event report by embodiment, realize the combination of general purpose event and customized event Statistics, allows user to obtain the statistical information of required various events from a bordereau, meets various user's need It asks.
Wherein, the acquisition control server is also used to configure the test information that the target application corresponds to test equipment; The data analytics server is also used to analyze the corresponding parameter information uploaded of the target application;Judge the ginseng When number information belongs to test equipment, the parameter information for belonging to test equipment is analyzed in real time;The report generation server, When being also used to judge that the parameter information belongs to test equipment, data sheet is generated in real time according to data analysis result.
Wherein, the acquisition control server 102, comprising: exploitation configuration server 1024;The exploitation configuration service Device, for after target application completes registration, the test for configuring at least one test equipment to the target application to be identified;For institute It states target application and configures acquisition parameter to be tested, using test mark and acquisition parameter as test information;The data Analysis server is also used to obtain the parameter information that target application corresponds to acquisition parameter from the parameter information of upload;Pass through institute Terminal parameter counterpart terminal in parameter information is stated to identify;Judge that the terminal iidentification identifies whether phase with test in test equipment table Together, when the terminal iidentification is identical as test mark any in test equipment table, judge that parameter information belongs to test equipment.
The method further include: the acquisition control server configures the test that the target application corresponds to test equipment Information;The data analytics server analyzes the corresponding parameter information uploaded of the target application;Judge the parameter When information belongs to test equipment, the parameter information for belonging to test equipment is analyzed in real time;The report generation server is sentenced When the parameter information that breaks belongs to test equipment, data sheet is generated in real time according to data analysis result.The target is configured to answer With the test information of corresponding test equipment, comprising: after target application completes registration, configure at least one to the target application The test of test equipment identifies;Acquisition parameter to be tested is configured for the target application, and the test is identified and acquired and is joined Number is as test information;The method further include: the data analytics server obtains target from the parameter information of upload Using the parameter information of corresponding acquisition parameter;It is identified by terminal parameter counterpart terminal in the parameter information;Judge the end Mark is held to identify whether with test in test equipment table identical, when test any in the terminal iidentification and test equipment table identifies When identical, judge that parameter information belongs to test equipment.
Developing, the step of configuration server 1024 configures target application and tested is specific as follows:
Referring to Fig. 6, the step flow chart of the test method of target application in accordance with another embodiment of the present invention is shown.
Step 602, the registration request of target application is received.
It step 604, is that target application distributes application identities according to registration request.
For the development and maintenance of application, corresponding acquisition parameter can be acquired in application operational process to determine application Operating condition, the present embodiment respectively application use general sampling instrument, therefore can in advance test application call sampling instrument Carry out parameter acquisition it is whether normal, can need to application to be tested as target application.The test of target application usually requires Test result is known in real time, therefore can configure test equipment for target application, and the collection result of test equipment is carried out in real time Analysis.Target application is registered first, registration request can be issued, the correlation of target application is carried in the registration request Information, obtaining in server according to registration request is that target application distributes application identities, to pass through application identities unique identification A application program.After target application completes registration, SDK needed for sampling instrument acquires data can be sent and answered to target With enabling target application that the sampling instrument is called to be acquired at runtime.
Step 606, to target application, the test mark of at least one test equipment is configured.
Step 608, acquisition parameter to be tested is configured for target application, believed using test mark and acquisition parameter as test Breath.
After target application completes registration, the terminal iidentification such as M2 value that can upload test equipment gives exploitation configuration server, Exploitation configuration server identifies the test that terminal iidentification is configured to test equipment, so as to target application configuration at least one The test of a test equipment identifies.Target application acquisition parameter to be tested can also be configured, that is, is needed when determining test from mesh The acquisition parameter acquired in mark application, to obtain the parameter information of corresponding acquisition parameter.Test mark and acquisition parameter are made To test information.To which target application can call sampling instrument to be acquired, i.e., target application is to add the survey of sampling instrument Examination application.
Cloud Server generates acquisition configuration information according to acquisition parameter and corresponding acquisition strategies, by acquisition configuration information It is handed down to each data terminal, allows each corresponding application according to acquisition configuration information to the corresponding parameter information of acquisition parameter It is reported, i.e., Cloud Server can acquire each acquisition by the terminal where acquisition parameter and the control application of acquisition configuration information The corresponding parameter information of parameter is automatically performed the data acquisition of application.Terminal device calls acquisition work according to acquisition configuration information Tool such as calls SDK to carry out the acquisition of parameter to target application, and by acquisition to parameter information be uploaded to data analysis service Device.
Step 610, the parameter information that target application corresponds to acquisition parameter is obtained from the parameter information of upload.
Step 612, the source of parameter information is analyzed, judges whether parameter information belongs to test equipment.
Data analytics server obtains the parameter information that target application corresponds to acquisition parameter from the parameter information of upload, so Terminal parameter counterpart terminal mark is searched from parameter information afterwards, will be surveyed in the terminal iidentification and preconfigured test equipment table Test-object knowledge is compared, and it is identical to judge that the terminal iidentification is identified whether with test in test equipment table, when the terminal iidentification When identical as test mark any in test equipment table, judge that parameter information belongs to test equipment, i.e., the parameter information is from survey It is collected in examination equipment.
According to the present invention in an alternative embodiment, judges whether parameter information belongs to test equipment, can specifically include: It is identified by terminal parameter counterpart terminal in parameter information, determines the source of parameter information;Judge terminal iidentification and test equipment Test identifies whether identical in table;When terminal iidentification is identical as test mark any in test equipment table, parameter information is judged Belong to test equipment.In the present embodiment, the test mark of each test equipment can be saved in the server, generates corresponding test Equipment list, convenient for determining test equipment when subsequent analysis.Terminal parameter counterpart terminal mark, the terminal are searched from parameter information Mark can be to collect from which terminal with the source of identification parameter information.
Terminal iidentification is compared with the test mark in test equipment table, is judged in terminal iidentification and test equipment table Test identifies whether identical, that is, judges whether parameter current information belongs to test equipment.If so, i.e. terminal iidentification and test equipment Any test mark is identical in table, then judges that parameter information belongs to test equipment, i.e., the parameter information is adopted from test equipment What collection obtained.Conversely, the parameter information is not from test if terminal iidentification is all different with test mark in test equipment table It is collected in equipment, i.e., parameter information is not belonging to test equipment, can carry out statistics generation according to general process flow Report, and errorless real-time statistics.
The parameter information of upload is determined by terminal iidentification whether come self-testing device, if so, i.e. parameter information belongs to Test equipment executes step 614;If it is not, i.e. parameter information is not belonging to test equipment, terminate the process, is not necessarily to real-time statistics.
Step 614, for the parameters information for belonging to test equipment, respectively according to statistical to relevant parameter information It is counted.
Step 616, statistical result is corresponded to according to each parameter information generate testing journal sheet.
After determining that parameter information belongs to test equipment, the parameters information of test equipment is handled, wherein pressing Corresponding parameter information is counted according to the mode of statistics.As some button of certain page trigger number, to the institute of the page There is button to be numbered, i.e., each button has oneself corresponding number, and button triggering is primary, carries out to the number of button triggering Superposition, the button if number is 1 trigger 3 times, i.e., the data of corresponding statistics include that button 1 triggers 3 times.For another example the page is cut It changes, it is first determined current page information, then search upwards, determine the page info of previous page, if current page is homepage, Previous page is recorded as sky, then searches the page info of next page, is successively counted.
According to the corresponding statistical information of each parameter, the corresponding one or more acquisition parameters of each target application are determined;And It determines the corresponding statistical data of each parameter, parameters and the corresponding statistical data of parameter is generated and surveyed according to the classification of application Try report.
Step 618 analyzes operation result of the sampling instrument in target application according to testing journal sheet.
It is added with sampling instrument in target application, test information is adopted to be applied by sampling instrument auxiliary mark Collection.After acquisition, uploading simultaneously real-time statistics generation testing journal sheet, sampling instrument can also be analyzed according to testing journal sheet and answered in target Operation result in.Operation result includes at least one of the following: that data acquisition results, data upload result, report generation knot Fruit and apply operation result.
Data acquisition results are the acquisition situation for passing through sampling instrument in testing journal sheet's analysis and test device to parameter, in this way It is no being capable of normal acquisition.It is to pass through the parameter information upload of sampling instrument in testing journal sheet's analysis and test device that data, which upload result, Whether situation such as uploads normal.Report generation result passes through sampling instrument upload parameter in testing journal sheet's analysis and test device After information, report generation situation can normal statistical parameters information generation report.Pass through testing journal sheet using operation result The operating condition of target application when analysis and test device is acquired by sampling instrument, is uploaded, as target application operation whether Normally, if Caton occur, dodge the problems such as moving back, collapsing.
The embodiment of the present invention is by installation targets application in a test device, then is Target Assignment application identities, for test Device configuration test mark, by the acquisition parameter of target application and test mark as test information upload server, server The data information uploaded by parsing multiple equipment determines test equipment belonging to test information according to test mark, to parameter Information is counted with statistical, is generated testing journal sheet according to statistical result, can clearly be reacted and be worked as by testing journal sheet Operating condition of the preceding target application in test equipment;The test application auxiliary ginseng of sampling instrument can also be installed in target application The acquisition of number information analyzes operating condition of the sampling instrument in target application using testing journal sheet.
The data analytics server 104 is also used to the lookup checking parameter from the parameter information and corresponds to check information; The check information analyze and determines abduction check results.
The data analytics server 104 is searched from the parameter information for determining the parameter identification of checking parameter The parameter identification corresponds to check information;Detect whether the check information is target information;If the check information is not mesh Information is marked, determines that flow exists and kidnaps exception, record is kidnapped abnormal in the abduction check results;If the check information is Target information determines that data transmission is normal, and record transmission is normal in the abduction check results.
The method further include: data analytics server searches the corresponding verification letter of checking parameter from the parameter information Breath;The check information analyze and determines abduction check results.Checking parameter is searched from the parameter information corresponds to school Test information;The check information analyze and determines abduction check results, comprising: the parameter identification for determining checking parameter, from The parameter identification is searched in the parameter information corresponds to check information;Detect whether the check information is target information;If The check information is not target information, determines that flow exists and kidnaps exception, record is kidnapped different in the abduction check results Often;If the check information is target information, determine that data transmission is normal, record transmits just in the abduction check results Often.
When statistics is completed in parameter information acquisition, transmission and statistical result can also be examined, wherein for the verification of transmission Step is specific as follows:
Referring to Fig. 7, the step flow chart of transfer check method in accordance with another embodiment of the present invention is shown.
Step 702, the parameter information of upload is received.
Wherein, it is collected when the parameter information application operation for each acquisition parameter.In data collection and analysis In system, data of the acquisition control server based on acquisition required for each service platform determine application to be collected.It is answered in determination With rear, Cloud Server can determine static parameter, the dynamic parameter of application to be collected, and setting acquisition according to application type Configuration information, allow it is each apply or the terminal of application according to the acquisition configuration information collection, upload and collected respectively adopt Collection parameter corresponds to parameter information.
Optionally, the parameter information of upload may include: the parameter information that transfer returns to destination address after kidnapping, Yi Jizhi Connect the parameter information for passing destination address.Wherein, destination address belongs to address list.It substantially, can be in data analysis service Device presets address list.The address list contains each IP address for uploading to data analytics server, is equivalent to target Address;And the corresponding address information of each IP address, it is equivalent to target address information.When parameter information needs to upload to a certain mesh Address is marked, it can be by destination address address as a purpose.
In the concrete realization, by determining the IP address uploaded, parameter information can upload to number from terminal where application According to Analysis server.Therefore, can in parameter information biography recorded thereon IP address, generate the parameter letter for uploading destination address Breath such as records the last IP address that uploads and generates LastIP information.Wherein, it may include straight for uploading the parameter information of destination address Connect pass destination address parameter information and abduction after transfer return destination address parameter information etc..
Step 704, the parameter identification for determining checking parameter searches the parameter identification from the parameter information and corresponds to school Test information.
In embodiments of the present invention, Data analysis server can determine the school for needing to verify according to verification demand Test parameter.By the parameter identification for determining checking parameter, so that it may be searched according to identified parameter identification.If from parameter The corresponding check information of parameter identification determined by being found in information, so that it may the check information found is extracted, with Just whether detection parameters information is intercepted in transmission process.As a specific example of the invention, it is assumed that parameter information from Terminal A is uploaded in data analytics server B, and Analysis server B is after determining the identifier of IP address, according to the IP address Identifier can extract the corresponding LastIP information of identifier of IP address, the LastIP information from the parameter information of upload Contain each IP address that parameter information is uploaded from terminal A to Analysis server B, such as LastIP1, LastIP2, LastIP3.
Step 706, detect whether the check information is target information.
If the check information is not target information, 708 are thened follow the steps;If the check information is target information, Execute step 710.
Optionally, data analytics server can pass through the target address information in detection IP address information and address list Matching, judges whether parameter information was intercepted.In a preferred embodiment of the invention, above-mentioned steps 706 can be inspection The IP address information is surveyed to match with the target address information in address list.Specifically, if extracted from parameter information The corresponding IP address of IP address information not in preset address list, i.e., address list with cannot finding extracted IP When the corresponding destination address of location information, do not determine target address information in extracted IP address information and address list not Match, then can determine that parameter information was intercepted, executes step 708.If the extracted IP address information pair from parameter information The IP address answered in preset list, i.e., address list with can finding the corresponding IP of extracted IP address information Location, determines that extracted IP address information is matched with the target address information in address list, then can determine that parameter information does not have It was intercepted, and executed step 710.In conjunction with above-mentioned example, if can be found in preset address list LastIP1, LastIP2 and LastIP3 can then determine that parameter information is not intercepted, and execute step 710;If cannot be in address list In find LastIP1, it can be determined that go out parameter information and intercepted by illegal terminal or rogue program, and interception parameter information is non- Method terminal or the corresponding IP address of rogue program are LastIP1, then follow the steps 708.
Step 708, it determines that flow exists and kidnaps exception, record is kidnapped abnormal in the abduction check results.
Specifically, data analytics server determines that parameter information was intercepted, so that it may determine parameter information upload procedure In there are flows to kidnap phenomenon, and the parameter information this time received is possible to intercepted terminal or rogue program and distorts, It can determine that the parameter information uploads corresponding flow and there is abduction exception, parameter letter is recorded in kidnapping check results The abduction of breath is abnormal, and recording parameters information intercepts or record LastIP1 by the terminal of LastIP1 such as in kidnapping check results For illegal IP address, malicious IP addresses etc., generate data analysis result, so as to avoid using intercepted parameter information into Row statistics, guarantees the accuracy of data analysis result.
Step 710, determine that data transmission is normal, record transmission is normal in the abduction check results.
When parameter information did not intercept, so that it may determine that data transmission is normal, kidnap in check results and record the parameter Information transmission is normal, ensure that the accuracy of data analysis result.
The data analytics server 104 is also used to search the corresponding storage information of storage parameter from the parameter information; According to the storage infomation detection quality of data, quality indicator result is determined.The data analytics server 104, for determining The storage mark for storing parameter searches the corresponding storage information of storage mark from the parameter information;According to the storage At least one terminal iidentification of information searching;When the corresponding terminal iidentification of the storage information, up-to-standard quality school is generated Test result;When the storage information corresponds to more than one terminal iidentification, searches the terminal iidentification and correspond to successfully upload information;It will The corresponding successful information that uploads of each terminal iidentification is ranked up, and determining the upload successful information according to ranking results, there is no redundancies When, judge data exception, generates the quality indicator result of data exception.
In fact, when data terminal (abbreviation terminal) such as mobile phone, tablet computer is collected by sampling instrument using data Afterwards, i.e., after collecting the corresponding parameter information of each acquisition parameter, collected parameter information will be uploaded, so that data point Analysis server can receive the parameter information of the upload.The parameter information may include storage information, check information and acquisition Corresponding information of parameter etc..Wherein, storage letter can be used to detection data quality, determine quality indicator as a result, such as safe digital Block (Secure Digital Memory Card) information (abbreviation SD card information), multimedia storage card (Multi Media Card, MMC) information, SM card (Smart Media Card) information, CF card (Compact Flash Card) information etc.;Verification Information can be used for analyzing data transmission scenarios, determines and kidnaps check results, as the address (Internet Protocol) IP is believed Breath.After receiving parameter information, data analytics server can be analyzed parameter information, be looked into from the parameter information Look for the corresponding storage information of storage parameter.Specifically, can be needed to set preset storage parameter according to detection, such as preset SD card parameter. During data analysis, by searching for the preset corresponding storage information of storage parameter, so that it may get storage ginseng The corresponding storage information of number.Data analytics server extract storage information after, using storage information to parameter information into Row data quality checking, to judge that collected parameter information with the presence or absence of data fabrication, that is, judges collected parameter information Accuracy, determine quality indicator result.
The method further include: the data analytics server is searched storage parameter correspondence from the parameter information and deposited Store up information;According to the storage infomation detection quality of data, quality indicator result is determined.Storage is searched from the parameter information The corresponding storage information of parameter;According to the storage infomation detection quality of data, quality indicator is determined as a result, comprising determining that storage The storage of parameter identifies, and the corresponding storage information of storage mark is searched from the parameter information;According to the storage information Search at least one terminal iidentification;When the corresponding terminal iidentification of the storage information, up-to-standard quality indicator knot is generated Fruit;When the storage information corresponds to more than one terminal iidentification, searches the terminal iidentification and correspond to successfully upload information;By each end The corresponding successful information that uploads of mark is held to be ranked up, when determining that redundancy is not present in the upload successful information according to ranking results, Judge data exception, generates the quality indicator result of data exception.
After the completion of parameter information acquisition, the quality of data can be acquired with inspection institute, wherein the matter of the data for transmission It is specific as follows to measure verification step:
Referring to Fig. 8, the step flow chart of quality of data method of calibration in accordance with another embodiment of the present invention is shown.
Step 802, the parameter information of upload is received.
Wherein, it is collected when the parameter information application operation for each acquisition parameter.
In data acquisition and analysis system, data of the acquisition control server based on acquisition required for each service platform, really Fixed application to be collected.After determining application, Cloud Server can determine the static ginseng of application to be collected according to application type Number, dynamic parameter, and setting acquisition configuration information, believe that each terminal applied or applied according to the acquisition configuration Breath acquisition uploads collected each acquisition parameter and corresponds to parameter information.
Step 804, the storage mark for determining storage parameter is searched the storage mark correspondence from the parameter information and is deposited Store up information.
In embodiments of the present invention, Data analysis server can determine institute according to the demand of data quality checking The storage information for needing to extract carries out data quality checking to parameter information using extracted storage information, to judge to upload Parameter information it is whether abnormal.Specifically, the storage mark by determining storage parameter, so that it may according to identified parameter mark Knowledge is searched;If the corresponding storage information of storage mark determined by being found from parameter information, so that it may be deposited what is found Storage information extracts, and to carry out the detection of the quality of data to the parameter information of upload, the parameter information that such as judgement uploads is The no data to fake.
In fact, the storage parameter of data analytics server setting may include SD card parameter, then stores parameter correspondence and deposit Storing up information may include SD card information.As a specific example of the invention, data analytics server can be by determining SD Card identifier, so that it may the parameter information received be searched according to SD card identifier, the SD is extracted from parameter information Card identifier corresponds to SD card information.It should be noted that each SD card has unique corresponding SD card mark, and SD card information It can be used for searching the mark of SD card corresponding to SD card.
Step 806, according at least one terminal iidentification of the storage information searching.
After extracting storage information, so that it may carry out data quality checking according to storage information, judge collected parameter Information whether there is data fabrication.Specifically, extracting the identification information of each terminal from all parameter informations received;And sentence Whether the terminal iidentification of disconnected extracted identification information corresponds to extracted storage information;It is extracted if whether terminal iidentification corresponds to Storage information, it can determine it is extracted storage information be the terminal storage information, foundation extracts store information and The corresponding relationship of the terminal iidentification of the terminal.
As a specific example of the invention, it is assumed that terminal A, terminal B and the same SD card of terminal C connection, mark It for SD card 1, and is SD card information 1 by the SD card information labeling of SD card 1;Terminal D connects another SD card, is labeled as SD card 2, It and is SD card information 2 by the SD card information labeling of SD card 2.When data analytics server is uploaded from terminal A, terminal B or terminal C Parameter information in extract SD card information when, extracted SD card information be SD card information 1, according to SD card information 1 search SD Card mark can find the corresponding SD card mark of terminal A, the corresponding SD card mark of terminal B and the corresponding SD card mark of terminal C Know, i.e., searches the parameter information uploaded, 3 SD card marks corresponding to available SD card information 1 according to SD card information 1.When When data analytics server extracts SD card information from the parameter information that terminal D uploads, extracted SD card information is SD card Information 2 searches SD card mark according to SD card information 2, can find the corresponding SD card mark of terminal D, i.e., look into according to SD card information 2 Look for the parameter information of upload, 1 SD card mark corresponding to available SD card information 2.
Step 808, using the terminal iidentification detection data quality, quality indicator result is determined.
In the concrete realization, data analytics server can count terminal iidentification corresponding to storage information, really The quantity of fixed storage information counterpart terminal mark, the quantity based on terminal iidentification judge whether the storage information belongs to an end End is equivalent to and judges parameter information corresponding to the storage information with the presence or absence of data fabrication.If storing the corresponding terminal of information The quantity of mark is 1, then the storage information belongs to a terminal, and as in above-mentioned example, SD card information 2 belongs to terminal D, can sentence Fixed collected data are normal, that is, determining parameter information corresponding to SD card information 2 not is the data faked, and generate the data and adopt Collect up-to-standard quality indicator result.If the quantity for storing the corresponding terminal iidentification of information is not 1, which is not Belong to a terminal, as in above-mentioned example, SD card information 1 belongs to 3 terminals, it is possible to determine that collected data exception, i.e. SD Parameter information corresponding to card information 1 may be the data of fraud, generate the quality indicator result of the data exception.
Optionally, when the corresponding terminal iidentification of the storage information, up-to-standard quality indicator result is generated.Work as institute It states storage information and corresponds to more than one terminal iidentification, generate the quality indicator result of data exception.Specifically, when storage information pair When answering a terminal iidentification, data analytics server may determine that parameter information corresponding to the storage information is normal data, Data analysis can be carried out using the parameter information, generate data sheet required for each service platform, to understand business demand, Business is adjusted.
Optionally, when there are when more than one terminal iidentification, search the terminal iidentification to correspond to successfully for the terminal iidentification Upload information;The corresponding successful information that uploads of each terminal iidentification is ranked up;Determine that described upload successfully is believed according to ranking results Breath judges data exception there is no when redundancy.In fact, the terminal device such as display where some applications, does not have locally Memory space, by connection processor, perhaps hard disk utilizes the memory space of processor or hard disk processing data.Wherein, more A terminal can share the memory space processing data of same processor or hard disk, and such as multiple displays connect the same SD Card, that is, share the memory space of the same SD card.In acquisition data procedures, to connecting the more of same hard disk or processor A terminal carries out data acquisition, and substantial collected parameter information is the data of the same hard disk or processor.
When storage information corresponds to more than one terminal iidentification, it is corresponding that data analytics server can search each terminal iidentification Success upload information, such as Successful transmissions log information (transformation).Terminal iidentification corresponds to successfully upload information Successful transmissions numbers, such as the number transformation times (referred to as tt value) of Successful transmissions log.Each time at Function uploads collected parameter information, and tt value increases according to unit value automatically, such as automatic to add 1.
When storage information counterpart terminal mark is more than one, data analytics server can be corresponded to each terminal iidentification It passes successful information to be ranked up, be such as ranked up according to the size of tt value, judge whether upload successful information based on ranking results There are redundancies.When uploading successful information, there is no when redundancy, can determine that the corresponding multiple terminal iidentifications of storage information are substantial It is the data of same processor or hard disk, that is, there is data fabrication, determines data exception.In conjunction with above-mentioned example, SD card letter The corresponding 3 SD cards mark of breath 1, data analytics server are ranked up the number of Successful transmissions log according to the size of tt value, Judge whether the number of Successful transmissions log repeats;When the number of Successful transmissions log does not repeat, i.e., in Successful transmissions log Number when redundancy is not present, it is possible to determine that data exception such as assumes that the tt value of terminal A corresponding SD card mark is 1, terminal B The tt value of corresponding SD card mark is 3, and the tt value of the corresponding SD card mark of terminal C is 2, i.e. the number of Successful transmissions log is not deposited In redundancy, it is possible to determine that the parameter information comprising SD card information 1 is abnormal, is equivalent to and determines the parameter information comprising SD card information 1 There are data fabrication, the quality indicator of data exception is generated as a result, the parameter information is avoided to carry out data analysis, that is, avoids using Abnormal parameter information is analyzed, and the accuracy of data acquisition is improved.
In embodiments of the present invention, when storing information and corresponding to more than one terminal iidentification, data analytics server can be with Determine data exception, generates the quality indicator of data exception as a result, carrying out data analysis to avoid using abnormal data, guarantee The accuracy of data analysis result.
For embodiment of the method, for simple description, therefore, it is stated as a series of action combinations, but this field Technical staff should be aware of, and embodiment of that present invention are not limited by the describe sequence of actions, because implementing according to the present invention Example, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art should also know that, specification Described in embodiment belong to preferred embodiment, the actions involved are not necessarily necessary for embodiments of the present invention.
For system embodiments, since it is basically similar to the method embodiment, related so being described relatively simple Place illustrates referring to the part of embodiment of the method.
Algorithm and display are not inherently related to any particular computer, virtual system, or other device provided herein. Various general-purpose systems can also be used together with teachings based herein.As described above, it constructs required by this kind of system Structure be obvious.In addition, the present invention is also not directed to any particular programming language.It should be understood that can use various Programming language realizes summary of the invention described herein, and the description done above to language-specific is to disclose this hair Bright preferred forms.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that implementation of the invention Example can be practiced without these specific details.In some instances, well known method, structure is not been shown in detail And technology, so as not to obscure the understanding of this specification.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of the various inventive aspects, Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes In example, figure or descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. required to protect Shield the present invention claims features more more than feature expressly recited in each claim.More precisely, as following Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore, Thus the claims for following specific embodiment are expressly incorporated in the specific embodiment, wherein each claim itself All as a separate embodiment of the present invention.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed Meaning one of can in any combination mode come using.
Various component embodiments of the invention can be implemented in hardware, or to run on one or more processors Software module realize, or be implemented in a combination thereof.It will be understood by those of skill in the art that can be used in practice Microprocessor or digital signal processor (DSP) realize one in data acquisition and analysis system according to an embodiment of the present invention The some or all functions of a little or whole components.The present invention is also implemented as executing method as described herein Some or all device or device programs (for example, computer program and computer program product).Such realization Program of the invention can store on a computer-readable medium, or may be in the form of one or more signals.This The signal of sample can be downloaded from an internet website to obtain, and is perhaps provided on the carrier signal or mentions in any other forms For.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and ability Field technique personnel can be designed alternative embodiment without departing from the scope of the appended claims.In the claims, Any reference symbol between parentheses should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not Element or step listed in the claims.Word "a" or "an" located in front of the element does not exclude the presence of multiple such Element.The present invention can be by means of including the hardware of several different elements and being come by means of properly programmed computer real It is existing.In the unit claims listing several devices, several in these devices can be through the same hardware branch To embody.The use of word first, second, and third does not indicate any sequence.These words can be explained and be run after fame Claim.
The invention discloses A1, a kind of data acquisition and analysis system, comprising: acquisition control server, data analysis service Device, report generation server and at least one data terminal are equipped with sampling instrument in the data terminal;
The acquisition control server, for configuring the acquisition configuration information to data terminal and being handed down to corresponding number According to terminal, wherein the configuration information is used to control the acquisition of acquisition parameter;
The data terminal, for the sampling instrument described in application run time call, according to acquisition configuration information to acquisition The parameter information of parameter is acquired;And the parameter information of acquisition is uploaded to the data analytics server;
The data analytics server is analyzed for corresponding to parameter information to each acquisition parameter of upload, obtains number According to analysis result;The data analysis result is sent to the report generation server;
The report generation server, for generating data sheet according to the data analysis result.
A2, system as described in a1, the acquisition control server include cloud control server;
The cloud control server, for determining the acquisition parameter of the application according to application type, wherein the acquisition ginseng Number includes: dynamic parameter and/or static parameter;Acquisition configuration information is configured according to terminal where the application and application, wherein The acquisition configuration information is used to control the acquisition and upload of the acquisition parameter;Acquisition parameter and acquisition configuration information are issued To the data terminal where application.
A3, as described in A2 system,
The cloud control server, for the upload condition and/or sampling condition of configuration parameter information, by the condition of upload and/ Or sampling condition is added in acquisition configuration information;Terminal where configuring the application corresponds to the acquisition threshold value of memory, will be described Acquisition threshold value is added in acquisition configuration information;The upload interval of terminal corresponding network type where configuring the application, by institute Upload interval is stated to be added in the acquisition configuration information;Terminal where configuring the application corresponds to cache threshold, will be described slow Threshold value is deposited to be added in acquisition configuration information;And in the acquisition configuration information configuration protocol upload sequence, sample rate and The priority of sampling parameter.
A4, as described in A2 system,
The data terminal, for using the static parameter applied described in sampling instrument foundation acquisition configuration information collection Parameter information;And dynamic parameter to be collected is determined according to acquisition configuration information using the sampling instrument, it is answered according to described in Operation acquires the parameter information of the dynamic parameter in real time.
A5, the system as described in A4,
The data terminal, for when detecting the changing interface of the application, the interface before record switching to be upper one Page, the interface after record switching are current page, and the page up and current page are added in application interface starting information;Work as inspection When measuring the button of the application and being triggered, the corresponding button number of the button is obtained, it is corresponding to update the button number Button number and number of clicks are added in button click information by number of clicks;Acquire the relevant operation of the application Time is as duration information, wherein the duration information includes: interface runing time and using runing time.
A6, the system as described in A2 to A5 is any, the parameter information of the static parameter include at least one of the following: terminal Mark, version information, channel information, network type and resolution information;The parameter information of the dynamic parameter include with down toward One item missing: application interface starts information, button click information, duration information, exception information and session information.
A7, system as described in a1,
The report generation server corresponds to the customized management information of customized event for the application according to configuration, Obtain business statistics information;Customized event report is generated according to the customized management information and business statistics information.
A8, the system as described in A7,
The report generation server, be also used to obtain the application from the service management page applies path, And the application corresponds to the customized event information of customized event, wherein the customized event information includes: event name Title and event attribute;Customized management information is generated using the application path and customized event information.
A9, the system as described in A8,
The report generation server is applied for determining according to the application path;For each customized event, obtain Take the corresponding logical name of the event title and the corresponding logical attribute of the event attribute;Search the logical name Corresponding acquisition parameter, determines the corresponding business statistics information of the acquisition parameter according to the logical attribute;And determination is respectively adopted Collect the corresponding event title of parameter, making by oneself for application is generated using the business statistics information of each event title and corresponding acquisition parameter Adopted event report.
A10, system as described in a1,
The acquisition control server is also used to configure the test information that the target application corresponds to test equipment;
The data analytics server is also used to analyze the corresponding parameter information uploaded of the target application;Sentence When the parameter information that breaks belongs to test equipment, the parameter information for belonging to test equipment is analyzed in real time;
The report generation server when being also used to judge that the parameter information belongs to test equipment, is analyzed according to data Data sheet is generated when fructufy.
A11, the system as described in A10, the acquisition control server, comprising: exploitation configuration server;
The exploitation configuration server, for configuring at least one to the target application after target application completes registration The test of a test equipment identifies;Acquisition parameter to be tested is configured for the target application, and the test is identified and acquired Parameter is as test information;
The data analytics server is also used to the acquisition target application from the parameter information of upload and corresponds to acquisition parameter Parameter information;It is identified by terminal parameter counterpart terminal in the parameter information;Judge the terminal iidentification and test equipment table It is middle test identify whether it is identical, when the terminal iidentification is identical with test mark any in test equipment table, judge parameter letter Breath belongs to test equipment.
A12, system as described in a1,
The data analytics server is also used to the lookup checking parameter from the parameter information and corresponds to check information;It is right The check information, which analyze, determines abduction check results.
A13, the system as described in A12,
The data analytics server searches institute for determining the parameter identification of checking parameter from the parameter information It states parameter identification and corresponds to check information;Detect whether the check information is target information;If the check information is not target Information determines that flow exists and kidnaps exception, and record is kidnapped abnormal in the abduction check results;If the check information is mesh Information is marked, determines that data transmission is normal, record transmission is normal in the abduction check results.
A14, system as described in a1,
The data analytics server is also used to search the corresponding storage information of storage parameter from the parameter information;According to According to the storage infomation detection quality of data, quality indicator result is determined.
A15, the system as described in A14,
The data analytics server searches institute for determining the storage mark of storage parameter from the parameter information State the corresponding storage information of storage mark;According at least one terminal iidentification of the storage information searching;When the storage information pair A terminal iidentification is answered, up-to-standard quality indicator result is generated;When the storage information corresponds to more than one terminal iidentification, It searches the terminal iidentification and corresponds to successfully upload information;The corresponding successful information that uploads of each terminal iidentification is ranked up, according to row Sequence result determines that the upload successful information there is no when redundancy, judges data exception, generates the quality indicator knot of data exception Fruit.
The invention also discloses B16, a kind of data acquisition analysis method, wherein the data acquisition analysis method application In data acquisition and analysis system, data acquisition and analysis system include: the acquisition control server, data analytics server, Report generation server and at least one data terminal are equipped with sampling instrument in the data terminal;
The method includes:
The acquisition control server configures the acquisition configuration information to data terminal and is handed down to corresponding data end End;
Data terminal sampling instrument described in application run time call, according to acquisition configuration information to acquisition parameter Parameter information is acquired;
The parameter information of acquisition is uploaded to the acquisition control server by the data terminal;
The data analytics server corresponds to parameter information to each acquisition parameter of upload and analyzes, and obtains data analysis As a result;
The data analysis result is sent to the report generation server by the data analytics server;
The report generation server generates data sheet according to the data analysis result.
B17, the method as described in B16, the acquisition control server configure the acquisition configuration information to data terminal And it is handed down to corresponding data terminal, comprising:
The acquisition control server determines the acquisition parameter of the application according to application type, wherein the acquisition ginseng Number includes: dynamic parameter and/or static parameter;
Acquisition configuration information according to terminal configuration where the application and application, wherein the acquisition configuration information is used In the acquisition and upload that control the acquisition parameter;
Acquisition parameter and acquisition configuration information are handed down to the data terminal where application.
B18, the method as described in B17, the step according to the acquisition configuration information of terminal configuration where the application and application Suddenly it comprises at least one of the following:
Upload condition and/or sampling condition are added to acquisition by the upload condition and/or sampling condition of configuration parameter information In configuration information;
Terminal where configuring the application corresponds to the acquisition threshold value of memory, and the acquisition threshold value is added to acquisition configuration letter In breath;
Upload interval is added to described adopt by the upload interval of terminal corresponding network type where configuring the application Collect in configuration information;
Terminal where configuring the application corresponds to cache threshold, and the cache threshold is added in acquisition configuration information;
Configuration protocol upload sequence, the priority of sample rate and sampling parameter in the acquisition configuration information.
B19, the method as described in B17, it is described that the parameter information of acquisition parameter is acquired according to acquisition configuration information, Include:
Parameter information using the sampling instrument according to the static parameter applied described in acquisition configuration information collection;
Dynamic parameter to be collected is determined according to acquisition configuration information using the sampling instrument, the fortune according to the application Row acquires the parameter information of the dynamic parameter in real time.
B20, the method as described in B19 acquire the parameter information of the dynamic parameter according to the operation of the application in real time The step of comprise at least one of the following:
When detecting the changing interface of the application, the interface before record switching is page up, the boundary after record switching Face is current page, and the page up and current page are added in application interface starting information;
When the button for detecting the application is triggered, the corresponding button number of the button is obtained, is pressed described in update Button numbers corresponding number of clicks, and button number and number of clicks are added in button click information;
The relevant runing time of the application is acquired as duration information, wherein the duration information includes: interface operation Time and apply runing time.
B21, the method as described in B17 to B20 is any, the parameter information of the static parameter include at least one of the following: Terminal iidentification, version information, channel information, network type and resolution information;The parameter information of the dynamic parameter include with At least one of lower: application interface starts information, button click information, duration information, exception information and session information.
B22, the method as described in B16, the report generation server generate datagram according to the data analysis result Table, comprising:
Customized management information of the report generation server according to the corresponding customized event of application of configuration, obtains industry Business statistical information;Customized event report is generated according to the customized management information and business statistics information.
B23, the method as described in B22 further include the steps that configuring customized management information:
The application path and the application that the application is obtained from the service management page correspond to customized event Customized event information, wherein the customized event information includes: event title and event attribute;
Customized management information is generated using the application path and customized event information.
B24, the method as described in B23, the customized management information of the corresponding customized event of application according to configuration, obtain Business statistics information;Customized event report is generated according to the customized management information and business statistics information, comprising:
It determines and applies according to the application path;
For each customized event, the corresponding logical name of the event title and the event attribute pair are obtained The logical attribute answered;
It searches the logical name and corresponds to acquisition parameter, determine the corresponding industry of the acquisition parameter according to the logical attribute Business statistical information;
Determine the corresponding event title of each acquisition parameter, the business statistics using each event title and corresponding acquisition parameter is believed Breath generates the customized event report of application.
B25, the method as described in B16, further includes:
The acquisition control server configures the test information that the target application corresponds to test equipment;
The data analytics server analyzes the corresponding parameter information uploaded of the target application;Judge the ginseng When number information belongs to test equipment, the parameter information for belonging to test equipment is analyzed in real time;
It is real-time according to data analysis result when the report generation server judges that the parameter information belongs to test equipment Generate data sheet.
B26, the method as described in B25 configure the test information that the target application corresponds to test equipment, comprising:
After target application completes registration, the test for configuring at least one test equipment to the target application is identified;For The target application configures acquisition parameter to be tested, using test mark and acquisition parameter as test information;
The method further include:
The data analytics server obtains the parameter letter that target application corresponds to acquisition parameter from the parameter information of upload Breath;It is identified by terminal parameter counterpart terminal in the parameter information;Judge to test in the terminal iidentification and test equipment table It identifies whether identical, when the terminal iidentification is identical as test mark any in test equipment table, judges that parameter information belongs to Test equipment.
B27, the method as described in B16, further includes:
Data analytics server searches checking parameter from the parameter information and corresponds to check information;
The check information analyze and determines abduction check results.
B28, the method as described in B27 search checking parameter from the parameter information and correspond to check information;To the school Information is tested to carry out analyzing determining abduction check results, comprising:
The parameter identification for determining checking parameter searches the parameter identification from the parameter information and corresponds to check information;
Detect whether the check information is target information;
If the check information is not target information, determines that flow exists and kidnap exception, in the abduction check results Record is kidnapped abnormal;
If the check information is target information, determines that data transmission is normal, record and pass in the abduction check results It is defeated normal.
B29, the method as described in B16, further includes:
The data analytics server searches the corresponding storage information of storage parameter from the parameter information;
According to the storage infomation detection quality of data, quality indicator result is determined.
B30, the method as described in B29 search the corresponding storage information of storage parameter from the parameter information;According to described in The infomation detection quality of data is stored, determines quality indicator result, comprising:
The storage mark for determining storage parameter searches the corresponding storage information of storage mark from the parameter information;
According at least one terminal iidentification of the storage information searching;
When the corresponding terminal iidentification of the storage information, up-to-standard quality indicator result is generated;
When the storage information corresponds to more than one terminal iidentification, searches the terminal iidentification and correspond to successfully upload information;
The corresponding successful information that uploads of each terminal iidentification is ranked up, determines the upload successful information according to ranking results There is no when redundancy, data exception is judged, generate the quality indicator result of data exception.

Claims (30)

1. a kind of data acquisition and analysis system, comprising: acquisition control server, data analytics server, report generation server With at least one data terminal, sampling instrument is installed in the data terminal;
The acquisition control server, for configuring acquisition configuration information to data terminal and being handed down to corresponding data terminal, Wherein, the configuration information is used to control the acquisition of acquisition parameter;The acquisition configuration information includes: acquisition threshold value;It is described to adopt Collecting parameter includes: static parameter and/or dynamic parameter;
The data terminal, for the sampling instrument described in application run time call, according to acquisition configuration information to acquisition parameter Parameter information be acquired, and the parameter information of acquisition is uploaded to the data analytics server, comprising: described in acquisition Using the memory information of place data terminal;When the memory information is not up to the acquisition threshold value, the static ginseng is acquired Several parameter informations, when the memory information reaches the acquisition threshold value, the application acquires each in the application when running The parameter information of static parameter and/or dynamic parameter;
The data analytics server is analyzed for corresponding to parameter information to each acquisition parameter of upload, obtains data point Analyse result;The data analysis result is sent to the report generation server;
The report generation server, for generating data sheet according to the data analysis result.
2. system according to claim 1, which is characterized in that the acquisition control server includes cloud control server;
The cloud control server, for determining the acquisition parameter of the application according to application type;According to the application and application Place terminal configure acquisition configuration information, wherein the acquisition configuration information be used for control the acquisition parameter acquisition and It passes;Acquisition parameter and acquisition configuration information are handed down to the data terminal where application.
3. system according to claim 2, which is characterized in that
The cloud control server by upload condition and/or is adopted for the upload condition and/or sampling condition of configuration parameter information Batten part is added in acquisition configuration information;Terminal where configuring the application corresponds to the acquisition threshold value of memory, by the acquisition Threshold value is added in acquisition configuration information;The upload interval of terminal corresponding network type where configuring the application, on described Interval is passed to be added in the acquisition configuration information;Terminal where configuring the application corresponds to cache threshold, by the caching threshold Value is added in acquisition configuration information;And configuration protocol upload sequence, sample rate and sampling in the acquisition configuration information The priority of parameter.
4. system according to claim 2, which is characterized in that
The data terminal, for the parameter using sampling instrument according to the static parameter applied described in acquisition configuration information collection Information;And dynamic parameter to be collected is determined according to acquisition configuration information using the sampling instrument, according to the application Operation acquires the parameter information of the dynamic parameter in real time.
5. system according to claim 4, which is characterized in that
The data terminal, for when detecting the changing interface of the application, the interface before record switching to be page up, note Interface after record switching is current page, and the page up and current page are added in application interface starting information;When detecting When the button of the application is triggered, the corresponding button number of the button is obtained, the button is updated and numbers corresponding click Button number and number of clicks are added in button click information by number;Acquire the relevant runing time of the application As duration information, wherein the duration information includes: interface runing time and using runing time.
6. according to any system of claim 2 to 5, which is characterized in that the parameter information of the static parameter include with It is at least one of lower: terminal iidentification, version information, channel information, network type and resolution information;The parameter of the dynamic parameter Information includes at least one of the following: application interface starting information, button click information, duration information, exception information and session letter Breath.
7. system according to claim 1, which is characterized in that
The report generation server is obtained for the customized management information of the corresponding customized event of application according to configuration Business statistics information;Customized event report is generated according to the customized management information and business statistics information.
8. system according to claim 7, which is characterized in that
The report generation server is also used to obtain the application path and described of the application from business administration page Using the customized event information of corresponding customized event, wherein the customized event information includes: event title and event Attribute;Customized management information is generated using the application path and customized event information.
9. system according to claim 8, which is characterized in that
The report generation server is applied for determining according to the application path;For each customized event, institute is obtained State the corresponding logical name of event title and the corresponding logical attribute of the event attribute;It is corresponding to search the logical name Acquisition parameter determines the corresponding business statistics information of the acquisition parameter according to the logical attribute;And determine each acquisition ginseng The corresponding event title of number generates the customized thing of application using the business statistics information of each event title and corresponding acquisition parameter Part report.
10. system according to claim 1, which is characterized in that
The acquisition control server is also used to configure the test information that target application corresponds to test equipment;
The data analytics server is also used to analyze the corresponding parameter information uploaded of the target application;Judge institute When stating parameter information and belonging to test equipment, the parameter information for belonging to test equipment is analyzed in real time;
The report generation server, when being also used to judge that the parameter information belongs to test equipment, according to data analysis result Data sheet is generated in real time.
11. system according to claim 10, which is characterized in that the acquisition control server, comprising: exploitation configuration clothes Business device;
The exploitation configuration server, for configuring at least one survey to the target application after target application completes registration Try the test mark of equipment;Acquisition parameter to be tested is configured for the target application, by test mark and acquisition parameter As test information;
The data analytics server is also used to obtain the parameter that target application corresponds to acquisition parameter from the parameter information of upload Information;It is identified by terminal parameter counterpart terminal in the parameter information;Judge to survey in the terminal iidentification and test equipment table Examination identifies whether identical, when the terminal iidentification is identical as test mark any in test equipment table, judges parameter information category In test equipment.
12. system according to claim 1, which is characterized in that
The data analytics server is also used to the lookup checking parameter from the parameter information and corresponds to check information;To described Check information, which analyze, determines abduction check results.
13. system according to claim 12, which is characterized in that
The data analytics server searches the ginseng for determining the parameter identification of checking parameter from the parameter information Number identifies corresponding check information;Detect whether the check information is target information;If the check information is not target information, It determines that flow exists and kidnaps exception, record is kidnapped abnormal in the abduction check results;If the check information is target letter Breath determines that data transmission is normal, and record transmission is normal in the abduction check results.
14. system according to claim 1, which is characterized in that
The data analytics server is also used to search the corresponding storage information of storage parameter from the parameter information;According to institute The storage infomation detection quality of data is stated, determines quality indicator result.
15. system according to claim 14, which is characterized in that
The data analytics server is deposited described in lookup from the parameter information for determining the storage mark of storage parameter The corresponding storage information of storage mark;According at least one terminal iidentification of the storage information searching;When the storage information corresponding one A terminal iidentification generates up-to-standard quality indicator result;When the storage information corresponds to more than one terminal iidentification, search The terminal iidentification corresponds to successfully upload information;The corresponding successful information that uploads of each terminal iidentification is ranked up, according to sequence knot Fruit determines that the upload successful information there is no when redundancy, judges data exception, generates the quality indicator result of data exception.
16. a kind of data acquisition analysis method, wherein the data acquisition analysis method is applied to data acquisition and analysis system In, data acquisition and analysis system includes: acquisition control server, data analytics server, report generation server and at least one A data terminal is equipped with sampling instrument in the data terminal;
The method includes:
The acquisition control server configuration acquisition configuration information to data terminal and is handed down to corresponding data terminal;It is described to adopt Collecting configuration information includes: acquisition threshold value;Acquisition parameter includes: static parameter and/or dynamic parameter;
Data terminal sampling instrument described in application run time call, according to acquisition configuration information to the parameter of acquisition parameter Information is acquired, comprising: the memory information of data terminal where obtaining the application, when the memory information is not up to described When acquiring threshold value, the parameter information of the static parameter is acquired, it is described to answer when the memory information reaches the acquisition threshold value The parameter information of each static parameter and/or dynamic parameter in the application is acquired when with operation;
The parameter information of acquisition is uploaded to the acquisition control server by the data terminal;
The data analytics server corresponds to parameter information to each acquisition parameter of upload and analyzes, and obtains data analysis knot Fruit;
The data analysis result is sent to the report generation server by the data analytics server;
The report generation server generates data sheet according to the data analysis result.
17. according to the method for claim 16, which is characterized in that the acquisition control server configures the acquisition configuration Information is to data terminal and is handed down to corresponding data terminal, comprising:
The acquisition control server determines the acquisition parameter of the application according to application type;
Acquisition configuration information is configured according to terminal where the application and application, wherein the acquisition configuration information is for controlling The acquisition and upload of the acquisition parameter;
Acquisition parameter and acquisition configuration information are handed down to the data terminal where application.
18. according to the method for claim 17, which is characterized in that according to terminal configuration acquisition where the application and application The step of configuration information, comprises at least one of the following:
Upload condition and/or sampling condition are added to acquisition configuration by the upload condition and/or sampling condition of configuration parameter information In information;
Terminal where configuring the application corresponds to the acquisition threshold value of memory, and the acquisition threshold value is added to acquisition configuration information In;
Upload interval is added to the acquisition and matched by the upload interval of terminal corresponding network type where configuring the application In confidence breath;
Terminal where configuring the application corresponds to cache threshold, and the cache threshold is added in acquisition configuration information;
Configuration protocol upload sequence, the priority of sample rate and sampling parameter in the acquisition configuration information.
19. according to the method for claim 17, which is characterized in that ginseng of the foundation acquisition configuration information to acquisition parameter Number information is acquired, comprising:
Parameter information using the sampling instrument according to the static parameter applied described in acquisition configuration information collection;
Dynamic parameter to be collected is determined according to acquisition configuration information using the sampling instrument, the operation according to the application is real When acquire the parameter information of the dynamic parameter.
20. according to the method for claim 19, which is characterized in that the operation according to the application acquires the dynamic in real time The step of parameter information of parameter, comprises at least one of the following:
When detecting the changing interface of the application, the interface before record switching is page up, and the interface after record switching is The page up and current page are added in application interface starting information by current page;
When the button for detecting the application is triggered, the corresponding button number of the button is obtained, the button is updated and compiles Button number and number of clicks are added in button click information by number corresponding number of clicks;
The relevant runing time of the application is acquired as duration information, wherein the duration information includes: interface runing time With apply runing time.
21. 7 to 20 any method according to claim 1, which is characterized in that the parameter information of the static parameter includes At least one of below: terminal iidentification, version information, channel information, network type and resolution information;The ginseng of the dynamic parameter Number information includes at least one of the following: application interface starting information, button click information, duration information, exception information and session Information.
22. according to the method for claim 16, which is characterized in that the report generation server is analyzed according to the data As a result data sheet is generated, comprising:
Customized management information of the report generation server according to the corresponding customized event of application of configuration, obtains business system Count information;Customized event report is generated according to the customized management information and business statistics information.
23. according to the method for claim 22, which is characterized in that further include the steps that configuring customized management information:
The application path and the application that the application is obtained from business administration page correspond to the customized of customized event Event information, wherein the customized event information includes: event title and event attribute;
Customized management information is generated using the application path and customized event information.
24. according to the method for claim 23, which is characterized in that the application according to configuration corresponds to making by oneself for customized event Adopted management information obtains business statistics information;Customized thing is generated according to the customized management information and business statistics information Part report, comprising:
It determines and applies according to the application path;
For each customized event, obtains the corresponding logical name of the event title and the event attribute is corresponding Logical attribute;
It searches the logical name and corresponds to acquisition parameter, determine the corresponding business system of the acquisition parameter according to the logical attribute Count information;
Determine the corresponding event title of each acquisition parameter, the business statistics information using each event title and corresponding acquisition parameter is raw At the customized event report of application.
25. according to the method for claim 16, which is characterized in that further include:
The acquisition control server configuration target application corresponds to the test information of test equipment;
The data analytics server analyzes the corresponding parameter information uploaded of the target application;Judge the parameter letter When breath belongs to test equipment, the parameter information for belonging to test equipment is analyzed in real time;
When the report generation server judges that the parameter information belongs to test equipment, generated in real time according to data analysis result Data sheet.
26. according to the method for claim 25, which is characterized in that configure the test that the target application corresponds to test equipment Information, comprising:
After target application completes registration, the test for configuring at least one test equipment to the target application is identified;It is described Target application configures acquisition parameter to be tested, using test mark and acquisition parameter as test information;
The method further include:
The data analytics server obtains the parameter information that target application corresponds to acquisition parameter from the parameter information of upload;It is logical Terminal parameter counterpart terminal in the parameter information is crossed to identify;Judge the terminal iidentification is with test mark in test equipment table It is no identical, when the terminal iidentification is identical as test mark any in test equipment table, judge that parameter information belongs to test and sets It is standby.
27. according to the method for claim 16, which is characterized in that further include:
Data analytics server searches checking parameter from the parameter information and corresponds to check information;
The check information analyze and determines abduction check results.
28. according to the method for claim 27, which is characterized in that search checking parameter from the parameter information and correspond to school Test information;The check information analyze and determines abduction check results, comprising:
The parameter identification for determining checking parameter searches the parameter identification from the parameter information and corresponds to check information;
Detect whether the check information is target information;
If the check information is not target information, determines that flow exists and kidnap exception, recorded in the abduction check results It kidnaps abnormal;
If the check information is target information, determine that data transmission is normal, record transmits just in the abduction check results Often.
29. according to the method for claim 16, which is characterized in that further include:
The data analytics server searches the corresponding storage information of storage parameter from the parameter information;
According to the storage infomation detection quality of data, quality indicator result is determined.
30. according to the method for claim 29, which is characterized in that search storage parameter correspondence from the parameter information and deposit Store up information;According to the storage infomation detection quality of data, quality indicator result is determined, comprising:
The storage mark for determining storage parameter searches the corresponding storage information of storage mark from the parameter information;
According at least one terminal iidentification of the storage information searching;
When the corresponding terminal iidentification of the storage information, up-to-standard quality indicator result is generated;
When the storage information corresponds to more than one terminal iidentification, searches the terminal iidentification and correspond to successfully upload information;
The corresponding successful information that uploads of each terminal iidentification is ranked up, determines that the upload successful information is not deposited according to ranking results In redundancy, data exception is judged, generate the quality indicator result of data exception.
CN201510938627.6A 2015-12-15 2015-12-15 A kind of data acquisition and analysis system and method Active CN105553769B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201510938627.6A CN105553769B (en) 2015-12-15 2015-12-15 A kind of data acquisition and analysis system and method
PCT/CN2016/104923 WO2017101606A1 (en) 2015-12-15 2016-11-07 System and method for collecting and analyzing data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510938627.6A CN105553769B (en) 2015-12-15 2015-12-15 A kind of data acquisition and analysis system and method

Publications (2)

Publication Number Publication Date
CN105553769A CN105553769A (en) 2016-05-04
CN105553769B true CN105553769B (en) 2019-03-05

Family

ID=55832708

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510938627.6A Active CN105553769B (en) 2015-12-15 2015-12-15 A kind of data acquisition and analysis system and method

Country Status (2)

Country Link
CN (1) CN105553769B (en)
WO (1) WO2017101606A1 (en)

Families Citing this family (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105553769B (en) * 2015-12-15 2019-03-05 北京奇虎科技有限公司 A kind of data acquisition and analysis system and method
CN106101175B (en) * 2016-05-25 2019-08-23 腾讯科技(深圳)有限公司 Apparatus management/control methods, devices and systems
CN107809344B (en) * 2016-09-09 2021-01-22 中华电信股份有限公司 Real-time traffic collection and analysis system and method
CN106549830A (en) * 2016-11-09 2017-03-29 上海最会保网络科技有限公司 A kind of Mobile solution data acquisition unit and method
CN106506851B (en) * 2016-11-28 2021-01-01 深圳前海谷谷力生物科技有限公司 Data statistics adaptation method and device for mobile terminal
CN106649241A (en) * 2016-12-27 2017-05-10 北京奇虎科技有限公司 Method and device for generating report based on custom events
CN106649240A (en) * 2016-12-27 2017-05-10 北京奇虎科技有限公司 Method and device for displaying statement based on custom events
CN107102860A (en) * 2017-04-21 2017-08-29 上海青橙实业有限公司 Collecting method, mobile terminal and server
CN107018046A (en) * 2017-06-06 2017-08-04 上海鋆创信息技术有限公司 A kind of collecting method, device, terminal and storage medium
CN109769305A (en) * 2017-11-09 2019-05-17 普天信息技术有限公司 Method, base station, electronic equipment and the storage medium of dispatch deal
CN109905253B (en) * 2017-12-07 2022-05-17 航天信息股份有限公司 Log information acquisition method and device
CN108418787B (en) * 2018-01-02 2021-02-26 深圳壹账通智能科技有限公司 Method for acquiring enterprise resource planning data, terminal device and medium
CN110221922A (en) * 2018-03-02 2019-09-10 网易(杭州)网络有限公司 The Caton localization method and device of program product, medium and calculate equipment
CN108833459B (en) * 2018-04-09 2022-05-13 平安普惠企业管理有限公司 Data reporting method and terminal equipment
CN110391925A (en) * 2018-04-20 2019-10-29 阿里巴巴集团控股有限公司 A kind of collecting method, data acquisition device and server
CN108762960B (en) * 2018-05-14 2021-07-06 国网福建省电力有限公司 Mobile application monitoring system
CN109189664B (en) * 2018-07-24 2022-08-02 网宿科技股份有限公司 Information acquisition method and terminal for application program
CN109376140A (en) * 2018-08-24 2019-02-22 国网吉林省电力有限公司信息通信公司 A kind of static resource automation collection method, system, equipment and storage medium
CN111198942B (en) * 2018-10-31 2023-07-04 合肥神策数据网络科技有限公司 Data analysis report generation method and device, mobile terminal and storage medium
CN109711156B (en) * 2018-12-28 2023-01-31 上海北信源信息技术有限公司 Method and system for monitoring and managing hard disk information of intranet computer
CN110159252A (en) * 2019-06-04 2019-08-23 国网北京市电力公司 Data collection system and method
CN110633205A (en) * 2019-06-20 2019-12-31 北京无限光场科技有限公司 Method and device for detecting embedded point event, terminal equipment and medium
CN110275902A (en) * 2019-06-28 2019-09-24 重庆回形针信息技术有限公司 A kind of data acquisition and analysis system and method
CN110287471A (en) * 2019-06-28 2019-09-27 重庆回形针信息技术有限公司 A kind of graphic analyses system
CN112395173B (en) * 2019-08-14 2023-10-13 腾讯科技(深圳)有限公司 Method and device for reporting information flow data
CN110569168B (en) * 2019-08-26 2022-07-08 腾讯科技(深圳)有限公司 Data interaction method, related equipment and storage medium
CN112434023B (en) * 2019-08-26 2022-06-10 长鑫存储技术有限公司 Process data analysis method and device, storage medium and computer equipment
CN110515963A (en) * 2019-08-30 2019-11-29 北京东软望海科技有限公司 Collect method, apparatus, electronic equipment and the readable storage medium storing program for executing of statistical information
CN110995524B (en) * 2019-10-28 2022-06-14 北京三快在线科技有限公司 Flow data monitoring method and device, electronic equipment and computer readable medium
CN111209057B (en) * 2020-01-10 2022-09-09 厦门瑞为信息技术有限公司 Method and device for quickly adjusting sensing terminal
CN113126562B (en) * 2020-01-16 2023-03-10 智能云科信息科技有限公司 Data acquisition method, device and system and computer readable storage medium
WO2021212492A1 (en) * 2020-04-24 2021-10-28 深圳市欢太科技有限公司 Information pushing method and apparatus, electronic device, and computer-readable medium
CN111581931B (en) * 2020-04-26 2023-08-11 泰康保险集团股份有限公司 Report generation method and device based on data leakage prevention system
CN111611256B (en) * 2020-04-30 2023-05-09 广东良实机电工程有限公司 Equipment energy consumption monitoring method and device, terminal equipment and storage medium
CN111694720B (en) * 2020-06-15 2023-11-24 山东浪潮云服务信息科技有限公司 Method for automatically monitoring data acquisition progress
CN111897714B (en) * 2020-06-24 2024-03-26 方欣科技有限公司 Test data precipitation method, device and system based on auxiliary test tool
CN112181804B (en) * 2020-08-31 2023-09-08 五八到家有限公司 Parameter verification method, device and storage medium
CN112130854B (en) * 2020-09-09 2023-12-22 海看网络科技(山东)股份有限公司 Method for detecting keywords of probe system by IPTV
CN112015870A (en) * 2020-09-14 2020-12-01 支付宝(杭州)信息技术有限公司 Data uploading method and device
CN112328619A (en) * 2020-09-24 2021-02-05 杭州小电科技股份有限公司 Data quality monitoring method, device, system, electronic device and storage medium
CN112235060A (en) * 2020-09-29 2021-01-15 石家庄市善理通益科技有限公司 Abnormal behavior monitoring and collecting method applied to talkback terminal
CN112817782B (en) * 2021-02-20 2023-10-13 腾讯科技(深圳)有限公司 Data acquisition reporting method and device, electronic equipment and storage medium
CN113014647B (en) * 2021-02-25 2022-05-03 浙江正元智慧科技股份有限公司 Operation and maintenance platform remote data acquisition system based on big data
CN113515507B (en) * 2021-03-12 2024-02-02 中电建电力检修工程有限公司 Method and system applied to dam water seepage detection
CN113114736A (en) * 2021-03-25 2021-07-13 北京数字磐石科技有限公司 Ore machine management method and system
CN113626477B (en) * 2021-07-19 2023-10-10 浙江中控信息产业股份有限公司 Configurable report system and method based on water plant Internet of Things system
CN114615291A (en) * 2021-12-08 2022-06-10 江苏众亿国链大数据科技有限公司 Data acquisition method based on Internet of things
CN114401289A (en) * 2021-12-31 2022-04-26 深圳市麦谷科技有限公司 Task batch uploading method and system
CN114460400A (en) * 2022-01-19 2022-05-10 西北核技术研究所 Pulse current injection automatic experiment system and method
CN114296009B (en) * 2022-03-10 2022-05-24 山东汇能电气有限公司 Intelligent analysis system for transformer operation
CN114785784B (en) * 2022-04-14 2023-10-24 中国第一汽车股份有限公司 Data processing method and device and electronic equipment
CN115102936B (en) * 2022-06-22 2023-11-21 苏州达家迎信息技术有限公司 Batch information uploading method and device, storage medium and electronic equipment
CN116303689A (en) * 2023-05-25 2023-06-23 武汉科迪智能环境股份有限公司 Method and device for generating data report, computer equipment and readable storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101557582A (en) * 2008-04-08 2009-10-14 中国移动通信集团公司 Method and device for mobile communication user information statistics
CN102711141A (en) * 2012-05-15 2012-10-03 上海交通大学无锡研究院 Mobile network service quality distributed type collection method based on mobile terminal
CN103118095A (en) * 2013-01-25 2013-05-22 浪潮电子信息产业股份有限公司 Cloud data center information difference collecting method

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103188088B (en) * 2011-12-27 2015-11-18 北京新媒传信科技有限公司 Equipment information collection system and method
CN103248651B (en) * 2012-02-09 2016-02-24 腾讯科技(深圳)有限公司 A kind of method and system of performance monitoring and client and server
WO2013186870A1 (en) * 2012-06-13 2013-12-19 株式会社日立製作所 Service monitoring system and service monitoring method
CN103795580B (en) * 2012-10-29 2016-10-26 腾讯科技(深圳)有限公司 A kind of data monitoring method, system and relevant device
CN104239577A (en) * 2014-10-09 2014-12-24 北京奇虎科技有限公司 Method and device for detecting authenticity of webpage data
CN104657278A (en) * 2015-03-13 2015-05-27 百度在线网络技术(北京)有限公司 Client side performance evaluation method and system
CN105119899B (en) * 2015-07-17 2019-01-11 世纪龙信息网络有限责任公司 Non-invasive client runtime data acquisition method and system
CN105515909B (en) * 2015-12-15 2018-10-19 北京奇虎科技有限公司 A kind of data acquisition test method and apparatus
CN105553769B (en) * 2015-12-15 2019-03-05 北京奇虎科技有限公司 A kind of data acquisition and analysis system and method
CN105373293A (en) * 2015-12-15 2016-03-02 北京奇虎科技有限公司 Data acquisition method and apparatus
CN105376335B (en) * 2015-12-15 2019-12-24 北京奇虎科技有限公司 Collected data uploading method and device
CN105391602B (en) * 2015-12-15 2019-02-26 北京奇虎科技有限公司 A kind of data acquisition test method and apparatus
CN105516321B (en) * 2015-12-15 2019-06-04 北京奇虎科技有限公司 A kind of collecting method and device
CN105574150A (en) * 2015-12-15 2016-05-11 北京奇虎科技有限公司 Data processing method and device
CN105577472A (en) * 2015-12-15 2016-05-11 北京奇虎科技有限公司 Data acquisition test method and device
CN105553770B (en) * 2015-12-15 2019-12-24 北京奇虎科技有限公司 Data acquisition control method and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101557582A (en) * 2008-04-08 2009-10-14 中国移动通信集团公司 Method and device for mobile communication user information statistics
CN102711141A (en) * 2012-05-15 2012-10-03 上海交通大学无锡研究院 Mobile network service quality distributed type collection method based on mobile terminal
CN103118095A (en) * 2013-01-25 2013-05-22 浪潮电子信息产业股份有限公司 Cloud data center information difference collecting method

Also Published As

Publication number Publication date
WO2017101606A1 (en) 2017-06-22
CN105553769A (en) 2016-05-04

Similar Documents

Publication Publication Date Title
CN105553769B (en) A kind of data acquisition and analysis system and method
CN106844217B (en) Method and device for embedding point of applied control and readable storage medium
CN105516321B (en) A kind of collecting method and device
CN106649063B (en) Method and system for monitoring time-consuming data during program operation
CN110414242A (en) For detecting the method, apparatus, equipment and medium of service logic loophole
Ma et al. Design and implementation of a toolkit for usability testing of mobile apps
CN109302522A (en) Test method, device and computer system and medium
CN105376335A (en) Method and device for collection data uploading
CN104966002B (en) The method and apparatus for identifying false mobile terminal
CN105515909B (en) A kind of data acquisition test method and apparatus
CN109885496B (en) Test log management method and system
CN107800757B (en) User behavior recording method and device
CN105373293A (en) Data acquisition method and apparatus
CN109491860A (en) Method for detecting abnormality, terminal device and the medium of application program
CN105577472A (en) Data acquisition test method and device
CN112363943B (en) Buried point setting method and device, computer equipment and storage medium
CN111654495B (en) Method, apparatus, device and storage medium for determining traffic generation source
CN108074033A (en) Processing method, system, electronic equipment and the storage medium of achievement data
CN105022694A (en) Test case generation method and system for mobile terminal test
CN105574150A (en) Data processing method and device
CN106980572B (en) Online debugging method and system for distributed system
CN105183658A (en) Software code testing method and device
CN114356631A (en) Fault positioning method and device, computer equipment and storage medium
CN105553770B (en) Data acquisition control method and device
CN114610799A (en) Data processing method and device based on environment monitoring and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20220721

Address after: Room 801, 8th floor, No. 104, floors 1-19, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100015

Patentee after: BEIJING QIHOO TECHNOLOGY Co.,Ltd.

Address before: 100088 room 112, block D, 28 new street, new street, Xicheng District, Beijing (Desheng Park)

Patentee before: BEIJING QIHOO TECHNOLOGY Co.,Ltd.

Patentee before: Qizhi software (Beijing) Co.,Ltd.