CN110471945A - Processing method, system, computer equipment and the storage medium of alive data - Google Patents
Processing method, system, computer equipment and the storage medium of alive data Download PDFInfo
- Publication number
- CN110471945A CN110471945A CN201910606335.0A CN201910606335A CN110471945A CN 110471945 A CN110471945 A CN 110471945A CN 201910606335 A CN201910606335 A CN 201910606335A CN 110471945 A CN110471945 A CN 110471945A
- Authority
- CN
- China
- Prior art keywords
- user
- data
- event
- information
- statistical criteria
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 37
- 238000012545 processing Methods 0.000 claims abstract description 13
- 238000004590 computer program Methods 0.000 claims description 12
- 238000001514 detection method Methods 0.000 claims description 4
- 238000011835 investigation Methods 0.000 claims description 2
- 238000004364 calculation method Methods 0.000 claims 1
- 238000000034 method Methods 0.000 abstract description 11
- 230000008569 process Effects 0.000 description 7
- 230000006399 behavior Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000009466 transformation Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013075 data extraction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The present invention relates to technical field of data processing, the present invention provides a kind of processing method and system of alive data, which comprises will bury the event information in an alive data and user information classification；Classification storage is carried out to event information according to event type, obtains Active event table；The user information of same subscriber is merged, classification storage is carried out to user information according to user property type, obtains user list；The Statistical Criteria for obtaining input, is associated inquiry according to Statistical Criteria from Active event table and user list, obtains target alive data.The above method, an alive data is buried according to classification storage, it can accordingly search to meet in the SS under each classification according to Statistical Criteria and bury an alive data under SS, the target alive data for meeting Statistical Criteria can be filtered out after association, script can be write to avoid according to the connection between SSs all types of in Statistical Criteria, workload is reduced, the efficiency that alive data is extracted is improved.
Description
Technical field
The present invention relates to technical field of data processing, specifically, the present invention relates to a kind of processing method of alive data,
Processing system, computer equipment and the storage medium of alive data.
Background technique
As business processing is carried out information-based propulsion by more and more business platforms, the welcome by users.
When in business platform towards user and can operation service type it is more, the flow of the business platform can increase accordingly very much.It is logical
It crosses and business platform is carried out after data are buried a little and counts alive data, can satisfy and the flow of business platform is analyzed, into
And the optimization demand or active user's demand of the business platform can be analyzed to a certain degree.
In the prior art, the alive data under the Statistical Criteria of agreement can be generally obtained by fixed interface, for
Other Statistical Criterias then need to write corresponding script to obtain alive data.But the process of script is write according to Statistical Criteria
Complexity reduces the efficiency that alive data is extracted.
Summary of the invention
The purpose of the present invention is intended at least can solve above-mentioned one of technological deficiency, and especially alive data extraction efficiency is low
Technological deficiency.
The present invention provides a kind of processing method of alive data, includes the following steps:
Obtain business platform buries an alive data, by the event information and user information minute buried in an alive data
Class；
Classification storage is carried out to the event information according to event type, obtains Active event table；
The user information of same subscriber is merged, classification is carried out to the user information according to user property type and is deposited
Storage, obtains user list；
Obtain input Statistical Criteria, according to the Statistical Criteria from the Active event table and the user list into
Row correlation inquiry obtains target alive data.
It is in one embodiment, described to obtain the step of burying alive data of business platform, comprising:
It obtains the original of business platform and buries point data, missing values detection and exceptional value inspection are carried out to the original point data of burying
It surveys, original with missing values and exceptional value is buried into point data and duplicate original bury a little is removed according to data, acquisition institute
It states and buries an alive data.
In one embodiment, described according to the Statistical Criteria from the Active event table and the user list
Before the step of being associated inquiry, further includes:
Receive it is newly-increased bury an alive data, from newly-increased the burying isolated in an alive data newly-increased event information and
Add User information；Classification storage is carried out to the newly-increased event information according to the event type, obtains delta events table, and
The delta events table is added to the Active event table；According to the user list described in information update that Adds User.
In one embodiment, after the described the step of delta events table is added to the Active event table,
Further include:
Receive the newly-increased upload data stroke count for burying an alive data；Record the first event of the Active event table
Item number and second event item number, and the difference of the first event item number and the second event item number is entered as into data strip
Number, wherein first event item number and second event item number respectively add the delta events table in the Active event table
The item number of pre and post event information；Judge whether the upload data stroke count is equal to the logging data item number；In
When the upload data stroke count is equal to the logging data item number, determine that the data of the Active event table are complete, and execute institute
State the step of inquiry is associated from the Active event table and the user list according to the Statistical Criteria；On described
When passing data stroke count not equal to the logging data item number, the prompting message for indicating data exception is generated.
In one embodiment, it is described according to the Statistical Criteria from the Active event table and the user list into
The step of row correlation inquiry, comprising:
Departure event Statistical Criteria and user property Statistical Criteria from the Statistical Criteria；In the Active event table tune
Take the object event information for belonging to the event statistics bore；It is transferred in the user list and the object event information institute
Target user's information of association user；Target user's information is screened according to the user property Statistical Criteria, is enlivened
User information；Any active ues information is counted, obtains the target alive data, and draw user's map.
In one embodiment, it is described according to the Statistical Criteria from the Active event table and the user list into
The step of row correlation inquiry, comprising:
The event statistics bore and the user property Statistical Criteria are separated from the Statistical Criteria；In the user
The target user's information for belonging to the user property Statistical Criteria is transferred in list；It is transferred and the mesh in the Active event table
Mark the object event information of user associated by user information；Statistics belongs to the event statistics mouth from the object event information
The target alive data of diameter.
In one embodiment, the step of acquisition Statistical Criteria, comprising:
Using bore data acquired in label generator as parameter tags, the parameter tags are saved and shown,
In, the label generator is for generating parameter tags relevant to event type and/or user property type；Get parms pond
Parameter tags in son, and the Statistical Criteria is generated according to the parameter tags in the parameter pond, wherein the parameter pond
Son corresponds to the input frame of Statistical Criteria for parameter tags for identification.
The present invention also provides a kind of processing systems of alive data, comprising:
Categorization module buries an alive data for obtain business platform, and the event buried in an alive data is believed
Breath and user information classification；
Memory module obtains Active event table for carrying out classification storage to the event information according to event type；
Merging module, for merging the user information of same subscriber, according to user property type to the user
Information carries out classification storage, obtains user list；
Enquiry module, for obtaining the Statistical Criteria of input, according to the Statistical Criteria from the Active event table and institute
It states and is associated inquiry in user list, obtain target alive data.
The present invention also provides a kind of computer equipment, including memory, processor and storage on a memory and can located
The computer program run on reason device, the processor are realized living described in any of the above-described embodiment when executing the computer program
The step of processing method for the data that jump.
The present invention also provides a kind of storage mediums for being stored with computer-readable instruction, are stored thereon with computer program,
The computer program realizes the step of processing method of alive data described in any of the above-described embodiment when being executed by processor.
Processing method, system, computer equipment and the storage medium of above-mentioned alive data, bury an alive data by
According to classification storage, it can accordingly search and meet under SS in the SS under each classification according still further to Statistical Criteria
An alive data is buried, and the alive data of burying met under SS under each classification is associated, can be filtered out full
The target alive data of sufficient Statistical Criteria avoids writing script according to the connection between SSs all types of in Statistical Criteria,
Workload is reduced, the efficiency that alive data is extracted is improved.
The additional aspect of the present invention and advantage will be set forth in part in the description, these will become from the following description
Obviously, or practice through the invention is recognized.
Detailed description of the invention
Above-mentioned and/or additional aspect and advantage of the invention will become from the following description of the accompanying drawings of embodiments
Obviously and it is readily appreciated that, in which:
Fig. 1 is the implementation environment figure of the processing method of the alive data provided in one embodiment；
Fig. 2 is the flow chart of the processing method of alive data in one embodiment；
Fig. 3 is the flow chart of the processing method of alive data in one embodiment；
Fig. 4 is the structural schematic diagram of the processing system of alive data in one embodiment；
Fig. 5 is the schematic diagram of internal structure of computer equipment in one embodiment.
Specific embodiment
The embodiment of the present invention is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, and for explaining only the invention, and is not construed as limiting the claims.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singular " one " used herein, " one
It is a ", " described " and "the" may also comprise plural form.Those skilled in the art of the present technique are appreciated that unless otherwise defined, here
All terms (including technical terms and scientific terms) used have with the those of ordinary skill's in fields of the present invention
It is commonly understood by identical meaning.It should also be understood that those terms such as defined in the general dictionary, it should be understood that tool
Have with the consistent meaning of meaning in the context of the prior art, and unless otherwise will not by specific definitions as here
It is explained in an idealized or overly formal meaning.
As shown in FIG. 1, FIG. 1 is the implementation environment figures of the processing method of the alive data provided in one embodiment, at this
In implementation environment, including computer equipment 110 and business platform 120.
Computer equipment 110 is connect with business platform 120.Can have data on business platform 120 to bury a little, data are buried a little
It can be used for the acquisition of alive data in subsequent progress business platform 120.Computer equipment 110 has the energy of operation and storage
Power can analyze the alive data in business platform 120.Computer equipment 110 can for laptop, desktop computer etc.,
However, it is not limited to this.
In one embodiment, as shown in Fig. 2, Fig. 2 is the flow chart of the processing method of alive data in one embodiment,
A kind of processing method of alive data is proposed in the present embodiment, the processing method of the alive data can be applied to above-mentioned meter
It calculates in machine equipment 110, can specifically include following steps:
Step S210: obtain business platform buries an alive data, will bury the event information in an alive data and user
Information classification.
In this step, burying an alive data can recorde relationship between user and behavior event, thus can by point
It is other to process to burying data relevant and related to user to behavior event in an alive data, it obtains burying an alive data
In event information and user information.
Specifically, the step of burying alive data of business platform is obtained in step S210, may include:
It obtains the original of business platform and buries point data, missing values detection and rejecting outliers are carried out to original point data of burying,
Original with missing values and exceptional value is buried into point data and duplicate original bury a little is removed according to data, work is buried in acquisition
Jump data.
It is usually buried according to data and a little point data of burying original in business platform is acquired, original after acquisition buries points
There is a problem that missing, exception, repetition, noise according to occasional.The mode of an alive data is buried in above-mentioned acquisition, can be passed through
Original point data of burying is cleaned, and original with missing values and exceptional value is buried point data respectively and duplicate original is buried a little
It is removed according to data, i.e. there is the original of unfavorable condition to bury point data for removal, obtains data and completely buries an alive data, can
With avoid as far as possible it is subsequent bury the processing of alive data when because of error caused by data exception, reduce error rate.
Step S220: classification storage is carried out to event information according to event type, obtains Active event table.
In this step, classify according to event type to event information, storage has determined that the event information of event type
With the event type, i.e., an alive data is buried according to event type storage.Wherein, event type can be mentioned according to business platform
Business, the function of confession carry out planning and designing, can pre-define several event types.In the industry by taking Bank Insurance business as an example
It is engaged in platform, can divide and publish the events class such as event including declaration form event, user's transformation event, customer registration affair, login
Type, the type of service and business datum of the event type divided often concern relevant to its business department are related.
Step S230: the user information of same subscriber is merged, and is carried out according to user property type to user information
Classification storage obtains user list.
User can operate multiple events in business platform, therefore part buries an alive data and can come from identical use
Family merges same subscriber and is burying the user information in an alive data, and the same user is with a user information, it is possible to reduce
Repetition storage to user information.In this step, according to the user information of no duplicate customer, it can include to bury work to generating
The user list of all user's corresponding user informations in the data that jump；The user property type of user information can also be determined simultaneously.
Wherein, the type of user property type is more, is more conducive to adapt to the high Statistical Criteria of fineness, or is conducive to draw finely
User's map.To the process that user information is classified, the corresponding user property class of various information in user information can be determined
Type, and various information and corresponding user property type association are stored.User information may include user's gender, user
Age, user location, user's occupation, the various information such as amount of money in user account, user property type may include gender,
The types such as age, area, occupation, account amount of money, by user's Gender Classification in user information for sex types and with gender class
Type stores user's gender, so analogizes the age of user stored in the user information, user location, user's duty
The information such as amount of money in industry, user account.
Step S240: obtaining the Statistical Criteria of input, is carried out from Active event table and user list according to Statistical Criteria
Correlation inquiry obtains target alive data.
In this step, inquiry meets the target alive data of Statistical Criteria in Active event table and user list.
Wherein, may include: the step of acquisition Statistical Criteria in step S240
S241: using bore data acquired in label generator as parameter tags, saving simultaneously display parameters label,
In, label generator is for generating parameter tags relevant to event type and/or user property type.
In this step, user inputs bore data by the visualized operation page in label generator, by the bore number
According to as parameter tags, parameter tags can represent some for indicating the bore data of SS.The parameter tags
It may be displayed on the visualized operation page, and can be dragged.It can establish to the mode of label generator input bore data
The parameter tags, label generator can also pre-define common bore data as parameter tags.
After parameter tags are dragged to parameter pond by user, S242: the ginseng in the pond that can identify and get parms
Number label, and Statistical Criteria is generated according to the parameter tags in parameter pond, wherein parameter pond is parameter tags for identification
The input frame of corresponding Statistical Criteria.
In this step, parameter tags in identification parameter pond can be according to the corresponding bore number of institute's identification parameter label
According to counting statistics bore, avoids passing through and write script to determine Statistical Criteria, reduce workload.
In the mode of the Statistical Criteria of above-mentioned acquisition input, can under visualization quick direct construction Statistical Criteria, drop
The workload of low determining Statistical Criteria improves the efficiency that alive data is extracted.
The processing method of above-mentioned alive data buries an alive data according to classification storage, exists according still further to Statistical Criteria
SS under each classification can accordingly search the alive data of burying met under SS, and will be under each classification
The alive data of burying met under SS is associated, and can be filtered out the target alive data for meeting Statistical Criteria, be kept away
Exempt to write script according to the connection between SSs all types of in Statistical Criteria, reduce workload, improves alive data and extract
Efficiency.
Further, after obtaining user list, Active event table and user list can be stored in refreshing plan system
Database in, and by refreshing plan system to operation is associated between Active event table and user list, in order to subsequent progress
Correlation inquiry.
In one embodiment, it is closed from Active event table and user list in step S240 according to Statistical Criteria
Before the step of joint investigation is ask, can also include:
S251: receive it is newly-increased bury an alive data, newly-increased event information is isolated in an alive data from newly-increased burying
With the information that Adds User.
It in this step, receives and buries the incremental data that an alive data increases newly within the certain predetermined time, i.e., newly-increased buries a little
Alive data.
S252: carrying out classification storage to newly-increased event information according to event type, obtain delta events table, and by increment thing
Part table is added to Active event table.
In this step, Active event table is added in a manner of adding increment to newly-increased temporal information, it specifically can be to new
Increase after event information is classified and be stored as delta events table, and delta events table is incorporated into Active event table.
S253: according to the information update user list that Adds User.
It,, can after receiving incremental data since the user information of same subscriber in user list does not repeat in this step
To update user list according to the user information for merging same subscriber；The information that can also be Added User by comparison and user arrange
The user information of table searches there is no the information that Adds User in user list, which is added to user list,
Complete the update of user list.
The processing method of above-mentioned alive data increases data newly by receiving in the certain predetermined time, a little active number is buried in update
According to corresponding Active event table and user list, do not need to receive magnanimity every time buries an alive data, avoids waste data
The resource of transmission and data storage, can reduce cost.
It in one embodiment, can be with after the step of delta events table being added to Active event table in S251
Include:
S261: the newly-increased upload data stroke count for burying an alive data is received.
In this step, can receive it is newly-increased bury alive data while, while the increment of received data.
S262: the first event item number and second event item number of record Active event table, and by first event article number and the
The difference of two event item numbers enters as number of data, wherein first event item number and second event item number are respectively active
The item number of the pre and post event information of delta events table is added in event table.
In this step, the increment of data in the Active event table after calculating newly-increased event information.
S263: judge to upload whether data stroke count is equal to logging data item number.
In this step, judge whether received increment is corresponding with the increment of storing data, it can judgement uploads data pen
Whether number is equal to logging data item number.
S264: when uploading data stroke count equal to logging data item number, determine that the data of Active event table are complete, and execute
The step of being associated inquiry from Active event table and user list according to Statistical Criteria.
In this step, when received increment with the increment of storing data be it is corresponding, can be and upload data stroke count and be equal to
Logging data item number, then it represents that receive and storage data be it is consistent, ensure data it is complete after, can continue to hold
The subsequent step of row.
S265: it when uploading data stroke count not equal to logging data item number, generates the prompting for indicating data exception and believes
Breath.
In this step, when the increment of received increment and storing data is to have differences, it can be and upload data stroke count not
Equal to logging data item number, then it represents that shortage of data or data exception occur in transmission or storing process, can be generated and send
The prompting message for indicating data exception, for reminding.
The processing method of above-mentioned alive data, newly-increased data are verified by received increment and the increment of storing data is
It is no to meet consistency, the integrality for burying an alive data after can ensureing newly-increased data.
In one embodiment, it is associated from Active event table and user list in step S240 according to Statistical Criteria
The step of inquiry may include:
A1: departure event Statistical Criteria and user property Statistical Criteria from Statistical Criteria.
A2: the object event information for belonging to event statistics bore is transferred in Active event table.
A3: target user's information with user associated by object event information is transferred in user list.
A4: target user's information is screened according to user property Statistical Criteria, obtains any active ues information.
A5: statistics any active ues information obtains target alive data, and draw user's map.
The processing method of above-mentioned alive data, according to the corresponding object event information of event statistics bore in Statistical Criteria,
Again be associated inquiry under user property Statistical Criteria, and count any active ues information, obtain target alive data, Ke Yigen
User's map is drawn according to the target alive data.
In one embodiment, it is associated from Active event table and user list in step S240 according to Statistical Criteria
The step of inquiry may include:
B1: departure event Statistical Criteria and user property Statistical Criteria from Statistical Criteria.
B2: the target user's information for belonging to user property Statistical Criteria is transferred in user list.
B3: the object event information with user associated by target user's information is transferred in Active event table.
B4: statistics belongs to the target alive data of event statistics bore from object event information.
The processing method of above-mentioned alive data, according to user property Statistical Criteria in Statistical Criteria, corresponding target user believes
Breath, then be associated inquiry under event statistics bore, available target alive data after statistics object event information.
In another embodiment, as shown in figure 3, Fig. 3 is the process of the processing method of alive data in one embodiment
Figure, the present embodiment provides a kind of processing methods of alive data, can specifically include following steps:
S310: obtaining the original of business platform and bury point data, to it is original bury point data cleaned and obtain bury it is a little active
Data.Missing values detection and rejecting outliers are carried out to original point data of burying, will be buried a little with missing values and the original of exceptional value
Data and duplicate original bury a little are removed according to data, and an alive data is buried in acquisition.
S320: the event information in an alive data and user information classification will be buried.
S330: classification storage is carried out to event information according to event type, obtains Active event table.According to event type pair
Event information is classified, and storage has determined that the event information and the event type of event type, i.e., stores according to event type
Bury an alive data.Wherein, event type business according to provided by business platform, function carry out planning and designing, can be with
Pre-define several event types.In the business platform by taking Bank Insurance business as an example, can divide including declaration form event,
The event types such as event are published in user's transformation event, customer registration affair, login, the event type divided often with its business
The type of service of the relevant concern of department is related with business datum.
S340: the user information of same subscriber is merged, and is classified according to user property type to user information
Storage, obtains user list.User can operate multiple events in business platform, therefore part is buried an alive data and can be come from
Identical user, the same user have a user information, to reduce the user information for repeating storage, merge same subscriber and exist
Bury the user information in an alive data.In this step, according to the user information of no duplicate customer, it can include to bury to generating
The user list of all user's corresponding user informations in point alive data；The user property type of user information is also determined simultaneously.
Wherein, the type of user property type is more, is more conducive to adapt to the high Statistical Criteria of fineness, or is conducive to draw finely
User's map.
S350: receiving a newly-increased alive data of burying, and updates Active event table and user list.What reception increased newly buries work
The upload data stroke count for the data that jump.Newly-increased event information is isolated in an alive data from newly-increased burying and the information that Adds User.
Classification storage is carried out to newly-increased event information according to event type, obtains delta events table, and delta events table is added to work
Jump event table.According to the information update user list that Adds User.
S360: the data consistency after updating in Active event table and user list is examined.Record the of Active event table
One event item number and second event item number, and the difference of first event item number and second event item number is entered as into data strip
Number, wherein first event item number and second event item number respectively add the sum before delta events table in Active event table
The item number of event information later.Judge to upload whether data stroke count is equal to logging data item number.It is equal to uploading data stroke count
When logging data item number, determine that the data of Active event table are complete, and execute according to Statistical Criteria from Active event table and user
The step of inquiry is associated in list.When uploading data stroke count not equal to logging data item number, generate for indicating data
Abnormal prompting message.
S370: the Statistical Criteria of input is obtained.Bore data are inputted in label generator and generate parameter tags, are saved
And display parameters label, wherein label generator is for generating parameter mark relevant to event type and/or user property type
Label.After parameter tags are dragged to parameter pond, parameter tags in available parameter pond, and according to parameter pond
In parameter tags generate Statistical Criteria, wherein parameter pond is that parameter tags correspond to the input frame of Statistical Criteria for identification.
S380: inquiry is associated from Active event table and user list according to Statistical Criteria, target is obtained and actively counts
According to.
Departure event Statistical Criteria and user property Statistical Criteria from Statistical Criteria；It is transferred in Active event table and belongs to thing
The object event information of part Statistical Criteria；It transfers in user list and believes with the target user of user associated by object event information
Breath；Target user's information is screened according to user property Statistical Criteria, obtains any active ues information；Any active ues information is counted, is obtained
To target alive data, and draw user's map.
Alternatively, departure event Statistical Criteria and user property Statistical Criteria from Statistical Criteria；It is transferred in user list
Belong to target user's information of user property Statistical Criteria；It transfers in Active event table with user's associated by target user's information
Object event information；Statistics belongs to the target alive data of event statistics bore from object event information.
The processing method of above-mentioned alive data buries an alive data according to classification storage, exists according still further to Statistical Criteria
SS under each classification can accordingly search the alive data of burying met under SS, and will be under each classification
The alive data of burying met under SS is associated, and can be filtered out the target alive data for meeting Statistical Criteria, be kept away
Exempt to write script according to the connection between SSs all types of in Statistical Criteria, reduce workload, improves alive data and extract
Efficiency.Quick direct construction Statistical Criteria, reduction the workload of Statistical Criteria can be determined under visualization simultaneously, improve and live
The efficiency that the data that jump are extracted.
In one embodiment, as shown in figure 4, the structure that Fig. 4 is the processing system of alive data in one embodiment is shown
It is intended to, provides a kind of processing system of alive data in the present embodiment, may include categorization module 410, memory module 420, closes
And module 430 and enquiry module 440, in which:
Categorization module 410 buries an alive data for obtain business platform, will bury the event information in an alive data
Classify with user information.
In categorization module 410, burying an alive data can recorde relationship between user and behavior event, therefore can lead to
It crosses and processes respectively to burying data relevant and related to user to behavior event in an alive data, obtain burying a little active
Event information and user information in data.
Memory module 420 obtains Active event table for carrying out classification storage to event information according to event type.
Memory module 420 can classify to event information according to event type, and storage has determined that the thing of event type
Part information and the event type, i.e., bury an alive data according to event type storage.Wherein, event type can be flat according to business
Business provided by platform, function carry out planning and designing, can pre-define several event types.It is being with Bank Insurance business
In the business platform of example, it can divide and publish event etc. including declaration form event, user's transformation event, customer registration affair, login
Event type, the type of service and business datum of the event type divided often concern relevant to its business department are related.
Merging module 430 believes user according to user property type for merging the user information of same subscriber
Breath carries out classification storage, obtains user list.
User can operate multiple events in business platform, therefore part buries an alive data and can come from identical use
Family merges same subscriber and is burying the user information in an alive data, and the same user is with a user information, it is possible to reduce
Repetition storage to user information.Merging module 430, according to the user information of no duplicate customer, it can include to bury to generating
The user list of all user's corresponding user informations in point alive data；The user property class of user information can also be determined simultaneously
Type.Wherein, the type of user property type is more, is more conducive to adapt to the high Statistical Criteria of fineness, or is conducive to draw essence
Thin user's map.To the process that user information is classified, it can determine that the corresponding user of various information belongs in user information
Property type, and various information and corresponding user property type association are stored.User information may include user's gender,
Age of user, user location, user's occupation, various information, the user property type such as amount of money may include in user account
The types such as gender, age, area, occupation, account amount of money, by user's Gender Classification in user information for sex types and with property
Other type stores user's gender, so analogizes the age of user stored in the user information, user location, uses
The information such as amount of money in family occupation, user account.
Enquiry module 440, for obtaining the Statistical Criteria of input, according to Statistical Criteria from Active event table and user list
In be associated inquiry, obtain target alive data.
Enquiry module 440 can be inquired in Active event table and user list to be met the target of Statistical Criteria and actively counts
According to.
The processing system of above-mentioned alive data buries an alive data according to classification storage, exists according still further to Statistical Criteria
SS under each classification can accordingly search the alive data of burying met under SS, and will be under each classification
The alive data of burying met under SS is associated, and can be filtered out the target alive data for meeting Statistical Criteria, be kept away
Exempt to write script according to the connection between SSs all types of in Statistical Criteria, reduce workload, improves alive data and extract
Efficiency.
The specific of processing system about alive data limits the processing method that may refer to above for alive data
Restriction, details are not described herein.Modules in the processing system of above-mentioned alive data can be fully or partially through software, hard
Part and combinations thereof is realized.Above-mentioned each module can be embedded in the form of hardware or independently of in the processor in computer equipment,
It can also be stored in a software form in the memory in computer equipment, execute the above modules in order to which processor calls
Corresponding operation.
As shown in figure 5, Fig. 5 is the schematic diagram of internal structure of computer equipment in one embodiment.The computer equipment packet
Include processor, non-volatile memory medium, memory and the network interface connected by system bus.Wherein, which sets
Standby non-volatile memory medium is stored with operating system and computer program, can when which is executed by processor
So that processor realizes a kind of processing method of alive data.The processor of the computer equipment calculates and controls energy for providing
Power supports the operation of entire computer equipment.Computer program can be stored in the memory of the computer equipment, the computer
When program is executed by processor, processor may make to execute a kind of processing method of alive data.The network of the computer equipment
Interface is used for and terminal connection communication.It will be understood by those skilled in the art that structure shown in Fig. 5, only and the application
The block diagram of the relevant part-structure of scheme, does not constitute the restriction for the computer equipment being applied thereon to application scheme,
Specific computer equipment may include perhaps combining certain components than more or fewer components as shown in the figure or having
Different component layouts.
In one embodiment it is proposed that a kind of computer equipment, including memory, processor and storage are on a memory
And the computer program that can be run on a processor, processor are realized in any of the above-described embodiment when executing the computer program
The step of processing method of alive data.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated
Machine program realizes the step of processing method of alive data in any of the above-described embodiment when being executed by processor.
It should be understood that although each step in the flow chart of attached drawing is successively shown according to the instruction of arrow,
These steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps
Execution there is no stringent sequences to limit, can execute in the other order.Moreover, at least one in the flow chart of attached drawing
Part steps may include that perhaps these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps
Completion is executed, but can be executed at different times, execution sequence, which is also not necessarily, successively to be carried out, but can be with other
At least part of the sub-step or stage of step or other steps executes in turn or alternately.
The above is only some embodiments of the invention, it is noted that for the ordinary skill people of the art
For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered
It is considered as protection scope of the present invention.
Claims (10)
1. a kind of processing method of alive data, which comprises the steps of:
Obtain business platform buries an alive data, and the event information buried in an alive data and user information are classified；
Classification storage is carried out to the event information according to event type, obtains Active event table；
The user information of same subscriber is merged, classification storage is carried out to the user information according to user property type,
Obtain user list；
The Statistical Criteria for obtaining input, is closed from the Active event table and the user list according to the Statistical Criteria
Joint investigation is ask, and target alive data is obtained.
2. the processing method of alive data according to claim 1, which is characterized in that described to obtain burying a little for business platform
The step of alive data, comprising:
It obtains the original of business platform and buries point data, missing values detection and rejecting outliers are carried out to the original point data of burying,
Original with missing values and exceptional value is buried into point data and duplicate original bury a little is removed according to data, is buried described in acquisition
Point alive data.
3. the processing method of alive data according to claim 1, which is characterized in that described according to the Statistical Criteria
Before the step of being associated inquiry in the Active event table and the user list, further includes:
What reception increased newly buries an alive data, isolates newly-increased event information in an alive data from newly-increased the burying and increases newly
User information；
Classification storage is carried out to the newly-increased event information according to the event type, obtains delta events table, and by the increasing
Amount event table is added to the Active event table；
According to the user list described in information update that Adds User.
4. the processing method of alive data according to claim 3, which is characterized in that described by the delta events table
After the step of being added to the Active event table, further includes:
Receive the newly-increased upload data stroke count for burying an alive data；
Record the first event item number and second event item number of the Active event table, and by the first event item number and described
The difference of second event item number enters as number of data, wherein first event item number and second event item number are respectively in institute
State the item number that the pre and post event information of delta events table is added in Active event table；
Judge whether the upload data stroke count is equal to the logging data item number；
When the upload data stroke count is equal to the logging data item number, determine that the data of the Active event table are complete, and
Execute described the step of inquiry is associated from the Active event table and the user list according to the Statistical Criteria；
When the upload data stroke count is not equal to the logging data item number, generates the prompting for indicating data exception and believe
Breath.
5. the processing method of alive data according to claim 1, which is characterized in that it is described according to the Statistical Criteria from
The step of being associated inquiry in the Active event table and the user list, comprising:
Departure event Statistical Criteria and user property Statistical Criteria from the Statistical Criteria；
The object event information for belonging to the event statistics bore is transferred in the Active event table；
Target user's information with user associated by the object event information is transferred in the user list；
Target user's information is screened according to the user property Statistical Criteria, obtains any active ues information；
Any active ues information is counted, obtains the target alive data, and draw user's map.
6. the processing method of alive data according to claim 1, which is characterized in that it is described according to the Statistical Criteria from
The step of being associated inquiry in the Active event table and the user list, comprising:
The event statistics bore and the user property Statistical Criteria are separated from the Statistical Criteria；
The target user's information for belonging to the user property Statistical Criteria is transferred in the user list；
The object event information with user associated by target user's information is transferred in the Active event table；
Statistics belongs to the target alive data of the event statistics bore from the object event information.
7. the processing method of alive data according to claim 1, which is characterized in that the step for obtaining Statistical Criteria
Suddenly, comprising:
Using bore data acquired in label generator as parameter tags, saves and show the parameter tags, wherein institute
State label generator for generate relevant to event type and/or user property type parameter tags；
The parameter tags to get parms in pond, and the Statistical Criteria is generated according to the parameter tags in the parameter pond,
Wherein, the parameter pond is the input frame that parameter tags correspond to Statistical Criteria for identification.
8. a kind of processing system of alive data characterized by comprising
Categorization module buries an alive data for obtain business platform, by the event information buried in an alive data and
User information classification；
Memory module obtains Active event table for carrying out classification storage to the event information according to event type；
Merging module, for merging the user information of same subscriber, according to user property type to the user information
Classification storage is carried out, user list is obtained；
Enquiry module, for obtaining the Statistical Criteria of input, according to the Statistical Criteria from the Active event table and the use
It is associated inquiry in the list of family, obtains target alive data.
9. a kind of computer equipment including memory, processor and stores the meter that can be run on a memory and on a processor
Calculation machine program, which is characterized in that the processor realizes any one of claims 1 to 7 institute when executing the computer program
The step of stating the processing method of alive data.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of processing method of alive data described in any one of claims 1 to 7 is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910606335.0A CN110471945B (en) | 2019-07-05 | 2019-07-05 | Active data processing method, system, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910606335.0A CN110471945B (en) | 2019-07-05 | 2019-07-05 | Active data processing method, system, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110471945A true CN110471945A (en) | 2019-11-19 |
| CN110471945B CN110471945B (en) | 2024-02-06 |
Family
ID=68506766
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910606335.0A Active CN110471945B (en) | 2019-07-05 | 2019-07-05 | Active data processing method, system, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110471945B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111752799A (en) * | 2020-06-24 | 2020-10-09 | 中国建设银行股份有限公司 | Service link tracking method, device, equipment and storage medium |
| CN112579408A (en) * | 2020-10-29 | 2021-03-30 | 上海钱拓网络技术有限公司 | Classification method of embedded point information |
| CN112966174A (en) * | 2019-12-13 | 2021-06-15 | 北京默契破冰科技有限公司 | Method, apparatus, and computer storage medium for processing data |
| CN114168430A (en) * | 2022-01-06 | 2022-03-11 | 携程旅游网络技术（上海）有限公司 | Front-end abnormal alarm configuration method, system, equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105227751A (en) * | 2014-06-30 | 2016-01-06 | 腾讯科技（深圳）有限公司 | The method and system of realization event information digitalization |
| CN106557513A (en) * | 2015-09-29 | 2017-04-05 | 腾讯科技（深圳）有限公司 | Event information method for pushing and event information pusher |
| CN106980769A (en) * | 2017-04-05 | 2017-07-25 | 张莹 | A kind of destination client category system |
| CN107368488A (en) * | 2016-05-12 | 2017-11-21 | 阿里巴巴集团控股有限公司 | A kind of method for determining user behavior preference, the methods of exhibiting and device of recommendation information |
| CN107402910A (en) * | 2017-07-07 | 2017-11-28 | 北京今目标信息技术有限公司 | Data managing method, equipment and computer-readable recording medium based on list |
| US20180025071A1 (en) * | 2016-07-20 | 2018-01-25 | LogsHero Ltd. | Automatic event classification |
| CN109150641A (en) * | 2017-06-15 | 2019-01-04 | 北京国双科技有限公司 | A kind of data acquisition, querying method, device, storage medium and processor |
| CN109767259A (en) * | 2018-12-15 | 2019-05-17 | 深圳壹账通智能科技有限公司 | Based on operation event promotion method, apparatus, equipment and the medium for burying point data |
-
2019
- 2019-07-05 CN CN201910606335.0A patent/CN110471945B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105227751A (en) * | 2014-06-30 | 2016-01-06 | 腾讯科技（深圳）有限公司 | The method and system of realization event information digitalization |
| CN106557513A (en) * | 2015-09-29 | 2017-04-05 | 腾讯科技（深圳）有限公司 | Event information method for pushing and event information pusher |
| CN107368488A (en) * | 2016-05-12 | 2017-11-21 | 阿里巴巴集团控股有限公司 | A kind of method for determining user behavior preference, the methods of exhibiting and device of recommendation information |
| US20180025071A1 (en) * | 2016-07-20 | 2018-01-25 | LogsHero Ltd. | Automatic event classification |
| CN106980769A (en) * | 2017-04-05 | 2017-07-25 | 张莹 | A kind of destination client category system |
| CN109150641A (en) * | 2017-06-15 | 2019-01-04 | 北京国双科技有限公司 | A kind of data acquisition, querying method, device, storage medium and processor |
| CN107402910A (en) * | 2017-07-07 | 2017-11-28 | 北京今目标信息技术有限公司 | Data managing method, equipment and computer-readable recording medium based on list |
| CN109767259A (en) * | 2018-12-15 | 2019-05-17 | 深圳壹账通智能科技有限公司 | Based on operation event promotion method, apparatus, equipment and the medium for burying point data |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112966174A (en) * | 2019-12-13 | 2021-06-15 | 北京默契破冰科技有限公司 | Method, apparatus, and computer storage medium for processing data |
| CN111752799A (en) * | 2020-06-24 | 2020-10-09 | 中国建设银行股份有限公司 | Service link tracking method, device, equipment and storage medium |
| CN112579408A (en) * | 2020-10-29 | 2021-03-30 | 上海钱拓网络技术有限公司 | Classification method of embedded point information |
| CN114168430A (en) * | 2022-01-06 | 2022-03-11 | 携程旅游网络技术（上海）有限公司 | Front-end abnormal alarm configuration method, system, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110471945B (en) | 2024-02-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110471945A (en) | Processing method, system, computer equipment and the storage medium of alive data | |
| CN109118296A (en) | Movable method for pushing, device and electronic equipment | |
| CN111915366B (en) | User portrait construction method, device, computer equipment and storage medium | |
| CN107909178B (en) | Electronic device, loss of association repair rate prediction method, and computer-readable storage medium | |
| CN105556552A (en) | Fraud detection and analysis | |
| CN108021651A (en) | Network public opinion risk assessment method and device | |
| US20130212155A1 (en) | Processing event instance data in a client-server architecture | |
| CN111881221A (en) | Method, device and equipment for customer portrait in logistics service | |
| CN113537850A (en) | Storage optimization method and device, computer equipment and storage medium | |
| CN113268403A (en) | Time series analysis and prediction method, device, equipment and storage medium | |
| CN109409948B (en) | Transaction abnormity detection method, device, equipment and computer readable storage medium | |
| CN110704699A (en) | Data image construction method and device, computer equipment and storage medium | |
| CN115994079A (en) | Test method, test device, electronic apparatus, storage medium, and program product | |
| CN114723554B (en) | Abnormal account identification method and device | |
| CN111553803A (en) | Claims processing method and device | |
| CN114004712B (en) | Service value chain construction method based on event log | |
| Nadaf et al. | Data mining in telecommunication | |
| CN113065894A (en) | Data collection method and device based on user portrait and order analysis and storage medium | |
| CN110309211A (en) | A kind of method and relevant device positioning ETL Process Problems | |
| JP2013069223A (en) | Generation program, generation method, and generation device | |
| CN111078816B (en) | Position-based analysis method, device, terminal and storage medium | |
| CN109739401B (en) | User characteristic data management system, interface display method thereof and related equipment | |
| US10380266B2 (en) | Method and system for analyzing data in a database | |
| CN116862582A (en) | Business abnormality detection method and device and computer equipment | |
| CN116910352A (en) | Report recommending method, device, equipment and medium based on artificial intelligence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |