CN106982253A - A kind of user's portrait analysis method and device, network system - Google Patents
A kind of user's portrait analysis method and device, network system Download PDFInfo
- Publication number
- CN106982253A CN106982253A CN201710188900.7A CN201710188900A CN106982253A CN 106982253 A CN106982253 A CN 106982253A CN 201710188900 A CN201710188900 A CN 201710188900A CN 106982253 A CN106982253 A CN 106982253A
- Authority
- CN
- China
- Prior art keywords
- user
- data
- portrait
- code stream
- initial data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Abstract
The embodiment provides a kind of user portrait analysis method and device, network system, it is related to network communication technology field, when solving the method parsing user's portrait analyzed again using storage by third company or self-built analysis platform in the prior art, there is the problem of time delay is very high, storage hardware cost is high.The device includes, data capture unit, for obtaining the initial data code stream that PGW is exported in real time, and reads PGW in real time to the first data of the user generated after the progress DPI parsings of initial data code stream；Processing unit, the initial data code stream for being obtained to data capture unit generates the second data of user in the way of concurrent operation；Data generating unit, for the second data of the first data and the processing unit generation read according to data capture unit, the statistic analysis result of user's portrait of generation user is simultaneously sent to third party's shared platform.The embodiment of the present invention is used for the manufacture of user's portrait device.
Description
Technical field
The present invention relates to network communication technology field, more particularly to a kind of user portrait analysis method and device, network system
System.
Background technology
Pure pipeline operation mode refers to that mobile operator is provided solely for the service that user is linked into network, i.e., traditional width
Band online or the online of mobile phone mobile data services；And as internet, cloud computing, big data are continued to develop, pure pipeline fortune
The development that the pattern of battalion has been out of step with the times, mobile operator begins attempt to the Model Transformation runed from pure pipeline, utilizes the palm
The mass users data held, carry out big data analysis, go to drive the upgrading of enterprise value, provide the user more preferable service.
In the prior art, third generation partner program (English full name：3rd Generation Partnership
Project, referred to as：Mobile core network equipment as defined in 3GPP) does not parse user and draws a portrait this function (without this function
Have no effect on user and normally use business), in order to obtain comprehensively and accurately user's portrait, mobile operator spares no expense huge
Manpower and materials cost, the stream compression of mobile core network is moved on in foreign medium and stored, then these data are led
Go out the analysis that data are carried out to third company or self-built analysis platform；And the method that this storage is analyzed again, at least deposit
Following not enough：
First, time delay is very high
On the one hand it is time delay (even most fast storage device solid state hard disc (the English full name of storing process：Solid
State Drives, referred to as：SSD), time loss is also considerable, is on the other hand that there is also processing for external system
Time delay, it is impossible to reach quick analysis, quick application；
2nd, storage hardware cost is high
The adept machine of user is in not wireless net (English full name：WIreless-Fidelity, referred to as：Wifi) produced under environment
Internet data be very huge (PB (9.0072e+15 bits) level can be reached), in order to store this kind of data need it is a large amount of
Storage hardware deposit these Internet datas, so as to cause third company or self-built analysis platform is in storage hardware
Substantial amounts of fund can be spent in cost.
From the foregoing, analyzed again using storage by third company or self-built analysis platform in the prior art
During method parsing user's portrait, there is the problem of time delay is very high, storage hardware cost is high.
The content of the invention
Embodiments of the invention provide a kind of user's portrait analysis method and device, network system, solve prior art
In the method analyzed again using storage by third company or self-built analysis platform when parsing user and drawing a portrait, there is time delay
It is very high, the problem of storage hardware cost is high.
To reach above-mentioned purpose, embodiments of the invention are adopted the following technical scheme that：
First aspect, embodiments of the invention carry a kind of user's portrait resolver, including：
Data capture unit, for obtaining the initial data code stream that PGW in mobile core network is exported in real time, and reads movement
PGW carries out the first data of the user generated after deep message detection DPI parsings to initial data code stream in real time in core net；
Processing unit, the initial data code stream for being obtained to data capture unit is generated and used in the way of concurrent operation
Second data at family；
Data generating unit, for the second number of the first data and the processing unit generation read according to data capture unit
According to, the statistic analysis result of user's portrait of generation user is simultaneously sent to third party's shared platform, wherein, third party's shared platform
The statistic analysis result that user for real-time presentation user draws a portrait.
Specifically, the device also includes：
Memory cell, the statistic analysis result of user's portrait of the user generated for data storage generation unit.
Specifically, the mode of concurrent operation includes MapReduce mode；
Processing unit, burst is carried out specifically for the initial data code stream obtained according to Map function pairs data capture unit
Statistics, and collected by the initial data code stream of Reduce function pairs data capture unit acquisition, the second of generation user
Data.
Specifically, the mode of concurrent operation includes Hadoop and/or Hbase and/or Hive and/or Spark；
Processing unit, is carried out default specifically for the initial data code stream obtained by Hadoop to data capture unit
Classification and statistics, generate the second data of user；
And/or
Processing unit, is carried out default specifically for the initial data code stream obtained by Hbase to data capture unit
Classification and statistics, generate the second data of user；
And/or
Processing unit, specifically for carrying out default point to the initial data code stream that data capture unit is obtained by Hive
Class and statistics, generate the second data of user；
And/or
Processing unit, is carried out default specifically for the initial data code stream obtained by Spark to data capture unit
Classification and statistics, generate the second data of user.
Second aspect, the embodiment of present aspect provide a kind of user's portrait analytic method, including：
The initial data code stream that PGW is exported in real time in mobile core network is obtained, and it is right in real time to read PGW in mobile core network
Initial data code stream carries out the first data of the user generated after deep message detection DPI parsings；
To initial data code stream in the way of concurrent operation, the second data of user are generated；
According to the first data and the second data, the statistic analysis result of user's portrait of generation user is simultaneously sent to third party
Shared platform, wherein, third party's shared platform is used for the statistic analysis result that the user of real-time presentation user draws a portrait.
Specifically, this method also includes：
Store the statistic analysis result of user's portrait of user.
Specifically, the mode of concurrent operation includes MapReduce mode；
To initial data code stream in the way of concurrent operation, the second data of user are generated, including：
Burst statistics is carried out according to Map function pair initial data code stream, and passes through Reduce function pair initial data code streams
Collected, generate the second data of user.
Specifically, the mode of concurrent operation includes Hadoop and/or Hbase and/or Hive and/or Spark；
To initial data code stream in the way of concurrent operation, the second data of user are generated, including：
Default classification and statistics are carried out to initial data code stream by Hadoop, the second data of user are generated；
And/or
Default classification and statistics are carried out to initial data code stream by Hbase, the second data of user are generated；
And/or
Default classification and statistics are carried out to initial data code stream by Hive, the second data of user are generated；
And/or
Default classification and statistics are carried out to initial data code stream by Spark, the second data of user are generated.
Specifically, the statistic analysis result of user's portrait of user includes：The webpage preferences of user and the application of user
Program APP preferences, the Back ground Information of user, the time preference of user, the consuming capacity of user and the resident area of user.
The third aspect, embodiments of the invention provide a kind of network system, including UE, eNodeB, MME, SGW, PGW and
IMS, wherein any one user portrait resolver as first aspect is provided belongs to PGW.
User's portrait analysis method and device provided in an embodiment of the present invention, network system, using PGW to initial data code
Stream carries out the first data of the user generated after deep message detection DPI parsings, and each user DPI can be dynamically grasped in real time
The renewal of the data of parsing, improves the real-time of data；Due to without the initial data code stream of magnanimity is carried out into advance deposit
Storage, but the second data of user directly are obtained by way of the initial data code stream that is exported to PGW is with concurrent operation, this
When the second data size be far smaller than the initial data code stream of magnanimity, can greatly reduce the expenditure in storage hardware；
Second data of the first data and the processing unit generation that final data generation unit is read according to data capture unit, generation is used
The statistic analysis result of user's portrait at family sends the system that the user for being used for real-time presentation user to third party's shared platform draws a portrait
Analysis result is counted, without initial data code stream is stored to third company or self-built analysis platform, is then entered again
Row obtains the statistic analysis result that the user of user draws a portrait to the analysis of initial data code stream, therefore solves and lead in the prior art
Cross third company or self-built analysis platform using storage analyze again method parsing user draw a portrait when, there is time delay very
It is high, the problem of storage hardware cost is high.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the accompanying drawing used required in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is a kind of structural representation of user's portrait resolver provided in an embodiment of the present invention；
Fig. 2 is a kind of another structural representation of user's portrait resolver provided in an embodiment of the present invention；
Fig. 3 is a kind of flow chart of user's portrait analytic method provided in an embodiment of the present invention；
Fig. 4 for a kind of user portrait analytic method provided in an embodiment of the present invention a kind of flow chart；
Fig. 5 is a kind of structural representation of network system provided in an embodiment of the present invention.
Reference：
User's portrait resolver -10；
Data capture unit -101；Processing unit -102；Data generating unit -103；Memory cell -104；
Network system -20；
User equipment -201；Base station -202；Mobile management nodes -203；Gateway -204；Public data network gateway-
205；Network protocol multi-media sub-system -206.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
Embodiment one, embodiments of the invention carry a kind of user's portrait resolver 10, include as shown in Figure 1：
Data capture unit 101, for obtaining public data network gateway (English full name in mobile core network：Public
Data Network GateWay, referred to as：PGW the initial data code stream) exported in real time, and it is real to read PGW in mobile core network
When to initial data code stream carry out deep message detection (English full name：Deep Packet Inspection, referred to as：DPI) solve
The first data of the user generated after analysis.
Processing unit 102, for the initial data code stream that is obtained to data capture unit 101 in the way of concurrent operation,
Generate the second data of user.
Data generating unit 103, the first data and processing unit 102 for being read according to data capture unit 101 are given birth to
Into the second data, generation user user portrait statistic analysis result simultaneously send to third party's shared platform, wherein, the 3rd
Square shared platform is used for the statistic analysis result that the user of real-time presentation user draws a portrait.
User's portrait resolver provided in an embodiment of the present invention, data capture unit is using PGW to initial data code stream
The first data of user generated after deep message detection DPI parsings are carried out, each user DPI solutions can be dynamically grasped in real time
The renewal of the data of analysis, improves the real-time of data；Due to the storage advance without the initial data code stream progress by magnanimity,
But processing unit is directly by way of the initial data code stream that is exported to PGW is with concurrent operation, the second number of user is obtained
According to now the size of the second data is far smaller than the initial data code stream of magnanimity, can be greatly reduced in storage hardware
Expenditure；Second number of the first data and the processing unit generation that final data generation unit is read according to data capture unit
According to the statistic analysis result of user's portrait of generation user, which is sent to third party's shared platform, is used for the user of real-time presentation user
The statistic analysis result of portrait, without initial data code stream is stored to third company or self-built analysis platform,
Then the statistic analysis result that the analysis to initial data code stream obtains user's portrait of user is carried out again, therefore is solved existing
When the method analyzed again using storage by third company or self-built analysis platform in technology parses user's portrait, exist
The problem of time delay is very high, storage hardware cost is high.
Embodiment two, embodiments of the invention carry a kind of user's portrait resolver 10, include as shown in Figure 2：
Data capture unit 101, for obtaining the initial data code stream that PGW in mobile core network is exported in real time, and reads
PGW carries out the first number of the user generated after deep message detection DPI parsings to initial data code stream in real time in mobile core network
According to.
It should be noted that in actual application, initial data code stream can carry out DPI parsing work in PGW, so that
Reflect what business user has carried out, what website have accessed, open what APP, so can by these data according to
Family carries out classification storage；It therefore, it can by reading DPI corresponding storage informations in PGW, can dynamically grasp every in real time
(collection is not accomplished, because collection is disposable behavior, even if frequency is high again for the renewal of the data of individual user DPI parsings
Also only it is to speed up refresh rate).
Processing unit 102, for the initial data code stream that is obtained to data capture unit 101 in the way of concurrent operation,
Generate the second data of user.
It should be noted that in actual application, the data volume of initial data code stream is very huge, therefore PGW is in itself
Also it will not store, for this partial data, the processing unit of user's portrait resolver provided in an embodiment of the present invention can be direct
The initial data code stream transmitted to PGW obtains the second data of user in the way of concurrent operation；Wherein, the second data include：
Valuable summary info, this partial information are primarily to make up the defect of DPI data；Here valuable summary letter
Breath, can be according to the demand sets itself of operator.
Specifically, mode containment mapping (the English full name of concurrent operation：Map) reduction (English full name：Reduce side)
Formula；
Processing unit, burst is carried out specifically for the initial data code stream obtained according to Map function pairs data capture unit
Statistics, and collected by the initial data code stream of Reduce function pairs data capture unit acquisition, the second of generation user
Data.
Specifically, the mode of concurrent operation includes extra large dupp (English full name：Hadoop Distributed File
System, referred to as：) and/or hadoop databases (English full name Hadoop：Hadoop Database, referred to as：Hbase) and/
Or hadoop Tool for Data Warehouse (English full name：) and/or Apache's big data computing engines (English full name Hive：Spark)；
Processing unit, is carried out default specifically for the initial data code stream obtained by Hadoop to data capture unit
Classification and statistics, generate the second data of user；
And/or
Processing unit, is carried out default specifically for the initial data code stream obtained by Hbase to data capture unit
Classification and statistics, generate the second data of user；
And/or
Processing unit, specifically for carrying out default point to the initial data code stream that data capture unit is obtained by Hive
Class and statistics, generate the second data of user；
And/or
Processing unit, is carried out default specifically for the initial data code stream obtained by Spark to data capture unit
Classification and statistics, generate the second data of user.
Data generating unit 103, the first data and processing unit 102 for being read according to data capture unit 101 are given birth to
Into the second data, generation user user portrait statistic analysis result simultaneously send to third party's shared platform, wherein, the 3rd
Square shared platform is used for the statistic analysis result that the user of real-time presentation user draws a portrait.
Memory cell 104, the statistical analysis knot of user's portrait of the user generated for data storage generation unit 103
Really.
It should be noted that in actual application, the statistic analysis result of user's portrait of user, which is included, passes through PGW pairs
Initial data code stream carry out DPI processing user the first data and by directly to initial data code stream with the side of concurrent operation
Formula, the second data of the user of calculating, so as to grasp the necessary information needed for user's portrait in real time, and due to the of user
One data and the second data are only some summary infos；Therefore, the expense in storage hardware is minimum.
User's portrait resolver provided in an embodiment of the present invention, data capture unit is using PGW to initial data code stream
The first data of user generated after deep message detection DPI parsings are carried out, each user DPI solutions can be dynamically grasped in real time
The renewal of the data of analysis, improves the real-time of data；Due to the storage advance without the initial data code stream progress by magnanimity,
But processing unit is directly by way of the initial data code stream that is exported to PGW is with concurrent operation, the second number of user is obtained
According to, and the second data of user are stored, because the second data of user contain some summary infos, therefore accounted in terms of storage
Storage hardware and its lack, so as to be greatly reduced the expenditure in storage hardware；Final data generation unit according to
Second data of the first data and the processing unit generation that data capture unit is read, the statistical of user's portrait of generation user
Analysis result sends the statistic analysis result that the user for being used for real-time presentation user to third party's shared platform draws a portrait, without inciting somebody to action
Initial data code stream is stored to third company or self-built analysis platform, and the analysis to initial data code stream is then carried out again
The statistic analysis result of user's portrait of user is obtained, therefore is solved in the prior art by third company or self-built
When the method parsing user that analysis platform is analyzed again using storage draws a portrait, there is the problem of time delay is very high, storage hardware cost is high.
Embodiment three, the embodiment of present aspect provide a kind of user's portrait analytic method, include as shown in Figure 3：
The initial data code stream that PGW is exported in real time in S101, acquisition mobile core network, and read PGW in mobile core network
The first data of user generated after deep message detection DPI parsings are carried out to initial data code stream in real time.
S102, to initial data code stream in the way of concurrent operation, generate user the second data.
S103, according to the first data and the second data, the statistic analysis result of user's portrait of generation user is simultaneously sent extremely
Third party's shared platform, wherein, third party's shared platform is used for the statistic analysis result that the user of real-time presentation user draws a portrait.
User's portrait analytic method provided in an embodiment of the present invention, deep message is carried out using PGW to initial data code stream
The first data of the user generated after detection DPI parsings, can dynamically grasp the data of each user DPI parsings more in real time
Newly, the real-time of data is improved；Due to the storage advance without the initial data code stream progress by magnanimity, but directly pass through
The initial data code stream exported to PGW obtains the size of the second data, now the second data of user in the way of concurrent operation
Far smaller than the initial data code stream of magnanimity, can be greatly reduced the expenditure in storage hardware；Finally according to the first number
Being sent according to the statistic analysis result with the second data, user's portrait of generation user to third party's shared platform is used to present in real time
The statistic analysis result of user's portrait of user, without initial data code stream is stored to third company or self-built
Analysis platform, then carries out the statistic analysis result that the analysis to initial data code stream obtains user's portrait of user, therefore again
Solve the method analyzed again using storage by third company or self-built analysis platform in the prior art and parse user
During portrait, there is the problem of time delay is very high, storage hardware cost is high.
Example IV, the embodiment of present aspect provide a kind of user's portrait analytic method, include as shown in Figure 4：
The initial data code stream that PGW is exported in real time in S101, acquisition mobile core network, and read PGW in mobile core network
The first data of user generated after deep message detection DPI parsings are carried out to initial data code stream in real time.
S102, to initial data code stream in the way of concurrent operation, generate user the second data.
Specifically, the mode of concurrent operation includes MapReduce mode；
To initial data code stream in the way of concurrent operation, the second data of user are generated, including：
Burst statistics is carried out according to Map function pair initial data code stream, and passes through Reduce function pair initial data code streams
Collected, generate the second data of user.
Specifically, the mode of concurrent operation includes Hadoop and/or Hbase and/or Hive and/or Spark；
To initial data code stream in the way of concurrent operation, the second data of user are generated, including：
Default classification and statistics are carried out to initial data code stream by Hadoop, the second data of user are generated；
And/or
Default classification and statistics are carried out to initial data code stream by Hbase, the second data of user are generated；
And/or
Default classification and statistics are carried out to initial data code stream by Hive, the second data of user are generated；
And/or
Default classification and statistics are carried out to initial data code stream by Spark, the second data of user are generated.
It should be noted that in actual application, can be by using in hadoop, hbase, hive or spark one
Individual or multiple technologies come improve user draw a portrait statistical work efficiency.
S103, according to the first data and the second data, the statistic analysis result of user's portrait of generation user is simultaneously sent extremely
Third party's shared platform, wherein, third party's shared platform is used for the statistic analysis result that the user of real-time presentation user draws a portrait.
S104, user's portrait of storage user statistic analysis result.
Specifically, the statistic analysis result of user's portrait of user includes：The webpage preferences of user and the application of user
Program APP preferences, the Back ground Information of user, the time preference of user, the consuming capacity of user and the resident area of user.
User's portrait analytic method provided in an embodiment of the present invention, deep message is carried out using PGW to initial data code stream
The first data of the user generated after detection DPI parsings, can dynamically grasp the data of each user DPI parsings more in real time
Newly, the real-time of data is improved；Due to the storage advance without the initial data code stream progress by magnanimity, but directly pass through
The initial data code stream exported to PGW obtains the second data of user in the way of concurrent operation, and stores the second number of user
According to, because the second data of user contain some summary infos, therefore the storage hardware that is taken in terms of storage and its lack,
So as to be greatly reduced the expenditure in storage hardware；Finally according to the first data and the second data, the user of user is generated
The statistic analysis result of portrait sends the statistical analysis knot that the user for being used for real-time presentation user to third party's shared platform draws a portrait
Really, without initial data code stream is stored to third company or self-built analysis platform, then carry out again to original
The analysis of data code flow obtains the statistic analysis result of user's portrait of user, therefore solves in the prior art by third party
When the method parsing user that company or self-built analysis platform are analyzed again using storage draws a portrait, there is that time delay is very high, storage is hard
The problem of part cost is high.
Embodiment five, embodiments of the invention provide a kind of network system 20, and (the English of user equipment 201 is included as shown in Figure 5
Literary full name：User Equipment, referred to as：UE), (the English full name of base station 202：Evolved Node B, referred to as：eNodeB)、
(the English full name of mobile management nodes 203：Mobility Management Entity, referred to as：MME), (English of gateway 204
Literary full name：Serving GateWay, referred to as：SGW), PGW205 and (the English full name of network protocol multi-media sub-system 206：
Internet Protocol Multimedia Subsystem, referred to as：IMS), wherein any one provided such as first aspect is used
Family portrait resolver 10 belongs to PGW205.
It should be noted that in actual application, as shown in figure 5, user equipment (UE) sends URL (English
Literary full name：Uniform Resource Locator, referred to as:URL) information is to base station eNodeB；Base station eNodeB will be received
UE URL information sent by mobile management nodes MME to gateway SGW；Gateway SGW sets the user received
Standby URL information is connected to network protocol multi-media sub-system IMS by network protocol multi-media sub-system PGW；In UE and IMS
While carrying out information exchange, because PGW has DPI functions in itself, therefore UE URL information can carry out DPI parsings in PGW
Work, and the user after can DPI be parsed the first data storage in PGW；User's portrait provided in an embodiment of the present invention
Resolver, first by reading the first data of the stored users of PGW, can reduce the Preliminary Analysis work of user's portrait
Make, farthest using existing resource, each user DPI solutions can dynamically be grasped in real time simultaneously by reducing the analysis repeated
The renewal of the data of analysis；Secondly, by way of to UE URL information with concurrent operation, the second data of user are obtained, due to
Necessary summary info is contained in the second data of user, compared with prior art the UE of middle storage magnanimity URL information, can be with
It is greatly reduced the expenditure in storage hardware；The first data that final data generation unit is read according to data capture unit
The second data generated with processing unit, the statistic analysis result of user's portrait of generation user is sent to third party's shared platform
The statistic analysis result that user for real-time presentation user draws a portrait, without initial data code stream is stored into public to third party
Department or self-built analysis platform, then carry out the statistical that the analysis to initial data code stream obtains user's portrait of user again
Analyse result.
Therefore, network system provided in an embodiment of the present invention, is only extended upgrading, no on tangible PGW network element devices
With the mobile communication network structure for changing current operator, lower deployment cost is low, and risk is controllable；And due to directly to UE URL
Information is handled, and without excessive data cached, only stored the corresponding summary info of each user, is different from traditional deposit
Storage-analytical model, possesses higher real-time and relatively low storage hardware is supported；Therefore solve in the prior art by the 3rd
When the method parsing user that Fang companies or self-built analysis platform are analyzed again using storage draws a portrait, there is that time delay is very high, storage
The problem of hardware cost is high.
The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any
Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained
Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.
Claims (10)
- The resolver 1. a kind of user draws a portrait, it is characterised in that including：Data capture unit, for obtaining the initial data code stream that PGW in mobile core network is exported in real time, and reads the movement PGW carries out the first number of the user generated after deep message detection DPI parsings to the initial data code stream in real time in core net According to；Processing unit, the initial data code stream for being obtained to the data capture unit is given birth in the way of concurrent operation Into the second data of the user；Data generating unit, is generated for first data read according to the data capture unit and the processing unit Second data, the statistic analysis result for generating user's portrait of the user simultaneously sent to third party's shared platform, its In, third party's shared platform is used for the statistic analysis result for user's portrait that the user is presented in real time.
- The resolver 2. user according to claim 1 draws a portrait, it is characterised in that described device also includes：Memory cell, the statistic analysis result of user's portrait of the user for storing the data generating unit generation.
- The resolver 3. user according to claim 1 draws a portrait, it is characterised in that the mode of the concurrent operation is included MapReduce mode；The processing unit, the initial data code stream obtained specifically for the data capture unit according to Map function pairs Burst statistics is carried out, and the initial data code stream obtained by data capture unit described in Reduce function pairs is converged Always, the second data of the user are generated.
- The resolver 4. user according to claim 1 draws a portrait, it is characterised in that the mode of the concurrent operation is included Hadoop and/or Hbase and/or Hive and/or Spark；The processing unit, specifically for the initial data code obtained by the Hadoop to the data capture unit Stream carries out default classification and statistics, generates the second data of the user；And/orThe processing unit, specifically for the initial data code obtained by the Hbase to the data capture unit Stream carries out default classification and statistics, generates the second data of the user；And/orThe processing unit, specifically for the initial data code stream obtained by the Hive to the data capture unit Default classification and statistics are carried out, the second data of the user are generated；And/orThe processing unit, specifically for the initial data code obtained by the Spark to the data capture unit Stream carries out default classification and statistics, generates the second data of the user.
- The analytic method 5. a kind of user draws a portrait, it is characterised in that including：The initial data code stream that PGW is exported in real time in mobile core network is obtained, and it is right in real time to read PGW in the mobile core network The initial data code stream carries out the first data of the user generated after deep message detection DPI parsings；To the initial data code stream in the way of concurrent operation, the second data of the user are generated；According to first data and second data, statistic analysis result and the transmission of user's portrait of the user are generated To third party's shared platform, wherein, third party's shared platform is used for the statistics for user's portrait that the user is presented in real time Analysis result.
- The analytic method 6. user according to claim 5 draws a portrait, it is characterised in that methods described also includes：Store the statistic analysis result of user's portrait of the user.
- The analytic method 7. user according to claim 1 draws a portrait, it is characterised in that the mode of the concurrent operation is included MapReduce mode；It is described to the initial data code stream in the way of concurrent operation, generate the second data of the user, including：Initial data code stream carries out burst statistics according to Map function pairs, and passes through initial data described in Reduce function pairs Code stream is collected, and generates the second data of the user.
- The analytic method 8. user according to claim 1 draws a portrait, it is characterised in that the mode of the concurrent operation is included Hadoop and/or Hbase and/or Hive and/or Spark；It is described to the initial data code stream in the way of concurrent operation, generate the second data of the user, including：Default classification and statistics are carried out to the initial data code stream by the Hadoop, the second number of the user is generated According to；And/orDefault classification and statistics are carried out to the initial data code stream by the Hbase, the second number of the user is generated According to；And/orDefault classification and statistics are carried out to the initial data code stream by the Hive, the second number of the user is generated According to；And/orDefault classification and statistics are carried out to the initial data code stream by the Spark, the second number of the user is generated According to.
- The analytic method 9. user according to claim 5 draws a portrait, it is characterised in that the statistics of user's portrait of the user Analysis result includes：The webpage preferences of the user and the application APP preference of the user, the basis letter of the user Breath, the time preference of the user, the consuming capacity of the user and the resident area of the user.
- 10. a kind of network system, it is characterised in that including UE, eNodeB, MME, SGW, PGW and IMS, wherein such as claim User's portrait resolver described in any one of 1-4 belongs to the PGW.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710188900.7A CN106982253A (en) | 2017-03-27 | 2017-03-27 | A kind of user's portrait analysis method and device, network system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710188900.7A CN106982253A (en) | 2017-03-27 | 2017-03-27 | A kind of user's portrait analysis method and device, network system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106982253A true CN106982253A (en) | 2017-07-25 |
Family
ID=59339045
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710188900.7A Pending CN106982253A (en) | 2017-03-27 | 2017-03-27 | A kind of user's portrait analysis method and device, network system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106982253A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112862298A (en) * | 2020-07-09 | 2021-05-28 | 北京睿知图远科技有限公司 | Credit assessment method for user portrait |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103136288A (en) * | 2011-12-05 | 2013-06-05 | 上海博路信息技术有限公司 | Multi-dimensional information system of mobile terminal |
| US20160021173A1 (en) * | 2014-07-16 | 2016-01-21 | TUPL, Inc. | Resource management in a big data environment |
| CN105574159A (en) * | 2015-12-16 | 2016-05-11 | 浙江汉鼎宇佑金融服务有限公司 | Big data-based user portrayal establishing method and user portrayal management system |
| CN105657001A (en) * | 2015-12-28 | 2016-06-08 | 中国联合网络通信集团有限公司 | Method and device for analyzing communication big data |
| CN106504099A (en) * | 2015-09-07 | 2017-03-15 | 国家计算机网络与信息安全管理中心 | A kind of system for building user's portrait |
-
2017
- 2017-03-27 CN CN201710188900.7A patent/CN106982253A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103136288A (en) * | 2011-12-05 | 2013-06-05 | 上海博路信息技术有限公司 | Multi-dimensional information system of mobile terminal |
| US20160021173A1 (en) * | 2014-07-16 | 2016-01-21 | TUPL, Inc. | Resource management in a big data environment |
| CN106504099A (en) * | 2015-09-07 | 2017-03-15 | 国家计算机网络与信息安全管理中心 | A kind of system for building user's portrait |
| CN105574159A (en) * | 2015-12-16 | 2016-05-11 | 浙江汉鼎宇佑金融服务有限公司 | Big data-based user portrayal establishing method and user portrayal management system |
| CN105657001A (en) * | 2015-12-28 | 2016-06-08 | 中国联合网络通信集团有限公司 | Method and device for analyzing communication big data |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112862298A (en) * | 2020-07-09 | 2021-05-28 | 北京睿知图远科技有限公司 | Credit assessment method for user portrait |
| CN112862298B (en) * | 2020-07-09 | 2024-02-27 | 北京睿知图远科技有限公司 | Credit evaluation method for user portrait |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102111453A (en) | Method and system for extracting Internet user network behaviors | |
| CN102523274B (en) | Based on wireless personalized accurate information active pushing system and the method for core-network side | |
| CN103209087B (en) | Distributed information log statistical processing methods and system | |
| CN102916854B (en) | Flow statistical method, device and proxy server | |
| Ahmad et al. | A view from the other side: Understanding mobile phone characteristics in the developing world | |
| CN103595576B (en) | Interconnection port ICP flow statistical system and method based on content provider identifications | |
| EP2610767A1 (en) | Web page download time analysis | |
| Jun et al. | Mining and modelling the dynamic patterns of service providers in cellular data network based on big data analysis | |
| CN103139137B (en) | Network service provider method and device | |
| CN103678372B (en) | A kind of method and apparatus for obtaining the application performance of the page | |
| CN104021433A (en) | System and method for achieving user loss prediction in data information communication network | |
| CN110109660A (en) | A kind of monitoring short message touching reaches the system and method for effect | |
| CN106230809B (en) | A kind of mobile Internet public sentiment monitoring method and system based on URL | |
| CN106506514A (en) | A kind of 4G mobile datas signaling plane and correlating method and the system of user plane | |
| CN105681125A (en) | Method for counting traffic of virtual machine extranet of cloud platform | |
| EP2882135B1 (en) | Network server system, client device, computer program product and computer-implemented method | |
| CN104298782A (en) | Method for analyzing active access behaviors of internet users | |
| CN111294849A (en) | Method and device for judging poor Internet access quality of LTE (Long term evolution) user | |
| CN113872810A (en) | Service simulation method and device, electronic equipment and storage medium | |
| Yang et al. | Characterizing smartphone traffic with MapReduce | |
| CN104980474A (en) | Device and method for realizing mobile handling of documents | |
| Fang et al. | Fine-grained HTTP web traffic analysis based on large-scale mobile datasets | |
| CN105184559B (en) | A kind of payment system and method | |
| CN106982253A (en) | A kind of user's portrait analysis method and device, network system | |
| Li et al. | Characterizing service providers traffic of mobile internet services in cellular data network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170725 |
|
| RJ01 | Rejection of invention patent application after publication |