CN105701224B - Security information customized service system based on big data - Google Patents
Security information customized service system based on big data Download PDFInfo
- Publication number
- CN105701224B CN105701224B CN201610028294.8A CN201610028294A CN105701224B CN 105701224 B CN105701224 B CN 105701224B CN 201610028294 A CN201610028294 A CN 201610028294A CN 105701224 B CN105701224 B CN 105701224B
- Authority
- CN
- China
- Prior art keywords
- information
- user
- score
- customer
- big data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a security information customized service system based on big data; a big data processing system receives mass log data sent by user terminals, extracts user equipment information and user behavior information so as to generate an equipment-user matching relation sheet, and sends the matching relation sheet and user browse information of the equipment to a information adaption server; the information adaption server builds a user-information correlation model through user attribute, user behavior attribute and information attribute, thus obtaining adapted customized information for each user; the information adaption server recognizes a client number from the matching relation sheet according to equipment information sent by the user terminal, and pushes the user customized information to the corresponding user terminal. The security information customized service system can fast recognize security browse client, can provide customized information highly associated to the client, thus solving the problems that conventional security software cannot recognize browse clients, and cannot push information content with pertinency; the security information customized service system can improve information push accuracy.
Description
Technical field
The present invention relates to a kind of big data collection analysis technology, more particularly, to a kind of security information based on big data
Individuation service system.
Background technology
In recent years, with the popularization of " big data " concept, in many fields, service provider start conscious to magnanimity
User data carries out Real-time Collection and analysis, thus extracting valuable information.After more valuable informix being utilized, push away
Give target group more accurately customized information, be one with data mining, natural language processing and Internet technology
Based on comprehensive method system.Suitable information pushing is given suitable people, is the work of a great challenge.This mistake
Journey needs information to be made sufficiently analyze, and does careful portraying to the interest of people, behavior simultaneously, and both are carried out effective
Join.
In recent years, the attention rate more and more higher to securities market for the people.The money that securities broker company provides to security user daily
News information is more, thousand of easily, lack of targeted, and current push mode underaction, typically pass through website or
User side provides the user with general information.Browse user at present in the majority, when online user is, and online user is who cannot know
Not, therefore push personalized information aspect inefficient.
Content of the invention
It is an object of the invention to overcoming the deficiencies in the prior art, there is provided a kind of security information individual character based on big data
Change service system, can quickly identify and browse client, and personalized information is provided.
The present invention is achieved by the following technical solutions, and the present invention includes big data processing system and information adaptation services
Device；
Described big data processing system, the massive logs data that receive user terminal sends, extract user equipment information
With user behavior information, generate equipment and user's mapping table, then by the user of described mapping table and this equipment
The information of browsing is sent to information adaptation services device,
Described information adaptation services device, sets up user and information by user property, user behavior attribute and information attribute
Related degree model, obtain the personalized information after every user adaptation, then the facility information according to user terminal transmission, from
After identifying customer ID in described mapping table, the personalized message push of this user is given corresponding user terminal.
Described big data processing system receives the destructuring daily record data that mobile phone terminal and PC end send, described destructuring
Daily record data includes cell-phone number, IMEI number, customer ID, MAC Address, browses securities information, landing time and number of times, and according to institute
State destructuring daily record data and generate equipment and user's mapping table, and regularly update.
The generation method of described mapping table, comprises the following steps：
(11) cell-phone number, IMEI number and client's number of User logs in cell phone system are extracted from mobile phone daily record data
According to extracting MAC Address and client's number of User logs in PC system from PC daily record data；
(12) all customer IDs logging on each cell-phone number, IMEI number, MAC Address are counted respectively；
(13) if only one of which customer ID logs on a cell-phone number, IMEI number or MAC Address, or there are multiple visitors
Family number logs in but only one of which customer ID login times or ratio exceed threshold values, then by this cell-phone number, IMEI number or MAC Address
Correspond on this customer ID, in write device and user's mapping table；
(14) if there being multiple customer IDs to log on a cell-phone number, IMEI number or MAC Address, and more than one client
Number login times or ratio exceed threshold values, then this cell-phone number, IMEI number or MAC Address are corresponded to the super of the last login
Cross on the customer ID of threshold values, in write device and user's mapping table.
Described user property includes personal share position in storehouse, personal share liveness, the personal share attribute held position, and user behavior attribute is included certainly
Select stocks, browse stock, add self-selected stock time, number of visits；It is ageing, corresponding that information attribute includes information importance degree, information
Personal share, corresponding industry, column priority.
The method for building up of described related degree model is as follows：
(21) by the information classification pushing be personal share information, industry Zone Information and macroscopical information；
(22) calculate the information weighted score under each classification respectively and sort；
(23) information of N name before the information weighted score under each classification is pushed to corresponding user terminal respectively.
In described step (22), personal share information weighted score=personal share position in storehouse score+personal share liveness score+interpolation is free
Stock number of days+number of visits score+personal share information importance degree score+ageing the score of personal share information+personal share column preference score.
In described step (22), industry Zone Information weighted score=industry existing position ratio score+industry historical analysis obtains
Point+the regional position ratio+concept position ratio+ageing score of industry Zone Information importance degree score+industry Zone Information+industry column is excellent
First level score.
In described step (22), macroscopical information weighted score=macroscopic view information importance degree score+macroscopic view information is ageing to be obtained
Point+macroscopical column preference score.
The described facility information according to user terminal transmission, identifies the method for user such as from described mapping table
Under：
(24) information sending when being started according to user terminal, judges it is mobile terminal or PC by information adaptation services device
Terminal, if the cell-phone number after comprising in data to encrypt or IMEI number, is judged to mobile terminal, otherwise is PC terminal；
(25) if user terminal is mobile terminal, first corresponding customer ID is inquired about according to cell-phone number, if inquired about into
Work(, returns customer ID, if inquired about unsuccessfully, inquires about corresponding customer ID further according to IMEI number, if successful inquiring, returns client
Number, if inquiring about unsuccessfully, exiting and inquiring about and return Universal Subscriber mark；
(26) if user terminal is PC terminal, corresponding customer ID is inquired about according to MAC Address, if successful inquiring, returns
Return customer ID, if inquiring about unsuccessfully, exiting and inquiring about and return Universal Subscriber mark.
After described information adaptation services device identifies customer ID, up-to-date personalized information that related degree model is obtained,
It is pushed to the user terminal at user place, the user for Universal Subscriber mark pushes general information, after receiving new information, close
Connection degree model is repeatedly updated calculating daily.
The present invention has advantages below compared to existing technology：The present invention extracts from big data and analyzes user profile, energy
Enough quick identification security browse client, are adapted to backstage information service device according to user profile, and provide personalized with
The information of client's highlights correlations, overcomes traditional security software None- identified and browses client, and push information content does not have pin
To sex chromosome mosaicism, improve information content precision.
Brief description
Fig. 1 is the flow chart of the present invention.
Specific embodiment
Below embodiments of the invention are elaborated, the present embodiment is carried out under premised on technical solution of the present invention
Implement, give detailed embodiment and specific operating process, but protection scope of the present invention is not limited to following enforcements
Example.
As shown in figure 1, the present embodiment includes big data processing system and information adaptation services device；
Described big data processing system, the massive logs data that receive user terminal sends, daily data volume is about
50G, 80,000,000,000 row, extract user equipment information and user behavior information, generate equipment and user's mapping table, then will
The user of described mapping table and this equipment browses information and is sent to information adaptation services device,
Described information adaptation services device, sets up user and information by user property, user behavior attribute and information attribute
Related degree model, obtain the personalized information after every user adaptation, then the facility information according to user terminal transmission, from
After identifying customer ID in described mapping table, the personalized message push of this user is given corresponding user terminal.
The big data processing system platform of the present embodiment uses Hadoop framework, and inside is using HDFS and MapReduce simultaneously
At least 3 servers, information adaptation services device uses oracle database.
The user terminal of the present embodiment includes mobile phone terminal and PC end, and big data processing system receives mobile phone terminal and PC end sends
Destructuring daily record data, described destructuring daily record data includes cell-phone number, IMEI number, customer ID, MAC Address, browses
Securities information, landing time and number of times, and equipment and user's mapping table are generated according to described destructuring daily record data, and
Regularly update.
Customer ID in the present embodiment is the user name for logging in security that each user is stored in securities system,
There is uniqueness.IMEI number is the unique mark of cell phone apparatus, and MAC Address is the unique mark of PC equipment, and is written into daily record
In data.
The generation method of mapping table, comprises the following steps：
(11) cell-phone number, IMEI number and client's number of User logs in cell phone system are extracted from mobile phone daily record data
According to extracting MAC Address and client's number of User logs in PC system from PC daily record data；
(12) all customer IDs logging on each cell-phone number, IMEI number, MAC Address are counted respectively；
(13) if only one of which customer ID logs on a cell-phone number, IMEI number or MAC Address, or there are multiple visitors
Family number logs in but only one of which customer ID login times or ratio are more than 3 times, then by this cell-phone number, IMEI number or MAC Address
Correspond on this customer ID, in write device and user's mapping table；
(14) if there being multiple customer IDs to log on a cell-phone number, IMEI number or MAC Address, and more than one client
This cell-phone number, IMEI number or MAC Address more than 3 times, are then corresponded to the super of the last login by number login times or ratio
Cross on the customer ID of 3 times, in write device and user's mapping table.
User property includes personal share position in storehouse, personal share liveness, the personal share attribute held position, and user behavior attribute includes free
Stock, browse stock, add the self-selected stock time, number of visits；Information attribute include information importance degree, information ageing, corresponding
Stock, corresponding industry, column priority.
The personal share attribute held position is：Industry, concept, plate, personal share liveness are ups and downs ratio.The personal share of user is with industry
Match with the personal share in information and trade information, targetedly just can push.
The method for building up of related degree model is as follows：
(21) by the information classification pushing be personal share information, industry Zone Information and macroscopical information；
(22) calculate the information weighted score under each classification respectively and sort；
Personal share information weighted score=personal share position in storehouse score+personal share liveness score+interpolation self-selected stock number of days+number of visits
Score+personal share information importance degree score+ageing the score of personal share information+personal share column preference score,
Industry Zone Information weighted score=industry existing position ratio score+industry historical analysis score+area position ratio+
Concept position ratio+ageing the score of industry Zone Information importance degree score+industry Zone Information+industry column preference score,
The macroscopical information weighted score=macroscopic view information importance degree score+ageing score of macroscopic view information+macroscopic view column is preferential
Level score,
(23) information of N name before the information weighted score under each classification is pushed to corresponding user terminal respectively, this
In embodiment, for avoiding the too many client of information to be not able to watch over, select front 30 message push of highest scoring.
In the present embodiment, each weighted score is as shown in table 1.
Each weight score-sheet of table 1
The facility information being sent according to user terminal, the method identifying user from described mapping table is as follows：
(24) information sending when being started according to user terminal, judges it is mobile terminal or PC by information adaptation services device
Terminal, if the cell-phone number after comprising in data to encrypt or IMEI number, is judged to mobile terminal, otherwise is PC terminal；
(25) if user terminal is mobile terminal, first corresponding customer ID is inquired about according to cell-phone number, if inquired about into
Work(, returns customer ID, if inquired about unsuccessfully, inquires about corresponding customer ID further according to IMEI number, if successful inquiring, returns client
Number, if inquiring about unsuccessfully, exiting and inquiring about and return Universal Subscriber mark；
(26) if user terminal is PC terminal, corresponding customer ID is inquired about according to MAC Address, if successful inquiring, returns
Return customer ID, if inquiring about unsuccessfully, exiting and inquiring about and return Universal Subscriber mark.
The identification of information adaptation services device browses client's accuracy more than 95%, after identifying customer ID, by the information degree of association
The up-to-date personalized information that model obtains, is pushed to the user terminal at user place.Information adaptation services device receives new money
After news, related degree model repeatedly updates daily and calculates.From starting client, to identification customer ID and push personalized information, when
Between be less than 3 seconds.
For the user terminal of None- identified customer ID, the i.e. user terminal of Universal Subscriber mark, push general information.Logical
With information be exclusion personal attribute after by the calculated information of above-mentioned related degree model, such as amount of increase and amount of decrease larger
Stock, and important industry and macroscopical information.
The foregoing is only presently preferred embodiments of the present invention, not in order to limit the present invention, all essences in the present invention
Any modification, equivalent and improvement made within god and principle etc., should be included within the scope of the present invention.
Claims (9)
1. a kind of security information individuation service system based on big data it is characterised in that include big data processing system and
Information adaptation services device；
Described big data processing system, the massive logs data that receive user terminal sends, extract user equipment information and use
Family behavioural information, generates equipment and user's mapping table, then browses the user of described mapping table and this equipment
Information is sent to information adaptation services device,
Described information adaptation services device, sets up the pass of user and information by user property, user behavior attribute and information attribute
Connection degree model, obtains the personalized information after every user's adaptation, the facility information then sending according to user terminal, from described
After identifying customer ID in mapping table, the personalized message push of this user is given corresponding user terminal；
The generation method of described mapping table, comprises the following steps：
(11) cell-phone number, IMEI number and client's number of User logs in cell phone system are extracted from mobile phone daily record data, from
MAC Address and client's number of User logs in PC system is extracted in PC daily record data；
(12) all customer IDs logging on each cell-phone number, IMEI number, MAC Address are counted respectively；
(13) if only one of which customer ID logs on a cell-phone number, IMEI number or MAC Address, or there are multiple customer IDs
Log in but only one of which customer ID login times or ratio exceed threshold values, then by this cell-phone number, IMEI number or MAC Address correspond to
To on this customer ID, in write device and user's mapping table；
(14) if there being multiple customer IDs to log on a cell-phone number, IMEI number or MAC Address, and more than one customer ID is stepped on
Record number of times or ratio exceed threshold values, then exceed valve by what this cell-phone number, IMEI number or MAC Address corresponded to the last login
On the customer ID of value, in write device and user's mapping table.
2. a kind of security information individuation service system based on big data according to claim 1 is it is characterised in that institute
State big data processing system and receive the destructuring daily record data that mobile phone terminal and PC end send, described destructuring daily record data bag
Include cell-phone number, IMEI number, customer ID, MAC Address, browse securities information, landing time and number of times, and according to described destructuring
Daily record data generates equipment and user's mapping table, and regularly updates.
3. a kind of security information individuation service system based on big data according to claim 1 is it is characterised in that institute
State user property and include personal share position in storehouse, personal share liveness, the personal share attribute held position；User behavior attribute includes self-selected stock, browses
Stock, interpolation self-selected stock time, number of visits；Information attribute includes that information importance degree, information be ageing, corresponding personal share, correspondence
Industry, column priority.
4. a kind of security information individuation service system based on big data according to claim 3 is it is characterised in that institute
The method for building up stating related degree model is as follows：
(21) by the information classification pushing be personal share information, industry Zone Information and macroscopical information；
(22) calculate the information weighted score under each classification respectively and sort；
(23) information of N name before the information weighted score under each classification is pushed to corresponding user terminal respectively.
5. a kind of security information individuation service system based on big data according to claim 4 is it is characterised in that institute
State in step (22), personal share information weighted score=personal share position in storehouse score+personal share liveness score+interpolation self-selected stock number of days+clear
Look at the number of times score+personal share information importance degree score+ageing score of personal share information+personal share column preference score.
6. a kind of security information individuation service system based on big data according to claim 4 is it is characterised in that institute
State in step (22), hold position in industry Zone Information weighted score=industry existing position ratio score+industry historical analysis score+area
Ratio+concept position ratio+ageing the score of industry Zone Information importance degree score+industry Zone Information+industry column preference score.
7. a kind of security information individuation service system based on big data according to claim 4 is it is characterised in that institute
State in step (22), the macroscopical information weighted score=macroscopic view information importance degree score+ageing score of macroscopic view information+macroscopic view column
Preference score.
8. a kind of security information individuation service system based on big data according to claim 1 is it is characterised in that institute
State the facility information sending according to user terminal, the method identifying user from described mapping table is as follows：
(24) information sending when being started according to user terminal, by the judgement of information adaptation services device be mobile terminal or PC is whole
End, if the cell-phone number after comprising in data to encrypt or IMEI number, is judged to mobile terminal, otherwise is PC terminal；
(25) if user terminal is mobile terminal, first corresponding customer ID is inquired about according to cell-phone number, if successful inquiring, return
Returning customer ID, if inquired about unsuccessfully, inquiring about corresponding customer ID further according to IMEI number, if successful inquiring, return customer ID, such as
Fruit is inquired about unsuccessfully, exits and inquires about and return Universal Subscriber mark；
(26) if user terminal is PC terminal, corresponding customer ID is inquired about according to MAC Address, if successful inquiring, return visitor
Family number, if inquiring about unsuccessfully, exiting and inquiring about and return Universal Subscriber mark.
9. a kind of security information individuation service system based on big data according to claim 8 is it is characterised in that institute
State the up-to-date personalized information after information adaptation services device identifies customer ID, related degree model being obtained, be pushed to user
The user terminal being located, the user for Universal Subscriber mark pushes general information, and after receiving new information, related degree model is every
It is repeatedly updated calculating.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610028294.8A CN105701224B (en) | 2016-01-14 | 2016-01-14 | Security information customized service system based on big data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610028294.8A CN105701224B (en) | 2016-01-14 | 2016-01-14 | Security information customized service system based on big data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105701224A CN105701224A (en) | 2016-06-22 |
| CN105701224B true CN105701224B (en) | 2017-02-08 |
Family
ID=56227393
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610028294.8A Expired - Fee Related CN105701224B (en) | 2016-01-14 | 2016-01-14 | Security information customized service system based on big data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105701224B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106327331A (en) * | 2016-08-18 | 2017-01-11 | 北京富盈通科技有限公司 | Intelligent transaction system |
| CN108270842B (en) * | 2017-06-09 | 2021-07-02 | 阿里巴巴（中国）有限公司 | Method, system and server for pushing rights and interests task |
| CN107491533A (en) * | 2017-08-22 | 2017-12-19 | 安徽简道科技有限公司 | Security information individuation service system based on big data |
| CN108628949A (en) * | 2018-03-30 | 2018-10-09 | 北京金堤科技有限公司 | A kind of processing method and processing device that information is shown |
| CN109166039A (en) * | 2018-08-10 | 2019-01-08 | 大智慧信息技术有限公司 | The preparation method and system of free index |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101334880A (en) * | 2007-06-28 | 2008-12-31 | 神乎科技股份有限公司 | Securities information service system and method |
| CN101355713B (en) * | 2007-07-23 | 2015-03-11 | 神乎科技股份有限公司 | System and method for broadcasting securities information |
| CN102333067A (en) * | 2010-07-14 | 2012-01-25 | 蔡权伟 | Omnibearing diversified financial information service system and transaction and information inquiry method |
| CN102609877A (en) * | 2011-01-25 | 2012-07-25 | 腾讯科技（深圳）有限公司 | Method for jointly displaying quotation and negotiable securities information and system thereof |
-
2016
- 2016-01-14 CN CN201610028294.8A patent/CN105701224B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN105701224A (en) | 2016-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105701224B (en) | Security information customized service system based on big data | |
| CN105608179B (en) | The method and apparatus for determining the relevance of user identifier | |
| CN108984650B (en) | Computer-readable recording medium and computer device | |
| CN109617762B (en) | Method for identifying mobile application by using network flow | |
| EP2698967A1 (en) | Social network data mining method for terminal user, and relevant method, device and system | |
| CN108269128B (en) | Advertisement putting method, device, equipment and storage medium | |
| CN105095211B (en) | The acquisition methods and device of multi-medium data | |
| WO2017186090A1 (en) | Communication number processing method and apparatus | |
| US20120209828A1 (en) | Information processing apparatus, information processing method, program for information processing apparatus and recording medium | |
| CN107784051A (en) | Online customer service answering system and method | |
| WO2007071143A1 (en) | Method and apparatus for issuing network information | |
| CN103336766A (en) | Short text garbage identification and modeling method and device | |
| CN113412608B (en) | Content pushing method and device, server and storage medium | |
| CN107666404B (en) | Broadband network user identification method and device | |
| CN110648172B (en) | Identity recognition method and system integrating multiple mobile devices | |
| RU2011142328A (en) | SECURITY CARD PROTECTION SYSTEM | |
| CN103905482B (en) | Method, push server and the system of pushed information | |
| CN105792152B (en) | Pseudo base station short message identification method and device | |
| CN109299742A (en) | Method, apparatus, equipment and the storage medium of automatic discovery unknown network stream | |
| CN105871585A (en) | Terminal association method and device | |
| CN106921795A (en) | A kind of contact data management method and its system | |
| CN103970891A (en) | Method for inquiring user interest information based on context | |
| CN110020161B (en) | Data processing method, log processing method and terminal | |
| CN112632409A (en) | Same user identification method, device, computer equipment and storage medium | |
| CN107958070B (en) | Personalized message pushing method based on user preference |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170208 Termination date: 20220114 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |