CN105930524A - Big data aggregation method facing quick service - Google Patents
Big data aggregation method facing quick service Download PDFInfo
- Publication number
- CN105930524A CN105930524A CN201610361834.4A CN201610361834A CN105930524A CN 105930524 A CN105930524 A CN 105930524A CN 201610361834 A CN201610361834 A CN 201610361834A CN 105930524 A CN105930524 A CN 105930524A
- Authority
- CN
- China
- Prior art keywords
- result
- data
- big data
- carrying
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a big data aggregation method facing a quick service. The big data aggregation method comprises the following steps of S1: by a big data platform, carrying out acquisition on data and carrying out real-time synchronization with a network; S2: by the big data platform, classifying acquired data information, carrying out analysis, induction and summarization, and then according to an analysis result, carrying out refined classification; S3: storing classification results in different information databases; S4: inputting keywords or key terms in an information search platform by a user, carrying out rapid search on the information databases by an information search unit in the information search platform, carrying out de-emphasis determination on the results by a result analysis unit, carrying out induction and summarization on the results by a result summarization unit, carrying out sorting, and feeding the results to a user by a result display unit. According to the big data aggregation method disclosed by the invention, mass of data is subjected to classified aggregation management; the quick search service of the user is met by the information search platform; moreover, the method has high data storage capacity and can ensure timeliness and accuracy of the data.
Description
Technical field
The present invention relates to data aggregation technique field, particularly relate to a kind of big towards quick service
Data aggregation method.
Background technology
Now, information technology is flourishing swift and violent, and network has become an a kind of indispensable part.
Utilize web search demand information, use a network for the exchange and conmmunication of person to person, utilize net
Network carries out the issue etc. of information, and network makes the life of people become convenient, makes interpersonal
Distance become closer to.The major way that modern people search for information is by network, in the face of in real time
Change and the information updated, how effectively integrating these information has become what technological staff faced
Extremely urgent problem.Traditional data integration method limited in one's ability, the storage of mass data
Search procedure is made to become slow.Owing to data aggregation method has problems, so often there will be number
The most perfect according to retrieval, there is omission or the phenomenon repeated in part data retrieval.
Summary of the invention
The invention aims to solve shortcoming present in prior art, and the one proposed
Big data aggregation method towards quick service.
A kind of big data aggregation method towards quick service, comprises the following steps；
S1: network data is adopted by the way of on-line operation by big data platform on a large scale
Collection, and keep real-time synchronization with network data；
The data message of collection is carried out point by S2: big data platform according to different fields, industry
Class, and carry out detailed analysis, conclude and sum up, further according to analysis result according to dividing step by step
Mode carry out classification；
S3: the result divided step by step is stored in different information databases, it is ensured that Mei Gexin
Ceasing between data base non-interference, the most all information databases are all simultaneously connected with information search and put down
Platform；
S4: user inputs keyword or word in information search platform, in information search platform
Information retrieval unit each information database will be carried out quick-searching, and by respective knot
Fruit is sent to interpretation of result unit and carries out duplicate removal judgement, judges that through duplicate removal the result of screening passes again
Deliver to result summary unit and carry out conclusion and the summary of result, and arrange according to certain sequence
Sequence, the final result after sequence feeds back to user by result display unit.
Preferably, described data relate to multiple field or industry is then equal in involved field or industry
It is analyzed and divides.
Preferably, described duplicate removal judges it is that interpretation of result unit is carried out according to the retrieval result received
Analyze, the data of identical content are only left and taken a result.
The present invention makes the data of big data platform protect with network data by the way of on-line operation
Hold synchronization, it is ensured that search data ageing good, mass data through excessive data platform collection,
The mode analyzed and divide step by step carries out the refinement of data, it is simple to the fast search service in later stage,
And data are carried out the storage of different information database, both can increase the amount of storage of information,
Simultaneously when later retrieval, multiple data bases retrieve simultaneously, improve retrieval rate, duplicate removal
Judge ensure that and retrieve on the premise of quickly carrying out, the accuracy of data.
Detailed description of the invention
Below in conjunction with specific embodiment, the present invention is explained orally further.
A kind of big data aggregation method towards quick service that the present invention proposes, including following step
Suddenly；
S1: network data is adopted by the way of on-line operation by big data platform on a large scale
Collection, and keep real-time synchronization with network data；
The data message of collection is carried out point by S2: big data platform according to different fields, industry
Class, and carry out detailed analysis, conclude and sum up, further according to analysis result according to dividing step by step
Mode carry out classification；
S3: the result divided step by step is stored in different information databases, it is ensured that Mei Gexin
Ceasing between data base non-interference, the most all information databases are all simultaneously connected with information search and put down
Platform；
S4: user inputs keyword or word in information search platform, in information search platform
Information retrieval unit each information database will be carried out quick-searching, and by respective knot
Fruit is sent to interpretation of result unit and carries out duplicate removal judgement, judges that through duplicate removal the result of screening passes again
Deliver to result summary unit and carry out conclusion and the summary of result, and arrange according to certain sequence
Sequence, the final result after sequence feeds back to user by result display unit.
In the present invention, described data relate to multiple field or industry then in involved field or industry
All it is analyzed and divides.
In the present invention, described duplicate removal judges it is that interpretation of result unit enters according to the retrieval result received
Row is analyzed, and the data of identical content are only left and taken a result.
The present invention makes the data of big data platform protect with network data by the way of on-line operation
Hold synchronization, it is ensured that search data ageing good, mass data through excessive data platform collection,
The mode analyzed and divide step by step carries out the refinement of data, it is simple to the fast search service in later stage,
And data are carried out the storage of different information database, both can increase the amount of storage of information,
Simultaneously when later retrieval, multiple data bases retrieve simultaneously, improve retrieval rate, duplicate removal
Judge ensure that and retrieve on the premise of quickly carrying out, the accuracy of data.
The above, the only present invention preferably detailed description of the invention, but the protection model of the present invention
Enclosing and be not limited thereto, any those familiar with the art is in the skill that the invention discloses
In the range of art, according to technical scheme and inventive concept equivalent in addition thereof or change
Become, all should contain within protection scope of the present invention.
Claims (3)
1. the big data aggregation method towards quick service, it is characterised in that include with
Lower step；
S1: network data is adopted by the way of on-line operation by big data platform on a large scale
Collection, and keep real-time synchronization with network data；
The data message of collection is carried out point by S2: big data platform according to different fields, industry
Class, and carry out detailed analysis, conclude and sum up, further according to analysis result according to dividing step by step
Mode carry out classification；
S3: the result divided step by step is stored in different information databases, it is ensured that Mei Gexin
Ceasing between data base non-interference, the most all information databases are all simultaneously connected with information search and put down
Platform；
S4: user inputs keyword or word in information search platform, in information search platform
Information retrieval unit each information database will be carried out quick-searching, and by respective knot
Fruit is sent to interpretation of result unit and carries out duplicate removal judgement, judges that through duplicate removal the result of screening passes again
Deliver to result summary unit and carry out conclusion and the summary of result, and arrange according to certain sequence
Sequence, the final result after sequence feeds back to user by result display unit.
A kind of big data aggregation method towards quick service the most according to claim 1,
It is characterized in that, described data relate to multiple field or industry is then equal in involved field or industry
It is analyzed and divides.
A kind of big data aggregation method towards quick service the most according to claim 1,
It is characterized in that, described duplicate removal judges it is that interpretation of result unit is carried out according to the retrieval result received
Analyze, the data of identical content are only left and taken a result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610361834.4A CN105930524A (en) | 2016-05-28 | 2016-05-28 | Big data aggregation method facing quick service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610361834.4A CN105930524A (en) | 2016-05-28 | 2016-05-28 | Big data aggregation method facing quick service |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105930524A true CN105930524A (en) | 2016-09-07 |
Family
ID=56841284
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610361834.4A Pending CN105930524A (en) | 2016-05-28 | 2016-05-28 | Big data aggregation method facing quick service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105930524A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106529730A (en) * | 2016-11-16 | 2017-03-22 | 盐城工学院 | Object-oriented information management method for power enterprise |
| CN108829817A (en) * | 2018-06-12 | 2018-11-16 | 海南省火蓝数据有限公司 | A kind of Content Management System melting media for big data |
| CN110580255A (en) * | 2018-06-08 | 2019-12-17 | 深圳艾派网络科技股份有限公司 | method and system for storing and retrieving data |
| CN111858783A (en) * | 2020-07-10 | 2020-10-30 | 脑谷人工智能研究院(南京)有限公司 | Data induction and arrangement platform based on big data intelligent analysis |
| CN113704310A (en) * | 2021-09-08 | 2021-11-26 | 北京城建设计发展集团股份有限公司 | Rail transit driving command system and driving data processing method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101146152A (en) * | 2006-09-14 | 2008-03-19 | 中国电信股份有限公司 | Information collection and search system for telecommunication information station |
| CN102541864A (en) * | 2010-12-15 | 2012-07-04 | 北京航天长峰科技工业集团有限公司 | Public security service information management method |
| CN103365868A (en) * | 2012-03-29 | 2013-10-23 | 腾讯科技（深圳）有限公司 | Data processing method and data processing system |
-
2016
- 2016-05-28 CN CN201610361834.4A patent/CN105930524A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101146152A (en) * | 2006-09-14 | 2008-03-19 | 中国电信股份有限公司 | Information collection and search system for telecommunication information station |
| CN102541864A (en) * | 2010-12-15 | 2012-07-04 | 北京航天长峰科技工业集团有限公司 | Public security service information management method |
| CN103365868A (en) * | 2012-03-29 | 2013-10-23 | 腾讯科技（深圳）有限公司 | Data processing method and data processing system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106529730A (en) * | 2016-11-16 | 2017-03-22 | 盐城工学院 | Object-oriented information management method for power enterprise |
| CN110580255A (en) * | 2018-06-08 | 2019-12-17 | 深圳艾派网络科技股份有限公司 | method and system for storing and retrieving data |
| CN108829817A (en) * | 2018-06-12 | 2018-11-16 | 海南省火蓝数据有限公司 | A kind of Content Management System melting media for big data |
| CN111858783A (en) * | 2020-07-10 | 2020-10-30 | 脑谷人工智能研究院(南京)有限公司 | Data induction and arrangement platform based on big data intelligent analysis |
| CN113704310A (en) * | 2021-09-08 | 2021-11-26 | 北京城建设计发展集团股份有限公司 | Rail transit driving command system and driving data processing method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105930524A (en) | Big data aggregation method facing quick service | |
| CN107844565B (en) | Commodity searching method and device | |
| WO2014094332A1 (en) | Method for creating knowledge base engine for emergency management of sudden event and method for querying in knowledge base engine | |
| CN104077407B (en) | A kind of intelligent data search system and method | |
| CN107578353A (en) | The registrable property determination methods of work mark based on big data and device | |
| CN106033445B (en) | The method and apparatus for obtaining article degree of association data | |
| CN106055621A (en) | Log retrieval method and device | |
| JP2016532173A (en) | Semantic information, keyword expansion and related keyword search method and system | |
| CN104392006B (en) | A kind of event query processing method and processing device | |
| CN108363717B (en) | Data security level identification and detection method and device | |
| CN107609023A (en) | A kind of registrable property determination methods of the work mark based on big data and device | |
| CN111506727B (en) | Text content category acquisition method, apparatus, computer device and storage medium | |
| CN106559634A (en) | For the date storage method and device of traffic block port video monitoring | |
| CN110503249A (en) | One kind complaining prediction technique caused by having a power failure | |
| CN104881398B (en) | Chinese author sends out author's mechanism information abstracting method of english literature | |
| CN107832444A (en) | Event based on search daily record finds method and device | |
| CN103761286B (en) | A kind of Service Source search method based on user interest | |
| CN114817575B (en) | Large-scale electric power affair map processing method based on extended model | |
| CN108153781A (en) | The method and apparatus for extracting the keyword of business scope | |
| CN106611016A (en) | Image retrieval method based on decomposable word pack model | |
| CN109284409A (en) | Picture group geographic positioning based on extensive streetscape data | |
| CN107862867A (en) | Based on big data for the first time enter the method and system of city vehicle analysis | |
| WO2023020508A1 (en) | Automatic commodity classification method and apparatus, and computer device | |
| CN105786929A (en) | Information monitoring method and device | |
| CN113392304B (en) | Big data storage service method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160907 |