CN106844391A - The method that security data query and storage are carried out using big data - Google Patents
The method that security data query and storage are carried out using big data Download PDFInfo
- Publication number
- CN106844391A CN106844391A CN201510887934.6A CN201510887934A CN106844391A CN 106844391 A CN106844391 A CN 106844391A CN 201510887934 A CN201510887934 A CN 201510887934A CN 106844391 A CN106844391 A CN 106844391A
- Authority
- CN
- China
- Prior art keywords
- data
- application
- layer
- analysis
- security
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2219—Large Object storage; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
A kind of method that application big data carries out security data query and storage, during each service application in original system all incorporated into cloud computing framework, is divided into and is included into infrastructure layer, podium level, application layer；Infrastructure layer by the data classified and stored of front-end collection to corresponding resource pool, data source support is provided for podium level to data calculate excavating respectively；Podium level is calculated all data that infrastructure layer is provided, mathematical modeling, comprehensive analysis, data are processed by analysis model, algorithm engine, digging tool, using big data calculation, to data comprehensive analysis, laterally series connection is concluded in longitudinal direction, while being attached data with upper application layer by ESB ESB；Application layer converges the information access of security business all departments.
Description
Technical field
The present invention relates to network data management and application field, and in particular to one kind application big data carries out security data query and deposits
The method of storage.
Background technology
With the development of the collection neutralization business of data, public security system runs the society of accumulative police service data and its correlation for many years
With reference to data, such as bayonet socket, video, criminal, society rapidly increases than reciprocity data volume, and public security industry is to data
Application demand has not surmounted the demand that traditional historical data is backed up for management, and traditional Intellectual Analysis Technology cannot meet at all
Demand.Information-based high speed development, the demand and big data technology trends of public business application, promotes police field application big
Data are analyzed, and make the police service cloud system based on big data platform, be public security industry solve data volume it is huge, originate it is many
The complicated problem of sample, treatment.Therefore, the application such as efficient storage, inquiry, analysis, early warning is extremely urgent for public security system.
The present invention proposes that a kind of big data cloud computing architectural framework that is based on solves public security data query and stores this problem.
The content of the invention
The present invention is directed to propose the system that a kind of inquiry solved based on cloud computing big data technology in public security data is applied with storage
The method of architecture design, can be effectively applied to the business demand of public security, police service application and information for police field, can be based on
The architectural framework of proposition builds police service cloud platform.
Technical scheme is as follows：
A kind of method that application big data carries out security data query and storage, it is characterised in that：By the information data in original system
Collection, data summarization, information sharing, data storage, analysis mining technology, computation model, each service application all incorporate
In cloud computing framework, it is divided into and is included into infrastructure layer, podium level, application layer；
Computing resource pond, memory resource pool, Internet resources pond are included in infrastructure layer, respectively sorts out the data of front-end collection
Store to corresponding resource pool, data source support is provided for podium level to data calculate excavating；
Podium level is calculated all data that infrastructure layer is provided, mathematical modeling, comprehensive analysis, by analysis model,
Algorithm engine, digging tool are processed data, and using big data calculation, to data comprehensive analysis, laterally longitudinal direction is returned
Receive series connection, while data are attached with upper application layer by ESB ESB；
Application layer converges public business many categories within police force, multidisciplinary, multi-service system, by information, commander, traffic, fire-fighting, anti-terrorism,
The information access of public access offices, data, the analysis result for adequately and reasonably being provided using lower floor, are business system service.
Big data proposed by the present invention inquiry and storage cloud platform, are the fruitful raising of big data framework that public security system is made
The overall efficiency of operation of original police affairses system.New system architecture can make existing public security industry in applying to public business
Data storage and query aspects high speed development, embody in the following areas in business：
First is that big data technology realizes efficient real-time query, storage, security system is significantly lifted business efficiency.Build
Big data cluster environment is totally time-consuming only to be needed ten minutes or so, substantially reduces the on-line time of operation system.Simultaneously by opening
Hair big data excavates application, ensures and significantly shortens query time in the inquiry of hundred million DBMSs, so as to improve security system to phase
The inquiry of pass information, retrieval capability.Draw to about 400,000,000 records (occur in different cities in 1 hour by pressure test
Same vehicle license number) retrieval in, obtain more than 4500 bar related datas.
Second disposes a time for application by former 1-2 month using virtualization advanced technology, upper layer application rapid deployment
It is reduced to or so 2 hours.After new system is reached the standard grade, be able to can just be completed by empty machine construction and the built-in application template of system
Using deployment, one application time of deployment was reduced to 1-2 hour by former 1-2 month.
3rd is to rely on big data police service cloud, and the extended capability and system reliability of security system been significantly enhanced.With business
Demand growth, often occur original server cannot support works load pressure situation, in conventional data storage foundation frame
Generally require to buy the server more increased and match somebody with somebody on structure, then move on new server application, but often related to using migration
And shut down to business.Under present cloud platform architecture, it is only necessary to which the resources such as Installed System Memory, CPU are extended, without
Shutting down can be for application load provides the resources such as more calculating, storage, internal memory, networks.Current system is based entirely on cloud meter
Framework is calculated, is capable of achieving, from switching is striven forward, to have also related to the safety precautions such as backup after the system failure.Total system reliability
Compared to being substantially improved in the past.Additionally, new big data cloud framework also simplify substantial amounts of work in terms of operation maintenance.Framework
In carry the system that can monitor the operation health status of all hardware resource under cloud platform, pinpoint the problems in time and solved.
Specific embodiment
The existing multiple servers of security system integrate and construct unified police service cloud platform, it is original it is some should
Also moved to comprehensively in new cloud platform with system, while allowing to increase multiple applications, such as pattern of crime in security system
The hot spot applications such as identification, road conditions early warning and anti-terrorism early warning, it is contemplated that can be applied for more than nearly 150 and be runed on big data platform,
The inquiry of the data in guarantee security system and storage service demand.
By the information data collection in security system, data summarization, information sharing, data storage, analysis mining technology, calculating
During model, each service application etc. all incorporate cloud computing framework, be divided into be included into infrastructure layer (IaaS), podium level (PaaS),
Application layer (SaaS).
Computing resource pond, memory resource pool, Internet resources pond are included in infrastructure layer (IaaS), respectively by front-end collection
Data classified and stored is to corresponding resource pool.Data source support is provided for podium level to data calculate excavating.
Podium level (PaaS) is also the emphasis of the design, and it is calculated all data that infrastructure layer is provided, mathematics is built
Mould, comprehensive analysis.Data are processed by the Stream Processing mode such as analysis model, algorithm engine, digging tool, is used
Big data calculation, to data comprehensive analysis, laterally series connection is concluded in longitudinal direction, for the Information System in security system provides data
Analysis result.Emphasis personnel management and control that the data of analysis are mainly in information, pattern of crime are distinguished, the analysis of road condition analyzing, prediction scheme,
The transverse and longitudinal such as combine related cases is analysed and compared, for the analysis of big information data provides strong data support.Pass through ESB simultaneously
With upper application layer be attached data by ESB.
Application layer (SaaS) converges security business many categories within police force, multidisciplinary, multi-service system, by information, commander, traffic, disappears
Anti-, anti-terrorism, letters and calls, each committee of other whole cities do the information access such as office, data, the analysis for adequately and reasonably being provided using lower floor
As a result, it is full the service of security business system to be.
Simultaneously, it is considered to which whole big data architectural framework safely and steadily runs, by network security system, operation and maintenance system, security
The security systems such as net internet video private network, information management platform, the overall planning of standard criterion system, global design.For whole
Security big data framework provides strong guarantee and services.
At the same time the business in whole security systems can be provided by modes such as related cloud data center operating systems
The integration and unified management in source.
Claims (1)
1. a kind of method that application big data carries out security data query and storage, it is characterised in that：By the information in original system
Data acquisition, data summarization, information sharing, data storage, analysis mining technology, computation model, each service application whole
Incorporate in cloud computing framework, be divided into and be included into infrastructure layer, podium level, application layer；
Computing resource pond, memory resource pool, Internet resources pond are included in infrastructure layer, respectively sorts out the data of front-end collection
Store to corresponding resource pool, data source support is provided for podium level to data calculate excavating；
Podium level is calculated all data that infrastructure layer is provided, mathematical modeling, comprehensive analysis, by analysis model,
Algorithm engine, digging tool are processed data, and using big data calculation, to data comprehensive analysis, laterally longitudinal direction is returned
Receive series connection, while data are attached with upper application layer by ESB ESB；
Application layer converges security business many categories within police force, multidisciplinary, multi-service system, by information, commander, traffic, fire-fighting, anti-terrorism,
The information access of letters and calls, data, the analysis result for adequately and reasonably being provided using lower floor are the service of security business system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510887934.6A CN106844391A (en) | 2015-12-07 | 2015-12-07 | The method that security data query and storage are carried out using big data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510887934.6A CN106844391A (en) | 2015-12-07 | 2015-12-07 | The method that security data query and storage are carried out using big data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106844391A true CN106844391A (en) | 2017-06-13 |
Family
ID=59151964
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510887934.6A Pending CN106844391A (en) | 2015-12-07 | 2015-12-07 | The method that security data query and storage are carried out using big data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106844391A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108965451A (en) * | 2018-07-31 | 2018-12-07 | 南京中铁信息工程有限公司 | A kind of police service cloud computing platform unifies O&M operation platform system |
| CN111371830A (en) * | 2019-11-26 | 2020-07-03 | 航天科工网络信息发展有限公司 | Intelligent cooperative cloud architecture based on data driving under ten thousand network fusion scene |
-
2015
- 2015-12-07 CN CN201510887934.6A patent/CN106844391A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108965451A (en) * | 2018-07-31 | 2018-12-07 | 南京中铁信息工程有限公司 | A kind of police service cloud computing platform unifies O&M operation platform system |
| CN111371830A (en) * | 2019-11-26 | 2020-07-03 | 航天科工网络信息发展有限公司 | Intelligent cooperative cloud architecture based on data driving under ten thousand network fusion scene |
| CN111371830B (en) * | 2019-11-26 | 2022-09-30 | 中国长峰机电技术研究设计院 | Intelligent cooperative cloud architecture based on data driving under fusion scene of ten thousand networks |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107577771B (en) | Big data mining system | |
| CN104778245A (en) | Similar trajectory mining method and device on basis of massive license plate identification data | |
| CN103970851B (en) | The method that magnanimity Credential data directly provides general headquarters of large-size enterprise group financial statement | |
| CN105631026A (en) | Security data analysis system | |
| CN111563524A (en) | Multi-station fusion system operation situation abnormity monitoring and alarm combining method | |
| CN103530715A (en) | Grid management system and grid management method of high-speed railway train operation fixed equipment | |
| CN112446549A (en) | Urban garbage intelligent supervision platform based on big data | |
| Heydarian et al. | A visual monitoring framework for integrated productivity and carbon footprint control of construction operations | |
| KR20180086602A (en) | Apparatus and method for estimating traffic jam area based on machine learning | |
| CN106844391A (en) | The method that security data query and storage are carried out using big data | |
| CN116824868A (en) | Method, device, equipment and medium for identifying illegal parking points and predicting congestion of vehicles | |
| KR101400499B1 (en) | Apparatus and method of parallel processing of linked big data | |
| US20240028950A1 (en) | Method and system for urban road infrastructure monitoring | |
| CN109447306B (en) | Subway accident delay time prediction method based on maximum likelihood regression tree | |
| CN116012019A (en) | Financial wind control management system based on big data analysis | |
| CN114155447B (en) | Artificial intelligence big data acquisition system | |
| CN115186935A (en) | Electromechanical device nonlinear fault prediction method and system | |
| CN107248118A (en) | Data digging method, device and system | |
| Shen et al. | LSTM combined with BIM technology in the management of small and medium-sized span highway concrete beam bridges | |
| CN112416898A (en) | Intelligent water conservancy data center construction method | |
| Costantini et al. | Digital forensics evidence analysis: An answer set programming approach for generating investigation hypotheses | |
| Wang et al. | Air quality data analysis and forecasting platform based on big data | |
| Alalloush et al. | Usage of k-means algorithm to analyze crime dataset | |
| Hu et al. | Traffic Flow Prediction Method Based on Big Data Mining | |
| CN117523825A (en) | Intersection vehicle flow data processing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170613 |
|
| WD01 | Invention patent application deemed withdrawn after publication |