CN112668841A - Comprehensive traffic monitoring system and method based on data fusion - Google Patents
Comprehensive traffic monitoring system and method based on data fusion Download PDFInfo
- Publication number
- CN112668841A CN112668841A CN202011478467.9A CN202011478467A CN112668841A CN 112668841 A CN112668841 A CN 112668841A CN 202011478467 A CN202011478467 A CN 202011478467A CN 112668841 A CN112668841 A CN 112668841A
- Authority
- CN
- China
- Prior art keywords
- data
- monitoring
- management
- comprehensive
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention is suitable for the technical field of traffic, and provides a comprehensive traffic monitoring system and a method based on data fusion, wherein the comprehensive traffic monitoring system comprises a data access layer: the system comprises a comprehensive database, a traffic monitoring server and a traffic monitoring server, wherein the comprehensive database is used for respectively collecting different types of data, accessing real-time monitoring data of traffic operation and transmitting the data to the comprehensive database; a data fusion layer: comprises a data sharing exchange platform; metadata management and data maintenance management guarantee the accuracy of data and the smoothness of operation; and (3) a service application layer: the index monitoring system comprises an index monitoring system, an index monitoring system and early warning management. Therefore, the invention can form a basic information resource system capable of supporting the sharing application of the whole industry, provides a whole network, multi-mode, integrated and all-around monitoring and service for the industry, improves the cooperation between the government, the enterprise and the department, unifies the data standards, and realizes the effective conversion and application of the data and the enabling.
Description
Technical Field
The invention relates to the technical field of traffic, in particular to a comprehensive traffic monitoring system and method based on data fusion.
Background
The transportation informatization is developed at a high speed, but the globality, systematicness and cooperativity of each business field are insufficient, and the problems of difficult resource sharing, difficult interconnection and intercommunication and difficult business cooperation exist, a basic information resource system capable of supporting the whole industry sharing application is not formed, the open sharing degree of industry information resources is insufficient, the cross-mode, cross-department and cross-region information open sharing is insufficient, and data cannot be effectively converted, applied and enabled. Therefore, the multi-party data fusion cooperation needs to be promoted, the conversion to the multi-party co-construction shared traffic data is realized, and a scientific, fine and intelligent treatment and service system is created.
In view of the above, the prior art is obviously inconvenient and disadvantageous in practical use, and needs to be improved.
Disclosure of Invention
In view of the above-mentioned drawbacks, the present invention provides a comprehensive traffic monitoring system and method based on data fusion, which can form a basic information resource system capable of supporting industry-wide shared applications, provide network-wide, multi-mode, integrated, and all-around monitoring and service for industry, improve the coordination between government, industry, and department, unify data standards, and implement effective transformation, application, and enabling of data.
In order to achieve the above purpose, the invention provides a comprehensive traffic monitoring system based on data fusion, which comprises a data access layer, a data fusion layer and a service application layer.
The data access layer comprises a comprehensive database, and after different types of data are collected respectively in a data sharing exchange system-based mode, the collected data are accessed into real-time monitoring data of traffic operation through a data interface of the data access layer and are transmitted to the comprehensive database, so that the access and the convergence of data resources are realized.
The data fusion layer comprises a data sharing exchange platform, and the data sharing exchange platform is built by establishing a data standard specification and an information resource sharing directory; the data quality online control technology and the big data analysis technology fuse and share mass data; metadata management and data maintenance management guarantee the accuracy of data and the smoothness of operation.
The business application layer comprises an index monitoring system, an index monitoring system and early warning management, and a comprehensive traffic monitoring application system facing enterprises, industry administrative departments and traffic management departments is constructed.
According to the data fusion-based comprehensive traffic monitoring system, the data acquisition mode based on the data sharing and exchanging system comprises 4 modes of real-time data exchange, data import, manual input and direct use.
According to the comprehensive traffic monitoring system based on data fusion, the comprehensive database comprises a basic database, a business database, an index database, a subject database and a shared database.
According to the data fusion-based comprehensive traffic monitoring system, the data sharing and exchanging platform comprises an information resource sharing catalog management platform, a data exchanging and sharing platform, a data management and control platform and a big data analysis platform.
According to the data fusion-based comprehensive traffic monitoring system, the metadata comprise data of concepts, relations and rules in the business field and are used for supporting technical activities, management activities and business activities of the big data platform system, and metadata management realizes metadata acquisition, metadata storage, metadata functions, metadata encapsulation, metadata application and assists the big data platform system in perfecting safety control to form a metadata base, a shared exchange database and a data warehouse.
According to the data fusion-based comprehensive traffic monitoring system, the index monitoring system is a monitoring index system in the industry and is the basis for quantifying the target characteristics of a certain project in the industry, and the index monitoring system comprises two detection modules, namely daily monitoring and thematic monitoring.
A comprehensive traffic monitoring method based on data fusion based on a comprehensive traffic monitoring system comprises the following steps:
a. constructing a unified data standard specification and a data interface;
b. constructing a comprehensive traffic data information resource management system;
c. constructing a comprehensive traffic data sharing exchange system;
d. constructing a data quality control system;
e. constructing a big data analysis system;
f. constructing a metadata management system;
g. constructing a data maintenance management system;
h. constructing a data index calculation engine, and dividing the calculation logic of indexes in space and time dimensions to form an index calculation atom facing to a grid in space dimension and a calculation atom facing to the minimum moment of the indexes in time dimension;
i. constructing a monitoring service rapid development deployment system consisting of an application component set and a basic support service;
j. establishing a unified working environment for comprehensive traffic monitoring and early warning around the comprehensive traffic monitoring demand and early warning service;
k. based on abnormal monitoring conditions, providing a cooperative management mechanism and function for industry supervision departments and operation enterprises;
l, providing influence correlation analysis among indexes aiming at different side points concerned by nodes at different time;
and m, providing monitoring and early warning aiming at the comprehensive traffic operation condition.
According to the monitoring method of the comprehensive traffic system based on data fusion, the specific process of the data maintenance management system is as follows:
a. constructing a monitoring system for the operation of a data server and a website;
b. a set of access control mechanism is established to effectively control the entrance of illegal users so as to ensure the safety of an application system;
c. establishing a management system for users and user authorities, and controlling the functional authorities of the users and the operation authorities of system data;
d. establishing a log recording and management system for the processes of data adaptation, data transmission, exchange flow and the like;
e. establishing a backup and recovery strategy for data such as exchange node information, exchange node state information, exchange process configuration information, exchange process state information, log information and the like.
According to the monitoring method of the comprehensive traffic system based on data fusion, the detailed construction process of the metadata management system is as follows:
a. extracting data in a database;
b. cleaning the extracted data;
c. storing the cleaned data;
d. synchronizing the cleaned data to a service application;
e. the automatic acquisition requirement of data is met through the adapter.
According to the monitoring method of the comprehensive transportation system based on data fusion, a Hadoop ecosystem is adopted in the big data analysis system and comprises a hive warehouse, an HBase database and a Hadoop MapReduce.
The invention aims to provide a comprehensive traffic monitoring system and method based on data fusion, which process and process various links such as data access, preprocessing, fusion processing and the like by adopting the technologies such as data quality management and control, data association degree, fusion processing and the like, have the capabilities of quick calculation, access and visual presentation on the premise of ensuring the data accuracy, and create a scientific, fine and intelligent treatment and service system; the monitoring range covers three road network systems of urban road network, expressway and common road, covers four urban traffic modes of ground public transportation, rail transportation, taxi and slow traffic, four inter-urban traffic modes of highway, railway, civil aviation and water transportation, and covers 18 industry fields of tourism, junction, transportation of dangerous goods, static traffic, energy conservation and emission reduction, transfinite treatment and public opinion, a basic information resource system capable of supporting all-industry shared application is formed, all-road network, multi-mode, integrated and all-dimensional monitoring and service are provided for the industry, the collaborative force among government enterprises, the industry and provinces is improved, data standards are unified, and effective conversion, application and energy supply of data are realized. In conclusion, the invention has the beneficial effects that: the system has the capability of quick calculation, access and visual presentation, and creates a scientific, fine and intelligent treatment and service system; the system can form a basic information resource system capable of supporting the sharing application of the whole industry, provides a whole-path network, multi-mode, integrated and all-dimensional monitoring and service for the industry, improves the cooperative strength among government enterprises, industries and provinces, unifies the data standards, and realizes the effective conversion and application of the data and the enabling.
Drawings
FIG. 1 is a schematic diagram of the system architecture of the present invention;
FIG. 2 is a schematic diagram of a big data analysis technique route of the present invention;
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It should be noted that in the description of the present invention, the terms of direction or positional relationship indicated by the terms "upper", "lower", "left", "right", "inner", "outer", etc. are based on the directions or positional relationships shown in the drawings, which are only for convenience of description, and do not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation, and thus, should not be construed as limiting the present invention.
Furthermore, it should be noted that, in the description of the present invention, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
Referring to fig. 1 and 2, the present invention provides a comprehensive traffic monitoring system based on data fusion, including:
a data access layer: according to the existing various data resource acquisition conditions, the characteristics of various data sources and data updating and exchanging requirements are combined, network conditions are comprehensively considered, the fact that the data of different types are acquired respectively by 4 modes of real-time data exchange, data import, manual input, direct use and the like based on a data sharing and exchanging system is determined, then the acquired data are accessed into real-time monitoring data of traffic operation through a data interface of a data access layer, five comprehensive databases including a basic database, a business database, an index database, a theme database and a sharing database are built in the data access layer, and the accessed data are transmitted to a target database or a target system in the five comprehensive databases through data transmission, so that the data resources are accessed and converged.
A data fusion layer: the data sharing exchange platform is built by establishing a data standard specification and an information resource sharing directory, adopts a standard method and technology to establish an information classification rule, establishes a classification directory and an index for the shared information resources and services, realizes extraction of information resource related characteristic information, and forms public resource core metadata.
The data sharing exchange platform comprises:
the information resource sharing catalog management platform realizes the functions of catalog preparation, registration, management, release and the like of the shared information resources, and provides support for data sharing exchange and data resource query tracing.
The data exchange sharing platform is responsible for defining data exchange, transmission and access control strategies and providing an efficient data transmission and management control mechanism, and the data exchange sharing platform comprises the functions of integrating, sharing and exchanging data and files among unit related systems such as all service systems in a road network center, unit related service systems for deployment and the like.
The data management and control platform comprises data standard management and data quality management, and realizes full-flow data quality monitoring from a source system interface layer to an operation analysis system application layer through source system core data audit, source system dimensional table audit, data entity inspection, processing process inspection and key index inspection, so that data quality problems can be found in advance and processed in time.
The big data analysis platform realizes the processing and analysis of mass traffic data through a distributed processing system, and studies and judges the urban comprehensive traffic operation trend in a future period, so that the traffic operation analysis work can be developed more scientifically and efficiently, and support is provided for scientific decision making in the urban traffic industry.
The data fusion layer can also realize fusion and sharing of mass data, and particularly analyzes shared information resources and information exchange services provided by each unit through a data quality online control technology and a big data analysis technology, clears the structures and the mutual relations of the shared information resources, extracts relevant characteristic information of the exchange service resources and forms exchange service core metadata; and assigning values to the classification information in the core metadata of the information resources, and assigning codes to the unique identifiers of the information resources to realize the fusion and sharing of mass data.
Metadata also includes data extraction of concepts, relationships and rules in the business domain for supporting technical, management and business activities of large data platform systems. The metadata management and metadata management realizes the perfect safety control of metadata acquisition, metadata storage, metadata functions, metadata encapsulation, metadata application and an auxiliary big data platform system, forms a metadata base, and shares a switching database and a data warehouse.
The detailed process of the metadata management system construction is as follows:
a. extracting data in a database;
b. cleaning the extracted data;
c. storing the cleaned data;
d. synchronizing the cleaned data to a service application;
e. the automatic acquisition requirement of data is met through the adapter.
The data fusion layer guarantees the accuracy and the running stability of data through metadata management and data maintenance management; through technologies in the aspects of a metadata extraction engine, a blood margin analysis algorithm, a data quality check algorithm and the like, effective data management and control are performed, alarm information generated in data quality monitoring is managed, metadata information is integrated, topology presentation is realized, and a global view of a system data processing state and a quality condition is provided; the method comprises the steps that a physical facility platform based on a cluster is used for realizing the processing and analysis of mass traffic data through a distributed processing system; extracting data of concepts, relations and rules in the business field into metadata, and realizing metadata acquisition, metadata storage, metadata functions, metadata encapsulation, metadata application and complete safety control of an auxiliary big data platform system; and aiming at the collection and analysis and active alarm of all monitoring data in all monitoring ranges, the big data service environment is managed and controlled from the aspect of high availability.
The data maintenance mainly collects the running state of each machine component at regular time through the monitoring agent, such as the utilization rate of a CPU, the running of service, the communication of ports, the occupation of bandwidth flow and the like, and the monitoring server stores the information collected by the monitoring agent and vividly describes the running state of the machine in a graph display mode.
The specific process of the data maintenance management system is as follows:
a. constructing a monitoring system for the operation of a data server and a website;
b. a set of access control mechanism is established to effectively control the entrance of illegal users so as to ensure the safety of an application system;
c. establishing a management system for users and user authorities, and controlling the functional authorities of the users and the operation authorities of system data;
d. establishing a log recording and management system for the processes of data adaptation, data transmission, exchange flow and the like;
e. establishing a backup and recovery strategy for data such as exchange node information, exchange node state information, exchange process configuration information, exchange process state information, log information and the like.
And (3) a service application layer: the method is used for constructing a comprehensive traffic monitoring application system facing enterprises, industry departments and traffic management departments. Specifically, the service application layer is divided into an index monitoring system, an index monitoring system and pre-alarm management.
The index monitoring system is obtained by comprehensively calculating various indexes and weights, and can be a cross-industry monitoring system.
The index monitoring system is a monitoring index system in the industry and is a basis for quantifying the target characteristics of a certain project in the industry, the index monitoring system comprises two detection modules, one is a daily monitoring function module comprising more than ten fields such as an urban road network, an expressway, a common road, a ground bus and the like, the daily monitoring realizes the analysis of the industry operation trend by finely studying and judging industrial informationized data, and each field monitors comprehensive traffic from four hierarchical step types including a road network, a region, a channel and a node, thereby providing powerful support for improving the refinement level of a traffic management department; the other is a special monitoring function module for major activities, holidays, congestion point sections, traffic attraction points, extreme weather and the like, wherein the special monitoring is realized by constructing an index and index two-stage monitoring system, the industry operation situation is quantized in a grading manner, the index system is used for intuitively quantizing the cross-industry complex phenomenon, the overall urban traffic operation state is comprehensively monitored, and the comprehensive traffic cooperative operation is supported.
The early warning management comprises the steps that a PC edition is taken as a core and is also provided with a display layer, the display layer displays data subjected to background access processing in various forms such as a map, a line graph and a table, the data are displayed to the government, enterprises and the public in various forms such as a large screen, a webpage and an APP, when accident handling, important activities, traffic transportation guarantee in a key period and daily work scheduling are carried out, monitoring personnel realize important business operation through the PC edition, leaders and joint personnel visually master information at the same time through the large screen edition and carry out coordinated command scheduling, and front-line handling personnel receive scheduling instructions based on the mobile phone edition and can report feedback site conditions in real time.
On the basis of the comprehensive traffic monitoring system based on data fusion, the comprehensive traffic monitoring method based on the data fusion is also provided:
1. constructing a unified data standard specification and a data interface: the interface for accessing data is managed in a unified way, and can be accessed in various ways, including HTTP (hypertext transfer protocol), Kafka (open source streaming platform), WS (Web service), and the like, and the visual interface configuration is supported. Various interface components are provided that can be configured to perform data access functions.
2. Constructing a comprehensive traffic data information resource management system: the method adopts a service-oriented technical architecture to describe the characteristics of the shared information resources, forms uniform and standard directory contents, and organizes and manages the directory contents by effectively classifying the directory contents.
3. Constructing a comprehensive traffic data sharing and exchanging system: the shared exchange of data in various forms is realized by using various exchange components and exchange channels, including auditing of the shared exchange, shared exchange based on the exchange components, shared exchange based on data downloading, and shared exchange based on data service, and the shared exchange system requires configurability and automation, reduces manual intervention as much as possible, supports authentication, scrambling and desensitization, and provides a log management function of the shared exchange.
4. Constructing a data quality control system: the method comprises the steps of establishing an effective data quality monitoring mechanism by taking data accuracy, consistency, integrity, availability and safety as targets, setting data quality detection points in the main data processing stage of a system, managing alarm information generated in data quality monitoring, integrating metadata information, realizing topology presentation and providing a global view of data processing state and quality condition.
5. Constructing a big data analysis system: the method comprises the steps of adopting a Hadoop (Hadoop is a distributed system infrastructure developed by an Apache foundation) ecosystem, realizing on-demand service of shared configurable computing resources (comprising a network, a server, storage, application, service and the like), summarizing a hive warehouse (hive is a data warehouse tool based on the Hadoop) on the basis of distributed processing, realizing column-type storage of data through an HBase database (HBase is a distributed and column-oriented open source database), processing mass data in the HBase by utilizing a Hadoop MapReduce (MapReduce is a programming model and is used for parallel operation of large-scale data sets), and realizing quick query and positioning of the data;
6. constructing a metadata management system: the data is cleaned and integrated through the steps of extraction, conversion, loading and the like. The data cleaning is mainly to perform corresponding cleaning operation on data with problems of ambiguity, repetition, incompleteness, violation of business or logic rules and the like in a source database; data quality analysis is required to find problematic data prior to cleaning. Data loading is to load the extracted and converted result data into a target database through a loading tool or a self-written SQL (Structured Query Language) program.
7. Constructing a data maintenance management system: and monitoring the running condition of the platform in a visual interface mode, wherein the monitoring comprises the integrity of a resource directory, the health condition of a running environment, the running condition of a database, a shared exchange link, the running condition of a shared exchange task, alarming and processing, log query and statistical analysis, and providing a configuration function of related monitoring items.
8. Constructing a data index calculation engine: and calling data calculation services including index calculation services, classification services, feature analysis services and the like through the data calculation framework. The dependency relationship and the sequence of execution among the services are uniformly scheduled by a computing framework. Roughly divided into real-time calculations and offline calculations. The results are calculated by Spark (Spark is a fast and general calculation engine specially designed for large-scale data processing), hive script, a dimension table and an algorithm library which are defined in advance. The calculation result is saved to the DW.
9. Constructing a monitoring business rapid development deployment system consisting of an application component set and a basic support service: based on the general design idea of an SOA (Service-Oriented Architecture), the overall Architecture design is performed, and each independent functional unit is packaged in the form of a Service or a component, so that the expansibility, flexibility and robustness of the whole system are improved.
10. Establishing a comprehensive traffic monitoring and early warning unified working environment around the comprehensive traffic monitoring demand and early warning service: the PC edition is taken as a core, and the system has multiple display modes such as large screen and APP, when accident handling, important activities, traffic transportation guarantee in key period and daily work scheduling are carried out, monitoring personnel realize important business operation through the PC edition, leaders and joint personnel visually grasp information and carry out cooperative command scheduling through the large screen, and front-line treating personnel receive scheduling instructions based on the mobile phone edition and can report feedback field conditions in real time.
11. Based on abnormal condition monitoring, the system provides a cooperative management mechanism and function for industry supervision departments and operation enterprises: the method comprises the steps of building three levels of early warning information publishing platforms of provinces, cities and counties, realizing connection of related emergent public event emergency command platforms of all levels, and realizing uniform collection, management and publishing of early warning information of multiple departments of emergent events.
12. Aiming at different focus points concerned by nodes at different time, providing influence correlation analysis among indexes: the data mining analysis is carried out by a data mining method, such as mining algorithms of association analysis, cluster analysis, classification analysis, anomaly analysis, specific group analysis, evolution analysis and the like, and a search algorithm, a modeling technology and a learning theory of artificial intelligence, pattern recognition and machine learning are combined. Thereby grasping the intrinsic management relationship between the data.
13. Monitoring and early warning are provided aiming at the comprehensive traffic operation condition: based on an 'industry index + industry index' monitoring means of automatic sensing and big data dynamic fusion, the system realizes the functions of industry comprehensive operation monitoring and early warning, multi-index fusion analysis and intelligent aid decision support through a multi-screen collaborative application service mode, and provides full-path network, multi-mode, integrated and all-dimensional monitoring and service for the industry.
In conclusion, the platform adopts the technologies of data quality management and control, data association degree, fusion processing and the like to process and process various links such as data access, preprocessing, fusion processing and the like, has the capabilities of quick calculation, access and visual presentation on the premise of ensuring the data accuracy, and creates a scientific, fine and intelligent management and service system; the monitoring range covers three road network systems of urban road network, expressway and common road, covers four urban traffic modes of ground public transportation, rail transit, taxi and slow traffic, four inter-urban traffic modes of highway, railway, civil aviation and water traffic, covers 18 industry fields of tourism, junction, transportation of dangerous goods, static traffic, energy conservation and emission reduction, overrun control and public opinion, forms a basic information resource system capable of supporting all-industry shared application, provides all-road network, multi-mode, integrated and all-dimensional monitoring and service for the industry, improves the cooperative strength among government enterprises, industries and provinces, unifies data standards, and realizes effective conversion and transportation of data and enables the data. The invention has the beneficial effects that: processing and processing links such as data access, preprocessing, fusion processing and the like, and on the premise of ensuring data accuracy, the system has the capability of quick calculation, access and visual presentation, and creates a scientific, fine and intelligent treatment and service system; a basic information resource system capable of supporting the sharing application of the whole industry is formed, a whole-way network, a multi-mode, integrated and all-dimensional monitoring and service are provided for the industry, the cooperation force among government enterprises, the industry and the department is improved, the data standards are unified, and the effective conversion and application of the data and the enabling are realized.
The present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof, and it should be understood that various changes and modifications can be effected therein by one skilled in the art without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (10)
1. A comprehensive traffic monitoring system based on data fusion is characterized by comprising a data access layer, a data fusion layer and a service application layer;
the data access layer comprises a comprehensive database, and after different types of data are respectively collected in a data sharing exchange system-based mode, the collected data are accessed into real-time monitoring data of traffic operation through a data interface of the data access layer and are transmitted to the comprehensive database, so that the access and the convergence of data resources are realized;
the data fusion layer comprises a data sharing exchange platform, and the data sharing exchange platform is built by establishing a data standard specification and an information resource sharing directory; the data quality online control technology and the big data analysis technology fuse and share mass data; metadata management and data maintenance management guarantee the accuracy of data and the smoothness of operation;
the business application layer comprises an index monitoring system, an index monitoring system and early warning management, and a comprehensive traffic monitoring application system facing enterprises, industry administrative departments and traffic management departments is constructed.
2. The integrated traffic monitoring system based on data fusion of claim 1, wherein the data collection modes based on the data sharing and exchanging system include 4 modes of real-time data exchange, data import, manual entry and direct use.
3. The integrated traffic monitoring system based on data fusion of claim 1, wherein the integrated database comprises a base database, a business database, an index database, a subject database and a shared database.
4. The integrated traffic monitoring system based on data fusion of claim 1, wherein the data sharing and exchanging platform comprises an information resource sharing directory management platform, a data exchanging and sharing platform, a data management and control platform and a big data analysis platform.
5. The integrated traffic monitoring system based on data fusion of claim 1, characterized in that the metadata includes data of concepts, relations and rules in business field for supporting technical activities, management activities and business activities of the big data platform system, the metadata management implements metadata acquisition, metadata storage, metadata functions, metadata encapsulation, metadata application and assists the big data platform system to perfect security control, form metadata base, shared exchange database and data warehouse.
6. The integrated traffic monitoring system based on data fusion as claimed in claim 1, wherein the index monitoring system is an intra-industry monitoring index system, which is a basis for quantifying the target characteristics of a project in the industry, and comprises two detection modules of daily monitoring and thematic monitoring.
7. An integrated traffic monitoring method based on data fusion based on the integrated traffic monitoring system of any one of claims 1 to 6, characterized by comprising the following steps:
a. constructing a unified data standard specification and a data interface;
b. constructing a comprehensive traffic data information resource management system;
c. constructing a comprehensive traffic data sharing exchange system;
d. constructing a data quality control system;
e. constructing a big data analysis system;
f. constructing a metadata management system;
g. constructing a data maintenance management system;
h. constructing a data index calculation engine, and segmenting the calculation logic of indexes in the space dimension and the time dimension to form an index calculation atom facing to a grid in the space dimension and a calculation atom facing to the minimum moment of the indexes in the time dimension;
i. constructing a monitoring service rapid development deployment system consisting of an application component set and a basic support service;
j. establishing a unified working environment for comprehensive traffic monitoring and early warning around the comprehensive traffic monitoring demand and early warning service;
k. based on abnormal monitoring conditions, providing a cooperative management mechanism and function for industry supervision departments and operation enterprises;
l, providing influence correlation analysis among indexes aiming at different side points concerned by nodes at different time;
and m, providing monitoring and early warning aiming at the comprehensive traffic operation condition.
8. The comprehensive traffic monitoring method based on data fusion as claimed in claim 7, wherein the specific process of the data maintenance management system is as follows:
a. constructing a monitoring system for the operation of a data server and a website;
b. a set of access control mechanism is established to effectively control the entrance of illegal users so as to ensure the safety of an application system;
c. establishing a management system for users and user authorities, and controlling the functional authorities of the users and the operation authorities of system data;
d. establishing a log recording and management system for the processes of data adaptation, data transmission, exchange flow and the like;
e. establishing a backup and recovery strategy for data such as exchange node information, exchange node state information, exchange process configuration information, exchange process state information, log information and the like.
9. The integrated traffic monitoring method based on data fusion of claim 7, wherein the metadata management system is constructed in the following detailed process:
a. extracting data in a database;
b. cleaning the extracted data;
c. storing the cleaned data;
d. synchronizing the cleaned data to a service application;
e. the automatic acquisition requirement of data is met through the adapter.
10. The comprehensive traffic monitoring method based on data fusion of claim 7, wherein the big data analysis system adopts a Hadoop ecosystem, and comprises a hive warehouse, an HBase database and a Hadoop MapReduce.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011478467.9A CN112668841A (en) | 2020-12-15 | 2020-12-15 | Comprehensive traffic monitoring system and method based on data fusion |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011478467.9A CN112668841A (en) | 2020-12-15 | 2020-12-15 | Comprehensive traffic monitoring system and method based on data fusion |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112668841A true CN112668841A (en) | 2021-04-16 |
Family
ID=75406095
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011478467.9A Pending CN112668841A (en) | 2020-12-15 | 2020-12-15 | Comprehensive traffic monitoring system and method based on data fusion |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112668841A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113269446A (en) * | 2021-05-29 | 2021-08-17 | 北京第二外国语学院 | Cultural and tourism economic operation data monitoring system architecture |
| CN113762638A (en) * | 2021-09-16 | 2021-12-07 | 江苏长天智远交通科技有限公司 | Traffic transportation operation monitoring early warning and decision analysis system and method thereof |
| CN114500324A (en) * | 2022-01-24 | 2022-05-13 | 国家工业信息安全发展研究中心 | Integrated access system for industrial internet simulation test bed |
| CN115037769A (en) * | 2022-07-01 | 2022-09-09 | 成都民航空管科技发展有限公司 | SOA-based air traffic control automation system and implementation method thereof |
| CN116204576A (en) * | 2023-05-04 | 2023-06-02 | 北京城建交通设计研究院有限公司 | Method and system for generating GTFS format data by public transportation data |
| CN117112499A (en) * | 2023-10-25 | 2023-11-24 | 数研院(福建)信息产业发展有限公司 | Data directory grading method, medium and equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107274667A (en) * | 2017-08-14 | 2017-10-20 | 公安部交通管理科学研究所 | Urban transportation intelligence managing and control system networking joint control framework and implementation |
| CN107871204A (en) * | 2017-10-09 | 2018-04-03 | 中国电子科技集团公司第二十八研究所 | A kind of Urban Operation centric system architecture and engineering system |
| CN111178742A (en) * | 2019-12-25 | 2020-05-19 | 北京高诚科技发展有限公司 | Comprehensive traffic cooperative operation system and method based on multi-level index system |
| US20200334605A1 (en) * | 2018-11-21 | 2020-10-22 | Beijing Yutian Technology Co. Ltd | Emergency resource sharing and exchange system |
-
2020
- 2020-12-15 CN CN202011478467.9A patent/CN112668841A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107274667A (en) * | 2017-08-14 | 2017-10-20 | 公安部交通管理科学研究所 | Urban transportation intelligence managing and control system networking joint control framework and implementation |
| CN107871204A (en) * | 2017-10-09 | 2018-04-03 | 中国电子科技集团公司第二十八研究所 | A kind of Urban Operation centric system architecture and engineering system |
| US20200334605A1 (en) * | 2018-11-21 | 2020-10-22 | Beijing Yutian Technology Co. Ltd | Emergency resource sharing and exchange system |
| CN111178742A (en) * | 2019-12-25 | 2020-05-19 | 北京高诚科技发展有限公司 | Comprehensive traffic cooperative operation system and method based on multi-level index system |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113269446A (en) * | 2021-05-29 | 2021-08-17 | 北京第二外国语学院 | Cultural and tourism economic operation data monitoring system architecture |
| CN113762638A (en) * | 2021-09-16 | 2021-12-07 | 江苏长天智远交通科技有限公司 | Traffic transportation operation monitoring early warning and decision analysis system and method thereof |
| CN114500324A (en) * | 2022-01-24 | 2022-05-13 | 国家工业信息安全发展研究中心 | Integrated access system for industrial internet simulation test bed |
| CN114500324B (en) * | 2022-01-24 | 2023-08-18 | 国家工业信息安全发展研究中心 | Integrated access system for industrial Internet simulation test bed |
| CN115037769A (en) * | 2022-07-01 | 2022-09-09 | 成都民航空管科技发展有限公司 | SOA-based air traffic control automation system and implementation method thereof |
| CN115037769B (en) * | 2022-07-01 | 2024-03-22 | 成都民航空管科技发展有限公司 | SOA-based air traffic control automation system and realization method thereof |
| CN116204576A (en) * | 2023-05-04 | 2023-06-02 | 北京城建交通设计研究院有限公司 | Method and system for generating GTFS format data by public transportation data |
| CN117112499A (en) * | 2023-10-25 | 2023-11-24 | 数研院(福建)信息产业发展有限公司 | Data directory grading method, medium and equipment |
| CN117112499B (en) * | 2023-10-25 | 2024-01-02 | 数研院(福建)信息产业发展有限公司 | Data directory grading method, medium and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112668841A (en) | Comprehensive traffic monitoring system and method based on data fusion | |
| CN112687097A (en) | Highway highway section level data center platform system | |
| CN104616205B (en) | A kind of operation states of electric power system monitoring method based on distributed information log analysis | |
| CN105407159B (en) | Logistics transportation position service system | |
| CN114971574A (en) | Multi-mode information composite sensing and fusion framework and method based on cloud edge cooperation | |
| CN108197261A (en) | A kind of wisdom traffic operating system | |
| Song et al. | Big data and emergency management: concepts, methodologies, and applications | |
| Silva et al. | Disaster mitigation and preparedness using linked open data | |
| CN112988865A (en) | Industrial Internet service management system | |
| Badidi et al. | Towards a Platform for Urban Data Management, Integration and Processing. | |
| CN113869589A (en) | Power transmission line accident prediction method based on knowledge graph and inspection system | |
| CN110858354A (en) | Urban public safety service system | |
| CN117112702A (en) | Service rapid processing system for long and large bridge tunneling scene | |
| CN117033504A (en) | Mass data distributed management system of homeland space basic information platform | |
| CN112383435B (en) | Fault processing method and device | |
| Jia et al. | Intelligent traffic decision analysis system based on big data mining | |
| CN112180861A (en) | Integrated bridge monitoring system | |
| Boubiche et al. | Integrating Big data paradigm in WSNs | |
| Zhao et al. | Research on the application of big data technology in smart city | |
| CN116129640B (en) | Data management method and device for road data | |
| Liu | Intelligent Community Management System Based on Big Data Technology | |
| Guo et al. | Multi-source heterogeneous data access management framework and key technologies for electric power Internet of Things | |
| Citrigno et al. | Smart Applications for Smart City: a Contribution to Innovation. | |
| Min et al. | Development and Application of Power Grid Disaster Intelligent Perception and Emergency Command System | |
| Narendra et al. | Dynamic Contextual Goal Management in IoT-Based Systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |