CN103500173B - A kind of querying method of track traffic Monitoring Data - Google Patents

A kind of querying method of track traffic Monitoring Data Download PDF

Info

Publication number
CN103500173B
CN103500173B CN201310395393.6A CN201310395393A CN103500173B CN 103500173 B CN103500173 B CN 103500173B CN 201310395393 A CN201310395393 A CN 201310395393A CN 103500173 B CN103500173 B CN 103500173B
Authority
CN
China
Prior art keywords
data
data file
monitoring
index
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310395393.6A
Other languages
Chinese (zh)
Other versions
CN103500173A (en
Inventor
鲍侠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING TAILEDE INFORMATION TECHNOLOGY Co Ltd
Original Assignee
BEIJING TAILEDE INFORMATION TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING TAILEDE INFORMATION TECHNOLOGY Co Ltd filed Critical BEIJING TAILEDE INFORMATION TECHNOLOGY Co Ltd
Priority to CN201310395393.6A priority Critical patent/CN103500173B/en
Publication of CN103500173A publication Critical patent/CN103500173A/en
Application granted granted Critical
Publication of CN103500173B publication Critical patent/CN103500173B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2453Query optimisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a kind of querying method of track traffic Monitoring Data.This method is:1)Data-storage system checks the monitor data file newly stored in real time, and is converted into binary form and is stored;Wherein, data-storage system uses cloud computing platform, and it includes a distributed memory system and a search index system;2)Data-storage system carries out parallel processing to the monitor data file, and creating one to each detection data file is indexed, and the corresponding index data of each monitor data file is inserted into the search index system;3)The search index system is inquired about according to the detection inquiry request of input and obtains monitor data file list, then reads Monitoring Data record from the monitor data file of the distributed memory system according to the detection data file list.The present invention substantially increases the establishment speed of index and the efficiency of inquiry.

Description

A kind of querying method of track traffic Monitoring Data
Technical field
The present invention provides a kind of querying method of track traffic Monitoring Data, belongs to field of cloud computer technology.
Background technology
As China railways include the Large scale construction of government railway, enterprise railway and City Rail Transit System, railway Equipment, the technology of particularly Source of Railway Communication and Signalling equipment is increasingly advanced, but railway electrical maintenance maintenance technology is not adjoint The Large scale construction of railway and synchronized development, cause railway electrical maintenance maintenance technology to turn into the weak ring of technology of railway territory Section.The Liang Ge main market players of railway electrical:Railway communication signal(Railway parent company, Railway Bureau, electricity business section, electricity business workshop, electricity business Work area)With Source of Railway Communication and Signalling equipment vendors, while line pressure on huge is carry, carry again it is increasingly heavy on The O&M pressure of line equipment, they are for raising railway electrical maintenance maintenance technical merit and the information metaplasia of production safety ability Production instrument has the market demand urgently met.
Currently for the existing a variety of monitoring systems of Source of Railway Communication and Signalling equipment, include the vehicle computing of high ferro signal monitoring Machine (ATP), railway wireless network (GSM-R), radio block center (RBC), temporary speed limitation (TSRS) and existing signal monitoring (CSM):Interlock (CBI), dispatching concentration (CTC) and train control center (TCC) and the monitoring of other basis signals, including track switch, rail Road circuit, semaphore and power supply panel etc., in addition to these equipment monitoring systems, AT STATION, electricity business section, urban rail cluster car Section and urban rail wire center also all deploy CSM systems, believe for the Monitoring Data and alarm of managing various equipment concentratedly Breath, and notify electric business personnel to carry out maintenance maintenance according to these information.
At present, the subject matter that railway communication signal is present be continued to use in electricity business production process traditional plan and control and therefore Hinder the electricity business mode of production repaiied, numerous advanced communication and signal equipments are maintain, inevitably according into the blind of hidden trouble of equipment Area, blind spot, electricity business production field generally existing surplus and repaiied and phenomenon in bad repair.Surplus is repaiied, and what is brought is the huge of person property's power Waste;And it is in bad repair, then it may bring the driving accident of car crash.Vast railway electrical personnel, in heavy psychological pressure and The normal operation of communication and signal equipment is maintain under labor intensity load, with manpower, be can't bear the heavy load.They are in the urgent need to a set of energy The tool of production of enough solution electric discharge business productivity --- synthesization, intelligentized electricity business monitoring operational system, so that will be current with failure Repair, plan and control is the traditional electricity business safety in production O&M pattern being oriented to, be progressively changed into using status maintenance as the informationization being oriented to Electricity business safety in production O&M pattern, look into hidden danger so as to realize, control hidden danger, by hidden trouble of equipment eliminate bud, realize protect Hinder the electricity business Safety Production Target of traffic safety.
The subject matter that Source of Railway Communication and Signalling equipment vendors presently, there are is, the relative distribution of monitoring information and isolated, So that the utilization of monitoring information is very inconvenient, utilization rate is not high.It is each other between the monitoring information that part monitoring system is produced Relatively independent information island, Centralizing inspection is not fully achieved also;The management method of existing track traffic Monitoring Data is Data used are all used into relational database, such as oracle database is stored and managed.In order to tackle the number of magnanimity According to generally using the cluster being made up of multiple database servers, such as Oracle RAC.In relational database, data are It is highly independent, with monitoring and the gradually increase of data storage amount, the data storage and way to manage of relational database cluster With following deficiency:
It is to carry out storage using 3 grades of memories and deposit parallel to carry out storing current topmost method for high-volume database Storage and inquiring technology.But these methods are disadvantageous in that the expense for hardware compares for the storage maximum of data Greatly, and need to develop special Database Systems it is managed, and their most essential thinkings are exactly to expand firmly Part equipment obtains big memory space, processing time of the inquiry greatly increased while increasing storage capacity.
Although the processing speed for the high speed that parallel database technology is obtained using multiple processors, cost is increase hardware Expense, and the growth rate of processing will be less than the processing speed of hardware device.When data volume is very big, data query and analysis Need the time overhead spent very big Deng operation, it is impossible to meet the need for rapid data browses and analyze and process.
The content of the invention
In view of the above-mentioned problems, it is an object of the invention to provide a kind of querying method of track traffic Monitoring Data, passing through cloud Platform, cloud storage technology improve the search efficiency of various resources and track traffic Monitoring Data.
To achieve the above object, the technical solution adopted by the present invention is as follows:
A kind of querying method of track traffic Monitoring Data, its step is:
1)Data-storage system checks the numeric type monitor data file newly stored in real time, and is converted into binary system shape Formula is stored;Wherein, data-storage system uses cloud computing platform, and it includes a distributed memory system and a search index System;
2)Data-storage system carries out parallel processing to the monitor data file, and one is created to each detection data file Index, and the corresponding index data of each monitor data file is inserted into the search index system;
3)The search index system is inquired about according to the detection inquiry request of input and obtains monitor data file list, so Read Monitoring Data record from the monitor data file of the distributed memory system according to the detection data file list afterwards.
Further, the distributed memory system is HDFS storage systems, and the search index system is Hbase indexes Inquiry system.
Further, the cloud computing platform is provided with host node and some child nodes;Check distributed using host node The monitor data file newly stored in HDFS storage systems, and create the index data of the detection data file;The cloud computing The monitor data file is distributed to the parallel establishment that different child nodes are indexed by platform.
Further, the distributed memory system includes a meta data file, and the distributed memory system extracts prison The metadata of data file is surveyed, as a data record storage in the meta data file.
Further, the metadata include filename, monitor data file in field in the monitor data file Offset, monitoring file size.
Further, it is described to be to the method that each detection data file creates an index:
1) child node is recorded simultaneously to the newly-built data flow of each monitor data file index creation task distributed The filename of the monitor data file;
2)Child node extracts metadata according to file name from the meta data file, and according to the metadata record pair The monitoring file data is parsed, and the index field for extracting setting using the offset is added to index data list In;
3)Child node sets up a concordance list to each index field in index data list;Packet in the concordance list Include:Index field, data acquisition time, the storage address of Monitoring Data record.
Further, the line unit of the concordance list is arranged according to syllable sequence order.
Further, the cloud computing platform sets host node and child node using Zookeeper, and to the cloud computing Platform carries out load balancing.
Further, the monitor data file includes the equipment state record of some collections;The equipment state record Some switching values and the value of analog quantity of corresponding monitoring of equipment signal under time including data acquisition, and the time.
Further, the monitoring inquiry request includes the time range and monitoring parameter of Monitoring Data.
Track traffic Monitoring Data is produced and preserved in the form of the switching value and analog quantity of monitoring of equipment signal.So The switching value and analog data at a certain moment are merged into an equipment state record by data collecting system afterwards, are stored in each electricity The centralized monitoring system for section of being engaged in.The equipment state records the time for including data acquisition, and setting corresponding under the time Some switching values and the value of analog quantity of standby monitoring signals.Comprehensive operation platform is collected simultaneously to the Monitoring Data of each electricity business section It is centrally stored in data-storage system.Data-storage system in the present invention uses cloud computing platform, utilizes numerous X86-based meters Calculation machine, sets up the distributed cloud computing platform with good reliability and scalability, can be to being up to PB grades of Monitoring Data Carry out monitoring processing in real time to support there is provided multiple business such as the real-time query of Monitoring Data analyses, be device data prison shown in Fig. 1 The framework of Monitoring Data collection and inquiry system in examining system.
As shown in figure 1, continuously slave unit signal acquiring system gathers out Monitoring Data, then these original numbers According to that will be handled by synthesis system, to generate Monitoring Data record.The Monitoring Data record of synthesis is with close to text data Form represent that dozens of data field is included in each record, and such as track circuit voltage, track circuit phase angle are believed Breath.Monitoring Data is generally with a regular time(Such as one minute)It is maintained at for unit in the database of data collecting system. Therefore, it is per minute all to have a Monitoring Data generation, and according to the difference of equipment frequency acquisition, can be wrapped in daily monitor database Recorded containing many Monitoring Datas.The storage system of these centrally stored data is with greater need for the prisons stored in the multiple electricity business sections of maintenance Survey data.
In order to be able to be inquired about these Monitoring Datas record, it is necessary to be converted into binary form.Using binary system The advantage of storage is can to save memory space, and can carry out data storage with fixed byte length.Due to binary form Record between offset be fixed value, therefore be easy to create the index inquiry related to progress.Table 1 is original record structuring A kind of concrete form of storage, is converted into binary form.For the storage and management of these structural datas, the present invention Solution be:Monitoring Data is synthesized into a data file in units of daily, is stored in HDFS systems, while in order to Quick search disposal ability is provided, search index will be set up for Monitoring Data record, and these search indexes are stored in In HBase.
Table 1 is the concrete form of original record structured storage
Numbering Device name Work(goes out voltage(Volt) Work(goes out electric current(Milliampere) Carrier frequency(Hertz) Low frequency(Hertz)
1 3DG 114.40 358.00 2298.70 27.80
2 7DG 114.40 415.00 2598.70 27.90
3 9DG 78.60 173.00 1701.40 26.70
4 13DG 76.20 202.00 2001.40 27.90
5 17DG 111.50 355.00 2298.70 27.80
Therefore, to from collection and synthesis system, the monitor data file per minute continually produced is, it is necessary in real time These data files are checked, and are indexed establishment processing in time.Index data includes the acquisition time of Monitoring Data, monitoring ginseng Several and corresponding storage address.
Because Monitoring Data amount is huge, it is necessary to using multiple servers progress parallel processing, so be accomplished by a management Person carrys out the newly-generated monitor data file of scanography, and the index creation task of different monitor data files is distributed to not Processing is gone with node.Accordingly, it would be desirable to consider to carry out parallelization task scheduling and load balance process on computing cluster, to complete Search index processing task above.
In specific design, overall plan can be divided into two large divisions.
Part I is that the reading of monitor data file and the search index based on HBase are created., it is necessary to set during this Putting a host node is used to detect monitor data file new in HDFS, and then, the host node is by the Monitoring Data detected File distributing completes search index to different child nodes and created, and the corresponding index data of every monitoring record is inserted into In HBase.In order to prevent host node single-unit point failure and handle load balancing well, whole calculating is managed using Zookeeper Cluster.
Part II is the search index based on HBase, receives and handle the monitoring inquiry request of user(Inquiry request bag Include the time range and monitoring parameter of Monitoring Data), specific query processing is completed into HBase, result monitoring number is being obtained After record queries list, then detailed Monitoring Data record is read into the monitor data file for be stored in HDFS, and one by one Return to client.
Compared with prior art, the positive effect of the present invention is:
(1)Large-scale data is stored using file database system, relational database cluster maintenance and expansion are solved Cost.
(2)Structure data is stored by binary form, the space for taking storage is reduced.
(3)Data directory is set up using parallel method, the establishment speed of index is improved, and improves the efficiency of inquiry.
Brief description of the drawings
Fig. 1 track traffic Monitoring Data Management System structural framing figures;
Fig. 2 illustrates the Monitoring Data query processing flow of the above.
Embodiment
Below by specific embodiments and the drawings, the present invention is described in detail.
The structural framing of track traffic Monitoring Data Management System as shown in Figure 1 includes following major part:
(1)Distributed document storage based on HDFS
The main function of the part is to provide the storage platform of Monitoring Data.Distributed file system is located at whole system Bottom, it provides unified memory access interface to computation model layer, database layer, and other modules can be very square by calling for interface Just data are accessed in distributed file system.Meanwhile, the mechanism such as replication policy, load balancing that this layer is provided also ensure that The availability and reliability of storage platform, stable, dependable memory space is provided for whole system.
(2)Index management based on HBase
The main function of the part is to provide data storage support, can provide data persistence to operation layer and computation layer Function.And set by rational major key and Indexing Mechanism, provide efficient data access capabilities to upper strata.Made using HBase For database, system high concurrent, the demand of enhanced scalability disclosure satisfy that.While the data storage on monitoring device information In HBase.
(3)Distributed scheduling management based on Zookeeper
The main function of the part is that the server cluster of whole system is managed, while providing global configuration information Management function.By calling index generating algorithm, index is generated to the data parallel that is stored in distributed file system.
(4)Data analysis based on MapReduce
The main function of the part is that the data being stored in distributed file system are carried out using data analysis algorithm Analysis, and export analysis result.
(5)Data memory interface
The main function of the part is the equipment condition monitoring data that collection is received from data collecting system, by data storage To distributed file system.
(6)Data-query interfaces
The main function of the part is to receive data inquiry request from data exhibiting layer, literary from distribution by data directory Required data are inquired about in part system, by data returned data represent layer.
The implementation steps of the present invention are as follows:
(1)The storage of Monitoring Data
The Monitoring Data obtained from data collecting system, the form that it is stored is as shown in table 1.In order to save the sky of storage Between and improve inquiry efficiency, the data of these structurings are used as storage with the structured data type of a set form Type.Include the data type and offset in the structure of each single item in these structured data types, these information together with The initial time of data storage is stored with meta data file in each file.Data memory interface is each by what is obtained Ending of the data supplementing storage at moment to the respective file of distributed file system., will when file size reaches limit value Mono- new file of data Cun Chudao, and a new data record is generated in the metadata.
(2)The detection of monitor data file and index creation task scheduling.
Monitoring Data is organized in the form of a file, and processing at this stage is directly to be stored in data in binary form In file, not comprising any redundant data.Follow-up inquiry will obtain data by filename and offset.Due to monitoring Data are the monitoring files that we must be new in scanning system in real time, then by Monitoring Data all the time all in generation File is assigned to different index creation nodes.In order to realize that the load balancing and single-point of system are fault-tolerant, file scan will be monitored Service and index creation service are distributed on different nodes, are so accomplished by a manager Zookeeper to manage these Cluster.
Based on computing cluster, the Basic Design and implementation method being uniformly controlled with Zookeeper completions are, by computing cluster In all node all include Zookeeper management, selection two of which calculate node is registered as Zookeeper Master Service node(It is responsible for the scanning of new monitor data file and the scheduling distribution of index creation task), Zookeeper will be automatic A primary server joint is elected in two server nodes.When primary server joint breaks down, Zookeeper is by energy Automatically a remaining server node is promoted to the master server that primary server joint carrys out taking over failing, with this, it is ensured that simultaneously The distribution of row calculating task and dispatch deal are not in single point failure.
An idle node is selected in the currently active ground child node that master server is safeguarded in Zookeeper, and One index creation task is distributed to the node;When multiple index creation tasks are reached, host node will effectively can be calculated Task is distributed to different calculate nodes, realizes load balancing of the parallel computation task on whole clustered node.
(3)Data are read from HDFS and create index.
In order to create search index, it would be desirable to read the monitor data file being stored in HDFS, and will be every in file Individual Monitoring Data record progressive scan, extracts the conventional field for needing to set up index and imports in HBase.
The step includes:
1)Monitoring Data is progressively scanned.
Receive a monitor data file index creation task per child node, program will a newly-built data flow, The monitoring file data read from HDFS is read in internal memory, while recording the title of this document in a program(It is set to fileName).Interface is parsed by call request, metadata is extracted from the meta data file of distributed memory system:File Offset, monitoring file size of the field in monitor data file, these metadata are passed in name, monitor data file Raw data file parses interface method, and parsing interface by raw data file can be handled data.
2)Table is built to conventional field.
Raw sensor data file is parsed according to metadata, Monitoring Data record is extracted, to the prison extracted Survey data record to be progressively scanned, the Monitoring Data record in the specified fileName files read from HDFS is read in interior In depositing.Some fields do not work to lookup processing in Monitoring Data record, thus, it is only required to by the electricity related to equipment state The conventional index field such as pressure, electric current is extracted, and is added in index data list.
3)Set up concordance list.
Every Monitoring Data record has more than ten of field, and the field for being wherein used to inquiring about only has several, therefore only needs to Several concordance lists are set up in HBase according to these fields.Below exemplified by by track circuit Voltage Establishment concordance list.In rope Draw in table ConstructRailVoltageIndexItem, the information in each concordance list includes " index field(Such as track Circuit voltage)The storage address of+data acquisition time+record(That is Index)”.
(4)Inquire about Monitoring Data information.
In HBase, the line unit of a table(rowkey)Arranged according to syllable sequence order.
Here the design to concordance list is as follows:Rowkey is:The field of inquiry.One row cluster:Offset:Monitoring Data is remembered The position in monitor data file is recorded, i.e. filename adds offset.Here row name is set to sky, to reduce data volume, carries High insertion speed.
Query steps are as follows:
1)For given query condition, rational inquiry syllable sequence is spliced into(With rowkey), pass through HBase API energy A rowkey or rowkey upper rowkey is enough directly targeted to, the monitoring of the condition of satisfaction is thus quickly navigated to Data directory data.
2)Follow-up data are read, the Monitoring Data positional information for the condition that meets is read, search index is recorded successively, works as hair When existing rowkey is unsatisfactory for condition, then search index is finished.
3)According to all Monitoring Data positional information set for meeting condition obtained, from the corresponding monitoring number on HDFS Recorded according to all Monitoring Datas are read out in file.
The exploitation of this example and running environment, have mainly used HDFS, HBase and Zookeeper.HDFS is used to store original Beginning Monitoring Data, HBase is used to store search index, and Zookeeper is used to manage cluster, scheduling index creation task.Wherein The function of interface module is as follows:
(1)Monitor data file is detected and index creation task dispatch.
Host node server is responsible for monitor data file detection and index creation task scheduling, and its main processing function is:
1)Detect whether to produce new monitor data file;
2)The filename of new monitor data file is integrated into index creation request, child node processing is distributed to;
3)If child node fails, the index creation request in child node is transferred in other child nodes.
The function of host node service routine part is as follows:
1)A certain moment, only one of which service routine provides service.
2)Solve Single Point of Faliure.
The Single Point of Faliure of host node is solved the problems, such as by Zookeeper:If the primary server joint scanned is lost Imitate, then other standby host nodes take over its work, continue to scan on new file;If a certain host node is failed ,/APP/ File destination below Server/TMP will change, and monitor that each standby host node of the catalogue will receive an event and ask Ask, new host node is then chosen again;The standby host node do not chosen continues waiting for the arrival of new event.
The function of child node part monitoring processing request is as follows:
1)Whether arrived based on Zookeeper detection requests.
2)Whether detect this request is rational request.
(2)Read Monitoring Data and index creation processing.
Just to the index creation task requests of receiving, child node reads HDFS Monitoring Data, and concrete function is as follows:
1)Read HDFS files.
2)Handle the data in HDFS files and insert in HBase concordance lists.
The function of being scanned to Monitoring Data and create index is as follows:
Index data is generated, and is inserted in HBase.
Explanation:The often row of concordance list includes following data:
1)rowkey:Form is rail_voltage(8 bytes)+sample_time_s(4 bytes)+index(4 Byte).
2)Row cluster:A row are included in Offset, row cluster(The row are unnamed).Form is:Filename ID(8 bytes)+ number According to the offset in file(8 bytes).
(3)Monitoring Data is inquired about.
The major function of Monitoring Data inquiry is as follows:
The concordance list inquired about in HBase.
Explanation:
(1)Interface is generated by Monitoring Data field by line unit value(Such as, track circuit voltage)It is converted into the time and rope Draw the rowKey form identical syllable sequences of table, for example, track circuit voltage+data acquisition time.Scanned by data file Interface finds rowkey and the syllable sequence identical a line, if there is no then pointing to previous row.
(2)Inquiry is set to point to qualified row.
(3)Ergodic data backward, if data are unsatisfactory for querying condition(Track circuit voltage and sampling time), then inquire about Finish.
(4)In this example, the form of index is:Track circuit voltage+sampling time+index.If number exceedes, Then directly exit;If track circuit voltage is eligible, whether detection time is eligible.

Claims (6)

1. a kind of querying method of track traffic Monitoring Data, its step is:
1) data-storage system checks the numeric type monitor data file newly stored in real time, and is converted into binary form and enters Row storage;Wherein, data-storage system uses cloud computing platform, and it includes a distributed memory system and a search index system System;The distributed memory system includes a meta data file, and the distributed memory system extracts the member of monitor data file Data, as a data record storage in the meta data file;The metadata includes filename, Monitoring Data text Offset, monitoring file size of the field in the monitor data file in part;
2) data-storage system carries out parallel processing to the monitor data file, and a rope is created to each monitor data file Draw, and the corresponding index data of each monitor data file is inserted into the search index system;Wherein, it is described to each Monitor data file creates a method indexed:
21) child node is to the newly-built data flow of each monitor data file index creation task distributed, while recording this The filename of monitor data file;
22) child node extracts metadata according to file name from the meta data file, and according to the metadata record to this Monitoring file data is parsed, and the index field for extracting setting using the offset is added to index data list In;
23) child node sets up a concordance list to each index field in index data list;Information in the concordance list includes: Index field, data acquisition time, the storage address of Monitoring Data record;
3) the search index system is inquired about according to the monitoring inquiry request of input and obtains monitor data file list, Ran Hougen Monitoring Data record is read from the monitor data file of the distributed memory system according to the monitor data file list.
2. the method as described in claim 1, it is characterised in that the distributed memory system is HDFS storage systems, the rope Draw inquiry system for Hbase search index systems.
3. method as claimed in claim 2, it is characterised in that the cloud computing platform is provided with host node and some child nodes; Using the monitor data file newly stored in host node inspection distribution HDFS storage systems, and create the monitor data file Index data;The monitor data file is distributed to the parallel wound that different child nodes are indexed by the cloud computing platform Build.
4. method as claimed in claim 3, it is characterised in that the cloud computing platform using Zookeeper set host node and Child node, and load balancing is carried out to the cloud computing platform.
5. the method as described in claim 1 or 2 or 3, it is characterised in that the monitor data file includes some of collection and set Standby state recording;The equipment state record includes monitoring of equipment letter corresponding under the time of data acquisition, and the time Number some switching values and analog quantity value.
6. the method as described in claim 1 or 2 or 3, it is characterised in that the monitoring inquiry request include Monitoring Data when Between scope and monitoring parameter.
CN201310395393.6A 2013-09-03 2013-09-03 A kind of querying method of track traffic Monitoring Data Active CN103500173B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310395393.6A CN103500173B (en) 2013-09-03 2013-09-03 A kind of querying method of track traffic Monitoring Data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310395393.6A CN103500173B (en) 2013-09-03 2013-09-03 A kind of querying method of track traffic Monitoring Data

Publications (2)

Publication Number Publication Date
CN103500173A CN103500173A (en) 2014-01-08
CN103500173B true CN103500173B (en) 2017-07-28

Family

ID=49865384

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310395393.6A Active CN103500173B (en) 2013-09-03 2013-09-03 A kind of querying method of track traffic Monitoring Data

Country Status (1)

Country Link
CN (1) CN103500173B (en)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103795572B (en) * 2014-01-24 2017-07-21 北京京东尚科信息技术有限公司 The switching method and monitoring server of principal and subordinate's server
CN103970842A (en) * 2014-04-24 2014-08-06 河海大学 Water conservancy big data access system and method for field of flood control and disaster reduction
CN104320486B (en) * 2014-11-10 2018-10-23 连云港杰瑞电子有限公司 A kind of intelligent transportation platform data integrated approach based on big data
CN105630847B (en) * 2014-11-21 2019-06-07 深圳市腾讯计算机系统有限公司 Date storage method, data query method, apparatus and system
CN105592484A (en) * 2015-12-18 2016-05-18 潘小胜 Railway interlock system performance optimizing apparatus
CN105574593B (en) * 2015-12-18 2020-05-05 中南大学 Track state static detection and control system and method based on cloud computing and big data
CN105930441B (en) * 2016-04-18 2019-04-26 华信咨询设计研究院有限公司 A kind of radio monitoring data query method
CN105930426B (en) * 2016-04-18 2019-03-08 华信咨询设计研究院有限公司 Radio monitoring data query method
CN106485514A (en) * 2016-11-01 2017-03-08 安徽拾穗谷生态科技有限公司 A kind of agricultural product quality and safety reviews big data processing method
CN107463706B (en) * 2017-08-18 2020-06-23 国网上海市电力公司 Hadoop-based mass wave recording data storage and analysis method and system
CN107807608A (en) * 2017-11-02 2018-03-16 腾讯科技(深圳)有限公司 Data processing method, data handling system and storage medium
CN110022257B (en) * 2018-01-08 2023-04-07 北京京东尚科信息技术有限公司 Distributed messaging system
CN108737503A (en) * 2018-04-25 2018-11-02 江苏鸣鹤云科技有限公司 A kind of efficient big data distributed transmission system and method
CN108959527B (en) * 2018-06-28 2023-06-09 卡斯柯信号有限公司 Method for reading and displaying interlocking log based on Windows file mapping technology
CN109783449A (en) * 2018-12-13 2019-05-21 深圳壹账通智能科技有限公司 Data query processing method, platform, system and readable storage medium storing program for executing
CN110795498A (en) * 2019-09-16 2020-02-14 华东交通大学 Railway power supply dispatching cluster monitoring system visualization method based on column database reverse index
CN111125171A (en) * 2019-12-22 2020-05-08 浪潮(北京)电子信息产业有限公司 Monitoring data access method, device, equipment and readable storage medium
CN111737255A (en) * 2020-06-02 2020-10-02 通号城市轨道交通技术有限公司 Method and system for storing interlocking monitoring data
CN113839919B (en) * 2021-08-06 2023-04-18 上海富欣智能交通控制有限公司 Transmission data structure configuration method, data transceiving method and communication system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101917237A (en) * 2010-07-27 2010-12-15 北京全路通信信号研究设计院 Railway signal monitoring method and system
CN101950297A (en) * 2010-09-10 2011-01-19 北京大学 Method and device for storing and inquiring mass semantic data
CN102063486A (en) * 2010-12-28 2011-05-18 东北大学 Multi-dimensional data management-oriented cloud computing query processing method
CN102508913A (en) * 2011-11-17 2012-06-20 张真 Cloud computing system with data cube storage index structure

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8341345B2 (en) * 2005-08-08 2012-12-25 International Business Machines Corporation System and method for providing content based anticipative storage management

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101917237A (en) * 2010-07-27 2010-12-15 北京全路通信信号研究设计院 Railway signal monitoring method and system
CN101950297A (en) * 2010-09-10 2011-01-19 北京大学 Method and device for storing and inquiring mass semantic data
CN102063486A (en) * 2010-12-28 2011-05-18 东北大学 Multi-dimensional data management-oriented cloud computing query processing method
CN102508913A (en) * 2011-11-17 2012-06-20 张真 Cloud computing system with data cube storage index structure

Also Published As

Publication number Publication date
CN103500173A (en) 2014-01-08

Similar Documents

Publication Publication Date Title
CN103500173B (en) A kind of querying method of track traffic Monitoring Data
CN105554059B (en) Logistics transportation Intellisense and position service system based on Beidou navigation technology
CN108964996B (en) Urban and rural integrated information grid system and information sharing method based on same
WO2016004775A1 (en) Method and system for integrated operation and maintenance of rail transportation signals based on cloud computing
CN103412897B (en) A kind of parallel data processing method based on distributed frame
CN103902838B (en) A kind of TMIS wagon flows assay method and system based on cloud computing
CN107665578A (en) Management and control system and method is integrated based on the traffic that big data is studied and judged
CN107133273A (en) A kind of transit's routes data processing method and server cluster based on big data
CN107784098A (en) Real-time data warehouse platform
CN104298726B (en) A kind of BMS data-storage systems and its method based on database
CN108860223B (en) Data processing system and method
CN104933070A (en) Catalog management system used for government affairs information platform
CN104599032A (en) Distributed memory power grid construction method and system for resource management
CN104239377A (en) Platform-crossing data retrieval method and device
CN107800808A (en) A kind of data-storage system based on Hadoop framework
CN107609987A (en) A kind of intelligent power transformation operational system of equipment oriented owner
CN106446085A (en) Big data management system
CN105574640A (en) Method for constructing unified and comprehensive management platform of application
CN107798062A (en) A kind of transformer station's historical data unifies storage method and system
CN112559634A (en) Big data management system based on computer cloud computing
Guo Application of meteorological big data
CN109657000B (en) Real-time data synchronization method and device of rail transit comprehensive monitoring system
Liu et al. A Cloud-computing and big data based wide area monitoring of power grids strategy
Anastasiou et al. Admsv2: A modern architecture for transportation data management and analysis
CN116629802A (en) Big data platform system for railway port station

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant