CN107968729A - A kind of railway signal data flow storage management system - Google Patents
A kind of railway signal data flow storage management system Download PDFInfo
- Publication number
- CN107968729A CN107968729A CN201711408825.7A CN201711408825A CN107968729A CN 107968729 A CN107968729 A CN 107968729A CN 201711408825 A CN201711408825 A CN 201711408825A CN 107968729 A CN107968729 A CN 107968729A
- Authority
- CN
- China
- Prior art keywords
- data
- railway signal
- bag
- storage management
- protocol data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/069—Management of faults, events, alarms or notifications using logs of notifications; Post-processing of notifications
Abstract
The invention discloses a kind of railway signal data flow storage management system, which can not only keep original text Log functions, more can comprehensively record the data flow of railway signal system especially TDCS/CTC systems；The system can utilize buffer memory, compression storage mode, significantly reduce data volume, and then the use of system disk resource and Internet resources is greatly decreased when recording data；Further, it is possible to automatic dynamic switch, realize be locally stored, remotely store two ways under data storage；Meanwhile incremental sequence number is also set to each bag data, realize that data store unique serial number management, prevent from losing extremely during record data；In addition, the system when analyzing field failure can fast positioning, and according to the historical data of production environment, basis is provided for automatic test.
Description
Technical field
The present invention relates to technical field of rail traffic, more particularly to a kind of railway signal data flow storage management system.
Background technology
At present in software systems, generally usage log function (Log) comes logging software operation internal state, software records
Daily record etc., mainly includes：Operation Debugging message DEBUG, data processing daily record INFO, the warning information of software of software of software
The daily record such as error message ERROR of WARN, software.In common soft project, daily record store function is mostly with Unix/
SysLog standard logs interfaces under Linux are packaged, and realize log recording and the daily record classification of above- mentioned information.Believe in railway
Number system especially TDCS/CTC systems find that existing daily record memory management functions are unsatisfactory for actual field demand using middle, mainly
Including：
1) especially TDCS/CTC systems, operating platform have more and more used Windows behaviour in railway signal system
Make system, and windows platform lacks similar syslog interfaces, it is generally general to be recorded during code programming under Windows at present
Logical Log texts are main log mode.
2) when aiming at storage day, if there is bad track write-in disk failure, when consequent malfunction analyzes inquiry log, nothing in hard disk etc.
Method is known whether there are daily record Loss, is less known and be lost how many daily records.
3) each terminal of railway signal system may employ the industrial personal computer of low-power consumption version, and the hardware based on scene limits
System, can not record too many daily record；Windows systems do not support log server pattern, the syslog modes of Unix/Linux
Although support be locally stored with log server mode, cannot dynamically switch.During railway TDCS/CTC system deployments, daily record
Server is typically placed in center.When station communicates failure with central site network, it is desired to be able to by a part of information record
Local terminal AT STATION, does not lose daily record data during failure, in case failure reason analysis；When network service recovers, it is
The destination that daily record stores can be directed to central log server by system again, that is, realize that the dynamic of daily record data storage is cut
Change；But it can not realize at present.
4) daily record existing at present storage is too simple, and the daily record note of text formatting is manually exported when can only be Software Coding
Record.
The content of the invention
The object of the present invention is to provide a kind of railway signal data flow storage management system, the original of agreement bottom is able to record
Beginning data, i.e. raw data, so that when signal accident is analyzed, time information data flow is complete before and after failure can occur
Mirror image reappears, and realizes forward and reverse storage management of whole data flow.
The purpose of the present invention is what is be achieved through the following technical solutions：
A kind of railway signal data flow storage management system, including：
Forward data stream process engine modules, the underlying protocol data packet for that will receive carry out layering encapsulation step by step：
Underlying protocol data envelope is first dressed up into application layer protocol data according to encapsulation format, is packaged into and has identified according still further to encapsulation format
Protocol data bag；
Data flow storage management engine modules, for caching the protocol data bag of identification newly received, according to default side
Formula has identified that railway signal conventional data bag is dressed up in protocol data encapsulating by some, and distributes unique sequence number, according still further to specific
Mode is compressed；
Data flow stores dynamic select module, for according to setting, compressed railway signal conventional data bag is static
Stored to local hard drive, or store to Remote Log Server, storage, which is set, supports switching at runtime；
Reverse data stream process engine modules, for the general number of the compressed railway signal of reverse read from local hard drive
According to bag, and decompression is carried out, layering step by step is then carried out to the railway signal conventional data bag after decompression and is split, is obtained
Underlying protocol data packet be sent to forward data stream process engine modules.
The technical solution provided by the invention described above mainly has the advantages that：
1) original text Log functions can be not only kept, more can comprehensively record railway signal system especially TDCS/
The data flow of CTC system.
2) when recording data, buffer memory, compression storage mode can be utilized, significantly reduces data volume, Jin Er great
Width reduces the use of system disk resource and Internet resources.
3) record when, can automatic dynamic switching, realize be locally stored, remotely store two ways under data deposit
Storage.
4) in record, incremental sequence number is set to each bag data, realizes that data store unique serial number management, prevents from remembering
Lost extremely when recording data.
5) when analyzing field failure can fast positioning, and be automatic test according to the historical data of production environment
Basis is provided.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, required use in being described below to embodiment
Attached drawing be briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for this
For the those of ordinary skill in field, without creative efforts, other can also be obtained according to these attached drawings
Attached drawing.
Fig. 1 is a kind of schematic diagram of railway signal data flow storage management system provided in an embodiment of the present invention；
Fig. 2 is data encapsulation format schematic diagram provided in an embodiment of the present invention；
Fig. 3 is layered encapsulation process figure step by step to be provided in an embodiment of the present invention.
Embodiment
With reference to the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Ground describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.Based on this
The embodiment of invention, the every other implementation that those of ordinary skill in the art are obtained without making creative work
Example, belongs to protection scope of the present invention.
During signal systems such as railway TDCS/CTC etc. are applied at the scene, based on security, maintainable consideration, network operator
It is expected that software is able to record in addition to above-mentioned running log information with guardian, complete bottom-up information data flow is also deposited
Storage, i.e. scene need one to be based on inter-area traffic interarea, running software daily record, debugging log, alarm mistake etc. by bottom to upper strata
Unified storage management.System is able to record the initial data of agreement bottom, i.e. raw data for this, so that in signal accident point
During analysis, the complete mirror image of time information data flow reappears before and after failure can occur, and realizes that the forward and reverse of whole data flow deposits
Storage management；The embodiment of the present invention provides a kind of railway signal data flow storage management system for this, which can solve as follows
Technical problem：
1) to railway signal system especially TDCS/CTC systems, system have it is multi-platform under (Windows/Linux is put down
Platform), the data flow of a variety of data communication protocols unify memory management functions, not only the debugging log including software, log,
The log recording functions such as error log, alarm log, can more realize the memory management functions to original agreement data flow；
2) system supports being locally stored of text log and inter-area traffic interarea, two kinds of teledata flow management server storage
Mode, and support switching at runtime, it can be automatically switched to when local and remote server interruption and record is locally stored；
3) system provides the forward supervision engine of a variety of railway signal system data protocols, can identify the original of each agreement
Inter-area traffic interarea is simultaneously stored with raw forms, and accomplishes slow formula storage, after the cache threshold of setting, just carries out storage management,
It is compressed in storage based on DEFLATE compression algorithms, hard disk is just stored in after compression or is sent to remote server, as far as possible
With bulky grain degree, the storage data of few frequency；
4) system provides the backward supervision engine of a variety of railway signal system data protocols, for RAW data flows, carries out anti-
To parsing, decompress, handle data flow by corresponding protocol format, there is provided return and survey interface, for testing system or accident analysis system
System survey, and forms an exploitation, test, the closed loop configuration of failure reduction.
5) lost extremely in log record process in order to prevent, system increases sequence number ID management when data flow stores and examines
Function, ID is incremental, detects whether there are storage failure scenarios with this.
As shown in Figure 1, be a kind of schematic diagram of railway signal data flow storage management system provided in an embodiment of the present invention,
It mainly includes：
1st, forward data stream process engine modules.
The underlying protocol data packet received is mainly carried out layering step by step and encapsulated by it：First bottom is assisted according to encapsulation format
View data envelope dresses up application layer protocol data, is packaged into according still further to encapsulation format and has identified protocol data bag.
Underlying protocol data packet reverse data stream process in its exterior, application of software data process layer or system
Engine modules.
1) if underlying protocol data packet is from reverse data stream process engine modules in its exterior or system (under i.e.
Layer data stream), then adaptation inspection is carried out according to agreement prescribed form, only meet the underlying protocol data packet of agreement prescribed form
Just it is regarded as legal data packet；For legal data packet, input to application of software data process layer is handled by programmed logic, together
When, carry out layering encapsulation step by step；
If 2) come from application of software data process layer (i.e. upper layer data stream), layering encapsulation step by step is directly carried out.
Simply introduce herein and be layered encapsulation process step by step：
Underlying protocol data envelope is first dressed up into application layer protocol data packet：Underlying protocol packet content is not done and is changed
Become, increasing sender's timestamp, recipient's timestamp, sending entity and receiving entity word before underlying protocol data packet
Section；
Application layer protocol packet encapsulation protocol data bag has been identified into again：Increase version before application layer protocol data
Sheet, Apple talk Data Stream Protocol Apple Ta type, transmitting-receiving mark and checksum field；
If what is received is text entry, first it is abstracted, increases the frame head postamble of internal custom, be encapsulated as one
A underlying protocol data packet, then carry out above-mentioned being layered encapsulation process step by step.
2nd, data flow storage management engine modules.
It is mainly used for the protocol data bag of identification that caching newly receives, and agreement has been identified by some according to predetermined manner
Data envelope dresses up railway signal conventional data bag, and distributes unique sequence number, is compressed according still further to ad hoc fashion.
The module is the data flow processing module of core, by buffer memory, compression two kinds of technological means of storage, reduction pair
Hard disk I/O, network I/O handle up, and realize the coarse granule storage of data flow.
Using railway signal conventional data bag as substantially during the data flow storage management engine modules compression storage data
Unit, several have identified that protocol data bag will be encapsulated as a railway signal conventional data bag；
1) when the protocol data bag of identification newly received, processing is made the following judgment：
If Tcur-Tcache_t>=TSe_waitMax, then it is data cached not renew the identification agreement for filling and newly receiving
Data packet, and railway signal conventional data bag is dressed up into the protocol data of identification cached before encapsulating；Wherein Tcur is system
Current time, Tcache_t are the railway signal conventional data bag final updating time in caching, and TSec_waitMax is maximum
Stand-by period threshold value；
If L_cache+L_AuPDULen>RSGDU_maxlen, the then data cached identification for not renewing dress and newly receiving
Protocol data bag, railway signal conventional data bag is dressed up by the protocol data of identification cached before encapsulating；, will after emptying caching
The protocol data bag of identification newly received is stored into caching, is formed a railway signal conventional data packet delay and is waited, and
Renewal time；Wherein L_cache is the data length cached, and L_AuPDULen is the protocol data bag of identification newly received
Data length, RSGDU_maxlen is the length threshold of maximum railway signal conventional data bag；
If L_cache+L_AuPDULen<=RSGDU_maxlen, then by the protocol data of the identification bag newly received with
It is data cached to carry out the encapsulation that continues, form new railway signal conventional data bag, and renewal time；
Railway signal conventional data bag after encapsulation increase on the basis of protocol data bag has been identified frame head, version number,
Compress mark, storage mark, data packet sequence number, the protocol data bag of the identification number included, verify and with postamble field.
2) when data flow storage management engine modules need to manage railway signal conventional data bag real-time storage, call
Data flow sequence number management module, determines that the sequence number of railway signal conventional data bag is uniquely changed, sequence number management is adopted to improve efficiency
With the method for salary distribution of predistribution and dynamic amplification：
To each bottom passage, a serial number range [ID_left, ID_right], all railways letter are allocated in advance
Distributed unitedly during number conventional data bag selection sequence number by data flow sequence number management module, it is ensured that sequence number is unique and is incremented by；
To each bottom passage, data flow sequence number management module is according to its usage amount periodic test, when discovery has made
Serial number range reaches regulation boundary (for example, 70% more than serial number range), then implements dynamic and expand, increase sequence number model newly
Enclose, using first the serial number range of distribution uses according to before during sequence number, then using newly-increased serial number range, so circulation after exhausting.
3) the data flow storage management engine modules use data flow to the railway signal conventional data bag of Allotment Serial Number
Compression algorithm, to realize lossless date-compress.
In the embodiment of the present invention, in order to reduce amount of storage, Compression Strategies are introduced, based on DEFLATE compression algorithms to data
It is compressed, compressed data is stored to data volume, while updates the compression mark and data length of the PDU.Pass through
DEFLATE algorithms, it is possible to achieve lossless data compression, significantly reduces the size of RSGDU, so as to record the data cell
When, stored with coarse grained data flow, overhead when reducing data storage.
It is of course also possible to use the data stream compression algorithm of such as GZIP etc.
3rd, data flow storage dynamic select module.
It is mainly used for according to setting, is stored compressed railway signal conventional data bag is static to local hard drive,
Or store to Remote Log Server, storage, which is set, supports switching at runtime.
If provided as being locally stored, then it is stored directly in the local hard drive of system, local number is deleted after successfully storing
According to；
If provided as long-range storage, then remote data storage management module is called, attempts related data packets being sent to far
Journey log server is stored, local temporarily not delete data, this is deleted after Remote Log Server confirms to store successfully
Ground data；If failure or time-out during long-range storage, the storage mark of related data is locally automatically updated, and is stored in the sheet of system
In ground hard disk, avoid losing data to greatest extent.
Meanwhile, it is capable to according to the switching at runtime for being set for being locally stored with remotely storing.
4th, remote data storage management module.
It is mainly responsible for the network data communication between maintenance system and Remote Log Server, the data packet that will be stored
It is sent in Remote Log Server, and storage result is fed back into data flow storage dynamic select module, realizes similar Unix/
Syslog functions under Linux, and being capable of cross-platform Windows/Linux uses.
5th, reverse data stream process engine modules.
It is mainly used for the compressed railway signal conventional data bag of the reverse read from local hard drive, and unzips it
Processing, then carries out the railway signal conventional data bag after decompression layering step by step and splits, the underlying protocol data packet of acquisition
It is sent to forward data stream process engine modules；Specifically：
The reverse data stream process engine modules are general to compressed railway signal using corresponding decompression algorithm
Data unzip it, and obtain corresponding railway signal conventional data bag, afterwards, railway signal conventional data bag are split as one
It is a or multiple identified protocol data bag；Then, identified that protocol data bag carries out agreement identification and adaptation, confirmation and is to each
It is no legal；It is application layer protocol data that to legal having identified, protocol data bag, which continues to seal off, and then it is underlying protocol number to seal off
According to bag.
When scene is broken down, data flow during failure, maximum journey can be accurately reappeared by the modular system
The reduction field data of degree, fast positioning and solution so as to fulfill problem.
The building block technique is utilized at the same time, production environment is able to record the various contextual data streams of railway signal system, is soft
Part automatic test provides the foundation.By inverse injection, by the historical data in production environment, the progress of test system is injected into
Return and survey, contrast test result and former production environment as a result, unmanned test can be realized easily.
On the other hand, reverse data stream process engine modules read railway signal from data flow storage management engine modules and lead to
During with data packet, moreover it is possible to realize the multidimensional conversion function of data flow, including the polymorphic multidimensional such as binary system, text, protocol analysis
The data display interface of degree, to research and develop, to test, maintenance personnel intuitively analyzes bottom data.
6th, text log management engine.
The module is mainly responsible for compatible existing text entry and program running log mode；To existing text entry software
Run data processing daily record INFO, the warning information WARN of software and the error message of software of Debugging message DEBUG, software
ERROR information, is packaged and is handled with the unified without differences for adapting to data flow storage management engine modules.
Above to form the major function of the main modular of the system, packet encapsulation process therein is done into one below
The introduction of step.
In railway signal system especially TDCS/CTC systems, internal system, (interlocking, row control, monitor with external system
Deng) communication control procedure it is different, but be transmitted with data frame as defined in a kind of agreement.The structure of data frame is generally
Frame head, imformosome, postamble etc., the data frame definition of different agreement is different, has in corresponding data communication protocol bright
True regulation.In order to be managed collectively the data flow of various agreements, it is necessary to be encapsulated to data stream.As shown in Fig. 2, during encapsulation
It is layered using top-down mode, different agreement, the data of different-format, layering encapsulation, adds new frame head step by step
Etc. information, final encapsulation into a standard railway signal conventional data bag, it is main as follows：
1st, underlying protocol data packet (Protocol Data Unit, abbreviation PDU)：Signal system application layer number to be processed
According to bag, this data packet is to meet a bag data of communication protocol standard, for example meets the bag CTC protocol datas or a bag of specification
CTC is with interlocking interface protocol data etc..For compatible existing text entry, to text Log, software operation state Log information,
Equally it is abstracted, increases the frame head postamble of internal custom, is encapsulated as an independent PDU.
2nd, application layer protocol data packet (Application Protocol Data Unit, abbreviation AppPDU)：Bottom is assisted
Based on discussing data packet, the change of any content is not made in itself to the data packet, but in order to identify the underlying protocol data packet
Application layer attribute, the field such as increase sender timestamp, recipient's timestamp, sending entity, receiving entity.
3rd, protocol data bag (Authenticated Protocol Data Unit, abbreviation AuthPDU) has been identified：It is pair
Application layer protocol data packet continues to encapsulate, and increase version, Apple talk Data Stream Protocol Apple Ta type, transmitting-receiving indicate, verify and wait field；Wherein
Common data protocol Unified coding in big systems several to railway signal, since 0, a kind of data protocol of each digitized representation
Communication format, citing：0 data cell defined for existing text Log, 1 is TDCS data communication protocols, and 2 be CTC data communications
Agreement, 3 be CTC and the communication protocol for interlocking interface, and 4 be data communication protocol of CTC and train control center etc..
4th, railway signal conventional data bag (Railway Signal General Data Unit, abbreviation RSGDU)：To
Identification protocol data bag continues to encapsulate, and increase frame head, version number, compression mark, storage mark, data packet ID, include
AuthPDU bags number, verification and, the field such as postamble.
As shown in figure 3, to be layered encapsulation process step by step；Wherein, application layer protocol data packet, includes a underlying protocol data
Bag, an and application layer protocol data packet uniquely corresponding one has identified protocol data bag, it is multiple to have identified that protocol data bag be with
Form a railway signal conventional data bag.
Such scheme of the embodiment of the present invention mainly has the advantages that：
1) original text Log functions can be not only kept, more can comprehensively record railway signal system especially TDCS/
The data flow of CTC system.
2) when recording data, buffer memory, compression storage mode can be utilized, significantly reduces data volume, Jin Er great
Width reduces the use of system disk resource and Internet resources.
3) record when, can automatic dynamic switching, realize be locally stored, remotely store two ways under data deposit
Storage.
4) in record, incremental sequence number is set to each bag data, realizes that data store unique serial number management, prevents from remembering
Lost extremely when recording data.
5) when analyzing field failure can fast positioning, and be automatic test according to the historical data of production environment
Basis is provided.
The foregoing is only a preferred embodiment of the present invention, but protection scope of the present invention be not limited thereto,
Any one skilled in the art is in the technical scope of present disclosure, the change or replacement that can readily occur in,
It should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with the protection model of claims
Subject to enclosing.
Claims (10)
- A kind of 1. railway signal data flow storage management system, it is characterised in that including：Forward data stream process engine modules, the underlying protocol data packet for that will receive carry out layering encapsulation step by step：First press Underlying protocol data envelope is dressed up into application layer protocol data according to encapsulation format, is packaged into according still further to encapsulation format and has identified agreement Data packet；Data flow storage management engine modules, will according to predetermined manner for caching the protocol data bag of identification newly received It is some to have identified that railway signal conventional data bag is dressed up in protocol data encapsulating, and unique sequence number is distributed, according still further to ad hoc fashion It is compressed；Data flow stores dynamic select module, for according to setting, by compressed railway signal conventional data bag it is static to Local hard drive stores, or stores to Remote Log Server, and storage, which is set, supports switching at runtime；Reverse data stream process engine modules, for the compressed railway signal conventional data of reverse read from local hard drive Bag, and decompression is carried out, layering step by step is then carried out to the railway signal conventional data bag after decompression and is split, acquisition Underlying protocol data packet is sent to forward data stream process engine modules.
- A kind of 2. railway signal data flow storage management system according to claim 1, it is characterised in that the forward direction number The underlying protocol data packet received according to stream process engine modules comes from its exterior, application of software data process layer or system Interior reverse data stream process engine modules；If the reverse data stream process engine modules in its exterior or system, are fitted according to agreement prescribed form With inspection, only meet that the underlying protocol data packet of agreement prescribed form is just regarded as legal data packet；, will for legal data packet Input is handled to application of software data process layer by programmed logic, meanwhile, carry out layering encapsulation step by step；If coming from application of software data process layer, layering encapsulation step by step is directly carried out.
- A kind of 3. railway signal data flow storage management system according to claim 1 or 2, it is characterised in that it is described by Stage layered encapsulation process is as follows：Underlying protocol data envelope is first dressed up into application layer protocol data packet：To underlying protocol packet content without modification, exist Increase sender's timestamp, recipient's timestamp, sending entity and receiving entity field before underlying protocol data packet；Application layer protocol packet encapsulation protocol data bag has been identified into again：Increase version, number before application layer protocol data According to stream protocol type, transmitting-receiving mark and checksum field；If what is received is text entry, first it is abstracted, increases the frame head postamble of internal custom, is encapsulated as a bottom Layer protocol data packet, then carry out above-mentioned being layered encapsulation process step by step.
- A kind of 4. railway signal data flow storage management system according to claim 1, it is characterised in that the data flow Using railway signal conventional data bag as base unit during storage management engine modules compression storage data, several have identified association View data packet will be encapsulated as a railway signal conventional data bag；When the protocol data bag of identification newly received, processing is made the following judgment：If Tcur-Tcache_t>=TSe_waitMax, then it is data cached not renew the identification protocol data for filling and newly receiving Bag, and railway signal conventional data bag is dressed up into the protocol data of identification cached before encapsulating；Wherein Tcur is current for system Time, Tcache_t are the railway signal conventional data bag final updating time in caching, and TSec_waitMax waits to be maximum Time threshold；If L_cache+L_AuPDULen>RSGDU_maxlen, then it is data cached not renew the identification agreement for filling and newly receiving Data packet, railway signal conventional data bag is dressed up by the protocol data of identification cached before encapsulating；After emptying caching, will newly it connect It is received to have identified that protocol data bag is stored into caching, form a railway signal conventional data packet delay and wait, and update Time；Wherein L_cache is the data length cached, and L_AuPDULen is the number for having identified protocol data bag newly received According to length, RSGDU_maxlen is the length threshold of maximum railway signal conventional data bag；If L_cache+L_AuPDULen<=RSGDU_maxlen, then by the protocol data of the identification bag newly received and caching Data carry out the encapsulation that continues, and form new railway signal conventional data bag, and renewal time；Railway signal conventional data bag after encapsulation increases frame head, version number, compression on the basis of protocol data bag has been identified Mark, storage mark, data packet sequence number, the protocol data bag of the identification number included, verification and with postamble field.
- 5. a kind of railway signal data flow storage management system according to claim 1 or 4, it is characterised in that work as data When stream storage management engine modules need to manage railway signal conventional data bag real-time storage, data flow sequence number management mould is called Block, determines that the sequence number of railway signal conventional data bag is uniquely changed, the method for salary distribution that sequence number management is expanded using predistribution with dynamic：To each bottom passage, a serial number range [ID_left, ID_right] is allocated in advance, all railway signals lead to Select to be distributed unitedly by data flow sequence number management module during sequence number with data packet, it is ensured that sequence number is unique and is incremented by；It is used when finding according to its usage amount periodic test to each bottom passage, data flow sequence number management module Serial number range reaches regulation boundary, then implements dynamic amplification, increase serial number range newly, use the sequence first distributed during sequence number according to before Number scope uses, then using newly-increased serial number range, so circulation after exhausting.
- A kind of 6. railway signal data flow storage management system according to claim 1 or 4, it is characterised in that the number Data stream compression algorithm is used to the railway signal conventional data bag of Allotment Serial Number according to stream storage management engine modules, to realize number According to lossless compression.
- A kind of 7. railway signal data flow storage management system according to claim 1, it is characterised in that the data flow Dynamic select module is stored, if provided as being locally stored, is then stored directly in the local hard drive of system, is deleted after successfully storing Except local data；If provided as long-range storage, then remote data storage management module is called, attempts related data packets being sent to long-range day Will server is stored, local temporarily not delete data, and local number is deleted after Remote Log Server confirms to store successfully According to；If failure or time-out during long-range storage, the storage mark of related data is locally automatically updated, and is stored in the local hard of system In disk；Meanwhile, it is capable to according to the switching at runtime for being set for being locally stored with remotely storing.
- A kind of 8. railway signal data flow storage management system according to claim 1 or 7, it is characterised in that the system Further include：Remote data storage management module, the network data communication being responsible between maintenance system and Remote Log Server will The data packet to be stored is sent in Remote Log Server, and storage result is fed back to data flow storage dynamic select module, And being capable of cross-platform Windows/Linux uses.
- A kind of 9. railway signal data flow storage management system according to claim 1, it is characterised in that the reversely number Compressed railway signal conventional data bag is unziped it using corresponding decompression algorithm according to stream process engine modules, is obtained Corresponding railway signal conventional data bag is obtained, afterwards, railway signal conventional data bag is split as one or more and has identified association Discuss data packet；Then, identified that protocol data bag carries out agreement identification and adaptation to each, it is legal to be confirmed whether；To legal It is application layer protocol data to have identified that protocol data bag continues to seal off, and then it is underlying protocol data packet to seal off.
- 10. a kind of railway signal data flow storage management system according to claim 1, it is characterised in that the system is also Including：Text log management engine, the module are mainly responsible for compatible existing text entry and program running log mode；To both Have text entry running software Debugging message DEBUG, the data processing daily record INFO of software, software warning information WARN and The error message ERROR information of software, is packaged at the unified without differences to adapt to data flow storage management engine modules Reason.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711408825.7A CN107968729B (en) | 2017-12-22 | 2017-12-22 | Railway signal data flow storage management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711408825.7A CN107968729B (en) | 2017-12-22 | 2017-12-22 | Railway signal data flow storage management system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107968729A true CN107968729A (en) | 2018-04-27 |
| CN107968729B CN107968729B (en) | 2020-11-20 |
Family
ID=61995131
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711408825.7A Active CN107968729B (en) | 2017-12-22 | 2017-12-22 | Railway signal data flow storage management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107968729B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109299140A (en) * | 2018-10-18 | 2019-02-01 | 航天科工智能机器人有限责任公司 | The storage processing system and method for automatic labeling machine working traffic |
| CN109377090A (en) * | 2018-11-22 | 2019-02-22 | 湖南铁路科技职业技术学院 | A kind of railway transportation data communication support platform based on cloud service |
| CN109542059A (en) * | 2018-11-19 | 2019-03-29 | 国核自仪系统工程有限公司 | Historical data compression set and method |
| CN109753048A (en) * | 2018-12-12 | 2019-05-14 | 中国铁道科学研究院集团有限公司通信信号研究所 | The automatic Test driver automotive engine system of high-speed rail signalling arrangement |
| CN110191027A (en) * | 2019-06-19 | 2019-08-30 | 上海电气泰雷兹交通自动化系统有限公司 | A kind of communication mistake diagnostic method between CCU and MCU |
| CN111123732A (en) * | 2018-10-31 | 2020-05-08 | 百度在线网络技术（北京）有限公司 | Method, device, storage medium and terminal equipment for simulating automatic driving vehicle |
| CN111741013A (en) * | 2020-07-21 | 2020-10-02 | 炬芯（珠海）科技有限公司 | Data transmission method and device |
| CN111737255A (en) * | 2020-06-02 | 2020-10-02 | 通号城市轨道交通技术有限公司 | Method and system for storing interlocking monitoring data |
| CN112073541A (en) * | 2020-11-11 | 2020-12-11 | 卡斯柯信号(北京)有限公司 | Method and system for storing key data confidence of safety critical equipment |
| CN113254448A (en) * | 2021-05-27 | 2021-08-13 | 北京全路通信信号研究设计院集团有限公司 | Data recording method and system |
| CN116627920A (en) * | 2023-07-24 | 2023-08-22 | 华能信息技术有限公司 | Data storage method based on industrial Internet |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1889410A (en) * | 2006-07-31 | 2007-01-03 | 杭州华为三康技术有限公司 | Coding terminal, decoding terminal and coding and decoding terminal based on IP network |
| US20130279382A1 (en) * | 2012-04-24 | 2013-10-24 | Minyoung Park | Methods and arrangements to coordinate communications in a wireless network |
| CN103391185A (en) * | 2013-08-12 | 2013-11-13 | 北京泰乐德信息技术有限公司 | Cloud security storage and processing method and system for rail transit monitoring data |
-
2017
- 2017-12-22 CN CN201711408825.7A patent/CN107968729B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1889410A (en) * | 2006-07-31 | 2007-01-03 | 杭州华为三康技术有限公司 | Coding terminal, decoding terminal and coding and decoding terminal based on IP network |
| US20130279382A1 (en) * | 2012-04-24 | 2013-10-24 | Minyoung Park | Methods and arrangements to coordinate communications in a wireless network |
| CN103391185A (en) * | 2013-08-12 | 2013-11-13 | 北京泰乐德信息技术有限公司 | Cloud security storage and processing method and system for rail transit monitoring data |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109299140A (en) * | 2018-10-18 | 2019-02-01 | 航天科工智能机器人有限责任公司 | The storage processing system and method for automatic labeling machine working traffic |
| CN111123732B (en) * | 2018-10-31 | 2023-06-27 | 百度在线网络技术（北京）有限公司 | Method and device for simulating automatic driving vehicle, storage medium and terminal equipment |
| CN111123732A (en) * | 2018-10-31 | 2020-05-08 | 百度在线网络技术（北京）有限公司 | Method, device, storage medium and terminal equipment for simulating automatic driving vehicle |
| CN109542059A (en) * | 2018-11-19 | 2019-03-29 | 国核自仪系统工程有限公司 | Historical data compression set and method |
| CN109377090A (en) * | 2018-11-22 | 2019-02-22 | 湖南铁路科技职业技术学院 | A kind of railway transportation data communication support platform based on cloud service |
| CN109753048A (en) * | 2018-12-12 | 2019-05-14 | 中国铁道科学研究院集团有限公司通信信号研究所 | The automatic Test driver automotive engine system of high-speed rail signalling arrangement |
| CN110191027A (en) * | 2019-06-19 | 2019-08-30 | 上海电气泰雷兹交通自动化系统有限公司 | A kind of communication mistake diagnostic method between CCU and MCU |
| CN111737255A (en) * | 2020-06-02 | 2020-10-02 | 通号城市轨道交通技术有限公司 | Method and system for storing interlocking monitoring data |
| CN111741013B (en) * | 2020-07-21 | 2021-02-26 | 炬芯科技股份有限公司 | Data transmission method and device |
| CN111741013A (en) * | 2020-07-21 | 2020-10-02 | 炬芯（珠海）科技有限公司 | Data transmission method and device |
| CN112073541A (en) * | 2020-11-11 | 2020-12-11 | 卡斯柯信号(北京)有限公司 | Method and system for storing key data confidence of safety critical equipment |
| CN112073541B (en) * | 2020-11-11 | 2021-02-26 | 卡斯柯信号(北京)有限公司 | Method and system for storing key data confidence of safety critical equipment |
| CN113254448A (en) * | 2021-05-27 | 2021-08-13 | 北京全路通信信号研究设计院集团有限公司 | Data recording method and system |
| CN113254448B (en) * | 2021-05-27 | 2024-04-30 | 北京全路通信信号研究设计院集团有限公司 | Data recording method and system |
| CN116627920A (en) * | 2023-07-24 | 2023-08-22 | 华能信息技术有限公司 | Data storage method based on industrial Internet |
| CN116627920B (en) * | 2023-07-24 | 2023-11-07 | 华能信息技术有限公司 | Data storage method based on industrial Internet |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107968729B (en) | 2020-11-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107968729A (en) | A kind of railway signal data flow storage management system | |
| CN104168148B (en) | A kind of multi-interface data harvester and acquisition method | |
| CN106656799B (en) | A kind of message forwarding method and device based on wireless mesh network | |
| CN101039212B (en) | Fast data storage method | |
| CN102194499A (en) | Method and device for synchronizing compressed dictionary | |
| CN101179564B (en) | Link layer automatic request retransmission based TCP packet header compression method and system thereof | |
| CN103369593B (en) | A kind of method compressing reconciliation compressed ethernet message and network element device | |
| CN110300120A (en) | The hierarchical synchronization method and system of reverse data under the conditions of a kind of physical isolation | |
| CN113377815B (en) | Method for continuously transmitting write snapshot breakpoint facing real-time database | |
| CN103647706A (en) | Self-adaptation protocol communication gateway and communication platform | |
| CN102868552A (en) | Data sending method | |
| CN115484131B (en) | Internet of things gateway and equipment data storage system for same | |
| CN100370866C (en) | Wireless network controller log recording system and its method | |
| CN111726414A (en) | Vehicle reported data processing method and vehicle data reporting system | |
| CN102497450A (en) | Two-stage-system-based distributed data compression processing method | |
| CN111343632B (en) | Industrial Internet covert communication method and system | |
| CN112118283A (en) | Data processing method and system based on multi-level cache | |
| CN113190519B (en) | Running log compression method based on railway running scene template | |
| CN112486948B (en) | Real-time data processing method | |
| CN103001864A (en) | Information forwarding method based on International Electrotechnical Commission (IEC) 61850data set | |
| CN108390899B (en) | Software defined network-based method for content collaboration of two-layer switch | |
| CN114845323A (en) | Wireless network optimization platform and method based on digital twin | |
| CN103346945A (en) | Method, device and system for transmitting data of CAPWAP tunnel | |
| CN110071792B (en) | Low-delay high-reliability wireless transmission control method based on half-duplex bus | |
| CN108540313B (en) | Method for acquiring circuit structure of northbound interface based on type identifier |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |