CN104038314B - A kind of new safety supervision networking dynamic data RTTS and method - Google Patents
A kind of new safety supervision networking dynamic data RTTS and method Download PDFInfo
- Publication number
- CN104038314B CN104038314B CN201410194137.5A CN201410194137A CN104038314B CN 104038314 B CN104038314 B CN 104038314B CN 201410194137 A CN201410194137 A CN 201410194137A CN 104038314 B CN104038314 B CN 104038314B
- Authority
- CN
- China
- Prior art keywords
- data
- ore deposit
- safety supervision
- distributor
- deposit end
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The present invention discloses a kind of new safety supervision networking dynamic data RTTS and method, the Transmission system includes being used for the data center's acquisition system for gathering ore deposit end data in real time, and ore deposit end data is transferred to safety supervision management system, data center's acquisition system includes：System environments dispensing unit, database accessor, memory queue manager, asynchronous file processor, data distributor, data encrypting and deciphering, Compress softwares processor and thread-management unit.Deploying client program is not needed, operation maintenance is simple.Using this Transmission system of the present invention and method, the encryption and compression of data can be carried out, ensures the security of data, can also split upload simultaneously for big file, reduce the loss for losing data.
Description
Technical field
The present invention relates to safety supervision networked system, more particularly to a kind of new safety supervision networking dynamic data RTTS
And method.
Background technology
Coal mine safety monitoring networking plays a part of becoming more and more important in terms of Safety of Coal Mine Production, and its application can manage colliery
Reason department can when, clearly grasp and understand the dynamic datas such as the gas in colliery, oxygen, wind speed, blast, temperature, so as to and
When avoid or prevent the generations of mine safety accidents.
Existing technology is (compatible using Microsoft SQL Server2005 mainly using Java6 as programming platform
Microsoft SQL Server2000, ORALCE, MySQL etc.) data database storing, the network transmission association based on TCP/IP
View, realize the real-time Transmission of system dynamic data.Specific design is as follows：
(1) database design is carried out.The database for storing real-time dynamic data is named, and is each ore deposit end
Carry out a point storehouse (optional), the design by real time data and statistics separation management, further to database table per diem, the moon, year
A point list processing is carried out, for storing dynamic realtime analog quantity, switching value data.
(2) each ore deposit end is both needed to dispose corresponding client-side program, and real time data is called for central data collection system.
(3) database connecting test.Database connecting test is realized, need to be every a data transfer cycle (generally
10s), test-based examination once whether the database successful connection with server, so circulation.
(4) extraction and the real-time Transmission of dynamic data are carried out.Realize that data communicate using socket (Socket) interface.
(5) web page is carried out to browse.
But there is the shortcomings that following in above-mentioned prior art：
1. needing deploying client program, operation maintenance is complicated.
2. not carrying out the encryption and compression of data, the security of data can not be ensured.
3. no matter data file size, send 1 data file per wholesale, have loss of data.
It can be seen that during safety monitoring system networking is realized, the real-time Transmission of dynamic data plays vital
Effect, can make the various data messages of underground coal mine be real-time transmitted to the data center of colliery administrative department.How convenient,
Efficiently realize the real-time Transmission of dynamic data, while and can enough ensures the security of data, reliability, reduce system in the future
Maintenance, it is to need urgent problem at present.
The content of the invention
For above the deficiencies in the prior art, the present invention provides a kind of new safety supervision networking dynamic data real-time Transmission system
System and method.
The present invention uses following technical proposals：
A kind of new safety supervision networking dynamic data RTTS includes being used for the data for gathering ore deposit end data in real time
Central data system, and ore deposit end data is transferred to safety supervision management system, data center's acquisition system includes：
System environments dispensing unit, it is configured and parses for the integrated environment configuration to data central data system；
Database accessor, for the collection that conducted interviews to each ore deposit end data, and by the real-time Data Transmission at ore deposit end to interior
Deposit queue management device；
Memory queue manager, for preserving the data of the database accessor collection, and each ore deposit that will be gathered
End data corresponds to a memory queue；
Asynchronous file processor, a proprietary thread is established by thread pool manager, obtained from memory queue real
When data, formed asynchronous file, and the asynchronous file is distributed by data distributor；
Data distributor, for by the data information transfer received to specified safety supervision management system；
Thread pool manager, for the system configuration unit, database accessor, memory queue manager, asynchronous text
Part processor, the separate threads that data distributor is formed with each ore deposit end are managed, distribute and dispatch.
Further, the data distributor also includes data encrypting and deciphering, Compress softwares processor, for when distributing data
The data of distribution are encrypted, compression processing.
Further, the ore deposit end data is stored in the form of file.
Further, the data received are carried out data point by the data distributor by HttpClient http protocol
Hair.
A kind of new safety supervision networking dynamic data live transmission method includes：
1) database accessor conducts interviews simultaneously according to the environment configuration information of system environments dispensing unit to specified ore deposit end
Gathered data；
2) modification time of real-time data collection is read, when judging whether nearest modification time is more than last time reading
Between, if the file read then abandons this access；
3) judge whether ore deposit end real data files are currently written into information, abandoned if information is write to this document
This is accessed, and is returned to step 2 hair and is opened back-call request, is so moved in circles until other systems stop writing to this document
Enter；
4) when no external system operates to this document, database accessor starts to read this document content, and will read
The real time information taken is stored in memory queue, is and then done and is accessed operation next time；
5) data in memory queue are placed in asynchronous file processor by data distributor, and are read at asynchronous file
The data in device are managed, the form by these data by parameter, send the distributor specified to；
6) distributor the data received are encrypted, compression processing, and by the data transfer after processing to recipient.
Further, the distributor by the data transfer received to recipient when, if occurring mistake in transmitting procedure
When, first data are encrypted, compression processing, then the data after processing are added in corresponding memory queue, pass through data
Distributor is distributed again.
Beneficial effects of the present invention are as follows：
1. not needing deploying client program, operation maintenance is simple.
2. carrying out the encryption and compression of data, the security of data can be ensured.
3. can split upload for big file, loss of data is lost in reduction.
Brief description of the drawings
The embodiment of the present invention is described in further detail below in conjunction with the accompanying drawings.
Fig. 1 shows safety supervision networked system dynamic data RTTS structured flowchart；
Fig. 2 shows data center's acquisition system structured flowchart；
Fig. 3 shows data center's acquisition system transmission data method block diagram.
Embodiment
In order to illustrate more clearly of the present invention, the present invention is done further with reference to preferred embodiments and drawings
It is bright.Similar part is indicated with identical reference in accompanying drawing.It will be appreciated by those skilled in the art that institute is specific below
The content of description is illustrative and be not restrictive, and should not be limited the scope of the invention with this.
It is safety supervision networked system dynamic data RTTS structured flowchart as shown in Figure 1, the Transmission system includes using
In data center's acquisition system of collection ore deposit end data in real time, and ore deposit end data is transferred to colliery safety supervision management system.Ore deposit end
In real time data be stored in the form of a file on the host computer at each ore deposit end, file can be as the change of real time data be without stopping
Renewal this document.Data center's acquisition system can be communicated with multiple ore deposit ends host computer simultaneously, collection system of data center
System can be that the data file of an independent system or multiple acquisition systems respectively from different ore deposit end host computers is entered
Row communication.
After data center's acquisition system gathers the data of ore deposit end host computer by SMB agreements, in order to ensure the complete of data
Property do correlation processing.That is data center's acquisition system is encrypted, compresses and pass through httpClient to the data after processing
(using http agreements), which pushes away real time data information, to be taken to colliery safety supervision management system.Safety supervision management system in colliery is again to number in real time
After decompression, decryption is entered, stored data into by specified rule in corresponding database and database table.
It is an object of the present invention to provide a kind of new safety supervision networking dynamic data RTTS, the transmission system
System includes being used for the data center's acquisition system for gathering ore deposit end data in real time, and ore deposit end data is transferred into safety supervision management system.
This mode gathered using data center, it is not necessary to capture program is put into each ore deposit end when being gathered as traditional approach, so as to real
Now it is managed collectively, reduces the purpose safeguarded.It is as Figure 2-3 data center's acquisition system structured flowchart, the data center adopts
Collecting system includes：
System environments dispensing unit：It is that the integrated environment of data central data system is configured to be configured and parse.This
System is preserved using the properties document forms of java standards, then adds configuration information by system environments dispensing unit
It is loaded into system.
Database accessor：Database accessor is used to access each ore deposit end data, by the real-time data acquisition of each ore deposit into data
In heart acquisition system.In specific embodiment, each ore deposit end can correspond to the example of a database accessor, therefore can realize
Different ore deposit ends enter data access using different database accessors.The accessor of system default acquiescence is real for SMB protocol access
When data.
Memory queue manager：Accessor is not directly distributed to safety supervision management system, is after each ore deposit end data is obtained
The data at each ore deposit end are faster responded, this partial data is first stored in memory queue by the system, and each ore deposit can
A corresponding memory queue, memory queue manager are allocated and dispatched to above-mentioned memory queue.
Asynchronous file processor：One proprietary thread is established by thread pool manager, obtained from memory queue real
When data, formed asynchronous file, above-mentioned file distributed by distributor.If sending failure, such as network connection error etc.,
The system will can not send successful data and be saved in again in asynchronous file.The main purpose of asynchronous file processor is tissue
With managing above-mentioned file, such as the size of file is set, forms the bar number of asynchronous file record every time, to having sent with not sending
File enter and arrange, expired, failure file is deleted etc., and upload can be split for big file, reduction is lost
Loss of data.
Data distributor：After each ore deposit end data is obtained, by these data distributions to the safety supervision management system specified.Number
Effect according to distributor is exactly to be serviced for this, and the transmitter of system default acquiescence is to be carried out using httpClient http protocol
Real-time data distribution.The each request that can send client using HTTP connections herein is required for server back response,
, can actively release connection after request terminates.Certain the system has reserved extensive interface in design, can also pass through realization
Expansion interface realizes the distribution form of other communications protocol.
Thread pool manager：Either accessor, memory queue, distributor, asynchronous file are all corresponding in the present system
Multiple ore deposit ends, and the corresponding respective independent thread of above-mentioned each functional unit carries out computing and processing.This just needs this to be
System supports multithreading and to for improving performance, multiple threads is carried out with pondization management.The purpose of thread pool manager is pipe
Manage the thread of each function, these threads are scheduled and reclaim etc..
Data encrypting and deciphering, Compress softwares processor：It is the kit of an instrument aspect, the system is examined when designing early stage
Consider the security of distribution data and the occupancy of Internet resources, develop the kit.Its effect in the present system be
Data when distributing data to distribution are encrypted, compression is handled；After safety supervision system receives data, in the data solution to reception
After pressure, decryption oprerations, business processing and storage can be carried out.
It is a further object to provide a kind of new safety supervision networking dynamic data live transmission method, the transmission
Method comprises the following steps：
1) database accessor example accesses the ore deposit end host computer specified, access protocol is default to be adopted according to environment configuration information
With SMB agreements；
2) modification time of real-time data collection is read, it is last to judge whether the nearest modification time of real data files is more than
Read access time, if the file read then abandons this access；
3) judge whether ore deposit end real data files are currently written into information, abandoned if information is write to this document
This is accessed, and is returned to step 1 hair and is opened back-call request, is so moved in circles until other systems stop writing to this document
Enter；
4) when no external system (ore deposit end master system) operates to this document, database accessor, which starts to read, to be somebody's turn to do
File content, and the real time information of reading is stored in memory queue, and then do and access operation next time.Now from access
File to the time being put into spent by the whole process of memory queue database accessor be only a few tens of milliseconds, therefore avoid from
Read the possibility that real time data loses in ore deposit end.Simultaneously because real time data change in ore deposit end is very fast, basic each second is all becoming
Change.Memory queue is introduced herein, can solve the problem that the information congestion problems of real time data.
Each memory queue can correspond to a thread, data be read from memory queue, then the data of reading are write
In asynchronous file.If without asynchronous file, if distributor obtains data transmission directly from memory queue, when distributor
Recipient can not receive data or not smooth with the network of recipient, memory queue can be caused to rise suddenly and sharply, so that real time data is full of
Internal memory causes system paralysis to be suffered from.On the other hand, because real time data is all stored in internal memory, once then all information will be all for power down
Lose.Therefore in order to avoid two kinds the occurrence of, the present invention have added an asynchronous file between memory queue and distributor
Processor.
5) a proprietary thread is established by thread pool manager, real time data is obtained from memory queue, by its shape
Into asynchronous file, the asynchronous file is distributed by data distributor.All distributors are managed by a distributor manager,
Asynchronous file is called by distributor manager, and reads the real time data in asynchronous file, the shape that these data are passed through into parameter
Formula, send the distributor specified to.In whole data transfer procedure, we can have found that having many thread tasks participates in it
In, and the task of each thread is run independently of each other.Such as one group of thread will be put into data in memory queue, and another group of line
Journey is fetched from memory queue according to asynchronous file is saved as, and also one group of thread can go to read the asynchronous file not read.Cause
This employs thread pool administrative skill herein for more efficient, the more preferable a large amount of threads of management.
6) after distributor receives data, data are entered with encryption, compression is handled, and by the data transfer after processing to connecing
Debit.By encrypting, compression processing, ensure that the effective and safe that company data is transferred to from ore deposit end data.
The data that distributor will treat, by the communications protocol (defaulting to http protocol) specified, real time data is sent
To recipient.If mistake or abnormal (such as Network Abnormal) occurs during transmission in distributor, distributor can be by this portion
Divided data enters back into decompression, decryption processing, and the data after processing are added in corresponding memory queue.Prepare to the data
Do and distribute next time.
The present invention can gather the real time data of the dynamic changes such as the gas at ore deposit end, oxygen, wind speed, blast, temperature, will be each
These real time datas of ore deposit are dynamically stored in real-time files, at the same from each ore deposit extraction real-time files data, and by these
Data are effectively transferred in colliery safety supervision management system.The safety supervision networking transport system can realize timeliness during data transfer
Property, integrality, while can also reduce the later maintenance of whole system.
Obviously, the above embodiment of the present invention is only intended to clearly illustrate example of the present invention, and is not pair
The restriction of embodiments of the present invention, for those of ordinary skill in the field, may be used also on the basis of the above description
To make other changes in different forms, all embodiments can not be exhaustive here, it is every to belong to this hair
Row of the obvious changes or variations that bright technical scheme is extended out still in protection scope of the present invention.
Claims (6)
1. a kind of new safety supervision networking dynamic data RTTS, it is characterised in that the Transmission system includes being used in fact
When gather data center's acquisition system of ore deposit end data, and ore deposit end data is transferred to safety supervision management system, the data center
Acquisition system includes：
System environments dispensing unit, it is configured and parses for the integrated environment configuration to data central data system；
Database accessor, for the collection that conducted interviews to each ore deposit end data, and by the real-time Data Transmission at ore deposit end to internal memory team
Column manager；
Memory queue manager, for preserving the data of the database accessor collection, and each ore deposit end number that will be gathered
According to corresponding to a memory queue；
Asynchronous file processor, a proprietary thread is established by thread pool manager, number in real time is obtained from memory queue
According to being formed asynchronous file, and distribute the asynchronous file by data distributor；
Data distributor, for by the data information transfer received to specified safety supervision management system；
Thread pool manager, for the system configuration unit, database accessor, memory queue manager, at asynchronous file
Device is managed, the separate threads that data distributor is formed with each ore deposit end are managed, distribute and dispatch.
A kind of 2. new safety supervision networking dynamic data RTTS according to claim 1, it is characterised in that institute
Stating data distributor also includes data encrypting and deciphering, Compress softwares processor, for being carried out when distributing data to the data of distribution
Encryption, compression processing.
A kind of 3. new safety supervision networking dynamic data RTTS according to claim 2, it is characterised in that institute
Ore deposit end data is stated to be stored in the form of file.
A kind of 4. new safety supervision networking dynamic data RTTS according to claim 3, it is characterised in that institute
State data distributor and the data received are subjected to data distribution by HttpClient http protocol.
A kind of 5. new safety supervision connection of the new safety supervision networking dynamic data RTTS based on described in claim 1
Net dynamic data live transmission method, it is characterised in that the transmission method includes：
1) database accessor conducts interviews and gathered to specified ore deposit end according to the environment configuration information of system environments dispensing unit
Data；
2) modification time of real-time data collection is read, judges whether nearest modification time is more than last time read access time, such as
Fruit is that the file read then abandons this access；
3) judge whether ore deposit end real data files are currently written into information, this is abandoned if information is write to this document
Access, return to step 2) and initiate back-call request, so move in circles until other systems stop writing to this document；
4) when no external system operates to this document, database accessor starts to read this document content, and by reading
Real time information is stored in memory queue, is and then done and is accessed operation next time；
5) data in memory queue are placed in asynchronous file processor by data distributor, and read asynchronous file processor
In data, the form by these data by parameter, send the distributor specified to；
6) distributor the data received are encrypted, compression processing, and by the data transfer after processing to recipient.
6. new safety supervision networking dynamic data live transmission method according to claim 5, it is characterised in that described point
Send out device by the data transfer received to recipient when, if occur wrong in transmitting procedure, first data are encrypted, pressed
Contracting is handled, then the data after processing are added in corresponding memory queue, is distributed again by data distributor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410194137.5A CN104038314B (en) | 2014-05-09 | 2014-05-09 | A kind of new safety supervision networking dynamic data RTTS and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410194137.5A CN104038314B (en) | 2014-05-09 | 2014-05-09 | A kind of new safety supervision networking dynamic data RTTS and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104038314A CN104038314A (en) | 2014-09-10 |
| CN104038314B true CN104038314B (en) | 2018-02-02 |
Family
ID=51468920
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410194137.5A Active CN104038314B (en) | 2014-05-09 | 2014-05-09 | A kind of new safety supervision networking dynamic data RTTS and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104038314B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534272A (en) * | 2016-10-21 | 2017-03-22 | 江苏方天电力技术有限公司 | System and method for processing parameters of coal-fired unit |
| CN107566455B (en) * | 2017-08-08 | 2020-04-03 | 武汉合康智能电气有限公司 | Charging pile wireless communication system and communication method |
| CN109766713B (en) * | 2018-12-15 | 2021-01-12 | 中国大唐集团科学技术研究院有限公司 | Method for realizing dynamic rapid desensitization of data based on proxy |
| CN111966472B (en) * | 2020-07-02 | 2023-09-26 | 佛山科学技术学院 | Process scheduling method and system of industrial real-time operating system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102497427A (en) * | 2011-12-13 | 2012-06-13 | 山东省建筑科学研究院 | Method and device for realizing data acquisition services of renewable energy source monitoring system |
| CN102594888A (en) * | 2012-02-16 | 2012-07-18 | 西北工业大学 | Method for enhancing real-time performance of network file system |
| CN103685083A (en) * | 2013-12-31 | 2014-03-26 | 曙光云计算技术有限公司 | Communication method in asynchronous management network |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101345652B (en) * | 2008-08-15 | 2011-04-27 | 北京立通无限科技有限公司 | Data acquisition method and data acquisition equipment |
| CN201364485Y (en) * | 2009-01-21 | 2009-12-16 | 重庆交通大学 | Bridge monitoring system based on C/S mode |
| CN101976210B (en) * | 2010-08-26 | 2013-02-06 | 中国石油集团川庆钻探工程有限公司 | Well site data remote transmission system based on message middleware |
-
2014
- 2014-05-09 CN CN201410194137.5A patent/CN104038314B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102497427A (en) * | 2011-12-13 | 2012-06-13 | 山东省建筑科学研究院 | Method and device for realizing data acquisition services of renewable energy source monitoring system |
| CN102594888A (en) * | 2012-02-16 | 2012-07-18 | 西北工业大学 | Method for enhancing real-time performance of network file system |
| CN103685083A (en) * | 2013-12-31 | 2014-03-26 | 曙光云计算技术有限公司 | Communication method in asynchronous management network |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104038314A (en) | 2014-09-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103024014B (en) | By the method and system of the mass data distribution processor of message queue | |
| CN104038314B (en) | A kind of new safety supervision networking dynamic data RTTS and method | |
| CN103259683B (en) | Based on the Web network management system L2 cache method for pushing of HTML5 | |
| CN104301404B (en) | A kind of method and device of the adjustment operation system resource based on virtual machine | |
| CN101969386A (en) | Log acquisition device and log acquisition method | |
| CN107818120A (en) | Data processing method and device based on big data | |
| CN104778188A (en) | Distributed device log collection method | |
| CN107025222A (en) | A kind of distributed information log acquisition method and device | |
| CN104933114A (en) | Mass log management cloud platform | |
| US11847108B2 (en) | System and method for capturing data to provide to a data analyser | |
| CN101771548A (en) | File synchronizing method and system | |
| CN105447146A (en) | Massive data collecting and exchanging system and method | |
| CN103517085B (en) | Method for implementing remote server management based on video decoding design | |
| CN104503894A (en) | System and method for monitoring state of distributed server in real time | |
| CN102118361B (en) | Method and device for controlling data transmission based on network protocol | |
| CN103490978A (en) | Terminal, server and message monitoring method | |
| CN106534272A (en) | System and method for processing parameters of coal-fired unit | |
| CN101408756A (en) | Remote monitoring and anglicizing system and method of nuclear power steam turbine regulation system | |
| CN110989935A (en) | Data processing and transmitting method and device of flash system | |
| CN106302699A (en) | A kind of method processing many deciphering machines PC end task of decryption | |
| US20110238781A1 (en) | Automated transfer of bulk data including workload management operating statistics | |
| US20140181249A1 (en) | Storage medium, information processing apparatus, and object transmission method | |
| CN110515938B (en) | Data aggregation storage method, equipment and storage medium based on KAFKA message bus | |
| CN104735109A (en) | Medical image data storing system | |
| CN109614380A (en) | Log processing method, system, computer equipment and readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |