CN104038314A - Novel safety-monitoring networking real-time dynamic data transmission system and method - Google Patents
Novel safety-monitoring networking real-time dynamic data transmission system and method Download PDFInfo
- Publication number
- CN104038314A CN104038314A CN201410194137.5A CN201410194137A CN104038314A CN 104038314 A CN104038314 A CN 104038314A CN 201410194137 A CN201410194137 A CN 201410194137A CN 104038314 A CN104038314 A CN 104038314A
- Authority
- CN
- China
- Prior art keywords
- data
- file
- ore deposit
- distributor
- memory queue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Information Transfer Between Computers (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention discloses a novel safety-monitoring networking real-time dynamic data transmission system and a method. The transmission system comprises a data center acquisition system used for acquiring mine end data and the mine end data are transmitted to a safety monitoring management system. The data center acquisition system comprises a system environment configuration unit, a data access device, a memory queue manager, an asynchronous file processor, a data distribution device, a data encryption and decryption and compression and decompression processor and a thread management unit. A client program does not need to be configured, and operation and maintenance are simple. By adopting the transmission system and the method, encryption and compression of the data can be carried out, safety of the data can be ensured, a large file can be split for being uploaded, and loss of data can be reduced.
Description
Technical field
The present invention relates to safety supervision networked system, particularly a kind of novel safety supervision networking dynamic data RTTS and method.
Background technology
Coal mine safety monitoring networking plays a part to become more and more important aspect Safety of Coal Mine Production, its application can make colliery administrative department can time, grasp and understand clearly the dynamic datas such as the gas, oxygen, wind speed, blast, temperature in colliery, thereby avoid in time or prevent the generation of mine safety accidents.
Existing technology is mainly taking Java6 as programming platform, utilize Microsoft SQL Server2005 (compatible Microsoft SQL Server2000, ORALCE, MySQL etc.) data database storing, based on the network transmission protocol of TCP/IP, realize the real-time Transmission of system dynamic data.Specific design is as follows:
(1) carry out database design.The database of storage real-time dynamic data is named, and divide storehouse (optional) for each ore deposit end, the design separates real time data management with statistics, further to database table per diem, month, year divide list processing, be used for storing dynamic real-time Simulation amount, switching value data.
(2) each ore deposit end all needs to dispose corresponding client-side program, calls real time data for centre data acquisition system.
(3) database connecting test.Want fulfillment database connecting test, need be every a data transfer cycle (being generally 10s), test-based examination once whether with the database successful connection of server, so circulation.
(4) carry out extraction and the real-time Transmission of dynamic data.Adopt the data communication of socket (Socket) Interface realization.
(5) carry out web web page browsing.
But there is following shortcoming in above-mentioned prior art:
1. need deploying client program, operation maintenance complexity.
2. do not carry out encryption and the compression of data, cannot ensure the fail safe of data.
3. data file size no matter, every wholesale 1 data file of sending, has loss of data.
Visible, in the process that realizes safety monitoring system networking, the real-time Transmission of dynamic data plays vital effect, can make various data messages under coal mine be real-time transmitted to the data center of colliery administrative department.How can realize easily and efficiently the real-time Transmission of dynamic data, can ensure again fail safe, the reliability of data simultaneously, reduce the maintenance of system in the future, be to need at present urgent problem.
Summary of the invention
For above the deficiencies in the prior art, the invention provides a kind of novel safety supervision networking dynamic data RTTS and method.
The present invention adopts following technical proposals:
Novel safety supervision networking dynamic data RTTS comprises the data center's acquisition system for Real-time Collection ore deposit end data, and ore deposit end data is transferred to safety supervision management system, and described data center acquisition system comprises:
System environments dispensing unit, arranges and resolves for the integrated environment configuration to data center's acquisition system;
Data access device, for collection that each ore deposit end data is conducted interviews, and by the real-time Data Transmission of ore deposit end to memory queue manager;
Memory queue manager, the data that gather for preserving described data access device, and gathered each ore deposit end data is corresponded to a memory queue;
Asynchronous file handler, sets up a proprietary thread by thread pool manager, obtains real time data from memory queue, is formed asynchronous file, and distributes this asynchronous file by data distributor;
Data distributor, for the safety supervision management system to appointment by the data information transfer receiving;
Thread pool manager, for to described system configuration unit, data access device, memory queue manager, asynchronous file handler, the separate threads that data distributor and each ore deposit end form manages, and distributes and scheduling.
Further, described data distributor also comprises data encrypting and deciphering, Compress softwares processor, for the data of distribution being encrypted, compressing processing when the distributing data.
Further, described ore deposit end data adopts the form of file to store.
Further, described data distributor carries out Data dissemination by the data that receive by the http protocol of HttpClient.
A kind of novel safety supervision networking dynamic data live transmission method comprises:
1) data access device, according to the environment configurations information of system environments dispensing unit, conducts interviews and image data to the ore deposit end of specifying;
2) read the modification time of real-time data collection, judge whether nearest modification time is greater than for the last time to read the time, if the file having read is abandoned this access;
3) judge that whether ore deposit end real time data file is just at writing information, if to this file writing information, abandon this access, turn back to step 2 and open back-call request, so move in circles until other system stops writing to this file;
4) when not having external system to do exercises while doing to this file, data access device starts to read this file content, and the real time information of reading is left in memory queue, and then does accessing operation next time;
5) data distributor, by the data placement in memory queue in asynchronous file handler, and reads the data in asynchronous file handler, by the form of parameter, sends these data the distributor of appointment to;
6) distributor is encrypted, compresses processing by the data that receive, and by transfer of data after treatment to recipient.
Further, described distributor is by the transfer of data receiving during to recipient, when wrong, first data is encrypted, compresses processing if occurred in transmitting procedure, again data after treatment are added in corresponding memory queue, again distribute by data distributor.
Beneficial effect of the present invention is as follows:
1. do not need deploying client program, operation maintenance is simple.
2. carry out encryption and the compression of data, can ensure the fail safe of data.
3. can split and upload for large file, reduce and lose loss of data.
Brief description of the drawings
Below in conjunction with accompanying drawing, the specific embodiment of the present invention is described in further detail.
Fig. 1 illustrates safety supervision networked system dynamic data RTTS structured flowchart;
Fig. 2 illustrates data center's acquisition system structured flowchart;
Fig. 3 illustrates data center's acquisition system transmission data method block diagram.
Embodiment
In order to be illustrated more clearly in the present invention, below in conjunction with preferred embodiments and drawings, the present invention is described further.Parts similar in accompanying drawing represent with identical Reference numeral.It will be appreciated by those skilled in the art that specifically described content is illustrative and nonrestrictive below, should not limit the scope of the invention with this.
Be illustrated in figure 1 safety supervision networked system dynamic data RTTS structured flowchart, this transmission system comprises the data center's acquisition system for Real-time Collection ore deposit end data, and ore deposit end data is transferred to colliery safety supervision management system.Real time data in the end of ore deposit is stored in the form of file on the host computer of each ore deposit end, and file can ceaselessly upgrade along with the variation of real time data this file.Data center's acquisition system can simultaneously be carried out communication with multiple ore deposits end host computer, and data center's acquisition system can be an independently system, can be also that multiple acquisition systems are carried out communication from the data file of different ore deposit end host computer respectively.
Data center's acquisition system gathers by SMB agreement after the data of ore deposit end host computer, in order to ensure that the integrality of data does relevant processing.Be data center's acquisition system to data after treatment, be encrypted, compress by httpClient (adopt http agreement) real time data information is pushed away and is taken to colliery safety supervision management system.Safety supervision management system in colliery enters after decompress(ion), deciphering real time data again, by specified rule, data is saved in corresponding database and database table.
An object of the present invention is to provide a kind of novel safety supervision networking dynamic data RTTS, this transmission system comprises the data center's acquisition system for Real-time Collection ore deposit end data, and ore deposit end data is transferred to safety supervision management system.This mode that adopts data center to gather, needn't resemble when traditional approach gathers capture program is put into each ore deposit end, thereby realizes the object of unified management, reduction maintenance.Be data center's acquisition system structured flowchart as Figure 2-3, this data center's acquisition system comprises:
System environments dispensing unit: be that the integrated environment configuration of data center's acquisition system is arranged and resolved.Native system adopts the properties document form of java standard to preserve, and then adds configuration information by system environments dispensing unit and is loaded in system.
Data access device: data access device is used for accessing each ore deposit end data, by the real-time data acquisition in each ore deposit in data center's acquisition system.In specific embodiment, all examples of a corresponding data accessor of each ore deposit end, therefore can realize different ore deposits end and adopt different data access devices to enter data access.The accessor of system default acquiescence is SMB protocol access real time data.
Memory queue manager: accessor is obtaining after the end data of each ore deposit, not directly be distributed to safety supervision management system, in order to respond faster the data of each ore deposit end, native system will first be kept at this part data in memory queue, each ore deposit can a corresponding memory queue, and memory queue manager distributes above-mentioned memory queue and dispatches.
Asynchronous file handler: set up a proprietary thread by thread pool manager, obtain real time data from memory queue, formed asynchronous file, by the above-mentioned file of dispense.If sent unsuccessfully, such as network connection error etc., native system can be saved in asynchronous file again by not sending successful data.The main purpose of asynchronous file handler is the above-mentioned file of Organization And Management, the size of file is for example set, forms the number of asynchronous file record at every turn, enter arrangement to sending with the file not sending, file expired, that lost efficacy is deleted etc., and can split and upload for large file, reduce and lose loss of data.
Data distributor: obtaining after the end data of each ore deposit, be by these Data disseminations to the safety supervision management system of specifying.The effect of data distributor is exactly to serve for this reason, and the transmitter of system default acquiescence is to adopt the http protocol of httpClient to carry out real-time data distribution.Adopting HTTP to connect each request that can make client send herein all needs server back response, after request finishes, and initiatively release connection.Certainly native system has reserved extensive interface in design, also can realize by realizing expansion interface the distribution form of other communications protocol.
Thread pool manager: in native system, be that accessor, memory queue, distributor, asynchronous file are all corresponding multiple ore deposits ends, and the equal correspondence of above-mentioned each functional unit separately independently thread carry out computing and processing.This just needs native system to support multithreading and to for improving performance, multiple threads is carried out to pondization management.The object of thread pool manager is the thread of the each function of management, these threads is dispatched and is reclaimed etc.
Data encrypting and deciphering, Compress softwares processor: be the kit of an instrument aspect, native system is considered the fail safe of distributing data and the occupancy of Internet resources in the time designing early stage, has developed this kit.Its effect in native system is, in the time of distributing data, the data of distribution are encrypted, compress processing; When safety supervision system is received after data, after to the data decompression receiving, decryption oprerations, can carry out Business Processing and storage.
Another object of the present invention is to provide a kind of novel safety supervision networking dynamic data live transmission method, and this transmission method comprises the steps:
1) data access device example, according to environment configurations information, is accessed the ore deposit end host computer of specifying, the default employing of access protocal SMB agreement;
2) read the modification time of real-time data collection, judge whether the nearest modification time of real time data file is greater than for the last time to read the time, if the file having read is abandoned this access;
3) judge that whether ore deposit end real time data file is just at writing information, if to this file writing information, abandon this access, turn back to step 1 and open back-call request, so move in circles until other system stops writing to this file;
4) when not having external system (ore deposit end master system) to do exercises while doing to this file, data access device starts to read this file content, and the real time information of reading is left in memory queue, and then does accessing operation next time.Be now only a few tens of milliseconds from access file to the spent time of the whole process of putting into memory queue data access device, therefore avoided reading from ore deposit end the possibility that real time data loses.Because end real time data variation in ore deposit is very fast, all changing basic each second simultaneously.Introduce memory queue herein, the information that can the solve real time data problem of blocking up.
Each memory queue can a corresponding thread, reading out data from memory queue, then the data that read are write in asynchronous file.If there is no asynchronous file, distributor directly obtains the words that data send from memory queue, when the recipient of distributor cannot receive data or not smooth with recipient's network, can cause memory queue to rise suddenly and sharply, cause system paralysis to be suffered from thereby make real time data be full of internal memory.On the other hand, because real time data all leaves in internal memory, once power down all information will all lose.Therefore for fear of the generation of two kinds of situations, the present invention has added an asynchronous file handler between memory queue and distributor.
5) set up a proprietary thread by thread pool manager, from memory queue, obtain real time data, formed asynchronous file, distribute this asynchronous file by data distributor.All distributors manage by a distributor manager, call asynchronous file by distributor manager, and read the real time data in asynchronous file, by the form of parameter, send these data the distributor of appointment to.In whole data transfer procedure, we can find to have a lot of thread tasks and participate, and the separate operation of the task of each thread.For example one group of thread will be put into data in memory queue, and another group thread fetches data and saves as asynchronous file from memory queue, also has one group of thread can remove the asynchronous file not reading.Therefore in order more efficiently, better to manage a large amount of threads, adopted thread pool administrative skill herein.
6) distributor receives after data, to data enter encryption, compression process, and by transfer of data after treatment to recipient.Process by encrypting, compressing, ensured to be transferred to from ore deposit end data the effective and safe of company data.
Distributor, by the data of processing, by the communications protocol (defaulting to http protocol) of specifying, sends to recipient by real time data.For example, if wrong or abnormal (Network Abnormal) appears in distributor in the process sending, distributor can enter decompress(ion), decryption processing again by this part data, and data after treatment are added in corresponding memory queue.Prepare these data to do distribution next time.
The present invention can gather the real time data of the dynamic changes such as the gas, oxygen, wind speed, blast, temperature of ore deposit end, these real time datas in each ore deposit are kept in real-time files dynamically, extract the data of real-time files simultaneously from each ore deposit, and these data are effectively transferred in colliery safety supervision management system.Ageing, integrality when this safety supervision networking transmission system can realize transfer of data, also can reduce the later maintenance of whole system simultaneously.
Obviously; the above embodiment of the present invention is only for example of the present invention is clearly described; and be not the restriction to embodiments of the present invention; for those of ordinary skill in the field; can also make other changes in different forms on the basis of the above description; here cannot give all execution modes exhaustively, everyly belong to apparent variation or the still row in protection scope of the present invention of variation that technical scheme of the present invention extends out.
Claims (6)
1. a novel safety supervision networking dynamic data RTTS, it is characterized in that, this transmission system comprises the data center's acquisition system for Real-time Collection ore deposit end data, and ore deposit end data is transferred to safety supervision management system, and described data center acquisition system comprises:
System environments dispensing unit, arranges and resolves for the integrated environment configuration to data center's acquisition system;
Data access device, for collection that each ore deposit end data is conducted interviews, and by the real-time Data Transmission of ore deposit end to memory queue manager;
Memory queue manager, the data that gather for preserving described data access device, and gathered each ore deposit end data is corresponded to a memory queue;
Asynchronous file handler, sets up a proprietary thread by thread pool manager, obtains real time data from memory queue, is formed asynchronous file, and distributes this asynchronous file by data distributor;
Data distributor, for the safety supervision management system to appointment by the data information transfer receiving;
Thread pool manager, for to described system configuration unit, data access device, memory queue manager, asynchronous file handler, the separate threads that data distributor and each ore deposit end form manages, and distributes and scheduling.
2. a kind of novel safety supervision networking dynamic data RTTS according to claim 1, it is characterized in that, described data distributor also comprises data encrypting and deciphering, Compress softwares processor, for the data of distribution being encrypted, compressing processing when the distributing data.
3. a kind of novel safety supervision networking dynamic data RTTS according to claim 2, is characterized in that, described ore deposit end data adopts the form of file to store.
4. a kind of novel safety supervision networking dynamic data RTTS according to claim 3, is characterized in that, described data distributor carries out Data dissemination by the data that receive by the http protocol of HttpClient.
5. a novel safety supervision networking dynamic data live transmission method, is characterized in that, this transmission method comprises:
1) data access device, according to the environment configurations information of system environments dispensing unit, conducts interviews and image data to the ore deposit end of specifying;
2) read the modification time of real-time data collection, judge whether nearest modification time is greater than for the last time to read the time, if the file having read is abandoned this access;
3) judge that whether ore deposit end real time data file is just at writing information, if to this file writing information, abandon this access, turn back to step 2 and open back-call request, so move in circles until other system stops writing to this file;
4) when not having external system to do exercises while doing to this file, data access device starts to read this file content, and the real time information of reading is left in memory queue, and then does accessing operation next time;
5) data distributor, by the data placement in memory queue in asynchronous file handler, and reads the data in asynchronous file handler, by the form of parameter, sends these data the distributor of appointment to;
6) distributor is encrypted, compresses processing by the data that receive, and by transfer of data after treatment to recipient.
6. a kind of novel safety supervision networking dynamic data live transmission method according to claim 5, it is characterized in that, described distributor is by the transfer of data receiving during to recipient, if while there is mistake in transmitting procedure, first data are encrypted, compress processing, again data after treatment are added in corresponding memory queue, again distribute by data distributor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410194137.5A CN104038314B (en) | 2014-05-09 | 2014-05-09 | A kind of new safety supervision networking dynamic data RTTS and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410194137.5A CN104038314B (en) | 2014-05-09 | 2014-05-09 | A kind of new safety supervision networking dynamic data RTTS and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104038314A true CN104038314A (en) | 2014-09-10 |
| CN104038314B CN104038314B (en) | 2018-02-02 |
Family
ID=51468920
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410194137.5A Active CN104038314B (en) | 2014-05-09 | 2014-05-09 | A kind of new safety supervision networking dynamic data RTTS and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104038314B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534272A (en) * | 2016-10-21 | 2017-03-22 | 江苏方天电力技术有限公司 | System and method for processing parameters of coal-fired unit |
| CN107566455A (en) * | 2017-08-08 | 2018-01-09 | 武汉合康智能电气有限公司 | A kind of charging pile wireless communication system and communication means |
| CN109766713A (en) * | 2018-12-15 | 2019-05-17 | 中国大唐集团科学技术研究院有限公司 | A kind of data dynamic Rapid desensitization implementation method based on agency |
| CN111966472A (en) * | 2020-07-02 | 2020-11-20 | 佛山科学技术学院 | Process scheduling method and system for industrial real-time operating system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101345652A (en) * | 2008-08-15 | 2009-01-14 | 北京立通无限科技有限公司 | Data acquisition method and data acquisition equipment |
| CN201364485Y (en) * | 2009-01-21 | 2009-12-16 | 重庆交通大学 | Bridge monitoring system based on C/S mode |
| CN101976210A (en) * | 2010-08-26 | 2011-02-16 | 中国石油集团川庆钻探工程有限公司 | Well site data remote transmission method based on message middleware |
| CN102497427A (en) * | 2011-12-13 | 2012-06-13 | 山东省建筑科学研究院 | Method and device for realizing data acquisition services of renewable energy source monitoring system |
| CN102594888A (en) * | 2012-02-16 | 2012-07-18 | 西北工业大学 | Method for enhancing real-time performance of network file system |
| CN103685083A (en) * | 2013-12-31 | 2014-03-26 | 曙光云计算技术有限公司 | Communication method in asynchronous management network |
-
2014
- 2014-05-09 CN CN201410194137.5A patent/CN104038314B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101345652A (en) * | 2008-08-15 | 2009-01-14 | 北京立通无限科技有限公司 | Data acquisition method and data acquisition equipment |
| CN201364485Y (en) * | 2009-01-21 | 2009-12-16 | 重庆交通大学 | Bridge monitoring system based on C/S mode |
| CN101976210A (en) * | 2010-08-26 | 2011-02-16 | 中国石油集团川庆钻探工程有限公司 | Well site data remote transmission method based on message middleware |
| CN102497427A (en) * | 2011-12-13 | 2012-06-13 | 山东省建筑科学研究院 | Method and device for realizing data acquisition services of renewable energy source monitoring system |
| CN102594888A (en) * | 2012-02-16 | 2012-07-18 | 西北工业大学 | Method for enhancing real-time performance of network file system |
| CN103685083A (en) * | 2013-12-31 | 2014-03-26 | 曙光云计算技术有限公司 | Communication method in asynchronous management network |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534272A (en) * | 2016-10-21 | 2017-03-22 | 江苏方天电力技术有限公司 | System and method for processing parameters of coal-fired unit |
| CN107566455A (en) * | 2017-08-08 | 2018-01-09 | 武汉合康智能电气有限公司 | A kind of charging pile wireless communication system and communication means |
| CN107566455B (en) * | 2017-08-08 | 2020-04-03 | 武汉合康智能电气有限公司 | Charging pile wireless communication system and communication method |
| CN109766713A (en) * | 2018-12-15 | 2019-05-17 | 中国大唐集团科学技术研究院有限公司 | A kind of data dynamic Rapid desensitization implementation method based on agency |
| CN111966472A (en) * | 2020-07-02 | 2020-11-20 | 佛山科学技术学院 | Process scheduling method and system for industrial real-time operating system |
| CN111966472B (en) * | 2020-07-02 | 2023-09-26 | 佛山科学技术学院 | Process scheduling method and system of industrial real-time operating system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104038314B (en) | 2018-02-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108536761B (en) | Report data query method and server | |
| US10467105B2 (en) | Chained replication techniques for large-scale data streams | |
| US8762931B2 (en) | Generating an encoded package profile | |
| CN104603740B (en) | Filing data identifies | |
| CN102970158B (en) | Log storage and processing method and log server | |
| US9003389B2 (en) | Generating an encoded package profile based on executing host processes | |
| CN102497427B (en) | Method and device for realizing data acquisition services of renewable energy source monitoring system | |
| CN104391697B (en) | The cloud resource management system and method for application program | |
| US11218544B1 (en) | Tiered queuing system | |
| JP2016186782A (en) | Data processing method and data processor | |
| CN105677507B (en) | A kind of business data cloud standby system and method | |
| CN104144081A (en) | General application log management method, device and system | |
| CN104038314A (en) | Novel safety-monitoring networking real-time dynamic data transmission system and method | |
| CN110019104B (en) | File resource exchange method, file resource server and file exchange system | |
| CN102148833A (en) | Method for transmitting data report, server, client and system | |
| CN108737549A (en) | A kind of log analysis method and device of big data quantity | |
| CN104077420A (en) | Method and device for importing data into HBase database | |
| CN101771548A (en) | File synchronizing method and system | |
| CN103763368A (en) | Cross-data-center data synchronism method | |
| CN104243610A (en) | Distributed file transmission service method | |
| CN107220271A (en) | A kind of method and system of distributed digital resource storage processing and management | |
| CN105447146A (en) | Massive data collecting and exchanging system and method | |
| CN111339471A (en) | Method and device for dynamically loading page buried point data | |
| CN108205468A (en) | A kind of distributed system and implementation method towards massive video image | |
| CN111897877A (en) | High-performance and high-reliability data sharing system and method based on distributed thought |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |