CN102664633B - Real-time acquisition, compression and memory method for data in system - Google Patents
Real-time acquisition, compression and memory method for data in system Download PDFInfo
- Publication number
- CN102664633B CN102664633B CN201210109413.4A CN201210109413A CN102664633B CN 102664633 B CN102664633 B CN 102664633B CN 201210109413 A CN201210109413 A CN 201210109413A CN 102664633 B CN102664633 B CN 102664633B
- Authority
- CN
- China
- Prior art keywords
- data
- byte
- compression
- real
- logic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Abstract
The invention discloses a real-time acquisition, compression and memory method for data in a system. The real-time acquisition, compression and memory method is implemented by the aid of circuits including a signal conditioning circuit, an analog/digital converter, a data cache logic device, a memory controller and an external memory which are sequentially and electrically connected. The real-time acquisition, compression and memory method is characterized in that a real-time compression logic device is electrically connected between the analog/digital converter and the data cache logic device and is respectively electrically connected with a pulse-per-second receiver and control signals, and the real-time compression logic device, the data cache logic device and the memory controller are realized by gate array logics.
Description
Technical field
The present invention relates to compression storing data technology, be specially the Real-time Collection compression and storage method of data in a kind of system.This compression and storage method is mainly applicable to the collection analysis of the numeric class information to complexity, especially in the investigation to small probability event, is mainly used in the security fields with high reliability request.
Background technology
Complicated along with electronic system, the communication between system is absolutely necessary, especially a large amount of uses of numeric class bus.May occur some small probability faults in the debug phase, and these faults will bring great trouble to designer and user of service.Located out for what make that small probability fault can be very fast, thus problem is effectively solved, needed a kind of convenient and reliable recording means, for relevant data and the system works situation in analysis of failure moment.Traditional malfunction elimination method is first got rid of one by one by phenomenon, need a large amount of experiments to locate in whole process, but in system in the huge or noncommittal situation of phenomenon of the failure, its malfunction elimination process expends time in being one and the work of energy very much, far can not meet the requirement of real work efficiency.
Traditional high speed acquisition compression storage system due to sampling rate high, improve the sampling number in the unit interval, but the problem brought is also a lot of simultaneously, as: need data volume to be processed huge, the band of transmission data is wide, stores and takes up room large and adopt lossy compression method to improve data compression ratio etc.In the face of these problems, can only require that system reaches a kind of balance of appropriateness, therefore also limit the raising once again of sampling rate.
Summary of the invention
For the deficiencies in the prior art, the technical problem that quasi-solution of the present invention is determined is, there is provided the Real-time Collection compression and storage method of data in a kind of system, the method, for numeric class bus signals gatherer process, is intended to solve in the communications records process of numeric class bus system, still can provide enough amount of information, to recover the data message (timing diagram approach) of each bus in a period of time process, have compression ratio large, memory space is high, Real Time Compression speed is fast, and the feature such as decompress simple.
The technical solution that the present invention solve the technical problem is: the Real-time Collection compression and storage method designing data in a kind of system, and this Real-time Collection compression and storage method adopts following circuit to realize: the signal conditioning circuit be electrically connected successively, A/D converter, data buffer storage logic, Memory Controller and external memory storage; It is characterized in that being electrically connected with Real Time Compression logic between A/D converter and data buffer storage logic, described Real Time Compression logic is electrically connected with pulse per second (PPS) receiver and control signal respectively, and Real Time Compression logical AND data buffer storage logic and memory controller is all realized by gate array logic.
Compared with prior art, the inventive method is for numeric class bus signals gatherer process, with strong points, compression ratio is large, is convenient to store and transmission, also save a large amount of memory spaces, overcome prior art lack of memory capacity and the limited problem of acquisition time section, and there is non-destructive and real-time is good, decompress simple, reliable operation, the features such as applicability is strong.
Accompanying drawing explanation
Fig. 1 is the piece electrical theory diagram of a kind of embodiment of Real-time Collection compression and storage method of data in present system.
Fig. 2 is the Real Time Compression part programmable device control flow chart of a kind of embodiment of Real-time Collection compression and storage method of data in present system.
Embodiment
Below in conjunction with embodiment and accompanying drawing thereof, the present invention is described in more detail.
Real-time Collection compression and storage method (the abbreviation method of data in designed system of the present invention, see Fig. 1,2), this Real-time Collection compression and storage method adopts following circuit to realize: the signal conditioning circuit 1 be electrically connected successively, A/D converter 2, data buffer storage logic 6, Memory Controller 7 and external memory storage 8; It is characterized in that being electrically connected with Real Time Compression logic 5 between A/D converter 2 and data buffer storage logic 6, described Real Time Compression logic 5 is electrically connected with pulse per second (PPS) receiver 3 and control signal 4 respectively, and Real Time Compression logic 5 is all realized by gate array logic with data buffer storage logic 6 and Memory Controller 7.
Signal conditioning circuit 1 described in the inventive method, A/D converter 2, pulse per second (PPS) receiver 3, control signal 4 and external memory storage 8 itself is all existing ripe circuit, for whole collect and process storing process provides safeguard; Described data buffer storage logic 6 and Memory Controller 7 similar with other acquisition system principle, itself also belongs to existing design; Described Real Time Compression logic 5 is innovative design of the present invention.Described Real Time Compression logic 5, data buffer storage logic 6 and Memory Controller 7 are all realized by gate array logic.
Real-time Collection compression and storage method of the present invention is a kind of with strong points, the data processing method that compression ratio is high.Described external signal is necessary for digital signal, the signal exported through signal conditioning circuit 1 is more stable digital signal, through (in time not having data variation, sample magnitude saltus step can not be greater than the place value of 17 precision) that the numerical value of A/D converter 2 conversion is also more stable.Owing to being gather digital signal, be only concerned about the height of level logic, do not have high requirements to the precision of signal level value, sampling precision 128 level values of 7 can meet the analysis requirement to digital signal completely.
The voltage range that signal conditioning circuit 1 described in the inventive method adapts to external input signal is wider, is-15V-+15V, and the signal frequency range that can pass through is 0-10MHz.Output signal after signal conditioning circuit 1 is the discernible signal of next stage A/D converter 2, ensure that the input range of system.
A/D converter 2 described in the inventive method is 40MHz sampling rate, meets the analog/digital conversion requirement of 8 effective accuracies, provides the valid data being convenient to compress, processes with the Real Time Compression logic 5 supplying rear class.
Pulse per second (PPS) receiver 3 described in the inventive method is for solving synchronous pulse per second (PPS).The pulse per second (PPS) receiver 3 of embodiment designs for universal circuit, and the real-time clock received is delivered to Real Time Compression logic 5 in the mode of pulse per second (PPS), as the synchronous guarantee of compression process.
Control signal 4 described in the inventive method is in external equipment, and can control beginning and the end of each acquisition channel of whole acquisition system respectively, what whole system was become is flexible.
Real Time Compression logic 5 described in the inventive method is core design in whole system, is also that to ensure that whole Real-time Collection compression storing process is achieved basic.Due to gather signal be numeric class signal, there is more stable numerical value, therefore adopt following compressed logic method ideal, be mainly divided into 3 kinds of byte formats: data Zi Jie ﹑ quantum byte and second markers byte.Data byte form highest order is 1, and low 7 is data, and this byte value is 128 ~ 256, totally 128 numerals, retains 7 precision that mould/number gathers; Quantum byte form highest order is 0, and a secondary high position is 1, and latter 6 is quantity, can represent its quantity by multiple combination of bytes; Markers byte format second three byte representations, the first byte is 0x00 mark, and the second byte is count least-significant byte second, and the 3rd byte is count most-significant byte second.
The whole course of work of described Real Time Compression logic 5 is described in detail as follows (see Fig. 2): first, judge whether control signal 4 sends beginning acquisition, if do not received orders, then continue the order of wait control signal 4, if received orders, just start collect and process storing process: start conversion and record data, then judge whether control signal 4 orders and terminate collect and process process, if effectively, then terminate current record, if there is no the finish command, judge that whether pulse per second (PPS) receiver 3 is effective again, if effectively, just insert 3 byte number of seconds (counting from 0), otherwise front value is compared with the data gathered below, if two numerical value are more or less the same in 1 code word, just think same data, work adds 1 counting, until after there are being greater than the data of 1 code word, record counting number and this new data, and continue with Data Comparison below, then repeatedly perform above operation, carry out compression process.This compression algorithm can obtain great compression ratio.Test shows, the compression ratio of the inventive method is maximum can reach 1:5000000.
Data buffer storage logic 6 described in the inventive method is that the data after compression can be stored into smoothly in external memory storage 8 and establish a bridge, avoids the loss of data.Because the size after multichannel data compression is different, need certain priority to judge and read to wait for, get up to be absolutely necessary by data buffer storage, therefore data buffer storage logic 6 also has great significance.
Memory Controller 7 described in the inventive method mainly realizes the data in data buffer storage logic 6 to take out and United Dispatching is stored in external memory storage 8.Due to the more than road signal gathered, and the content gathered is also different, data volume size after Real Time Compression logic 5 processes also can be had nothing in common with each other, therefore connected storage controller 7 is needed, this link is stored, to ensure that data buffer area can not be overflowed and obliterated data by its United Dispatching.
The external memory storage 8 of the inventive method process is the final node of whole system, and the information of multichannel mass data signal stored in wherein, is namely recorded by it.General acquisition system all can need a larger memory space, in order to ensure that the mass data collected is stored, but the signal due to system acquisition is numeric class signal, and have employed the compression algorithm that compression ratio is high, therefore the capacity requirement of the present invention to memory is not very high, be easy to realize, be conducive to practical application and promote.
The whole flow process of the inventive method is inseparable with the co-ordination of described 8 functional modules, idiographic flow is: after first must receiving the enable command of control signal 4, signal after level biography could be changed by signal conditioning circuit 1 carries out mould/number biography through A/D converter 2 and changes, insert the pulse per second (PPS) received from pulse per second (PPS) receiver 3 to carry out Real Time Compression logic 5 and process simultaneously, then be stored in external memory storage 8 through data buffer storage logic 6 and Memory Controller 7 control data, each functional module remains respective work, until after receiving the finish command of control signal 4, whole system could terminate whole compression storage work.
The present invention does not address part and is applicable to prior art.
Consider the design bottleneck of conventional high rate image data compression storage system, the present invention only innovates for the collect and process storage of numeric class signal, improves the compression ratio of system, the data volume after compression is reduced, reduce the requirement to system data transmission rate, save memory space.The high speed and real time sampling compression and storage method of present system data only to complicated and huge numeric class bus communication system carries out information record and analyze important in inhibiting, but does not have advantage to the collection of other signal (as analog quantity) beyond numeric class signal, compression and storage.
Above embodiment is only the embody rule example to the inventive method Real-time Collection compression storing process, does not limit the protection range of the application's claim.Every amendment of carrying out in the application's claim technical scheme and non-intrinsically safe improve, all within the application's claims.
Claims (3)
1. the Real-time Collection compression and storage method of data in system, this Real-time Collection compression and storage method adopts following circuit to realize: the signal conditioning circuit be electrically connected successively, A/D converter, data buffer storage logic, Memory Controller and external memory storage; It is characterized in that being electrically connected with Real Time Compression logic between A/D converter and data buffer storage logic, described Real Time Compression logic is electrically connected with pulse per second (PPS) receiver and control signal respectively, and Real Time Compression logic, data buffer storage logic and memory controller are all realized by gate array logic; Described Real Time Compression logic is divided into 3 kinds of byte formats: data Zi Jie ﹑ quantum byte and second markers byte; Data byte form highest order is 1, and low 7 is data, and this byte value is 128 ~ 256, totally 128 numerals, retains 7 precision that mould/number gathers; Quantum byte form highest order is 0, and a secondary high position is 1, and latter 6 is quantity, can represent its quantity by multiple combination of bytes; Markers byte format second three byte representations, the first byte is 0x00 mark, and the second byte is count least-significant byte second, and the 3rd byte is count most-significant byte second;
The course of work of described Real Time Compression logic is: judge whether control signal sends beginning acquisition, if do not received orders, then continue the order of wait control signal, if received orders, just start collect and process storing process: start conversion and record data, then judge whether control signal orders and terminate collect and process process, if effectively, then terminate current record, if there is no the finish command, judge that whether pulse per second (PPS) receiver is effective again, if effectively, just insert 3 byte number of seconds, otherwise front value is compared with the data gathered below, if two numerical value are more or less the same in 1 code word, just think same data, work adds 1 counting, until after there are being greater than the data of 1 code word, record counting number and this new data, and continue with Data Comparison below, then repeatedly perform above operation, carry out compression process.
2. the Real-time Collection compression and storage method of data in system according to claim 1, is characterized in that described signal conditioning circuit adapts to the voltage range of external input signal for-15V-+15V, by signal frequency range be 0-10MHz.
3. the Real-time Collection compression and storage method of data in system according to claim 1, is characterized in that described A/D converter is the sampling rate of 40MHz, meets the analog/digital conversion requirement of 8 effective accuracies.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210109413.4A CN102664633B (en) | 2012-04-16 | 2012-04-16 | Real-time acquisition, compression and memory method for data in system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210109413.4A CN102664633B (en) | 2012-04-16 | 2012-04-16 | Real-time acquisition, compression and memory method for data in system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102664633A CN102664633A (en) | 2012-09-12 |
| CN102664633B true CN102664633B (en) | 2015-05-20 |
Family
ID=46774063
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210109413.4A Expired - Fee Related CN102664633B (en) | 2012-04-16 | 2012-04-16 | Real-time acquisition, compression and memory method for data in system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102664633B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110687858A (en) * | 2019-11-12 | 2020-01-14 | 天津津航计算技术研究所 | Synchronous acquisition and transmission system of multichannel pulse signal |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1612252A (en) * | 2003-10-31 | 2005-05-04 | 浙江中控技术股份有限公司 | Real-time data on-line compression and decompression method |
| CN201993755U (en) * | 2011-01-30 | 2011-09-28 | 上海振华重工(集团)股份有限公司 | Data filtration, compression and storage system of real-time database |
-
2012
- 2012-04-16 CN CN201210109413.4A patent/CN102664633B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1612252A (en) * | 2003-10-31 | 2005-05-04 | 浙江中控技术股份有限公司 | Real-time data on-line compression and decompression method |
| CN201993755U (en) * | 2011-01-30 | 2011-09-28 | 上海振华重工(集团)股份有限公司 | Data filtration, compression and storage system of real-time database |
Non-Patent Citations (2)
| Title |
|---|
| 机载多路视频图像采集与传输系统;嵇晓强等;《计算机工程》;20120331;第38卷(第6期);第2页3.3部分 * |
| 韦建敏.基于可编程逻辑器件的心电信号实时压缩方法研究.《中国优秀博硕士学位论文全文数据库(硕士)医药卫生科技辑》.2007,(第1期),第1页,第4页最后1段,第28-58,62-63页,第46页倒数第3段. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102664633A (en) | 2012-09-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103995764B (en) | A kind of logic analyser with serial bus protocol continuous trigger function | |
| CN201876484U (en) | High-voltage signal conditioning and data acquisition device | |
| CN103529804A (en) | Distributed control system based on EtherCAT bus | |
| CN102759675A (en) | On-line electric energy quality monitoring device | |
| CN102945594B (en) | Meter-bus data collector with ultra-low power loss | |
| CN111725776B (en) | FPGA-based power distribution network current differential protection device | |
| CN105572516A (en) | Multifunctional FPGA acquisition unit with time reference output | |
| CN202230480U (en) | High-speed signal collecting and data caching system based on field programmable gate array (FPGA) | |
| CN202837399U (en) | Synchronized phasor measurement apparatus | |
| CN104361374A (en) | Collecting and processing system and method of radio-frequency signals | |
| CN206041987U (en) | Power line interfering signal draw with synchronous playback device | |
| CN103529327B (en) | A kind of full station equipment for monitoring power quality and monitoring method being suitable for Intelligent transformer station | |
| CN102664633B (en) | Real-time acquisition, compression and memory method for data in system | |
| CN103235215A (en) | Multi-functional instrument | |
| CN100527184C (en) | Method for collecting transient data in power system | |
| CN102158381A (en) | Dual-mode network data acquisition device in smart grid and network data acquisition system | |
| CN205404700U (en) | Take multi -functional FPGA acquisition unit of time reference output | |
| CN104361373A (en) | Collecting and processing method of radio-frequency signals | |
| CN102508423A (en) | IRIG-B (Inter-Range Instrumentation Group-B) time-setting method adopting enhanced capture module | |
| CN202976445U (en) | Counter bus data collector with ultralow power consumption | |
| CN108132636A (en) | Based on monolithic processor controlled multi-channel data acquisition processing system | |
| CN204242207U (en) | A kind of Acquire and process system of radiofrequency signal | |
| CN109309682B (en) | FT 3-IEC 61850-9-2 protocol conversion method and system for digital metering | |
| CN202035001U (en) | Dual mode network data acquisition device and network data acquisition system of intelligent electric network | |
| CN109471060B (en) | Device for monitoring metering accuracy of digital electric energy meter on line |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150520 Termination date: 20170416 |