CN204496485U - A kind of I/O assisted access device based on high-speed data acquisition storage system - Google Patents
A kind of I/O assisted access device based on high-speed data acquisition storage system Download PDFInfo
- Publication number
- CN204496485U CN204496485U CN201520224400.0U CN201520224400U CN204496485U CN 204496485 U CN204496485 U CN 204496485U CN 201520224400 U CN201520224400 U CN 201520224400U CN 204496485 U CN204496485 U CN 204496485U
- Authority
- CN
- China
- Prior art keywords
- data
- buffer module
- collecting card
- solid state
- storage server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The utility model discloses a kind of I/O assisted access device based on high-speed data acquisition storage system, data collecting card and storage server is comprised based on high-speed data acquisition storage system, I/O assisted access device comprises: solid state buffer module, be arranged on data collecting card inside, receive the data of data collecting card collection and store, when the data stored in solid state buffer module reach setting threshold value or data collecting card stops data collection, stored data are sent to storage server by solid state buffer module; DMA buffer module, is arranged in storage server, and when storage server receives the data from data collecting card, data store according to physical memory addresses growing direction by DMA buffer module successively; When the data volume in DMA buffer module reaches preset value or exceed setting-up time when not receiving new data always and still have data in DMA buffer module, by stored data write physical storage medium.
Description
Technical field
The utility model relates to high-speed data acquisition field of storage, in particular to a kind of I/O assisted access device based on high-speed data acquisition storage system.
Background technology
The work of high-speed data acquisition storage system in record mode time, first by high-speed collection card, sampled data can be passed through DMA (Direct Memory Access, direct memory access) mode is saved in Installed System Memory, then notify that system takes these data away, and be saved in order in physical storage medium.Because data are saved in this process of physical storage medium by system, need to relate to data copy and once above I/O (Input/Output, input/output port) operation between storage allocation, internal memory, performance is soft low.In addition, there is the problems such as sporadic I/O time delay is large in traditional storage medium (as: disk or disk array), the image data of front end can be caused like this cannot by system process, thus to cause image data to lose in special time.
Utility model content
The utility model provides a kind of I/O assisted access device based on high-speed data acquisition storage system, in order to improve high-speed data acquisition storage system I/O performance and reliability.。
For achieving the above object, the utility model provides a kind of I/O assisted access device based on high-speed data acquisition storage system, describedly comprises data collecting card and storage server based on high-speed data acquisition storage system, and described I/O assisted access device comprises:
Solid state buffer module, be arranged on data collecting card inside, and be connected with the corresponding data interface of described data collecting card, described data collecting card is connected with described storage server, described solid state buffer module receives the data of described data collecting card collection and stores, when the data stored in described solid state buffer module reach setting threshold value or described data collecting card stops data collection, stored data are sent to described storage server by the corresponding data interface of described data collecting card by described solid state buffer module;
DMA buffer module, be arranged in described storage server, and be connected with the corresponding data interface of physical storage medium with described storage server respectively, when described storage server receives the data from described data collecting card, data store according to physical memory addresses growing direction by described DMA buffer module successively; When the data volume in described DMA buffer module reaches preset value or exceed setting-up time when not receiving new data always and still have data in described DMA buffer module, by stored data write physical storage medium.
Further, described solid state buffer module is flash memory.
Further, described solid state buffer module is random access memory.
The utility model, can I/O number of physical storage medium in effectively minimizing system when high-speed data acquisition storage system record data, in addition, forms large block I/O data by accumulation, thus improve performance.In each I/O process, reach supporting data zero-copy technique, thus effectively reduce I/O time delay.Meanwhile, by multi-buffer district, there is a certain amount of moment I/O time delay and do not lose sampled data in permission system, thus improve the reliability of system.
Accompanying drawing explanation
In order to be illustrated more clearly in the utility model embodiment or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only embodiments more of the present utility model, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the I/O assisted access device schematic diagram based on high-speed data acquisition storage system of the utility model embodiment.
Embodiment
Below in conjunction with the accompanying drawing in the utility model embodiment, be clearly and completely described the technical scheme in the utility model embodiment, obviously, described embodiment is only the utility model part embodiment, instead of whole embodiments.Based on the embodiment in the utility model, those of ordinary skill in the art are not paying the every other embodiment obtained under creative work prerequisite, all belong to the scope of the utility model protection.
Fig. 1 is the I/O assisted access device schematic diagram based on high-speed data acquisition storage system of the utility model embodiment.As shown in the figure, comprise data collecting card and storage server based on high-speed data acquisition storage system, I/O assisted access device comprises:
Solid state buffer module, be arranged on data collecting card inside, and be connected with the corresponding data interface of data collecting card, data collecting card is connected with storage server, solid state buffer module receives the data of data collecting card collection and stores, when the data stored in solid state buffer module reach setting threshold value or data collecting card stops data collection, stored data are sent to storage server by the corresponding data interface of data collecting card by solid state buffer module;
DMA buffer module, be arranged in storage server, and be connected with the corresponding data interface of physical storage medium with storage server respectively, when storage server receives the data from data collecting card, data store according to physical memory addresses growing direction by DMA buffer module successively; When the data volume in DMA buffer module reaches preset value or exceed setting-up time when not receiving new data always and still have data in DMA buffer module, by stored data write physical storage medium.
Such as, above-mentioned solid state buffer module can be flash memory or random access memory.。
In the above embodiment of the present invention, first the data that data collecting card collects can be saved in data buffering module, when being accumulated to one of following condition and triggering, then the data DMA in this buffer module in Installed System Memory:
(1) when buffer zone is filled up soon (can preliminary setting data threshold value);
(2) when capture card stops sampled data;
After in the data DMA in buffer module to Installed System Memory, sky is put immediately in the corresponding data field of buffer module, to reuse.
In storage server, continuous print physical memory is adopted to be used as DMA buffer module.During each DMA of capture card, successively data can be saved in DMA buffer module by physical memory addresses growing direction.By the scheme of this patent, can repeatedly continuous print sampled data be combined to inside a continuous print physical memory, when being accumulated to one of following condition and triggering, once this section of internal storage data be write in physical storage medium:
(1) when buffer data reaches predetermined amount of data;
(2) exceed certain time upper limit, never new request is got off, and when still having data in buffer zone;
(3) when stopping data collection, and when still having data in buffer zone.
When the data in DMA buffer module brush after in physical storage medium, DMA buffer module empties immediately, to reuse.
In summary, by such scheme of the present utility model, when high-speed data acquisition storage system record data, can I/O number of physical storage medium in effectively minimizing system, in addition, form large block I/O data by accumulation, thus improve performance.In each I/O process, reach supporting data zero-copy technique, thus effectively reduce I/O time delay.Meanwhile, by multi-buffer district, there is a certain amount of moment I/O time delay and do not lose sampled data in permission system, thus improve the reliability of system.
One of ordinary skill in the art will appreciate that: accompanying drawing is the schematic diagram of an embodiment, the module in accompanying drawing or flow process might not be that enforcement the utility model is necessary.
One of ordinary skill in the art will appreciate that: the module in the device in embodiment can describe according to embodiment and be distributed in the device of embodiment, also can carry out respective change and be arranged in the one or more devices being different from the present embodiment.The module of above-described embodiment can merge into a module, also can split into multiple submodule further.
Last it is noted that above embodiment is only in order to illustrate the technical solution of the utility model, be not intended to limit; Although be described in detail the utility model with reference to previous embodiment, those of ordinary skill in the art is to be understood that: it still can be modified to the technical scheme described in previous embodiment, or carries out equivalent replacement to wherein portion of techniques feature; And these amendments or replacement, do not make the essence of appropriate technical solution depart from the spirit and scope of the utility model embodiment technical scheme.
Claims (3)
1. based on an I/O assisted access device for high-speed data acquisition storage system, describedly comprise data collecting card and storage server based on high-speed data acquisition storage system, it is characterized in that, described I/O assisted access device comprises:
Solid state buffer module, be arranged on data collecting card inside, and be connected with the corresponding data interface of described data collecting card, described data collecting card is connected with described storage server, described solid state buffer module receives the data of described data collecting card collection and stores, when the data stored in described solid state buffer module reach setting threshold value or described data collecting card stops data collection, stored data are sent to described storage server by the corresponding data interface of described data collecting card by described solid state buffer module;
DMA buffer module, be arranged in described storage server, and be connected with the corresponding data interface of physical storage medium with described storage server respectively, when described storage server receives the data from described data collecting card, data store according to physical memory addresses growing direction by described DMA buffer module successively; When the data volume in described DMA buffer module reaches preset value or exceed setting-up time when not receiving new data always and still have data in described DMA buffer module, by stored data write physical storage medium.
2. I/O assisted access device according to claim 1, is characterized in that, described solid state buffer module is flash memory.
3. I/O assisted access device according to claim 1, is characterized in that, described solid state buffer module is random access memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201520224400.0U CN204496485U (en) | 2015-04-14 | 2015-04-14 | A kind of I/O assisted access device based on high-speed data acquisition storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201520224400.0U CN204496485U (en) | 2015-04-14 | 2015-04-14 | A kind of I/O assisted access device based on high-speed data acquisition storage system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN204496485U true CN204496485U (en) | 2015-07-22 |
Family
ID=53575781
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201520224400.0U Active CN204496485U (en) | 2015-04-14 | 2015-04-14 | A kind of I/O assisted access device based on high-speed data acquisition storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN204496485U (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105610530A (en) * | 2015-12-25 | 2016-05-25 | 航天恒星科技有限公司 | Satellite data acquisition and analysis method and system |
| CN106649140A (en) * | 2016-12-29 | 2017-05-10 | 深圳前海弘稼科技有限公司 | Data processing method, apparatus and system |
-
2015
- 2015-04-14 CN CN201520224400.0U patent/CN204496485U/en active Active
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105610530A (en) * | 2015-12-25 | 2016-05-25 | 航天恒星科技有限公司 | Satellite data acquisition and analysis method and system |
| CN105610530B (en) * | 2015-12-25 | 2021-02-23 | 航天恒星科技有限公司 | Satellite data acquisition and analysis method and system |
| CN106649140A (en) * | 2016-12-29 | 2017-05-10 | 深圳前海弘稼科技有限公司 | Data processing method, apparatus and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE102009037984B4 (en) | Memory unit for a hierarchical memory architecture | |
| CN107025069B (en) | Data path control for non-volatile memory | |
| CN101446924B (en) | Method and system for storing and obtaining data | |
| US20170308329A1 (en) | Methods and Systems for Processing PRP/SGL Entries | |
| US9792052B2 (en) | Nonvolatile memory interface for metadata shadowing | |
| US9411519B2 (en) | Implementing enhanced performance flash memory devices | |
| CN108874688B (en) | Message data caching method and device | |
| US20160180900A1 (en) | Implementing dram row hammer avoidance | |
| US10895991B2 (en) | Solid state device with improved sustained data writing speed | |
| TWI512609B (en) | Methods for scheduling read commands and apparatuses using the same | |
| CN103049220A (en) | Storage control method, storage control device and solid-state storage system | |
| CN101848135B (en) | Management method and management device for statistical data of chip | |
| KR20220045548A (en) | Command Draining Using Host Memory Buffer | |
| CN204496485U (en) | A kind of I/O assisted access device based on high-speed data acquisition storage system | |
| US20200089609A1 (en) | Data storage system with write back cache | |
| CN103778120A (en) | Global file identification generation method, generation device and corresponding distributed file system | |
| CN104239232A (en) | Ping-Pong cache operation structure based on DPRAM (Dual Port Random Access Memory) in FPGA (Field Programmable Gate Array) | |
| US20180174624A1 (en) | Memory component with adjustable core-to-interface data rate ratio | |
| CN110232029B (en) | Method for realizing DDR4 packet cache in FPGA based on index | |
| CN103514140B (en) | For realizing the reconfigurable controller of configuration information multi-emitting in reconfigurable system | |
| CN109375868B (en) | Data storage method, scheduling device, system, equipment and storage medium | |
| CN102637148B (en) | DDR SDRAM (double data rate synchronous dynamic random-access memory) based stacked data caching device and method thereof | |
| CN103577349B (en) | Select the method and apparatus that data carry out brush in the caches | |
| US20200073595A1 (en) | Flash memory controller capable of improving IOPS performance and corresponding method | |
| CN104461967B (en) | It is a kind of to support synchronous and asynchronous transfer mode parallel data grabbing card |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |