CN101923578B - File-type high-speed data stream access device and method thereof - Google Patents
File-type high-speed data stream access device and method thereof Download PDFInfo
- Publication number
- CN101923578B CN101923578B CN2010102764948A CN201010276494A CN101923578B CN 101923578 B CN101923578 B CN 101923578B CN 2010102764948 A CN2010102764948 A CN 2010102764948A CN 201010276494 A CN201010276494 A CN 201010276494A CN 101923578 B CN101923578 B CN 101923578B
- Authority
- CN
- China
- Prior art keywords
- data
- file
- speed
- flash
- primary memory
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a file-type high-speed data flow access device which comprises a data acquisition interface, a buffer, a flash control interface, an IDE interface, a flash memory, a data block counter and a nonvolatile memory, wherein, an input terminal of the data acquisition interface is connected with high-speed data flow, and an output terminal of the data acquisition interface is connected with the buffer; the flash control interface stores data in the buffer to the flash memory; the data block counter stores the number of data blocks in the nonvolatile memory; and the IDE interface reads out the data in the flash memory to a main memory in a file block format. The invention realizes real-time storage and high-speed file processing of the high-speed information data flow, andpeople only need to access or unload the high-speed data flow by a file read-write mode without additional preprocessing when in application, thus saving time, improving efficiency, strengthening performances of an embedded computer system, and having the characteristics of fast speed, good stability and the like. The invention further discloses a file-type high-speed data flow access method.
Description
Technical field
The present invention relates to a kind of storage and transmission of stream-oriented file, particularly relate to a kind of file-type high-speed data stream access device and method.
Background technology
Along with the high speed development and the application thereof of infotech are deeply extensive day by day, people handle and transmit fast bulky information storage, robotization and have higher requirement.But when prior art is stored high speed information, can not carry out documentation to it and handle, therefore people will face the number of complex data when using; Treatment capacity is big; Efficient is low, and if by force data are carried out documentation and handle, then can not realize data are at a high speed carried out real-time storage; Promptly when high-speed data is stored, can not take into account the requirement of documentation and real-time two aspects.Simplification when solving storage of real time property and the artificial treatment of above-mentioned high-speed data-flow is present high-speed data-flow storage, handle and important topic that transmission faces.
Summary of the invention
Goal of the invention of the present invention is to overcome the deficiency of prior art; A kind of file-type high-speed data stream access device and method are provided; Realize the real-time storage and the high speed documentation processing of high speed information data stream; So that people need not do extra pre-service to it when using these a large amount of, complicated high speed information data, only need operate getting final product to single file.
Goal of the invention of the present invention realizes through following technical scheme: the file-type high-speed data stream access device; It comprises data acquisition interface, impact damper, FLASH control interface, ide interface, FLASH storer, data block count device and nonvolatile memory; The input of data acquisition interface connects high-speed data-flow; Its output is connected to impact damper; The FLASH control interface will be after buffer buffers high-speed data-flow be that block unit writes in the FLASH storer by 512 bytes; The data block count device is that unit calculating deposits the data block number in the FLASH storer in the data block, and deposits the data block number in nonvolatile memory, and ide interface reads out to primary memory with the data in the FLASH storer with the blocks of files form.
The figure place of described FLASH storer is 16,32 or 64.The memory capacity of FLASH storer can increase or reduce number of chips as required and reach the total volume requirement, generally at 16G～100G.Usually, each chip is 8 a data width, and the highway width of the data stream in the time of can operating FLASH according to concrete application decision generally is 16,32,64, with meeting the requirements of data width after the parallel connection of 8 chips of monolithic of varying number.
The principle of work of file-type high-speed data stream access device of the present invention is: high-speed data-flow is that block unit writes in the FLASH by 512 bytes after through the acquisition interface collection, and the data block count device adds in the lump the content write non-volatile memory with counter simultaneously.The data access process is only carried out the FLASH read-write operation and is not had other operating influence like this, so the speed of record only depends on the read or write speed of FLASH, to reach the purpose of high speed storing.
File-type high-speed data flow access, it comprises a data record and two steps of data unloading, wherein:
Described data recording step comprises data acquisition, data buffering, data storage and data block count substep; Data acquisition receives high-speed data-flow; Data buffering carries out speed buffering to the data that receive; Matched data is gathered and the output storage speed, and data storage will deposit the FLASH storer in through the data of buffering, and data block count is calculated the data block number that deposits the FLASH storer in.
Described data unloading step comprises that the FLASH data read, file encapsulates and the file transfer substep; The FLASH data read and will be stored in the FLASH storer data read through ide interface and go into primary memory; File encapsulation will be kept at according to the file layout of setting that packing data becomes file in the primary memory, and file transfer is sent to target ground through the transmission mode of setting.
Wherein, described file encapsulation step comprises following substep:
(1) in primary memory, distributes one section primary memory space, supply partitions of file table and file directory to use;
(2) in the primary memory space, carry out division operation, the primary memory space and FLASH space are formed a virtual ATA equipment, and in primary memory space spanned file lead schedule;
(3) carry out format manipulation behind the subregion again, in the primary memory space, form the catalogue listing of empty partitions of file table and sky according to the size of ATA equipment;
(4), begin the chained list that fills up a document from the reference position of partitions of file table according to the file linked list format, last piece that is write down up to the last pointed FLASH storer of file chained list according to the count value of nonvolatile memory recorded data piece;
(5), fill in the reference position pointer of file size, modification date and the partitions of file table of catalogue listing, and fill in the filename of this document according to the count value of nonvolatile memory recorded data piece;
(6) formed a complete file structure in the virtual A TA equipment, this document structure has comprised all data messages that write down, and can pass through network or USB with file transfer to main frame or other equipment.
The invention has the beneficial effects as follows the real-time storage and the processing of documentation at a high speed that have realized the high speed information data stream; Be convenient to people and when using these a large amount of, complicated high speed information data, need do not do extra pre-service it; Only need or unload these high-speed data-flows, save the time, improve efficient according to the file read-write mode access; Strengthen the performance of embedded computer system, and had characteristics such as speed is exceedingly fast, good stability.
Description of drawings
Fig. 1 is the composition frame chart of data recording process of the present invention
Fig. 2 is the composition frame chart of data uninstall process of the present invention
Fig. 3 is the process flow diagram of high-speed data-flow reception of the present invention, storage and documentation
Fig. 4 is the process flow diagram of file encapsulation of the present invention.
Embodiment
Further describe technical scheme of the present invention below in conjunction with accompanying drawing: like Fig. 1; The file-type high-speed data stream access device; It comprises data acquisition interface, impact damper, FLASH control interface, FLASH storer, data block count device, nonvolatile memory and ide interface; The input of data acquisition interface connects high-speed data-flow, and its output is connected to impact damper, and the high-speed data-flow that the FLASH control interface will be after buffer buffers is that block unit writes in the FLASH storer by 512 bytes; The data block count device is that unit calculating deposits the data block number in the FLASH storer in the data block, and deposits the data block number in nonvolatile memory.
Like Fig. 2, file-type high-speed data stream access device of the present invention also comprises an ide interface, and ide interface reads out to primary memory with the data in the FLASH storer with the blocks of files form.Among Fig. 2, program FLASH preserves executable code of the present invention, calls in internal memory by CPU during operation, and described executable code mainly comprises the codes such as documentation processing of FLASH data.The high-speed data-flow of documentation can be offloaded to main frame or other destinations that needs through express network or USB mode.
The figure place of described FLASH storer is 32, selects the NAND FLASH chip of 8 2G bytes altogether for use, total volume 16G byte.
Like Fig. 3, file-type high-speed data flow access, it comprises a data record and two steps of data unloading, wherein:
Described data recording step comprises data acquisition, data buffering, data storage and data block count substep; Data acquisition receives high-speed data-flow; Data buffering carries out speed buffering to the data that receive; Matched data is gathered and the output storage speed, and data storage will deposit the FLASH storer in through the data of buffering, and data block count is calculated the data block number that deposits the FLASH storer in.
Described data unloading step comprises that the FLASH data read, file encapsulates and the file transfer substep; The FLASH data read through ide interface and read; File encapsulation will be kept at according to the file layout of setting that packing data becomes file in the primary memory, and file transfer is sent to target ground through the transmission mode of setting.
Like Fig. 4, described file encapsulation step comprises following substep:
(1) in primary memory, distributes one section primary memory space, supply partitions of file table and file directory to use;
(2) in the primary memory space, carry out division operation, the primary memory space and FLASH space are formed a virtual ATA equipment, and in primary memory space spanned file lead schedule;
(3) carry out format manipulation behind the subregion again, in the primary memory space, form the catalogue listing of empty partitions of file table and sky according to the size of ATA equipment;
(4), begin the chained list that fills up a document from the reference position of partitions of file table according to the file linked list format, last piece that is write down up to the last pointed FLASH storer of file chained list according to the count value of nonvolatile memory recorded data piece;
(5), fill in the reference position pointer of file size, modification date and the partitions of file table of catalogue listing, and fill in the filename of this document according to the count value of nonvolatile memory recorded data piece;
(6) formed a complete file structure in the virtual A TA equipment, this document structure has comprised all data messages that write down.
Present embodiment reaches the 200M byte per second through the test data writing speed, and main frame is through the formed log file of 100Mbps network offload.
Claims (1)
1. file-type high-speed data stream access device; It is characterized in that: it comprises data acquisition interface, impact damper, FLASH control interface, ide interface, FLASH storer, data block count device and nonvolatile memory; The input of data acquisition interface connects high-speed data-flow; Its output is connected to impact damper, and the high-speed data-flow that the FLASH control interface will be after buffer buffers is that block unit writes in the FLASH storer by 512 bytes, and the data block count device is unit count with the data block; And depositing the data block number in nonvolatile memory, ide interface reads out to primary memory with the data in the FLASH storer with the blocks of files form.
2
.File-type high-speed data stream access device according to claim 1 is characterized in that: the figure place of described FLASH storer is 16,32 or 64.
3
.File-type high-speed data flow access is characterized in that: it comprises a data record and two steps of data unloading, wherein:
Described data recording step comprises data acquisition, data buffering, data storage and data block count substep; Data acquisition receives high-speed data-flow; Data buffering carries out speed buffering to the data that receive; Matched data is gathered and the output storage speed, and data storage will deposit the FLASH storer in through the data of buffering, and data block count is calculated the data block number that deposits the FLASH storer in;
Described data unloading step comprises that the FLASH data read, file encapsulates and the file transfer substep; The FLASH data read and will be stored in the FLASH storer data read through ide interface and go into primary memory; File encapsulation will be kept at according to the file layout of setting that packing data becomes file in the primary memory, and file transfer is sent to target ground through the transmission mode of setting.
4
.File-type high-speed data flow access according to claim 3 is characterized in that: described file encapsulation step comprises following substep:
(1) in primary memory, distributes one section primary memory space, supply partitions of file table and file directory to use;
(2) in the primary memory space, carry out division operation, the primary memory space and FLASH space are formed a virtual ATA equipment, and in primary memory space spanned file lead schedule;
(3) carry out format manipulation behind the subregion again, in the primary memory space, form the catalogue listing of empty partitions of file table and sky according to the size of ATA equipment;
(4), begin the chained list that fills up a document from the reference position of partitions of file table according to the file linked list format, last piece that is write down up to the last pointed FLASH storer of file chained list according to the count value of nonvolatile memory recorded data piece;
(5), fill in the reference position pointer of file size, modification date and the partitions of file table of catalogue listing, and fill in the filename of this document according to the count value of nonvolatile memory recorded data piece;
(6) formed a complete file structure in the virtual A TA equipment, this document structure has comprised all data messages that write down.
5
.File-type high-speed data flow access according to claim 3 is characterized in that: described file transfer mode comprises Network Transmission mode, USB transmission mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102764948A CN101923578B (en) | 2010-09-09 | 2010-09-09 | File-type high-speed data stream access device and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102764948A CN101923578B (en) | 2010-09-09 | 2010-09-09 | File-type high-speed data stream access device and method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101923578A CN101923578A (en) | 2010-12-22 |
| CN101923578B true CN101923578B (en) | 2012-07-25 |
Family
ID=43338511
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010102764948A Expired - Fee Related CN101923578B (en) | 2010-09-09 | 2010-09-09 | File-type high-speed data stream access device and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101923578B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6694317B1 (en) * | 1997-12-31 | 2004-02-17 | International Business Machines Corporation | Method and apparatus for high-speed access to and sharing of storage devices on a networked digital data processing system |
| CN101156129A (en) * | 2005-04-15 | 2008-04-02 | 汤姆森许可贸易公司 | Method and system for storing logical data blocks into flash-blocks in multiple non-volatile memories which are connected to at least one common data i/o bus |
| CN101430634A (en) * | 2007-11-06 | 2009-05-13 | 孙国仲 | Memory device |
-
2010
- 2010-09-09 CN CN2010102764948A patent/CN101923578B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6694317B1 (en) * | 1997-12-31 | 2004-02-17 | International Business Machines Corporation | Method and apparatus for high-speed access to and sharing of storage devices on a networked digital data processing system |
| CN101156129A (en) * | 2005-04-15 | 2008-04-02 | 汤姆森许可贸易公司 | Method and system for storing logical data blocks into flash-blocks in multiple non-volatile memories which are connected to at least one common data i/o bus |
| CN101430634A (en) * | 2007-11-06 | 2009-05-13 | 孙国仲 | Memory device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101923578A (en) | 2010-12-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8370544B2 (en) | Data storage system with compression/decompression | |
| US8495332B2 (en) | Controller for optimizing throughput of read operations | |
| CN105103137B (en) | The compression and formatting of the data of data-storage system | |
| CN105074676B (en) | Multiple streams of the data of data-storage system are compressed and are formatted | |
| CN110069442A (en) | A kind of ultra-high-speed data acquisition device and method based on ZYNQ Series FPGA | |
| KR20120015313A (en) | Memory controllers, memory systems, solid state drivers and methods for processing a number of commands | |
| KR20120098505A (en) | Efficient buffering for a system having non-volatile memory | |
| CN110069443B (en) | UFS storage array system based on FPGA control and data transmission method | |
| CN101986305A (en) | File system operating method and communication device | |
| US20110258372A1 (en) | Memory device, host device, and memory system | |
| CN104126177A (en) | System and method for pre-interleaving sequential data | |
| KR20170111883A (en) | The apparatus and method of smart storage platfoam for efficient storage of big data | |
| CN109857679A (en) | The operating method of Memory Controller, storage system and storage system | |
| CN1304957C (en) | Method for improving compute system disc synchronous writing property based on movable memory | |
| CN102479549A (en) | Semiconductor storage device | |
| CN102981783A (en) | Cache accelerating method based on Nand Flash | |
| CN107111562A (en) | Live load self-adapting data packing algorithm | |
| US20200264811A1 (en) | A SD card-based high-speed data storage method | |
| CN108628542A (en) | A kind of Piece file mergence method and controller | |
| CN103309621B (en) | Read the method for data in sectional compression bag | |
| CN102520892A (en) | Multifunctional solid state data storage playback instrument | |
| CN102129476B (en) | Application of virtual file system by utilizing ZIP compression format | |
| CN110069557A (en) | Data transmission method, device, equipment and storage medium | |
| CN104461966B (en) | A kind of data buffer storage transmission method and its controller based on Nand Flash chips | |
| CN101923578B (en) | File-type high-speed data stream access device and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP03 | Change of name, title or address |
Address after: 610041, No. 2, No. 3, 22-31 floor, No. 1366, Tianfu Road, Chengdu hi tech Development Zone, Sichuan Patentee after: CHENGDU LATEST ELECTRONIC TECHNOLOGY CO., LTD. Address before: 611730 Sichuan Chengdu hi tech Development Zone West entrepreneurship Service Center Patentee before: Chengdu Latest Electronic Technology Co., Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120725 Termination date: 20180909 |