CN104102724A - Video monitoring data based write-in method - Google Patents
Video monitoring data based write-in method Download PDFInfo
- Publication number
- CN104102724A CN104102724A CN201410349100.5A CN201410349100A CN104102724A CN 104102724 A CN104102724 A CN 104102724A CN 201410349100 A CN201410349100 A CN 201410349100A CN 104102724 A CN104102724 A CN 104102724A
- Authority
- CN
- China
- Prior art keywords
- data
- write
- chinese ink
- file system
- brush dipped
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
Abstract
The invention discloses a video monitoring data based write-in method. The video monitoring data based write-in method includes steps of S10, optimizing the system, determining how many channels of data are written each second and how many channels of data are left in a cache; S11, establishing a file system alignment model, utilizing a chunk mechanism in a file system, aligning raid bands to chunks of the file system when the file system is created, wherein all blocks in each band are included in the same file system, the same channel of videos keeps writing only when data size reaches the set one, and the data size is the one generated by the channel of the videos within a write-in period. Aiming at monitoring characteristics of videos, the video monitoring data based write-in method provides a write-in model for optimization of video monitoring storage performance so as to improve data write-in performance.
Description
Technical field
The invention belongs to computer systems technology field, relate to a kind of wiring method based on video monitoring data.
Background technology
In field of storage because often there is write performance problem slowly in the difference of specific environment using, and a kind of storage to want to meet the write performance of all situations be more difficult.In order to meet the demand of real world applications, storage manufacturer tends to carry out for sector application feature the exploitation of special storage products.Wherein, video storage is exactly a typical example.Video storage is mainly a class storage products of developing for Video Surveillance Industry, and this product requirement meets high concurrent, and large flow, stores for real time data for a long time.Due to the now raising of Video Supervision Technique, monitor video also have SD progressively to high definition development, that is to say that tremendous growth will appear in each road video code flow of video monitoring, normally increase at double of this growth, by 1M, 2M becomes 4M or 8M.Because video manufacturer is unwilling too much to drop into too much cost in storage, so they wish to use a storage to reach performance requirement, that is to say, in the time that the sharpness of camera improves, in the nondecreasing situation of way of camera, the write performance of storage must significantly improve.
But it is a systems engineering that write performance improves, and relates to buffer memory, writes with a brush dipped in Chinese ink file system, logical volume, raid, the technology of the every aspects such as disk.And these technology must and environment for use match, this is also IO tuning effect difficulty very.
Visible, to exist for above-mentioned currently available technology problem, is necessary to develop research in fact, so that a kind of scheme to be provided, improves the write performance of data.
Summary of the invention
For addressing the above problem, the object of the present invention is to provide a kind of wiring method based on video monitoring data, video monitoring storage IO performance is optimized, to improve the write performance of data.
For achieving the above object, technical scheme of the present invention is:
Based on a wiring method for video monitoring data, comprise the steps:
S10, carry out system optimization, determine per secondly write with a brush dipped in Chinese ink in how many circuit-switched data and buffer memory to leave how many circuit-switched data;
S11, set up file system alignment model, file system is used bulk mechanism, and in the time that file system creates, raid band aligns with the bulk of file system, and in each band all are included in the bulk of same file system;
S11, set up file system alignment model, wherein, same road video is only just down write with a brush dipped in Chinese ink when data volume reaches the data volume of setting, and this data volume is exactly that a road video writes with a brush dipped in Chinese ink at one the data volume producing in the middle of the cycle.
Further, in step S10, write with a brush dipped in Chinese ink thread and can write with a brush dipped in Chinese ink for each road video, set up the cycle of writing with a brush dipped in Chinese ink and write with a brush dipped in Chinese ink way relational model, calculate the data volume of writing with a brush dipped in Chinese ink of every road video.
Further, in step S11, when bulk creates, if there is the capacity of a file system bulk of the inadequate establishment of remaining raid band, remaining band will give up automatically, and file system will not read and not write residue band.
Further, in step S11, the data volume of brushing under the video of same road is the maximum integer times that sets data volume; If if same road video is greater than the data volume of setting, write with a brush dipped in Chinese ink also and will only write with a brush dipped in Chinese ink the data that set that first produce, unnecessary is retained in buffer memory continuing; If the data volume of same road video in buffer memory is the integral multiple of lower brush setting data amount just, all data of Ze Gai road video all will be brushed into disk completely in this moment.
Further, in step S11, write with a brush dipped in Chinese ink thread and safeguard each road video data queue in buffer memory, the data block corresponding to fixed size in buffer memory of each in queue;
Compared to prior art, a kind of wiring method based on video monitoring data of the present invention, for video monitoring feature, is optimized proposition one to video monitoring memory property and writes model, to improve the write performance of data.
Brief description of the drawings
Fig. 1 is flow process diagram of the present invention.
Fig. 2 is that the present invention sets up file system alignment model diagram.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearer, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.
As shown in Figure 1, a kind of wiring method based on video monitoring data of the present invention, comprises the steps:
S10, carry out system optimization, determine per secondly write with a brush dipped in Chinese ink in how many circuit-switched data and buffer memory to leave how many circuit-switched data;
Particularly, writing with a brush dipped in Chinese ink thread can write with a brush dipped in Chinese ink for each road video, sets up the cycle of writing with a brush dipped in Chinese ink and writes with a brush dipped in Chinese ink way relational model, calculates the data volume of writing with a brush dipped in Chinese ink of every road video, enactment document system has bulk writing mechanism, and the lucky Yu Mei of each blocks of data road video to write with a brush dipped in Chinese ink data volume identical; Make raid5 system, wherein, the piece of Raid aligns with the piece of logical volume.
Yi400 road 2Mb/s code stream, the buffer memory of user's application is that 300MB is that example describes, for 400 road 2Mb/s code streams, because the buffer memory of user's application only has 300MB, if do not write with a brush dipped in Chinese ink, user cache is only with filling up in 3s.If in writing with a brush dipped in Chinese ink state, if also will finally there is frame losing lower than the speed of writing with a brush dipped in Chinese ink of 100MB in average per second.According to requirement above, can set up as drag:
1) writing with a brush dipped in Chinese ink thread can write with a brush dipped in Chinese ink for each road video;
2) setting every road video, to write with a brush dipped in Chinese ink the cycle be T;
3) set the way N writing with a brush dipped in Chinese ink in per second;
4) foundation is write with a brush dipped in Chinese ink the cycle and write with a brush dipped in Chinese ink way relational model has: within T time second, need to write with a brush dipped in Chinese ink 400 road videos, have N*T=400; Data volume within the T time in buffer memory is 300MB, and every road video flowing is middle 0.25MB/s per second, has 0.25N(1+2++T)=300;
5) calculate N=80, T=5;
6) data volume of writing with a brush dipped in Chinese ink that calculates every road video is 1.25MB;
7) suppose that file system has bulk writing mechanism, and the lucky 1.25MB of each blocks of data;
8) set each blocks of data and just take 2 raid bands, each stripe size 640K, according to raid5 system, if every dish chunksize is set as 64KB, this can use 11 dishes to make raid5 system;
9) piece of Raid and the piece of logical volume align;
10) in order to be cached with certain surplus, can expand user's space on this basis, such as 400MB or 500MB.
S11, set up file system alignment model
File system is used bulk mechanism, if the band of the bulk of file system and raid does not line up, will waste a large amount of cpu bandwidth, in the time that file system creates, need to align with the bulk of file system to realizing raid band, this alignment refers to that the bulk of file system layer just comprises a n power raid band of 2 for this reason.In each band all are included in the bulk of same file system.As shown in Figure 2, a file system blocks comprises 4 raid bands.When bulk creates, if there is the capacity of a file system bulk of the inadequate establishment of remaining raid band, remaining band will give up automatically, and file system will not read and not write residue band.
Model is write with a brush dipped in Chinese ink in S12, foundation
Model is write with a brush dipped in Chinese ink in foundation, and wherein, same road video is only just down write with a brush dipped in Chinese ink when data volume reaches the data volume of setting, and this data volume is exactly that a road video writes with a brush dipped in Chinese ink at one the data volume producing in the middle of the cycle.If if same road video is greater than the data volume of setting, write with a brush dipped in Chinese ink also and will only write with a brush dipped in Chinese ink the data that set that first produce, unnecessary is retained in buffer memory continuing.If the data volume of same road video in buffer memory is the integral multiple of lower brush setting data amount just, all data of Ze Gai road video all will be brushed into disk completely in this moment.The data volume of brushing under the video of same road in a word, must be the maximum integer times that sets data volume.Write with a brush dipped in Chinese ink thread and safeguard each road video data queue in buffer memory, the data block corresponding to fixed size in buffer memory of each in queue.Piece in user cache is also set fixing size completely, and user's video thread is all the data block of application fixed size at every turn.While writing with a brush dipped in Chinese ink, the way of writing with a brush dipped in Chinese ink p.s. can be greater than the way of calculating, but the data volume of every road video must be under each road video, to brush the integral multiple of data volume.
The present invention can reduce the IO number of concurrent in each second, lowers disk I/O fluctuation, reduces disk pressure.For the data volume of lower brush in each second (such as: 100MB), little for raid system pressure.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, all any amendments of doing within the spirit and principles in the present invention, be equal to and replace and improvement etc., within all should being included in protection scope of the present invention.
Claims (5)
1. the wiring method based on video monitoring data, is characterized in that, comprises the steps:
S10, carry out system optimization, determine per secondly write with a brush dipped in Chinese ink in how many circuit-switched data and buffer memory to leave how many circuit-switched data;
S11, set up file system alignment model, file system is used bulk mechanism, and in the time that file system creates, raid band aligns with the bulk of file system, and in each band all are included in the bulk of same file system;
S11, set up file system alignment model, wherein, same road video is only just down write with a brush dipped in Chinese ink when data volume reaches the data volume of setting, and this data volume is exactly that a road video writes with a brush dipped in Chinese ink at one the data volume producing in the middle of the cycle.
2. the wiring method based on video monitoring data as claimed in claim 1, it is characterized in that: in step S10, writing with a brush dipped in Chinese ink thread can write with a brush dipped in Chinese ink for each road video, sets up the cycle of writing with a brush dipped in Chinese ink and writes with a brush dipped in Chinese ink way relational model, calculates the data volume of writing with a brush dipped in Chinese ink of every road video.
3. the wiring method based on video monitoring data as claimed in claim 2, it is characterized in that: in step S11, when bulk creates, if there is the capacity of a file system bulk of the inadequate establishment of remaining raid band, remaining band will give up automatically, and file system will not read and not write residue band.
4. the wiring method based on video monitoring data as claimed in claim 3, is characterized in that: in step S11, the data volume of brushing under the video of same road be set data volume maximum integer doubly; If if same road video is greater than the data volume of setting, write with a brush dipped in Chinese ink also and will only write with a brush dipped in Chinese ink the data that set that first produce, unnecessary is retained in buffer memory continuing; If the data volume of same road video in buffer memory is the integral multiple of lower brush setting data amount just, all data of Ze Gai road video all will be brushed into disk completely in this moment.
5. the wiring method based on video monitoring data as claimed in claim 3, is characterized in that: in step S11, write with a brush dipped in Chinese ink thread and safeguard each road video data queue in buffer memory, the data block corresponding to fixed size in buffer memory of each in queue.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410349100.5A CN104102724A (en) | 2014-07-22 | 2014-07-22 | Video monitoring data based write-in method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410349100.5A CN104102724A (en) | 2014-07-22 | 2014-07-22 | Video monitoring data based write-in method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104102724A true CN104102724A (en) | 2014-10-15 |
Family
ID=51670878
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410349100.5A Pending CN104102724A (en) | 2014-07-22 | 2014-07-22 | Video monitoring data based write-in method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104102724A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104811646A (en) * | 2015-05-15 | 2015-07-29 | 电子科技大学 | Multi-video streaming data concurrent modulation and buffer storage method based on continuous storage model |
| CN105824580A (en) * | 2016-03-18 | 2016-08-03 | 福州瑞芯微电子股份有限公司 | Writing method of video files and recording equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101727299A (en) * | 2010-02-08 | 2010-06-09 | 北京同有飞骥科技有限公司 | RAID5-orientated optimal design method for writing operation in continuous data storage |
| CN201797568U (en) * | 2010-12-01 | 2011-04-13 | 北京同有飞骥科技股份有限公司 | Energy-saving disk array-based video monitoring system |
| CN102063270A (en) * | 2010-12-28 | 2011-05-18 | 成都市华为赛门铁克科技有限公司 | Write operation method and device |
| CN102096558A (en) * | 2011-01-20 | 2011-06-15 | 杭州华三通信技术有限公司 | Data storage method and device |
| CN102185929A (en) * | 2011-06-02 | 2011-09-14 | 杭州华三通信技术有限公司 | Storage area network (SAN)-resource-based video monitoring data storage method and device |
| CN102682012A (en) * | 2011-03-14 | 2012-09-19 | 成都市华为赛门铁克科技有限公司 | Method and device for reading and writing data in file system |
| CN102722340A (en) * | 2012-04-27 | 2012-10-10 | 华为技术有限公司 | Data processing method, apparatus and system |
-
2014
- 2014-07-22 CN CN201410349100.5A patent/CN104102724A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101727299A (en) * | 2010-02-08 | 2010-06-09 | 北京同有飞骥科技有限公司 | RAID5-orientated optimal design method for writing operation in continuous data storage |
| CN201797568U (en) * | 2010-12-01 | 2011-04-13 | 北京同有飞骥科技股份有限公司 | Energy-saving disk array-based video monitoring system |
| CN102063270A (en) * | 2010-12-28 | 2011-05-18 | 成都市华为赛门铁克科技有限公司 | Write operation method and device |
| CN102096558A (en) * | 2011-01-20 | 2011-06-15 | 杭州华三通信技术有限公司 | Data storage method and device |
| CN102682012A (en) * | 2011-03-14 | 2012-09-19 | 成都市华为赛门铁克科技有限公司 | Method and device for reading and writing data in file system |
| CN102185929A (en) * | 2011-06-02 | 2011-09-14 | 杭州华三通信技术有限公司 | Storage area network (SAN)-resource-based video monitoring data storage method and device |
| CN102722340A (en) * | 2012-04-27 | 2012-10-10 | 华为技术有限公司 | Data processing method, apparatus and system |
Non-Patent Citations (2)
| Title |
|---|
| 孙志卓等: "连续数据存储中面向RAID５的写操作优化设计", 《计算机研究与发展》 * |
| 李元章等: "Ｓ－RAID５：一种适用于顺序数据访问的节能磁盘阵列", 《计算机学报》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104811646A (en) * | 2015-05-15 | 2015-07-29 | 电子科技大学 | Multi-video streaming data concurrent modulation and buffer storage method based on continuous storage model |
| CN104811646B (en) * | 2015-05-15 | 2018-07-24 | 电子科技大学 | The storage method of the modulation of multiple video strems Data Concurrent and buffering based on Coutinuous store model |
| CN105824580A (en) * | 2016-03-18 | 2016-08-03 | 福州瑞芯微电子股份有限公司 | Writing method of video files and recording equipment |
| CN105824580B (en) * | 2016-03-18 | 2018-11-02 | 福州瑞芯微电子股份有限公司 | Video file write method and recording arrangement |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10754550B2 (en) | Optimized data placement for individual file accesses on deduplication-enabled sequential storage systems | |
| CN102301349B (en) | Accessing stripping rows of data in storage chips controlled by storage controller | |
| CN102799534B (en) | Based on storage system and method, the cold and hot data identification method of solid storage medium | |
| WO2018019119A1 (en) | Method and device for dynamic partial-parallel data layout for continuous data storage | |
| CN102023809B (en) | Storage system, method for reading data from storage system and method for writing data to storage system | |
| CN104484130A (en) | Construction method of horizontal expansion storage system | |
| CN102902709B (en) | The document storage system of a kind of fixed space distribution and implementation method | |
| CN103823728B (en) | A kind of method of raid-array Intelligent Reconstruction | |
| CN105893184B (en) | A kind of incremental backup method and device | |
| CN103034562A (en) | Meta data handling within a flash media controller | |
| KR20140042458A (en) | File management device of storage system and file management method thereof | |
| CN105205126A (en) | Storage method and storage system for map tiles | |
| KR20140050941A (en) | Method for managing data in non-volatile memory device | |
| CN104461387A (en) | Method for improving reading property of solid-state hard disk for no mapping region | |
| CN105224473A (en) | The update method that a kind of solid state hard disc is data cached and device | |
| CN103713973A (en) | Mixed storage backup method and system based on HDD and SSD | |
| CN102243615B (en) | Memory buffer management method supporting audio/video frame storage | |
| CN103645862B (en) | A kind of disk array initializes performance boost method | |
| CN104102724A (en) | Video monitoring data based write-in method | |
| CN101599167B (en) | Access method of memory | |
| CN102685436A (en) | Storage method employing scalable video coding technical design | |
| CN109375868B (en) | Data storage method, scheduling device, system, equipment and storage medium | |
| CN103514140B (en) | For realizing the reconfigurable controller of configuration information multi-emitting in reconfigurable system | |
| CN104811646B (en) | The storage method of the modulation of multiple video strems Data Concurrent and buffering based on Coutinuous store model | |
| CN106897440B (en) | File read-write processing method for distributed file system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20141015 |
|
| WD01 | Invention patent application deemed withdrawn after publication |