CN102883143A - Method for regulating RAID (Redundant Array Of Independent Disks) array cache - Google Patents
Method for regulating RAID (Redundant Array Of Independent Disks) array cache Download PDFInfo
- Publication number
- CN102883143A CN102883143A CN2012103555455A CN201210355545A CN102883143A CN 102883143 A CN102883143 A CN 102883143A CN 2012103555455 A CN2012103555455 A CN 2012103555455A CN 201210355545 A CN201210355545 A CN 201210355545A CN 102883143 A CN102883143 A CN 102883143A
- Authority
- CN
- China
- Prior art keywords
- array
- raid
- raid array
- rate information
- storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a method for regulating RAID (Redundant Array Of Independent Disks) array caches. The method is applied to network storage equipment in a video monitoring network, wherein the monitoring network comprises a plurality of pieces of front-end encoding equipment; and the network storage equipment comprises more than two RAID arrays and a cache for being shared by the RAID arrays. The method comprises the following steps of: receiving encoding rate information of video channels of the front-end encoding equipment, wherein the encoding rate information comprise code rate information on each storage logic unit corresponding to each video channel; inquiring the RAID array corresponding to each storage logic unit; respectively calculating the total code rate corresponding to each RAID array; and according to the total code rate of each RAID array, regulating the size of the cache distributed for each RAID array according to a certain proportion. By the technology adopted by the invention, the aim of reasonably distributing according to the actual monitoring service condition in the process of writing the caches into the RAID arrays is fulfilled, so that the performance of the storage equipment is further played.
Description
Technical field
The present invention relates to field of video monitoring, relate in particular to the storage of video data.
Background technology
The storage of using IPSAN to carry out monitor data in supervisory control system at present is a kind of very popular way.The IP network of crossing the data communication device of camera stores among the SAN, when the user need to check historical video recording, reads the video recording data and check from IPSAN.A kind of typical networking such as Fig. 1.The headend equipment of video monitoring system, store at the lower memory device that is transferred to the rear end of (such as the video management server VM, data management server DM) of supervisory control system server management control by IP network after with video data encoding such as encoder EC or web camera IPC.
IPSAN forms the RAID array with a plurality of hard disks, then array partition is become a series of logic storage unit LUN, again LUN is distributed to application apparatus (such as the encoding device in the supervisory control system) by the ISCSI agreement and stores.Encoding device writes data to process such as the Fig. 2 on the IPSAN.As the initiator of ISCSI agreement, EC writes data into first the target command queue as the memory device of target, stores the data of command queue into Raid again and writes buffer memory, brushes physical disk under the data in this buffer memory the most at last.
RAID has promoted the write performance of memory device to a certain extent, has promoted simultaneously the reliability of the data.But the writing rate of present limited physical hard disk is (far below the writing rate of RAM, especially at random write), after data arrival RAID writes buffer memory, by cache module the fragmentary data of receiving is reassembled into large data block, brush down again physical hard disk, write so that physical hard disk carries out order as far as possible.Therefore how effectively to utilize RAID to write the data that cache resources will determine whole memory device and write index.RAID array on the IPSAN is write buffer memory at present, according to each RAID array mean allocation.But the service conditions under the varying environment on each RAID array differs, and causes writing buffer memory and can not take full advantage of in each array, causes the performance of memory device can't obtain maximum performance.
Summary of the invention
The invention provides a kind of method of the RAID of adjustment array buffer memory, the method is applied on the network storage equipment in the video surveillance network, wherein this monitor network comprises some front end encoding devices, the described network storage equipment comprises two above RAID arrays and the buffer memory of sharing for each RAID array, the method comprises the encoder bit rate information of receiving front-end encoding device video channel, and this code rate information comprises the code rate information on each storage logical units corresponding to each video channel; Inquire about the RAID array corresponding with each storage logical units; Calculate respectively total bitrate corresponding to each RAID array; Adjust in proportion the cache size that each RAID array distributes according to the total bitrate of each RAID array.
When inquiring a storage logical units and correspond to two or more RAID arrays, when calculating RAID array total bitrate, with the code check of this storage logical units code check as each RAID array in two or more RAID arrays.
This encoder bit rate information is that memory device gets access to by the management server in the described video surveillance network.
The present invention also provides a kind of device of the RAID of adjustment array buffer memory, on the network storage equipment of this application of installation in video surveillance network, wherein this monitor network comprises some front end encoding devices, the described network storage equipment comprises two above RAID arrays and the buffer memory of sharing for each RAID array, described device comprises: the code check acquisition module, be used for obtaining the encoder bit rate information of front end encoding device video channel, this code rate information comprises the code rate information on each storage logical units corresponding to each video channel; Array code check computing module is used for calculating respectively total bitrate corresponding to each RAID array behind the inquiry RAID array corresponding with each storage logical units; The buffer memory distribution module,, be used for adjusting in proportion the cache size that each RAID array distributes according to the total bitrate of each RAID array.
This array code check computing module is used for when inquiring a storage logical units and correspond to two or more RAID arrays, when calculating RAID array total bitrate, with the code check of this storage logical units code check as each RAID array in two or more RAID arrays.
The management server that this code check acquisition module is further used for from described video surveillance network obtains described encoder bit rate information.
Beneficial effect of the present invention: realized that by the technology of the present invention the RAID array writes the purpose that buffer memory rationally distributes according to the actual monitored service conditions, thereby so that the performance of memory device has obtained larger performance.
Description of drawings
Fig. 1 is a kind of supervisory control system network diagram.
Fig. 2 is EC data write storage device process exemplary plot.
Fig. 3 is a kind of adjustment of the present invention RAID array buffer storage module map.
Embodiment
Below introduce in detail the embodiment of the invention.
Step 11, third party's front end watch-dog access DA, DA obtains the coded message of the video channel of front end watch-dog by SDK or ONVIF agreement.
The third party device here refers to the front end watch-dog that can not directly access the current video supervisory control system of other manufacturers produce, such as encoder EC etc.
When using ONVI F agreement to obtain the coded message of headend equipment, can directly use " GetVideEncode Configurations Command " order to obtain the coded message of each video channel of encoding device.Except the ONVIF agreement, can obtain with the mode of SDK aforementioned coded message.
The coded message of the video channel of front end watch-dog comprises: the information such as encoder bit rate, coded format and resolution.
Step 12, DA are each video channel configuration store resource and storage plan, and safeguard coded message for each video channel.
Storage resources mainly comprises the size of memory space.Distribute the 1TB memory space such as giving each road video channel.
Storage plan mainly comprised the time of carrying out Video Data Storage, such as uninterrupted storage in 24 hours; The storage of operating time 8 hour daytime.
Storage resources and storage plan are when arranging for each road video image, if the front end watch-dog has a plurality of video channels, such as a plurality of camera access encoders, DA need to be each camera corresponding video channel configuration store resource and storage plan.
DA is at the information table of local maintenance video channel.Such as the example of table 1, this list item comprises: the video channel name, and to the code check that the video of this video channel is encoded, storage resources information.
| The passage name | Code check | Storage Target | Storage LUN |
| CameraA | 2048 | Target1 | 1 |
| CameraB | 2048 | Target1 | 2 |
| CameraC | 4096 | Target2 | 1 |
| CameraD | 8192 | Target2 | 2 |
Table 1
Step 13, DA push storage resources information to VM.
DA need to be linked into monitoring server VM and push related resource information to VM.
Take DB33(Zhejiang Province provincial standard) as example, use SIP that resource supplying during to VM, in the SDP field, is added storage Target, LUN and code check attribute as follows:
| SDP | a=target：Target1 a=LUN：1 a=BitRate：2048 |
In this SDP field, Target information is shown as Target1, LUN information is shown as LUN1, and code rate information is 2048.
Step 14, VM receive and extract storage information when DA pushes resource.
VM is take target as index, the storage information that converges as shown in table 2.This storage information comprises the encoder bit rate of each video channel that each logic storage unit LUN is corresponding.
Table 2
Step 15, VM send to DM with storage information, are transmitted to memory device by DM.
In the supervisory control system of not distinguishing VM and DM, directly the management server by supervisory control system sends to memory device with storage information.
The encoder bit rate information of step 16, memory device receiving front-end encoding device video channel, this code rate information comprise the code rate information on each storage logical units LUN corresponding to each video channel.
Step 17, the inquiry RAID array corresponding with each storage logical units.
Step 18, calculate total bitrate on each RAID array respectively.
Step 19, adjust in proportion the cache size that each RAID array is assigned to according to the total bitrate of each RAID array.
As shown in table 3, the encoder bit rate information that memory device receives comprises: the code rate information that the storage logical units LUN1 of Target1 is corresponding is that code rate information corresponding to the LUN2 of 2048, Target1 also is 2048; The code rate information that the storage logical units LUN1 of Target2 is corresponding is that code rate information corresponding to the LUN2 of 4096, Target2 is 8192.
Determine after the memory device inquiry: the RAID array under the LUN1 of Target1 is array 1, and the RAID array under the LUN2 of Target1 is array 2; RAID array under the LUN1 of Target2 is array 2, and the RAID array under the LUN2 of Target2 is array 3.
Table 3
Memory device calculates the total bitrate on each RAID array, and the total bitrate of array 1 is 2048+2048=4096, and the total bitrate of array 2 is 4096; The total bitrate of array 3 is 8192.Referring to table 4.
| Array | Corresponding total bitrate |
| Array 1 | 4096 |
| Array 2 | 4096 |
| Array 3 | 8192 |
Table 4
Because the ratio of the total bitrate that the ratio of the buffer memory that each array needs and each array are corresponding is consistent, so the ratio of the buffer memory that each array (array 1, array 2, array 3) needs is: 4096:4096:8192, i.e. 1:1:2.When total buffer memory of distributing to array when memory device is 1GB, cache size such as table 5 that each array is assigned to.
| Array | Corresponding total bitrate | Distribute cache size |
| Array 1 | 4096 | 256MB |
| Array 2 | 4096 | 256MB |
| Array 3 | 8192 | 512MB |
Table 5
Storage logical units LUN in the above-mentioned example does not stride the RAID array, if when storage logical units occurs striding the situation of RAID array, and the code check of this LUN total bitrate corresponding to each array of striding video channel of needing to comprise that this LUN is corresponding then.
Storage logical units LUN2 such as Target2 strides array 2 and array 3, such as table 6:
Table 6
Memory device calculates each array corresponding total bitrate such as table 7:
| Array | Corresponding total bitrate |
| Array 1 | 4096 |
| Array 2 | 12288 |
| Array 3 | 8192 |
Table 7
Total buffer memory that memory device is distributed to the RAID array is in the situation of 1GB, after the buffer memory adjustment that each array obtains such as table 8:
| Array | Corresponding total bitrate | Distribute cache size |
| Array 1 | 4096 | 170MB |
| Array 2 | 12288 | 512MB |
| Array 3 | 8192 | 342MB |
Table 8
Can learn according to above embodiment, realize that the RAID array writes taking full advantage of of buffer memory, just need the rear end memory device to know the encoder bit rate information of front end watch-dog, distribute according to need to writing buffer memory according to encoder bit rate information and associated storage resource information again, can be fully utilized so that write buffer memory.
In the above-described embodiments, be with third party's monitoring frontend access DA, the supervisory control system that accesses again the video monitoring center is that coded message and the associated storage resource information how example is introduced the front end watch-dog is delivered to memory device.For other supervisory control system, can design according to actual conditions the transmittance process of coded message and associated storage resource.
Adjust the method for RAID array buffer memory based on memory device, the applicant provides a kind of device of correspondence, and this device can be realized by computer program.Certainly, do not get rid of by hardware directly realize or software and hardware in conjunction with situation about realizing.
Ginseng Fig. 3, the device of this adjustment RAID array buffer memory comprises code check acquisition module, array code check computing module and buffer memory distribution module.Wherein, the code check acquisition module, for the encoder bit rate information of obtaining front end encoding device video channel, this code rate information comprises the code rate information on each storage logical units corresponding to each video channel; Array code check computing module is used for calculating respectively total bitrate corresponding to each RAID array behind the inquiry RAID array corresponding with each storage logical units; The buffer memory distribution module is used for adjusting in proportion the cache size that each RAID array distributes according to the total bitrate of each RAID array.
This array code check computing module is when inquiring a storage logical units and correspond to two or more RAID arrays, when calculating RAID array total bitrate, with the code check of this storage logical units code check as each RAID array in two or more RAID arrays.
The above only is preferred embodiment of the present invention, and is in order to limit the present invention, within the spirit and principles in the present invention not all, any modification of making, is equal to replacement, improvement etc., all should be included within the scope of protection of the invention.
Claims (6)
1. method of adjusting RAID array buffer memory, the method is applied on the network storage equipment in the video surveillance network, wherein this monitor network comprises some front end encoding devices, the described network storage equipment comprises two above RAID arrays and the buffer memory of sharing for each RAID array, it is characterized in that:
The encoder bit rate information of receiving front-end encoding device video channel, this code rate information comprise the code rate information on each storage logical units corresponding to each video channel;
Inquire about the RAID array corresponding with each storage logical units;
Calculate respectively total bitrate corresponding to each RAID array;
Adjust in proportion the cache size that each RAID array distributes according to the total bitrate of each RAID array.
2. the method for claim 1, it is characterized in that, when inquiring a storage logical units and correspond to two or more RAID arrays, when calculating RAID array total bitrate, with the code check of this storage logical units code check as each RAID array in two or more RAID arrays.
3. the method for claim 1 is characterized in that, described encoder bit rate information is that memory device gets access to by the management server in the described video surveillance network.
4. device of adjusting RAID array buffer memory, on the network storage equipment of this application of installation in video surveillance network, wherein this monitor network comprises some front end encoding devices, the described network storage equipment comprises two above RAID arrays and the buffer memory of sharing for each RAID array, it is characterized in that, described device comprises:
The code check acquisition module, for the encoder bit rate information of obtaining front end encoding device video channel, this code rate information comprises the code rate information on each storage logical units corresponding to each video channel;
Array code check computing module is used for calculating respectively total bitrate corresponding to each RAID array behind the inquiry RAID array corresponding with each storage logical units;
The buffer memory distribution module is used for adjusting in proportion the cache size that each RAID array distributes according to the total bitrate of each RAID array.
5. device as claimed in claim 4, it is characterized in that, described array code check computing module is used for when inquiring a storage logical units and correspond to two or more RAID arrays, when calculating RAID array total bitrate, with the code check of this storage logical units code check as each RAID array in two or more RAID arrays.
6. device as claimed in claim 4 is characterized in that, the management server that described code check acquisition module is further used for from described video surveillance network obtains described encoder bit rate information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210355545.5A CN102883143B (en) | 2012-09-21 | 2012-09-21 | A kind of method adjusting RAID array buffer memory |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210355545.5A CN102883143B (en) | 2012-09-21 | 2012-09-21 | A kind of method adjusting RAID array buffer memory |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102883143A true CN102883143A (en) | 2013-01-16 |
| CN102883143B CN102883143B (en) | 2016-06-08 |
Family
ID=47484262
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210355545.5A Active CN102883143B (en) | 2012-09-21 | 2012-09-21 | A kind of method adjusting RAID array buffer memory |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102883143B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104133782A (en) * | 2014-07-04 | 2014-11-05 | 深圳英飞拓科技股份有限公司 | Adaptive management method and device of digital monitoring platform memory |
| WO2017059716A1 (en) * | 2015-10-09 | 2017-04-13 | 中兴通讯股份有限公司 | Method and device for redundant arrays of independent disks to share write cache |
| CN107333169A (en) * | 2017-06-30 | 2017-11-07 | 郑州云海信息技术有限公司 | A kind of client-cache method of adjustment and device |
| CN109327680A (en) * | 2018-09-21 | 2019-02-12 | 北京世纪东方国铁科技股份有限公司 | Multi-path video data concurrently stores and read method |
| CN112631524A (en) * | 2020-12-29 | 2021-04-09 | 杭州海康汽车软件有限公司 | Storage medium distribution method and device and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060224784A1 (en) * | 2005-04-04 | 2006-10-05 | Akira Nishimoto | Storage system providing stream-oriented performance assurance |
| CN101135994A (en) * | 2007-09-07 | 2008-03-05 | 杭州华三通信技术有限公司 | Method and apparatus for dividing cache space and cache controller thereof |
| CN101566933A (en) * | 2009-06-11 | 2009-10-28 | 成都市华为赛门铁克科技有限公司 | Method and device for configurating cache and electronic equipment and data read-write equipment |
| CN102185929A (en) * | 2011-06-02 | 2011-09-14 | 杭州华三通信技术有限公司 | Storage area network (SAN)-resource-based video monitoring data storage method and device |
-
2012
- 2012-09-21 CN CN201210355545.5A patent/CN102883143B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060224784A1 (en) * | 2005-04-04 | 2006-10-05 | Akira Nishimoto | Storage system providing stream-oriented performance assurance |
| CN101135994A (en) * | 2007-09-07 | 2008-03-05 | 杭州华三通信技术有限公司 | Method and apparatus for dividing cache space and cache controller thereof |
| CN101566933A (en) * | 2009-06-11 | 2009-10-28 | 成都市华为赛门铁克科技有限公司 | Method and device for configurating cache and electronic equipment and data read-write equipment |
| CN102185929A (en) * | 2011-06-02 | 2011-09-14 | 杭州华三通信技术有限公司 | Storage area network (SAN)-resource-based video monitoring data storage method and device |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104133782A (en) * | 2014-07-04 | 2014-11-05 | 深圳英飞拓科技股份有限公司 | Adaptive management method and device of digital monitoring platform memory |
| CN104133782B (en) * | 2014-07-04 | 2017-08-22 | 深圳英飞拓科技股份有限公司 | A kind of digital supervision platform internal memory adaptive management method and device |
| WO2017059716A1 (en) * | 2015-10-09 | 2017-04-13 | 中兴通讯股份有限公司 | Method and device for redundant arrays of independent disks to share write cache |
| CN106569728A (en) * | 2015-10-09 | 2017-04-19 | 中兴通讯股份有限公司 | Processing method and device for shared write cache of redundant arrays of independent disks (RAIDs) |
| CN106569728B (en) * | 2015-10-09 | 2021-02-23 | 中兴通讯股份有限公司 | Processing method and device for sharing write cache by multiple disk arrays RAID (redundant array of independent disks) |
| CN107333169A (en) * | 2017-06-30 | 2017-11-07 | 郑州云海信息技术有限公司 | A kind of client-cache method of adjustment and device |
| CN107333169B (en) * | 2017-06-30 | 2020-03-06 | 郑州云海信息技术有限公司 | Client cache adjusting method and device |
| CN109327680A (en) * | 2018-09-21 | 2019-02-12 | 北京世纪东方国铁科技股份有限公司 | Multi-path video data concurrently stores and read method |
| CN112631524A (en) * | 2020-12-29 | 2021-04-09 | 杭州海康汽车软件有限公司 | Storage medium distribution method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102883143B (en) | 2016-06-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10001944B2 (en) | Systems and methods for data organization in storage systems using large erasure codes | |
| US9104719B2 (en) | Storing data and metadata in a distributed storage network | |
| CN102883143A (en) | Method for regulating RAID (Redundant Array Of Independent Disks) array cache | |
| US9560133B2 (en) | Acquiring multi-media content | |
| CN108881942B (en) | Super-fusion normal state recorded broadcast system based on distributed object storage | |
| CN102291256B (en) | A kind of querying method of monitor data and equipment | |
| US9251050B2 (en) | Apparatus and method for resource alerts | |
| US10448062B2 (en) | Pre-fetching media content to reduce peak loads | |
| CN103209210B (en) | Method for improving erasure code based storage cluster recovery performance | |
| CN101644996A (en) | Storage method of index data and storage control device | |
| CN101488104A (en) | System and method for implementing high-efficiency security memory | |
| CN104919430A (en) | Real-time classification of data into data compression domains | |
| US11743316B2 (en) | Utilizing key assignment data for message processing | |
| CN104811646B (en) | The storage method of the modulation of multiple video strems Data Concurrent and buffering based on Coutinuous store model | |
| Ferner et al. | Toward sustainable networking: Storage area networks with network coding | |
| CN104301671A (en) | Traffic monitoring video storing method in HDFS based on event intensity | |
| CN102314322B (en) | Data processing method and device based on RAID (redundant array of independent disks) | |
| US10360106B2 (en) | Throttled real-time writes | |
| CN107229573B (en) | Elastic high-availability caching method based on solid state disk | |
| US11720256B2 (en) | Maximizing power savings using IO monitoring | |
| US20190056865A1 (en) | Intelligent Redundant Array of Independent Disks | |
| CN106998436B (en) | Video backup method and device | |
| CN104159058A (en) | Efficient method capable of realizing simultaneous video recording of multi-way media streams | |
| Qiang et al. | A Hyper-converged video management system based on object storage | |
| CN204650521U (en) | A kind of TB DBMS library storage system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |