CN102968360B - There is storage system and the method for N+1 redundancy feature - Google Patents

There is storage system and the method for N+1 redundancy feature Download PDF

Info

Publication number
CN102968360B
CN102968360B CN201210494172.XA CN201210494172A CN102968360B CN 102968360 B CN102968360 B CN 102968360B CN 201210494172 A CN201210494172 A CN 201210494172A CN 102968360 B CN102968360 B CN 102968360B
Authority
CN
China
Prior art keywords
storage
redundancy
plan
video
memory device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201210494172.XA
Other languages
Chinese (zh)
Other versions
CN102968360A (en
Inventor
郭中磊
陈维强
苑希强
黄玉平
王玮
刘微
裴雷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Hisense Network Technology Co Ltd
Original Assignee
Qingdao Hisense Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Hisense Network Technology Co Ltd filed Critical Qingdao Hisense Network Technology Co Ltd
Priority to CN201210494172.XA priority Critical patent/CN102968360B/en
Publication of CN102968360A publication Critical patent/CN102968360A/en
Application granted granted Critical
Publication of CN102968360B publication Critical patent/CN102968360B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The invention discloses a kind of storage system and the method with N+1 redundancy feature, described system comprises video camera, memory device and storage forwarding server, storage forwarding server receives the video code flow of video camera transmission and is stored to memory device, described memory device comprises N number of memory device and a redundant storage devices, and described storage forwarding server comprises: forwarding cache module, memory management module, redundancy handover module, redundancy recover module and data backup module.The present invention efficiently solves the situation that memory device damage rear video is lost in a large number.The automated back-up of data during redundancy, ensure that the data integrity after redundancy recovery and clog-free follow-up redundancy switch.Plan protection when redundancy switches and recovers, ensure that system is normally run.Code stream buffer memory during forwarding, ensure that video storage when redundancy switches and recovers is not lost, guarantees the lossless storage of system.

Description

There is storage system and the method for N+1 redundancy feature
Technical field
The present invention relates to a kind of video monitoring and technical field of video storage, specifically, relate to a kind of storage system with N+1 redundancy feature.
Background technology
along with the development of high definition IP video camera, the application of network high-definition monitoring becomes the important directions of development; Along with the continuous expansion of video monitoring scale, can not check all video camera real-time videos, history video becomes the significant data of Video Surveillance Industry simultaneously.Simultaneously along with the increase of monitoring quantity, memory capacity also will increase rapidly, for large-scale history video data, how ensure the complete of video data and will ensure that the picture quality of video data seems equally important.
In existing Video Storage System, mostly depend on the RAID of IP-SAN array support, HotSpare disk and timed backup and carry out data security protecting; But the data of its protection are the historical data stored, and do not have protection for imminent data.Carry out video storage because array needs are round-the-clock, after repeatedly reading and writing for a long time, once IP-SAN array breaks down, subsequent video data will be caused to lose.The video data lost before maintainer finds and repairs cannot be given for change, and the major event occurred during this period also cannot be reviewed, thus the massive losses caused.
The existing video monitoring system based on energy-saving disk array, video storage modules adopts the energy-saving disk array being suitable for continuous data and storing; Meet mass memory and the data protection demand of video monitoring system.Though overcome the round-the-clock concurrent working of ordinary magnetic disc, cause the shortcoming that energy consumption is high and the disk life-span is short, after disk array is broken down, there is no redundancy process, video data can be lost after causing trouble.
Also have a kind of data back up method and device thereof, be applied to video monitoring system, after data backup task starts, described video monitoring data, after the video monitoring data receiving scrambler transmission, is write writing buffer memory and reading buffer memory of described memory device by memory device respectively; Memory device receives reading data that video management server sends with after the request carrying out data backup, and the data read in buffer memory send to video management server to carry out data backup.Although video monitoring system data backup performance can be improved, after disk array is broken down, there is no redundancy process, video data can be lost after causing trouble.
Summary of the invention
The invention provides a kind of storage system with N+1 redundancy feature, solve the technical matters of video data loss when memory device breaks down in existing video storage process.
In order to solve the problems of the technologies described above, the present invention is achieved by the following technical solutions:
A kind of storage system with N+1 redundancy feature, comprise video camera, memory device and storage forwarding server, storage forwarding server receives the video code flow of video camera transmission and is stored to memory device, described memory device comprises N number of memory device and a redundant storage devices, and described storage forwarding server comprises:
Forwarding cache module, for receiving the video code flow that video camera sends, the code stream of reception carries out forwarding and buffer memory according to specified format;
Memory management module, for the storage of the configuration of storage plan, execution and video; In storage plan implementation, detect implementation status, if plan change, restart plan, and detect the fault in storing process in real time, fault is reported monitor supervision platform;
Redundancy handover module, for logical volume analysis during storage device failure and judgement, starts redundancy and switches, notify that memory management module switches to redundant storage devices during switching when logical volume fault exceedes threshold value;
Redundancy recovers module, for returning to original memory device after faulty equipment reparation;
Data backup module, when switching for redundancy and recover, the video data in backup forwarding cache, the video data simultaneously when switching during standby redundancy.
Preferably, described memory device is the IP-SAN network storage equipment.
Based on the above-mentioned storage system with N+1 redundancy feature, the invention allows for a kind of storage means with N+1 redundancy feature, described method comprises the steps:
Step 201, configuration forwards code stream, and forwarding cache module receives the video code flow that video camera sends, and carries out forwarding and buffer memory;
Step 202, configuration store plan, memory management module stores according to storage plan, detects implementation of the plan in real time, restarts plan time abnormal;
Step 203, memory management module detects storage device failure, reports monitor supervision platform in time after detection failure, simultaneously statistic logic volume damaged condition, determines that logical volume damages ratio;
Step 204, logical volume damages when ratio exceedes threshold value and starts redundancy handover module, switches to redundant storage devices;
Step 205, after failing storage device is repaired, issues new storage plan to the memory device repaired, deletes the back-up plan of redundant storage devices simultaneously;
Step 206, backs up data cached when switching or recover, the data simultaneously during standby redundancy.
Further, in described step 201, after user configures and forwards code stream, whether forwarding cache module detects code stream legal, if legal, open up buffer zone and carries out buffer memory and forward code stream.
Further, in described step 202, after configuration store plan, whether memory management module detects logical volume and can use, if available, stores; Detect during storage and whether extremely to store, if store abnormal, record trouble information; Also storage plan implementation status is followed the tracks of during storage, if plan change, restart plan.
Further, in described step 204, handoff procedure is as follows:
1), start redundancy switch after, redundant storage devices state is set to use, cause barrier storage device status be set to fault;
2), the storage plan read on original memory device, storage plan is backed up;
3), in redundant storage devices redistribute logical volume, the storage plan on amendment failing storage device, points to redundant storage devices by storage plan;
4), read share directory information, start the back-up plan of redundant storage devices.
Further, in described step 205, rejuvenation is as follows:
1), after failing storage device repairs, send redundancy and recover instruction, redundancy recovers the storage plan that module reads backup before redundancy;
2), revising storage plan, pointing to the memory device after repairing by storing;
3) back-up plan on redundance unit, is deleted;
4), by redundance unit be set to and do not use state, the memory device after reparation is set to using state again.
Further, in described step 206, data backup module reads share directory information, and by the data backup during redundancy to share directory, when switching being recovered, the data backup of buffer memory is to share directory.
Compared with prior art, advantage of the present invention and good effect are: the storage system with N+1 redundancy feature provided by the invention, efficiently solve the situation that memory device damage rear video is lost in a large number.The automated back-up of data during redundancy, ensure that the data integrity after redundancy recovery and clog-free follow-up redundancy switch.Plan protection when redundancy switches and recovers, ensure that system is normally run.Code stream buffer memory during forwarding, ensure that video storage when redundancy switches and recovers is not lost, guarantees the lossless storage of system.For the supervisory system of having disposed, only need to carry out storage system upgrading increase memory device, greatly reduce project reconstruction cost; For newly-built big-and-middle-sized video monitoring project, the cost only increasing a memory device but ensure that and substantially increases the integrality of video storage by the data integrity of history video.
After reading the detailed description of embodiment of the present invention by reference to the accompanying drawings, the other features and advantages of the invention will become clearly.
Accompanying drawing explanation
Fig. 1 is the system chart of the specific embodiment of the invention.
Fig. 2 is the block diagram of the storage forwarding server of the specific embodiment of the invention.
Fig. 3 is the process flow diagram of the specific embodiment of the invention.
Fig. 4 is the process flow diagram of specific embodiment of the invention step 201.
Fig. 5 is the process flow diagram of specific embodiment of the invention step 202.
Fig. 6 is the process flow diagram of specific embodiment of the invention step 204.
Fig. 7 is the process flow diagram of specific embodiment of the invention step 205.
Embodiment
Below in conjunction with accompanying drawing, the specific embodiment of the present invention is described in more detail:
Shown in Figure 1, the present embodiment proposes a kind of storage system with N+1 redundancy feature, comprise video camera, IP-SAN array and storage forwarding server, storage forwarding server receives the video code flow of video camera transmission and is stored to memory device, and memory device comprises N number of memory device and a redundant storage devices.
Formation and the effect of each several part are as follows:
Video camera: video can be transmitted through the network to the equipment of Surveillance center by general reference herein, and can be the combination of analog video camera and scrambler, also can be web camera.Camera video transmission mode is not limit, and clean culture, multicast, program request, Streaming Media forward.The effect of video camera is to gather head end video, carries out compression coding, and sent with the form of Streaming Media by video video.
IP-SAN array: the network storage equipment, is mainly used in depositing of video data, depositing of Backup Data.
Storage forwarding server: the core data processing unit of native system, adopt centralized management, distributed forwarding storage mode, support forwarding storage administration and the retrieval service of HD video and SD video, IP-SAN and the NAS memory device of support standard, can provide stable storage forwarding service and video frequency searching and the service of history video playback fast to client.
Wherein, video forwarding server comprises as lower module:
Forwarding cache module 110, for receiving the video code flow that video camera sends, the code stream of reception carries out forwarding and buffer memory according to specified format.
Memory management module 120, for the storage of the configuration of storage plan, execution and video; In storage plan implementation, automatically detect implementation status, plan change is restarted in time, and detects the fault in storing process in real time, fault is reported monitor supervision platform in time.
Redundancy handover module 130, for logical volume analysis during storage device failure and judgement, starts redundancy and switches when logical volume fault exceedes threshold value.Notify during switching that memory management module switches to redundant storage devices.
Redundancy recovers module 140, for returning to original memory device after faulty equipment reparation.
Data backup module 150, when switching for redundancy and recover, the video data in backup forwarding cache, the video data simultaneously when switching during standby redundancy.
In order to realize N+1 redundant storage system, this patent adopts video code flow to forward and buffer memory, redundancy switch data backup when recovering and the method for data cached backup.The method comprises following operation steps, see Fig. 3:
Step 201, user forwards page configuration forwarding information by real-time streams, mainly comprises code stream form, code stream type of receipt, code stream receiver address.After forwarding cache module detection code stream is legal, opens up buffer zone and carry out buffer memory and forward, buffer zone adopts circulation erase method to carry out, as shown in Figure 4.
Step 202, user, by the storage plan of storage plan administration interface configuration video camera, mainly comprises the logical volume of memory device, the user name logging in logical volume and password, storage number of days.Memory management module detects logical volume authority and capacity according to plan, and then receiving code stream stores; Detect during storage whether code stream interrupts, whether logical volume is abnormal, when breaking down, carry out record in time; Also storage plan implementation status is followed the tracks of during storage simultaneously, restarting in time during discovery plan change, ensure that arbitrary road video storage is not lost when planning switching especially, as shown in Figure 5.
Step 203, detecting IP-SAN array failure, reporting monitor supervision platform in time, to guarantee that maintainer understands storage system ruuning situation in time when breaking down; Statistic logic volume damaged condition simultaneously, analyzes and determines that logical volume damages ratio.
Step 204, logical volume damages when ratio exceedes threshold value and starts redundancy switching, as shown in Figure 6.
1), start redundancy switch after, redundance unit state is set to use, cause barrier array status be set to fault.
2), the storage plan read on original memory device, storage plan is backed up.
3), on redundance unit redistribute logical volume, the storage plan on amendment fault array, points to redundance unit by storage plan.
4), read NAS share directory information, start the back-up plan of redundance unit.
Step 205, after fault array is repaired, issues new storage plan to former array, deletes the back-up plan of redundance unit, as shown in Figure 7 simultaneously.
1), after maintainer repairs fault array, send redundancy and recover instruction, redundancy recovers the storage plan that module reads backup before redundancy.
2), revising storage plan, pointing to the array after repairing by storing.
3) back-up plan on redundance unit, is deleted.
4), by redundance unit be set to and do not use state, original equipment is set to using state again, guarantees follow-up redundancy detection and switch to carry out in time.
Step 206, backs up data cached when switching or recover, the data simultaneously during standby redundancy.
Backup module reads NAS share directory information, by the data backup during redundancy to NAS share directory.This process ensure that follow-up redundancy switches the loss of data that this redundancy can not be caused not out of date.
When switching recovers by backup module, the data backup of buffer memory is to NAS share directory.
Certainly; above-mentioned explanation is not limitation of the present invention; the present invention is also not limited in above-mentioned citing, the change that those skilled in the art make in essential scope of the present invention, remodeling, interpolation or replacement, also should belong to protection scope of the present invention.

Claims (4)

1. there is a storage means for N+1 redundancy feature, it is characterized in that: described method comprises the steps:
Step 201, configuration forwards code stream, and forwarding cache module receives the video code flow that video camera sends, and carries out forwarding and buffer memory;
Step 202, configuration store plan, memory management module stores according to storage plan, detects implementation of the plan in real time, restarts plan time abnormal;
Step 203, memory management module detects storage device failure, reports monitor supervision platform in time after detection failure, simultaneously statistic logic volume damaged condition, determines that logical volume damages ratio;
Step 204, logical volume damages when ratio exceedes threshold value and starts redundancy handover module, switches to redundant storage devices; Handoff procedure is as follows:
1), start redundancy switch after, redundant storage devices state is set to use, cause barrier storage device status be set to fault;
2), the storage plan read on original memory device, storage plan is backed up;
3), in redundant storage devices redistribute logical volume, the storage plan on amendment failing storage device, points to redundant storage devices by storage plan;
4), read share directory information, start the back-up plan of redundant storage devices;
Step 205, after failing storage device is repaired, issues new storage plan to the memory device repaired, deletes the back-up plan of redundant storage devices simultaneously; Rejuvenation is as follows:
1), after failing storage device repairs, send redundancy and recover instruction, redundancy recovers the storage plan that module reads backup before redundancy;
2), revising storage plan, pointing to the memory device after repairing by storing;
3) back-up plan on redundance unit, is deleted;
4), by redundance unit be set to and do not use state, the memory device after reparation is set to using state again;
Step 206, backs up data cached when switching or recover, the data simultaneously during standby redundancy.
2. the storage means with N+1 redundancy feature according to claim 1, it is characterized in that: in described step 201, after user configures and forwards code stream, whether forwarding cache module detects code stream legal, if legal, open up buffer zone and carry out buffer memory and forward code stream.
3. the storage means with N+1 redundancy feature according to claim 1, is characterized in that: in described step 202, and after configuration store plan, whether memory management module detects logical volume and can use, if available, stores; Detect during storage and whether extremely to store, if store abnormal, record trouble information; Also storage plan implementation status is followed the tracks of during storage, if plan change, restart plan.
4. the storage means with N+1 redundancy feature according to claim 1, it is characterized in that: in described step 206, data backup module reads share directory information, and by the data backup during redundancy to share directory, when switching being recovered, the data backup of buffer memory is to share directory.
CN201210494172.XA 2012-11-28 2012-11-28 There is storage system and the method for N+1 redundancy feature Active CN102968360B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210494172.XA CN102968360B (en) 2012-11-28 2012-11-28 There is storage system and the method for N+1 redundancy feature

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210494172.XA CN102968360B (en) 2012-11-28 2012-11-28 There is storage system and the method for N+1 redundancy feature

Publications (2)

Publication Number Publication Date
CN102968360A CN102968360A (en) 2013-03-13
CN102968360B true CN102968360B (en) 2015-08-05

Family

ID=47798513

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210494172.XA Active CN102968360B (en) 2012-11-28 2012-11-28 There is storage system and the method for N+1 redundancy feature

Country Status (1)

Country Link
CN (1) CN102968360B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103294574B (en) * 2013-06-25 2015-11-25 浙江宇视科技有限公司 A kind of apparatus and method realizing business bank switching fast
CN104699566B (en) * 2013-12-16 2018-01-19 杭州海康威视数字技术股份有限公司 Data redundancy backup method, system and memory node server based on cloud storage
CN106339297B (en) * 2016-09-14 2020-10-02 郑州云海信息技术有限公司 Method and system for real-time alarming of storage system fault
CN115442571A (en) 2016-09-23 2022-12-06 伊姆西Ip控股有限责任公司 Fault recovery method and device for video monitoring system
CN108509606A (en) * 2018-03-30 2018-09-07 湖南电灯泡信息技术服务有限公司 A kind of information technology teaching system based on big data
CN109491609B (en) * 2018-11-02 2022-04-22 郑州云海信息技术有限公司 Cache data processing method, device and equipment and readable storage medium
CN111787284A (en) * 2020-07-16 2020-10-16 济南浪潮数据技术有限公司 Data acquisition system
CN112911185B (en) * 2021-01-18 2022-10-18 浙江大华技术股份有限公司 Fault processing method and device for double-control equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101873462A (en) * 2009-08-07 2010-10-27 杭州海康威视数字技术股份有限公司 DVR (Digital Video Recorder) as well as data backup and recovery method and system thereof
CN101887351A (en) * 2010-06-22 2010-11-17 杭州华三通信技术有限公司 Fault-tolerance method and system for redundant array of independent disk
US8060630B1 (en) * 2002-11-27 2011-11-15 Symantec Operating Corporation Creating and configuring virtual fabrics in storage area networks
CN102723094A (en) * 2012-06-15 2012-10-10 杭州海康威视数字技术股份有限公司 High-reliability and easily-extensible video storage and retrieval method and system thereof

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8060630B1 (en) * 2002-11-27 2011-11-15 Symantec Operating Corporation Creating and configuring virtual fabrics in storage area networks
CN101873462A (en) * 2009-08-07 2010-10-27 杭州海康威视数字技术股份有限公司 DVR (Digital Video Recorder) as well as data backup and recovery method and system thereof
CN101887351A (en) * 2010-06-22 2010-11-17 杭州华三通信技术有限公司 Fault-tolerance method and system for redundant array of independent disk
CN102723094A (en) * 2012-06-15 2012-10-10 杭州海康威视数字技术股份有限公司 High-reliability and easily-extensible video storage and retrieval method and system thereof

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
基于IP-SAN的视频监控存储系统关键技术研究;何矩;《中国优秀硕士论文电子期刊网》;20111231;45-54 *
基于无线网络技术的数字视频监控系统;曹贝贞等;《计算机工程》;20070105(第01期);247-249 *

Also Published As

Publication number Publication date
CN102968360A (en) 2013-03-13

Similar Documents

Publication Publication Date Title
CN102968360B (en) There is storage system and the method for N+1 redundancy feature
CN102981931B (en) Backup method and device for virtual machine
CN101741536B (en) Data level disaster-tolerant method and system and production center node
CN102394774B (en) Service state monitoring and failure recovery method for controllers of cloud computing operating system
CN102033786B (en) Method for repairing consistency of copies in object storage system
CN102355368B (en) Fault processing method of network equipment and system
CN100426247C (en) Data recovery method
CN102752093B (en) Based on the data processing method of distributed file system, equipment and system
CN100525440C (en) Warm back-up method in use for video monitoring and controlling system
CN101097531A (en) Computer RAID array early-warning system and method
CN105430327A (en) NVR cluster backup method and device
CN102761615A (en) Method and device for realizing data synchronism of long-distance duplication system
CN105159795A (en) Data synchronization method, apparatus and system
CN102609327B (en) Method and device for improving reliability of multi-core processor
CN105335256A (en) Method, device and system for switching backup disks in complete cabinet server
CN104407940A (en) Method for quickly recovering CDP system
WO2014075586A1 (en) Method and device for automatically recovering storage of jbod array
WO2014114089A1 (en) Method and system for optimizing load balance of distributed file system
CN104615511A (en) Host batch recovery processing method and device based on double centers
CN102571845A (en) Data storage method and device of distributed storage system
CN103384266A (en) Parastor200 management node high availability method based on real-time synchronization at file level
CN102314322A (en) Data processing method and device based on RAID (redundant array of independent disks)
US20060212669A1 (en) Control method for storage system, storage system, storage control apparatus, control program for storage system, and information processing system
CN101714064A (en) Data access method and server
CN111240903A (en) Data recovery method and related equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant