CN107154966A - A kind of video data wiring method and device - Google Patents
A kind of video data wiring method and device Download PDFInfo
- Publication number
- CN107154966A CN107154966A CN201710272285.8A CN201710272285A CN107154966A CN 107154966 A CN107154966 A CN 107154966A CN 201710272285 A CN201710272285 A CN 201710272285A CN 107154966 A CN107154966 A CN 107154966A
- Authority
- CN
- China
- Prior art keywords
- memory node
- capacity
- memory
- video
- write
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of video data wiring method, previously according to the capacity weight of ratio setting each memory node of the specification capacity relative to the specification capacity sum of all memory nodes of each memory node, the subsequent memory space according to corresponding to the capacity weight of memory node distributes the catalogue with monitoring device on memory node, the quantity of the file write in every wheel video data write-in to memory node is arranged on according to capacity weight, using the quantity as memory node written document number, according to the maximum write-in way and the number of tasks of capacity weight distribution memory node of memory node, video data write-in is performed from catalogue to memory node finally according to number of tasks and written document number.So as to realize the balanced storage of video data between the memory node in different capabilities space, improve the adaptability of video monitoring storage system and reduce the extra work of technical staff.
Description
Technical field
The present invention relates to technical field of video monitoring, more particularly to a kind of video data wiring method.The present invention is gone back simultaneously
It is related to a kind of video data writing station.
Background technology
Video monitoring occupies more than half rivers and mountains in security protection industry, and it is mainly characterized by amount of image information greatly, so to storage
Space requirement is obvious.But video monitoring is stepped into high Qinghua epoch, and the intelligentized involvement of tight demand.For example, at present
High definition it is most basic be 720P, per hour video recording can be compressed to 3GB or so, it is probably 17T (17000G) to get off within one month.
The hundreds of even high-definition monitoring on thousands of roads in monitoring system, its huge video file produced pours into memory, in security protection video
In the case that definition is improved constantly and safety monitoring way is continuously increased, the storage problem of security protection industry is highlighted further.Yun Cun
Store up the important technology developed as security protection to support, the important technology support as video monitoring.
In video monitoring cloud storage, video recording/picture is merged and has retained period management, full covering is deleted, video index management
Deng complicated video surveillance applications, it should ensure that video/picture equilibrium is discrete as far as possible and be distributed on all cloud storage nodes,
Ensure single node again no more than the maximum performance specification allowed, therefore video monitoring cloud storage capacity equilibrium is that a comparison is answered
Miscellaneous work.
In order to realize video monitoring cloud storage capacity equilibrium, prior art protects the volume space that each node of cloud storage is provided
Hold consistent, poll writes each memory node when so writing video per road IPC (IP Camera, web camera), each
Node writes the file of formed objects.The file of each knot removal formed objects when full covering is deleted.
However, inventor has found during the present invention is realized, although the scheme of prior art simply and readily realizes,
But its key point realized is to ensure that all node capacity spaces are consistent, to realize that such configuration is relatively difficult, especially
When underlying resource is RAID (Redundant Arrays of Independent Disks, disk array) array, meeting
Configuration has more many disks, causes that whole scheme cost performance is not high, and dilatation is also inconvenient.
The content of the invention
, can not be in difference to solve video monitoring storage in the prior art the invention provides a kind of method for writing data
Disk between balanced data storage file technical problem, this method is applied to include monitoring device and multiple memory nodes
Video monitoring storage system in, previously according to specification of the specification capacity relative to all memory nodes of each memory node
The capacity weight of each memory node of ratio setting of capacity sum, this method also includes：
The catalogue institute with the monitoring device is distributed on the memory node according to the capacity weight of the memory node
Corresponding memory space；
The number of the file write in every wheel video data write-in to the memory node is arranged on according to the capacity weight
Amount, using the quantity as the memory node written document number；
The task of memory node according to the maximum write-in way of the memory node and the capacity weight distribution
Number, the number of tasks is not more than the general assignment number of the memory node；
The video counts are performed from the catalogue to the memory node according to the number of tasks and the written document number
According to write-in.
Preferably, the catalogue includes multiple video files, and the size of each video file is identical, according to the task
Several and described written document number performs the video data write-in from the catalogue to the memory node, is specially：
Epicycle was not carried out to the data write-in and the minimum memory node of number of tasks is as ingress to be written, according to institute
State the video file that the written document number of ingress to be written writes the catalogue to the ingress to be written, and after the completion of write-in after
It is continuous epicycle to be not carried out to the data write-in and the minimum memory node of number of tasks is used as new ingress to be written；
After all memory nodes write the once video file in epicycle, terminate the write-in of epicycle video data, and
Video data write-in described in a new round is performed in the case where the memory space of the memory node is not yet full.
Preferably, in addition to：
When the memory space of monitoring device arrival default retention phase or the memory node are expired, delete described
Remaining time exceedes the video file of default time threshold in memory node；
Or, when the memory space of monitoring device arrival default retention phase or the memory node are expired, according to
The order of remaining time from long to short, the quantity of memory node according to the video monitoring storage system and described is regarded
The size of frequency file deletes the video file in the memory node.
Preferably, in addition to：
After the video monitoring storage system adds new memory node, again according to the video monitoring storage system
In each memory node specification capacity it is each relative to the ratio setting of the specification capacity sum of all memory nodes it is described storage section
The capacity weight of point, and with the presence or absence of storage in the capacity weight judges the video monitoring storage system after setting completed
The full memory node in space.
Preferably, according to the specification capacity of each memory node relative to the specification capacity sum of all memory nodes
The capacity weight of each memory node of ratio setting, be specially：
Obtain the specification capacity that each memory node is reported；
It regard the specification capacity sum of all memory nodes as GREV capacity；
The specification capacity of each memory node ratio shared in total specification capacity is determined successively；
The capacity weight according to the ratio-dependent.
Correspondingly, the application also proposed a kind of video data writing station, the device be applied to comprising monitoring device with
And in the video monitoring storage system of multiple memory nodes, the device includes：
First setup module, previously according to specification of the specification capacity relative to all memory nodes of each memory node
The capacity weight of each memory node of ratio setting of capacity sum,
First distribute module, is distributed and the monitoring according to the capacity weight of the memory node on the memory node
Memory space corresponding to the catalogue of equipment；
Second setup module, is arranged in every wheel video data write-in according to the capacity weight and is write to the memory node
The quantity of the file entered, using the quantity as the memory node written document number；
Second distribute module, is deposited according to the maximum write-in way of the memory node and the capacity weight distribution
The number of tasks of node is stored up, the number of tasks is not more than the general assignment number of the memory node；
Writing module, institute is performed from the catalogue to the memory node according to the number of tasks and the written document number
State video data write-in.
Preferably, the catalogue includes multiple video files, and the size of each video file is identical, said write module
Specifically for：
Epicycle was not carried out to the data write-in and the minimum memory node of number of tasks is as ingress to be written, according to institute
State the video file that the written document number of ingress to be written writes the catalogue to the ingress to be written, and after the completion of write-in after
It is continuous epicycle to be not carried out to the data write-in and the minimum memory node of number of tasks is used as new ingress to be written；
After all memory nodes write the once video file in epicycle, terminate the write-in of epicycle video data, and
Video data write-in described in a new round is performed in the case where the memory space of the memory node is not yet full.
Preferably, in addition to：
Removing module, when the memory space that the monitoring device reaches default retention phase or the memory node is full
When, delete the video file that remaining time in the memory node exceedes default time threshold, or according to remaining time from length
To short order, the quantity of memory node according to the video monitoring storage system and the size of the video file
Delete the video file in the memory node.
Preferably, first setup module, is additionally operable to when the video monitoring storage system adds new memory node
Afterwards, again according to specification of the specification capacity relative to all memory nodes of each memory node in the video monitoring storage system
The capacity weight of each memory node of ratio setting of capacity sum, and judge described after setting completed in the capacity weight
With the presence or absence of the memory node that memory space is full in video monitoring storage system.
Preferably, first setup module specifically for：
Obtain the specification capacity that each memory node is reported；
It regard the specification capacity sum of all memory nodes as GREV capacity；
The specification capacity of each memory node ratio shared in total specification capacity is determined successively；
The capacity weight according to the ratio-dependent.
As can be seen here, by application the application technical scheme, previously according to each memory node specification capacity relative to
The capacity weight of each memory node of ratio setting of the specification capacity sum of all memory nodes, then according to the appearance of memory node
Amount weight distributes the memory space corresponding to the catalogue with monitoring device on memory node, and every wheel is arranged on according to capacity weight
The quantity of file write in video data write-in to memory node, using the quantity as memory node written document number, according to
The maximum write-in way and the number of tasks of capacity weight distribution memory node of memory node, finally according to number of tasks and write text
Number of packages performs video data write-in from catalogue to memory node.So as to be realized between the memory node in different capabilities space
The balanced storage of video data, improves the adaptability of video monitoring storage system and reduces the extra work of technical staff.
Brief description of the drawings
Fig. 1 is a kind of schematic flow sheet for video data wiring method that the application is proposed；
A kind of structural representation for video monitoring cloud storage system that Fig. 2 is proposed by the application specific embodiment；
Fig. 3 is the schematic diagram for the catalogue allocation space for being each video camera in the application specific embodiment；
Fig. 4 is a kind of structural representation for video data writing station that the application is proposed.
Embodiment
, should present applicant proposes a kind of video data wiring method in view of the technical problem proposed in background technology
It is different that scheme can allow for each node capacity space in video data storage systems, and can guarantee that on this basis video/
Picture file is still distributed to each node in a balanced way, to realize capacity equilibrium, while being no more than performance on each node
The maximum specification of permission.
Because this method is applied to comprising monitoring device, (these monitoring devices include front and rear in all kinds of field of video monitoring
End equipment) and the video monitoring storage system of multiple memory nodes in, in order to reach object above, the scheme of the application is advance
Each memory node of ratio setting according to the specification capacity of each memory node relative to the specification capacity sum of all memory nodes
Capacity weight, the abstract volume space ability provided each memory node with this is capacity weight.Each memory node
The specification capacity (i.e. maximum storable data volume) that capacity weight can accurately react the memory node accounts for video monitoring and deposited
The ratio of the specification capacity sum of all memory nodes in storage system.In a preferred embodiment of the invention, capacity weight
Determination mode it is as follows：
Step a) obtains the specification capacity that each memory node is reported；
Step b) regard the specification capacity sum of all memory nodes as GREV capacity；
Step c) determines the specification capacity of each memory node ratio shared in total specification capacity successively；
Step d) capacity weights according to the ratio-dependent.
As an example it is assumed that there are tri- different memory nodes of A, B, C, its specification capacity in video monitoring storage system
A, b, c respectively, in this specific embodiment, first memory node oneself report or active obtaining by way of determine this
The specification capacity of three memory nodes, determines the specification capacity sum a+b+c of all memory nodes on this basis, then A, B,
Tri- different memory nodes of C ratio shared in total specification capacity is respectively a/ (a+b+c), b/ (a+b+c) and c/ (a+
b+c).Ratio based on each memory node, technical staff can regard the concrete numerical value of each ratio as memory node correspondence
Capacity weight, or using the percent value of ratio as the corresponding capacity weight of memory node, these are all in the guarantor of the application
Within the scope of shield.
Illustrated with the embodiment in concrete application scene, it is false in video monitoring cloud storage system as shown in Figure 2
Provided with 3 CDV (Cloud Direct virtual, Yun Zhicun is virtual) memory node, 1T is provided respectively, and 3T, 4T storage is empty
Between (i.e. specification capacity), volume space ability that the specific embodiment of the application is provided CDV by following steps is abstract to hold
Measure weight：
There are a CDV clothes in CDS (Cloud Direct Storage, cloud is directly stored) system on each cloud storage node
Business, CDV services provide memory space service, and each CDV is serviced to be reported certainly to CDM (cloud directly deposits management server) management server
Oneself memory space ability (i.e. specification capacity).CDV1 reports the memory space service ability for oneself having 1TB, and CDV2 reports oneself
There is 3TB memory space service ability, CDV3 reports the memory space service ability for oneself having 4TB.Then CDM gives cloud storage node
1 assigns 0.125 (1/ (1+3+4)) capacity weight, and cloud storage node 2 assigns 0.375 capacity weight, and cloud storage node 3 is assigned
Give 0.5 capacity weight.In follow-up flow, the specific embodiment on each memory node allocated quota just according to total
Required memory space * capacity weights.
It should be noted that the determination mode and the form of expression of above capacity weight are only the preferred reality that the application is proposed
A scheme is applied, premise of the memory node relative to the capacity accounting of all memory nodes is accurately reflected enabling capacity weight
Under, the form of expression and acquisition modes of different capacity weight belong to the protection domain of the application.
It is based upon the capacity weight that each memory node is determined, a kind of video data wiring method such as Fig. 1 that the application is proposed
It is shown, specifically include following steps：
S101, the mesh with the monitoring device is distributed on the memory node according to the capacity weight of the memory node
The corresponding memory space of record.
There is a catalogue per road monitoring device, the storage size of the catalogue is for needed for the monitoring device within the retention phase
Memory space, the capacity weight based on each memory node, capacity weight is by technical scheme as memory node
The coefficient of the corresponding catalogue allocated quotas capacity of each monitoring device.Due to the different capacity power of different memory node correspondences
Weight, in order that data to be stored can be stored uniformly in the memory node of each different capabilities, the step is based on each depositing
The capacity weight of storage node determine respectively the data volume of each memory node storage number.
In the specific embodiment of the application, the step is in catalogue (catalogue for each video camera (i.e. monitoring device)
Contain multiple video files that monitoring device is gathered) allocation space when using capacity weight as coefficient, like this,
Each catalogue of monitoring device is equivalent to catalogue total capacity and capacity weight in the quota on capacity (i.e. memory space) of CDV nodes
The product of coefficient.The specific method of salary distribution is as shown in figure 3, the corresponding catalogue 1 of video camera 1 needs 100G memory spaces, 2 pairs of video camera
The catalogue 2 answered needs 200G memory spaces, and the corresponding catalogue 3 of video camera 3 needs 300G memory spaces.Present cloud storage system has
3 CDV nodes, node capacity space is different, and capacity weight is as previously described.According to the capacity weight of each memory node, CDV1
It is 12.5G to the quota on capacity that catalogue 1 is distributed, CDV2 is 37.5G to the quota on capacity that catalogue 1 is distributed, and CDV3 is distributed to catalogue 1
Quota on capacity be 50G.Catalogue 2 and catalogue 3 the like, it will not be repeated here.
S102, the file write in every wheel video data write-in to the memory node is arranged on according to the capacity weight
Quantity, using the quantity as the memory node written document number.
Due to the limitation of equipment performance, the needs that are completely written to of video data repeatedly carry out write-in behaviour to same memory node
Make.Because all video file sizes are fixed (video file i.e. in catalogue are all formed objects), in order to as far as possible discrete
Equilibrium, the application is identical with capacity weight to set each monitoring device to write file number on each memory node, so
Video file write-in number of times and capacity specifications ratio are just can guarantee that, especially by being arranged on during every wheel video data writes to storage
The quantity of the file of node write-in is realized.
Illustrated with specific embodiment, for by each memory node file ratio control coefficient range it
It is interior, the quantity of the file per secondary write-in can be set according to the size of single video file in catalogue, but each storage is saved
The ratio that the quantity for the file that point writes every time must be constituted with capacity weight is identical.For example, different memory nodes is direct
Capacity weight proportion be 1：3：4, then write to write every time on 1 file, CDV2 on CDV1 and write 4 every time on 3 files, CDV3
File.If not just multiple proportional, such as 1：1.1：1.2, then CDV1 writes every time writes 2 texts every time on 1 file, CDV2
The ratio that 2 files are write in the ratio control of part every time on 10%, CDV3 is controlled 20%.In specific application scenarios, skill
Art personnel can pass through capacity weight and construct a random function so that the ratio control of 1 file is write CDV2 10% more, with
And the ratio for writing 2 files on CDV3 every time is controlled 20%.
S103, the memory node according to the maximum write-in way of the memory node and the capacity weight distribution
Number of tasks, the number of tasks is not more than the general assignment number of the memory node.
Because the number of tasks on each memory node is not identical, but proportional to capacity weight, therefore it is
The number of tasks distributed on each memory node is no more than general assignment number, so as to ensure that the write-in way of each CDV nodes does not surpass
Cross node maximum performance specification, the capacity of actually node is directly proportional to way, such as the capacity weight of memory node
Ratio is 1：3：4, therefore be also 1 with the write-in way ratio corresponding to each memory node：3：4.
In the specific embodiment of the application, write-in way is corresponding with number of tasks., can when number of tasks is distributed
To be associated according to the actual write-in way of the node, such as CDV1 is 100 tunnels, and CDV2 is 300 tunnels, and CDV3 is 400 tunnels, then CDV1
Upper total number of tasks, which does not exceed the upper total number of tasks of 100, CDV2 and do not exceed the upper total number of tasks of 300, CDV3, not to be exceeded
400, according to this rule distribution write-in video file.
S104, performed according to the number of tasks and the written document number from the catalogue to the memory node described in regard
Frequency is according to write-in.
In order to realize that capacity load is balanced, while as keeping balanced per road monitoring device as possible discrete is distributed to each deposit
Store up on node, the technical scheme of the application is all storage by number of tasks at least in each data write operation of each round
Node is used as current storage device, but does not exceed number of tasks total on the CDV, and for same in same wheel
When User Catalog storage needs switching file, limit each memory node in video monitoring storage system and be merely able to be written into once.
Based on above-mentioned rule, video data write-in is accomplished by the following way in the preferred embodiment of the application：
Epicycle was not carried out to the data write-in and the minimum memory node of number of tasks is as ingress to be written, according to institute
State the video file that the written document number of ingress to be written writes the catalogue to the ingress to be written, and after the completion of write-in after
It is continuous epicycle to be not carried out to the data write-in and the minimum memory node of number of tasks is used as new ingress to be written；
After all memory nodes write the once video file in epicycle, terminate the write-in of epicycle video data, and
Video data write-in described in a new round is performed in the case where the memory space of the memory node is not yet full.
Correspondingly, in a particular embodiment, whenever CDM needs to filter out CDV based on mentioned above principle to store monitoring device
Catalogue when, can by CDV all under shared pool according to certain arrangement mode constitute a chained list, and for monitoring device come
Say, only take the gauge outfit of the chained list.Therefore, when arranging CDV chained lists, used CDV can not arrange gauge outfit in epicycle, and be not used
The CDV crossed sorts from less to more according to number of tasks, but no more than number of tasks total on the CDV.The chained list gauge outfit so constituted
Must be to be not used and CDV that number of tasks is minimum in epicycle.Therefore when the establishment new file for receiving monitoring device is asked,
CDM returns to the chained list, and the CDV that monitoring device need to only choose gauge outfit performs video data write-in.
For example, the corresponding catalogue 1 of video camera 1, when video camera writes video file, writes CDV1, CDV1 first
Write after a video file, be switched to CDV2 and continue written document, according to capacity ratio, write three files, then be switched to
CDV3, according to capacity ratio, writes four files, then be switched to next round.
It should be noted that the mode that above task based access control number and written document number perform video data write-in is only this Shen
The preferred embodiment please proposed, on the premise of write-in principle is followed, technical staff can be changed for write-in flow
Enter or extend, these belong to the protection domain of the application.
During the routine use of video monitoring system, the video file being stored in memory node has a preservation
In the time limit, because video file is all derived from the catalogue of monitoring device, therefore each monitoring device can retain the phase provided with one,
Whether the space in the retention phase and memory node, which is used up, contributes to determine the need for delete video text from memory node
The basis for estimation of part.
Based on described above, when some monitoring device corresponding retention phase has arrived or some memory node volume space is complete
Portion has been used up, and it is different (i.e. each that [z1] [MZ2] technical scheme completely covers deletion from capacity requirement identical CDV nodes
One oldest video file of knot removal), but start full covering and delete flow, why it is referred to as full covering and deletes flow,
It is because the deletion reaches being kept for monitoring device for specification capacity or the memory node only for some memory capacity
The video file time reaches the retention phase, and specific processing mode includes following two：
(1) when the memory space of monitoring device arrival default retention phase or the memory node are expired, delete
Remaining time exceedes the video file of default time threshold in the memory node.
Because each video file can record the corresponding write time while memory node is write, in the program
Under, remaining time of each video file in memory node directly can be determined according to the write time, then surpass remaining time
The video file for crossing time threshold is deleted.
(2) when the memory space of monitoring device arrival default retention phase or the memory node are expired, according to
The order of remaining time from long to short, the quantity of memory node according to the video monitoring storage system and described is regarded
The size of frequency file deletes the video file in the memory node.
The program is that the quantity based on the memory node that there is currently deletes video file from memory node on one's own initiative,
After the total size that the file for needing to delete is determined, the deletion scheme when deleting file also according to remaining time from long to short
Order deletes old video file.In specific application scenarios, it can delete oldest in memory node according to N*p GB sizes
Video file (N is CDV number of nodes, and p is each video file size), but the video file be not necessarily distributed in it is all
On CDV, perhaps only on certain several CDV.
Above scheme can allow the CDV nodes of shared pool to have different volume spaces, solve and require that CDV node capacities are empty
Between it is identical bring hard disk configuration increase the problem of.On this basis, the application preferred embodiment also proposed dilatation scheme, lead to
Crossing in the following manner and realizing needs the purpose of progressively dilatation according to user：
After the video monitoring storage system adds new memory node, again according to the video monitoring storage system
In each memory node specification capacity it is each relative to the ratio setting of the specification capacity sum of all memory nodes it is described storage section
The capacity weight of point, and with the presence or absence of storage in the capacity weight judges the video monitoring storage system after setting completed
The full memory node in space.
By taking tri- different memory nodes of existing A, B, C in video monitoring storage system as an example, its specification capacity difference
It is a, b, c, and tri- different memory nodes of A, B, C ratio shared in total specification capacity is respectively a/ (a+b+c), b/ (a
+ b+c) and c/ (a+b+c).In this specific embodiment, after the memory node D that a specification capacity is d is added, then
Tetra- different memory nodes of A, B, C, D ratio shared in total specification capacity is respectively a/ (a+b+c+d), b/ (a+b+c+
D), c/ (a+b+c+d) and d/ (a+b+c+d).Capacity weight based on each memory node redefined, subsequently when monitoring
Equipment have the video file in new catalogue need to after dilatation memory node write-in when, you can according to the capacity redefined
Weight is write in the way of S101-S104.
Correspondingly, if after the capacity weight redefined causes the memory space of original memory node full, Yuan Youcun
Store up node to delete the video file wherein stored by way of the full covering deletion in above-described embodiment, will not be repeated here.
[z3][MZ4]
Above scheme does not require that dilatation is certain and carries out dilatation according to identical capacity nodes, can progressively expand according to the actual requirements
Hold, dilatation can increase array or extension cabinet (as long as no more than performance of the CDV nodes) on existing CDV nodes, can also increase
CDV nodes.By taking the concrete application scene shown in Fig. 2 as an example, it is described as follows：
Increase CDV4, volume space 2TB, then capacity weight coefficient needs to readjust, the CDV1 quotas of catalogue 1 after adjustment
For 10G, the CDV2 quotas of catalogue 1 are 30G, and the CDV3 of catalogue 1 quota is 40G, and the CDV4 of catalogue 1 quota is 20G.Adjustment
Original above-quota part of CDV nodes (the retention phase can be caused to shorten) will not be deleted at once afterwards, but can progressively trigger full
Covering is deleted, and until all CDV nodes reach quota capacity, capacity is just balanced.
The specific embodiment is also to be in the way of in S101 when for newly-increased CDV nodes according to quota on capacity is set
Different monitoring device catalogues carries out video cloud storage distribution, after being assigned, and be able to will be supervised according to the step of S102-S104
Control the video recording increased newly in facility inventory and be written to the node, or write other CDV nodes and completely covered deletion action
The space vacated afterwards, it is to the last balanced, it can also ensure the lasting write-in of newly-increased video recording until finally reaching discrete quantization.
By the technical scheme of application the application, saved previously according to the specification capacity of each memory node relative to all storages
The capacity weight of each memory node of ratio setting of the specification capacity sum of point, is then being deposited according to the capacity weight of memory node
Distribution and the memory space corresponding to the catalogue of monitoring device on node are stored up, being arranged on every wheel video data according to capacity weight writes
Enter the quantity of the middle file write to memory node, using the quantity as memory node written document number, according to memory node
The number of tasks of maximum write-in way and capacity weight distribution memory node, finally according to number of tasks and written document number from catalogue
Video data write-in is performed to memory node.So as to realize video data between the memory node in different capabilities space
Equilibrium storage, improves the adaptability of video monitoring storage system and reduces the extra work of technical staff.
To reach above technical purpose, the application also proposed a kind of video data writing station, as shown in figure 4, the dress
Put applied in the video monitoring storage system comprising monitoring device and multiple memory nodes, the device includes：
First setup module 401, previously according to each memory node specification capacity relative to all memory nodes
The capacity weight of each memory node of ratio setting of specification capacity sum,
First distribute module 402, distributed according to the capacity weight of the memory node on the memory node with it is described
Memory space corresponding to the catalogue of monitoring device；
Second setup module 403, is arranged in every wheel video data write-in according to the capacity weight and is saved to the storage
Point write-in file quantity, using the quantity as the memory node written document number；
Second distribute module 404, according to the maximum write-in way of the memory node and the capacity weight distribution institute
The number of tasks of memory node is stated, the number of tasks is not more than the general assignment number of the memory node；
Writing module 405, holds according to the number of tasks and the written document number from the catalogue to the memory node
The row video data write-in.
In specific application scenarios, the catalogue includes multiple video files, and the size of each video file is identical,
Said write module specifically for：
Epicycle was not carried out to the data write-in and the minimum memory node of number of tasks is as ingress to be written, according to institute
State the video file that the written document number of ingress to be written writes the catalogue to the ingress to be written, and after the completion of write-in after
It is continuous epicycle to be not carried out to the data write-in and the minimum memory node of number of tasks is used as new ingress to be written；
After all memory nodes write the once video file in epicycle, terminate the write-in of epicycle video data, and
Video data write-in described in a new round is performed in the case where the memory space of the memory node is not yet full.
In specific application scenarios, in addition to：
Removing module, when the memory space that the monitoring device reaches default retention phase or the memory node is full
When, delete the video file that remaining time in the memory node exceedes default time threshold, or according to remaining time from length
To short order, the quantity of memory node according to the video monitoring storage system and the size of the video file
Delete the video file in the memory node.
In specific application scenarios, first setup module is additionally operable to when the video monitoring storage system is added
After new memory node, deposited again according to the specification capacity of each memory node in the video monitoring storage system relative to all
The capacity weight of each memory node of ratio setting of the specification capacity sum of node is stored up, and is set up in the capacity weight
Judge after finishing in the video monitoring storage system with the presence or absence of the memory node that memory space is full.
In specific application scenarios, first setup module specifically for：
Obtain the specification capacity that each memory node is reported；
It regard the specification capacity sum of all memory nodes as GREV capacity；
The specification capacity of each memory node ratio shared in total specification capacity is determined successively；
The capacity weight according to the ratio-dependent.
As can be seen here, by application the application technical scheme, previously according to each memory node specification capacity relative to
The capacity weight of each memory node of ratio setting of the specification capacity sum of all memory nodes, then according to the appearance of memory node
Amount weight distributes the memory space corresponding to the catalogue with monitoring device on memory node, and every wheel is arranged on according to capacity weight
The quantity of file write in video data write-in to memory node, using the quantity as memory node written document number, according to
The maximum write-in way and the number of tasks of capacity weight distribution memory node of memory node, finally according to number of tasks and write text
Number of packages performs video data write-in from catalogue to memory node.So as to be realized between the memory node in different capabilities space
The balanced storage of video data, improves the adaptability of video monitoring storage system and reduces the extra work of technical staff.
Through the above description of the embodiments, those skilled in the art can be understood that the present invention can lead to
Hardware realization is crossed, the mode of necessary general hardware platform can also be added to realize by software.Understood based on such, this hair
Bright technical scheme can be embodied in the form of software product, and the software product can be stored in a non-volatile memories
Medium (can be CD-ROM, USB flash disk, mobile hard disk etc.) in, including some instructions are to cause a computer equipment (can be
Personal computer, server, or network equipment etc.) perform method described in each of the invention implement scene.
It will be appreciated by those skilled in the art that accompanying drawing is a schematic diagram for being preferable to carry out scene, module in accompanying drawing or
Flow is not necessarily implemented necessary to the present invention.
It will be appreciated by those skilled in the art that the module in device in implement scene can be described according to implement scene into
Row is distributed in the device of implement scene, can also carry out one or more dresses that respective change is disposed other than this implement scene
In putting.The module of above-mentioned implement scene can be merged into a module, can also be further split into multiple submodule.
The invention described above sequence number is for illustration only, and the quality of implement scene is not represented.
Disclosed above is only several specific implementation scenes of the present invention, and still, the present invention is not limited to this, Ren Heben
What the technical staff in field can think change should all fall into protection scope of the present invention.
Claims (10)
1. a kind of video data wiring method, it is characterised in that methods described is applied to include monitoring device and multiple storages
In the video monitoring storage system of node, previously according to each memory node specification capacity relative to all memory nodes
The capacity weight of each memory node of ratio setting of specification capacity sum, this method also includes：
Distributed according to the capacity weight of the memory node on the memory node corresponding to the catalogue with the monitoring device
Memory space；
The quantity of the file write in every wheel video data write-in to the memory node is arranged on according to the capacity weight, will
The quantity as the memory node written document number；
The number of tasks of memory node, institute according to the maximum write-in way of the memory node and the capacity weight distribution
State the general assignment number that number of tasks is not more than the memory node；
The video data is performed according to the number of tasks and the written document number from the catalogue to the memory node to write
Enter.
2. the method as described in claim 1, it is characterised in that the catalogue includes multiple video files, each video text
The size of part is identical, performed according to the number of tasks and the written document number from the catalogue to the memory node described in regard
Frequency is according to write-in, specially：
Epicycle was not carried out to the data write-in and the minimum memory node of number of tasks is as ingress to be written, was treated according to described
The written document number for writing node writes the video file of the catalogue to the ingress to be written, and continuation will after the completion of write-in
Epicycle was not carried out the data write-in and the minimum memory node of number of tasks is as new ingress to be written；
After all memory nodes write the once video file in epicycle, terminate the write-in of epicycle video data, and in institute
State memory node memory space be not yet full in the case of perform a new round described in video data write-in.
3. the method as described in claim 1, it is characterised in that also include：
When the memory space of monitoring device arrival default retention phase or the memory node are expired, the storage is deleted
Remaining time exceedes the video file of default time threshold in node；
Or, when the memory space of monitoring device arrival default retention phase or the memory node are expired, according to retention
The order of time from long to short, the quantity of memory node according to the video monitoring storage system and video text
The size of part deletes the video file in the memory node.
4. method as claimed in claim 3, it is characterised in that also include：
After the video monitoring storage system adds new memory node, again according to each in the video monitoring storage system
The specification capacity of memory node is relative to each memory node of ratio setting of the specification capacity sum of all memory nodes
Capacity weight, and with the presence or absence of memory space in the capacity weight judges the video monitoring storage system after setting completed
Full memory node.
5. the method as described in claim any one of 1-4, it is characterised in that according to the specification capacity phase of each memory node
For the capacity weight of each memory node of ratio setting of the specification capacity sum of all memory nodes, it is specially：
Obtain the specification capacity that each memory node is reported；
It regard the specification capacity sum of all memory nodes as GREV capacity；
The specification capacity of each memory node ratio shared in total specification capacity is determined successively；
The capacity weight according to the ratio-dependent.
6. a kind of video data writing station, it is characterised in that described device is applied to include monitoring device and multiple storages
In the video monitoring storage system of node, the device includes：
First setup module, previously according to specification capacity of the specification capacity relative to all memory nodes of each memory node
The capacity weight of each memory node of ratio setting of sum,
First distribute module, is distributed and the monitoring device according to the capacity weight of the memory node on the memory node
Catalogue corresponding to memory space；
Second setup module, is arranged on what is write in every wheel video data write-in to the memory node according to the capacity weight
The quantity of file, using the quantity as the memory node written document number；
Second distribute module, stores section according to the maximum write-in way of the memory node and the capacity weight distribution
The number of tasks of point, the number of tasks is not more than the general assignment number of the memory node；
Writing module, performed according to the number of tasks and the written document number from the catalogue to the memory node described in regard
Frequency is according to write-in.
7. device as claimed in claim 6, it is characterised in that the catalogue includes multiple video files, each video text
The size of part is identical, said write module specifically for：
Epicycle was not carried out to the data write-in and the minimum memory node of number of tasks is as ingress to be written, was treated according to described
The written document number for writing node writes the video file of the catalogue to the ingress to be written, and continuation will after the completion of write-in
Epicycle was not carried out the data write-in and the minimum memory node of number of tasks is as new ingress to be written；
After all memory nodes write the once video file in epicycle, terminate the write-in of epicycle video data, and in institute
State memory node memory space be not yet full in the case of perform a new round described in video data write-in.
8. device as claimed in claim 6, it is characterised in that also include：
Removing module, when the memory space of monitoring device arrival default retention phase or the memory node are expired, is deleted
Except remaining time exceedes the video file of default time threshold in the memory node, or according to remaining time from long to short
Sequentially, the quantity of memory node according to the video monitoring storage system and the size of the video file delete institute
State the video file in memory node.
9. device as claimed in claim 8, it is characterised in that
First setup module, is additionally operable to after the video monitoring storage system adds new memory node, again basis
The specification capacity of each memory node is relative to the specification capacity sum of all memory nodes in the video monitoring storage system
The capacity weight of each memory node of ratio setting, and judge that the video monitoring is deposited after setting completed in the capacity weight
With the presence or absence of the memory node that memory space is full in storage system.
10. the device as described in claim any one of 6-9, it is characterised in that first setup module specifically for：
Obtain the specification capacity that each memory node is reported；
It regard the specification capacity sum of all memory nodes as GREV capacity；
The specification capacity of each memory node ratio shared in total specification capacity is determined successively；
The capacity weight according to the ratio-dependent.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710272285.8A CN107154966A (en) | 2017-04-24 | 2017-04-24 | A kind of video data wiring method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710272285.8A CN107154966A (en) | 2017-04-24 | 2017-04-24 | A kind of video data wiring method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107154966A true CN107154966A (en) | 2017-09-12 |
Family
ID=59792840
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710272285.8A Pending CN107154966A (en) | 2017-04-24 | 2017-04-24 | A kind of video data wiring method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107154966A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110351532A (en) * | 2019-08-08 | 2019-10-18 | 杭州阿启视科技有限公司 | Video big data cloud platform cloud storage service method |
| CN111526315A (en) * | 2020-04-28 | 2020-08-11 | 杭州海康威视数字技术股份有限公司 | Video data storage method, device, system and equipment |
| CN111831206A (en) * | 2019-04-15 | 2020-10-27 | 浙江宇视科技有限公司 | Storage space switching method and back-end monitoring system |
| CN112291292A (en) * | 2019-07-26 | 2021-01-29 | 浙江宇视科技有限公司 | Data storage method, device, equipment and medium |
| CN112748850A (en) * | 2019-10-29 | 2021-05-04 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer program product for storage management |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102088472A (en) * | 2010-11-12 | 2011-06-08 | 中国传媒大学 | Wide area network-oriented decomposition support method for animation rendering task and implementation method |
| US20120089778A1 (en) * | 2010-10-11 | 2012-04-12 | Intransa, Inc. | Storage system having cross node data redundancy and method and computer readable medium for same |
| CN103929500A (en) * | 2014-05-06 | 2014-07-16 | 刘跃 | Method for data fragmentation of distributed storage system |
| CN104158758A (en) * | 2014-08-26 | 2014-11-19 | 上海斐讯数据通信技术有限公司 | Load balancing processing method and system based on user message time feedback in SDN network |
| CN104754001A (en) * | 2013-12-30 | 2015-07-01 | 方正宽带网络服务股份有限公司 | Cloud storage system and data storage method |
| CN105224244A (en) * | 2015-09-07 | 2016-01-06 | 浙江宇视科技有限公司 | The method and apparatus that a kind of file stores |
-
2017
- 2017-04-24 CN CN201710272285.8A patent/CN107154966A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120089778A1 (en) * | 2010-10-11 | 2012-04-12 | Intransa, Inc. | Storage system having cross node data redundancy and method and computer readable medium for same |
| CN102088472A (en) * | 2010-11-12 | 2011-06-08 | 中国传媒大学 | Wide area network-oriented decomposition support method for animation rendering task and implementation method |
| CN104754001A (en) * | 2013-12-30 | 2015-07-01 | 方正宽带网络服务股份有限公司 | Cloud storage system and data storage method |
| CN103929500A (en) * | 2014-05-06 | 2014-07-16 | 刘跃 | Method for data fragmentation of distributed storage system |
| CN104158758A (en) * | 2014-08-26 | 2014-11-19 | 上海斐讯数据通信技术有限公司 | Load balancing processing method and system based on user message time feedback in SDN network |
| CN105224244A (en) * | 2015-09-07 | 2016-01-06 | 浙江宇视科技有限公司 | The method and apparatus that a kind of file stores |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111831206A (en) * | 2019-04-15 | 2020-10-27 | 浙江宇视科技有限公司 | Storage space switching method and back-end monitoring system |
| CN111831206B (en) * | 2019-04-15 | 2022-06-14 | 浙江宇视科技有限公司 | Storage space switching method and back-end monitoring system |
| CN112291292A (en) * | 2019-07-26 | 2021-01-29 | 浙江宇视科技有限公司 | Data storage method, device, equipment and medium |
| CN112291292B (en) * | 2019-07-26 | 2023-04-07 | 浙江宇视科技有限公司 | Data storage method, device, equipment and medium |
| CN110351532A (en) * | 2019-08-08 | 2019-10-18 | 杭州阿启视科技有限公司 | Video big data cloud platform cloud storage service method |
| CN112748850A (en) * | 2019-10-29 | 2021-05-04 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer program product for storage management |
| CN112748850B (en) * | 2019-10-29 | 2024-04-19 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer program product for storage management |
| CN111526315A (en) * | 2020-04-28 | 2020-08-11 | 杭州海康威视数字技术股份有限公司 | Video data storage method, device, system and equipment |
| CN111526315B (en) * | 2020-04-28 | 2023-03-14 | 杭州海康威视数字技术股份有限公司 | Video data storage method, device, system and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107154966A (en) | A kind of video data wiring method and device | |
| CN107104992B (en) | A kind of the storage resource distribution method and device of video cloud storage | |
| Hauglid et al. | DYFRAM: dynamic fragmentation and replica management in distributed database systems | |
| CN105224244B (en) | A kind of method and apparatus of file storage | |
| CN109428913A (en) | A kind of storage expansion method and device | |
| CN104317742A (en) | Automatic thin-provisioning method for optimizing space management | |
| CN106897442A (en) | A kind of distributed file system user quota method for pre-distributing and distribution system | |
| JPH04165541A (en) | File rearranging method | |
| US8516070B2 (en) | Computer program and method for balancing processing load in storage system, and apparatus for managing storage devices | |
| CN103324533A (en) | distributed data processing method, device and system | |
| CN111666159A (en) | Load balancing control method and device, storage medium and electronic equipment | |
| CN110362384A (en) | A kind of resource allocation methods, device, electronic equipment and storage medium | |
| CN107885616A (en) | A kind of mass small documents back-up restoring method based on file system parsing | |
| CN105912698A (en) | Deletion method and system of data file in disk | |
| CN108255855A (en) | Date storage method and device | |
| CN110321215A (en) | Queue control method and device | |
| CN113806300A (en) | Data storage method, system, device, equipment and storage medium | |
| CN112084173A (en) | Data migration method and device and storage medium | |
| CN108256034A (en) | Data migration method and equipment | |
| CN109299043A (en) | The big file delet method of distributed cluster system, device, equipment and storage medium | |
| CN110019132A (en) | Thumb up date storage method and equipment | |
| CN107577431A (en) | A kind of storage pool construction method and device | |
| CN107704199A (en) | A kind of logical partition method and device of solid state hard disc | |
| CN107295032A (en) | A kind of method and apparatus of the data syn-chronization of data center | |
| US20200401340A1 (en) | Distributed storage system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170912 |
|
| RJ01 | Rejection of invention patent application after publication |