CN106412612B - A kind of program file reorganizes and outfit method, apparatus and system - Google Patents
A kind of program file reorganizes and outfit method, apparatus and system Download PDFInfo
- Publication number
- CN106412612B CN106412612B CN201610854584.8A CN201610854584A CN106412612B CN 106412612 B CN106412612 B CN 106412612B CN 201610854584 A CN201610854584 A CN 201610854584A CN 106412612 B CN106412612 B CN 106412612B
- Authority
- CN
- China
- Prior art keywords
- storage array
- program file
- task
- storage
- outfit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/21815—Source of audio or video content, e.g. local disk arrays comprising local storage units
- H04N21/2182—Source of audio or video content, e.g. local disk arrays comprising local storage units involving memory arrays, e.g. RAID disk arrays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
- G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
- G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
- G06F11/2058—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring using more than 2 mirrored copies
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2181—Source of audio or video content, e.g. local disk arrays comprising remotely distributed storage units, e.g. when movies are replicated over a plurality of video servers
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A kind of program file is provided in the embodiment of the present application reorganizes and outfit method, apparatus and system, this method comprises: reading program file from media resource system；The program file is respectively written into the first storage array and the second storage array, wherein first storage array and the second storage array mirror image each other；First storage array and second storage array include one or more storage servers；Determine second task identification and second task status of the program file respectively in the first task mark and first task state and second storage array of first storage array；When according to the program file respectively first storage array first task mark and first task state, and the second task identification and the second task status in second storage array, determine that the program file when first storage array and second storage array are reorganized and outfit successfully, determines that the program file reorganizes and outfit completion.Using the scheme in the application, the influence normally broadcasted to program can be reduced.
Description
Technical field
This application involves what program broadcasted technical field more particularly to a kind of program file to reorganize and outfit method, apparatus and system.
Background technique
In Broadcast Control process, for program file as final broadcast entity, the business of reorganizing and outfit of program file is Broadcast Control system
The core business of system.Program file to reorganize and outfit process mainly include that level-one is reorganized and outfit, second level is reorganized and outfit, three-level is reorganized and outfit；And it stores and reorganizes and outfit
The storage server of program file is known as multistage storage server.
Multistage storage includes level-one storage, three secondary storage, tertiary storage parts；Level-one storage refers to that program file is moved
Enter the storage system to before broadcast system, refers mainly to media resource system；Secondary storage refers to that program file is migrated by external system and broadcasts
The storage system of system out；Tertiary storage is primarily referred to as the storage system of video server composition.Secondary storage system assumes responsibility for
The most caching of broadcast items file and safety reorganizes and outfit task, secondary storage system be responsible for transmitted from media resource system to
It broadcasts file uniformly to be reorganized and outfit, and is sent to each video server in tertiary storage in defined time unification.
In the prior art, each usually in each storage server when receiving the program file from media resource system
A part of program file reorganized and outfit is stored, if there is a certain storage server to break down, cannot provide in time and reorganize and outfit program text
Part influences whether normal broadcast task.
Summary of the invention
A kind of program file is provided in the embodiment of the present application reorganizes and outfit method, apparatus and system, is able to solve existing skill
In art reorganize and outfit in method a certain storage server break down when, influence the problem of normal program is reorganized and outfit.
According to the one aspect of the embodiment of the present application, provide a kind of program file reorganizes and outfit method, comprising: provides from matchmaker and is
System reads program file；The program file is respectively written into the first storage array and the second storage array, wherein first storage
Array and the second storage array mirror image each other；First storage array and second storage array include one or more storages
Server；Determine the program file respectively first storage array first task mark and first task state, and should
The second task identification and the second task status in second storage array；Wherein, which has for identifying storage array
Without the corresponding task of the program file, the task status is for identifying the shape that storage array executes the corresponding task of the program file
State；When according to the program file respectively the first task mark and first task state of first storage array and this
The second task identification and the second task status in two storage arrays, determine the program file first storage array and this
When two storage arrays are reorganized and outfit successfully, determine that the program file reorganizes and outfit completion.
According to the other side of the embodiment of the present application, a kind of device for reconditioning of program file is additionally provided, comprising: first
Read module, for reading program file from media resource system；First writing module, for the program file to be respectively written into first
Storage array and the second storage array, wherein first storage array and the second storage array mirror image each other；The first storage battle array
Column and second storage array include one or more storage servers；First determining module, for determining the program file
Second in the first task mark and first task state of first storage array and second storage array respectively
Business mark and the second task status；Wherein, the task identification is for identifying storage array whether there is or not the corresponding task of the program file,
The task status is for identifying the state that storage array executes the corresponding task of the program file；Second determining module is used for
According to the program file respectively in the first task mark and first task state of first storage array and second storage
The second task identification and the second task status in array determine the program file in first storage array and second storage
When array is reorganized and outfit successfully, determine that the program file reorganizes and outfit completion.
According to another aspect of the application, additionally provide a kind of program file reorganizes and outfit system, comprising: secondary storage system
System, for receiving and storing the program file from media resource system；The secondary storage system includes the first storage of mirror image each other
Array and the second storage array；Tertiary storage system, for receiving and storing the program file from the secondary storage system；It should
Tertiary storage system includes multiple video server clusters, and each video server cluster includes the first Video service of mirror image each other
Device and the second video server.
Method, apparatus and system are reorganized and outfit using the program file provided in the embodiment of the present application, it will be from media resource system
The program file read is stored to the first storage array of mirror image each other and the second storage array, and according to the program file point
The second task not in the first task mark and first task state and second storage array of first storage array
Mark and the second task status, determine the program file when first storage array and second storage array are reorganized and outfit successfully,
Determine that the program file reorganizes and outfit completion；Due to program file being stored to two different storage battle arrays respectively when program is reorganized and outfit
Therefore column when a certain storage array breaks down, can get the program file from another storage array, so as to
The program file is obtained in time, reduces the influence normally broadcasted to program.
Detailed description of the invention
The drawings described herein are used to provide a further understanding of the present application, constitutes part of this application, this Shen
Illustrative embodiments and their description please are not constituted an undue limitation on the present application for explaining the application.In the accompanying drawings:
Fig. 1 shows the system block diagram for reorganizing and outfit system of the program file according to the embodiment of the present application；
Fig. 2 shows the flow charts that the program in the embodiment of the present application one reorganizes and outfit method；
Fig. 3 shows the operation logic figure of the buffer area in the embodiment of the present application；
The structural schematic diagram of the device for reconditioning of the program file according to the embodiment of the present application two is shown in Fig. 4.
Specific embodiment
During realizing the application, inventors have found that in the prior art, receiving the section from media resource system
When mesh file, a part of program file reorganized and outfit usually respectively is stored in each storage server, if there is a certain storage server
It breaks down, cannot provide in time and reorganize and outfit program file, influence whether normal broadcast task.
To solve the above problems, reorganizing and outfit method, apparatus and system this application provides a kind of program file, will be provided from matchmaker
The program file read in system is stored to the first storage array of mirror image each other and the second storage array, and according to the program
File respectively in the first task mark and first task state and second storage array of first storage array the
Two task identifications and the second task status determine that the program file is reorganized and outfit into first storage array and second storage array
When function, determine that the program file reorganizes and outfit completion；Due to program file being stored to different two deposit respectively when program is reorganized and outfit
Array is stored up, therefore, when a certain storage array breaks down, the program file can be got from another storage array, thus
The program file can be obtained in time, reduce the influence normally broadcasted to program.Meanwhile the secondary storage of mirror image is whole as three-level
Standby source storage, can share wide pressure of reading tape.
In order to which technical solution in the embodiment of the present application and advantage is more clearly understood, below in conjunction with attached drawing to the application
Exemplary embodiment be described in more detail, it is clear that described embodiment be only the application a part implement
Example, rather than the exhaustion of all embodiments.It should be noted that in the absence of conflict, embodiment and reality in the application
The feature applied in example can be combined with each other.
Embodiment one
Fig. 1 shows the system block diagram for reorganizing and outfit system 100 of the program file according to the embodiment of the present application.
As shown in Figure 1, the system 100 of reorganizing and outfit according to the program file of the embodiment of the present application one includes: secondary storage system
102, for receiving and storing the program file from media resource system 101；The secondary storage system 102 includes the of mirror image each other
One storage array 102a and the second storage array 102b；Tertiary storage system 103 comes from the secondary storage for receiving and storing
The program file of system 102；The tertiary storage system includes two video server cluster 103a, 103b, video server collection
Group 103a includes the first video server 103a1 and the second video server 103a2 of mirror image each other；Video server cluster
103b includes the first video server 103b1 and the second video server 103b2 of mirror image each other.
In the specific implementation, tertiary storage system is in order to support the broadcast of multiple channels that can be divided into multiple video server collection
Group, each video server cluster store the program file of different channel respectively.In the specific implementation, two groups of collection shown in FIG. 1
The program that group can undertake 20 channels broadcasts, that is, every group of broadcast for undertaking 10 channels, each cluster internal include main view frequency
Server and standby video server, active and standby video server is by the way of mirror image.In the specific implementation, it also can be set more
The program file of the channel of more cluster or each cluster-based storage different number, the application is with no restriction.
In the specific implementation, the system 100 of reorganizing and outfit of program file can also include: correction verification module, for providing to from matchmaker
The program file of system carries out MD5 verification；And MD5 verification is carried out to the program file from secondary storage system.
System is reorganized and outfit to the program side of reorganizing and outfit according to the embodiment of the present application one below in conjunction with program file shown in FIG. 1
Method describes in detail.
Fig. 2 shows the flow charts that the program in the embodiment of the present application one reorganizes and outfit method.Program file is in storages at different levels
Migration and auditing flow can be divided into that second level is reorganized and outfit, three-level reorganizes and outfit two stages.The second level stage of reorganizing and outfit refer to program file first from
Such as the external system of media resource system reaches the process of secondary storage by migration.The three-level stage of reorganizing and outfit refers in secondary storage
Program file executes the process that migration task reaches video server after audit (artificial and MD5 verification) passes through.
As shown in Fig. 2, method is reorganized and outfit according to the program in the embodiment of the present application one the following steps are included:
S201 reads program file from media resource system.
In the specific implementation, a dedicated reading thread can be set to read program file from media resource system.
The program file is divided into the data block being sized by S202, and is respectively written into the first caching of buffer area
In queue and the second buffer queue；Wherein, the first buffer queue correspond to the first storage array, the second buffer queue it is corresponding in
Second buffer queue.
During program file moves into secondary storage by media resource system, the scheme in the application is for source program file
It reads primary and caches.
In the specific implementation, this, which is sized, can be the size of data such as 4096Byte.
In the specific implementation, program file can be divided into the data block being sized by reading thread, then sequence is read in and delayed
It rushes in two caching sequences of area buffer.
Specifically, it can store in program file to the first storage array and the second storage array and then do the school MD5
It tests.It can also store to before the first storage array and the second storage array, MD5 verification is executed to the file of caching in advance,
To save the time for re-reading file.
Specifically, when in advance execute MD5 verification when, the buffer area in addition to the first buffer queue and the second buffer queue,
It can also include the third buffer queue corresponding to MD5 correction verification module.
In the specific implementation, the operation logic of buffer area can be as shown in Figure 3.
As shown in figure 3, being read if buffer area buffer queue signals state is to read thread to have signal or read thread waiting time-out
Thread pushes to the data block in buffer into three buffer queues, while buffer quene state becomes no signal,
Buffer queue is set to and writes thread by reading thread after the completion of push, MD5 verification thread has signal.
When thread is write in buffer queue, MD5 verification thread has signal, thread is write, MD5 verifies thread for buffer queue
In data in the first buffering queue draw pop to come out, while buffer quene state becomes no signal, will after the completion of Pop
Buffer queue, which is set to reading thread, signal, and data are written in the buffer of Pop.
In the specific implementation, if the program file in caching is not verified by MD5, S201 can be re-executed, with
The program file is requested to media resource system, second level is re-started and reorganizes and outfit.If verified by MD5, S203 can be executed.
Respectively the first storage array is written, by the second buffer queue in data block order in first buffer queue by S203
In data be sequentially written in the second storage array.
S204, according to task situation of the program file in the first storage array and the second storage array, the respectively section
Task identification and task status is arranged in mesh file；Wherein, task identification includes task and without task；Task status includes into
In function, failure and execution.
In the specific implementation, task identification and the enumerated value of task status can be as shown in the table.
In upper table, A1 indicates certain program file in the task identification of the first storage array, and A2 indicates the program file
In the task status of the first storage array；B1 indicates certain program file in the task identification of the second storage array, and B2 is indicated should
Task status of the program file in the second storage array.When A1 or B1 is 0, indicate the program file in corresponding storage array
In had migration task in the given time, that is, write-in task；When A1 or B1 is 1, indicate that the program file is deposited accordingly
There is no migration task in the given time in storage array；When A2 or B2 is 0, indicate the program file in storage battle array accordingly
It is stored successfully in column；When A2 or B2 is 1, indicate that the program file stores failure in corresponding storage array；As A2 or B2
When being 2, indicate that the program file is carrying out migration task in corresponding storage array.General assignment state is according to front
What the value of A1, B1, A2, B2 determined, show that the second level of the program file reorganizes and outfit state.
S205, according to program file respectively in the first task mark and first task state of the first storage array, and
The second task identification and the second task status in second storage array determine that program file reorganizes and outfit into completion.
In the specific implementation, may usually there are following several situations:
1) when the first storage array of A has task and Mission Success, the second storage array B has task and Mission Success.
State value label are as follows: A1=0；B1=0；A2=0；B2=0；General assignment state=0；Second level is represented at this time and is reorganized and outfit appoints
Business is completed.
2) when .A has task and mission failure, B has task and mission failure.
State value is labeled as are as follows: A1=0；B1=0；A2=1；B2=1；General assignment state=1.Second level is represented at this time to reorganize and outfit
Mission failure need to re-initiate second level and reorganize and outfit task.
3), which works as A, B, task and only side's mission failure.
Such as: A success B failure, state value marks at this time are as follows: A1=0；B1=0；A2=0；B2=1；General assignment state=
0；Second level is represented at this time and reorganizes and outfit task completion, but the file stored in B reorganizes and outfit mission failure, file can be migrated from storage A
To storage B.
The status indicator value that the new task of initiation runs succeeded are as follows: A1=1；B1=0；A2=0；B2=0；General assignment state
=0. at this time file storage B reorganize and outfit task complete.
In the specific implementation, the fault recovery machine of the first storage array or the second storage array can also be further realized
System.
Still by taking above-mentioned A, B storage array as an example.After A failure, the program file from buffer area can only be migrated
To B, being can recorde down in only B at this time has file.After A restores from failure, file can be used and compare tool, to A, B
The program file of middle storage carries out contrast difference, lists the file lacked in A, can choose business idle period at this time, initiates
File synchronization task moves into the file lacked in A from B, to restore the consistency of file in A, B storage.
S206 carries out three-level and reorganizes and outfit after the completion of determining that second level is reorganized and outfit.
Above-mentioned steps S201 to S205 reorganizes and outfit for second level.
In the specific implementation, three-level reorganizes and outfit the mistake for referring to and program file being moved to video server from secondary storage array
Journey.Program file can carry out artificial review before doing three-level and reorganizing and outfit in secondary storage array.Artificial review refers to for inciting somebody to action
The process that the program file of video server is manually reexamined is moved to, program file is executed generally according to program listing
Audit task, in view of task amount and time-saving consideration, artificial review is generally according to channel strategy to one of storage battle array
The program file stored in column is audited.
After executing artificial review for the program file of a certain storage array A, the program file is marked to pass through for audit, after
Continuous three-level directly can execute migration movement to the program file during reorganizing and outfit.
If program file not by artificial review, continues to audit the same program text stored in another storage array B
Part, if also not passing through audit, program audit failure；It is marked if the program file audit in another storage array passes through
Program file in the storage array is that audit passes through, and the program file is migrated from storage array B to A.
After artificial review passes through, file can be reorganized and outfit according to the strategy execution three-level of default.
In the specific implementation, it may include: to obtain program text from the first storage array or the second storage array that three-level, which is reorganized and outfit,
Part；According to the corresponding broadcast channel of program file in program listing, the video server cluster of storage program file is determined；Wherein,
Video server cluster includes the first video server and the second video server, the first video server and the second Video service
Device mirror image each other；Program file is stored to the first video server and the second video server into video server cluster.
In the specific implementation, program file further can also stored to the first video into video server cluster
Before server and the second video server, program file is executed and carries out the 2nd MD5 verification；If the 2nd MD5 verification does not pass through,
The 3rd MD5 verification then is executed to the program file in another storage array.If the 2nd MD5 verification or the 3rd MD5 verification pass through,
Program file is then stored to the first video server and the second video server into video server cluster；If third
MD5 verification also fails, then the program file returns to the artificial review stage, and again to the same section stored in another storage array
Mesh file, which is done, manually to be examined, and is re-executed three-level after auditing successfully and is reorganized and outfit task.
In the specific implementation, the fault recovery of the first video server or the second video server can also be further realized
Mechanism.
Still by taking above-mentioned video server 103a1,103a2 as an example.After 103a1 failure, secondary storage system is come from
Program file can only migrate to 103a2, can recorde down only has file in 103a2 at this time.When 103a1 is extensive from failure
After multiple, file can be used and compare tool, contrast difference is carried out to the program file stored in 103a1,103a2, lists 103a1
The file of middle missing, can choose at this time business it is idle during, initiate file synchronization task, by the file lacked in 103a1 from
103a2 is moved into, to restore the consistency of file in 103a1,103a2 storage.
Method is reorganized and outfit using the program file provided in the embodiment of the present application, the program that will be read from media resource system
File is stored to the first storage array of mirror image each other and the second storage array, and first is deposited at this respectively according to the program file
Store up first task mark and first task state and the second task identification in second storage array and second of array
Business state determines that the program file when first storage array and second storage array are reorganized and outfit successfully, determines program text
Part reorganizes and outfit completion；Due to program file being stored to two different storage arrays, therefore, at certain respectively when program is reorganized and outfit
When one storage array breaks down, the program file can be got from another storage array, so as to obtain the section in time
Mesh file reduces the influence normally broadcasted to program.Meanwhile the source storage that the secondary storage of mirror image is reorganized and outfit as three-level, it can be with
Share wide pressure of reading tape.
Based on the same inventive concept, a kind of device for reconditioning of program file is additionally provided in the embodiment of the present application, due to this
The principle that device solves the problems, such as is similar to method provided by the embodiment of the present application one, therefore the implementation side of may refer to of the device
The implementation of method, overlaps will not be repeated.
Embodiment two
The structural schematic diagram of the device for reconditioning of the program file according to the embodiment of the present application two is shown in Fig. 4.
As shown in figure 4, including: the first reading according to the device for reconditioning 400 of the program file according to the embodiment of the present application two
Module 401, for reading program file from media resource system；First writing module 402, for the program file to be respectively written into
One storage array and the second storage array, wherein first storage array and the second storage array mirror image each other；First storage
Array and second storage array include one or more storage servers；First determining module 403, for determining the program
File respectively in the first task mark and first task state and second storage array of first storage array the
Two task identifications and the second task status；Wherein, whether there is or not the program file is corresponding for identifying storage array for the task identification
Task, the task status is for identifying the state that storage array executes the corresponding task of the program file；Second determining module
404, for according to the program file respectively first storage array first task mark and first task state, and
The second task identification and the second task status in second storage array determine the program file in first storage array and
When second storage array is reorganized and outfit successfully, determine that the program file reorganizes and outfit completion.
In the specific implementation, the first writing module can specifically include: the first write-in submodule is used for the program
File is divided into the data block being sized, and is respectively written into the first buffer queue and the second buffer queue of buffer area；Its
In, first buffer queue corresponds to the first storage array, and second buffer queue is corresponding in the second buffer queue；The
Two write-in submodules, for the first storage array to be written in the data block order in the first buffer queue respectively, is cached second
Data in queue are sequentially written in the second storage array.
In the specific implementation, buffer area can also include third buffer queue, and the third buffer queue corresponds to MD5 verification
Module；The device for reconditioning 400 of program file can also include: the first correction verification module, for by the number in the third buffer queue
MD5 correction verification module is written according to block, and executes the first MD5 verification；Third determining module, for confirming the first MD5 of the program file
Verification passes through.
In the specific implementation, the device for reconditioning 400 of program file can also include: setup module, for according to the program
Task situation of the file in first storage array and the second storage array, the respectively program file be arranged task identification and
Task status；Wherein, which includes task and without task；The task status includes successfully, unsuccessfully and in execution.
In the specific implementation, the second determining module, specifically can be used for having task in first storage array and task at
When function, determine that the program file reorganizes and outfit success in first storage array；Or there is task in second storage array and appoint
When being engaged in successfully, determine that the program file reorganizes and outfit success in second storage array.
In the specific implementation, the device for reconditioning 400 of program file can also include: copy module, for first depositing at this
Array without task or mission failure and when second storage array has task and Mission Success is stored up, by the program file from the
Two storage arrays are copied to first storage array；Or when first storage array have task and Mission Success and this
The program file is copied to second storage array from the first storage array without task or when mission failure by two storage arrays.
In the specific implementation, the device for reconditioning 400 of program file can also include: the second read module, for from this
One storage array or second storage array obtain the program file；4th determining module, for according to the program in program listing
The corresponding broadcast channel of file determines the video server cluster for storing the program file；Wherein, the video server cluster packet
The first video server and the second video server are included, first video server and second video server mirror image each other；
Third writing module, for the program file to be stored to the first video server and the second view into the video server cluster
Frequency server.
In the specific implementation, the device for reconditioning 400 of program file can also include: the second correction verification module, for this
The program file in one storage array or second storage array carries out the 2nd MD5 verification；And do not lead in the 2nd MD5 verification
It is out-of-date, the 3rd MD5 verification is executed to the program file in another storage array；5th determining module, for confirm this second
MD5 verification or the 3rd MD5 verification pass through.
Using the device for reconditioning of the program file provided in the embodiment of the present application, the program that will be read from media resource system
File is stored to the first storage array of mirror image each other and the second storage array, and first is deposited at this respectively according to the program file
Store up first task mark and first task state and the second task identification in second storage array and second of array
Business state determines that the program file when first storage array and second storage array are reorganized and outfit successfully, determines program text
Part reorganizes and outfit completion；Due to program file being stored to two different storage arrays, therefore, at certain respectively when program is reorganized and outfit
When one storage array breaks down, the program file can be got from another storage array, so as to obtain the section in time
Mesh file reduces the influence normally broadcasted to program.Meanwhile the source storage that the secondary storage of mirror image is reorganized and outfit as three-level, it can be with
Share wide pressure of reading tape.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The application is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Although the preferred embodiment of the application has been described, it is created once a person skilled in the art knows basic
Property concept, then additional changes and modifications may be made to these embodiments.So it includes excellent that the following claims are intended to be interpreted as
It selects embodiment and falls into all change and modification of the application range.
Obviously, those skilled in the art can carry out various modification and variations without departing from the essence of the application to the application
Mind and range.In this way, if these modifications and variations of the application belong to the range of the claim of this application and its equivalent technologies
Within, then the application is also intended to include these modifications and variations.
Claims (18)
1. a kind of program file reorganizes and outfit method characterized by comprising
Program file is read from media resource system；
The program file is respectively written into the first storage array and the second storage array, wherein first storage array and
Second storage array mirror image each other；First storage array and second storage array include one or more storage clothes
Business device；
Determine the program file respectively in the first task mark and first task state of first storage array, Yi Jisuo
State the second task identification and the second task status in the second storage array；Wherein, the task identification is for identifying storage battle array
It shows without the corresponding task of the program file, the task status is corresponding for identifying the storage array execution program file
Task state；
When according to the program file respectively first storage array first task mark and first task state, and
The second task identification and the second task status in second storage array determine the program file in first storage
When array and second storage array are reorganized and outfit successfully, determine that the program file reorganizes and outfit completion.
2. the method according to claim 1, wherein by the program file be respectively written into the first storage array and
Second storage array, specifically includes:
The program file is divided into the data block being sized, and is respectively written into the first buffer queue and second of buffer area
In buffer queue；Wherein, first buffer queue corresponds to the first storage array, and second buffer queue is corresponding in the
Two buffer queues；
The the first storage array, data in the second buffer queue are suitable is written into the data block order in the first buffer queue respectively
The second storage array is written in sequence.
3. according to the method described in claim 2, it is characterized in that, the buffer area further includes third buffer queue, described
Three buffer queues correspond to MD5 correction verification module；The method also includes:
MD5 correction verification module is written into data block in the third buffer queue, and executes the first MD5 verification；
Confirm that the first MD5 of the program file verification passes through.
4. the method according to claim 1, wherein being stored respectively described first according to the program file
First task mark and first task state and the second task identification in second storage array and second of array
Business state determines that the program file before first storage array and second storage array are reorganized and outfit successfully, is also wrapped
It includes:
According to task situation of the program file in first storage array and the second storage array, the respectively described section
Task identification and task status is arranged in mesh file；
Wherein, the task identification includes task and without task；The task status includes successfully, unsuccessfully and in execution.
5. according to the method described in claim 4, it is characterized in that, according to the program file respectively in the first storage battle array
The first task mark and first task state and the second task identification and the second task in second storage array of column
State determines that the program file reorganizes and outfit success in first storage array and second storage array, specifically includes:
When first storage array has task and Mission Success, determine the program file in first storage array
Reorganize and outfit success；And
When second storage array has task and Mission Success, determine the program file in second storage array
Reorganize and outfit success.
6. according to the method described in claim 5, it is characterized by further comprising:
When first storage array is without task or mission failure and second storage array has task and Mission Success
When, the program file is migrated from the second storage array to first storage array；Or
When first storage array has task and Mission Success and second storage array are without task or mission failure
When, the program file is migrated from the first storage array to second storage array.
7. method according to claim 5 or 6, which is characterized in that after determining that the program file is reorganized and outfit successfully, into one
Step includes:
The program file is obtained from first storage array or second storage array；
The corresponding broadcast channel of the program file according to program listing determines the video server collection for storing the program file
Group；Wherein, the video server cluster includes the first video server and the second video server, first Video service
Device and second video server mirror image each other；
The program file is stored to the first video server and the second video server into the video server cluster.
8. the method according to the description of claim 7 is characterized in that storing by the program file to the video server
Before the first video server and the second video server in cluster, further comprise:
2nd MD5 verification is carried out to the program file in first storage array or second storage array；
If the 2nd MD5 verification does not pass through, the 3rd MD5 verification is executed to the program file in another storage array；
Confirm that the 2nd MD5 verification or the 3rd MD5 verification pass through.
9. a kind of device for reconditioning of program file characterized by comprising
First read module, for reading program file from media resource system；
First writing module, for the program file to be respectively written into the first storage array and the second storage array, wherein institute
State the first storage array and the second storage array mirror image each other；First storage array and second storage array include
One or more storage servers；
First determining module, for determining the program file respectively in the first task mark of first storage array and the
One task status and the second task identification and the second task status in second storage array；Wherein, the task mark
Know for identifying storage array whether there is or not the corresponding task of the program file, the task status is executed for identifying storage array
The state of the corresponding task of the program file；
Second determining module, for according to the program file respectively first storage array first task mark and
First task state and the second task identification in second storage array and the second task status determine the program text
Part determines that the program file reorganizes and outfit completion when first storage array and second storage array are reorganized and outfit successfully.
10. device according to claim 9, which is characterized in that the first writing module specifically includes:
First write-in submodule, for the program file to be divided into the data block being sized, and is respectively written into buffer area
The first buffer queue and the second buffer queue in；Wherein, first buffer queue corresponds to the first storage array, and described the
Two buffer queues are corresponding in the second buffer queue；
Second write-in submodule, for the first storage array to be written, by the in the data block order in the first buffer queue respectively
Data in two buffer queues are sequentially written in the second storage array.
11. device according to claim 10, which is characterized in that the buffer area further includes third buffer queue, described
Third buffer queue corresponds to MD5 correction verification module；Described device further include:
First correction verification module for MD5 correction verification module to be written in the data block in the third buffer queue, and executes first
MD5 verification；
Third determining module, for confirming that the first MD5 of the program file verification passes through.
12. device according to claim 10, which is characterized in that further include:
Setup module, for the task feelings according to the program file in first storage array and the second storage array
Condition, the respectively described program file setting task identification and task status；
Wherein, the task identification includes task and without task；The task status includes successfully, unsuccessfully and in execution.
13. device according to claim 12, which is characterized in that the second determining module is specifically used for:
When first storage array has task and Mission Success, determine the program file in first storage array
Reorganize and outfit success；Or
When second storage array has task and Mission Success, determine the program file in second storage array
Reorganize and outfit success.
14. device according to claim 13, which is characterized in that further include:
Copy module, for first storage array without task or mission failure and second storage array have appoint
When business and Mission Success, the program file is copied to first storage array from the second storage array；Or
When first storage array has task and Mission Success and second storage array are without task or mission failure
When, the program file is copied to second storage array from the first storage array.
15. device described in 3 or 14 according to claim 1, which is characterized in that further comprise:
Second read module, for obtaining the program file from first storage array or second storage array；
4th determining module is used for the corresponding broadcast channel of the program file according to program listing, determines and stores the program
The video server cluster of file；Wherein, the video server cluster includes the first video server and the second Video service
Device, first video server and second video server mirror image each other；
Third writing module, for the program file to be stored to the first video server into the video server cluster
With the second video server.
16. device according to claim 15, which is characterized in that further comprise:
Second correction verification module, for being carried out to the program file in first storage array or second storage array
2nd MD5 verification；And the 2nd MD5 verification not by when, the is executed to the program file in another storage array
Three MD5 verification；
5th determining module, for confirming that the 2nd MD5 verification or the 3rd MD5 verification pass through.
17. a kind of program file reorganizes and outfit system characterized by comprising
Secondary storage system, for receiving and storing the program file from media resource system；The secondary storage system includes mutual
For the first storage array and the second storage array of mirror image；First storage array is stored with the first of the program file
Business mark and first task state, second storage array be stored with the program file the second task identification and second
Business state；Wherein, whether there is or not the corresponding task of the program file, the task shapes for identifying storage array for the task identification
State is for identifying the state that storage array executes the corresponding task of the program file；
Tertiary storage system, for according to the program file respectively first storage array first task mark and
First task state and the second task identification and the second task status in second storage array, determine the program
File receives and stores after first storage array and second storage array are reorganized and outfit successfully from the secondary storage
The program file of system；The tertiary storage system includes multiple video server clusters, and each video server cluster includes mutual
For the first video server and the second video server of mirror image.
18. system according to claim 17, which is characterized in that further include:
Correction verification module, for carrying out MD5 verification to the program file from media resource system；And to from secondary storage system
Program file carries out MD5 verification.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610854584.8A CN106412612B (en) | 2016-09-27 | 2016-09-27 | A kind of program file reorganizes and outfit method, apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610854584.8A CN106412612B (en) | 2016-09-27 | 2016-09-27 | A kind of program file reorganizes and outfit method, apparatus and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106412612A CN106412612A (en) | 2017-02-15 |
| CN106412612B true CN106412612B (en) | 2019-09-17 |
Family
ID=57997449
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610854584.8A Active CN106412612B (en) | 2016-09-27 | 2016-09-27 | A kind of program file reorganizes and outfit method, apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106412612B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101196840A (en) * | 2006-12-05 | 2008-06-11 | 国际商业机器公司 | System, method and program for configuring a data mirror |
| CN101562761A (en) * | 2009-05-18 | 2009-10-21 | 杭州华三通信技术有限公司 | Method and system for backup storage in optical network |
| CN101630281A (en) * | 2009-08-25 | 2010-01-20 | 杭州华三通信技术有限公司 | Image method and device of data storage |
| CN102855294A (en) * | 2012-08-13 | 2013-01-02 | 北京联创信安科技有限公司 | Intelligent hash data layout method, cluster storage system and method thereof |
| CN103095968A (en) * | 2012-12-28 | 2013-05-08 | 中央电视台 | Multi-scene self-adapting emergency handling method for broadcast system |
-
2016
- 2016-09-27 CN CN201610854584.8A patent/CN106412612B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101196840A (en) * | 2006-12-05 | 2008-06-11 | 国际商业机器公司 | System, method and program for configuring a data mirror |
| CN101562761A (en) * | 2009-05-18 | 2009-10-21 | 杭州华三通信技术有限公司 | Method and system for backup storage in optical network |
| CN101630281A (en) * | 2009-08-25 | 2010-01-20 | 杭州华三通信技术有限公司 | Image method and device of data storage |
| CN102855294A (en) * | 2012-08-13 | 2013-01-02 | 北京联创信安科技有限公司 | Intelligent hash data layout method, cluster storage system and method thereof |
| CN103095968A (en) * | 2012-12-28 | 2013-05-08 | 中央电视台 | Multi-scene self-adapting emergency handling method for broadcast system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106412612A (en) | 2017-02-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108268501B (en) | Service processing method and device in online data migration process | |
| KR20100070968A (en) | Cluster data management system and method for data recovery using parallel processing in cluster data management system | |
| CN105574217B (en) | The method of data synchronization and device of distributed relation database | |
| CN107590207A (en) | Method of data synchronization and device, electronic equipment | |
| US11474919B2 (en) | Method for managing multiple disks, electronic device and computer program product | |
| JP6260359B2 (en) | Data division processing program, data division processing device, and data division processing method | |
| CN105989059A (en) | Data record checking method and device | |
| US10346368B2 (en) | Method and apparatus of per-block-group journaling for ordered mode journaling file system | |
| CN109271360A (en) | Distributed objects storing data redundancy approach, device, equipment and storage medium | |
| CN105224244B (en) | A kind of method and apparatus of file storage | |
| EP3079065B1 (en) | Redo-logging for partitioned in-memory datasets | |
| CN105635311A (en) | Method for synchronizing resource pool information in cloud management platform | |
| CN109508912A (en) | A kind of business scheduling method, device, equipment and storage medium | |
| CN105701215A (en) | Hadoop MapReduce-based data connection method and device | |
| CN116501259A (en) | Disk group dual-activity synchronization method and device, computer equipment and storage medium | |
| CN108037894A (en) | A kind of disk space management method and device | |
| CN104268097B (en) | A kind of metadata processing method and system | |
| CN105607968A (en) | Incremental backup method and equipment | |
| CN109669621A (en) | A kind of file management method, file management system, electronic equipment and storage medium | |
| CN106682021A (en) | Database migration method and device | |
| CN106412612B (en) | A kind of program file reorganizes and outfit method, apparatus and system | |
| CN112306692B (en) | Method and device for group-in-group balancing of distributed storage system | |
| CN111522827B (en) | Data updating method and device and electronic equipment | |
| CN104378394A (en) | Method and device for updating server cluster file | |
| CN107992763A (en) | The power-off protection method and device of a kind of file system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |