CN105338374A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN105338374A CN105338374A CN201510719619.2A CN201510719619A CN105338374A CN 105338374 A CN105338374 A CN 105338374A CN 201510719619 A CN201510719619 A CN 201510719619A CN 105338374 A CN105338374 A CN 105338374A
- Authority
- CN
- China
- Prior art keywords
- multimedia file
- fragment
- processing unit
- video processing
- audio frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
Abstract
The present invention relates to a data processing method and device. The method comprises the following steps that: fragment aggregate information of multimedia files of video data and processed multimedia file fragments which are transmitted by a plurality of audio and video processing apparatuses are received; when a current receiving duration is larger than a preset receiving duration, whether un-received target multimedia file fragments exist is determined; when un-received target multimedia file fragments exist, a timeout request is transmitted to a dispatching device; corresponding target audio and video processing apparatuses are determined according to the timeout request, recorded audio and video processing apparatuses and corresponding relationships between tasks and the multimedia file fragments; and the current working states of the target audio and video processing apparatuses are obtained, and whether the target multimedia file fragments are transmitted to the other audio and video processing apparatuses is determined. With the data processing method and device provided by the technical schemes of the invention adopted, when anomalies occur on a certain audio and video processing apparatus, the anomalies can be discovered timely, and multimedia file fragments processed by the audio and video processing apparatus can be forwarded to the other audio and video processing apparatuses, and therefore, processing speed can be ensured.
Description
Technical field
The present invention relates to technical field of data processing, particularly relate to a kind of data processing method and device.
Background technology
Along with the development of network and cultural undertakings, audio and video resources extreme enrichment, also increases fast to the needs of the process of audio-video document.
The roughly flow process of audio-video document process is as follows: the audio-video document decapsulation that first need process becomes sequence of frames of video and audio frame sequence; Then sequence of frames of video and audio frame sequence are decoded as RAW form and PCM formatted data respectively; RAW form and PCM formatted data are processed; Be audio frame sequence and the sequence of frames of video of required form again by the data encoding of RAW form and PCM form; Finally audio frame sequence and sequence of frames of video are packaged into the file format of needs.
More than process is that the data processing equipment consisted of computer or computer has come, and these computers existing or data processing equipment are the process that the software and hardware resources of dependence the machine realizes to file.The amount of calculation of audio-video document process is huge, to the operational capability of processing unit and storage resource consumption very large, and along with the increasing of high resolution audio and video file and the continuous increase of processing demands, the bottleneck problem relying on unit to carry out audio-video document process becomes increasingly conspicuous, the slow and easily generation systems collapse of unit processing speed.Even if user uses the very high computer of configuration to be also difficult to ensure speed and the degree of stability of process, in enormous quantities and that time requirement is very high Processing tasks especially cannot be met.
In view of the above problem existed in prior art, provide a kind of distributed processing system(DPS), multiple stage computer or processing unit is used to realize parallel processing, and be that each device in distributed processing system(DPS) carries out task management by data processing method of the present invention, thus the time greatly reduced needed for process, reduce the processing pressure of system simultaneously, decrease the possibility of system crash.
Summary of the invention
The embodiment of the present invention provides a kind of data processing method and device, comprises following technical scheme:
According to the first aspect of the embodiment of the present invention, provide a kind of data processing method, for distributed processing system(DPS), described distributed processing system(DPS) comprises multiple audio frequency and video processing unit, and described method comprises:
Receive the fragment total number information of the multimedia file of the video data that described multiple audio frequency and video processing unit sends and the multimedia file fragment after processing;
According to the multimedia file fragment after described fragment total number information and the process that received determine current received duration be greater than preset receive duration time, whether there is the destination multimedia file fragmentation do not received;
When determining to there is described destination multimedia file fragmentation, send TIMEOUT to described dispatching device, described TIMEOUT comprises the identify label of described destination multimedia file fragmentation, and the identify label of task belonging to described destination multimedia file;
Control described dispatching device according to the corresponding relation between described TIMEOUT and the audio frequency and video processing unit recorded and task, multimedia file fragment, determine the target sound video process apparatus that described destination multimedia file fragmentation is corresponding;
Obtain the current operating state of described target video processing unit, determine whether other audio frequency and video processing unit be sent to by described destination multimedia file fragmentation in described multiple audio frequency and video processing unit according to described current operating state.
In one embodiment, described other audio frequency and video processing unit determining whether to be sent to by described destination multimedia file fragmentation in described multiple audio frequency and video processing unit according to described current operating state, comprising:
Judge that whether described current operating state is normal;
When judging that described current operating state is normal, ignoring described TIMEOUT, waiting for destination multimedia file fragmentation described in the process of described target sound video process apparatus;
When judging that described current operating state is abnormal, by described destination multimedia file fragmentation, other audio frequency and video processing unit be sent in described multiple audio frequency and video processing unit process.
In one embodiment, described system also comprises de-encapsulating devices, and before the multimedia file fragment after the fragment total number information receiving the multimedia file that described multiple audio frequency and video processing unit sends and process, described method also comprises:
Control described dispatching device and obtain described video data;
Control described de-encapsulating devices and decapsulation operation is carried out to described video data, to obtain the fragment total number information of described multimedia file fragment corresponding to described video data and described multimedia file;
Control described scheduler module described multimedia file fragment is distributed to multiple audio frequency and video processing unit processes.
In one embodiment, described according to the multimedia file fragment after described fragment total number information and the process that received determine current received duration be greater than preset receive duration time, whether there is the destination multimedia file fragmentation do not received, comprising:
Task corresponding to described multimedia file is created according to described fragment total number information, and generate fragment bitmap according to described fragment total number information, utilize the accepting state of multimedia file fragment described in described fragment bitmap record, wherein, figure place in described fragment bitmap is consistent with fragment sum, the fragment of every correspondence in described fragment bitmap, every in described fragment bitmap comprises the first state and the second state, described first state is for representing the multimedia file fragment after receiving process corresponding to institute's rheme, described second state is for representing the multimedia file fragment after not receiving process corresponding to institute's rheme,
Judge in described fragment bitmap, whether there is the target bit that the duration being in the second state is greater than described default reception duration;
When judging to there is described target bit in described fragment bitmap, determine that multimedia file fragment corresponding to described target bit is described destination multimedia file fragmentation.
In one embodiment, described method also comprises:
When after the multimedia file fragment after receiving all process corresponding to described video data, determine that the multimedia file fragment after to described all process carries out encapsulation operation, to obtain the video data after processing.
According to the second aspect of the embodiment of the present invention, provide a kind of data processing equipment, for distributed processing system(DPS), described distributed processing system(DPS) comprises multiple audio frequency and video processing unit, and described device comprises:
Receiver module, for receiving the fragment total number information of the multimedia file of the video data that described multiple audio frequency and video processing unit sends and the multimedia file fragment after processing;
First determination module, for determine according to the multimedia file fragment after described fragment total number information and the process that received current received duration be greater than preset receive duration time, whether there is the destination multimedia file fragmentation do not received;
Sending module, for when determining to there is described destination multimedia file fragmentation, send TIMEOUT to described dispatching device, described TIMEOUT comprises the identify label of described destination multimedia file fragmentation, and the identify label of task belonging to described destination multimedia file;
Second determination module, for controlling described dispatching device according to the corresponding relation between described TIMEOUT and the audio frequency and video processing unit recorded and task, multimedia file fragment, determine the target sound video process apparatus that described destination multimedia file fragmentation is corresponding;
3rd determination module, for obtaining the current operating state of described target video processing unit, determine whether other audio frequency and video processing unit be sent to by described destination multimedia file fragmentation in described multiple audio frequency and video processing unit according to described current operating state.
In one embodiment, described 3rd determination module comprises:
Judge submodule, for judging that whether described current operating state is normal;
Ignoring submodule, for when judging that described current operating state is normal, ignoring described TIMEOUT, wait for destination multimedia file fragmentation described in the process of described target sound video process apparatus;
Send submodule, for when judging that described current operating state is abnormal, by described destination multimedia file fragmentation, other audio frequency and video processing unit be sent in described multiple audio frequency and video processing unit process.
In one embodiment, described system also comprises de-encapsulating devices, and described device also comprises:
Acquisition module, before the multimedia file fragment after the fragment total number information receiving the multimedia file that described multiple audio frequency and video processing unit sends and process, controls described dispatching device and obtains described video data;
Decapsulation module, carries out decapsulation operation for controlling described de-encapsulating devices to described video data, to obtain the fragment total number information of described multimedia file fragment corresponding to described video data and described multimedia file;
Distribution module, is distributed to multiple audio frequency and video processing unit by described multimedia file fragment processes for controlling described scheduler module.
In one embodiment, described first determination module comprises:
Record sub module, for creating task corresponding to described multimedia file according to described fragment total number information, and generate fragment bitmap according to described fragment total number information, utilize the accepting state of multimedia file fragment described in described fragment bitmap record, wherein, figure place in described fragment bitmap is consistent with fragment sum, the fragment of every correspondence in described fragment bitmap, every in described fragment bitmap comprises the first state and the second state, described first state is for representing the multimedia file fragment after receiving process corresponding to institute's rheme, described second state is for representing the multimedia file fragment after not receiving process corresponding to institute's rheme,
Judging submodule, for judging in described fragment bitmap, whether there is the target bit that the duration being in the second state is greater than described default reception duration;
Determining submodule, for when judging to there is described target bit in described fragment bitmap, determining that multimedia file fragment corresponding to described target bit is described destination multimedia file fragmentation.
In one embodiment, described device also comprises:
Package module, for after receiving the multimedia file fragment after all process corresponding to described video data, determines that the multimedia file fragment after to described all process carries out encapsulation operation, to obtain the video data after processing.
The technical scheme that embodiments of the invention provide can comprise following beneficial effect:
Technique scheme, during multimedia file fragment after receiving the process that multiple audio frequency and video processing unit sends, if when exceeding default reception duration, still there is the destination multimedia file fragmentation do not received, then determine the target sound video process apparatus corresponding to destination multimedia file fragmentation, and then obtain the operating state of target sound video process apparatus, determine whether it exception occurs according to its operating state, thus determine whether that destination multimedia file fragmentation being sent to other audio frequency and video processing unit processes, like this, when audio frequency and video processing unit occurs abnormal, can Timeliness coverage, and the multimedia fragment file processed in time is delivered other audio frequency and video processing unit and is processed, thus guarantee processing speed.
Should be understood that, it is only exemplary and explanatory that above general description and details hereinafter describe, and can not limit the present invention.
Accompanying drawing explanation
Accompanying drawing to be herein merged in specification and to form the part of this specification, shows embodiment according to the invention, and is used from specification one and explains principle of the present invention.
Fig. 1 is the flow chart of the data processing method according to an exemplary embodiment.
Fig. 2 is the flow chart of step S105 in the data processing method according to an exemplary embodiment.
Fig. 3 is the flow chart of the another kind of data processing method according to an exemplary embodiment.
Fig. 4 is the flow chart of step S102 in the data processing method according to an exemplary embodiment.
Fig. 5 is the flow chart of another data processing method according to an exemplary embodiment.
Fig. 6 is the block diagram of the data processing equipment according to an exemplary embodiment.
Fig. 7 is the block diagram of Data processing the 3rd determination module according to an exemplary embodiment.
Fig. 8 is the block diagram of the another kind of data processing equipment according to an exemplary embodiment.
Fig. 9 is the block diagram of Data processing first determination module according to an exemplary embodiment.
The block diagram of another data processing equipment of Figure 10 according to an exemplary embodiment.
Embodiment
Here will be described exemplary embodiment in detail, its sample table shows in the accompanying drawings.When description below relates to accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawing represents same or analogous key element.Execution mode described in following exemplary embodiment does not represent all execution modes consistent with the present invention.On the contrary, they only with as in appended claims describe in detail, the example of apparatus and method that aspects more of the present invention are consistent.
Embodiments provide a kind of data processing method, as shown in Figure 1, the method comprising the steps of S101-S105:
In step S101, receive the fragment total number information of the multimedia file of the video data that multiple audio frequency and video processing unit sends and the multimedia file fragment after processing;
In step s 102, according to the multimedia file fragment after fragment total number information and the process that received determine current received duration be greater than preset receive duration time, whether there is the destination multimedia file fragmentation do not received;
In step s 103, when determining to there is destination multimedia file fragmentation, send TIMEOUT to dispatching device, TIMEOUT comprises the identify label of destination multimedia file fragmentation, and the identify label of task belonging to destination multimedia file;
In step S104, Control and Schedule device, according to the corresponding relation between TIMEOUT and the audio frequency and video processing unit recorded and task, multimedia file fragment, determines the target sound video process apparatus that destination multimedia file fragmentation is corresponding;
In step S105, obtain the current operating state of target video processing unit, determine whether other audio frequency and video processing unit be sent to by destination multimedia file fragmentation in multiple audio frequency and video processing unit according to current operating state.
In this embodiment, during multimedia file fragment after receiving the process that multiple audio frequency and video processing unit sends, if when exceeding default reception duration, still there is the destination multimedia file fragmentation do not received, then determine the target sound video process apparatus corresponding to destination multimedia file fragmentation, and then obtain the operating state of target sound video process apparatus, determine whether it exception occurs according to its operating state, thus determine whether that destination multimedia file fragmentation being sent to other audio frequency and video processing unit processes, like this, when audio frequency and video processing unit occurs abnormal, can Timeliness coverage, and the multimedia fragment file processed in time is delivered other audio frequency and video processing unit and is processed, thus guarantee processing speed.
As shown in Figure 2, in one embodiment, above-mentioned steps S105 comprises step S201-S203:
In step s 201, judge that whether current operating state is normal;
In step S202, when judging that current operating state is normal, ignoring TIMEOUT, waiting for target sound video process apparatus processing target multimedia file fragment;
In step S203, when judging that current operating state is abnormal, other audio frequency and video processing unit be sent to by destination multimedia file fragmentation in multiple audio frequency and video processing unit process.
In this embodiment, when not receiving destination multimedia file fragmentation in default reception duration, judge that whether the current operating state of the target sound video process apparatus of its correspondence is normal, if its current operating state is normal, then TIMEOUT can be ignored, wait for that this target sound video process apparatus is disposed, if its current operating state is abnormal, such as, target sound video process apparatus power-off etc. detected, then this destination multimedia file fragmentation is sent to other audio frequency and video processing unit, thus ensure that destination multimedia file fragmentation can be processed in time, ensure the processing speed of distributed processing system(DPS).
As shown in Figure 3, in one embodiment, distributed processing system(DPS) also comprises de-encapsulating devices, then, before the multimedia file fragment after the fragment total number information receiving the multimedia file that multiple audio frequency and video processing unit sends and process, method also comprises step S301-S303:
In step S301, Control and Schedule device obtains video data;
In step s 302, control de-encapsulating devices and decapsulation operation is carried out to video data, to obtain the fragment total number information of multimedia file fragment corresponding to video data and multimedia file;
In step S303, multimedia file fragment is distributed to multiple audio frequency and video processing unit and processes by Control and Schedule module.
In this embodiment, use multiple audio frequency and video processing unit to carry out parallel processing to video file, greatly reduce the time needed for process, reduce the processing pressure of system simultaneously, decrease the possibility of system crash.
As shown in Figure 4, in one embodiment, above-mentioned steps S102 comprises step S401-S403:
In step S401, task corresponding to multimedia file is created according to fragment total number information, and generate fragment bitmap according to fragment total number information, utilize the accepting state of fragment bitmap record multimedia file fragment, wherein, figure place in fragment bitmap is consistent with fragment sum, the fragment of every correspondence in fragment bitmap, every in fragment bitmap comprises the first state and the second state, first state is for representing the multimedia file fragment after receiving the corresponding process that puts in place, second state is for representing the multimedia file fragment after not receiving the corresponding process that puts in place,
In step S402, judge in fragment bitmap, whether there is the duration being in the second state and be greater than the target bit preset and receive duration;
In step S403, when judging to there is target bit in fragment bitmap, determine that multimedia file fragment corresponding to target bit is destination multimedia file fragmentation.
In this embodiment, can by the treatment state of each multimedia file fragment after fragment bitmap recording processing, in fragment bitmap, the accepting state of identification of multimedia fragment is carried out with different numerical value, as when not receiving the multimedia fragment in fragment bitmap after this corresponding process, this position represents with 0, and when receiving the multimedia fragment in fragment bitmap after this corresponding process, this position represents with 1.Certain duration being in 0 be greater than preset receive duration time, then this corresponding destination multimedia file fragmentation process time-out is described, can TIMEOUT be sent.Like this, with the accepting state of fragment bitmap record multimedia fragment, cheer and bright, be convenient to check.
As shown in Figure 5, in one embodiment, method also comprises step S501:
In step S501, when after the multimedia file fragment after receiving all process corresponding to video data, determine that the multimedia file fragment after to all process carries out encapsulation operation, to obtain the video data after processing.
In this embodiment, when after the multimedia fragment after receiving all process, namely when all positions of bitmap are 1, namely represent that reception is complete.Receive complete after, namely Voice & Video all receives complete, then start to encapsulate.During encapsulation, read the data of each fragment according to the order of sequence, encapsulate.
Following is apparatus of the present invention embodiment, may be used for performing the inventive method embodiment.
Fig. 6 is the block diagram of a kind of data processing equipment according to an exemplary embodiment, and as shown in Figure 6, this data processing equipment comprises:
Receiver module 61, for receiving the fragment total number information of the multimedia file of the video data that described multiple audio frequency and video processing unit sends and the multimedia file fragment after processing;
First determination module 62, for determine according to the multimedia file fragment after described fragment total number information and the process that received current received duration be greater than preset receive duration time, whether there is the destination multimedia file fragmentation do not received;
Sending module 63, for when determining to there is described destination multimedia file fragmentation, send TIMEOUT to described dispatching device, described TIMEOUT comprises the identify label of described destination multimedia file fragmentation, and the identify label of task belonging to described destination multimedia file;
Second determination module 64, for controlling described dispatching device according to the corresponding relation between described TIMEOUT and the audio frequency and video processing unit recorded and task, multimedia file fragment, determine the target sound video process apparatus that described destination multimedia file fragmentation is corresponding;
3rd determination module 65, for obtaining the current operating state of described target video processing unit, determine whether other audio frequency and video processing unit be sent to by described destination multimedia file fragmentation in described multiple audio frequency and video processing unit according to described current operating state.
As shown in Figure 7, in one embodiment, described 3rd determination module 65 comprises:
Judge submodule 71, for judging that whether described current operating state is normal;
Ignoring submodule 72, for when judging that described current operating state is normal, ignoring described TIMEOUT, wait for destination multimedia file fragmentation described in the process of described target sound video process apparatus;
Send submodule 73, for when judging that described current operating state is abnormal, by described destination multimedia file fragmentation, other audio frequency and video processing unit be sent in described multiple audio frequency and video processing unit process.
As shown in Figure 8, in one embodiment, described system also comprises de-encapsulating devices, and described device also comprises:
Acquisition module 81, before the multimedia file fragment after the fragment total number information receiving the multimedia file that described multiple audio frequency and video processing unit sends and process, controls described dispatching device and obtains described video data;
Decapsulation module 82, carries out decapsulation operation for controlling described de-encapsulating devices to described video data, to obtain the fragment total number information of described multimedia file fragment corresponding to described video data and described multimedia file;
Distribution module 83, is distributed to multiple audio frequency and video processing unit by described multimedia file fragment processes for controlling described scheduler module.
As shown in Figure 9, in one embodiment, described first determination module 62 comprises:
Record sub module 91, for creating task corresponding to described multimedia file according to described fragment total number information, and generate fragment bitmap according to described fragment total number information, utilize the accepting state of multimedia file fragment described in described fragment bitmap record, wherein, figure place in described fragment bitmap is consistent with fragment sum, the fragment of every correspondence in described fragment bitmap, every in described fragment bitmap comprises the first state and the second state, described first state is for representing the multimedia file fragment after receiving process corresponding to institute's rheme, described second state is for representing the multimedia file fragment after not receiving process corresponding to institute's rheme,
Judging submodule 92, for judging in described fragment bitmap, whether there is the target bit that the duration being in the second state is greater than described default reception duration;
Determining submodule 93, for when judging to there is described target bit in described fragment bitmap, determining that multimedia file fragment corresponding to described target bit is described destination multimedia file fragmentation.
As shown in Figure 10, in one embodiment, described device also comprises:
Package module 101, for after receiving the multimedia file fragment after all process corresponding to described video data, determines that the multimedia file fragment after to described all process carries out encapsulation operation, to obtain the video data after processing.
About the device in above-described embodiment, wherein the concrete mode of modules executable operations has been described in detail in about the embodiment of the method, will not elaborate explanation herein.
Those skilled in the art should understand, embodiments of the invention can be provided as method, system or computer program.Therefore, the present invention can adopt the form of complete hardware embodiment, completely software implementation or the embodiment in conjunction with software and hardware aspect.And the present invention can adopt in one or more form wherein including the upper computer program implemented of computer-usable storage medium (including but not limited to magnetic disc store and optical memory etc.) of computer usable program code.
The present invention describes with reference to according to the flow chart of the method for the embodiment of the present invention, equipment (system) and computer program and/or block diagram.Should understand can by the combination of the flow process in each flow process in computer program instructions realization flow figure and/or block diagram and/or square frame and flow chart and/or block diagram and/or square frame.These computer program instructions can being provided to the processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device to produce a machine, making the instruction performed by the processor of computer or other programmable data processing device produce device for realizing the function of specifying in flow chart flow process or multiple flow process and/or block diagram square frame or multiple square frame.
These computer program instructions also can be stored in can in the computer-readable memory that works in a specific way of vectoring computer or other programmable data processing device, the instruction making to be stored in this computer-readable memory produces the manufacture comprising command device, and this command device realizes the function of specifying in flow chart flow process or multiple flow process and/or block diagram square frame or multiple square frame.
These computer program instructions also can be loaded in computer or other programmable data processing device, make on computer or other programmable devices, to perform sequence of operations step to produce computer implemented process, thus the instruction performed on computer or other programmable devices is provided for the step realizing the function of specifying in flow chart flow process or multiple flow process and/or block diagram square frame or multiple square frame.
Obviously, those skilled in the art can carry out various change and modification to the present invention and not depart from the spirit and scope of the present invention.Like this, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification.
Claims (10)
1. a data processing method, for distributed processing system(DPS), described distributed processing system(DPS) comprises multiple audio frequency and video processing unit, it is characterized in that, described method comprises:
Receive the fragment total number information of the multimedia file of the video data that described multiple audio frequency and video processing unit sends and the multimedia file fragment after processing;
According to the multimedia file fragment after described fragment total number information and the process that received determine current received duration be greater than preset receive duration time, whether there is the destination multimedia file fragmentation do not received;
When determining to there is described destination multimedia file fragmentation, send TIMEOUT to described dispatching device, described TIMEOUT comprises the identify label of described destination multimedia file fragmentation, and the identify label of task belonging to described destination multimedia file;
Control described dispatching device according to the corresponding relation between described TIMEOUT and the audio frequency and video processing unit recorded and task, multimedia file fragment, determine the target sound video process apparatus that described destination multimedia file fragmentation is corresponding;
Obtain the current operating state of described target video processing unit, determine whether other audio frequency and video processing unit be sent to by described destination multimedia file fragmentation in described multiple audio frequency and video processing unit according to described current operating state.
2. method according to claim 1, is characterized in that, described other audio frequency and video processing unit determining whether to be sent to by described destination multimedia file fragmentation in described multiple audio frequency and video processing unit according to described current operating state, comprising:
Judge that whether described current operating state is normal;
When judging that described current operating state is normal, ignoring described TIMEOUT, waiting for destination multimedia file fragmentation described in the process of described target sound video process apparatus;
When judging that described current operating state is abnormal, by described destination multimedia file fragmentation, other audio frequency and video processing unit be sent in described multiple audio frequency and video processing unit process.
3. method according to claim 1, it is characterized in that, described system also comprises de-encapsulating devices, and before the multimedia file fragment after the fragment total number information receiving the multimedia file that described multiple audio frequency and video processing unit sends and process, described method also comprises:
Control described dispatching device and obtain described video data;
Control described de-encapsulating devices and decapsulation operation is carried out to described video data, to obtain the fragment total number information of described multimedia file fragment corresponding to described video data and described multimedia file;
Control described scheduler module described multimedia file fragment is distributed to multiple audio frequency and video processing unit processes.
4. method according to claim 1, it is characterized in that, described according to the multimedia file fragment after described fragment total number information and the process that received determine current received duration be greater than preset receive duration time, whether there is the destination multimedia file fragmentation do not received, comprising:
Task corresponding to described multimedia file is created according to described fragment total number information, and generate fragment bitmap according to described fragment total number information, utilize the accepting state of multimedia file fragment described in described fragment bitmap record, wherein, figure place in described fragment bitmap is consistent with fragment sum, the fragment of every correspondence in described fragment bitmap, every in described fragment bitmap comprises the first state and the second state, described first state is for representing the multimedia file fragment after receiving process corresponding to institute's rheme, described second state is for representing the multimedia file fragment after not receiving process corresponding to institute's rheme,
Judge in described fragment bitmap, whether there is the target bit that the duration being in the second state is greater than described default reception duration;
When judging to there is described target bit in described fragment bitmap, determine that multimedia file fragment corresponding to described target bit is described destination multimedia file fragmentation.
5. method according to claim 1, is characterized in that, described method also comprises:
When after the multimedia file fragment after receiving all process corresponding to described video data, determine that the multimedia file fragment after to described all process carries out encapsulation operation, to obtain the video data after processing.
6. a data processing equipment, for distributed processing system(DPS), described distributed processing system(DPS) comprises multiple audio frequency and video processing unit, it is characterized in that, described device comprises:
Receiver module, for receiving the fragment total number information of the multimedia file of the video data that described multiple audio frequency and video processing unit sends and the multimedia file fragment after processing;
First determination module, for determine according to the multimedia file fragment after described fragment total number information and the process that received current received duration be greater than preset receive duration time, whether there is the destination multimedia file fragmentation do not received;
Sending module, for when determining to there is described destination multimedia file fragmentation, send TIMEOUT to described dispatching device, described TIMEOUT comprises the identify label of described destination multimedia file fragmentation, and the identify label of task belonging to described destination multimedia file;
Second determination module, for controlling described dispatching device according to the corresponding relation between described TIMEOUT and the audio frequency and video processing unit recorded and task, multimedia file fragment, determine the target sound video process apparatus that described destination multimedia file fragmentation is corresponding;
3rd determination module, for obtaining the current operating state of described target video processing unit, determine whether other audio frequency and video processing unit be sent to by described destination multimedia file fragmentation in described multiple audio frequency and video processing unit according to described current operating state.
7. device according to claim 6, is characterized in that, described 3rd determination module comprises:
Judge submodule, for judging that whether described current operating state is normal;
Ignoring submodule, for when judging that described current operating state is normal, ignoring described TIMEOUT, wait for destination multimedia file fragmentation described in the process of described target sound video process apparatus;
Send submodule, for when judging that described current operating state is abnormal, by described destination multimedia file fragmentation, other audio frequency and video processing unit be sent in described multiple audio frequency and video processing unit process.
8. device according to claim 6, is characterized in that, described system also comprises de-encapsulating devices, and described device also comprises:
Acquisition module, before the multimedia file fragment after the fragment total number information receiving the multimedia file that described multiple audio frequency and video processing unit sends and process, controls described dispatching device and obtains described video data;
Decapsulation module, carries out decapsulation operation for controlling described de-encapsulating devices to described video data, to obtain the fragment total number information of described multimedia file fragment corresponding to described video data and described multimedia file;
Distribution module, is distributed to multiple audio frequency and video processing unit by described multimedia file fragment processes for controlling described scheduler module.
9. device according to claim 6, is characterized in that, described first determination module comprises:
Record sub module, for creating task corresponding to described multimedia file according to described fragment total number information, and generate fragment bitmap according to described fragment total number information, utilize the accepting state of multimedia file fragment described in described fragment bitmap record, wherein, figure place in described fragment bitmap is consistent with fragment sum, the fragment of every correspondence in described fragment bitmap, every in described fragment bitmap comprises the first state and the second state, described first state is for representing the multimedia file fragment after receiving process corresponding to institute's rheme, described second state is for representing the multimedia file fragment after not receiving process corresponding to institute's rheme,
Judging submodule, for judging in described fragment bitmap, whether there is the target bit that the duration being in the second state is greater than described default reception duration;
Determining submodule, for when judging to there is described target bit in described fragment bitmap, determining that multimedia file fragment corresponding to described target bit is described destination multimedia file fragmentation.
10. device according to claim 6, is characterized in that, described device also comprises:
Package module, for after receiving the multimedia file fragment after all process corresponding to described video data, determines that the multimedia file fragment after to described all process carries out encapsulation operation, to obtain the video data after processing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510719619.2A CN105338374A (en) | 2015-10-29 | 2015-10-29 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510719619.2A CN105338374A (en) | 2015-10-29 | 2015-10-29 | Data processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105338374A true CN105338374A (en) | 2016-02-17 |
Family
ID=55288601
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510719619.2A Pending CN105338374A (en) | 2015-10-29 | 2015-10-29 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105338374A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101917386A (en) * | 2009-11-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Cluster multimedia transcoding system and task processing method thereof |
| CN102123279A (en) * | 2010-12-28 | 2011-07-13 | 乐视网信息技术（北京）股份有限公司 | Distributed real-time transcoding method and system |
| US8346882B2 (en) * | 2003-06-04 | 2013-01-01 | Sony Computer Entertainment Inc. | Method for structuring a self-organized content distribution overlay network for a peer-to-peer network |
| CN103838878A (en) * | 2014-03-27 | 2014-06-04 | 无锡天脉聚源传媒科技有限公司 | Distributed type audio and video processing system and processing method |
-
2015
- 2015-10-29 CN CN201510719619.2A patent/CN105338374A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8346882B2 (en) * | 2003-06-04 | 2013-01-01 | Sony Computer Entertainment Inc. | Method for structuring a self-organized content distribution overlay network for a peer-to-peer network |
| CN101917386A (en) * | 2009-11-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Cluster multimedia transcoding system and task processing method thereof |
| CN102123279A (en) * | 2010-12-28 | 2011-07-13 | 乐视网信息技术（北京）股份有限公司 | Distributed real-time transcoding method and system |
| CN103838878A (en) * | 2014-03-27 | 2014-06-04 | 无锡天脉聚源传媒科技有限公司 | Distributed type audio and video processing system and processing method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102413150B (en) | Server and virtual desktop control method and virtual desktop control system | |
| CN108989885B (en) | Video file transcoding system, segmentation method, transcoding method and device | |
| CN103473142B (en) | Virtual machine migration method under a kind of cloud computing operating system and device | |
| KR101941336B1 (en) | File processing method and device for distributed systems | |
| EP3036911B1 (en) | Method, terminal, and system for reproducing content | |
| CN104703022A (en) | Apparatus and method for screen sharing | |
| US11201836B2 (en) | Method and device for managing stateful application on server | |
| CN108064086B (en) | Bandwidth allocation method and device, computer equipment and storage medium | |
| CN110602122A (en) | Video processing method and device, electronic equipment and storage medium | |
| JP5802215B2 (en) | Program, computer system and method for processing streams with multiple granularities | |
| EP4246965A2 (en) | Method and device, equipment, and storage medium for data processing | |
| CN101668018A (en) | Network transmission method and system therefor | |
| CN113381889B (en) | Network slice determination method and device, electronic equipment and storage medium | |
| WO2016048734A1 (en) | Processing parameters for operations on blocks while decoding images | |
| US20180227347A1 (en) | Virtualizing audio and video devices using synchronous a/v streaming | |
| CN103905843A (en) | Distributed audio/video processing device and method for continuous frame-I circumvention | |
| WO2012009150A2 (en) | Direct memory access engine physical memory descriptors for multi-media demultiplexing operations | |
| CN105354058A (en) | File updating method and apparatus | |
| CN105338374A (en) | Data processing method and device | |
| CN105812327A (en) | Combination high performance multifunctional communication method and system thereof | |
| CN105354080B (en) | A kind of task processing method and device | |
| CN111459653B (en) | Cluster scheduling method, device and system and electronic equipment | |
| CN101272211A (en) | Service cross software test method and system | |
| CN105302645A (en) | Task distribution method and apparatus | |
| CN113791735A (en) | Video data storage method and device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160217 |