CN103686207A - Transcoding task scheduling method and system - Google Patents
Transcoding task scheduling method and system Download PDFInfo
- Publication number
- CN103686207A CN103686207A CN201310646742.7A CN201310646742A CN103686207A CN 103686207 A CN103686207 A CN 103686207A CN 201310646742 A CN201310646742 A CN 201310646742A CN 103686207 A CN103686207 A CN 103686207A
- Authority
- CN
- China
- Prior art keywords
- transcoding
- score value
- video
- task
- transcoding task
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a transcoding task scheduling method and system. The method comprises the steps of acquiring corresponding video attribute information from a video to be transcoded and generating transcoding tasks containing score label information based on a preset score rule, placing the transcoding tasks containing the score label information in corresponding resource pool queues according to a preset score grading rule, and conducting transcoding on the transcoding tasks in each resource pool queue based on the first-in first-out processing mechanism. According to the transcoding task scheduling method and system, judgment of the priority and code rate of the video to be transcoded is conducted according to a preset video attribute rule, grouping is conducted at the same time according to the performance of a transcoding machine, and therefore the problem that current transcoding machines of video websites can not conduct transcoding task scheduling reasonably according to the state of a server and transcoding task attributes is effectively solved.
Description
Technical field
The application relates to video code conversion field, more specifically, relates to a kind of dispatching method and system of transcoding task.
Background technology
Video website converts abundant video resource to the form that is suitable for netcast, thereby people just can access corresponding video website by terminal, mobile terminal or the television terminal with network savvy and watch all kinds of videos.
For different video resources, it has different video formats, not all video format is all suitable for Internet Transmission and plays, conventionally, the video that video website can be converted to different video resources " .flv " and " .mp4 " form carries out Internet Transmission again, wherein, " .flv " form is suitable for television terminal transmission and plays, and " .mp4 " form is suitable for computer and mobile terminal network transmission and plays.That is to say, video website need to be set up transcoding task, carries out corresponding transcoding task carry out video code conversion processing by its inner trans-coding system.
In prior art, because video code conversion processing need to expend the longer time, in order to guarantee task amount, video website use tens or up to a hundred transcoding machines (as: transcoding server) carry out video code conversion.Because the model of transcoding machine is different, its handling property is not identical, and the speed that causes transcoding to process has dividing of height.So, just need to carry out suitable scheduling to different transcoding tasks, to make full use of the performance of transcoding machine, complete the different transcodings processing that require.But still there is following problem for the scheduling of transcoding task in video website at present:
1, the priority that can not reach the standard grade according to transcoding task is dispatched, and as: the task of Domestic News class must complete with the fastest speed the broadcasting of reaching the standard grade of transcoding task, need to carry out transcoding by high performance server; And the isometric video task of TV play can be reached the standard grade by suitable time-delay transcoding, can carry out transcoding by the server of low performance.But at present the transcoding machine of video website is only sequentially carried out according to the task in task list, can not flexible dispatching, cause the video that priority is high not issue in time.
2, can not dispatch according to the height of the code check of video resource, as: with regard to same film source, the transcoding efficiency of low code check is higher than the transcoding efficiency of high code, so for broadcasting that film source is reached the standard grade as early as possible, the low code check task transcoding time started should be early than the high code check task of same film source, meanwhile, the server performance that low code check task is distributed should be better than or equal the server that high code check task is distributed.But the current transcoding machine of video website, can not flexible dispatching, causes video code conversion efficiency low, can not issue in time video.
3, can not guarantee the fast transcoding of some particular task, as: carrying out Spring Festival Gala when live, all live tasks must complete fast, and needing sufficient server is that live task is carried out transcoding processing, can not cause live task not complete fast because of other tasks.Equally, the transcoding machine of video website is only sequentially carried out according to the task in task list at present, is difficult to guarantee the fast transcoding of some particular task, causes live video not issue in time.
4, can not make full use of the performance of server, under normal circumstances, what transcoding task should be average is assigned on every transcoding machine, makes the cpu busy percentage of every station server close.But the transcoding task of the transcoding machine of video website is Random assignment at present, can not dispatch, and causes the utilance of every station server inhomogeneous, waste transcoding resource.
Therefore, how solution must not rationally be carried out transcoding task scheduling according to server state and transcoding task attribute, just becomes technical problem urgently to be resolved hurrily.
Summary of the invention
In view of this, the application's technical problem to be solved has been to provide a kind of dispatching method and system of transcoding task, with solution, must not rationally carry out the problem of transcoding task scheduling according to server state and transcoding task attribute.
In order to solve the problems of the technologies described above, the application discloses a kind of dispatching method of transcoding task, comprising:
From need to carry out the video of transcoding, obtain corresponding video attribute information, and generate the transcoding task with score value label information in conjunction with preset score value rule;
By the described transcoding task with score value label information, according to preset score value grade classification, enter corresponding resource pool queue;
To the described transcoding task in each resource pool queue, according to first in first out treatment mechanism, carry out transcoding processing.
Preferably, to the described transcoding task in each resource pool queue, according to first in first out treatment mechanism, carry out transcoding processing, comprising:
To thering is the described transcoding task of special tag in each resource pool, extract, and seize the transcoding task of carrying out transcoding processing according to first in first out treatment mechanism, this transcoding task suspension being preempted is processed, preferentially to thering is the described transcoding task of special tag, process simultaneously, this transcoding task being preempted is discharged to the described transcoding task with special tag and according to described first in first out treatment mechanism, carries out again transcoding processing afterwards.
Preferably, the video attribute information of obtaining from described video generates the transcoding task with score value label information in conjunction with preset score value rule, is specially:
The preset different corresponding score value of video attribute information, forms described score value rule;
The video attribute information of obtaining from described video, generates the transcoding task with score value label information in conjunction with described score value rule.
Preferably, the preset different corresponding score value of video attribute information, forms described score value rule, is specially:
Described video attribute information comprises: physical attribute and service attribute; Different physical attributes and the different corresponding different score values of service attribute are set;
To the included physical attribute of the video attribute information of described video and service attribute score value the summation that adds up of correspondence respectively, draw the score value corresponding to video attribute information of this video, form described score value rule.
Preferably, described first in first out treatment mechanism, comprising:
To thering is the transcoding task of different score value label informations in each resource pool queue, according to creation-time, divide and successively process, the transcoding task identical to creation-time, then carry out first reprocessing according to the size of score value label information described in it.
In order to solve the problems of the technologies described above, disclosed herein as well is a kind of dispatching patcher of transcoding task, this system comprises: task generation unit, queue division unit and transcoding units, wherein,
Described task generation unit, for obtaining corresponding video attribute information from carrying out the video of transcoding, and the transcoding task that has score value label information in conjunction with the regular generation of preset score value is sent to described queue division unit;
Described queue division unit, for by the described transcoding task with score value label information, enters corresponding resource pool queue according to preset score value grade classification;
Described transcoding units, for the described transcoding task to each resource pool queue, carries out transcoding processing according to first in first out treatment mechanism.
Preferably, this system also comprises: special processing unit, for each resource pool being there is to the described transcoding task of special tag, extract, and seize the transcoding task of carrying out transcoding processing according to first in first out treatment mechanism, this transcoding task suspension being preempted is processed, preferentially to thering is the described transcoding task of special tag, process simultaneously, this transcoding task being preempted is discharged to the described transcoding task with special tag and according to described first in first out treatment mechanism, carries out again transcoding processing afterwards.
Preferably, described task generation unit, specifically for:
The preset different corresponding score value of video attribute information, forms described score value rule;
The video attribute information of obtaining from described video, generates the transcoding task with score value label information in conjunction with described score value rule;
Wherein, described video attribute information comprises: physical attribute and service attribute.
Preferably, described task generation unit, specifically for:
Different described physical attributes and the different corresponding different score values of described service attribute are set;
To its included physical attribute of the video attribute information analysis of described video and service attribute score value the summation that adds up of correspondence respectively, draw the score value corresponding to video attribute information of this video, form described score value rule.
Preferably, described first in first out treatment mechanism, is specially:
To thering is the transcoding task of different score value label informations in each resource pool queue, according to creation-time, divide and successively process, the transcoding task identical to creation-time, then carry out first reprocessing according to the size of score value label information described in it.
Compared with prior art, dispatching method and the system of a kind of transcoding task described in the application, reached following effect:
1) attribution rule of the application by setting in advance video is to needing the video of transcoding to carry out the judgement of priority, code check height, according to the performance of transcoding machine, divide into groups, the transcoding machine that efficiently solves current video website can not rationally carry out the problem of transcoding task scheduling according to server state and transcoding task attribute simultaneously.
2) the application can carry out role's configuration to different transcoding machines, delimit different transcoding tasks and process object, especially for particular video frequency transcoding task, by the specific transcoding machine of delimiting, processed specially, thereby can effectively guarantee the fast transcoding of some particular task, important video is issued in time.
Certainly, arbitrary product of enforcement the application must not necessarily need to reach above-described all technique effects simultaneously.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide further understanding of the present application, forms the application's a part, and the application's schematic description and description is used for explaining the application, does not form the improper restriction to the application.In the accompanying drawings:
Fig. 1 is the flow chart of the dispatching method of the transcoding task described in the embodiment of the present application one.
Fig. 2 is the flow chart of the dispatching method of the transcoding task described in the embodiment of the present application two and three.
Fig. 3 is the structured flowchart of the dispatching patcher of the transcoding task described in the embodiment of the present application five.
Fig. 4 is the structured flowchart of the dispatching patcher of the transcoding task described in the embodiment of the present application six.
Embodiment
As used some vocabulary in the middle of specification and claim, censure specific components.Those skilled in the art should understand, and hardware manufacturer may be called same assembly with different nouns.This specification and claims are not used as distinguishing the mode of assembly with the difference of title, but the difference in function is used as the criterion of distinguishing with assembly.If " comprising " mentioned in the middle of specification and claim is in the whole text an open language, therefore should be construed to " comprise but be not limited to "." roughly " refer to that in receivable error range, those skilled in the art can solve the technical problem within the scope of certain error, reach described technique effect substantially.In addition, " couple " word and comprise directly any and electric property coupling means indirectly at this.Therefore, if describe a first device in literary composition, be coupled to one second device, represent that described first device can directly be electrically coupled to described the second device, or be indirectly electrically coupled to described the second device by other devices or the means that couple.Specification subsequent descriptions is for implementing the application's better embodiment, and right described description is to illustrate that the application's rule is object, not in order to limit the application's scope.The application's protection range is when being as the criterion depending on the claims person of defining.
Embodiment mono-
As shown in Figure 1, be the dispatching method of a kind of transcoding task described in the embodiment of the present application one, the method comprises:
Specifically, described video attribute information comprises: the physical attribute of video and service attribute, and wherein, described physical attribute is specially the essential informations such as duration, code check and/or resolution of video; Described service attribute is specially the class of service under video, as: live class, commercial paper, news category and/or movie and television play class etc.In practical application, the described class of service of video was chosen and is determined by corresponding option before video is uploaded by video uploader, and certainly, definite mode of the described class of service of video does not form the restriction to the application.
In step 101, the video attribute information of obtaining from described video generates the transcoding task with score value label information in conjunction with preset score value rule, is specially: the preset different corresponding score value of video attribute information, forms described score value rule; The video attribute information of obtaining from described video, generates the transcoding task with score value label information in conjunction with described score value rule.
It should be noted that, in the step 101 of the present embodiment, according to the described video attribute information of video in different transcoding tasks, in conjunction with preset score value rule, just described physical attribute and the score value corresponding to service attribute of this transcoding task can be obtained, then the summation that adds up, the score value corresponding to video attribute information of this video can be obtained, the video attribute information of obtaining from described video again, generates the transcoding task with score value label information in conjunction with described score value rule.Thereby, by the size of score value, just can know intuitively the priority height of described transcoding task.
In the present embodiment, by described preset score value grade, described transcoding task division can be become at least two priority resource pool queues (can be also set of tasks) that height is different, if the score value that described in described transcoding task, score value label information is corresponding, higher than this score value grade, just adds high resource pool queue by described transcoding task; If score value corresponding to the described score value label information of described transcoding task, lower than this score value grade, just adds low-resource pool queue by described transcoding task.In two kinds of resource pool queues of height, then arrange and generate described internal task queue according to the height of the score value label information of the described transcoding task of difference.Certainly, aforesaid way does not form the restriction to the application.
Particularly, described first in first out treatment mechanism is: to having the transcoding task of different score value label informations in each resource pool queue, according to creation-time, divide and successively process, the transcoding task identical to creation-time, then carry out first reprocessing according to the size of score value label information described in it.
Wherein, described first in first out treatment mechanism, the high described transcoding priority of task of score value corresponding to described score value label information can be processed, or also the low described transcoding priority of task of score value corresponding to described score value label information can be processed, not do concrete restriction here.
Embodiment bis-
As shown in Figure 2, be the dispatching method of a kind of transcoding task described in the embodiment of the present application two, the method comprises:
Step 201 is obtained corresponding physical attribute and service attribute from need to carry out the video of transcoding, and generates the transcoding task with score value label information in conjunction with preset score value rule.The described video that wherein, need to carry out transcoding is the video (be specifically as follows the video uploading in corresponding transcoding server, do not limit at this) after uploading.
In step 201, described physical attribute is specially the essential informations such as duration, code check and/or resolution of video; Described service attribute is specially the class of service under video, as: live class, commercial paper, news category and/or movie and television play class etc.
Wherein, described preset score value rule is specially: the preset different corresponding score value of video attribute information, forms described score value rule.
In the present embodiment, the rule of preset score value described in step 201 concrete example as:
Described video attribute information comprises:
The physical attribute of video: 350 basic code rate, original painting code check, duration are less than 20 minutes, duration is less than 5 minutes, duration is less than 1 minute;
The service attribute of video: live, advertisement and with broadcasting.
Described in each, the corresponding score value arranging of the physical attribute of video and service attribute is respectively shown in following table:
Table one, score value corresponding to described video attribute information
| Video attribute information | Score value |
| 350 basic code rate | 10 |
| Original painting code check | 20 |
| Duration is less than 20 minutes | 10 |
| Duration is less than 5 minutes | 10 |
| Duration is less than 1 minute | 10 |
| Live | 100 |
| Advertisement | 200 |
| With broadcasting | 300 |
So, just can be according to described physical attribute and the service attribute of video in different transcoding tasks, find corresponding score value, as: the video code rate in certain live class transcoding task is 350, according to described preset score value rule, this transcoding task meets " 350 basic code rate " and " live " two video attribute information, and these two described score values corresponding to described video attribute information are respectively: 10 and 100.The summation that again this score value added up, generates the score value corresponding to described score value label information of this transcoding task, and 110.Thereby, by the size of score value, just can know intuitively the priority height of described transcoding task.
In the step 201 of the present embodiment, the video that needs transcoding can be the video resource being stored in corresponding video server, also can Shi Cong TV station, the video resource that obtains such as video resource provider, can also be to receive by cloud framework the video resource that various places user uploads.Certainly, for the source video sequence, delivering path, the transmission means that need transcoding to process, do not form the restriction to the application.
Particularly, described first in first out treatment mechanism is: to having the transcoding task of different score value label informations in each resource pool queue, according to creation-time, divide and successively process, the transcoding task identical to creation-time, then carry out first reprocessing according to the size of score value label information described in it.
Wherein, described first in first out treatment mechanism, the high described transcoding priority of task of score value corresponding to described score value label information can be processed, or also the low described transcoding priority of task of score value corresponding to described score value label information can be processed, not do concrete restriction here.
In addition, in the step 203 of the present embodiment, to the described transcoding task in each resource pool queue, according to first in first out treatment mechanism, carry out transcoding processing, also comprise: to thering is the described transcoding task of special tag in each resource pool, extract, and seize the transcoding task of carrying out transcoding processing according to first in first out treatment mechanism, this transcoding task suspension being preempted is processed, preferentially to thering is the described transcoding task of special tag, process simultaneously, after being discharged to the described transcoding task with special tag, this transcoding task being preempted carries out again transcoding processing according to described first in first out treatment mechanism.Thereby special described transcoding task does not need the wait of ranking, can carry out immediately transcoding processing, guaranteed the timely transcoding of this transcoding task after transmission play.
Particularly, for some particular video frequency (as: breaking news, the video that important live grade need to promptly be reached the standard grade and be play), in the time of can generating corresponding described transcoding task to this particular video frequency, generate special tag (as: interrupting label), having this described transcoding task that interrupts label can regard as and be endowed the highest transcoding priority, described transcoding task in all resource pool queues is all when queuing up, there is this transcoding task that interrupts label and seize the transcoding task of carrying out transcoding processing according to first in first out treatment mechanism, interrupt by force and the described transcoding task of processing is retracted to queue, seize transcoding resource, thereby can save queuing time, completed fast transcoding task.The described transcoding task being interrupted is carried out transcoding processing again according to first in first out treatment mechanism after being discharged to the described transcoding task with special tag.Certainly, the special tag of above-mentioned transcoding task can also adopt other modes, and the mode that interrupts does not form the restriction to the application.
Embodiment tri-
For the dispatching method of described transcoding task as shown in Figure 2, wherein step 203:
To the described transcoding task in each resource pool queue, according to first in first out treatment mechanism, carry out transcoding processing.
In above-mentioned steps 203, also comprise: to thering is the described transcoding task of special tag in each resource pool, extract, and seize the transcoding task of carrying out transcoding processing according to first in first out treatment mechanism, this transcoding task suspension being preempted is processed, preferentially to thering is the described transcoding task of special tag, process simultaneously, this transcoding task being preempted is discharged to the described transcoding task with special tag and according to described first in first out treatment mechanism, carries out again transcoding processing afterwards.
Specifically, the described described transcoding task with special tag, except generating, interrupt the mode of label, can also be according to the service attribute of different video code conversion tasks, generate corresponding service attribute label as special tag, for example: for straight multicast service, because all live class transcoding tasks must complete fast, can not cause live transcoding task-delay because of other transcoding tasks more, therefore, in the transcoding task of live class video, add corresponding live label (concrete as: " live " label), thereby, the transcoding task with this " live " label not be used in the wait of ranking in described resource pool queue, but directly seize in described resource pool queue the position of just processing at transcoding of task.Thereby, guaranteed the timely broadcasting of this live transcoding task.
In above-described embodiment two and three, according to described first in first out treatment mechanism, carry out transcoding processing, specifically can carry out transcoding processing by transcoding machine, the performance of different described transcoding machines is not identical yet, described transcoding machine is divided into groups according to the height of performance, and high performance described transcoding machine is processed the described transcoding task in high resource pool queue; The described transcoding machine of low performance is processed the described transcoding task queue in low-resource pool queue.Thereby, the performance of described transcoding machine can be made full use of, in the situation that guaranteeing described transcoding machine utilance, also guaranteed the treatment effeciency of described transcoding task.Certainly, the corresponded manner of above-mentioned transcoding machine can also be adjusted when the running at full capacity of high-performance transcoding machine, and the described transcoding machine of low performance also participates in the transcoding task in described high resource pool queue to carry out transcoding processing.
Embodiment tetra-
Below the concrete application of the dispatching method of described transcoding task is elaborated:
Now set: video A belongs to live class video, and its code check is 350 basic code rate; Video B is movie and television play video, and it has 350 basic code rate and two kinds of versions of 1080P high definition code check.
The step of carrying out transcoding dispatching distribution for above-mentioned video A and B is:
First, from need to carry out the video A of transcoding and B, obtain corresponding video attribute information, and in conjunction with preset score value rule, for video A and B, generate the transcoding task with score value label information respectively.
Then, by the described transcoding task with video A and the B of different score value label informations, according to preset score value grade classification, enter two resource pool queues that height is different.
Finally, to the video A in two resource pool queues of height and described transcoding task corresponding to B difference, according to first in first out treatment mechanism, carry out transcoding processing.
Particularly:
Because described video attribute information specifically comprises: the physical attribute of video and service attribute.So by reading the physical attribute of described video A, the code check that can know video A is 350, then reads the service attribute of described video A, can know that video A is live class video; By reading the physical attribute of described video B, the code check that can know video B is 350 and 1080P.And then can to video A and B, carry out determining of score value according to described preset score value rule.
Described preset score value rule is specially: the preset different corresponding score value of video attribute information, forms described score value rule.Regular in conjunction with score value preset described in above-described embodiment two:
Described video attribute information comprises:
The physical attribute of video: 350 basic code rate, original painting code check, duration are less than 20 minutes, duration is less than 5 minutes, duration is less than 1 minute;
The service attribute of video: live, advertisement and with broadcasting.
Described in each, the corresponding score value arranging of video physical attribute and service attribute is respectively shown in following table:
Table one, score value corresponding to described video attribute information
| Video attribute information | Score value |
| 350 basic code rate | 10 |
| Original painting code check | 20 |
| Duration is less than 20 minutes | 10 |
| Duration is less than 5 minutes | 10 |
| Duration is less than 1 minute | 10 |
| Live | 100 |
| Advertisement | 200 |
| With broadcasting | 300 |
So, because video A is that live class video and its video code rate are 350, according to described preset score value rule, the transcoding task of video A meets " 350 basic code rate " and " live " two described video attribute information, and described score value corresponding to these two video attribute information is respectively: 10 and 100.The summation that again this score value added up, the score value corresponding to described score value label information of the transcoding task that generating video A is corresponding, 110.Because video B is that movie and television play class video and its video code rate are 350 and 1080P, the transcoding task that in video B, code check is 350 meets the described video attribute information of " 350 basic code rate ", score value is 10, and the transcoding task that code check is 1080P does not have corresponding attribute conditions item, therefore, only as common transcoding task.
By described preset score value grade, described transcoding task division can be become to two priority resource pool queues that height is different, and using 100 as score value grade, the score value of video A is 110, enters high resource pool queue; The score value of video B is 10, enters low-resource pool queue.In low-resource pool queue, before the 350 code check transcoding tasks of video B come 1080P code check transcoding task.
It should be noted that, if the creation-time of the 1080P code check transcoding task of video B is early than 350 code check transcoding tasks, although this score value of 1080P code check transcoding task lower than this 350 code check transcoding task, preferentially 1080P code check transcoding task is carried out to transcoding processing.
In the present embodiment, the transcoding machines different by high low performance carry out transcoding processing, and high performance described transcoding machine is processed the described transcoding task in high resource pool queue, and the described transcoding machine of low performance is processed the described transcoding task queue in low-resource pool queue.In the situation that there is no other transcoding tasks, high-performance transcoding machine is processed the transcoding task of video A, and low performance transcoding machine is processed the 350 code check transcoding tasks of video B, and the 1080P code check transcoding task of video B is in wait state.
Now, video C needs emergency treatment, generate urgent transcoding task, and generate and interrupt label in the urgent transcoding task of video C, the urgent transcoding task with this video C that interrupts label can be regarded as and has been endowed the highest transcoding priority, and enter and in high resource pool queue, seize the transcoding task of carrying out the video A of transcoding processing according to first in first out treatment mechanism, and by the transcoding task suspension of video A, meanwhile, the transcoding that carries out video C is processed.After being discharged to the urgent transcoding task with the video C that interrupts label, the transcoding task of the video A being preempted carries out again transcoding processing according to described first in first out treatment mechanism.
In addition, can also carry out according to the performance utilance of different transcoding machines the distribution of described transcoding task, by average being assigned on different transcoding machines of described transcoding task, make every transcoding machine utilance close, make utilance scope maintain 20%～40%.
Embodiment five
As shown in Figure 3, be the dispatching patcher of a kind of transcoding task described in the embodiment of the present application five, this system comprises: task generation unit 301, queue division unit 302 and transcoding units 303, wherein,
Described task generation unit 301, couple mutually with queue division unit 302, for obtaining corresponding video attribute information from carrying out the video of transcoding, and the transcoding task that has score value label information in conjunction with the regular generation of preset score value is sent to described queue division unit 302.The described video that wherein, need to carry out transcoding is the video (be specifically as follows the video uploading in corresponding transcoding server, do not limit at this) after uploading
Particularly, described task generation unit 301, for: the preset different corresponding score value of video attribute information, forms described score value rule; The video attribute information of obtaining from described video, generates the transcoding task with score value label information in conjunction with described score value rule.
Described video attribute information specifically comprises: the physical attribute of video and service attribute, and wherein, described physical attribute is specially the essential informations such as duration, code check and/or resolution of video; Described service attribute is specially the class of service under video, as: live class, commercial paper, news category and/or movie and television play class etc.In practical application, the described class of service of video was chosen and is determined by corresponding option before video is uploaded by video uploader, and certainly, definite mode of the described class of service of video does not form the restriction to the application.
It should be noted that, in the present embodiment, described task generation unit 301 is further according to the described video attribute information of video in different transcoding tasks, in conjunction with preset score value rule, just can obtain described physical attribute and the score value corresponding to service attribute of this transcoding task, summation again adds up, can obtain the score value corresponding to video attribute information of this video, the video attribute information of obtaining from described video again, generates the transcoding task with score value label information in conjunction with described score value rule.Thereby, by the size of score value, just can know intuitively the priority height of described transcoding task.
Described queue division unit 302, couples mutually with described task generation unit 301 and transcoding units 303, for by the described transcoding task with score value label information, according to preset score value grade classification, enters corresponding resource pool queue.
In the present embodiment, by described preset score value grade, described transcoding task division can be become at least two priority resource pool queues (can be also set of tasks) that height is different, if the score value that described in described transcoding task, score value label information is corresponding, higher than this score value grade, just adds high resource pool queue by described transcoding task; If score value corresponding to the described score value label information of described transcoding task, lower than this score value grade, just adds low-resource pool queue by described transcoding task.In two kinds of resource pool queues of height, then arrange and generate described internal task queue according to the height of the score value label information of the described transcoding task of difference.Certainly, aforesaid way does not form the restriction to the application.
Described transcoding units 303, couples mutually with described queue division unit 302, for the described transcoding task to each resource pool queue, according to first in first out treatment mechanism, carries out transcoding processing.
Particularly, described first in first out treatment mechanism is: to having the transcoding task of different score value label informations in each resource pool queue, according to creation-time, divide and successively process, the transcoding task identical to creation-time, then carry out first reprocessing according to the size of score value label information described in it.
Wherein, described first in first out treatment mechanism, the high described transcoding priority of task of score value corresponding to described score value label information can be processed, or also the low described transcoding priority of task of score value corresponding to described score value label information can be processed, not do concrete restriction here.
Embodiment six
As shown in Figure 4, be the dispatching patcher of a kind of transcoding task described in the embodiment of the present application six, this system comprises: task generation unit 401, queue division unit 402, transcoding units 403 and special processing unit 404, wherein,
Described task generation unit 401, couple mutually with queue division unit 402, for obtaining corresponding physical attribute and service attribute from carrying out the video of transcoding, and the transcoding task that has score value label information in conjunction with the regular generation of preset score value is sent to described queue division unit 402.
Wherein, described physical attribute is specially the essential informations such as duration, code check and/or resolution of video; Described service attribute is specially the class of service under video, as: live class, commercial paper, news category and/or movie and television play class etc.
In the present embodiment, described task generation unit 401 is handled, and to need the video of transcoding can be the video resource being stored in corresponding video server, also can Shi Cong TV station, the video resource that obtains such as video resource provider, can also be to receive by cloud framework the video resource that various places user uploads.Certainly, for the source video sequence, delivering path, the transmission means that need transcoding to process, do not form the restriction to the application.
Described queue division unit 402, couples mutually with described task generation unit 401 and transcoding units 403, for by the described transcoding task with score value label information, according to preset score value grade classification, enters corresponding resource pool queue.
Described transcoding units 403, couples mutually with described queue division unit 402, for the described transcoding task to each resource pool queue, according to first in first out treatment mechanism, carries out transcoding processing.
Particularly, described first in first out treatment mechanism is: to having the transcoding task of different score value label informations in each resource pool queue, according to creation-time, divide and successively process, the transcoding task identical to creation-time, then carry out first reprocessing according to the size of score value label information described in it.
Wherein, described first in first out treatment mechanism, the high described transcoding priority of task of score value corresponding to described score value label information can be processed, or also the low described transcoding priority of task of score value corresponding to described score value label information can be processed, not do concrete restriction here.
Described special processing unit 404, couple mutually with described task generation unit 401 and queue division unit 402, for each resource pool being there is to the described transcoding task of special tag, extract, and seize the transcoding task of carrying out transcoding processing according to first in first out treatment mechanism, this transcoding task suspension being preempted is processed, preferentially to thering is the described transcoding task of special tag, process simultaneously, this transcoding task being preempted is discharged to the described transcoding task with special tag and according to first in first out treatment mechanism, carries out again transcoding processing afterwards.Thereby special described transcoding task does not need the wait of ranking, can carry out immediately transcoding processing, guaranteed the timely transcoding of this transcoding task after transmission play.
Because method part have been described in detail the embodiment of the present application, here the expansion of the System and method for corresponding part relating in embodiment is described and omitted, repeat no more.The reference method embodiment of content can to(for) the description of particular content in system, no longer specifically limits here.
Compared with prior art, dispatching method and the system of a kind of transcoding task described in the application, reached following effect:
1) attribution rule of the application by setting in advance video is to needing the video of transcoding to carry out the judgement of priority, code check height, according to the performance of transcoding machine, divide into groups, the transcoding machine that efficiently solves current video website can not rationally carry out the problem of transcoding task scheduling according to server state and transcoding task attribute simultaneously.
2) the application can carry out role's configuration to different transcoding machines, delimit different transcoding tasks and process object, especially for particular video frequency transcoding task, by the specific transcoding machine of delimiting, processed specially, thereby can effectively guarantee the fast transcoding of some particular task, important video is issued in time.
Also it should be noted that, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thereby the process, method, commodity or the system that make to comprise a series of key elements not only comprise those key elements, but also comprise other key elements of clearly not listing, or be also included as the intrinsic key element of this process, method, commodity or system.The in the situation that of more restrictions not, the key element being limited by statement " comprising ... ", and be not precluded within process, method, commodity or the system that comprises described key element and also have other identical element.
The embodiment that it will be understood by those skilled in the art that the application can be provided as method, system or computer program.Therefore, the application can adopt complete hardware implementation example, implement software example or in conjunction with the form of the embodiment of software and hardware aspect completely.And the application can adopt the form that wherein includes the upper computer program of implementing of computer-usable storage medium (including but not limited to magnetic disc store, CD-ROM, optical memory etc.) of computer usable program code one or more.
The embodiment that the foregoing is only the application, is not limited to the application.To those skilled in the art, the application can have various modifications and variations.Any modification of doing within all spirit in the application and principle, be equal to replacement, improvement etc., within all should being included in the application's claim scope.
Claims (10)
1. a dispatching method for transcoding task, is characterized in that, comprising:
From need to carry out the video of transcoding, obtain corresponding video attribute information, and generate the transcoding task with score value label information in conjunction with preset score value rule;
By the described transcoding task with score value label information, according to preset score value grade classification, enter corresponding resource pool queue;
To the described transcoding task in each resource pool queue, according to first in first out treatment mechanism, carry out transcoding processing.
2. the dispatching method of transcoding task as claimed in claim 1, is characterized in that, to the described transcoding task in each resource pool queue, according to first in first out treatment mechanism, carries out transcoding processing, comprising:
To thering is the described transcoding task of special tag in each resource pool, extract, and seize the transcoding task of carrying out transcoding processing according to first in first out treatment mechanism, this transcoding task suspension being preempted is processed, preferentially to thering is the described transcoding task of special tag, process simultaneously, this transcoding task being preempted is discharged to the described transcoding task with special tag and according to described first in first out treatment mechanism, carries out again transcoding processing afterwards.
3. the dispatching method of transcoding task as claimed in claim 1, is characterized in that, the video attribute information of obtaining from described video generates the transcoding task with score value label information in conjunction with preset score value rule, is further:
The preset different corresponding score value of video attribute information, forms described score value rule;
The video attribute information of obtaining from described video, generates the transcoding task with score value label information in conjunction with described score value rule.
4. the dispatching method of transcoding task as claimed in claim 3, is characterized in that, the preset different corresponding score value of video attribute information forms described score value rule, is further:
Described video attribute information comprises: physical attribute and service attribute; Different physical attributes and the different corresponding different score values of service attribute are set;
To the included physical attribute of the video attribute information of described video and service attribute score value the summation that adds up of correspondence respectively, draw the score value corresponding to video attribute information of this video, form described score value rule.
5. the dispatching method of transcoding task as claimed in claim 4, is characterized in that,
Described first in first out treatment mechanism, comprising:
To thering is the transcoding task of different score value label informations in each resource pool queue, according to creation-time, divide and successively process, the transcoding task identical to creation-time, then carry out first reprocessing according to the size of score value label information described in it.
6. a dispatching patcher for transcoding task, is characterized in that, this system comprises: task generation unit, queue division unit and transcoding units, wherein,
Described task generation unit, for obtaining corresponding video attribute information from carrying out the video of transcoding, and the transcoding task that has score value label information in conjunction with the regular generation of preset score value is sent to described queue division unit;
Described queue division unit, for by the described transcoding task with score value label information, enters corresponding resource pool queue according to preset score value grade classification;
Described transcoding units, for the described transcoding task to each resource pool queue, carries out transcoding processing according to first in first out treatment mechanism.
7. the dispatching patcher of transcoding task as claimed in claim 6, it is characterized in that, this system also comprises: special processing unit, for each resource pool being there is to the described transcoding task of special tag, extract, and seize the transcoding task of carrying out transcoding processing according to first in first out treatment mechanism, this transcoding task suspension being preempted is processed, preferentially to thering is the described transcoding task of special tag, process simultaneously, after being discharged to the described transcoding task with special tag, this transcoding task being preempted carries out again transcoding processing according to described first in first out treatment mechanism.
8. the dispatching patcher of transcoding task as claimed in claim 6, is characterized in that, described task generation unit, is further used for:
The preset different corresponding score value of video attribute information, forms described score value rule;
The video attribute information of obtaining from described video, generates the transcoding task with score value label information in conjunction with described score value rule;
Wherein, described video attribute information comprises: physical attribute and service attribute.
9. the dispatching patcher of transcoding task as claimed in claim 8, is characterized in that, described task generation unit, is further used for:
Different described physical attributes and the different corresponding different score values of described service attribute are set;
To its included physical attribute of the video attribute information analysis of described video and service attribute score value the summation that adds up of correspondence respectively, draw the score value corresponding to video attribute information of this video, form described score value rule.
10. the dispatching patcher of transcoding task as claimed in claim 6, is characterized in that, described first in first out treatment mechanism, is further:
To thering is the transcoding task of different score value label informations in each resource pool queue, according to creation-time, divide and successively process, the transcoding task identical to creation-time, then carry out first reprocessing according to the size of score value label information described in it.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310646742.7A CN103686207A (en) | 2013-12-04 | 2013-12-04 | Transcoding task scheduling method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310646742.7A CN103686207A (en) | 2013-12-04 | 2013-12-04 | Transcoding task scheduling method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103686207A true CN103686207A (en) | 2014-03-26 |
Family
ID=50322289
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310646742.7A Pending CN103686207A (en) | 2013-12-04 | 2013-12-04 | Transcoding task scheduling method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103686207A (en) |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104506881A (en) * | 2014-12-31 | 2015-04-08 | 成都东方盛行电子有限责任公司 | Scheduling method for audio/video fragment transcoding |
| CN104717517A (en) * | 2015-03-31 | 2015-06-17 | 北京奇艺世纪科技有限公司 | Scheduling method and scheduling device for video transcoding task |
| CN104717507A (en) * | 2015-03-31 | 2015-06-17 | 北京奇艺世纪科技有限公司 | Video transcoding method and device |
| CN104967868A (en) * | 2014-04-04 | 2015-10-07 | 清华大学 | Video transcoding method, video transcoding apparatus and server |
| CN105204921A (en) * | 2014-06-25 | 2015-12-30 | 北京奇虎科技有限公司 | Task distribution method, device, system and server |
| CN105721901A (en) * | 2014-12-31 | 2016-06-29 | 乐视云计算有限公司 | Video transcoder adaption method, device and system |
| CN106027596A (en) * | 2016-04-27 | 2016-10-12 | 乐视控股（北京）有限公司 | Task distributing method and device |
| CN106454402A (en) * | 2016-08-31 | 2017-02-22 | 腾讯科技（深圳）有限公司 | Transcoding task scheduling method and device |
| WO2017096947A1 (en) * | 2015-12-07 | 2017-06-15 | 乐视控股（北京）有限公司 | Real-time control method and device for real-time transcoding |
| CN107147867A (en) * | 2017-05-12 | 2017-09-08 | 网宿科技股份有限公司 | Distributed trans-coding method and system |
| WO2017166501A1 (en) * | 2016-03-31 | 2017-10-05 | 乐视控股（北京）有限公司 | Method and device for assigning transcoding task |
| CN108900804A (en) * | 2018-07-09 | 2018-11-27 | 南通世盾信息技术有限公司 | A kind of adaptive video method for stream processing based on video entropy |
| CN109213594A (en) * | 2017-07-06 | 2019-01-15 | 阿里巴巴集团控股有限公司 | Method, apparatus, equipment and the computer storage medium that resource is seized |
| CN109874036A (en) * | 2018-12-29 | 2019-06-11 | 中兴飞流信息科技有限公司 | A kind of video analysis method and device, equipment, storage medium |
| WO2019119633A1 (en) * | 2017-12-19 | 2019-06-27 | 平安科技（深圳）有限公司 | Live video transcoding device, method and computer readable storage medium |
| WO2020119515A1 (en) * | 2018-12-11 | 2020-06-18 | 阿里巴巴集团控股有限公司 | Video transcoding method and device |
| CN111695749A (en) * | 2019-03-14 | 2020-09-22 | 北京京东尚科信息技术有限公司 | Method and device for generating grouping tasks |
| CN112565774A (en) * | 2020-11-26 | 2021-03-26 | 北京达佳互联信息技术有限公司 | Video transcoding resource scheduling method and device |
| CN113419831A (en) * | 2021-06-23 | 2021-09-21 | 上海观安信息技术股份有限公司 | Sandbox task scheduling method and system |
| CN113784176A (en) * | 2021-11-12 | 2021-12-10 | 南京未来网络产业创新有限公司 | Intelligent processing method and system for cloud video platform |
| CN113891114A (en) * | 2021-11-18 | 2022-01-04 | 上海哔哩哔哩科技有限公司 | Transcoding task scheduling method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040024900A1 (en) * | 2002-07-30 | 2004-02-05 | International Business Machines Corporation | Method and system for enhancing streaming operation in a distributed communication system |
| CN101072227A (en) * | 2006-05-11 | 2007-11-14 | 华为技术有限公司 | Sending system, method and receiving system for video broadcasting system |
| CN101917384A (en) * | 2009-11-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Task distribution method and device for distributed transcoding system |
| CN101917385A (en) * | 2009-11-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Dispatch server and distributed system for multimedia trans-coding |
-
2013
- 2013-12-04 CN CN201310646742.7A patent/CN103686207A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040024900A1 (en) * | 2002-07-30 | 2004-02-05 | International Business Machines Corporation | Method and system for enhancing streaming operation in a distributed communication system |
| CN101072227A (en) * | 2006-05-11 | 2007-11-14 | 华为技术有限公司 | Sending system, method and receiving system for video broadcasting system |
| CN101917384A (en) * | 2009-11-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Task distribution method and device for distributed transcoding system |
| CN101917385A (en) * | 2009-11-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Dispatch server and distributed system for multimedia trans-coding |
Cited By (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104967868A (en) * | 2014-04-04 | 2015-10-07 | 清华大学 | Video transcoding method, video transcoding apparatus and server |
| CN104967868B (en) * | 2014-04-04 | 2018-09-04 | 清华大学 | video transcoding method, device and server |
| CN105204921A (en) * | 2014-06-25 | 2015-12-30 | 北京奇虎科技有限公司 | Task distribution method, device, system and server |
| CN105204921B (en) * | 2014-06-25 | 2019-03-01 | 北京奇虎科技有限公司 | Method for allocating tasks, device, system and server |
| CN105721901A (en) * | 2014-12-31 | 2016-06-29 | 乐视云计算有限公司 | Video transcoder adaption method, device and system |
| CN104506881A (en) * | 2014-12-31 | 2015-04-08 | 成都东方盛行电子有限责任公司 | Scheduling method for audio/video fragment transcoding |
| CN104717517B (en) * | 2015-03-31 | 2018-04-13 | 北京爱奇艺科技有限公司 | A kind of video code conversion method for scheduling task and device |
| CN104717517A (en) * | 2015-03-31 | 2015-06-17 | 北京奇艺世纪科技有限公司 | Scheduling method and scheduling device for video transcoding task |
| CN104717507A (en) * | 2015-03-31 | 2015-06-17 | 北京奇艺世纪科技有限公司 | Video transcoding method and device |
| WO2017096947A1 (en) * | 2015-12-07 | 2017-06-15 | 乐视控股（北京）有限公司 | Real-time control method and device for real-time transcoding |
| WO2017166501A1 (en) * | 2016-03-31 | 2017-10-05 | 乐视控股（北京）有限公司 | Method and device for assigning transcoding task |
| CN106027596A (en) * | 2016-04-27 | 2016-10-12 | 乐视控股（北京）有限公司 | Task distributing method and device |
| CN106454402A (en) * | 2016-08-31 | 2017-02-22 | 腾讯科技（深圳）有限公司 | Transcoding task scheduling method and device |
| CN107147867A (en) * | 2017-05-12 | 2017-09-08 | 网宿科技股份有限公司 | Distributed trans-coding method and system |
| CN107147867B (en) * | 2017-05-12 | 2020-09-18 | 网宿科技股份有限公司 | Distributed transcoding method and system |
| CN109213594A (en) * | 2017-07-06 | 2019-01-15 | 阿里巴巴集团控股有限公司 | Method, apparatus, equipment and the computer storage medium that resource is seized |
| CN109213594B (en) * | 2017-07-06 | 2022-05-17 | 阿里巴巴集团控股有限公司 | Resource preemption method, device, equipment and computer storage medium |
| WO2019119633A1 (en) * | 2017-12-19 | 2019-06-27 | 平安科技（深圳）有限公司 | Live video transcoding device, method and computer readable storage medium |
| CN108900804A (en) * | 2018-07-09 | 2018-11-27 | 南通世盾信息技术有限公司 | A kind of adaptive video method for stream processing based on video entropy |
| WO2020119515A1 (en) * | 2018-12-11 | 2020-06-18 | 阿里巴巴集团控股有限公司 | Video transcoding method and device |
| CN109874036B (en) * | 2018-12-29 | 2021-06-04 | 中兴飞流信息科技有限公司 | Video analysis method and device, equipment and storage medium |
| CN109874036A (en) * | 2018-12-29 | 2019-06-11 | 中兴飞流信息科技有限公司 | A kind of video analysis method and device, equipment, storage medium |
| CN111695749A (en) * | 2019-03-14 | 2020-09-22 | 北京京东尚科信息技术有限公司 | Method and device for generating grouping tasks |
| CN112565774A (en) * | 2020-11-26 | 2021-03-26 | 北京达佳互联信息技术有限公司 | Video transcoding resource scheduling method and device |
| CN112565774B (en) * | 2020-11-26 | 2023-05-02 | 北京达佳互联信息技术有限公司 | Video transcoding resource scheduling method and device |
| CN113419831A (en) * | 2021-06-23 | 2021-09-21 | 上海观安信息技术股份有限公司 | Sandbox task scheduling method and system |
| CN113419831B (en) * | 2021-06-23 | 2023-04-11 | 上海观安信息技术股份有限公司 | Sandbox task scheduling method and system |
| CN113784176A (en) * | 2021-11-12 | 2021-12-10 | 南京未来网络产业创新有限公司 | Intelligent processing method and system for cloud video platform |
| CN113891114A (en) * | 2021-11-18 | 2022-01-04 | 上海哔哩哔哩科技有限公司 | Transcoding task scheduling method and device |
| CN113891114B (en) * | 2021-11-18 | 2023-12-15 | 上海哔哩哔哩科技有限公司 | Transcoding task scheduling method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103686207A (en) | Transcoding task scheduling method and system | |
| JP6449351B2 (en) | Data mining to identify online user response to broadcast messages | |
| US11301425B2 (en) | Systems and computer implemented methods for semantic data compression | |
| CN103984740B (en) | Based on the method and system that the retrieved page of combination tag shows | |
| US11803557B2 (en) | Social intelligence architecture using social media message queues | |
| CN102436513A (en) | Distributed search method and system | |
| WO2021103366A1 (en) | Bullet screen processing method and system based on wechat mini-program | |
| CN103702135A (en) | Method and system for interaction of video distribution and medium resource system | |
| CN103702125A (en) | Method and system specific to fragment transcoding and scheduling | |
| CN103702138A (en) | Method and system for self-adaptive appointed transcoding | |
| CN101420356A (en) | Network content classified processing method and apparatus | |
| CN113505265B (en) | Data query method and device, electronic equipment, storage medium and program product | |
| CN106557483B (en) | Data processing method, data query method, data processing equipment and data query equipment | |
| CN111078646B (en) | Method and system for grouping software based on operation data of Internet equipment | |
| CN103686157A (en) | Method and system for providing alarm in cloud transcoding | |
| CN104217000A (en) | Content-based video retrieval system | |
| CN102833594A (en) | Method, device and system for searching IPTV (internet protocol television) programs | |
| CN104834728A (en) | Pushing method and device for subscribed video | |
| CN115964418A (en) | Multi-source heterogeneous data access system and method for Internet of things | |
| CN103686224A (en) | Method and system for transcoding task obtaining on basis of distributed locks | |
| CN112953944A (en) | Audio-video transcoding method based on MapReduce | |
| CN112015736A (en) | Spark Mllib-based multifunctional recommendation method and device | |
| CN111414553A (en) | Data processing system, method and storage medium | |
| CN110619074A (en) | Search method based on video network and video network management platform | |
| CN110418202A (en) | TV programme suggesting method, television set and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20151228 Address after: Room six, building 19, building 68, No. 100089 South Road, Haidian District, Beijing Applicant after: LETV CLOUD COMPUTING CO., LTD. Address before: Room six, building 19, building 68, No. 100089 South Road, Haidian District, Beijing Applicant before: LeTV Information Technology (Beijing) Co., Ltd. |
|
| AD01 | Patent right deemed abandoned |
Effective date of abandoning: 20180522 |
|
| AD01 | Patent right deemed abandoned |