CN109309646A - A kind of multi-media transcoding method and system - Google Patents

A kind of multi-media transcoding method and system Download PDF

Info

Publication number
CN109309646A
CN109309646A CN201710620933.4A CN201710620933A CN109309646A CN 109309646 A CN109309646 A CN 109309646A CN 201710620933 A CN201710620933 A CN 201710620933A CN 109309646 A CN109309646 A CN 109309646A
Authority
CN
China
Prior art keywords
transcoding
task
cloud storage
storage platform
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710620933.4A
Other languages
Chinese (zh)
Other versions
CN109309646B (en
Inventor
丁硕青
张炎泼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guizhou Baishan Cloud Polytron Technologies Inc
Guizhou Baishancloud Technology Co Ltd
Original Assignee
Guizhou Baishan Cloud Polytron Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guizhou Baishan Cloud Polytron Technologies Inc filed Critical Guizhou Baishan Cloud Polytron Technologies Inc
Priority to CN201710620933.4A priority Critical patent/CN109309646B/en
Publication of CN109309646A publication Critical patent/CN109309646A/en
Application granted granted Critical
Publication of CN109309646B publication Critical patent/CN109309646B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • H04L65/765Media network packet handling intermediate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004Server selection for load balancing
    • H04L67/1008Server selection for load balancing based on parameters of servers, e.g. available memory or workload
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/60Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The present invention provides a kind of multi-media transcoding method and systems.It is related to field of cloud calculation;The problem of it is low to solve existing multimedia transcoding system transcoding efficiency, is not able to satisfy a large amount of transcoding demands of different cloud storage platforms.This method comprises: transcoding server, according to the cloud storage platform specified in transcoding task, adaptation obtains interface corresponding with the cloud storage platform;It is by the interface that multimedia source files involved in the transcoding task are locally downloading, and transcoding is carried out according to the transcoding task, obtain file after transcoding;By the interface, file after the transcoding is uploaded to the cloud storage platform.Technical solution provided by the invention is suitable for cloud storage system, realizes the multimedia file transcoding that high flexibility can be adapted to different cloud storage platform different-format requirements.

Description

A kind of multi-media transcoding method and system
Technical field
The present invention relates to field of cloud calculation more particularly to a kind of multi-media transcoding method and systems.
Background technique
Net cast in recent years at any time, the continuous development in program request market, possess the enterprise of multi-media transcoding demand increasingly Come, and is much all using cloud storage platform in these companies.The coded format of different cloud storage Platform Requirements, storage text The standards such as the size of part are different, correspondingly, each cloud storage platform requires special multimedia transcoding system.
Multimedia transcoding system common at present, which is gathered around, to be had the disadvantage that:
Input/output source is single.Only support a kind of specific multimedia sources (such as: HTTP file push, the address URL) Transcoding processing is carried out, and is stored back into specific position after transcoding.
Resource isolation is poor.The transcoding task sharing same asset of different user creation, when a few users increase suddenly When task amount, it can have an immense impact on to overall performance.
Disaster tolerance is poor.Existing multimedia transcoding system is usually list IDC deployment, be will cause when the IDC breaks down Whole transcoding service is unavailable.
To sum up, existing multimedia transcoding system transcoding efficiency is low, is not able to satisfy the different a large amount of transcodings of cloud storage platform Demand.
Summary of the invention
Present invention seek to address that problem as described above.
According to the first aspect of the invention, a kind of multi-media transcoding method is provided, comprising:
Transcoding server obtains corresponding with the cloud storage platform according to the cloud storage platform specified in transcoding task, adaptation Interface;
It is by the interface that multimedia source files involved in the transcoding task are locally downloading, and according to described turn Code task carries out transcoding, obtains file after transcoding;
By the interface, file after the transcoding is uploaded to the cloud storage platform.
Preferably, transcoding server obtains and the cloud storage according to the cloud storage platform specified in transcoding task, adaptation Before the step of platform corresponding interface further include:
The identity key for receiving each cloud storage platform that user provides, in user, the cloud storage platform, cloud storage platform Identity key between establish incidence relation.
Preferably, the transcoding task carries task parameters, and the task parameters include at least appointing in following parameter One or any multinomial:
Queue ID, template ID, cloud storage platform, multimedia source files address, transcoding output parameter,
Transcoding server obtains corresponding with the cloud storage platform according to the cloud storage platform specified in transcoding task, adaptation Interface the step of include:
Transcoding server obtains corresponding cloud storage platform according to the cloud storage platform of user and transcoding task instruction Identity key;
According to the cloud storage platform specified in the identity key and transcoding task of the cloud storage platform, selection connects accordingly Mouthful.
Preferably, transcoding server obtains and the cloud storage according to the cloud storage platform specified in transcoding task, adaptation Before the step of platform corresponding interface, further includes:
According to the load condition of transcoding server each in transcoding server cluster, more idle transcoding server is selected to hold The row transcoding task.
Preferably, this method further include:
When receiving the creation transcoding task requests of user's submission, the task in the creation transcoding task requests is extracted Parameter generates transcoding task.
Preferably, this method further include:
It to the transcoding task of generation, is managed by least one queue, different queues has different priority.
Preferably, according to the load condition of transcoding server each in transcoding server cluster, more idle transcoding is selected Server executed before the step of transcoding task further include:
Select a transcoding task as current pending transcoding task from the higher queue of priority.
The present invention also provides a kind of multimedia transcoding systems, flat including multiple cloud storages using different coding format Platform, the system further include transcoding server cluster, and the transcoding server cluster includes more transcoding servers;
Transcoding server in the transcoding server cluster, for according in transcoding task specify cloud storage platform, Adaptation obtains interface corresponding with the cloud storage platform, by the interface by multimedia sources involved in the transcoding task File download carries out transcoding to local, and according to the transcoding task, obtains file after transcoding, will be described by the interface File is uploaded to the cloud storage platform after transcoding.
Preferably, the transcoding server, be also used to receive user offer each cloud storage platform identity key, with Family, the cloud storage platform, cloud storage platform identity key between establish incidence relation.
Preferably, the transcoding task carries task parameters, and the task parameters include at least appointing in following parameter One or any multinomial:
Queue ID, template ID, cloud storage platform, multimedia source files address, transcoding output parameter,
The transcoding server obtains phase specifically for the cloud storage platform according to user and transcoding task instruction The identity key for the cloud storage platform answered, according to the cloud storage specified in the identity key and transcoding task of the cloud storage platform Platform selects corresponding interface.
Preferably, which further includes task scheduling server cluster, and the task scheduling server cluster includes more Task distribution server;
Task distribution server in the task scheduling server cluster, for according to each in transcoding server cluster The load condition of transcoding server selects more idle transcoding server to execute the transcoding task.
Preferably, which further includes front end interface server cluster, comprising more in the front end interface server cluster Platform front end interface server;
Front end interface server in the front end interface server cluster, for turning in the creation for receiving user's submission When code task requests, the task parameters in the creation transcoding task requests are extracted, transcoding task is generated.
Preferably, which further includes distributed experiment & measurement system, and the distributed experiment & measurement system includes multiple data Library example;
The distributed experiment & measurement system is written in the front end interface server cluster, the transcoding task for that will generate, It to the transcoding task of generation, is managed by least one queue, different queues has different priority;
Database instance in the distributed experiment & measurement system, transcoding task and transcoding for storing the generation are appointed Business queue.
Preferably, the task distribution server in the task scheduling server cluster, is also used to higher from priority Select a transcoding task as current pending transcoding task in queue.
The present invention provides a kind of multi-media transcoding method and systems, and transcoding server is according to the cloud specified in transcoding task Storage platform, adaptation obtain interface corresponding with the cloud storage platform, will be involved in the transcoding task by the interface Multimedia source files it is locally downloading, and transcoding is carried out according to the transcoding task, obtains file after transcoding, then by described File after the transcoding is uploaded to the cloud storage platform by interface.It is low to solve existing multimedia transcoding system transcoding efficiency Under, be not able to satisfy the problem of different cloud storage platforms a large amount of transcoding demands, realizing high flexibility, can be adapted to different cloud storages flat The multimedia file transcoding that platform different-format requires.
Being described below for exemplary embodiment is read with reference to the drawings, other property features of the invention and advantage will It is apparent from.
Detailed description of the invention
It is incorporated into specification and the attached drawing for constituting part of specification shows the embodiment of the present invention, and with Principle for explaining the present invention together is described.In the drawings, similar appended drawing reference is for indicating similar element.Under Attached drawing in the description of face is some embodiments of the present invention, rather than whole embodiments.Those of ordinary skill in the art are come It says, without creative efforts, other drawings may be obtained according to these drawings without any creative labor.
Fig. 1 illustratively shows a kind of multimedia transcoding system framework of the offer of the embodiment of the present invention one;
Fig. 2 illustratively shows a kind of process of multi-media transcoding method of the offer of the embodiment of the present invention two;
Fig. 3 illustratively shows a kind of multimedia transcoding system framework of the offer of the embodiment of the present invention one.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.It needs Illustrate, in the absence of conflict, the features in the embodiments and the embodiments of the present application can mutual any combination.
Multimedia transcoding system common at present, which is gathered around, to be had the disadvantage that:
Input/output source is single.Only support a kind of specific multimedia sources (such as: HTTP file push, the address URL) Transcoding processing is carried out, and is stored back into specific position after transcoding.
Resource isolation is poor.The transcoding task sharing same asset of different user creation, when a few users increase suddenly When task amount, it can have an immense impact on to overall performance.
Disaster tolerance is poor.Existing multimedia transcoding system is usually list IDC deployment, be will cause when the IDC breaks down Whole transcoding service is unavailable.
To solve the above-mentioned problems, the embodiment provides a kind of multi-media transcoding method and systems.In user When creating transcoding request, corresponding parameter is provided, according to parameter generation and the matched interface of cloud storage platform, and then is connect by this Mouth carries out the transmission of file with cloud storage platform, supports the cloud storage platform of different multimedia source code format.
First in conjunction with attached drawing, the embodiment of the present invention one is illustrated.
The embodiment of the invention provides a kind of Multimedia Storage System, the framework of the system is as shown in Figure 1, comprising:
Multiple cloud storage platforms and transcoding server cluster using different coding format, the transcoding server cluster packet Containing more transcoding servers;
Transcoding server in described, for according in transcoding task specify cloud storage platform, adaptation obtain with it is described Multimedia source files involved in the transcoding task are downloaded to this by the interface by the corresponding interface of cloud storage platform Ground, and transcoding is carried out according to the transcoding task, file after transcoding is obtained, it, will be on file after the transcoding by the interface Reach the cloud storage platform.
Preferably, the transcoding server, be also used to receive user offer each cloud storage platform identity key, with Family, the cloud storage platform, cloud storage platform identity key between establish incidence relation.
Preferably, the transcoding task carries task parameters, and the task parameters include at least appointing in following parameter One or any multinomial:
Queue ID, template ID, cloud storage platform, multimedia source files address, transcoding output parameter,
The transcoding server obtains phase specifically for the cloud storage platform according to user and transcoding task instruction The identity key for the cloud storage platform answered, according to the cloud storage specified in the identity key and transcoding task of the cloud storage platform Platform selects corresponding interface.
Preferably, which further includes task scheduling server cluster, and the task scheduling server cluster includes more Task distribution server;
Task distribution server in the task scheduling server cluster, for according to each in transcoding server cluster The load condition of transcoding server selects more idle transcoding server to execute the transcoding task.
Preferably, which further includes front end interface server cluster, comprising more in the front end interface server cluster Platform front end interface server;
Front end interface server in the front end interface server cluster, for turning in the creation for receiving user's submission When code task requests, the task parameters in the creation transcoding task requests are extracted, transcoding task is generated.
Preferably, which further includes distributed experiment & measurement system, and the distributed experiment & measurement system includes multiple data Library example;
The distributed experiment & measurement system is written in the front end interface server cluster, the transcoding task for that will generate, It to the transcoding task of generation, is managed by least one queue, different queues has different priority;
Database instance in the distributed experiment & measurement system, transcoding task and transcoding for storing the generation are appointed Business queue.
Preferably, the task distribution server in the task scheduling server cluster, is also used to higher from priority Select a transcoding task as current pending transcoding task in queue.
Preferably, transcoding server cluster, task tune involved in above-mentioned multimedia transcoding system
Degree server cluster, front end interface server cluster are all set in different Internet data centers (IDC), with Meet whole network transcoding demand.Distributed experiment & measurement system is the master-slave database across IDC deployment.
With reference to the accompanying drawing, the embodiment of the present invention two is illustrated.
The embodiment of the invention provides a kind of multi-media transcoding methods, applied to multimedia transcoding system as shown in Figure 1 In, it can be adapted on the basis of the transcoding server of a variety of different cloud storage plateau coding formats realizing, to task pipe Reason has carried out further optimization with scheduling of resource, and detailed process is as shown in Figure 2, comprising:
Step 201, transcoding server receive the identity key for each cloud storage platform that user provides, in user, the cloud Incidence relation is established between storage platform, the identity key of cloud storage platform;
It is flat to provide cloud storage by way of encryption for the cloud storage platform parameters list that user supports according to transcoding server Identity key required for platform (for example AWS platform needs Access Key and Secret Key).
Transcoding server can will establish incidence relation between identity key that user provides, user, cloud storage platform and protect Deposit the incidence relation.
Step 202, front end interface server extract the wound when receiving the creation transcoding task requests of user's submission The task parameters in transcoding task requests are built, transcoding task is generated;
In this step, front end interface server handles the user's request received, is wound in the request received When building transcoding task requests, according to the task parameters carried in the request, transcoding task is generated.
The task parameters include at least any one of following parameter or any multinomial:
Queue ID, template ID, cloud storage platform, the identity key of cloud storage platform, multimedia source files address, transcoding are defeated Parameter (outgoing route, permission etc.) out.
Queue ID shows the transcoding task queue where transcoding task.After the completion of creation, data are written into transcoding task Library.Preferably, it to the transcoding task of generation, is managed by least one queue, different queues has different preferential Grade, different transcoding task queues is marked by queue ID.
The transcoding template that template ID shows that this transcoding task uses can determine output file according to transcoding template Format.Transcoding template defines the output parameter of transcoding, such as out-put container format, coding mode, video resolution, code rate Deng.Each user can create one or more transcoding templates.The transcoding template of creation is stored in distributed experiment & measurement system. User needs to provide a template ID when creating transcoding task.
In addition to creating transcoding task requests, user can also be by issuing following request, to the transcoding task in database It carries out maintenance management:
Creation delete check transcoding task;
Creation update delete check transcoding template;
Creation update delete check transcoding task queue.
If user has known that the template ID of oneself creation is directly being issued there is no need to re-request whole templates Corresponding template ID is indicated when transcoding task requests.
Current pending transcoding task is selected in step 203, the transcoding task being not carried out;
In this step, since synchronization may be stored with multiple transcoding tasks being not carried out in database, therefore, it is necessary to It determines and executes sequence, and sequentially distribution transcoding server executes.
Preferably, when there are multiple queues, select a transcoding task as current from the higher queue of priority Pending transcoding task.It, can be according to first carrying out first going out or other are applicable in for the transcoding task choosing in same queue It is carried out in the rule of current application scene.
Step 204 distributes transcoding server for current pending transcoding task;
In this step, due to being configured with transcoding server cluster, and each transcoding server in cluster can be handled not The transcoding task of same cloud storage platform.Therefore, it may select from the most suitable or appropriate transcoding server of performance to be turned Code task, to reach resource optimal allocation.
For example, more idle transcoding can be selected according to the load condition of transcoding server each in transcoding server cluster Server executes the transcoding task.Or, according to communication efficiency, quality etc. with cloud storage platform, selection and cloud storage platform Between transmit and stablize the transcoding server of high speed and execute the transcoding task.
According to the cloud storage platform specified in transcoding task, adaptation is obtained and the cloud storage for step 205, transcoding server The corresponding interface of platform;
In this step, transcoding server obtains corresponding with specified cloud storage platform according to the parameter in transcoding task, adaptation Interface.
It specifically includes:
1, it is flat to obtain corresponding cloud storage according to the cloud storage platform of user and transcoding task instruction for transcoding server The identity key of platform;
2, according to the cloud storage platform specified in the identity key and transcoding task of the cloud storage platform, selection is corresponding Interface.
Step 206, transcoding server are downloaded multimedia source files involved in the transcoding task by the interface Transcoding is carried out to local, and according to the transcoding task, obtains file after transcoding;
In this step, transcoding server passes through adaptation according to the information such as the position of source file, identity key in transcoding task Obtained interface downloads multimedia source files from specified cloud storage platform.Transcoding platform can be according to the body provided before user The download interface of part key and the corresponding cloud storage platform interface of cloud storage platform selecting, and advised according to the predefined conversion of platform The download interface parameter that the source filename provided when user then being created task is converted into cloud platform carries out transcoding.
According to the output parameter indicated in transcoding task, transcoding obtains file after the transcoding of required format.
File after the transcoding is uploaded to the cloud storage platform by the interface by step 207, transcoding server;
In this step, transcoding platform can be according to key and cloud platform the title selection pair provided before user after the completion of transcoding The upload interface for the cloud storage platform interface answered, and when user is created task according to platform predefined transformation rule, provides The Parameter Switch such as export file name, output permission carry out the file upload after transcoding at the upload interface parameters of cloud storage platform.
Preferably, after the completion of transcoding server can be with a transcoding task execution, the implementing result of the task is generated, it will Implementing result is supplied to people or entity with corresponding authority, and implementing result includes transcoding success/failure instruction information, input The contents such as the file information, output file information.Can be by way of user configuration, such as HTTP, mail, short message mode send this Implementing result.
With reference to the accompanying drawing, the embodiment of the present invention three is illustrated.
The embodiment of the invention provides a kind of multimedia transcoding systems, as shown in figure 3, by front end interface server cluster (including at least two front end interface servers across IDC deployment), distributed experiment & measurement system, task scheduling server cluster (including at least two task scheduling servers, across IDC deployment), transcoding server cluster (it include at least two transcoding servers, Across IDC deployment) composition.Wherein:
Front end interface server is asked for checking request legitimacy (being based on AWS signature algorithm), and the following user of processing It asks:
Creation delete check transcoding task;
Creation update delete check transcoding template;
Creation update delete check transcoding task queue.
Distributed experiment & measurement system is multiple master-slave databases across IDC deployment, for storing transcoding task, transcoding mould The information such as plate, transcoding task queue, performance statistics.
Task scheduling server is used to read executable transcoding task from database, and according to current transcoding server The server of load capacity (CPU, memory, current task number etc.) selection relative free is allocated task.
Transcoding server is responsible for according to the transcoding task that receives, to being stored in multimedia source files base in certain cloud storage platform Transcoding processing is carried out in FFmpeg, uploads the specified cloud storage platform in reuse family after transcoding again.For every transcoding server, also One maximum concurrent tasks number can be set, prevent resource from consuming excessively according to its performance.
Assuming that user has created transcoding task queue and transcoding template.
1. user submits " creation transcoding task " request, and provides required parameter: queue ID, template ID, cloud storage platform, Cloud storage platform identity key, multimedia source files address, transcoding output parameter (outgoing route, permission etc.).
2. the authentication module in front end interface server can be requested according to user in the signing messages checking request that carries close Method.It, will be in the respective queue of transcoding task write-in database after confirmation request is legal.
3. task scheduling server cluster periodically (per second) obtains executable task from database.
4. task scheduling server cluster is according to each turn in database for the transcoding task that each can be executed Code server load data (statistical module of each transcoding server can periodically report respective state), select a relative free Transcoding server.
5. transcoding task is sent to the transcoding server chosen by RPC request by task scheduling server cluster.
6. after transcoding server receives the transcoding task of distribution the following steps can be executed:
6.1. cloud storage interface adaptation module selects corresponding interface according to " the cloud storage platform " in task first.
6.2. according to the source file location being adapted in obtained interface specification and task, cloud storage platform identity key Etc. information (different " cloud storage platforms " may require that different information, herein only a kind of specific embodiment), by multimedia sources File download is to locally.
6.3. transcoding is carried out to locally downloading multimedia source files using FFmpeg module according to transcoding rule.
7. transcoding server will use the interface that adaptation obtains and file after transcoding be uploaded to the cloud storage after transcoding success Platform.
8. further, after transcoding success or failure, by transcoding result, (success loses the notification module in transcoding server Lose, transcoding input file information, output file information) by way of user configuration (HTTP, mail, short message) be sent to use Family.
Transcoding task involved in the embodiment of the present invention is created by user, is stored in database profession.Define a tool The transcoding event that will be executed asynchronously of body, task parameters include: cloud storage provider, original location parameter, output file Location parameter, output file permission etc..
Transcoding template involved in the embodiment of the present invention: it by system or user's creation, is stored in database profession.It defines The rule needed in transcoding, such as output encapsulation format, export Video coding mode, output resolution ratio, bit rate output, output frame Rate, watermark, editing parameter etc..Specified transcoding template is needed when creating transcoding task.
Transcoding task queue involved in the embodiment of the present invention: it is created, is stored in database profession by user.When creation is appointed Business is to need specified queue ID.Queue can be with configuration preference level, the information such as maximum parallel task number.
Different with existing video code conversion system, multimedia transcoding system provided in an embodiment of the present invention can permit user The queue of different priorities is created according to their own needs.For example, with the priority of numeral mark queue, priority from 0 to 9 (numerical value is lower, and priority is higher).One common application is that user can create a normal priority (priority 5) Queue, the queue of a high priority (priority 0).Most task can enter the queue of normal priority, when out The transcoding task can be put into high-priority queue by now urgent transcoding task, user.When there is available resources in system, it is Task in the queue of system meeting priority processing high priority.
It, further, can also be to the queue sum that each user can create for the overall load amount of control system Amount and the concurrent tasks quantity of each queue limit.
In the embodiment of the present invention, the interface call method that cloud storage adaptation module stores different cloud storage platforms (is based on Its platform SDK is realized), user need parameter to be offered (for example, for AWS S3 platform, then need Bucket, Key, The information such as AccessKey) and parameter transcoding rule.The main working process of adaptation module is as follows:
1. obtaining must parameter, transformation rule according to the cloud storage platform that user provides.
2. whether verify the parameter that user provides complete.
3. the Parameter Switch provided user according to Parameter Switch rule is at the format of parameter needed for cloud storage interface.
4. carrying out the downloading and upload of multimedia file using the interface that adaptation obtains.
The embodiment provides a kind of multi-media transcoding method and systems, and transcoding server is according in transcoding task Specified cloud storage platform, adaptation obtain interface corresponding with the cloud storage platform, are appointed the transcoding by the interface Multimedia source files involved in business are locally downloading, and carry out transcoding according to the transcoding task, obtain file after transcoding, then By the interface, file after the transcoding is uploaded to the cloud storage platform.It solves existing multimedia transcoding system to turn The problem of code efficiency is low, a large amount of transcoding demands that are not able to satisfy different cloud storage platforms, difference can be adapted to by realizing high flexibility The multimedia file transcoding that cloud storage platform different-format requires.The technical solution that the embodiment of the present invention provides, can be seamless It is adapted to different cloud storage platforms.When user replaces cloud storage platform, it is only necessary to change cloud storage provider and the phase in parameter Close parameter.By manageable different priorities transcoding task queue, more flexible two priority classes and preferably are realized Concurrency performance.It is isolated for queue, avoids single user pressure influence overall performance.All modules portion across IDC in system System reliability improves in administration.
Descriptions above can combine implementation individually or in various ways, and these variants all exist Within protection scope of the present invention.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations.Although Present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: it still may be used To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features; And these are modified or replaceed, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution spirit and Range.

Claims (14)

1. a kind of multi-media transcoding method characterized by comprising
Transcoding server obtains connect corresponding with the cloud storage platform according to the cloud storage platform specified in transcoding task, adaptation Mouthful;
It is by the interface that multimedia source files involved in the transcoding task are locally downloading, and appointed according to the transcoding Business carries out transcoding, obtains file after transcoding;
By the interface, file after the transcoding is uploaded to the cloud storage platform.
2. multi-media transcoding method according to claim 1, which is characterized in that transcoding server is according to transcoding task middle finger Before the step of fixed cloud storage platform, adaptation obtains interface corresponding with the cloud storage platform further include:
Receive user provide each cloud storage platform identity key, user, the cloud storage platform, cloud storage platform body Incidence relation is established between part key.
3. multi-media transcoding method according to claim 2, which is characterized in that the transcoding task carries task ginseng Number, the task parameters include at least any one of following parameter or any multinomial:
Queue ID, template ID, cloud storage platform, multimedia source files address, transcoding output parameter,
Transcoding server obtains connect corresponding with the cloud storage platform according to the cloud storage platform specified in transcoding task, adaptation Mouthful the step of include:
Transcoding server obtains the body of corresponding cloud storage platform according to the cloud storage platform of user and transcoding task instruction Part key;
According to the cloud storage platform specified in the identity key and transcoding task of the cloud storage platform, corresponding interface is selected.
4. multi-media transcoding method according to claim 1, which is characterized in that transcoding server is according to transcoding task middle finger Before the step of fixed cloud storage platform, adaptation obtains interface corresponding with the cloud storage platform, further includes:
According to the load condition of transcoding server each in transcoding server cluster, more idle transcoding server is selected to execute institute State transcoding task.
5. multi-media transcoding method according to claim 1 or 4, which is characterized in that this method further include:
When receiving the creation transcoding task requests of user's submission, the task ginseng in the creation transcoding task requests is extracted Number generates transcoding task.
6. multi-media transcoding method according to claim 5, which is characterized in that this method further include:
It to the transcoding task of generation, is managed by least one queue, different queues has different priority.
7. multi-media transcoding method according to claim 6, which is characterized in that according to each turn in transcoding server cluster Before the step of load condition of code server, the more idle transcoding server of selection executes the transcoding task further include:
Select a transcoding task as current pending transcoding task from the higher queue of priority.
8. a kind of multimedia transcoding system, including multiple cloud storage platforms using different coding format, which is characterized in that this is System further includes transcoding server cluster, and the transcoding server cluster includes more transcoding servers;
Transcoding server in the transcoding server cluster, for according to the cloud storage platform specified in transcoding task, adaptation Interface corresponding with the cloud storage platform is obtained, by the interface by multimedia source files involved in the transcoding task It is locally downloading, and transcoding is carried out according to the transcoding task, file after transcoding is obtained, by the interface, by the transcoding File is uploaded to the cloud storage platform afterwards.
9. multimedia transcoding system according to claim 8, which is characterized in that
The transcoding server is also used to receive the identity key of each cloud storage platform of user's offer, deposits in user, the cloud It stores up and establishes incidence relation between the identity key of platform, cloud storage platform.
10. multimedia transcoding system according to claim 9, which is characterized in that the transcoding task carries task ginseng Number, the task parameters include at least any one of following parameter or any multinomial:
Queue ID, template ID, cloud storage platform, multimedia source files address, transcoding output parameter,
The transcoding server obtains corresponding specifically for the cloud storage platform according to user and transcoding task instruction The identity key of cloud storage platform, it is flat according to the cloud storage specified in the identity key and transcoding task of the cloud storage platform Platform selects corresponding interface.
11. multimedia transcoding system according to claim 8, which is characterized in that the system further includes task schedule service Device cluster, the task scheduling server cluster include more task distribution servers;
Task distribution server in the task scheduling server cluster, for according to transcoding each in transcoding server cluster The load condition of server selects more idle transcoding server to execute the transcoding task.
12. the multimedia transcoding system according to claim 8 or 11, which is characterized in that the system further includes front end interface Server cluster includes more front end interface servers in the front end interface server cluster;
Front end interface server in the front end interface server cluster, for appointing in the creation transcoding for receiving user's submission When business request, the task parameters in the creation transcoding task requests are extracted, transcoding task is generated.
13. multimedia transcoding system according to claim 12, which is characterized in that the system further includes distributed data base Cluster, the distributed experiment & measurement system include multiple database instances;
The front end interface server cluster, the distributed experiment & measurement system is written in the transcoding task for that will generate, to life At transcoding task, be managed by least one queue, different queues have different priority;
Database instance in the distributed experiment & measurement system, for storing transcoding task and the transcoding task team of the generation Column.
14. multimedia transcoding system according to claim 13, which is characterized in that
Task distribution server in the task scheduling server cluster is also used to select one from the higher queue of priority A transcoding task is as current pending transcoding task.
CN201710620933.4A 2017-07-27 2017-07-27 Multimedia transcoding method and system Active CN109309646B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710620933.4A CN109309646B (en) 2017-07-27 2017-07-27 Multimedia transcoding method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710620933.4A CN109309646B (en) 2017-07-27 2017-07-27 Multimedia transcoding method and system

Publications (2)

Publication Number Publication Date
CN109309646A true CN109309646A (en) 2019-02-05
CN109309646B CN109309646B (en) 2021-04-27

Family

ID=65201754

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710620933.4A Active CN109309646B (en) 2017-07-27 2017-07-27 Multimedia transcoding method and system

Country Status (1)

Country Link
CN (1) CN109309646B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111901566A (en) * 2020-07-29 2020-11-06 浪潮云信息技术股份公司 Monitoring data storage system and storage method
WO2021151294A1 (en) * 2020-08-29 2021-08-05 平安科技(深圳)有限公司 Document transcoding method and apparatus, and scheduling server and storage medium
CN113938681A (en) * 2021-09-26 2022-01-14 浪潮云信息技术股份公司 System and method for controlling video code rate in multiple modes
CN115277579A (en) * 2022-07-25 2022-11-01 广州品唯软件有限公司 Warehouse video calling method and cloud platform

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102868707A (en) * 2011-07-04 2013-01-09 腾讯科技(深圳)有限公司 Method and system for downloading and transcoding file
CN105049505A (en) * 2015-07-09 2015-11-11 上海爱数软件有限公司 Method and system for adapting various kinds of cloud storage interfaces
CN106101258A (en) * 2016-07-08 2016-11-09 腾讯科技(深圳)有限公司 A kind of interface interchange method of mixed cloud, Apparatus and system
US20170188071A1 (en) * 2015-12-28 2017-06-29 Synchronoss Technologies, Inc. Method and apparatus for just-in-time transcoding
CN106973306A (en) * 2017-02-14 2017-07-21 北京时间股份有限公司 Distributed trans-coding method, apparatus and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102868707A (en) * 2011-07-04 2013-01-09 腾讯科技(深圳)有限公司 Method and system for downloading and transcoding file
CN105049505A (en) * 2015-07-09 2015-11-11 上海爱数软件有限公司 Method and system for adapting various kinds of cloud storage interfaces
US20170188071A1 (en) * 2015-12-28 2017-06-29 Synchronoss Technologies, Inc. Method and apparatus for just-in-time transcoding
CN106101258A (en) * 2016-07-08 2016-11-09 腾讯科技(深圳)有限公司 A kind of interface interchange method of mixed cloud, Apparatus and system
CN106973306A (en) * 2017-02-14 2017-07-21 北京时间股份有限公司 Distributed trans-coding method, apparatus and system

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111901566A (en) * 2020-07-29 2020-11-06 浪潮云信息技术股份公司 Monitoring data storage system and storage method
WO2021151294A1 (en) * 2020-08-29 2021-08-05 平安科技(深圳)有限公司 Document transcoding method and apparatus, and scheduling server and storage medium
CN113938681A (en) * 2021-09-26 2022-01-14 浪潮云信息技术股份公司 System and method for controlling video code rate in multiple modes
CN115277579A (en) * 2022-07-25 2022-11-01 广州品唯软件有限公司 Warehouse video calling method and cloud platform
CN115277579B (en) * 2022-07-25 2024-03-19 广州品唯软件有限公司 Warehouse video calling method and cloud platform

Also Published As

Publication number Publication date
CN109309646B (en) 2021-04-27

Similar Documents

Publication Publication Date Title
CN111866191B (en) Message event distribution method, distribution platform, system and server
CN109309646A (en) A kind of multi-media transcoding method and system
CN107545338B (en) Service data processing method and service data processing system
CN102655503A (en) Resource allocation using shared resource pools
CN106850788A (en) Towards the integrated framework and integrated approach of multi-source heterogeneous geographic information resources
CN102945175A (en) Terminal software online upgrading system and method based on cloud computing environment
CN111736775A (en) Multi-source storage method, device, computer system and storage medium
CN113535648A (en) Distributed cloud storage method, equipment and storage medium based on IPFS
WO2020253634A1 (en) Data processing method, system and device
CN106453576B (en) A kind of exchange method, system and control centre based on mixing cloud platform
CN114363407B (en) Message service method and device, readable storage medium and electronic equipment
CN111586149B (en) Network system based on cloud and block chain and service processing method and device thereof
CN111901230A (en) Internet of things gateway and system supporting equipment access verification and equipment access verification method
CN107220271A (en) A kind of method and system of distributed digital resource storage processing and management
CN110519185A (en) A kind of method of novel across a network data exchange
CN111932239A (en) Service processing method, device, node equipment and storage medium
CN111401991A (en) Data information distribution method and device, storage medium and computer equipment
WO2022083293A1 (en) Managing task flow in edge computing environment
CN115349117A (en) Multi-level cache grid system for multi-tenant, serverless environments
US20180027049A1 (en) Computing system and method of operating the computer system
CN101710903A (en) Method, system and platform for publishing information
CN111061723B (en) Workflow realization method and device
CN111190731A (en) Cluster task scheduling system based on weight
CN103092932A (en) Distributed document transcoding system
CN112380040A (en) Message processing method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant