CN112822188A - Method and device for monitoring transcoding task state in distributed transcoding system - Google Patents
Method and device for monitoring transcoding task state in distributed transcoding system Download PDFInfo
- Publication number
- CN112822188A CN112822188A CN202011641931.1A CN202011641931A CN112822188A CN 112822188 A CN112822188 A CN 112822188A CN 202011641931 A CN202011641931 A CN 202011641931A CN 112822188 A CN112822188 A CN 112822188A
- Authority
- CN
- China
- Prior art keywords
- transcoding
- task
- web client
- module
- state information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a method and a device for monitoring the status of a transcoding task in a distributed transcoding system, and relates to the technical field of distributed transcoding. The method comprises the steps that a transcoding task is created for a user by using a Web client, and by means of FFmpeg and a redis database, when each transcoding task runs in a distributed transcoding system, transcoding state information of each transcoding task is written in real time for the user to check. The device include transcoding server cluster module, redis database module to and web client module based on the browser, transcoding server cluster module updates the database module with the detailed state information of transcoding task in real time, later shows for the user through web client module in real time, convenient and fast and simply directly perceived, more press close to user's actual demand, optimize by a wide margin and improved user experience and feel.
Description
Technical Field
The invention relates to the technical field of distributed transcoding, in particular to a method and a device for monitoring the state of a transcoding task in a distributed transcoding system.
Background
With the development of scientific technology, media transmission ways and modes are more and more, media formats are also diversified, and content format requirements of different modes are completely different in the transmission processes of computers, mobile phones, streaming media, IPTV, high-definition digital broadcasting and the like. Therefore, the video transcoding becomes a common requirement for the video with the requirements of different coding formats, different packaging formats, different video code rates and different resolutions. Some detailed information about transcoding during transcoding is also urgently needed by many scenarios. In the current application scenario, the transcoding task status is usually monitored by FFmpeg or by the operating system load.
The prior art has the following disadvantages: the conventional FFmpeg monitors the transcoding task state, is inconvenient to operate, data is not visual, a professional can check the data, the technical threshold is high, and a common user cannot check and monitor the data. The existing operating system load monitors the state of the transcoding task, needs to be familiar with and know about performance indexes of the system, has high technical level requirement, and often has incomplete indexes of transcoding task monitoring and larger deviation.
Disclosure of Invention
The invention relates to a method for monitoring the status of a transcoding task in a distributed transcoding system, which is characterized by comprising the following steps: the method comprises the steps that a user creates transcoding tasks by using a Web client, an FFmpeg is combined with a redis database, when each transcoding task runs in a distributed transcoding system, detailed information for updating the transcoding state of each transcoding task is written into the redis database in real time through the FFmpeg, and the user checks the state information of the transcoding tasks in real time through a browser page, wherein the state information comprises a real-time decoding code rate, a real-time decoding frame rate, a real-time coding code rate and a real-time coding frame rate.
The method for monitoring the status of the transcoding task is characterized by comprising the following steps:
1) the web client starts to create transcoding tasks and configures parameters related to the transcoding tasks, wherein the web client uses a unique task identification number for each transcoding task when creating the tasks;
2) the web client initiates a transcoding request to a transcoding distributed transcoding server cluster through a network;
3) after receiving a transcoding request, a scheduling node in the distributed transcoding server cluster allocates a transcoding task to any one transcoding server node;
4) the transcoding server node of the transcoding task is obtained, the transcoding task is executed, wherein in the task execution process, relevant state information of the transcoding task is obtained in real time in an FFmpeg, and meanwhile, the unique task identification number is used as a unique identifier, and the transcoding state information of the transcoding task is reported to the redis database;
5) after the transcoding task starts to be executed, the web client initiates a request for checking the transcoding state information of the transcoding task;
6) the web client uses the unique task identification number as a unique identifier, queries transcoding state information of the transcoding task in the redis, and displays the transcoding state information in a browser;
7) and after the transcoding task is finished, the FFmpeg stops updating the state to a redis database.
The utility model provides a device of monitoring transcoding task state in distributed transcoding system which characterized in that the device is a transcoding server system, and it includes transcoding server cluster module, redis database module, web client module and Internet based on browser, wherein:
the transcoding server cluster module comprises a scheduling node and a plurality of transcoding server nodes, and each transcoding server node runs a plurality of transcoding tasks based on FFmpeg;
the redis database module is connected with the transcoding server cluster module and is used for correspondingly storing the state information of each transcoding task through a unique identifier and updating the state information in real time;
the web client module is realized based on a browser and is used for initiating and stopping a transcoding task and serving as an entrance for viewing status information of the transcoding task in real time;
the web client module is connected with the redis database module through the Internet and is used for transmitting data and instructions to the redis database module.
The method has the advantages that the method carries out data processing and integration through calculation in the FFmpeg and programming, comprehensively covers information and states about transcoding which need to be monitored, and a user can check detailed state information and the change process of indexes of each transcoding task in real time through a browser.
Drawings
Fig. 1 is a work flow block diagram of an embodiment of a method for monitoring a status of a transcoding task in a distributed transcoding system of the present invention;
fig. 2 is a block diagram illustrating an embodiment of an apparatus for monitoring status of transcoding tasks in a distributed transcoding system according to the present invention;
Detailed Description
The invention carries out data processing integration by internal calculation in the FFmpeg and programming on the basis of the data output by the conventional FFMpeg, comprehensively covers the information and the state about transcoding which needs to be monitored, and can be used for a user to check the detailed state information and the change process of indexes of each transcoding task in real time through a browser.
As mentioned above, the conventional method for monitoring status information of a transcoding task cannot meet user requirements because the operation is complicated, the output monitored information and indicators are not comprehensive enough, and even a large deviation may exist. The principle of the invention is that the state of transcoding, index data and the like are converted into comprehensive and detailed information after being processed, processed and integrated by FFMpeg internal calculation and stored in a Redis database, and the information is presented to customers in real time.
First, the technical terms used in the present invention are explained:
video coding: the original video is compressed through a compression technology, so that the volume of the video is reduced, and the flow of the video in network transmission is correspondingly reduced;
code rate: the data size occupied by the video file in unit time generally takes bit/second as a unit;
resolution ratio: the number of pixels contained in a unit inch includes a horizontal direction and a vertical direction;
video decoding: the process of restoring the coded video to the original image, the inverse process of video coding;
video transcoding: the conversion process of the video file among different coding formats, resolutions and code rates;
video encoding format: a series of defined algorithms for compression coding of video images, and the common video coding formats are h264 and h 265;
video packaging format: the video packaging format is to put video data, audio data and subtitle data which have been coded into a file according to a certain mode.
In an embodiment shown in fig. 1, a method for monitoring a status of a transcoding task in a distributed transcoding system of the present invention includes the following steps:
step 1-1: starting a web client program;
task identification number 1-2: the web client creates transcoding tasks, and creates a task identification number (task _ id) which is unique to each transcoding task;
step 1-3: the web client creates transcoding tasks, configures parameters related to the transcoding tasks, and creates task identification numbers 1-2 to use a unique task identification number (task _ id) for each transcoding task when creating the tasks;
step 1-4: a web client initiates a transcoding request to a transcoding distributed transcoding server cluster through a network;
step 1-5: after receiving a transcoding request, a scheduling node in the distributed transcoding cluster allocates a transcoding task to a certain node;
step 1-6: acquiring a transcoding server node for executing the task, and starting to execute the transcoding task;
step 1-7: a web client sends out a transcoding task state query request to check the existing task state;
task identification number 1-8: a unique task identification number (task _ id) created in each transcoding task;
step 1-9: in the process of executing the transcoding task in the step 1-6, acquiring state information related to transcoding in real time in the FFmpeg, and reporting the transcoding state information of the transcoding task to a redis database by using the task _ id in the task representation number 1-8 as a key;
step 1-10: querying a redis database by using the task _ id in the task representation numbers 1-8 as a key, and calling corresponding transcoding task information;
step 1-11: after the transcoding task is finished, FFmpeg stops updating the state to redis.
Step 1-12: the web client browser displays the transcoding task information acquired in the step 1-10;
step 1-13: and monitoring the transcoding task state information after the operation is finished.
In an embodiment shown in fig. 2, the apparatus for monitoring status of transcoding task in a distributed transcoding system of the present invention is a transcoding server system, comprising the following modules and transmission path Internet:
module 2-1: the transcoding server cluster module comprises a scheduling node and a plurality of transcoding server nodes, wherein the transcoding tasks are determined by the scheduling node to be allocated to the transcoding server nodes, and each transcoding server node runs a plurality of transcoding tasks based on FFmpeg;
module 2-2: the redis database module is connected with the transcoding server cluster module and is used for correspondingly storing the state information of each transcoding task through a unique identifier key and updating the state information in real time;
module 2-3: the web client module is realized based on a browser, and mainly completes the initiation and the stop of a transcoding task and is used as an entrance for viewing the status information of the transcoding task in real time;
transmission routes 2 to 4: the browser based Web client module 2-3 transmits data and instructions to the redis database module over the Internet.
Claims (3)
1. A method for monitoring the status of a transcoding task in a distributed transcoding system is characterized in that: the method comprises the steps that a user creates transcoding tasks by using a Web client, an FFmpeg is combined with a redis database, when each transcoding task runs in a distributed transcoding system, detailed information for updating the transcoding state of each transcoding task is written into the redis database in real time through the FFmpeg, and the user checks the state information of the transcoding tasks in real time through a browser page, wherein the state information comprises a real-time decoding code rate, a real-time decoding frame rate, a real-time coding code rate and a real-time coding frame rate.
2. The method for monitoring the status of a transcoding task of claim 1, comprising the steps of:
1) the web client starts to create transcoding tasks and configures parameters related to the transcoding tasks, wherein the web client uses a unique task identification number for each transcoding task when creating the tasks;
2) the web client initiates a transcoding request to a transcoding distributed transcoding server cluster through a network;
3) after receiving a transcoding request, a scheduling node in the distributed transcoding server cluster allocates a transcoding task to any one transcoding server node;
4) the transcoding server node of the transcoding task is obtained, the transcoding task is executed, wherein in the task execution process, relevant state information of the transcoding task is obtained in real time in an FFmpeg, and meanwhile, the unique task identification number is used as a unique identifier, and the transcoding state information of the transcoding task is reported to the redis database;
5) after the transcoding task starts to be executed, the web client initiates a request for checking the transcoding state information of the transcoding task;
6) the web client uses the unique task identification number as a unique identifier, queries transcoding state information of the transcoding task in the redis, and displays the transcoding state information in a browser;
7) and after the transcoding task is finished, the FFmpeg stops updating the state to a redis database.
3. The utility model provides a device of monitoring transcoding task state in distributed transcoding system which characterized in that the device is a transcoding server system, and it includes transcoding server cluster module, redis database module, web client module and Internet based on browser, wherein:
the transcoding server cluster module comprises a scheduling node and a plurality of transcoding server nodes, and each transcoding server node runs a plurality of transcoding tasks based on FFmpeg;
the redis database module is connected with the transcoding server cluster module and is used for correspondingly storing the state information of each transcoding task through a unique identifier and updating the state information in real time;
the web client module is realized based on a browser and is used for initiating and stopping a transcoding task and serving as an entrance for viewing status information of the transcoding task in real time;
the web client module is connected with the redis database module through the Internet and is used for transmitting data and instructions to the redis database module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011641931.1A CN112822188A (en) | 2020-12-31 | 2020-12-31 | Method and device for monitoring transcoding task state in distributed transcoding system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011641931.1A CN112822188A (en) | 2020-12-31 | 2020-12-31 | Method and device for monitoring transcoding task state in distributed transcoding system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112822188A true CN112822188A (en) | 2021-05-18 |
Family
ID=75858220
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011641931.1A Pending CN112822188A (en) | 2020-12-31 | 2020-12-31 | Method and device for monitoring transcoding task state in distributed transcoding system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112822188A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113938681A (en) * | 2021-09-26 | 2022-01-14 | 浪潮云信息技术股份公司 | System and method for controlling video code rate in multiple modes |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105162809A (en) * | 2015-10-23 | 2015-12-16 | 北京理工大学 | Real-time video transcoding system based on intermodule communication |
| CN107104961A (en) * | 2017-04-21 | 2017-08-29 | 中国电子科技集团公司第二十八研究所 | Distributed real-time video monitoring processing system based on ZooKeeper |
| CN107766129A (en) * | 2016-08-17 | 2018-03-06 | 北京金山云网络技术有限公司 | A kind of task processing method, apparatus and system |
-
2020
- 2020-12-31 CN CN202011641931.1A patent/CN112822188A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105162809A (en) * | 2015-10-23 | 2015-12-16 | 北京理工大学 | Real-time video transcoding system based on intermodule communication |
| CN107766129A (en) * | 2016-08-17 | 2018-03-06 | 北京金山云网络技术有限公司 | A kind of task processing method, apparatus and system |
| CN107104961A (en) * | 2017-04-21 | 2017-08-29 | 中国电子科技集团公司第二十八研究所 | Distributed real-time video monitoring processing system based on ZooKeeper |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113938681A (en) * | 2021-09-26 | 2022-01-14 | 浪潮云信息技术股份公司 | System and method for controlling video code rate in multiple modes |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108989885B (en) | Video file transcoding system, segmentation method, transcoding method and device | |
| US10021401B2 (en) | Analytic tool for managing distributed statistically multiplexed systems and method for using same | |
| CN113542795B (en) | Video processing method and device, electronic equipment and computer readable storage medium | |
| CN104469370A (en) | Video transcode method and device | |
| CN111147860B (en) | Video data decoding method and device | |
| EP3624453A1 (en) | A transcoding task allocation method, scheduling device and transcoding device | |
| CN108881817B (en) | Data synchronization method, device and system | |
| CN113225585A (en) | Video definition switching method and device, electronic equipment and storage medium | |
| CN104935952B (en) | A kind of video transcoding method and system | |
| CN111105521A (en) | Data reading method and device | |
| CN112822188A (en) | Method and device for monitoring transcoding task state in distributed transcoding system | |
| CN102770827B (en) | Method for showing multimedia content on the screen of terminal | |
| US9219795B2 (en) | Moving picture file transmitting server and method of controlling operation of same | |
| CN111629283A (en) | Multi-stream media gateway service system and method | |
| US8681860B2 (en) | Moving picture compression apparatus and method of controlling operation of same | |
| CN112866713B (en) | Transcoding all-in-one machine system and transcoding method | |
| US7643700B2 (en) | Processing of coded data according to user preference | |
| CN103974087B (en) | Video image file compressibility, client and method | |
| US11973994B2 (en) | Media processing method | |
| CN111131777B (en) | Viewing method and device for video network monitoring | |
| CN114422792A (en) | Video image compression method, device, equipment and storage medium | |
| CN114598834A (en) | Video processing method and device, electronic equipment and readable storage medium | |
| CN105187951B (en) | A kind of RTMP flow medium live system Reverse Turning Control method and its system | |
| CN116456136B (en) | Equipment screen throwing method and device based on localization | |
| CN116781973B (en) | Video encoding and decoding method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210518 |
|
| RJ01 | Rejection of invention patent application after publication |