CN114003238A - Transcoding card-based container deployment method, device, equipment and storage medium - Google Patents
Transcoding card-based container deployment method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN114003238A CN114003238A CN202111165128.XA CN202111165128A CN114003238A CN 114003238 A CN114003238 A CN 114003238A CN 202111165128 A CN202111165128 A CN 202111165128A CN 114003238 A CN114003238 A CN 114003238A
- Authority
- CN
- China
- Prior art keywords
- transcoding
- target
- hardware resource
- card
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000004590 computer program Methods 0.000 claims description 11
- 230000000694 effects Effects 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 239000003795 chemical substances by application Substances 0.000 description 2
- 238000004134 energy conservation Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 238000005192 partition Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000012384 transportation and delivery Methods 0.000 description 2
- 206010044565 Tremor Diseases 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000013439 planning Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45562—Creating, deleting, cloning virtual machine instances
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention discloses a container deployment method based on a transcoding card, which comprises the following steps: acquiring a deployment file; the deployment file comprises the target type and the target number of the application hardware resource module; determining the available number of each type of hardware resource module in each transcoding card; the coding units of each transcoding card are divided into different types of hardware resource modules, and the different types of hardware resource modules are provided with different numbers of coding units; and deploying the target containers on the target transcoding cards according to the target types, the target quantity and the available quantity. Therefore, in the application, by dividing the coding units in the transcoding card into different types of hardware resource modules, a plurality of containers can be deployed in the same transcoding card, and each container can occupy different types of hardware resource modules, so that the hardware utilization efficiency is improved; the invention also discloses a container deployment device, equipment and a storage medium based on the transcoding card, and the technical effects can be realized.
Description
Technical Field
The invention relates to the technical field of container deployment, in particular to a transcoding card-based container deployment method, a transcoding card-based container deployment device, transcoding card-based container deployment equipment and a transcoding card-based storage medium.
Background
With the continuous development of network technologies such as optical fiber, the broadband home-entry rate in China has reached 91% in 2020, and gigabit optical fiber has entered each home. Meanwhile, with the continuous development and popularization of 5G Mobile Communication Technology (fifth Generation Mobile Communication Technology), the network speed of the Mobile terminal in China can reach 100 Mbit/s. The continuous development of network technology brings continuous promotion of video services, video software such as express, tremble and silentness live broadcast is almost essential software for everyone, and the video reading amount of 14 hundred million people in China also brings huge transcoding pressure to the video software. Although the CPU (central processing unit) can also perform video transcoding, the CPU includes a control unit and a cache (cache) in addition to a computing unit, and also has complex control logic and a plurality of optimization circuits, and the computing unit only occupies a small part of the CPU, so the CPU is not suitable for completing a large-scale simple transcoding task. The transcoding card is a chip and a board card specially designed for completing a transcoding task, and a large number of coding and decoding units are contained in the transcoding card, so that the transcoding card is more suitable for completing a video transcoding task. The transcoding card contains a large number of coding and decoding units, so that multi-channel transcoding can be performed on one transcoding card.
At present, FFmpeg software is generally adopted to complete a transcoding task on a transcoding card, and when multi-channel transcoding is carried out on the same transcoding card, different transcoding processes can mutually influence each other due to sharing of hardware resources. In order to solve the problem that FFmpeg commands of different paths are mutually influenced when running on the same transcoding card, a Docker container can be deployed on the transcoding card by using a kubernets (container arrangement engine), and the resource isolation effect of the Docker container can avoid the mutual interference among the FFmpeg commands. At present, each container can automatically monopolize the transcoding card when the Docker containers are deployed, so that errors can be reported when other containers are deployed again after the first container is successfully deployed, and therefore, a plurality of Docker containers cannot be deployed simultaneously by the transcoding card at present.
Disclosure of Invention
The invention aims to provide a transcoding card-based container deployment method, a transcoding card-based container deployment device, transcoding card-based container deployment equipment and a transcoding card-based storage medium, so that the utilization efficiency of hardware is improved.
In order to achieve the above object, the present invention provides a transcoding card-based container deployment method, including:
acquiring a deployment file; the deployment file comprises a target type and a target number of the application hardware resource modules;
determining the available number of each type of hardware resource module in each transcoding card; the coding units of each transcoding card are divided into different types of hardware resource modules, and the different types of hardware resource modules are provided with different numbers of coding units;
deploying a target container on a target transcoding card according to the target type, the target quantity and the available quantity; the type of the hardware resource modules occupied by the target container in the running process is the target type, and the number of the occupied hardware resource modules is the target number.
Before determining the available number of each type of hardware resource module in each transcoding card, the method further comprises:
obtaining module division parameters from the deployment file; the module division parameter includes: dividing types and dividing numbers of the hardware resource modules;
and carrying out resource division on the coding unit of each transcoding card according to the module division parameters to generate different types of hardware resource modules.
Wherein the determining the available number of each type of hardware resource module in each transcoding card comprises:
determining the total number of each type of hardware resource module in each transcoding card;
acquiring the utilization rate of all coding units in each transcoding card;
and calculating the available number of each type of hardware resource module in each transcoding card according to the total number and the utilization rate.
Wherein, the calculating the available number of each type of hardware resource module in each transcoding card according to the total number and the utilization rate comprises:
determining the available number of each type of hardware resource module in each transcoding card through an available number determination rule; wherein the available quantity determination rule is as follows:
amounti＝efficiency*totali(1-usagei/100)；
wherein, i represents the ith transcoding card, amount represents the available quantity, efficiency represents the variable parameter, total represents the total quantity, and use represents the utilization rate.
Wherein the deploying a target container on a target transcoding card according to the target type, the target quantity, and the available quantity comprises:
determining a target transcoding card with the target number of hardware resource modules of the target type according to the available number of hardware resource modules of each type in each transcoding card;
deploying a target container on the target transcoding card according to the target type and the target quantity.
Wherein, the determining a target transcoding card having the target number of hardware resource modules of the target type according to the available number of hardware resource modules of each type in each transcoding card comprises:
determining the number of transcoding cards of the primarily selected transcoding cards according to the available number of each type of hardware resource module in each transcoding card; the primary selection transcoding cards are the transcoding cards of the hardware resource modules with the target quantity and the target types;
if the number of the transcoding cards is larger than 1, determining the total available number of all types of hardware resource modules in each primarily selected transcoding card, acquiring transcoding card operation mode information from the deployment file, and selecting a target transcoding card according to the transcoding card operation mode information and the total available number of each primarily selected transcoding card;
and if the number of the transcoding cards is 1, directly taking the primarily selected transcoding cards as target transcoding cards.
The method for selecting the target transcoding card according to the transcoding card operation mode information and the total available number of each primarily selected transcoding card comprises the following steps:
if the operation mode information of the transcoding cards is a performance mode, selecting the initially selected transcoding card with the least total available number as a target transcoding card;
and if the operation mode information of the transcoding cards is in a low power consumption mode, selecting the initially selected transcoding card with the largest total available number as a target transcoding card.
In order to achieve the above object, the present invention further provides a transcoding card based container deployment apparatus, including:
the first acquisition module is used for acquiring the deployment file; the deployment file comprises a target type and a target number of the application hardware resource modules;
the determining module is used for determining the available number of each type of hardware resource module in each transcoding card; the coding units of each transcoding card are divided into different types of hardware resource modules, and the different types of hardware resource modules are provided with different numbers of coding units;
the deployment module is used for deploying the target containers on the target transcoding cards according to the target types, the target quantities and the available quantities; the type of the hardware resource modules occupied by the target container in the running process is the target type, and the number of the occupied hardware resource modules is the target number.
To achieve the above object, the present invention further provides an electronic device comprising:
a memory for storing a computer program;
and the processor is used for realizing the steps of the transcoding card-based container deployment method when executing the computer program.
To achieve the above object, the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the above transcoding card based container deployment method.
According to the scheme, the container deployment method based on the transcoding card provided by the embodiment of the invention comprises the following steps: acquiring a deployment file; the deployment file comprises the target type and the target number of the application hardware resource module; determining the available number of each type of hardware resource module in each transcoding card; the coding units of each transcoding card are divided into different types of hardware resource modules, and the different types of hardware resource modules are provided with different numbers of coding units; deploying a target container on the target transcoding card according to the target type, the target quantity and the available quantity, wherein the type of the hardware resource modules occupied by the target container during the operation is the target type, and the quantity of the hardware resource modules occupied by the target container is the target quantity. Therefore, in the application, by dividing the coding units in the transcoding card into different types of hardware resource modules, a plurality of containers can be deployed in the same transcoding card, and each container can occupy different types of hardware resource modules, so that the hardware utilization efficiency is improved; the invention also discloses a container deployment device, equipment and a storage medium based on the transcoding card, and the technical effects can be realized.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a kubernets cluster architecture disclosed in the embodiments of the present invention;
fig. 2 is a schematic flowchart of a transcoding card-based container deployment method disclosed in an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a transcoding card based container deployment apparatus according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a schematic diagram of a kubernets cluster architecture provided in the embodiment of the present invention is shown. As can be seen from fig. 1, the kubernets cluster is divided into Master nodes and Node nodes. The Master node is mainly responsible for cluster control, and performs functions such as scheduling Pod (basic building module in kubernets), and the Master node mainly has 4 modules, which are an API Server (Application Programming Interface Server), a Scheduler (Scheduler), a contoller manager (controller manager), and an etcd (storage system). The API Server is an API interface for externally exposing kubernets, is an entry for performing resource operation outside, and provides mechanisms such as authentication, authorization, access control, API registration and discovery. The Scheduler is responsible for scheduling resources, schedules the Pod to a corresponding machine according to a predetermined scheduling policy, monitors the newly created Pod, and selects a node for their operation if the node is not allocated, which is the scheduling of the Pod. The Controller manager is responsible for maintaining the state of the cluster, such as fault detection, auto-extension, rolling updates, etc., which are background threads that handle regular tasks in the cluster. etcd is a backend database of kubernets where all kubernets cluster data is stored. The state of the entire cluster is saved.
The Node nodes are managed nodes, the Node nodes can be a physical host or a virtual host, the Node nodes are the work responsible nodes in the kubernetes cluster, and each Node can be distributed with some work loads by a Master. The kubernetes mainly comprises four components of Kubelet (node agent), Kube-proxy (network agent component), fluent (daemon process) and Pod. kubelet is responsible for maintaining the life cycle of the container, as well as for managing Volume and the network, and this component is responsible for creating Pod. The kube-proxy is responsible for providing cluster-internal Service discovery and load balancing for Service. Fluent is a daemon that helps provide a cluster-level log. Pod is the smallest scheduling unit in kubernets, and Pod is the smallest unit for management, creation and planning. Each Pod contains at least one Docker container, and the user's command will eventually run in the Docker container of each node. In this scheme, each node is a physical host, and as shown in fig. 1, each node includes a certain number of transcoding cards, and each transcoding card has a certain number of decoding units and encoding units.
In the embodiment, the scheme provides a hardware resource division strategy during software containerization deployment of the transcoding card, and hardware resources of the transcoding card are divided through the strategy so as to deploy a plurality of containers on the same transcoding card.
Referring to fig. 2, an embodiment of the present invention provides a schematic flowchart of a transcoding card-based container deployment method, where the method specifically includes the following steps:
s101, acquiring a deployment file; the deployment file comprises the target type and the target number of the application hardware resource module;
in this embodiment, the deployment file mainly includes two types of information: module partitioning parameters and container deployment parameters; the module division parameters are used for carrying out resource division on the coding units in each transcoding card; the container deployment parameters comprise a target type, a target quantity req _ nums and transcoding card operation Mode information Mode of the application hardware resource module, the target type is the type of the hardware resource module occupied by the target container during operation, the target quantity is the quantity of the hardware resource module of a certain type occupied by the target container during operation, and the transcoding card operation Mode information is used for selecting and deploying the target transcoding card of the target container. When a container is deployed, whether the transcoding card has a target number of hardware resource modules meeting a target type or not is firstly inquired, then different transcoding cards are selected according to different modes, when the selection performance is preferential, the container is deployed on different transcoding cards as much as possible to achieve larger performance when the container is deployed. When the low energy consumption mode is selected, the containers are deployed on the same transcoding card as much as possible to save energy.
S102, determining the available number of each type of hardware resource module in each transcoding card; the coding units of each transcoding card are divided into different types of hardware resource modules, and the different types of hardware resource modules are provided with different numbers of coding units;
in this embodiment, first, module partition parameters need to be acquired from the deployment file, where the module partition parameters include: dividing types and dividing numbers of the hardware resource modules; and then, carrying out resource division on the coding unit of each transcoding card according to the module division parameters to generate different types of hardware resource modules.
Specifically, the resource is divided by a hardware resource dividing plug-in, the hardware resource dividing plug-in is deployed to each transcoding card by a deployment file of kubernets, for example, the deployment file is delivery. Yakect apply-f delivery. yaml. It should be noted that, when transcoding is performed, the transcoding card is completed by the encoding unit and the decoding unit, and one transcoding card includes a large number of basic encoding units and decoding units. Because the transcoding card is used for transcoding the video, the computing power is limited by the encoding unit, and the decoding unit is not the bottleneck of the computing power, according to the scheme, only the encoding unit is subjected to resource division to form hardware resource modules.
It should be noted that, as can be seen from the actual operation situation, the amount of computation power required for processing different videos is different when the ffmpeg command is executed, for example, the computation power required for the videos with different time lengths, resolutions, and frame rates is different. Therefore, according to different requirements of computing power, the transcoding cards are divided into the following 4 types according to the module division parameters during resource division: 480p, 720p, 1080p, 2160p, calculate according to the actual computing power of transcoding the card chip, transcoding card computing power can stably operate the transcoding of 16 way 1080p videos, so in this scheme, can divide the coding unit of a transcoding card into: 96 480p type hardware resource modules, 36 720p hardware resource modules, 16 1080p hardware resource modules, 4 2160p hardware resource modules, that is: the number of coding units of the 1 2160p hardware resource module is 24 times of the number of coding units of the 480p hardware resource module. The hardware resource modules of different types can be simultaneously divided on the same transcoding card, when a container is deployed, different hardware resource module types are selected according to the needs of transcoding tasks, for example, containers occupying 480p hardware resource module types and 2160p hardware resource module types can be respectively operated on the same transcoding card, and the multi-type concurrent hardware resource division method can realize more efficient hardware resource utilization.
Further, when the available number of each type of hardware resource module in each transcoding card is determined, the total number of each type of hardware resource module in each transcoding card may be determined, then the utilization rate of all the coding units in each transcoding card may be obtained, and the available number of each type of hardware resource module in each transcoding card may be calculated according to the total number and the utilization rate.
Specifically, when the available number is determined, all the transcoding cards of the host are traversed, and then the available number of hardware resource modules of the current deployment container is calculated according to the total number of each type of hardware resource modules recorded in the deployment file, the utilization rate and other information. Such as: in the ith transcoding card, the total number of the hardware resource modules of a certain type is total, and the current utilization rate of the coding units is use, wherein the utilization rate is the ratio of the number of the idle coding units in the ith transcoding card to the total number of the coding units, and then the available number of the hardware resource modules of a certain type on the transcoding card i is amount and can be obtained by calculation according to formula 1:
amounti＝totali(1-usagei/100) (1)
however, in the actual ffmpeg transcoding calculation, the calculation capability cannot reach one hundred percent due to many reasons such as task scheduling, so that a variable parameter efficiency needs to be introduced when the number of available hardware resource modules is calculated, each ffmpeg in the container can normally run in the actual situation by controlling the variable parameter, and the empirical value of the variable parameter in the transcoding card is 0.7. Therefore, in the scheme, the available number of each type of hardware resource module in each transcoding card can be determined through an available number determination rule; the available quantity determination rule is the following equation 2:
amounti＝efficiency*totali(1-usagei/100) (2)
wherein, i represents the ith transcoding card, amount represents the available quantity, efficiency represents the variable parameter, total represents the total quantity, and use represents the utilization rate. It should be noted that the available number calculated by the present solution is the available number of a certain type of hardware resource module of a certain transcoding card, so the total available number of the transcoding card is the sum of the available numbers of all types of hardware resource modules.
S103, deploying target containers on the target transcoding cards according to the target types, the target quantity and the available quantity; the type of the hardware resource modules occupied by the target container in the running process is a target type, and the number of the occupied hardware resource modules is a target number.
When the target container is deployed, the target transcoding card with the target number of the hardware resource modules of the target type is determined according to the available number of the hardware resource modules of each type in each transcoding card; and then deploying the target containers on the target transcoding cards according to the target types and the target quantity. When the target transcoding card is determined, firstly, the number of the transcoding cards of the primarily selected transcoding card is determined according to the available number of each type of hardware resource module in each transcoding card; the primarily selected transcoding card is a transcoding card with a target number of target type hardware resource modules; if the number of the transcoding cards is larger than 1, determining the total available number of all types of hardware resource modules in each primarily selected transcoding card, acquiring the running mode information of the transcoding cards from the deployment file, and selecting a target transcoding card according to the running mode information of the transcoding cards and the total available number of each primarily selected transcoding card; and if the number of the transcoding cards is 1, directly taking the primarily selected transcoding card as a target transcoding card.
Specifically, in the scheme, when multiple containers containing the ffmpeg command are started on the same transcoding card through a kubernets deployment file, if the deployment file name is ffmpeg-test.yaml, the deployment command is as follows: kubecect apply-f ffmpeg-test. yaml. In addition, when the Docker containers for operating ffmpeg transcoding commands are deployed on the transcoding cards in batches through the kubernets deployment file, operation Mode information Mode can be transmitted into the deployment file, the operation Mode information determines the operation Mode of the transcoding cards, and if the operation Mode information of the transcoding cards is the PERFORMANCE Mode PERFOMANCE, the initially selected transcoding cards with the minimum total available number are selected as target transcoding cards; and if the operation mode information of the transcoding card is a LOW POWER consumption mode LOW _ POWER, selecting the initially selected transcoding card with the largest total available quantity as the target transcoding card. That is to say, when the PERFOMANCE mode is selected, for PERFORMANCE priority, the container is deployed on different transcoding cards as much as possible to achieve greater PERFORMANCE when the container is deployed, and when the LOW _ POWER mode is selected, the container is deployed on the same transcoding card as much as possible to save energy when the container is deployed, for example: when the transcoding card works with performance priority, selecting the transcoding card with the most remaining hardware resources on the host for deployment; when energy conservation is selected to be preferred, the transcoding card with the least residual hardware resources is selected for deployment on the premise of meeting the requirement of applying for the number of resource modules.
In conclusion, the scheme optimizes the containerized deployment of the code card software, and compared with the existing scheme, the scheme at least has the following beneficial effects:
firstly, the scheme can realize that the transcoding card software deploys a plurality of containers on the same transcoding card through a hardware resource division strategy.
The scheme divides the transcoding card into various hardware resource module types, so that a user can select the required types according to requirements, and the hardware utilization efficiency is improved by matching and using different hardware resource module types.
Third, the Mode parameters of the operation Mode of the transcoding card are introduced, a user can select different transcoding card selection strategies according to performance priority or energy conservation priority, and the user can select the transcoding card selection strategies according to requirements.
According to the scheme, the computing capacity cannot reach one hundred percent according to various reasons such as task scheduling in the actual operation process of the transcoding card, and the efficiency parameter is introduced to avoid the crash problem caused by reaching the computing capacity limit in the operation of the ffmpeg transcoding command.
In the following, the deployment apparatus, the device, and the storage medium provided in the embodiments of the present invention are introduced, and the deployment apparatus, the device, and the storage medium described below and the deployment method described above may be referred to each other.
Referring to fig. 3, an embodiment of the present invention provides a schematic structural diagram of a container deployment apparatus based on a transcoding card, which specifically includes:
a first obtaining module 11, configured to obtain a deployment file; the deployment file comprises a target type and a target number of the application hardware resource modules;
a determining module 12, configured to determine an available number of each type of hardware resource module in each transcoding card; the coding units of each transcoding card are divided into different types of hardware resource modules, and the different types of hardware resource modules are provided with different numbers of coding units;
a deployment module 13, configured to deploy a target container on a target transcoding card according to the target type, the target quantity, and the available quantity; the type of the hardware resource modules occupied by the target container in the running process is the target type, and the number of the occupied hardware resource modules is the target number.
Wherein the apparatus further comprises:
the second acquisition module is used for acquiring module division parameters from the deployment file; the module division parameter includes: dividing types and dividing numbers of the hardware resource modules;
and the dividing module is used for carrying out resource division on the coding unit of each transcoding card according to the module division parameters to generate different types of hardware resource modules.
Wherein the determining module comprises:
the first determining unit is used for determining the total number of each type of hardware resource module in each transcoding card;
the acquisition unit is used for acquiring the utilization rate of all the coding units in each transcoding card;
and the calculating unit is used for calculating the available number of each type of hardware resource module in each transcoding card according to the total number and the utilization rate.
Wherein the computing unit is specifically configured to: determining the available number of each type of hardware resource module in each transcoding card through an available number determination rule; wherein the available quantity determination rule is as follows:
amounti＝efficiency*totali(1-uSagei/100)；
wherein, i represents the ith transcoding card, amount represents the available quantity, efficiency represents the variable parameter, total represents the total quantity, and use represents the utilization rate.
Wherein the deployment module comprises:
a second determining unit, configured to determine, according to an available number of each type of hardware resource module in each transcoding card, a target transcoding card having the target number of the target type of hardware resource modules;
and the deployment unit is used for deploying the target containers on the target transcoding cards according to the target types and the target quantities.
Wherein the second determination unit includes:
the first determining subunit is used for determining the number of the transcoding cards of the primarily selected transcoding cards according to the available number of each type of hardware resource module in each transcoding card; the primary selection transcoding cards are the transcoding cards of the hardware resource modules with the target quantity and the target types;
the second determining subunit is used for determining the total available number of all types of hardware resource modules in each primarily selected transcoding card when the number of the transcoding cards is greater than 1;
the acquiring subunit is used for acquiring the transcoding card operation mode information from the deployment file;
the selecting subunit is used for selecting a target transcoding card according to the transcoding card operation mode information and the total available number of each primarily selected transcoding card;
and the third determining subunit is used for directly taking the primarily selected transcoding card as a target transcoding card when the number of the transcoding cards is 1.
Wherein the selection subunit is specifically configured to: if the operation mode information of the transcoding cards is a performance mode, selecting the initially selected transcoding card with the least total available number as a target transcoding card; and if the operation mode information of the transcoding cards is in a low power consumption mode, selecting the initially selected transcoding card with the largest total available number as a target transcoding card.
Referring to fig. 4, an electronic device according to an embodiment of the present invention includes:
a memory 21 for storing a computer program;
a processor 22, configured to implement the steps of the transcoding card based container deployment method according to any of the above method embodiments when executing the computer program.
In this embodiment, the device may be a PC (Personal Computer), or may be a terminal device such as a smart phone, a tablet Computer, a palmtop Computer, or a portable Computer.
The device may include a memory 21, a processor 22, and a bus 23.
The memory 21 includes at least one type of readable storage medium, which includes a flash memory, a hard disk, a multimedia card, a card type memory (e.g., SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, and the like. The memory 21 may in some embodiments be an internal storage unit of the device, for example a hard disk of the device. The memory 21 may also be an external storage device of the device in other embodiments, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) Card, Flash memory Card (Flash Card), etc. provided on the device. Further, the memory 21 may also include both an internal storage unit of the device and an external storage device. The memory 21 may be used not only to store application software installed in the device and various types of data such as program codes for executing the deployment method, etc., but also to temporarily store data that has been output or is to be output.
The bus 23 may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 4, but this does not indicate only one bus or one type of bus.
Further, the device may further include a network interface 24, and the network interface 24 may optionally include a wired interface and/or a wireless interface (e.g., WI-FI interface, bluetooth interface, etc.), which are generally used to establish a communication connection between the device and other electronic devices.
Optionally, the device may further comprise a user interface 25, the user interface 25 may comprise a Display (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 25 may also comprise a standard wired interface, a wireless interface. Alternatively, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, or the like. The display, which may also be referred to as a display screen or display unit, is suitable for displaying information processed in the device and for displaying a visualized user interface.
Fig. 4 shows only the device with the components 21-25, and it will be understood by those skilled in the art that the structure shown in fig. 4 does not constitute a limitation of the device, and may comprise fewer or more components than those shown, or some components may be combined, or a different arrangement of components.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the transcoding card-based container deployment method described in any of the above method embodiments are implemented.
Wherein the storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A transcoding card based container deployment method is characterized by comprising the following steps:
acquiring a deployment file; the deployment file comprises a target type and a target number of the application hardware resource modules;
determining the available number of each type of hardware resource module in each transcoding card; the coding units of each transcoding card are divided into different types of hardware resource modules, and the different types of hardware resource modules are provided with different numbers of coding units;
deploying a target container on a target transcoding card according to the target type, the target quantity and the available quantity; the type of the hardware resource modules occupied by the target container in the running process is the target type, and the number of the occupied hardware resource modules is the target number.
2. The container deployment method of claim 1, wherein prior to determining the available number of each type of hardware resource module in each transcoding card, further comprising:
obtaining module division parameters from the deployment file; the module division parameter includes: dividing types and dividing numbers of the hardware resource modules;
and carrying out resource division on the coding unit of each transcoding card according to the module division parameters to generate different types of hardware resource modules.
3. The container deployment method of claim 1, wherein the determining the available number of each type of hardware resource module in each transcoding card comprises:
determining the total number of each type of hardware resource module in each transcoding card;
acquiring the utilization rate of all coding units in each transcoding card;
and calculating the available number of each type of hardware resource module in each transcoding card according to the total number and the utilization rate.
4. The container deployment method of claim 3, wherein the calculating the available number of each type of hardware resource module in each transcoding card according to the total number and the utilization rate comprises:
determining the available number of each type of hardware resource module in each transcoding card through an available number determination rule; wherein the available quantity determination rule is as follows:
amounti＝efficiency*totali(1-usagei/100)；
wherein, i represents the ith transcoding card, amount represents the available quantity, efficiency represents the variable parameter, total represents the total quantity, and use represents the utilization rate.
5. The container deployment method according to any one of claims 1 to 4, wherein deploying target containers on a target transcoding card according to the target type, the target number and the available number comprises:
determining a target transcoding card with the target number of hardware resource modules of the target type according to the available number of hardware resource modules of each type in each transcoding card;
deploying a target container on the target transcoding card according to the target type and the target quantity.
6. The container deployment method of claim 5, wherein the determining a target transcoding card having the target number of hardware resource modules of the target type according to the available number of hardware resource modules of each type in each transcoding card comprises:
determining the number of transcoding cards of the primarily selected transcoding cards according to the available number of each type of hardware resource module in each transcoding card; the primary selection transcoding cards are the transcoding cards of the hardware resource modules with the target quantity and the target types;
if the number of the transcoding cards is larger than 1, determining the total available number of all types of hardware resource modules in each primarily selected transcoding card, acquiring transcoding card operation mode information from the deployment file, and selecting a target transcoding card according to the transcoding card operation mode information and the total available number of each primarily selected transcoding card;
and if the number of the transcoding cards is 1, directly taking the primarily selected transcoding cards as target transcoding cards.
7. The container deployment method of claim 6, wherein the selecting a target transcoding card according to the transcoding card operation mode information and the total available number of each initially selected transcoding card comprises:
if the operation mode information of the transcoding cards is a performance mode, selecting the initially selected transcoding card with the least total available number as a target transcoding card;
and if the operation mode information of the transcoding cards is in a low power consumption mode, selecting the initially selected transcoding card with the largest total available number as a target transcoding card.
8. A transcoding card based container deployment apparatus, comprising:
the first acquisition module is used for acquiring the deployment file; the deployment file comprises a target type and a target number of the application hardware resource modules;
the determining module is used for determining the available number of each type of hardware resource module in each transcoding card; the coding units of each transcoding card are divided into different types of hardware resource modules, and the different types of hardware resource modules are provided with different numbers of coding units;
the deployment module is used for deploying the target containers on the target transcoding cards according to the target types, the target quantities and the available quantities; the type of the hardware resource modules occupied by the target container in the running process is the target type, and the number of the occupied hardware resource modules is the target number.
9. An electronic device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the transcoding card based container deployment method according to any of claims 1 to 7 when executing said computer program.
10. A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of the method for transcoding card based container deployment according to any of the claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111165128.XA CN114003238B (en) | 2021-09-30 | 2021-09-30 | Container deployment method, device, equipment and storage medium based on transcoding card |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111165128.XA CN114003238B (en) | 2021-09-30 | 2021-09-30 | Container deployment method, device, equipment and storage medium based on transcoding card |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114003238A true CN114003238A (en) | 2022-02-01 |
| CN114003238B CN114003238B (en) | 2023-11-03 |
Family
ID=79922245
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111165128.XA Active CN114003238B (en) | 2021-09-30 | 2021-09-30 | Container deployment method, device, equipment and storage medium based on transcoding card |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114003238B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115098238A (en) * | 2022-07-07 | 2022-09-23 | 北京鼎成智造科技有限公司 | Application program task scheduling method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011057489A1 (en) * | 2009-11-11 | 2011-05-19 | 腾讯科技（深圳）有限公司 | Method and device for multimedia file transcoding |
| US20150281751A1 (en) * | 2014-03-31 | 2015-10-01 | Arris Enterprises, Inc. | Adaptive streaming transcoder synchronization |
| WO2017016292A1 (en) * | 2015-07-24 | 2017-02-02 | 乐视控股（北京）有限公司 | Method of allocating video transcoding resource and system utilizing same |
| US20190034233A1 (en) * | 2017-07-28 | 2019-01-31 | Genband Us Llc | Virtual container processing on high performance computing processors |
| CN112256430A (en) * | 2020-10-23 | 2021-01-22 | 北京三快在线科技有限公司 | Container deployment method, device, equipment and storage medium |
-
2021
- 2021-09-30 CN CN202111165128.XA patent/CN114003238B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011057489A1 (en) * | 2009-11-11 | 2011-05-19 | 腾讯科技（深圳）有限公司 | Method and device for multimedia file transcoding |
| US20150281751A1 (en) * | 2014-03-31 | 2015-10-01 | Arris Enterprises, Inc. | Adaptive streaming transcoder synchronization |
| WO2017016292A1 (en) * | 2015-07-24 | 2017-02-02 | 乐视控股（北京）有限公司 | Method of allocating video transcoding resource and system utilizing same |
| US20190034233A1 (en) * | 2017-07-28 | 2019-01-31 | Genband Us Llc | Virtual container processing on high performance computing processors |
| CN112256430A (en) * | 2020-10-23 | 2021-01-22 | 北京三快在线科技有限公司 | Container deployment method, device, equipment and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115098238A (en) * | 2022-07-07 | 2022-09-23 | 北京鼎成智造科技有限公司 | Application program task scheduling method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114003238B (en) | 2023-11-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111052149B (en) | Method and apparatus for determining memory requirements in a network | |
| EP3073374B1 (en) | Thread creation method, service request processing method and related device | |
| US7945913B2 (en) | Method, system and computer program product for optimizing allocation of resources on partitions of a data processing system | |
| WO2018130163A1 (en) | Scheduling method and device for mobile cloud computing platform | |
| CN108462760B (en) | Electronic device, automatic cluster access domain name generation method and storage medium | |
| CN105335229A (en) | Business resource scheduling method and apparatus | |
| CN109960575B (en) | Computing capacity sharing method, system and related equipment | |
| CN111880936A (en) | Resource scheduling method and device, container cluster, computer equipment and storage medium | |
| US8799474B2 (en) | Apparatus and method to allocate limited resources | |
| CN113157379A (en) | Cluster node resource scheduling method and device | |
| WO2023174037A1 (en) | Resource scheduling method, apparatus and system, device, medium, and program product | |
| CN111104219A (en) | Binding method, device, equipment and storage medium of virtual core and physical core | |
| CN114003238A (en) | Transcoding card-based container deployment method, device, equipment and storage medium | |
| CN110912967A (en) | Service node scheduling method, device, equipment and storage medium | |
| CN116069493A (en) | Data processing method, device, equipment and readable storage medium | |
| CN111459648B (en) | Heterogeneous multi-core platform resource optimization method and device for application program | |
| CN111475251A (en) | Cluster container scheduling method, system, terminal and storage medium | |
| CN114924888A (en) | Resource allocation method, data processing method, device, equipment and storage medium | |
| CN111722888B (en) | Operation execution method, device, equipment and readable storage medium | |
| CN115361285B (en) | Method, device, equipment and medium for realizing off-line service mixed deployment | |
| CN112995704B (en) | Cache management method and device, electronic equipment and storage medium | |
| CN117707797A (en) | Task scheduling method and device based on distributed cloud platform and related equipment | |
| CN115391042B (en) | Resource allocation method and device, electronic equipment and storage medium | |
| CN114201306B (en) | Multi-dimensional geographic space entity distribution method and system based on load balancing technology | |
| CN115951988B (en) | Job scheduling method, computing equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |