CN112135172A

CN112135172A - Weak network-based audio and video processing method and system

Info

Publication number: CN112135172A
Application number: CN202011051309.5A
Authority: CN
Inventors: 杨思亭; 杨柱豪
Original assignee: Guangzhou Yunzhi Communication Technology Co ltd
Current assignee: Jiang Xingyu
Priority date: 2020-09-29
Filing date: 2020-09-29
Publication date: 2020-12-25

Abstract

The embodiment of the invention provides an audio and video processing method and system based on a weak network, which extracts the transmission quality characteristics of each audio and video transmission information set in a transmission quality identification mode, determines the transmission record portrait of a transmission protocol layer corresponding to each audio and video transmission node based on a transmission quality label interval, thereby converting each transmission control strategy into an effective coordination scheduling reference, determining the transmission channel distribution information corresponding to each transmission protocol layer according to the transmission record portrait of the transmission protocol layer corresponding to each audio and video transmission node, generating the thread characteristic information of the audio and video transmission thread corresponding to the audio and video transmission information, switching to a corresponding target audio and video transmission server to execute the audio and video transmission task of the audio and video transmission server, thereby effectively combining the specific type of the transmission protocol layer to carry out coordination scheduling switching, and further the applicability of the switched audio and video transmission server is improved.

Description

Weak network-based audio and video processing method and system

Technical Field

The invention relates to the technical field of audio and video transmission, in particular to an audio and video processing method and system based on a weak network.

Background

At present, in the audio and video transmission process of an audio and video transmission server, when the server is suddenly in a weak network environment, the normal audio and video transmission service is greatly affected, so that corresponding coordination scheduling processing needs to be performed. However, the traditional scheduling switching scheme does not consider the specific type of the transport protocol layer to perform coordinated scheduling switching, which results in low applicability of the switched audio/video transmission server.

Disclosure of Invention

In order to overcome at least the above disadvantages in the prior art, an object of the present invention is to provide an audio/video processing method and system based on a weak network, which can effectively combine the specific type of the transport protocol layer to perform coordinated scheduling switching, thereby improving the applicability of the switched audio/video transmission server.

In a first aspect, the present invention provides an audio/video processing method based on a weak network, which is applied to a scheduling server, wherein the scheduling server is in communication connection with a plurality of audio/video transmission servers, and the method includes:

acquiring at least one audio/video transmission information set from audio/video transmission information of the audio/video transmission server in a weak network environment, wherein each audio/video transmission node in each audio/video transmission information set belongs to the same transmission protocol layer, and each audio/video transmission node corresponds to a transmission control strategy under the transmission protocol layer to which the audio/video transmission node belongs;

carrying out transmission quality identification on the audio and video transmission information sets based on each transmission control strategy under the transmission protocol layer to obtain the transmission quality characteristics of each audio and video transmission information set and the corresponding transmission quality label intervals;

determining a transmission recording portrait of a transmission protocol layer corresponding to each audio and video transmission node according to the transmission quality characteristics and the corresponding transmission quality label interval;

according to the transmission record portrait of the transmission protocol layer corresponding to each audio and video transmission node, determining transmission channel distribution information corresponding to each transmission protocol layer, generating thread characteristic information of an audio and video transmission thread corresponding to the audio and video transmission information according to the transmission channel distribution information corresponding to each transmission protocol layer, and switching to a corresponding target audio and video transmission server according to the thread characteristic information of the audio and video transmission thread to execute an audio and video transmission task of the audio and video transmission server.

In a possible implementation manner of the first aspect, the step of obtaining at least one audio/video transmission information set from the audio/video transmission information of the audio/video transmission server in the weak network environment includes:

and acquiring audio and video transmission nodes of which transmission protocol layers belong to the same transmission protocol layer from the audio and video transmission information of the audio and video transmission server in the weak network environment, and determining the audio and video transmission nodes belonging to each transmission protocol layer as a corresponding audio and video transmission information set.

In a possible implementation manner of the first aspect, the step of identifying transmission quality of the audio/video transmission information sets based on each transmission control policy under the transmission protocol layer to obtain transmission quality characteristics of each audio/video transmission information set and a corresponding transmission quality tag interval includes:

traversing audio and video transmission nodes in the audio and video transmission information set for each audio and video transmission information set, extracting network plug flow characteristic vectors clustering transmission control strategies under a transmission protocol layer to which the audio and video transmission information set belongs from the audio and video transmission nodes, and determining network plug flow element information corresponding to the audio and video transmission information set according to the extracted network plug flow characteristic vectors;

removing set noise characteristic vectors contained in the network plug flow characteristic vectors in the network plug flow element information, splitting the network plug flow characteristic vectors from which the set noise characteristic vectors are removed to obtain first network plug flow element information, and determining the code rate change degree of each network plug flow element according to the occupied area of the network plug flow element in the network plug flow characteristic vectors contained in the first network plug flow element information;

removing network plug flow elements with the code rate change degree smaller than a preset code rate change degree threshold value in the first network plug flow element information to obtain second network plug flow element information, taking the network plug flow elements with the code rate change degree not smaller than the preset code rate change degree threshold value as first network plug flow elements to obtain a first network plug flow element list, and determining a second network plug flow element list which corresponds to each first network plug flow element and consists of the network plug flow elements connected behind the first network plug flow element according to matching information of each first network plug flow element in the first network plug flow element list in the second network plug flow element information;

judging whether the second network plug flow element list is empty or not, if the second network plug flow element list is empty, circularly returning, and if the second network plug flow element list is not empty, counting the code rate change degree of each network plug flow element in the second network plug flow element list, and judging whether the code rate change degree of each network plug flow element meets the requirement of the minimum code rate change degree or not;

if the code rate change degree of the network plug flow element does not meet the requirement of the minimum code rate change degree, circularly returning, if the code rate change degree of the network plug flow element meets the requirement of the minimum code rate change degree, discretizing a first network plug flow element corresponding to the network plug flow element and the second network plug flow element list to obtain a new first network plug flow element, determining a second network plug flow element list of the new first network plug flow element, and performing circular recognition on the second network plug flow element list corresponding to the new first network plug flow element to obtain all target first network plug flow elements meeting the requirement of the minimum code rate change degree and the corresponding code rate change degrees;

the data returned circularly is all target first network plug flow elements meeting the requirement of minimum code rate change degree and corresponding code rate change degrees which are obtained currently, all target first network plug flow elements meeting the requirement of minimum code rate change degree and corresponding code rate change degrees are obtained, the target first network plug flow elements are used as transmission quality characteristics of the audio and video transmission information set, and the code rate change degree of each target first network plug flow element in the second network plug flow element list is used as a transmission quality label interval corresponding to the transmission quality characteristics.

In a possible implementation manner of the first aspect, the step of determining, according to the transmission quality characteristic and the corresponding transmission quality tag interval, a transmission record sketch of a transmission protocol layer to which each of the audio/video transmission nodes belongs includes:

screening the transmission quality characteristics according to the transmission quality characteristics and the corresponding transmission quality label intervals to obtain target transmission quality characteristics covering preset transmission quality label intervals;

acquiring a first transmission record network label set corresponding to a first transmission quality object and a second transmission record network label set corresponding to a second transmission quality object on a target transmission quality characteristic, wherein the first transmission record network label set comprises a plurality of label attribute updating segments for performing label attribute updating on related quality evaluation indexes in the target transmission quality characteristic by the first transmission quality object, the second transmission record network label set comprises a plurality of label attribute updating segments for performing label attribute updating on related quality evaluation indexes in the target transmission quality characteristic by the second transmission quality object, and each label attribute updating segment comprises a plurality of label attribute updating segment nodes;

clustering a plurality of label attribute updating segments in the first transmission record network label set based on the preset label attribute updating segment category to obtain a clustered first transmission record network label set; the preset label attribute updating fragment category belongs to types corresponding to a plurality of label attribute updating fragment nodes;

combining all label attribute updating segment nodes corresponding to each preset label attribute updating segment category in a preset label attribute updating segment category list in the clustered first transmission record network label set into a first preset label attribute updating segment list;

removing duplication of the first preset tag attribute updating fragment list to obtain a first tag attribute updating fragment list, so as to obtain a first tag attribute updating fragment list corresponding to the preset tag attribute updating fragment category list;

combining each label attribute updating segment node in the first label attribute updating segment list into a first label attribute updating segment node list corresponding to the first transmission quality object, wherein the first label attribute updating segment node list corresponds to the preset label attribute updating segment type list, and the preset label attribute updating segment type is a list formed by each label attribute updating segment type used for information updating;

extracting, from the second transmission record network tag set, each tag attribute update segment node corresponding to each preset tag attribute update segment category in the preset tag attribute update segment category list, and combining the extracted tag attribute update segment nodes into a second tag attribute update segment node list corresponding to the second transmission quality object, where the second tag attribute update segment node list corresponds to the preset tag attribute update segment category list, and the first tag attribute update segment node list and the second tag attribute update segment node list are lists formed by the tag attribute update segment nodes extracted from the corresponding transmission record network tag set;

determining an image collection type of the same label attribute update fragment node between the first label attribute update fragment node list and the second label attribute update fragment node list, and obtaining an interval range of a type interval corresponding to the image collection type;

when the interval range covers a preset interval range, determining the first transmission quality object and the second transmission quality object as a label attribute updating unit;

any two transmission quality elements in the target transmission quality characteristics are used as a first transmission quality object and a second transmission quality object to update information, and a label attribute updating unit list with label attribute updating behaviors in the target transmission quality characteristics is obtained until the detection of the transmission quality elements in the target transmission quality characteristics is completed;

taking the image collection type of the transmission quality element in the tag attribute updating unit list as a target unit image collection type;

taking the image collection type of the transmission quality element corresponding to the target transmission quality characteristic as a target global image collection type;

calculating a common collection type of the target unit image collection type and the target global image collection type to obtain a common collection type characteristic corresponding to the target transmission quality characteristic;

and when the common collection type characteristics meet preset characteristic conditions, determining the portrait information formed by the common collection type characteristics corresponding to the target transmission quality characteristics as a transmission record portrait of a transmission protocol layer corresponding to each audio/video transmission node.

In a possible implementation manner of the first aspect, the step of determining, according to the transmission record sketch of the transmission protocol layer to which each of the audio/video transmission nodes belongs, transmission channel distribution information corresponding to each of the transmission protocol layers includes:

acquiring corresponding transmission channel tags and initial channel pointing characteristics of the transmission channel tags from transmission record portraits of transmission protocol layers corresponding to the audio and video transmission nodes;

predicting the transmission channel label according to a pre-trained artificial intelligence model to obtain a target channel pointing characteristic;

comparing the initial channel pointing characteristics with the target channel pointing characteristics to obtain pointing comparison information;

and determining the transmission channel distribution information corresponding to each transmission protocol layer according to the direction comparison information.

In one possible implementation form of the first aspect, the initial channel pointing characteristic comprises at least one initial auxiliary channel pointing characteristic, and the target channel pointing characteristic comprises at least one target auxiliary channel pointing characteristic;

the step of comparing the initial channel pointing characteristics with the target channel pointing characteristics to obtain pointing comparison information includes:

performing regression analysis on each initial auxiliary channel pointing characteristic and each target auxiliary channel pointing characteristic respectively to obtain auxiliary regression analysis information, and obtaining at least one auxiliary regression analysis information when the regression analysis of the at least one target auxiliary channel pointing characteristic is completed; the at least one target auxiliary channel pointing feature corresponds to the at least one auxiliary regression analysis information one to one, and the auxiliary regression analysis information represents whether the initial auxiliary channel pointing feature is matched with the target auxiliary channel pointing feature or not;

discretizing the at least one auxiliary regression analysis information to obtain regression analysis information corresponding to the pointing characteristics of each initial auxiliary channel; wherein the regression analysis information characterizes whether target affiliated channel directional characteristics exist for regression analysis with initial affiliated channel directional characteristics, the regression analysis information corresponding to each of the initial affiliated channel directional characteristics;

extracting the initial auxiliary channel pointing characteristics of the target auxiliary channel pointing characteristics with regression analysis represented by the regression analysis information in the at least one initial auxiliary channel pointing characteristic to obtain regression analysis initial auxiliary channel pointing characteristics;

extracting target auxiliary channel pointing characteristics subjected to regression analysis with the regression analysis initial auxiliary channel pointing characteristics from the at least one target auxiliary channel pointing characteristics according to the regression analysis information, and taking the target auxiliary channel pointing characteristics as regression analysis target auxiliary channel pointing characteristics;

discretizing the initial auxiliary channel pointing characteristics except the regression analysis initial auxiliary channel pointing characteristics in the at least one initial auxiliary channel pointing characteristic to obtain an initial discretization characteristic sequence;

discretizing the target auxiliary channel pointing characteristics except the regression analysis target auxiliary channel pointing characteristics in the at least one target auxiliary channel pointing characteristic to obtain a target discretization characteristic sequence;

fusing the initial discretization characteristic sequence and the target discretization characteristic sequence to obtain the directional comparison information;

the initial auxiliary channel pointing characteristics comprise initial uplink channel information, initial flow control engine information and initial associated object information, and the target auxiliary channel pointing characteristics comprise target uplink channel information, target flow control engine information and target associated object information.

In a possible implementation manner of the first aspect, each initial auxiliary channel pointing characteristic includes initial uplink channel information and initial flow control engine information, and each target auxiliary channel pointing characteristic includes target uplink channel information and target flow control engine information;

the step of performing regression analysis on each initial auxiliary channel pointing characteristic and each target auxiliary channel pointing characteristic respectively to obtain auxiliary regression analysis information, and when the regression analysis of the at least one target auxiliary channel pointing characteristic is completed, obtaining at least one auxiliary regression analysis information includes:

matching the initial uplink channel information with target uplink channel information of each target auxiliary channel pointing characteristic to obtain matching reference information corresponding to each target auxiliary channel pointing characteristic; the matching reference information represents whether the initial uplink channel information is matched with the target uplink channel information;

determining initial flow control engine buffer area information by using the initial flow control engine information, and determining target flow control engine buffer area information of the pointing characteristic of each target auxiliary channel by using the target flow control engine information of the pointing characteristic of each target auxiliary channel;

obtaining association information corresponding to each piece of target flow control engine buffer area information and the initial flow control engine buffer area information and a discretization processing result corresponding to each piece of target flow control engine buffer area information and the initial flow control engine buffer area information according to the initial flow control engine buffer area information and each piece of target flow control engine buffer area information;

and obtaining at least one auxiliary regression analysis information by using the correlation information and the discretization processing result.

In a possible implementation manner of the first aspect, the step of determining, according to the direction comparison information, transmission channel distribution information corresponding to each of the transmission protocol layers includes:

and acquiring a target channel distribution map node corresponding to each direction comparison node from the direction comparison information, and using each target channel distribution map node as the transmission channel distribution information corresponding to each transmission protocol layer in a clustering and arranging manner.

In a possible implementation manner of the first aspect, the step of generating thread feature information of an audio/video transmission thread corresponding to the audio/video transmission information according to transmission channel distribution information corresponding to each transmission protocol layer, and switching to a corresponding target audio/video transmission server according to the thread feature information of the audio/video transmission thread to execute an audio/video transmission task of the audio/video transmission server includes:

acquiring transmission channel calling information, transmission channel mapping thread information associated with the transmission channel calling information and historical channel mapping thread information from map nodes mapped by transmission channel distribution information corresponding to each transmission protocol layer, wherein the historical channel mapping thread information comprises at least one channel mapping thread information of a historical transmission process;

inputting the transmission channel mapping thread information and the historical channel mapping thread information into a machine learning model, performing thread feature extraction on the transmission channel mapping thread information to obtain a first thread feature segment, and performing thread feature extraction on each historical channel mapping thread information to obtain a second thread feature segment;

fusing the segment parts in the first thread feature segment to obtain a first thread transmission behavior vector used for expressing the thread transmission behavior of the transmission channel mapping thread information, and fusing the segment parts in the second thread feature segment to obtain a second thread transmission behavior vector used for expressing the thread transmission behavior of the historical channel mapping thread information;

calculating the similarity between the first thread transmission behavior vector and each second thread transmission behavior vector, and taking the calculated similarity as the similarity between the transmission channel mapping thread information and the historical channel mapping thread information;

determining the calculated similarity as the corresponding correlation degree when the corresponding transmission channel mapping thread information is strongly correlated with the historical channel mapping thread information; the relevancy is used for measuring the degree of the transmission channel mapping thread information depending on the historical channel mapping thread information;

calculating calling process information of the transmission channel mapping thread information to the transmission channel calling information based on the first thread feature segment and a third thread feature segment of the transmission channel calling information, and operating the calling process information and the association degree to obtain calling process configuration information of the transmission channel calling information aiming at the transmission channel mapping thread information and a thread feature region of the historical channel mapping thread information in the transmission channel calling information;

according to the calling process configuration information and the thread characteristic region corresponding to the strong association condition of the association degree, determining the thread characteristic information corresponding to the thread characteristic region in the calling process configuration information, and generating the thread characteristic information of the audio and video transmission thread corresponding to the audio and video transmission information according to the extracted thread characteristic information

In a second aspect, an embodiment of the present invention further provides a system for an audio/video processing method based on a weak network, which is applied to a scheduling server, where the scheduling server is in communication connection with a plurality of audio/video transmission servers, and the system includes:

the acquisition module is used for acquiring at least one audio and video transmission information set from audio and video transmission information of the audio and video transmission server in a weak network environment, each audio and video transmission node in each audio and video transmission information set belongs to the same transmission protocol layer, and each audio and video transmission node corresponds to a transmission control strategy under the transmission protocol layer to which the audio and video transmission node belongs;

the identification module is used for identifying the transmission quality of the audio and video transmission information sets based on each transmission control strategy under the transmission protocol layer to obtain the transmission quality characteristics of each audio and video transmission information set and the corresponding transmission quality label intervals;

the determining module is used for determining a transmission recording portrait of a transmission protocol layer corresponding to each audio/video transmission node according to the transmission quality characteristics and the corresponding transmission quality label interval;

and the switching module is used for determining transmission channel distribution information corresponding to each transmission protocol layer according to the transmission record portrait of the transmission protocol layer to which each audio/video transmission node corresponds, generating thread characteristic information of an audio/video transmission thread corresponding to the audio/video transmission information according to the transmission channel distribution information corresponding to each transmission protocol layer, and switching to a corresponding target audio/video transmission server according to the thread characteristic information of the audio/video transmission thread to execute an audio/video transmission task of the audio/video transmission server.

In a third aspect, an embodiment of the present invention further provides a system for audio and video processing based on a weak network, where the system for audio and video processing based on a weak network includes a scheduling server and a plurality of audio and video transmission servers in communication connection with the scheduling server;

the scheduling server is used for acquiring at least one audio and video transmission information set from audio and video transmission information of the audio and video transmission server in a weak network environment, each audio and video transmission node in each audio and video transmission information set belongs to the same transmission protocol layer, and each audio and video transmission node corresponds to a transmission control strategy under the transmission protocol layer to which the audio and video transmission node belongs;

the scheduling server is used for identifying the transmission quality of the audio and video transmission information sets based on each transmission control strategy under the transmission protocol layer to obtain the transmission quality characteristics of each audio and video transmission information set and the corresponding transmission quality label intervals;

the scheduling server is used for determining a transmission recording portrait of a transmission protocol layer corresponding to each audio/video transmission node according to the transmission quality characteristics and the corresponding transmission quality label interval;

the scheduling server is used for determining transmission channel distribution information corresponding to each transmission protocol layer according to the transmission record portrait of the transmission protocol layer to which each audio/video transmission node corresponds, generating thread characteristic information of an audio/video transmission thread corresponding to the audio/video transmission information according to the transmission channel distribution information corresponding to each transmission protocol layer, and switching to a corresponding target audio/video transmission server according to the thread characteristic information of the audio/video transmission thread to execute an audio/video transmission task of the audio/video transmission server.

In a fourth aspect, an embodiment of the present invention further provides a dispatch server, where the dispatch server includes a processor, a machine-readable storage medium, and a network interface, where the machine-readable storage medium, the network interface, and the processor are connected through a bus system, the network interface is configured to be communicatively connected to at least one audio/video transmission server, the machine-readable storage medium is configured to store a program, an instruction, or a code, and the processor is configured to execute the program, the instruction, or the code in the machine-readable storage medium to perform the weak network-based audio/video processing method in the first aspect or any one of the possible implementation manners in the first aspect.

In a fifth aspect, an embodiment of the present invention provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed, the computer is caused to execute the weak network-based audio/video processing method in the first aspect or any one of the possible implementation manners of the first aspect.

Based on any one of the aspects, the transmission quality characteristics of each audio and video transmission information set are extracted in a transmission quality identification mode, and the transmission record portrait of the transmission protocol layer to which each audio and video transmission node belongs is determined based on the transmission quality label interval, so that each transmission control strategy is converted into an effective coordination scheduling reference. Therefore, according to the transmission record portrait of the transmission protocol layer corresponding to each audio and video transmission node, the transmission channel distribution information corresponding to each transmission protocol layer is determined, the thread characteristic information of the audio and video transmission thread corresponding to the audio and video transmission information is generated according to the transmission channel distribution information corresponding to each transmission protocol layer, and the audio and video transmission task of the audio and video transmission server is executed by switching to the corresponding target audio and video transmission server according to the thread characteristic information of the audio and video transmission thread, so that the coordinated scheduling switching can be effectively carried out by combining the specific type of the transmission protocol layer, and the applicability of the switched audio and video transmission server is improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.

Fig. 1 is a schematic view of an application scenario of a weak network-based audio/video processing method system according to an embodiment of the present invention;

fig. 2 is a schematic flowchart of an audio and video processing method based on a weak network according to an embodiment of the present invention;

fig. 3 is a functional module schematic diagram of a weak network-based audio and video processing method system according to an embodiment of the present invention;

fig. 4 is a schematic block diagram of a scheduling server for implementing the weak network-based audio/video processing method according to an embodiment of the present invention.

Detailed Description

In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only examples or embodiments of the present description, and that for a person skilled in the art, the present description can also be applied to other similar scenarios on the basis of these drawings without inventive effort. Unless otherwise apparent from the context, or otherwise indicated, like reference numbers in the figures refer to the same structure or operation.

It should be understood that "system", "unit" and/or "module" as used in this specification is a method for distinguishing different components, elements, parts or assemblies at different levels. However, other words may be substituted by other expressions if they accomplish the same purpose.

As used in this specification and the appended claims, the terms "a," "an," "the," and/or "the" are not intended to be inclusive in the singular, but rather are intended to be inclusive in the plural, unless the context clearly dictates otherwise. In general, the terms "comprises" and "comprising" merely indicate that steps and elements are included which are explicitly identified, that the steps and elements do not form an exclusive list, and that a method or apparatus may include other steps or elements.

Flow charts are used in this description to illustrate operations performed by a system according to embodiments of the present description. It should be understood that the preceding or following operations are not necessarily performed in the exact order in which they are performed. Rather, the various steps may be processed in reverse order or simultaneously. Meanwhile, other operations may be added to the processes, or a certain step or several steps of operations may be removed from the processes.

Fig. 1 is an interaction schematic diagram of a system 10 of an audio and video processing method based on a weak network according to an embodiment of the present invention. The weak network-based audio and video processing method system 10 can comprise a scheduling server 100 and an audio and video transmission server 200 which is in communication connection with the scheduling server 100. The weak network-based audio and video processing method system 10 shown in fig. 1 is only one possible example, and in other possible embodiments, the weak network-based audio and video processing method system 10 may also include only a part of the components shown in fig. 1 or may also include other components.

In this embodiment, the internet of things cloud scheduling server 100 and the audio and video transmission server 200 in the weak network-based audio and video processing method system 10 may execute the weak network-based audio and video processing method described in the following method embodiment in a matching manner, and the specific steps of the scheduling server 100 and the audio and video transmission server 200 may refer to the detailed description of the following method embodiment.

In order to solve the technical problem in the foregoing background art, fig. 2 is a schematic flowchart of a weak network-based audio/video processing method according to an embodiment of the present invention, where the weak network-based audio/video processing method provided in this embodiment may be executed by the scheduling server 100 shown in fig. 1, and the weak network-based audio/video processing method is described in detail below.

And step S110, acquiring at least one audio/video transmission information set from the audio/video transmission information of the audio/video transmission server in the weak network environment.

And step S120, identifying the transmission quality of the audio and video transmission information sets based on each transmission control strategy under the transmission protocol layer to obtain the transmission quality characteristics of each audio and video transmission information set and the corresponding transmission quality label intervals.

And step S130, determining the transmission recording portrait of the transmission protocol layer corresponding to each audio and video transmission node according to the transmission quality characteristics and the corresponding transmission quality label interval.

Step S140, according to the transmission record portrait of the transmission protocol layer corresponding to each audio/video transmission node, determining the transmission channel distribution information corresponding to each transmission protocol layer, generating the thread characteristic information of the audio/video transmission thread corresponding to the audio/video transmission information according to the transmission channel distribution information corresponding to each transmission protocol layer, and switching to the corresponding target audio/video transmission server according to the thread characteristic information of the audio/video transmission thread to execute the audio/video transmission task of the audio/video transmission server.

In this embodiment, each audio/video transmission node in each audio/video transmission information set belongs to the same transmission protocol layer, and each audio/video transmission node corresponds to a transmission control strategy under the belonging transmission protocol layer. For example, the audio and video transmission nodes of which the transmission protocol layers belong to the same transmission protocol layer can be obtained from the audio and video transmission information of the audio and video transmission server in the weak network environment, and the audio and video transmission nodes belonging to each transmission protocol layer are determined as the corresponding audio and video transmission information sets.

Illustratively, the audio/video transmission information may include a plurality of audio/video transmission nodes, each audio/video transmission node may refer to a node set formed by related control portions of the audio/video transmission process, and the node set formed by the related control portions may be used to represent different information having a control process in the actual audio/video transmission process. Similarly, for different audio/video transmission nodes, the types of the corresponding transmission protocol layers are different, so that the transmission protocol layers can correspond to a certain transmission protocol layer one by one, that is, the transmission protocol layers can be used for representing the types of the fields of the transmission protocol layers.

In this embodiment, the transmission quality may include, but is not limited to, an average code rate, an average frame rate, a buffer data throughput, an average TCP sending time per frame, and the like, and the transmission quality characteristic may be used to represent a characteristic binarization sequence corresponding to the transmission quality, and a corresponding transmission quality label interval may be used to represent that the characteristic binarization sequence corresponding to the transmission quality has a characteristic interval with an associated transmission quality label.

In this embodiment, the transmission record representation may be used to represent representation information in units of a time axis of a generated tag attribute update behavior, so that transmission channel distribution information corresponding to each transmission protocol layer may be determined according to the transmission record representation of the corresponding transmission protocol layer corresponding to each audio/video transmission node, and the transmission channel distribution information is used to represent a transmission channel calling condition in the tag attribute update process, so that thread feature information of the audio/video transmission thread corresponding to the audio/video transmission information may be specifically generated according to the transmission channel distribution information corresponding to each transmission protocol layer.

Based on the design, the embodiment extracts the transmission quality characteristics of each audio/video transmission information set in a transmission quality identification mode, and determines the transmission record portrait of the transmission protocol layer corresponding to each audio/video transmission node based on the transmission quality label interval, so that each transmission control strategy is converted into an effective coordination scheduling reference. Therefore, according to the transmission record portrait of the transmission protocol layer corresponding to each audio and video transmission node, the transmission channel distribution information corresponding to each transmission protocol layer is determined, the thread characteristic information of the audio and video transmission thread corresponding to the audio and video transmission information is generated according to the transmission channel distribution information corresponding to each transmission protocol layer, and the corresponding target audio and video transmission server is switched to execute the audio and video transmission task of the audio and video transmission server according to the thread characteristic information of the audio and video transmission thread, so that the coordinated scheduling switching can be effectively combined with the specific type of the transmission protocol layer, and the applicability of the switched audio and video transmission server is improved.

In one possible implementation, step S120 may be implemented by the following exemplary sub-steps, which are described in detail below.

And a substep S121, traversing audio and video transmission nodes in the audio and video transmission information set for each audio and video transmission information set, extracting network plug flow characteristic vectors clustering transmission control strategies under a transmission protocol layer to which the audio and video transmission information set belongs from the audio and video transmission nodes, and determining network plug flow element information corresponding to the audio and video transmission information set according to the extracted network plug flow characteristic vectors.

And a substep S122, removing the set noise characteristic vector contained in each network plug flow characteristic vector in the network plug flow element information, splitting the network plug flow element of the network plug flow characteristic vector from which the set noise characteristic vector is removed to obtain first network plug flow element information, and determining the code rate change degree of each network plug flow element according to the occupied area of the network plug flow element in the network plug flow characteristic vector contained in the first network plug flow element information.

For example, the occupied area of the network plug flow element in the network plug flow feature vector included in the first network plug flow element information may refer to the length of the overlapping segment portion of the network plug flow element in the network plug flow feature vector included in the first network plug flow element information.

And a substep S123 of removing network plug flow elements in the first network plug flow element information, in which the code rate change degree is smaller than a preset code rate change degree threshold, to obtain second network plug flow element information, taking the network plug flow elements in which the code rate change degree is not smaller than the preset code rate change degree threshold as the first network plug flow elements to obtain a first network plug flow element list, and determining, according to matching information of each first network plug flow element in the first network plug flow element list in the second network plug flow element information, a second network plug flow element list corresponding to each first network plug flow element and composed of network plug flow elements connected behind the first network plug flow element.

And a substep S124, determining whether the second network plug flow element list is empty, if the second network plug flow element list is empty, returning in a circulating manner, and if the second network plug flow element list is not empty, counting the code rate change degree of each network plug flow element in the second network plug flow element list, and determining whether the code rate change degree of each network plug flow element meets the requirement of the minimum code rate change degree.

And a substep S125, circularly returning if the code rate change degree of the network plug flow element does not meet the requirement of the minimum code rate change degree, discretizing a first network plug flow element corresponding to the network plug flow element and a second network plug flow element list if the code rate change degree of the network plug flow element meets the requirement of the minimum code rate change degree to obtain a new first network plug flow element, determining a second network plug flow element list of the new first network plug flow element, and performing circular identification on the second network plug flow element list corresponding to the new first network plug flow element to obtain all target first network plug flow elements meeting the requirement of the minimum code rate change degree and the corresponding code rate change degrees.

For example, the data returned in the loop is all target first network stream pushing elements meeting the requirement of the minimum code rate change degree and the corresponding code rate change degrees which are currently obtained, all target first network stream pushing elements meeting the requirement of the minimum code rate change degree and the corresponding code rate change degrees are obtained, the target first network stream pushing elements are used as the transmission quality characteristics of the audio and video transmission information set, and the code rate change degrees of all the target first network stream pushing elements in the second network stream pushing element list are used as the transmission quality label intervals corresponding to the transmission quality characteristics.

In a possible implementation manner, for step S130, in order to accurately and comprehensively determine the transmission quality element having the tag attribute updating behavior, thereby improving the coverage rate and accuracy of information updating, and effectively determining the transmission record portrait of the transmission protocol layer to which each audio/video transmission node corresponds, the following exemplary sub-steps may be implemented. The detailed description is as follows.

And a substep S131, screening the transmission quality characteristics according to the transmission quality characteristics and the corresponding transmission quality label interval to obtain target transmission quality characteristics covering the preset transmission quality label interval.

In the substep S132, a first transmission record network tag set corresponding to the first transmission quality object and a second transmission record network tag set corresponding to the second transmission quality object are obtained on the target transmission quality characteristics.

For example, the first transmission record network tag set includes a plurality of tag attribute update segments in which the first transmission quality object performs tag attribute update on the relevant quality assessment index in the target transmission quality characteristic, the second transmission record network tag set includes a plurality of tag attribute update segments in which the second transmission quality object performs tag attribute update on the relevant quality assessment index in the target transmission quality characteristic, and each tag attribute update segment includes a plurality of tag attribute update segment nodes.

And a substep S133, based on the preset tag attribute update segment category, clustering a plurality of tag attribute update segments in the first transmission record network tag set to obtain a clustered first transmission record network tag set. And the preset label attribute updating fragment category belongs to the types corresponding to the plurality of label attribute updating fragment nodes.

In the substep S134, each label attribute updating segment node corresponding to each preset label attribute updating segment category in the preset label attribute updating segment category list in the clustered first transmission record network label set is combined into a first preset label attribute updating segment list.

In the substep S135, the first predetermined tag attribute updating segment list is deduplicated to obtain a first tag attribute updating segment list, so as to obtain a first tag attribute updating segment list corresponding to the preset tag attribute updating segment category list, and each tag attribute updating segment node in the first tag attribute updating segment list is combined into a first tag attribute updating segment node list corresponding to the first transmission quality object.

For example, the first tag attribute updating segment node list corresponds to a preset tag attribute updating segment category list, and the preset tag attribute updating segment category type is a list composed of all tag attribute updating segment categories used for information updating.

In the substep S136, each label attribute updating segment node corresponding to each preset label attribute updating segment category in the preset label attribute updating segment category list is extracted from the second transmission record network label set, and is combined into a second label attribute updating segment node list corresponding to the second transmission quality object.

For example, the second tag attribute updating segment node list corresponds to a preset tag attribute updating segment category list, and the first tag attribute updating segment node list and the second tag attribute updating segment node list are lists formed by tag attribute updating segment nodes extracted from the corresponding transmission record network tag set.

And a substep S137, determining the portrait collection type of the same tag attribute update fragment node between the first tag attribute update fragment node list and the second tag attribute update fragment node list, obtaining an interval range from a type interval corresponding to the portrait collection type, and determining the first transmission quality object and the second transmission quality object as tag attribute update units when the interval range covers a preset interval range.

In the substep S138, any two transmission quality elements in the target transmission quality characteristic are used as the first transmission quality object and the second transmission quality object to perform information updating, and a tag attribute updating unit list with a tag attribute updating behavior in the target transmission quality characteristic is obtained until the detection between the transmission quality elements in the target transmission quality characteristic is completed.

And a substep S139, using the image collection type of the transmission quality element in the tag attribute updating unit list as a target unit image collection type, using the image collection type of the transmission quality element corresponding to the target transmission quality characteristic as a target global image collection type, calculating a common collection type of the target unit image collection type and the target global image collection type to obtain a common collection type characteristic corresponding to the target transmission quality characteristic, and when the common collection type characteristic meets a preset characteristic condition, determining image information formed by the common collection type characteristic corresponding to the target transmission quality characteristic as a transmission record image of a transmission protocol layer corresponding to each audio/video transmission node.

Based on the steps, when the transmission quality element with the label attribute updating behavior updates the label attribute, the same label attribute updating segment node exists between the corresponding label attribute updating segments; therefore, when information is updated, a transmission record network label set formed by a plurality of label attribute updating segments of transmission quality elements is obtained, whether label attribute updating behaviors exist in the transmission quality elements is determined according to whether common attribute conditions exist between label attribute updating segment node lists corresponding to operation lists among the transmission quality elements, and whether the transmission quality elements are label attribute updating units is further determined.

In a possible implementation manner, further referring to step S140, in the process of determining the transmission channel distribution information corresponding to each transmission protocol layer according to the transmission record portrait of the transmission protocol layer to which each audio/video transmission node corresponds, the following exemplary sub-steps may be implemented, which are described in detail below.

And a substep S141 of obtaining a corresponding transmission channel label and an initial channel pointing characteristic of the transmission channel label from the transmission record portrait of the transmission protocol layer to which each audio/video transmission node belongs.

And a substep S142, predicting the transmission channel label according to the pre-trained artificial intelligence model to obtain the target channel pointing characteristic.

And a substep S143, comparing the initial channel pointing characteristic with the target channel pointing characteristic to obtain pointing comparison information.

For example, the initial channel pointing characteristics may include at least one initial auxiliary channel pointing characteristic and the target channel pointing characteristics include at least one target auxiliary channel pointing characteristic. On the basis, each initial auxiliary channel pointing characteristic and each target auxiliary channel pointing characteristic are subjected to regression analysis respectively to obtain auxiliary regression analysis information, and when the regression analysis of at least one target auxiliary channel pointing characteristic is completed, at least one auxiliary regression analysis information is obtained. The target auxiliary channel pointing characteristics correspond to the auxiliary regression analysis information one by one, and the auxiliary regression analysis information represents whether the initial auxiliary channel pointing characteristics are matched with the target auxiliary channel pointing characteristics.

And then, discretizing at least one auxiliary regression analysis information to obtain regression analysis information corresponding to each initial auxiliary channel pointing characteristic. And the regression analysis information characterizes whether target auxiliary channel pointing characteristics exist in regression analysis with the initial auxiliary channel pointing characteristics, and the regression analysis information corresponds to each initial auxiliary channel pointing characteristic.

Therefore, the initial auxiliary channel pointing characteristics of the target auxiliary channel pointing characteristics with regression analysis in the regression analysis information characterization can be extracted from the at least one initial auxiliary channel pointing characteristics to obtain the regression analysis initial auxiliary channel pointing characteristics, and the target auxiliary channel pointing characteristics subjected to regression analysis with the regression analysis initial auxiliary channel pointing characteristics are extracted from the at least one target auxiliary channel pointing characteristics according to the regression analysis information to serve as the regression analysis target auxiliary channel pointing characteristics.

And then discretizing the initial auxiliary channel pointing characteristics except the regression analysis initial auxiliary channel pointing characteristics in the at least one initial auxiliary channel pointing characteristic to obtain an initial discretization characteristic sequence, discretizing the target auxiliary channel pointing characteristics except the regression analysis target auxiliary channel pointing characteristics in the at least one target auxiliary channel pointing characteristic to obtain a target discretization characteristic sequence, and fusing the initial discretization characteristic sequence and the target discretization characteristic sequence to obtain pointing comparison information.

The initial auxiliary channel pointing characteristics may include initial uplink channel information, initial flow control engine information, and initial associated object information, and the target auxiliary channel pointing characteristics include target uplink channel information, target flow control engine information, and target associated object information.

Illustratively, each initial auxiliary channel pointing characteristic includes initial uplink channel information and initial flow control engine information, and each target auxiliary channel pointing characteristic includes target uplink channel information and target flow control engine information.

Therefore, in the process of performing regression analysis on each initial auxiliary channel pointing characteristic and each target auxiliary channel pointing characteristic respectively to obtain auxiliary regression analysis information, and obtaining at least one auxiliary regression analysis information when the regression analysis of at least one target auxiliary channel pointing characteristic is completed, the initial uplink channel information can be matched with the target uplink channel information of each target auxiliary channel pointing characteristic respectively to obtain the matching reference information corresponding to each target auxiliary channel pointing characteristic.

The matching reference information may represent whether the initial uplink channel information is matched with the target uplink channel information.

And then, determining initial flow control engine buffer area information by using the initial flow control engine information, and determining target flow control engine buffer area information of the pointing characteristic of each target auxiliary channel by using the target flow control engine information of the pointing characteristic of each target auxiliary channel.

Therefore, according to the initial flow control engine buffer area information and each target flow control engine buffer area information, the correlation information corresponding to each target flow control engine buffer area information and the initial flow control engine buffer area information and the discretization processing result corresponding to each target flow control engine buffer area information and the initial flow control engine buffer area information can be obtained, and then at least one piece of attached regression analysis information is obtained by using the correlation information and the discretization processing result.

For example, in the process of obtaining at least one auxiliary regression analysis information by using the correlation information and the discretization processing result, business regression analysis information corresponding to the directional characteristic of each target auxiliary channel can be constructed; and when the matching reference information represents that the initial uplink channel information is the same as the target uplink channel information and the service regression analysis information exceeds a preset matching degree threshold value, generating auxiliary regression analysis information with the initial auxiliary channel pointing characteristics matched with the target auxiliary channel pointing characteristics. For another example, when the matching reference information indicates that the initial uplink channel information is the same as the target uplink channel information and the service regression analysis information is less than or equal to the preset matching degree threshold, generating the auxiliary regression analysis information that the initial auxiliary channel pointing characteristic does not match the target auxiliary channel pointing characteristic.

For another example, when the matching reference information indicates that the initial uplink channel information is different from the target uplink channel information and the service regression analysis information exceeds a preset matching degree threshold, generating the auxiliary regression analysis information that the initial auxiliary channel pointing characteristic is not matched with the target auxiliary channel pointing characteristic.

For another example, when the matching reference information represents that the initial uplink channel information is different from the target uplink channel information and the service regression analysis information is less than or equal to a preset matching degree threshold, generating auxiliary regression analysis information that the initial auxiliary channel pointing characteristic is not matched with the target auxiliary channel pointing characteristic, and when the discretization processing of at least one target auxiliary channel pointing characteristic is completed, obtaining at least one auxiliary regression analysis information. Wherein the at least one secondary regression analysis information is in one-to-one correspondence with at least one target secondary channel pointing characteristic.

And a substep S144, determining the distribution information of the transmission channel corresponding to each transmission protocol layer according to the pointing comparison information.

For example, the target channel distribution map node corresponding to each direction comparison node may be obtained from the direction comparison information, and each target channel distribution map node is used as the transmission channel distribution information corresponding to each transmission protocol layer in a clustered arrangement manner.

In a possible implementation manner, still referring to step S140, in the process of generating the thread feature information of the audio/video transmission thread corresponding to the audio/video transmission information according to the transmission channel distribution information corresponding to each transmission protocol layer, the following exemplary sub-steps may be implemented, which are described in detail below.

And a substep S145, obtaining transmission channel calling information and transmission channel mapping thread information and historical channel mapping thread information associated with the transmission channel calling information from the map node mapped by the transmission channel distribution information corresponding to each transport protocol layer, wherein the historical channel mapping thread information includes at least one channel mapping thread information of a historical transmission process.

And a substep S146, inputting the transmission channel mapping thread information and the historical channel mapping thread information into a machine learning model, performing thread feature extraction on the transmission channel mapping thread information through the machine learning model to obtain a first thread feature segment, and performing thread feature extraction on each historical channel mapping thread information to obtain a second thread feature segment.

And a substep S147, fusing the segment parts in the first thread feature segment to obtain a first thread transmission behavior vector for representing the thread transmission behavior of the transmission channel mapping thread information, and fusing the segment parts in the second thread feature segment to obtain a second thread transmission behavior vector for representing the thread transmission behavior of the history channel mapping thread information.

And a substep S148 of calculating a similarity between the first thread transmission behavior vector and each second thread transmission behavior vector, and using the calculated similarity as a similarity between the transmission channel mapping thread information and the historical channel mapping thread information.

And a substep S149 of determining the calculated similarity as a correlation corresponding to the transmission channel mapping thread information strongly correlated with the historical channel mapping thread information. The degree of association is used to measure the degree to which the transmission channel mapping thread information depends on the historical channel mapping thread information.

And a substep S1491, calculating calling process information of the transmission channel calling information by the transmission channel mapping thread information based on the first thread feature segment and the third thread feature segment of the transmission channel calling information, and operating the calling process information and the association degree to obtain calling process configuration information of the transmission channel calling information aiming at the transmission channel mapping thread information and a thread feature region of historical channel mapping thread information in the transmission channel calling information.

And a substep S1492, determining the thread characteristic information corresponding to the thread characteristic region in the calling process configuration information according to the calling process configuration information and the thread characteristic region corresponding to the strong association condition, and generating the thread characteristic information of the audio/video transmission thread corresponding to the audio/video transmission information according to the extracted thread characteristic information.

Therefore, the depth identification of the thread characteristic information calling process is further carried out through the identification mode with strong correlation, so that the thread characteristic information corresponding to the thread characteristic area is determined in the calling process configuration information, the thread characteristic information of the audio and video transmission thread corresponding to the audio and video transmission information is generated according to the extracted thread characteristic information, and the applicability of the switched audio and video transmission server can be effectively improved.

Fig. 3 is a schematic diagram of functional modules of an audio and video processing system 300 based on a weak network according to an embodiment of the present invention, and this embodiment may divide the functional modules of the audio and video processing system 300 based on a weak network according to a method embodiment executed by the dispatch server 100, that is, the following functional modules corresponding to the audio and video processing system 300 based on a weak network may be used to execute each method embodiment executed by the dispatch server 100. The weak network-based audio/video processing system 300 may include an obtaining module 310, an identifying module 320, a determining module 330, and a switching module 340, and the functions of the functional modules of the weak network-based audio/video processing system 300 are described in detail below.

The obtaining module 310 is configured to obtain at least one audio/video transmission information set from audio/video transmission information of an audio/video transmission server in a weak network environment, where each audio/video transmission node in each audio/video transmission information set belongs to the same transmission protocol layer, and each audio/video transmission node corresponds to a transmission control policy in the transmission protocol layer to which it belongs. The obtaining module 310 may be configured to perform the step S110, and the detailed implementation of the obtaining module 310 may refer to the detailed description of the step S110.

The identification module 320 is configured to identify transmission quality of the audio/video transmission information sets based on each transmission control policy under the transmission protocol layer to which the transmission control policy belongs, and obtain transmission quality characteristics of each audio/video transmission information set and a corresponding transmission quality tag interval. The identification module 320 may be configured to perform the step S120, and the detailed implementation of the identification module 320 may refer to the detailed description of the step S120.

And the determining module 330 is configured to determine, according to the transmission quality characteristic and the corresponding transmission quality tag interval, a transmission record portrait of the transmission protocol layer to which each audio/video transmission node belongs. The determining module 330 may be configured to perform the step S130, and the detailed implementation of the determining module 330 may refer to the detailed description of the step S130.

The switching module 340 is configured to determine transmission channel distribution information corresponding to each transmission protocol layer according to the transmission record portrait of the transmission protocol layer to which each audio/video transmission node corresponds, generate thread feature information of an audio/video transmission thread corresponding to the audio/video transmission information according to the transmission channel distribution information corresponding to each transmission protocol layer, and switch to a corresponding target audio/video transmission server according to the thread feature information of the audio/video transmission thread to execute an audio/video transmission task of the audio/video transmission server. The switching module 340 may be configured to perform the step S140, and the detailed implementation of the switching module 340 may refer to the detailed description of the step S140.

It should be noted that the division of the modules of the above system is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity, or may be physically separated. And these modules can be realized in the form of software called by processing element; or may be implemented entirely in hardware; and part of the modules can be realized in the form of calling software by the processing element, and part of the modules can be realized in the form of hardware. For example, the obtaining module 310 may be a separate processing element, or may be integrated into a chip of the system, or may be stored in a memory of the system in the form of program code, and a processing element of the system calls and executes the functions of the obtaining module 310. Other modules are implemented similarly. In addition, all or part of the modules can be integrated together or can be independently realized. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.

For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), or one or more microprocessors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs), among others. For another example, when some of the above modules are implemented in the form of a processing element scheduler code, the processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor that can call program code. As another example, these modules may be integrated together, implemented in the form of a system-on-a-chip (SOC).

Fig. 4 is a schematic diagram illustrating a hardware structure of the dispatch server 100 for implementing the weak network-based audio/video processing method according to an embodiment of the present invention, and as shown in fig. 4, the dispatch server 100 may include a processor 110, a machine-readable storage medium 120, a bus 130, and a transceiver 140.

In a specific implementation process, at least one processor 110 executes computer-executable instructions stored in the machine-readable storage medium 120 (for example, the obtaining module 310, the identifying module 320, the determining module 330, and the switching module 340 included in the weak-network-based audio/video processing system 300 shown in fig. 3), so that the processor 110 may execute the weak-network-based audio/video processing method according to the above method embodiment, where the processor 110, the machine-readable storage medium 120, and the transceiver 140 are connected through the bus 130, and the processor 110 may be configured to control a transceiving action of the transceiver 140, so as to perform data transceiving with the aforementioned audio/video transmission server 200.

For a specific implementation process of the processor 110, reference may be made to the above-mentioned various method embodiments executed by the dispatch server 100, which implement principles and technical effects are similar, and this embodiment is not described herein again.

In the embodiment shown in fig. 4, it should be understood that the Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor, or in a combination of the hardware and software modules within the processor.

The machine-readable storage medium 120 may comprise high-speed RAM memory and may also include non-volatile storage NVM, such as at least one disk memory.

The bus 130 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus 130 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, the buses in the figures of the present invention are not limited to only one bus or one type of bus.

In addition, an embodiment of the present invention further provides a readable storage medium, where a computer executing instruction is stored in the readable storage medium, and when a processor executes the computer executing instruction, the weak network-based audio and video processing method is implemented.

Having thus described the basic concept, it will be apparent to those skilled in the art that the foregoing detailed disclosure is to be regarded as illustrative only and not as limiting the present specification. Various modifications, improvements and adaptations to the present description may occur to those skilled in the art, although not explicitly described herein. Such modifications, improvements and adaptations are proposed in the present specification and thus fall within the spirit and scope of the exemplary embodiments of the present specification.

Also, the description uses specific words to describe embodiments of the description. Such as "one possible implementation," "one possible example," and/or "exemplary" means that a particular feature, structure, or characteristic described in connection with at least one embodiment of the specification is included. Therefore, it is emphasized and should be appreciated that two or more references to "one possible implementation," "one possible example," and/or "exemplary" in various places throughout this specification are not necessarily referring to the same embodiment. Furthermore, some features, structures, or characteristics of one or more embodiments of the specification may be combined as appropriate.

Moreover, those skilled in the art will appreciate that aspects of the present description may be illustrated and described in terms of several patentable species or situations, including any new and useful combination of processes, machines, manufacture, or materials, or any new and useful improvement thereof. Accordingly, aspects of this description may be performed entirely by hardware, entirely by software (including firmware, resident software, micro-code, etc.), or by a combination of hardware and software. The above hardware or software may be referred to as "data block," module, "" engine, "" unit, "" component, "or" system. Furthermore, aspects of the present description may be represented as a computer product, including a computer-readable program product, in one or more computer-readable media.

The computer storage medium may comprise a propagated data signal with the computer program embodied therein, for example, on a baseband or as part of a carrier wave. The propagated signal may take any of a variety of forms, including electromagnetic, optical, etc., or any suitable combination. A computer storage medium may be any computer-readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, or device. Program modules located on computer storage media may be propagated over any suitable media, including radio, cable, fiber optic cable, RF, or the like, or any combination of the preceding.

Computer program adaptations required for operation of various portions of this specification may be written in any one or more programming languages, including an object oriented programming language such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C + +, C #, VB.NET, Python, and the like, a conventional programming language such as C, Visual Basic, Fortran 2003, Perl, COBOL 2002, PHP, ABAP, a dynamic programming language such as Python, Ruby, and Groovy, or other programming languages, and the like. The program match may run entirely on the user's computer, or as a stand-alone software package on the user's computer, or partly on the user's computer and partly on a remote computer or entirely on the remote computer or medical services platform. In the latter scenario, the remote computer may be connected to the user's computer through any network format, such as a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet), or in a cloud computing environment, or as a service, such as a software as a service (SaaS).

Additionally, the order in which the elements and lists are processed, the use of alphanumeric characters, or other designations in this specification is not intended to limit the order in which the processes and methods of this specification are performed, unless otherwise specified in the claims. While various presently contemplated embodiments of the invention have been discussed in the foregoing disclosure by way of example, it is to be understood that such detail is solely for that purpose and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover all modifications and equivalent arrangements that are within the spirit and scope of the embodiments herein. For example, although the system components described above may be implemented by hardware devices, they may also be implemented by software-only solutions, such as installing the described system on an existing healthcare platform or mobile device.

Similarly, it should be noted that in the preceding description of embodiments of the present specification, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of one or more of the embodiments. This method of disclosure, however, is not intended to imply that more features than are expressly recited in a claim. Indeed, the embodiments may be characterized as having less than all of the features of a single embodiment disclosed above.

It is to be understood that the descriptions, definitions and/or uses of terms in the accompanying materials of this specification shall control if they are inconsistent or contrary to the descriptions and/or uses of terms in this specification.

Finally, it should be understood that the embodiments described herein are merely illustrative of the principles of the embodiments of the present disclosure. Other variations are also possible within the scope of the present description. Thus, by way of example, and not limitation, alternative configurations of the embodiments of the specification can be considered consistent with the teachings of the specification. Accordingly, the embodiments of the present description are not limited to only those embodiments explicitly described and depicted herein.

Claims

1. A weak network-based audio and video processing method is applied to a scheduling server, wherein the scheduling server is in communication connection with a plurality of audio and video transmission servers, and the method comprises the following steps:

2. The weak network-based audio/video processing method according to claim 1, wherein the step of obtaining at least one audio/video transmission information set from the audio/video transmission information of the audio/video transmission server in the weak network environment includes:

3. The weak network-based audio/video processing method according to claim 1, wherein the step of identifying the transmission quality of the audio/video transmission information sets based on the transmission control strategies under the transmission protocol layer to obtain the transmission quality characteristics of the audio/video transmission information sets and the corresponding transmission quality tag intervals comprises:

4. The weak network-based audio/video processing method according to claim 1, wherein the step of determining the transmission record portrayal of the transmission protocol layer to which each of the audio/video transmission nodes corresponds according to the transmission quality characteristics and the corresponding transmission quality label intervals comprises:

5. The weak network-based audio/video processing method according to any one of claims 1 to 4, wherein the step of determining the distribution information of the transmission channel corresponding to each transmission protocol layer according to the transmission record portrait of the transmission protocol layer to which each audio/video transmission node belongs includes:

6. The weak network based audio-video processing method according to claim 5, wherein the initial channel pointing characteristics include at least one initial auxiliary channel pointing characteristic, and the target channel pointing characteristics include at least one target auxiliary channel pointing characteristic;

7. The weak network-based audio and video processing method according to claim 6, wherein each of the initial auxiliary channel pointing characteristics includes initial uplink channel information and initial flow control engine information, and each of the target auxiliary channel pointing characteristics includes target uplink channel information and target flow control engine information;

8. The weak network-based audio/video processing method according to claim 5, wherein the step of determining the transmission channel distribution information corresponding to each of the transmission protocol layers according to the direction comparison information includes:

and acquiring a target channel distribution map node corresponding to each direction comparison node from the direction comparison information, and taking each target channel distribution map node as transmission channel distribution information corresponding to each transmission protocol layer in a clustered arrangement mode.

9. The weak network-based audio and video processing method according to any one of claims 1 to 8, wherein the step of generating the thread feature information of the audio and video transmission thread corresponding to the audio and video transmission information according to the transmission channel distribution information corresponding to each transmission protocol layer, and switching to a corresponding target audio and video transmission server according to the thread feature information of the audio and video transmission thread to execute the audio and video transmission task of the audio and video transmission server includes:

determining thread characteristic information corresponding to the thread characteristic region in the calling process configuration information according to the calling process configuration information and the thread characteristic region corresponding to the strong association condition of the association degree, and generating the thread characteristic information of the audio and video transmission thread corresponding to the audio and video transmission information according to the extracted thread characteristic information;

and switching to a corresponding target audio and video transmission server according to the thread characteristic information of the audio and video transmission thread to execute the audio and video transmission task of the audio and video transmission server.

10. A weak network-based audio and video processing method system is characterized in that the system is applied to a scheduling server, the scheduling server is in communication connection with a plurality of audio and video transmission servers, and the system comprises: