WO2017020661A1

WO2017020661A1 - Code stream sending method and device

Info

Publication number: WO2017020661A1
Application number: PCT/CN2016/086381
Authority: WO
Inventors: 刘艳
Original assignee: 华为技术有限公司
Priority date: 2015-07-31
Filing date: 2016-06-20
Publication date: 2017-02-09
Also published as: CN106412620A

Abstract

Disclosed are a code stream sending method and device which are used for solving the technical problem that many code streams are lost when a terminal receives code streams sent by an opposite end. The method comprises: a media gateway receiving attribute information about code streams sent by a media receiving end, and determining first code stream conversion information according to the attribute information about the code streams; the media gateway modifying, according to information about the mode in which conversion is performed by layers, attribute information about code streams sent by a media sending end into the attribute information sent by the media receiving end, and sending the modified attribute information to the media sending end; the media gateway receiving code streams in a first format, which are sent by the media sending end, and converting the code streams in the first format into code streams in a second format; and the media gateway sending the code streams in the second format to the media receiving end.

Description

Code stream sending method and device

The present application claims priority to Chinese Patent Application No. 201510466493.2, the entire disclosure of which is hereby incorporated by reference. in.

Technical field

The present invention relates to the field of communications technologies, and in particular, to a code stream sending method and device.

Background technique

Based on H.264 (a digital video compression format) / AVC (Advanced Video Coding), SVC (Scalable Video Coding) technology, namely H.264/SVC, SVC technology Utilizing the various efficient algorithm tools of the AVC codec, the time (frame rate) and spatial (resolution) of the video generated by the code can be expanded, and different frame rates, resolutions or quality levels can be generated. Decoding the video, the effect is better.

The code stream generated by the SVC encoding of the original video sequence has a base layer and a plurality of enhancement layers. The basic layer includes the most basic video reconstruction information, and the low-quality video sequence can be recovered when the basic layer is received, and the enhancement layer includes the detailed information of the reconstructed video. As the data of the received enhancement layer increases, Combined with the basic layer, the video sequence of higher quality is gradually recovered, thereby showing the scalable characteristics of the video.

However, in the prior art, the H.264/SVC terminal and the H.264/AVC terminal are only limited to the interworking of the base layer, that is, regardless of the resolution, frame rate, or code rate that the AVC terminal itself can support. If the value is high, only the code stream of the basic layer sent by the SVC terminal can be received, and more code streams are lost, resulting in poor quality of the reconstructed video.

Summary of the invention

The embodiment of the invention provides a code stream sending method and device, which are used to solve the technical problem that the terminal loses more code streams when receiving the code stream sent by the peer end.

In a first aspect, a code stream sending method is provided, including:

The media gateway receives the attribute information of the code stream sent by the media receiving end, and determines the first code stream conversion information according to the attribute information of the code stream; the first code stream conversion information includes a conversion type information and a layer-by-layer conversion mode. Information, the conversion type information including information of a code stream converted into a single layer encoding format by a code stream of a multi-layer encoding format;

The media gateway modifies the attribute information of the code stream sent by the media sending end to the attribute information sent by the media receiving end according to the information of the layer-by-layer mode, and sends the modified attribute information to the media sending end. ;

The media gateway receives the code stream of the first format sent by the media sending end, and converts the code stream of the first format into a code stream of the second format; the code stream of the first format is the media The sending end is sent according to the modified attribute information, where the first format is a multi-layer encoding format, and the second format is a single-layer encoding format;

The media gateway sends the code stream of the second format to the media receiving end.

With reference to the first aspect, in a first possible implementation manner of the first aspect, the information that is converted into the code stream of the single layer coding format by the code stream of the multi-layer coding format includes: information converted from the SVC format to the AVC format, At least one of information converted from the SHVC format to the AVC format and information converted from the SHVC format to the HEVC format.

With reference to the first aspect, or the first possible implementation manner of the first aspect, in the second possible implementation manner of the first aspect, the information of the layer-by-layer conversion mode includes information converted according to a preset level;

The media gateway receives the code stream in the first format sent by the media sending end, and includes:

The media gateway receives the code stream of the preset level sent by the media sending end, and the format of the code stream of the preset level is the first format.

In conjunction with the second possible implementation of the first aspect, in a third possible implementation of the first aspect, converting the code stream of the first format to the code stream of the second format includes:

Converting the code stream of the preset level into a code stream of the second format.

With reference to the second possible implementation manner of the first aspect, in a fourth possible implementation manner of the first aspect, the first code stream conversion information further includes conversion level information, which is: extracting data related to a frame rate Package information

Converting the code stream of the first format into a code stream of the second format, including:

Extracting, according to the conversion level information, a data packet related to a frame rate from a code stream of the preset level;

The extracted frame rate related data packet is converted into the code stream of the second format.

With reference to the second possible implementation manner of the first aspect, in a fifth possible implementation manner of the first aspect, the first code stream conversion information further includes conversion level information, that is: extracting data related to resolution Package information

Extracting, according to the conversion level information, a resolution-related data packet from the code stream of the preset level;

The extracted resolution-related data packet is converted into the code stream of the second format.

With reference to the first aspect or the first possible implementation manner of the first aspect to the fifth possible implementation manner, in a sixth possible implementation manner of the first aspect, The attribute information of the code stream determines the first stream conversion information, including:

Determining, according to the attribute information of the code stream and the conversion capability information, the first code stream conversion information;

The attribute information of the code stream is used to indicate attribute information of a code stream supported by the media receiving end; or

The attribute information of the code stream is used to indicate the first code stream conversion information;

The conversion capability information includes the conversion type information and the information of the layer-by-layer conversion mode, wherein the information of the layer-by-layer conversion mode includes information converted according to a preset level.

In conjunction with the sixth possible implementation of the first aspect, in a seventh possible implementation of the first aspect, the conversion capability information further includes conversion level information, where:

The conversion level information includes: extracting information of a data packet related to a frame rate, or extracting information of a data packet related to the resolution.

In a second aspect, a media gateway is provided, including:

a determining module, configured to receive attribute information of a code stream sent by the media receiving end, and determine first code stream conversion information according to the attribute information of the code stream; the first code stream conversion information includes conversion type information and layer by layer Information of the converted mode, the conversion type information including information of a code stream converted into a single layer encoding format by a code stream of a multi-layer encoding format;

a change module, configured to modify attribute information of the code stream sent by the media sending end to the attribute information sent by the media receiving end according to the information of the layer-by-layer conversion mode, and send the modified attribute information to the media to send end;

a conversion module, configured to receive a code stream in a first format sent by the media sending end, and convert the code stream in the first format into a code stream in a second format; The media sending end is sent according to the modified attribute information, where the first format is a multi-layer encoding format, and the second format is a single-layer encoding format;

And a sending module, configured to send the code stream in the second format to the media receiving end.

In a third aspect, a media receiving end is provided, including:

a sending module, configured to send attribute information of the code stream to the media gateway, where the attribute information of the code stream is used to determine the first code stream conversion information; the first code stream conversion information includes conversion type information and layer-by-layer conversion Mode information, the conversion type information including information of a code stream converted into a single layer encoding format by a code stream of a multi-layer encoding format;

a receiving module, configured to receive a code stream of a second format sent by the media gateway, where the code stream of the second format is a code stream of the first format received by the media gateway according to the first code stream conversion information Converted to get.

In the embodiment of the present invention, the code stream conversion information (that is, the first code stream conversion information) is provided, and after determining the first code stream conversion information, the media gateway may modify the layer-by-layer conversion mode information in the first code stream conversion information. The attribute information of the code stream sent by the media sending end, and notifying the media sending end of the modified attribute information, so that the media sending end sends the code stream of the first format to the media gateway according to the attribute information of the modified code stream, and the media sending The code stream sent by the terminal is the code stream requested by the media gateway, and meets the requirements of the media receiving end. The media gateway can directly convert the code stream of the first format into the code stream of the second format, and the code stream of the second format is the media receiving. The terminal supports, so the media receiving end can receive the code stream in the second format.

In this way, the media receiving end specifically receives the parts of the code stream, and can notify the media gateway by using the attribute information of the code stream, can receive as many code streams as possible, try to avoid the loss of the code stream, and increase the information receiving capability and information of the media receiving end. The amount of reception, in addition, because the received code stream is more, that is, the received video information is more, the video quality reconstructed according to the received code stream is better.

DRAWINGS

1 is a flowchart of a method for transmitting a code stream according to an embodiment of the present invention;

2 is a flowchart of a method for receiving a code stream according to an embodiment of the present invention;

3 is an interaction diagram of a first example of a code stream conversion method according to an embodiment of the present invention;

4 is an interaction diagram of a second example of a code stream conversion method according to an embodiment of the present invention;

FIG. 5 is an interaction diagram of a third example of a code stream conversion method according to an embodiment of the present invention; FIG.

6 is a structural block diagram of a media gateway according to an embodiment of the present invention;

FIG. 7 is a structural block diagram of a media receiving end according to an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of a media gateway according to an embodiment of the present invention;

FIG. 9 is a schematic structural diagram of a media receiving end according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

First, some concepts used in the embodiments of the present invention will be described.

1. Media Gateway (MGW) is a functional unit for connecting different types of networks. In related standards (such as H.248 (a media gateway control protocol), MGCP (Media Gateway Control Protocol), etc.), a media gateway is defined to convert a media format in one network into another A device in the media format required by the network. The media gateway uses various media (such as voice, data, fax, video, etc.) in a circuit-switched network (such as PSTN (Public Switched Telephone Network)) and a packet network (such as IP (Internet Protocol) network). Transfer between, it provides a bidirectional interface for communication between related entities of different networks. For example, the media gateway can convert between the bearer channel of the circuit switched network and the media stream of the packet network, and can process audio, video or T.120 (a protocol for multipoint data conference and real-time communication), and also has the processing The ability to combine any combination of the three, and the ability to perform full-duplex media translation. The media gateway can be divided into a trunking gateway, an access gateway, and a multimedia service access gateway according to the location of the media gateway in the network and the processed media stream. Wireless Access Gateway, etc.

2. Conference Center, which can communicate with multiple terminals in media. When media communication with the terminal, it can be transited through the media gateway. For example, the conference center may include an AS (Application Server) and an MRF (Multimedia Resource Function). The AS and the MRF may be located in the same physical entity or may be located in different physical entities. The AS can be used by the MediaX3600 (the core component in the converged conference system). The MRF can include a Multimedia Resource Function Controller (MRFC) and a Multimedia Resource Function Processor (MRFP).

3. A terminal, which is a device that provides voice and/or data connectivity to a user, for example, may include a handheld device with wireless connectivity, or a processing device connected to a wireless modem. The terminal can communicate with the core network via the RAN to exchange voice and/or data with the RAN. The terminal may be a UE (User Equipment), a wireless terminal, a mobile terminal, a Subscriber Unit, a Subscriber Station, a Mobile Station, a Mobile Station, a Remote Station (Remote). Station), AP (Access Point, access point), far Remote Terminal, Access Terminal, User Terminal, User Agent, User Device, etc. For example, it can be a mobile phone (or "cellular" phone), a computer with a mobile terminal, a portable, pocket, handheld, computer built-in or in-vehicle mobile device. For example, PCS (Personal Communication Service) telephone, cordless telephone, SIP (Session Initiation Protocol) telephone, WLL (Wireless Local Loop) station, PDA (Personal Digital Assistant), etc. .

The media sender can be a conference center or can be any terminal. Similarly, the media receiving end can be a conference center, or can be any terminal.

In the embodiment of the present invention, the conversion capability information is provided, and the code stream conversion information may be determined according to the conversion capability information, thereby performing code stream conversion. The conversion capability information may include conversion type information and conversion mode information, and optionally, conversion level information. The following are introduced separately.

First, the conversion type information.

Optionally, H.264/SVC is based on H.264/AVC, and H.265/SHVC (Scalable High Video Coding) is H.264/AVC and H.265/ respectively. HEVC (High Efficiency Video Coding) is a basic layer. Therefore, the conversion type information may include information of a code stream converted into a single layer coding format by a code stream of a multi-layer coding format, and may also include a single layer coding format. The code stream is converted into information of a code stream of a multi-layered encoded format, and may also include information that is not converted.

For example, the information of the code stream converted into the single layer encoding format by the code stream of the multi-layer encoding format may include: information converted from the SVC format to the AVC format, information converted from the SHVC format to the AVC format, and converted from the SHVC format to At least one of the information in the HEVC format; the information of the code stream converted from the code stream of the single layer encoding format to the code stream of the multi-layer encoding format may include: information converted from the AVC format to the SVC format, converted from the AVC format to the SHVC format. At least one of information, and information converted from the HEVC format to the SHVC format; information that is not converted may be expressed, for example, as NONE. In addition, it is naturally known to those skilled in the art that SHVC is also applicable to the present invention if it has a next generation layered coding format.

Second, the conversion mode information.

In the embodiment of the present invention, based on the feature of the SVC layering, the conversion mode information may include information of a layer-by-layer conversion mode, that is, layer-by-layer conversion according to a hierarchical relationship.

In the embodiment of the present invention, the information of the layer-by-layer conversion mode may include information converted according to a preset level, that is, the specified preset level may be converted. In the embodiment of the present invention, the information converted according to the preset level may have different representation manners.

1. For example, a possible information to be converted according to a preset level may be a level specified, which means that the layer and the layers below the layer are converted. At this time, the specified layer and the layer below the specified layer can be regarded as the preset level. For example, the information converted according to the preset level may include "highest strategy", "average strategy", and "minimum strategy", indicating conversion according to the highest enhancement layer, conversion according to the average enhancement layer, and conversion according to the lowest enhancement layer, respectively. If the conversion is performed according to the highest enhancement layer, it indicates that the media sender is to be notified, all layers of the code stream are sent, and the code stream sent by the media sender is sent. Converting; if the average enhancement layer is converted, it means that the media sender is to be notified, only each layer starting from the average enhancement layer (including the average enhancement layer) is sent, and other enhancement layers above the average enhancement layer need not be sent, and Transmitting the code stream sent by the media sender; if converting according to the lowest enhancement layer, it indicates that the media sender is to be notified, only each layer from the lowest enhancement layer (including the lowest enhancement layer), above the lowest enhancement layer The other enhancement layers do not need to be sent, and the code stream sent by the media sender is converted.

For example, the code stream to be sent by the media sending end includes a basic layer (or may also be referred to as a base layer) and multiple enhancement layers, and the enhancement layer with the serial number in the middle may refer to an average enhancement layer, for example, the media sending end is to be sent. The code stream comprises a total of 8 layers, including a basic layer and 7 enhancement layers, the serial numbers are 0-8, 0 is the base layer, and the others are enhancement layers, and the average enhancement layer can refer to the fourth enhancement layer in the middle. , that is, the enhancement layer numbered 4. For example, if the code stream to be sent by the media sending end includes one base layer and multiple enhancement layers, the enhancement layer closest to the base layer can be regarded as the lowest enhancement layer. For example, the layer corresponding to the sequence number 0 is the base layer, and then the layer can be considered as The layer corresponding to the serial number 1 is the lowest enhancement layer. Of course, here is just an example, the average enhancement layer may also refer to other enhancement layers, and the lowest enhancement layer may also refer to other enhancement layers.

2. For example, another possible information that is converted according to a preset level may be one or more levels, which means that each layer specified is converted. At this point, the specified layer can be considered as a preset level. Among them, when you specify a level, the level it depends on needs to be within the specified range.

For example, the code stream to be sent by the media sending end includes a total of 8 layers, including a basic layer and 7 enhancement layers, the serial numbers are 0-8, 0 is the base layer, and the others are enhancement layers. The policy according to the preset level conversion may be, for example, a policy according to the base layer conversion (that is, the specified level is layer 0), or may be, for example, a policy according to the base layer and the first enhancement layer (ie, the specified level is 0. a layer and a first layer, wherein the first layer is dependent on the 0th layer), or may be, for example, a base layer, a first enhancement layer, a second enhancement layer, a third enhancement layer, and a fourth enhancement layer (ie, a specified hierarchy) It is the 0th layer, the 1st layer, the 2nd layer, the 3rd layer and the 4th layer, wherein the first layer has a dependency on the 0th layer, that is, it depends on the 0th layer, and the 2nd layer has a dependency on the 1st layer. The third layer has a dependence on the second layer, and the fourth layer has a dependency on the third layer. In general, the fourth layer has dependence on the 0th layer, the 1st layer, the 2nd layer, and the 3rd layer. Relationship, therefore, for example, to specify the 4th layer as the preset level, you need to specify the 0th layer, the 1st layer, the 2nd layer, and the 3rd layer as the preset level, for example, to specify the 3rd layer as the preset. Level, you need to specify layer 0, layer 1 and layer 2 as the default level, etc.), and so on.

Since the base layer contains the most basic video reconstruction information, the base layer should be included in the preset hierarchy regardless of the manner in which the layer-switched mode information is indicated.

Third, the conversion level information.

In another embodiment of the present invention, the conversion capability information may further include conversion level information.

The conversion level information may include: extracting information of the data packet related to the frame rate, or extracting information of the data packet related to the resolution, respectively, indicating that the packet is extracted according to the air domain and the packet is extracted according to the time domain. For example, if the conversion level information includes extracting information about a data packet related to a frame rate, it indicates that a data packet related to a frame rate is extracted from a code stream of a preset level sent by the media sending end; if the conversion level information includes extraction The information about the resolution-related data packet indicates that the resolution-related data packet is extracted from the preset-level code stream sent by the media sender for conversion.

For example, the preset stream of the code stream sent by the media sender includes a total of 4 layers, including 1 base layer and 3 enhancement layers. If the conversion level information includes extracting data packets related to the frame rate, the layer 4 can be extracted from the layer. A frame rate related packet is extracted from the code stream, and the extracted data packet is converted.

Additionally, the terms "system" and "network" are used interchangeably herein. The term "and/or" in this context is merely an association describing the associated object, indicating that there may be three relationships, for example, A and / or B, which may indicate that A exists separately, and both A and B exist, respectively. B these three situations. In addition, the character "/" in this article, unless otherwise specified, generally indicates that the contextual object is an "or" relationship.

The embodiments of the present invention are further described in detail below with reference to the accompanying drawings.

Referring to FIG. 1, an embodiment of the present invention provides a code stream sending method, and a flow of the method is described as follows.

Step 101: The media gateway receives the attribute information of the code stream sent by the media receiving end, and determines the first code stream conversion information according to the attribute information of the code stream. The first code stream conversion information includes the conversion type information and the layer-by-layer conversion. The information of the mode, the conversion type information includes information of a code stream converted into a single layer coding format by a code stream of a multi-layer coding format.

Step 102: The media gateway modifies the attribute information of the code stream sent by the media sending end to the attribute information sent by the media receiving end according to the information of the layer-by-layer conversion mode, and sends the modified attribute information to the media sending end.

Step 103: The media gateway receives the code stream of the first format sent by the media sending end, and converts the code stream of the first format into the code stream of the second format. The code stream of the first format is the media sending end according to the modified The attribute information is sent, the first format is a multi-layer encoding format, and the second format is a single layer encoding format.

Step 104: The media gateway sends the code stream in the second format to the media receiving end.

Optionally, in another embodiment of the present invention, the media gateway may determine the first code stream conversion information according to the attribute information of the code stream and the conversion capability information. The determination method is as follows:

Determining the first stream conversion information according to the attribute information of the code stream, including:

Determining the first code stream conversion information according to the attribute information of the code stream and the conversion capability information;

The attribute information of the code stream is used to indicate the attribute information of the code stream supported by the media receiving end; or the attribute information of the code stream is used to indicate the first code stream conversion information.

The above determination methods cover the following situations:

1. The media receiving end may store the conversion capability information (for example, the media receiving end may be a conference center), or the media gateway may send the conversion capability information to the media receiving end, and the media receiving end may according to its own capabilities, or may The first stream conversion information is determined from the conversion capability information by information such as the capability and the current network status.

For example, if the media receiving end is a conference center, the media receiving end has certain intelligence. The media gateway can send the conversion capability information to the conference center. The conference center can select the code stream conversion information suitable for itself according to its own capabilities, or according to its own capabilities and current network status information, for example, This is referred to as first stream conversion information, and the first stream conversion information is transmitted to the media gateway. In this way, the media gateway can determine to use the first code stream conversion information for code stream conversion.

In this case, because the conference center has certain intelligence, it can be used as a media receiver. Capabilities, or, may select code stream conversion information (ie, first code stream conversion information) according to information such as its own capabilities and current network status, such that the selected first stream conversion information can more fully reflect the requirements of the media receiving end. Therefore, the code stream conversion process can be completed as much as possible according to the requirements of the media receiving end, and the success rate of the code stream receiving at the receiving end of the medium is improved.

2. The media gateway stores the conversion capability information, and the media gateway may determine the first code stream conversion information from the conversion capability information according to the capability of the media receiving end, or according to the capability of the media receiving end and the current network state.

For example, the media receiving end is an ordinary terminal, and it can be considered that the ordinary terminal does not have good intelligence. The media gateway may determine the first code stream conversion information suitable for the media receiving end according to the capability of the media receiving end, or according to the capability of the media receiving end and the current network status, without determining by the media receiving end.

In this case, since some ordinary terminals are not considered to have good intelligence, they may not have the ability to select the code stream conversion information. Therefore, the media gateway may be based on its own capabilities fed back by the terminals, or may be based on The information that is forwarded by these terminals and the current network status and other information, selects the code stream conversion information suitable for these terminals from the stored conversion capability information, and has lower requirements on the intelligence of the terminal, and the scope of application is wider. And the media gateway may also select the code stream conversion information suitable for the media receiving end according to the attribute information of the code stream fed back by the media receiving end, so that the selected first code stream conversion information may reflect the requirement of the media receiving end as much as possible, thereby enabling the code stream conversion. The process can be completed as much as possible according to the requirements of the media receiving end, and the success rate of the code stream receiving at the receiving end of the media is improved.

Certainly, the media gateway determines the first code stream conversion information. In addition to the above enumerated manners, there may be other determination manners, which are not limited by the present invention.

After determining the first code stream conversion information, the media gateway establishes a transmission channel with the media receiving end, and the media gateway performs a code stream conversion function, and sends the converted code stream to the media receiving end.

As described above, whether the media gateway or the media receiving end selects the code stream conversion information, the capability of the media receiving end can be used as a reference condition, or the capability of the media receiving end and the current network state can be used as reference conditions.

In another embodiment of the present invention, the network status may be represented by a network resource (NR), and the network resource recommendation may be evaluated from two dimensions: a traffic occupation situation and a packet loss rate, and of course, other possible indicators may also be adopted. The evaluation is carried out, and the invention is not limited. If the two dimensions of traffic occupation and packet loss rate are evaluated, examples are as follows:

a) The rate of flow (Rf) = actual traffic / total hardware bandwidth.

For example, multiple intervals can be set. For example, setting the [0, X1%] interval indicates that the flow is sufficient, setting [X1%, X2%] indicates that the flow is flat, and setting the [X2%, X3%] interval indicates that the flow is tight. The specific number of intervals, the endpoint value of the interval, and the like can be set differently according to different situations.

b) The rate of lost packets (Rp).

For example, the packet loss rate can be calculated according to the RTCP feedback mechanism (that is, the number of packets sent in the SR (Sender Report) in the Real-time Transport Control Protocol (RTCP) message can be The number of received packets in the corresponding RR (Receiver Report) is used to count the packet loss rate.

For example, a plurality of sections can be set. For example, a plurality of packet loss rate sections such as [0, Y1%], [Y1%, Y2%], and [Y2%, Y3%] can be set. Specifically, the values of Y1, Y2, and Y3 can be set according to different situations. And, the information of the specific number of sections, the endpoint value of the section, and the like can be set differently according to different situations.

For example, a way to evaluate network resources based on traffic usage and packet loss rate is as follows:

When Rf<X1% and Rp<Y1%, it is determined that NR is sufficient;

When X1%<Rf<X2% or Y1%<p<Y2%, it is determined that NR is flat;

When X2%<Rf<X3% or Y2%<p<Y3%, it is determined that NR is nervous;

When Rf>X3% or Rp>Y3%, it is judged that NR is extremely tight.

For example, if the NR is determined to be sufficient, the preset level may be selected to be all layers of the code stream to be transmitted by the media transmitting end; if the NR is determined to be extremely tight, the conversion type information may be selected as NONE, that is, no conversion is performed. ,and many more.

In addition, in another embodiment of the present invention, in addition to the network resources, the capabilities of other terminals in the network may be considered when evaluating the network status. For example, if the media gateway needs to evaluate the network status, the media gateway can consider the capabilities of the peer (eg, may include the media receiver and/or the media sender) in addition to the network resources. If the conference center needs to evaluate the network status, the conference center can consider the network resources in addition to the network resources. If the conference center serves as the media receiver, the peer end can refer to the media sender. If the conference center serves as the media sender, The peer may then refer to the capabilities of the media receiving end, and/or may also consider the capabilities of multiple terminals in the network, such as the ability to consider one or more terminals in communication with the conference center, and the like.

The capabilities of the terminal can be evaluated from the dimensions of the resolution, and of course from other dimensions. For example, if the evaluation is performed from the dimension of the resolution, the corresponding interval may be set. For example, the terminal whose resolution is greater than or equal to 720P is a high-capacity terminal, and the terminal whose resolution is [360P, 180P] is a low-capability terminal. A terminal with a resolution of 180P or less is set as a low-capability terminal, and the like. The manner in which the capabilities of the terminal are evaluated is not limited in the present invention.

The media gateway has modified the attribute information of the code stream sent by the media sending end according to the information of the layer-by-layer conversion mode, and sends the modified attribute information to the media sending end. Therefore, in another embodiment of the present invention, The information of the layer-converted mode includes the information converted according to the preset level. In step 103, the media gateway receives the code stream of the first format sent by the media sending end, including:

The media gateway receives the preset level code stream sent by the media sending end, and the format of the preset level code stream is the first format.

In this embodiment, the media sending end may send the layer indicated by the layer-switched mode information to the media gateway, and the layer-switched mode information may not be sent to the media gateway. In this way, the media gateway receives the required layer, does not need to receive other unneeded layers, reduces the amount of data to be transmitted, and saves system resources.

For example, the code stream to be sent by the media sending end itself includes 8 layers, including 1 base layer and 7 enhancement layers, the serial numbers are 0-7, the base layer number is 0, and the highest enhancement layer serial number is 7. The information of the layer-by-layer conversion mode includes information converted according to a preset level, for example, a layer of the third layer and below, that is, the preset level is the 0th layer, the 1st layer, the 2nd layer, and the 3rd layer. Floor. Then, the media sending end may send the 0th layer, the 1st layer, the 2nd layer, and the 3rd layer of the code stream to be sent to the media gateway, and the 4th, 5th, and 6th layers of the code stream to be sent And layer 7 can be sent without, reducing The amount of data that the media gateway needs to receive, and the data that the media gateway does not need to receive is reduced, which is equivalent to reducing the redundant data received by the media gateway.

In another embodiment of the present invention, the code stream sent by the media sending end needs to be transferred to the media receiving end after being transferred by the media gateway, and then, in step 103, after receiving the code stream of the first format sent by the media sending end, the media gateway may It is converted into a code stream in a second format. The code stream format sent by the media sending end is referred to as a first format, and the code stream format supported by the media receiving end is referred to as a second format. The embodiments of the present invention mainly protect the manner in which the code stream of the multi-layer format is converted into the code stream of the single-layer format. Therefore, the first format is a multi-layer encoding format, and the second format is a single-layer encoding format.

For example, if the first format is the SVC format and the second format is the AVC format, the media gateway converts the received preset-level SVC format code stream into the AVC format code stream.

Optionally, in another embodiment of the present invention, if the first code stream conversion information includes information of a code stream converted into a single layer encoding format by a code stream of a multi-layer encoding format, and includes converting according to a preset level The information of the mode is to convert the code stream of the first format into the code stream of the second format, including: converting the code stream of the preset level into the code stream of the second format.

That is, the media gateway receives the code stream of the preset level, and the media gateway can convert the received code stream into the code stream of the second format. For the manner of converting the format of the specific code stream, refer to the prior art, and the present invention is not limited.

In another embodiment of the present invention, if the first stream conversion information includes information of a code stream converted into a single layer encoding format by a code stream of a multi-layer encoding format, and information of a mode converted according to a preset level. Also includes conversion level information, which is described as follows:

1. The conversion level information includes extracting information of a data packet related to a frame rate.

And converting the code stream of the first format into the code stream of the second format, including: extracting, according to the conversion level information, a frame rate-related data packet from the code stream of the preset level; and extracting the frame rate related to the extracted frame rate The packet is converted to a code stream of the second format.

For example, the code stream to be sent by the media sending end itself includes 8 layers, including 1 base layer and 7 enhancement layers, the serial numbers are 0-7, the base layer number is 0, and the highest enhancement layer serial number is 7. The information of the layer-by-layer conversion mode includes information converted according to a preset level, for example, a layer of the third layer and below, that is, the preset level is the 0th layer, the 1st layer, the 2nd layer, and the 3rd layer. Floor. Then, the media sending end may send the 0th layer, the 1st layer, the 2nd layer, and the 3rd layer of the code stream to be sent to the media gateway. After receiving, the media gateway may extract a frame rate-related data packet from the received preset level code stream, and convert the extracted frame rate-related data packet into a second format code stream, and the preset level is For a data packet that is not related to the frame rate, the media gateway may not perform the conversion, so as to ensure that the converted code stream is the code stream required by the media receiving end.

For example, if the media receiving end requires a higher frame rate of the code stream, the media gateway can perform code stream conversion in this manner to obtain the code stream required by the media receiving end as much as possible.

2. The conversion level information includes extracting information of the data packet related to the resolution.

And converting the code stream of the first format into the code stream of the second format, including: extracting, according to the conversion level information, a resolution-related data packet from the code stream of the preset level; and extracting the resolution-related The packet is converted to a code in the second format flow.

For example, the code stream to be sent by the media sending end itself includes 8 layers, including 1 base layer and 7 enhancement layers, the serial numbers are 0-7, the base layer number is 0, and the highest enhancement layer serial number is 7. The information of the layer-by-layer conversion mode includes information converted according to a preset level, for example, a layer of the third layer and below, that is, the preset level is the 0th layer, the 1st layer, the 2nd layer, and the 3rd layer. Floor. Then, the media sending end may send the 0th layer, the 1st layer, the 2nd layer, and the 3rd layer of the code stream to be sent to the media gateway. After receiving the media gateway, the resolution-related data packet may be extracted from the received preset-level code stream, and the extracted resolution-related data packet is converted into the second-format code stream, and the preset level is The media gateway may not convert the data packets that are not related to the resolution, so as to ensure that the converted code stream is the code stream required by the media receiving end.

For example, if the resolution of the code stream on the media receiving end is relatively high, the media gateway can perform code stream conversion in this manner to obtain the code stream required by the media receiving end as much as possible.

After converting the code stream of the first format to the code stream of the second format, the media gateway may send the code stream of the second format to the media receiving end according to step 104, so that the media receiving end receives the sending by the media sending end. The code stream, the format of the received code stream is also a format that the media receiving end can support, and the received content is also adapted to the media receiving end.

The media gateway notifies the media sender according to the first code stream conversion information, which code streams are sent, and also converts the preset layer code stream according to the first code stream conversion information (for example, conversion level information), the first code stream The conversion information is the code stream conversion information determined by considering the capability of the media receiving end. Then, the media transmitting end sends the SVC format code stream, and the media receiving end supports the AVC format code stream as an example, according to the media receiving end. The code stream conversion information determined by the capability may convert the code stream of other layers of the SVC (for example, the enhancement layer) in addition to the code stream of the base layer of the SVC, which is equivalent to the AVC terminal being able to receive the SVC terminal. In addition to the code stream of the base layer, it can also receive the code stream of other layers (such as the enhancement layer) sent by the SVC terminal. Generally, the enhancement layer is a refinement of the base layer. If there is only the base layer, the entire picture may be Complete, but there may be partial unclearness. If there are not only the base layer and the enhancement layer, the picture will be much clearer than the base layer, and the details will be more realistic and can be more Image quality, at the same time, try to receive more code streams, try to avoid the loss of code stream, increase the information receiving ability and information receiving amount of the media receiving end, in addition, because the received code stream is more, that is, the received video information More, the quality of the video reconstructed according to the received code stream is better.

In another embodiment of the present invention, after the media gateway establishes a transmission channel with the media receiving end, the media gateway can re-evaluate the network state in real time, timing, or triggered. The manner of specifically evaluating the network state is as previously described. If the evaluation determines that the code stream conversion information needs to be adjusted, the media gateway may adjust the code stream conversion information, for example, from the first code stream conversion information to the second code stream conversion information. For example, before the network resource is evaluated as “sufficient”, the conversion policy information corresponding to the first stream conversion information is “the highest policy”, and when the evaluation is later, the network resource is “tight”, the media gateway may adjust. Converting the policy information, for example, to the “minimum policy”, thereby obtaining new code stream conversion information (ie, the second code stream conversion information). After the adjustment, the media gateway re-notifies the media sender, so that the media sender sends the second The code stream converts the information to match the code stream.

The second code stream conversion information may include information of a code stream converted into a single layer coding format by a code stream of a multi-layer coding format, and information of a layer-by-layer conversion mode. Optionally, the second code stream conversion information is included. It can also include conversion level information.

For example, the code stream to be sent by the media sending end itself includes 8 layers, including 1 base layer and 7 enhancement layers, the serial numbers are 0-7, the base layer number is 0, and the highest enhancement layer serial number is 7. The information of the layer-by-layer conversion mode corresponding to the first code stream conversion information includes information converted according to a preset level, and the preset level is, for example, a layer of the third layer and below, that is, the preset level is the 0th layer, Layer 1, Layer 2 and Layer 3. Then, the media sending end may send the 0th layer, the 1st layer, the 2nd layer, and the 3rd layer of the code stream to be sent to the media gateway. After the code stream conversion information is updated to the second code stream conversion information, the information of the layer-by-layer conversion mode corresponding to the first code stream conversion information includes information converted according to a preset level, and the preset level is, for example, the fourth layer. And the following levels, that is, the preset levels are the 0th layer, the 1st layer, the 2nd layer, the 3rd layer, and the 4th layer. Then, the media sending end may send the 0th layer, the 1st layer, the 2nd layer, the 3rd layer, and the 4th layer of the code stream to be sent to the media gateway.

In this embodiment, the media gateway can adjust the code stream conversion information according to the network status and the like, so that the code stream conversion conforms to the requirements of the media receiving end as much as possible, improves the network resource utilization rate, and improves the success rate of the code stream transmission.

In the embodiment of the present invention, the code stream conversion information (that is, the first code stream conversion information) is provided. After determining the first code stream conversion information, the media gateway may perform code stream conversion according to the first code stream conversion information, that is, the media sending end. The transmitted code stream of the first format is converted into the code stream of the second format, and the code stream of the second format is supported by the media receiving end, so the media receiving end can receive the code stream of the second format. Before the media stream sends the code stream sent by the media sending end to the media receiving end, the format of the received code stream is first converted. For example, the media sending end sends the SVC format code stream, and the media receiving end supports the AVC. In the format of the code stream, the media gateway can convert the SVC format code stream into the AVC format code stream, and then send the AVC format code stream to the media receiving end.

The code stream in the SVC format is sent by the media sender, and the code stream in the AVC format is supported by the media receiver as an example. The AVC terminal can receive the code stream of the base layer sent by the SVC terminal. The code stream of other layers (such as the enhancement layer) sent by the SVC terminal tries to avoid the loss of the code stream, increases the information receiving capability and the information receiving amount of the media receiving end, and further, because the received code stream is more, that is, the received video information. More, the quality of the video reconstructed according to the received code stream is better.

Referring to FIG. 2, based on the same inventive concept, an embodiment of the present invention provides a code stream receiving method, which is a method performed by a media receiving end corresponding to the method introduced in the process of FIG. The process is described below.

Step 201: The media receiving end sends the attribute information of the code stream to the media gateway, where the attribute information of the code stream is used to determine the first code stream conversion information, where the first code stream conversion information includes the conversion type information and the layer-by-layer conversion mode. The information of the conversion type includes information of a code stream converted into a single layer coding format by a code stream of a multi-layer coding format.

Step 202: The media receiving end receives the code stream of the second format sent by the media gateway, where the code stream of the second format is obtained by the media gateway converting the code stream of the first format received according to the first code stream conversion information.

In the embodiment of the present invention, the media receiving end may be a device with certain intelligence, such as a conference center, or may be a device with weak intelligence, such as a terminal.

Optionally, in another embodiment of the present invention, before the media receiving end sends the attribute information of the code stream to the media gateway, the method further includes: the media receiving end receiving the conversion capability information sent by the media gateway; and the media receiving end according to the conversion capability information. Determining the attribute information of the code stream, the attribute information of the code stream is used to indicate the first code stream conversion information; wherein the conversion capability information includes the conversion type information and the information of the layer-by-layer conversion mode, and the information of the layer-by-layer conversion mode includes Set the information of the level conversion.

That is, if the media receiving end is a device with certain intelligence, for example, a conference center, the media receiving end may store the conversion capability information, or the media gateway may send the conversion capability information to the media receiving end, and the media receiving end may according to its own The capability, or the first code stream conversion information is determined from the conversion capability information according to the information of the capability and the current network state, and the attribute information of the code stream corresponding to the first code stream conversion information may be sent to the media gateway. Or it can be understood that the media receiving end can modify the attribute information of the code stream sent by the media gateway according to the first code stream conversion information, and send the attribute information of the modified code stream to the media gateway.

Alternatively, if the media receiving end is a less intelligent device, such as a terminal, it may not have the ability to select a code stream conversion information, so the media gateway may be based on its own capabilities fed back by the media receiving end, or may be based on the media. The information fed back by the receiving end and the current network state and the like, and the code stream conversion information suitable for the media receiving end are selected from the stored conversion capability information, and the intelligence requirement of the media receiving end is relatively low, and the applicable scope is wider. And the media gateway may also select the code stream conversion information suitable for the media receiving end according to the attribute information of the code stream fed back by the media receiving end, so that the selected first code stream conversion information may reflect the requirement of the media receiving end as much as possible, thereby enabling the code stream conversion. The process can be completed as much as possible according to the requirements of the media receiving end, and the success rate of the code stream receiving at the receiving end of the media is improved.

In another embodiment of the present invention, the conversion capability information further includes conversion level information; wherein: the conversion level information includes: extracting information of the data packet related to the frame rate, or extracting information of the data packet related to the resolution.

In another embodiment of the present invention, the media receiving end, such as the conference center, can also re-evaluate the network status in real time, timing, or triggered. The manner in which the network status is specifically evaluated is described in the flow of FIG. If the evaluation determines that the code stream conversion information needs to be adjusted, the media receiving end may adjust the code stream conversion information, for example, from the first code stream conversion information to the second code stream conversion information, for example, before the network resource is evaluated as “sufficient”, The conversion strategy information corresponding to the first stream conversion information is the "highest policy", and when the evaluation is later performed, the network resource is evaluated as "tight", and the media receiving end may adjust the conversion policy information, for example, to the "minimum policy". Therefore, the new code stream conversion information (ie, the second code stream conversion information) is obtained. After the adjustment, the media receiving end notifies the media gateway of the adjusted code stream conversion information.

The processing method after the media gateway receives the second stream conversion information is described in the flow of FIG. 1. In the embodiment of the present invention, the media receiving end can adjust the code stream conversion information according to the network status and the like, so that the code stream conversion conforms to the requirements of the media receiving end as much as possible, improves the network resource utilization rate, and improves the success rate of the code stream transmission.

In addition, after receiving the code stream in the second format, the media receiving end may further send the code stream in the second format to the other media receiving end. That is, the media receiving end can also serve as a media transmitting end.

In the embodiment of the present invention, the media receiving end may send the attribute information of the code stream to the media gateway, and the media gateway may determine the first code stream conversion information according to the attribute information of the code stream, and then the media gateway may perform the code according to the first code stream conversion information. Stream conversion, that is, converting the code stream of the first format sent by the media sender to the code stream of the second format, and the code stream of the second format is the medium The body receiving end supports, so the media receiving end can receive the code stream in the second format. Correspondingly, the media gateway is the first code stream conversion information determined after considering the situation of the media receiving end, and the finally obtained code stream is also the code stream required by the media receiving end, and can meet the requirements of the media receiving end as much as possible.

For example, the media sender sends the SVC format code stream, and the media receiver supports the AVC format code stream. The media gateway can convert the SVC format code stream into the AVC format code stream, and specifically convert the SVC format. Which part of the code stream is also determined according to the first code stream conversion information, and then the code stream of the AVC format is sent to the media receiving end.

Continuing to send the SVC format code stream to the media sender, the media receiver supports the AVC format code stream as an example, which is equivalent to the AVC terminal being able to receive the code stream of the base layer sent by the SVC terminal. Supported by the code stream conversion information, it can also receive the code stream of other layers (such as the enhancement layer) sent by the SVC terminal, try to avoid the loss of the code stream, increase the information receiving capability and the information receiving amount of the media receiving end, and further, because of the received There are more code streams, that is, more received video information, and the quality of the video reconstructed according to the received code stream is better.

Since FIG. 1 and FIG. 2 are corresponding processes, the contents can be referred to each other, and thus the duplicate content is not described in detail.

Hereinafter, the flow of FIG. 1 and the flow of FIG. 2 will be exemplified.

Referring to FIG. 3, the terminal serves as a media sending end, and the conference center serves as a media receiving end, and the media gateway is used to forward between the media sending end and the media receiving end. The terminal in FIG. 3 may be, for example, a UE, and the media gateway may be, for example, an SBC (Session Border Controller). The conference center may be, for example, an MRF (in FIG. 3, the AS and the MRF may be located in the same entity). For example, the terminal sends the code stream in the SVC format, and the conference center supports the code stream in the AVC format.

1. The terminal initiates a session. That is, the terminal sends a first session request message to the media gateway for requesting to send the code stream to the conference center.

2. After receiving the first session request message, the media gateway sends a second session request message carrying the conversion capability information to the conference center.

The conversion capability information includes, for example:

{

{Conversion type information: SVC-AVC; SHVC-AVC; SHVC-HEVC; AVC-SVC; AVC-SHVC; HEVC-SHVC; NONE};

{Information converted by default level: highest strategy, or average strategy, or minimum strategy};

{Conversion level information: Extract resolution-related packets, or extract frame rate-related packets}

}

3. The conference center receives the second session request message. Because the session between the terminal and the conference center is not completely established at this time, the conference center can be used as the basis for selecting the code stream conversion information according to the capability of the conference center and the current network state. For example, the conference center can be based on the capabilities of the conference center and the current The traffic statistics are used as a basis. The conference center selects the first code stream conversion information from the conversion capability information according to the capability of the conference center and the current network state, and sends a second session response message carrying the first code stream conversion information to the media gateway.

For example, the first stream conversion information includes:

{

{Conversion type information: SVC-AVC};

{Information converted by default level: highest strategy};

}

After receiving the second session response message, the media gateway sends the third session request information carrying the first code stream conversion information to the conference center.

After receiving the third session request message, the conference center sends a third session response message to the media gateway, where the third session response message indicates that the conference center accepts the first code stream conversion information.

After receiving the third session response message, the media gateway sends a first session response message to the terminal, and the SDP (Session Description Protocol) is associated with the SVC code stream in the attribute information of the code stream carried in the first session response message. The attribute is based on the first stream conversion information, and the SDP attributes related to the other codecs are negotiated with the corresponding codec attributes received from the conference center.

7. After receiving the response of the terminal to the first session response message, the media gateway establishes a session channel with the terminal, and the terminal can send the code stream.

Once the media channel is established, the code stream is normally transmitted, and the terminal 1 sends the code stream to the media gateway 2. After receiving the code stream in the SVC format, the media gateway 2 converts the code stream into the AVC format code stream according to the conversion level information, and then the AVC. The formatted code stream is sent to the terminal 2. At this time, the terminal may also send an RTCP message (which carries the SR) to indicate the number of data packets sent in a certain period of time while transmitting the code stream. At the same time, the conference center, which is the receiving end of the media, can send an RTCP message (which carries the RR) to the terminal, and the RR carries the number of data packets received by the conference center from the terminal in the corresponding period.

8-9. The conference center adjusts the code stream conversion information according to the network status (for example, according to the RTCP message).

The RTCP message contains the SR and the RR, the SR contains the number of packets sent, and the RR contains the number of packets received. The conference center can calculate the packet loss rate based on the SR and the RR, and then combine the traffic statistics and the peer capability to determine whether to adjust the code stream conversion information. If the code stream conversion information is to be adjusted, the adjusted code stream conversion information is notified to the media gateway.

10-11. If the media gateway receives the new code stream conversion information, initiates session re-negotiation to the conference center according to the new code stream conversion information. The final session is updated. As shown in FIG. 3, the AVC code stream 1 in FIG. 3 indicates that the AVC code stream is converted according to the first code stream conversion information, and the AVC code stream 2 indicates that the information is converted according to the second code stream (ie, the adjusted code). Stream conversion information) AVC code stream obtained after conversion.

In this embodiment, the media receiving end may send the attribute information of the code stream to the media gateway, and the media gateway may determine the first code stream conversion information according to the attribute information of the code stream, and then the media gateway may perform the code according to the first code stream conversion information. The stream conversion is to convert the code stream of the first format sent by the media sending end into the code stream of the second format, and the code stream of the second format is supported by the media receiving end, so the media receiving end can receive the code stream of the second format. . Correspondingly, the media gateway is the first code stream conversion information determined after considering the situation of the media receiving end, and the finally obtained code stream is also the code stream required by the media receiving end, and can meet the requirements of the media receiving end as much as possible.

For example, the media sender sends the SVC format code stream, and the media receiver supports the AVC format code stream. The media receiving end may determine the first code stream conversion information, and send the first code stream conversion information to the media gateway, where the media gateway may notify the media sending end to send the first code stream conversion information according to the first code stream conversion information. Adapting the code stream of the SVC format, and converting the received SVC format code stream into the AVC format code stream, and then transmitting the AVC format code stream to the media receiving end. In this way, the first code stream conversion information is determined by the media receiving end, and can basically reflect the requirements of the media receiving end more realistically, so as to ensure that the media receiving end can receive the code stream that is needed by itself. For example, if the capability of the media receiving end is strong, or if the capability of the media receiving end is strong and the current network state is also good, the number of layers of the SVC format indicated in the first stream conversion information may be relatively large. So that the media receiver can receive more code streams, which helps to reconstruct better quality video.

Referring to FIG. 4, on the basis of FIG. 3, the conference center also sends the AVC code stream obtained by converting the second code stream conversion information to other media receiving ends (ie, terminal 2 in FIG. 4). In FIG. 4, the media transmitting end is referred to as the terminal 1, the media gateway between the terminal 1 and the conference center is referred to as the media gateway 1, and the conference center and the terminal 2 are also forwarded by the media gateway, and the media gateway is referred to as a media gateway. 2. The media gateway 2 is also, for example, an SBC.

For the steps 1-11, reference may be made to the description for FIG. 3, and details are not described.

12. The conference center initiates a renegotiation request message to the terminal 2.

13. The conference center forwards the code stream (ie, AVC stream 2) converted according to the second stream conversion information to the terminal 2.

The step 12 may include multiple steps, and the conference center may initiate a renegotiation request message to the terminal to request to send the code stream to the terminal, and may refer to the existing implementation process, and details are not described herein.

In this embodiment, after receiving the code stream in the AVC format, the media receiving end may further forward the received code stream to other terminals, so that the media gateway does not need to specifically send the code stream to the terminals, thereby reducing the terminal. The process of information exchange with the media gateway reduces the burden on the media gateway.

Wherein, when the conference center is used as the media receiving end and/or the media sending end (for example, FIG. 3 is an example of a conference center as a media receiving end, FIG. 4 is an example of a conference center serving as a media receiving end and a media sending end at the same time), which is a point-to-multiple An example of point communication, because the conference center can complete multipoint communication.

Referring to FIG. 5, the terminal 1 serves as a media sending end, the terminal 2 serves as a media receiving end, the media gateway 1 and the media gateway 2 are used for forwarding between the media sending end and the media receiving end, and FIG. 5 further includes an application server. . The terminal in FIG. 5 may be, for example, a UE, and the media gateway may be, for example, an SBC (Session Border Controller). For example, the terminal 1 transmits a code stream in an SVC format, and the terminal 2 supports a code stream in an AVC format. FIG. 5 is an example of a terminal-terminal, that is, an example of point-to-point communication.

1. The terminal 1 sends a first session request message to the media gateway 2, requesting to send a code stream to the terminal 2.

2. After receiving the first session request message, the media gateway 2 sends a second session request message to the terminal 2. For example, after receiving the first session request message, the media gateway 2 may forward the first session request message to the terminal 2 directly. In this case, the second session request message is the same message as the first session request message.

3. After receiving the second session request message, the terminal 2 generates a second session response message according to its own capabilities. For example, the terminal 2 cannot identify the SVC stream attribute carried in the second session request message because the SVC is not supported, so the second session responds. The SVC stream attribute is removed from the message, and the second session response message is sent to the media gateway 2.

The media gateway 2 identifies that the terminal 2 does not support the SVC capability according to the second session response message, and the media gateway determines the first code stream conversion information according to the stored conversion capability information, and sends a third session request message to the terminal 2, and the third The session request message carries the first stream conversion information. For example, the media gateway 2 may modify the media attribute of the SVC code stream to the media attribute of the AVC code stream in the third session request message.

For example, conversion capability information includes:

{

}

For example, the first stream conversion information includes:

{

{Conversion type information: SVC-AVC};

{Information converted by default level: average strategy};

{Conversion level information: extracting data packets related to resolution};

}

5. The terminal 2 re-responds to the third session request message sent by the media gateway 2, and replies to the media gateway 2 with a third session response message.

After the media gateway 2 receives the third session response message, if the third session response message indicates that the terminal 2 accepts the first code stream conversion information, the media gateway 2 sends a first session response message to the terminal. In the attribute information of the code stream carried in the first session response message, the SDP attribute related to the SVC code stream is subject to the first code stream conversion information, and the SDP attributes related to other codecs are received from the media gateway 2 The attribute negotiation of the codec shall prevail.

7. Once the media channel is established, the code stream is normally transmitted, and the terminal 1 sends the code stream to the media gateway 2. After receiving the code stream in the SVC format, the media gateway 2 converts the code stream into the AVC format code stream according to the conversion level information, and then The code stream of the AVC format is transmitted to the terminal 2. Moreover, while transmitting the code stream to the media gateway 2, the terminal 1 may also send an RTCP message (which carries the SR) to indicate the number of data packets sent in a certain period of time, and at the same time, the media gateway 2 as the media receiving end will RTCP message ( The RR is sent to the terminal 1, and the RR carries the number of data packets received by the media gateway 2 from the terminal 1 in the corresponding period.

8-9. The media gateway 2 adjusts the code stream conversion information according to the current network state (for example, according to the RTCP message).

The RTCP message contains the SR and the RR, the SR contains the number of packets sent, and the RR contains the number of packets received. The conference center can calculate the packet loss rate based on the SR and the RR, and then combine the traffic statistics and the peer capability to determine whether to adjust the code stream conversion information.

If the media gateway 2 adjusts the code stream conversion information, the session re-negotiation is initiated to the terminal 2 according to the new code stream conversion information. The final session is updated. As shown in FIG. 5, the AVC code stream 1 in FIG. 5 indicates that the information is converted according to the first code stream conversion information. The obtained AVC code stream, AVC code stream 2 indicates an AVC code stream obtained by converting the second code stream conversion information (i.e., the adjusted code stream conversion information).

In this embodiment, the media receiving end (ie, the terminal 2) is an ordinary terminal. For example, the media receiving end has weak intelligence and does not have the capability of selecting the code stream conversion information. Therefore, the media gateway can respond to the media receiving end. The ability of the media to select the code stream conversion information suitable for the media receiving end from the stored conversion capability information has lower requirements on the intelligence of the media receiving end, and the scope of application is wider. And the media gateway also selects the code stream conversion information suitable for the media receiving end according to the attribute information of the code stream fed back by the media receiving end, so that the selected first code stream conversion information can reflect the requirement of the media receiving end as much as possible, thereby enabling the code stream conversion process to Try to complete the requirements of the media receiving end, and improve the success rate of the stream receiving at the receiving end of the media.

The device in the embodiment of the present invention is described below with reference to the accompanying drawings.

Referring to FIG. 6 , based on the same inventive concept, an embodiment of the present invention provides a media gateway, which may include a determining module 601, a changing module 602, a converting module 603, and a sending module 604.

The determining module 601 is configured to receive attribute information of the code stream sent by the media receiving end, and determine the first code stream conversion information according to the attribute information of the code stream; the first code stream conversion information includes the conversion type information and the layer-by-layer conversion mode. Information, the conversion type information includes information of a code stream converted into a single layer encoding format by a code stream of a multi-layer encoding format;

The change module 602 is configured to modify the attribute information of the code stream sent by the media sending end to the attribute information sent by the media receiving end according to the information of the layer-by-layer conversion mode, and send the modified attribute information to the media sending end;

The converting module 603 is configured to receive a code stream of a first format sent by the media sending end, and convert the code stream of the first format into a code stream of the second format; the code stream of the first format is modified by the media sending end. The attribute information is sent, the first format is a multi-layer encoding format, and the second format is a single layer encoding format;

The sending module 604 is configured to send the code stream in the second format to the media receiving end.

In another embodiment of the present invention, the information of the code stream converted into the single layer encoding format by the code stream of the multi-layer encoding format includes: information converted from the SVC format to the AVC format, information converted from the SHVC format to the AVC format, And at least one of information converted from the SHVC format to the HEVC format.

In another embodiment of the present invention, the information of the mode converted by layer includes information converted according to a preset level;

The conversion module 603 is configured to receive the code stream in the first format sent by the media sending end, and specifically includes:

The code stream of the preset level sent by the sending end of the media is received, and the format of the code stream of the preset level is the first format.

In another embodiment of the present invention, the converting module 603 is configured to convert the code stream in the first format into the code stream in the second format, and specifically includes:

The code stream of the preset level is converted into the code stream of the second format.

In another embodiment of the present invention, the first code stream conversion information further includes conversion level information, which is: extracting information about a data packet related to a frame rate;

The converting module 603 is configured to convert the code stream in the first format into the code stream in the second format, and specifically includes:

Extracting a frame rate-related data packet from a code stream of a preset level according to conversion level information;

The extracted frame rate related data packet is converted into a code stream of the second format.

In another embodiment of the present invention, the first code stream conversion information further includes conversion level information, which is: extracting information about a resolution-related data packet;

Extracting the resolution-related data packet from the code stream of the preset level according to the conversion level information;

The extracted resolution-related data packet is converted into a code stream of the second format.

In another embodiment of the present invention, the determining module 601 is configured to determine the first code stream conversion information according to the attribute information of the code stream, and specifically includes:

The attribute information of the code stream is used to indicate attribute information of the code stream supported by the media receiving end; or

The conversion capability information includes information of the conversion type information and the mode of the layer-by-layer conversion, wherein the information of the mode of the layer-by-layer conversion includes information converted according to a preset level.

In another embodiment of the present invention, the conversion capability information further includes conversion level information; wherein:

The device in the embodiment of the present invention is a device corresponding to the method as described above. For example, the media gateway may be the media gateway described in FIG. 1 to FIG. 5. Therefore, the functions implemented by each module in the media gateway, as well as some implementation details, may be referred to the description of the method part.

In this embodiment, after determining the first code stream conversion information, the media gateway may perform code stream conversion according to the first code stream conversion information, and then send the converted code stream to the media receiving end, so that the media receiving end can receive The code stream that can be identified by itself, and the first code stream conversion information is determined by the media gateway through the attribute information of the code stream sent by the media receiving end, so that the converted code stream can meet the requirements of the media receiving end as much as possible.

The media gateway can perform code stream conversion according to the requirements of the media receiving end, and the media gateway has strong intelligence.

Referring to FIG. 7, an embodiment of the present invention provides a media receiving end, which may be, for example, a conference center, or other common terminals. The media receiving end may include a sending module 701 and a receiving module 702.

The sending module 701 is configured to send the attribute information of the code stream to the media gateway, where the attribute information of the code stream is used to determine the first code stream conversion information; the first code stream conversion information includes the conversion type information and the information of the layer-by-layer conversion mode. The conversion type information includes information of a code stream converted into a single layer encoding format by a code stream of a multi-layer encoding format;

The receiving module 702 is configured to receive a code stream in a second format sent by the media gateway, where the code stream in the second format is obtained by converting, by the media gateway, a code stream in a first format received according to the first code stream conversion information.

In another embodiment of the present invention, the information of the code stream converted into the single layer encoding format by the code stream of the multi-layer encoding format includes: information converted from the SVC format to the AVC format, information converted from the SHVC format to the AVC format, And transferred by SHVC format Switch to at least one of the HEVC format information.

In another embodiment of the present invention, the media receiving end further includes a determining module;

The receiving module 702 is further configured to: before the sending module 701 sends the attribute information of the code stream to the media gateway, receive the conversion capability information sent by the media gateway;

The determining module is configured to: determine attribute information of the code stream according to the conversion capability information, where the attribute information of the code stream is used to indicate the first code stream conversion information;

The conversion capability information includes information of the conversion type information and the mode of the layer-by-layer conversion, and the information of the mode of the layer-by-layer conversion includes information converted according to a preset level.

The media receiving end in the embodiment of the present invention may be the media receiving end described in FIG. 1 to FIG. 5. Therefore, the functions implemented by each module in the media receiving end, as well as some implementation details, may be referred to the description of the method part.

In this embodiment, the media receiving end may send the attribute information of the code stream to the media gateway, so that the media gateway may determine the first code stream conversion information according to the attribute information of the code stream, and then perform the code stream according to the first code stream conversion information. The code stream obtained after the conversion is sent to the media receiving end, so that the media receiving end can receive the code stream that can be recognized by the media, because the first code stream conversion information is determined by the media gateway through the attribute information of the code stream sent by the media receiving end, The converted code stream can match the needs of the media receiver as much as possible.

The media receiving end can send the attribute information of the code stream to the media gateway to inform the media gateway of what kind of code stream it needs. The media receiving end has a strong initiative, and the received code stream has a high utilization rate.

Referring to FIG. 8 , based on the same inventive concept and the above embodiments, an embodiment of the present invention further provides a media gateway, which may include a memory 801, a processor 802, a receiver 803, and a transmitter 804.

The processor 802 may be a central processing unit or an ASIC (Application Specific Integrated Circuit), and may be one or more integrated circuits for controlling program execution, and may be an FPGA (Field Programmable Gate Array). The hardware circuit developed by the programming gate array can be a baseband chip. The number of memories 801 may be one or more. The memory 801 may include a ROM (Read Only Memory), a RAM (Random Access Memory), and a disk storage. The receiver 803 and the transmitter 804 may belong to a radio frequency system, and the receiver 803 and the transmitter 804 are configured to perform network communication with an external device, and specifically, may communicate with an external device through a network such as an Ethernet, a radio access network, or a wireless local area network. Receiver 803 and transmitter 804 may be physically separate components or may be physically identical components.

These memories 801, receivers 803, and transmitters 804 may be coupled to the processor 802 via a bus, or may be coupled to the processor 802 via dedicated connection lines, respectively.

By programming the processor 802, the code corresponding to the method shown above is solidified into the chip, thereby enabling the chip to perform the method shown in the previous embodiment while it is running. How to design and program the processor 802 Techniques well known to those skilled in the art will not be described here.

In the embodiment of the present invention,

The memory 801 is configured to store an instruction required by the processor 802 to perform a task;

The receiver 803 is configured to receive attribute information of a code stream sent by the media receiving end.

The processor 802 is configured to execute the instruction stored in the memory 801, determine the first code stream conversion information according to the attribute information of the code stream, and modify the attribute information of the code stream sent by the media sending end to the media according to the information of the layer-by-layer conversion mode. The attribute information sent by the receiving end is sent to the media sending end by the sender 804. The first stream converting information includes the conversion type information and the layer-by-layer conversion mode information, and the conversion type information includes The code stream of the layer coding format is converted into the information of the code stream of the single layer coding format;

The receiver 803 is further configured to receive a code stream in a first format sent by the media sending end.

The processor 802 is further configured to convert the code stream in the first format into the code stream in the second format, and send the code stream in the second format to the media receiving end by using the transmitter 804; the code stream in the first format is sent by the media. According to the modified attribute information, the first format is a multi-layer encoding format, and the second format is a single layer encoding format.

Optionally, in another embodiment of the present invention, the information of the code stream converted into the single layer coding format by the code stream of the multi-layer coding format includes: information converted from the SVC format to the AVC format, and converted from the SHVC format to the AVC. At least one of format information and information converted from the SHVC format to the HEVC format.

Optionally, in another embodiment of the present invention, the information of the mode converted by layer includes information converted according to a preset level;

The receiver 803 is configured to receive the code stream in the first format sent by the media sending end, and specifically includes:

Optionally, in another embodiment of the present invention, the processor 802 is further configured to convert the code stream of the first format into the code stream of the second format, specifically:

Optionally, in another embodiment of the present invention, the first code stream conversion information further includes conversion level information, which is: extracting information about a data packet related to a frame rate;

The processor 802 is further configured to convert the code stream in the first format into the code stream in the second format, and specifically includes:

Optionally, in another embodiment of the present invention, the first code stream conversion information further includes conversion level information, which is: extracting information about a resolution-related data packet;

Optionally, in another embodiment of the present invention, the processor 802 is configured to determine, according to the attribute information of the code stream, the first code stream conversion information, specifically:

Optionally, in another embodiment of the present invention, the conversion capability information further includes conversion level information, where:

Referring to FIG. 9 , based on the same inventive concept and the foregoing embodiments, an embodiment of the present invention further provides a media receiving end, where the media receiving end may include a memory 901, a processor 902, a receiver 903, and a transmitter 904.

The processor 902 may be a central processing unit or an ASIC, and may be one or more integrated circuits for controlling program execution, may be hardware circuits developed using an FPGA, and may be baseband chips. The number of memories 901 may be one or more. The memory 901 may include a ROM, a RAM, and a disk storage. The receiver 903 and the transmitter 904 may belong to a radio frequency system, and the receiver 903 and the transmitter 904 are configured to perform network communication with an external device, and specifically, may communicate with an external device through a network such as an Ethernet, a radio access network, or a wireless local area network. Receiver 903 and transmitter 904 may be physically separate components or may be physically identical components.

These memories 901, receivers 903, and transmitters 904 may be coupled to the processor 902 via a bus, or may be coupled to the processor 902 via dedicated connection lines, respectively.

By programming the processor 902, the code corresponding to the method shown above is solidified into the chip, thereby enabling the chip to perform the method shown in the previous embodiment while it is running. How to design and program the processor 902 is a technique known to those skilled in the art, and details are not described herein again.

In the embodiment of the present invention,

The memory 901 is configured to store an instruction required by the processor 902 to perform a task;

The processor 902 is configured to execute the instruction stored in the memory 901, and send the attribute information of the code stream to the media gateway by using the transmitter 904, where the attribute information of the code stream is used to determine the first code stream conversion information; the first code stream conversion information includes Converting type information and information of a mode converted by layer, the conversion type information including information of a code stream converted into a single layer encoding format by a code stream of a multi-layer encoding format;

The receiver 903 is configured to receive a code stream in a second format sent by the media gateway, where the code stream in the second format is obtained by converting, by the media gateway, a code stream in a first format received according to the first code stream conversion information.

Optionally, in another embodiment of the present invention,

The receiver 903 is further configured to: before the processor 902 sends the attribute information of the code stream to the media gateway through the transmitter 904, Receiving conversion capability information sent by the media gateway;

The processor 902 is further configured to: determine attribute information of the code stream according to the conversion capability information, where the attribute information of the code stream is used to indicate the first code stream conversion information;

Based on the same inventive concept and the foregoing embodiments, an embodiment of the present invention provides a media system, where the media system includes the media gateway and the conference center introduced in the foregoing embodiments.

In the media system, the media gateway implements code stream conversion, and the conference center can serve as a media sending end. When acting as a media sending end, the conference center sends the code stream to the media gateway, and the media gateway performs the code stream according to the method provided in the previous embodiment. After the conversion, the converted code stream is sent to the media receiving end. When the conference center is used as the media receiving end, the media gateway converts the code stream sent by the media sending end according to the method provided in the previous embodiment, and then sends the converted code stream to the conference center.

In the application, the conference center in the media system can be used only as the media sending end, or can be used only as the media receiving end, or can also serve as the media sending end and the media receiving end at the same time, which is not limited by the present invention.

The working process of the media system has been described in the previous embodiment.

In the media system, the media receiving end may send the attribute information of the code stream to the media gateway, so that the media gateway may determine the first code stream conversion information according to the attribute information of the code stream, and then perform code stream conversion according to the first code stream conversion information. The obtained code stream is sent to the media receiving end, so that the media receiving end can receive the code stream that can be recognized by the media, because the first code stream conversion information is determined by the media gateway through the attribute information of the code stream sent by the media receiving end, and thus the conversion The subsequent stream can be as close as possible to the needs of the media receiver.

The media receiving end can send the attribute information of the code stream to the media gateway to inform the media gateway of what kind of code stream it needs. The media receiving end has a strong initiative, and the received code stream has a high utilization rate. The media gateway can perform code stream conversion after considering the situation of the media receiving end, and can obtain the code stream required by the media receiving end as much as possible, and the media gateway has strong processing capability and high intelligence.

By providing a media system, the code stream can be converted, so that the converted code stream is as close as possible to the needs of the media receiving end. At the same time, the working mode of the media system is relatively simple. In practical applications, the scope of application can be relatively wide.

In the embodiment of the present invention, the code stream conversion information (that is, the first code stream conversion information) is provided, and after determining the first code stream conversion information, the media gateway may modify the layer-by-layer conversion mode information in the first code stream conversion information. The attribute information of the code stream sent by the media sending end, and notifying the media sending end of the modified attribute information, so that the media sending end sends the code stream of the first format to the media gateway according to the attribute information of the modified code stream, and the media sending The code stream sent by the terminal is also the code stream requested by the media gateway, which meets the requirements of the media receiving end, and the media gateway can directly convert the code stream of the first format into the second format. The code stream, the code stream of the second format is supported by the media receiving end, so the media receiving end can receive the code stream of the second format.

For example, the media sender sends the SVC format code stream, and the media receiver supports the AVC format code stream. The media gateway can convert the SVC format code stream into the AVC format code stream, and then the AVC format code. The stream is sent to the media receiver.

It will be clearly understood by those skilled in the art that for the convenience and brevity of the description, only the division of each functional unit described above is exemplified. In practical applications, the above function assignment can be completed by different functional units as needed. The internal structure of the device is divided into different functional units to perform all or part of the functions described above. For the specific working process of the system, the device and the unit described above, reference may be made to the corresponding process in the foregoing method embodiments, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit or unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application, in essence or the contribution to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium. , including a number of instructions to make a computer device (can be a A human computer, server, or network device, or the like, or a processor, performs all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

The above embodiments are only used to describe the technical solutions of the present application in detail, but the description of the above embodiments is only for helping to understand the method and the core idea of the present invention, and should not be construed as limiting the present invention. Those skilled in the art will be able to devise variations or alternatives within the scope of the present invention within the scope of the present invention.

Claims

A code stream sending method, comprising:

The media gateway receives the attribute information of the code stream sent by the media receiving end, and determines the first code stream conversion information according to the attribute information of the code stream; the first code stream conversion information includes a conversion type information and a layer-by-layer conversion mode. Information, the conversion type information including information of a code stream converted into a single layer encoding format by a code stream of a multi-layer encoding format;

The media gateway modifies the attribute information of the code stream sent by the media sending end to the attribute information sent by the media receiving end according to the information of the layer-by-layer mode, and sends the modified attribute information to the media sending end. ;

The media gateway receives the code stream of the first format sent by the media sending end, and converts the code stream of the first format into a code stream of the second format; the code stream of the first format is the media The sending end is sent according to the modified attribute information, where the first format is a multi-layer encoding format, and the second format is a single-layer encoding format;

The media gateway sends the code stream of the second format to the media receiving end.
The method according to claim 1, wherein the information of the code stream converted into the single layer encoding format by the code stream of the multi-layer encoding format comprises: information converted from the scalable video encoding SVC format to the advanced video encoding AVC format. At least one of information converted from the scalable high-efficiency video coding SHVC format to the AVC format, and information converted from the scalable high-efficiency video coding SHVC format to the high-efficiency video coding HEVC format.
The method according to claim 1 or 2, wherein the information of the layer-by-layer conversion mode comprises information converted according to a preset level;

The media gateway receives the code stream in the first format sent by the media sending end, and includes:

The media gateway receives the code stream of the preset level sent by the media sending end, and the format of the code stream of the preset level is the first format.
The method of claim 3, wherein converting the code stream of the first format to the code stream of the second format comprises:

Converting the code stream of the preset level into a code stream of the second format.
The method according to claim 3, wherein the first code stream conversion information further comprises conversion level information, which is: extracting information of a data packet related to a frame rate;

Converting the code stream of the first format into a code stream of the second format, including:

Extracting, according to the conversion level information, a data packet related to a frame rate from a code stream of the preset level;

The extracted frame rate related data packet is converted into the code stream of the second format.
The method according to claim 3, wherein the first code stream conversion information further comprises conversion level information, which is: extracting information of the data packet related to the resolution;

Converting the code stream of the first format into a code stream of the second format, including:

Extracting, according to the conversion level information, a resolution-related data packet from the code stream of the preset level;

The extracted resolution-related data packet is converted into the code stream of the second format.
The method according to any one of claims 1-6, wherein determining the first code stream conversion information according to the attribute information of the code stream comprises:

Determining, according to the attribute information of the code stream and the conversion capability information, the first code stream conversion information;

The attribute information of the code stream is used to indicate attribute information of a code stream supported by the media receiving end; or the attribute information of the code stream is used to indicate the first code stream conversion information;

The conversion capability information includes the conversion type information and the information of the layer-by-layer conversion mode, and the information of the layer-by-layer conversion mode includes information converted according to a preset level.
The method of claim 7, wherein the conversion capability information further comprises conversion level information; wherein:

The conversion level information includes: extracting information of a data packet related to a frame rate, or extracting information of a data packet related to the resolution.
A media gateway, comprising:

a determining module, configured to receive attribute information of a code stream sent by the media receiving end, and determine first code stream conversion information according to the attribute information of the code stream; the first code stream conversion information includes conversion type information and layer by layer Information of the converted mode, the conversion type information including information of a code stream converted into a single layer encoding format by a code stream of a multi-layer encoding format;

a change module, configured to modify attribute information of the code stream sent by the media sending end to the attribute information sent by the media receiving end according to the information of the layer-by-layer conversion mode, and send the modified attribute information to the media to send end;

a conversion module, configured to receive a code stream in a first format sent by the media sending end, and convert the code stream in the first format into a code stream in a second format; The media sending end is sent according to the modified attribute information, where the first format is a multi-layer encoding format, and the second format is a single-layer encoding format;

And a sending module, configured to send the code stream in the second format to the media receiving end.
The media gateway according to claim 9, wherein the information of the code stream converted into the single layer coding format by the code stream of the multi-layer coding format comprises: converting from the scalable video coding SVC format to the advanced video coding AVC format. The information, the information converted from the scalable high-efficiency video coding SHVC format to the AVC format, and the information converted from the scalable high-efficiency video coding SHVC format to the high-efficiency video coding HEVC format.
The media gateway according to claim 9 or 10, wherein the information of the layer-by-layer conversion mode comprises information converted according to a preset level;

The converting module is configured to receive the code stream in the first format sent by the media sending end, and specifically includes:

And receiving, by the media sending end, the code stream of the preset level, where the format of the code stream of the preset level is the first format.
The media gateway according to claim 11, wherein the converting module is configured to convert the code stream of the first format into a code stream of the second format, and specifically includes:

Converting the code stream of the preset level into a code stream of the second format.
The media gateway according to claim 11, wherein the first stream conversion information further comprises conversion level information, which is: extracting information of a data packet related to a frame rate;

The converting module is configured to convert the code stream in the first format into a code stream in the second format, and specifically includes:

Extracting, according to the conversion level information, a data packet related to a frame rate from a code stream of the preset level;

The extracted frame rate related data packet is converted into the code stream of the second format.
The media gateway according to claim 11, wherein the first code stream conversion information further comprises conversion level information, which is: extracting information about a resolution-related data packet;

The converting module is configured to convert the code stream in the first format into a code stream in the second format, and specifically includes:

Extracting, according to the conversion level information, a resolution-related data packet from the code stream of the preset level;

The extracted resolution-related data packet is converted into the code stream of the second format.
The media gateway according to any one of claims 9-14, wherein the determining module is configured to determine, according to the attribute information of the code stream, the first code stream conversion information, which specifically includes:

Determining, according to the attribute information of the code stream and the conversion capability information, the first code stream conversion information;

The attribute information of the code stream is used to indicate attribute information of a code stream supported by the media receiving end; or the attribute information of the code stream is used to indicate the first code stream conversion information;

The conversion capability information includes the conversion type information and the information of the layer-by-layer conversion mode, and the information of the layer-by-layer conversion mode includes information converted according to a preset level.
The media gateway according to claim 15, wherein said conversion capability information further comprises conversion level information; wherein:

The conversion level information includes: extracting information of a data packet related to a frame rate, or extracting information of a data packet related to the resolution.
A media receiving end, comprising:

a sending module, configured to send attribute information of the code stream to the media gateway, where the attribute information of the code stream is used to determine the first code stream conversion information; the first code stream conversion information includes conversion type information and layer-by-layer conversion Mode information, the conversion type information including information of a code stream converted into a single layer encoding format by a code stream of a multi-layer encoding format;

a receiving module, configured to receive a code stream of a second format sent by the media gateway, where the code stream of the second format is a code stream of the first format received by the media gateway according to the first code stream conversion information Converted to get.
The media receiving end according to claim 17, wherein the information of the code stream converted into the single layer encoding format by the code stream of the multi-layer encoding format comprises: converting from the scalable video encoding SVC format to the advanced video encoding AVC format. The information, the information converted from the scalable high-efficiency video coding SHVC format to the AVC format, and the information converted from the scalable high-efficiency video coding SHVC format to the high-efficiency video coding HEVC format.
The media receiving end according to claim 17 or 18, wherein the media receiving end further comprises a determining module;

The receiving module is further configured to: receive, before the sending module sends the attribute information of the code stream to the media gateway, Conversion capability information sent by the media gateway;

The determining module is configured to: determine attribute information of the code stream according to the conversion capability information, where the attribute information of the code stream is used to indicate the first code stream conversion information;

The conversion capability information includes the conversion type information and the information of the layer-by-layer conversion mode, and the information of the layer-by-layer conversion mode includes information converted according to a preset level.
The media receiving end according to claim 19, wherein said conversion capability information further comprises conversion level information; wherein:

The conversion level information includes: extracting information of a data packet related to a frame rate, or extracting information of a data packet related to the resolution.