CN114302353A

CN114302353A - Media negotiation method, communication device and readable storage medium

Info

Publication number: CN114302353A
Application number: CN202111664710.0A
Authority: CN
Inventors: 侯冠军
Original assignee: China Mobile Communications Group Co Ltd; MIGU Music Co Ltd; MIGU Culture Technology Co Ltd
Current assignee: China Mobile Communications Group Co Ltd; MIGU Music Co Ltd; MIGU Culture Technology Co Ltd
Priority date: 2021-12-31
Filing date: 2021-12-31
Publication date: 2022-04-08
Anticipated expiration: 2041-12-31
Also published as: CN114302353B

Abstract

The invention provides a media negotiation method, communication equipment and a readable storage medium, which belong to the technical field of communication, wherein the media negotiation method applied to first communication equipment comprises the following steps: sending offer information aiming at a target service to second communication equipment, wherein the offer information comprises information of each media format of each form of media in each media stream related to the target service and grouping information of the media formats, the grouping information can indicate the corresponding relation of each media format of each form of media in each media stream related to the target service, and the corresponding relation is determined by the target service; and receiving response information sent by the second communication equipment according to the offer information. The invention can quickly negotiate the media negotiation result meeting the service requirement.

Description

Media negotiation method, communication device and readable storage medium

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a media negotiation method, a communication device, and a readable storage medium.

Background

The current media negotiation method is generally a way of negotiating respectively for each media type or each form of media, but the result negotiated by such a negotiation way sometimes cannot satisfy the service requirement. For example, in a video color ring back tone service, an audio encoding format and a video encoding format in a media file of video color ring back tone content are fixed, that is, there is a corresponding relationship between the two, and if a way of negotiating the audio media stream capability and the video media stream capability respectively is adopted, the corresponding relationship cannot be transmitted and expressed in the negotiation process. This easily causes the problem that the audio media format and the video media format in the negotiation result do not correspond to the media file of the video color ring back tone content to be played. Especially, under the condition that the audio coding format and the video coding format in the media file of the video color ring back tone content are respectively multiple, the probability that the negotiated result can not satisfy the playing of the media file of the video color ring back tone content is higher.

Disclosure of Invention

In view of the above, the present invention provides a media negotiation method, a communication device and a readable storage medium, which are used to solve the problem that the negotiation result is easily unable to meet the service requirement in the current media negotiation manner in which media of various media types or media of various forms are respectively negotiated.

To solve the above technical problem, in a first aspect, the present invention provides a media negotiation method applied to a first communication device, including:

sending offer information aiming at a target service to second communication equipment, wherein the offer information comprises information of each media format of each form of media in each media stream related to the target service and grouping information of the media formats, the grouping information can indicate the corresponding relation of each media format of each form of media in each media stream related to the target service, and the corresponding relation is determined by the target service;

and receiving response information sent by the second communication equipment according to the offer information.

In a second aspect, the present invention further provides a media negotiation method, applied to a second communication device, including:

receiving offer information aiming at a target service, which is sent by first communication equipment, wherein the offer information comprises information of each media format of each form of media in each media stream related to the target service and grouping information of the media formats, the grouping information can indicate a corresponding relation of each media format of each form of media in each media stream related to the target service, and the corresponding relation is determined by the target service;

generating response information according to the grouping information of the media formats, wherein the response information comprises the media formats required to be responded in each grouping;

and sending the response information to the first communication equipment.

In a third aspect, the present invention further provides a media negotiation configuration method, applied to a first communication device, including:

sending configuration information to the second communication device; alternatively, the first and second electrodes may be,

receiving configuration information sent by second communication equipment;

wherein the configuration information comprises a grouping configuration information set and a media format configuration information set;

the grouping configuration information set and the media format configuration information set are used for indicating each media format of each form of media in each media stream related to the target service and grouping information of the media format;

the grouping information can indicate the corresponding relation of each media format of each form of media in each media stream related to the target service, and the corresponding relation is determined by the target service.

In a fourth aspect, the present invention further provides a first communication device, including:

an offer sending module, configured to send offer information for a target service to a second communication device, where the offer information includes information of each media format of each type of media in each media stream related to the target service and grouping information of the media formats, and the grouping information can indicate a correspondence relationship between each media format of each type of media in each media stream related to the target service, where the correspondence relationship is determined by the target service;

and the response receiving module is used for receiving response information sent by the second communication equipment according to the offer information.

In a fifth aspect, the present invention further provides a second communication device, including:

an offer receiving module, configured to receive offer information for a target service, sent by a first communication device, where the offer information includes information of each media format of each type of media in each media stream related to the target service and grouping information of the media formats, and the grouping information can indicate a correspondence relationship between each media format of each type of media in each media stream related to the target service, where the correspondence relationship is determined by the target service;

the response generating module is used for generating response information according to the grouping information of the media formats, and the response information comprises the media formats which need to be responded in each grouping;

and the response sending module is used for sending the response information to the first communication equipment.

In a sixth aspect, the present invention further provides a first communication device, including:

the configuration sending module is used for sending configuration information to the second communication equipment; alternatively, the first and second electrodes may be,

the configuration receiving module is used for receiving configuration information sent by the second communication equipment;

In a seventh aspect, the present invention further provides a communication device, including a memory, a processor, and a program stored in the memory and executable on the processor; the processor, when executing the program, performs the steps of the method of the first, second or third aspect.

In an eighth aspect, the present invention also provides a readable storage medium, on which a program is stored, which program, when executed by a processor, performs the steps in the method of the first, second or third aspect.

The technical scheme of the invention has the following beneficial effects:

in the embodiment of the present invention, a packet negotiation mechanism is superimposed on the basis of a basic media negotiation scheme, and specifically, an offer party carries packet information of a media format determined according to a service correspondence of a target service in offer information to transmit a correspondence of each media format of each form of media in each media stream related to the target service in the target service to a response party. Alternatively, the grouping information may be configured in advance. The responder can generate a response result which can meet the service corresponding relation of the target service according to the grouping information, thereby meeting the service requirement that the corresponding relation exists on the service among the media formats of the media in various forms in the target service and the negotiation result needs to be synchronized in the negotiation result according to the requirement of keeping the corresponding relation through one-time negotiation. Moreover, the negotiation is completed quickly in a convergence manner, so that the service negotiation delay is greatly saved, the error probability caused by repeated negotiation is avoided, the timeliness and the success rate of the service reaching the user are ensured, and the service experience of the user is improved; the negotiation is completed through rapid convergence, a large amount of contents are not manufactured, transcoding playing is not involved, the service experience is best, meanwhile, the system support requirement is reasonable, and the cost of the contents manufacturing and quality control, the contents storage equipment, the media playing equipment and the like is lowest; the playing content is quickly negotiated and accurately approved, and the content only needs to make fewer high-quality standard media files according to the service requirement, so that the high-quality files can be guaranteed to be played according to the terminal and network conditions; the service experience is best, the content management is flexible, the service operation can be focused, and the sustainable development can be realized; the method has the advantages that the played content is quickly and accurately approved through negotiation, network resources and bandwidth are accurately applied according to needs, and waste of the network resources and network impact caused by first virtual height and multiple negotiations are avoided.

Drawings

Fig. 1 is a schematic diagram of a video color ring media negotiation process under a Precondition process;

fig. 2 is a flowchart illustrating a media negotiation method according to a first embodiment of the present invention;

fig. 3 is a flowchart illustrating a media negotiation method according to a second embodiment of the present invention;

fig. 4 is a flowchart illustrating a media negotiation configuration method according to a third embodiment of the present invention;

fig. 5 is a flowchart illustrating a media negotiation configuration method according to a fourth embodiment of the present invention;

fig. 6 is a flowchart illustrating a media negotiation method according to a fifth embodiment of the present invention;

fig. 7 is a schematic structural diagram of a first communication device in a sixth embodiment of the present invention;

fig. 8 is a schematic structural diagram of a second communication device in a seventh embodiment of the present invention;

fig. 9 is a schematic structural diagram of a media negotiation system in an eighth embodiment of the present invention;

fig. 10 is a schematic structural diagram of a first communication device in a ninth embodiment of the present invention;

fig. 11 is a schematic structural diagram of a first communication device in a tenth embodiment of the present invention;

fig. 12 is a schematic structural diagram of a communication device in an eleventh embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the drawings of the embodiments of the present invention. It is to be understood that the embodiments described are only a few embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the invention, are within the scope of the invention.

In the related art, in the field of communication services such as audio and video calls and related audio and video color ring, audio and video notification, media negotiation such as audio and video is usually performed based on a Session Description Protocol (SDP) offer/answer model, and a service side and a terminal side negotiate media capabilities such as audio and video, respectively, so as to play service media contents such as call, audio and video color ring.

Taking the color ring media negotiation of the video color ring AS an example, the negotiation flow refers to fig. 1, where in an SDP offer carried by a first Update (Update) message that a color ring service platform (CAT AS, Customized Alerting Tone Application Server) initiates the video color ring media negotiation to a calling terminal (UE-a), a video media stream description and an audio media stream description generally carry only media format capability description information lines (PT lines) of each payload type (payload type) of H264/CBP (restricted base line configuration) video coding and broadband Adaptive Multi-Rate voice (AMR-WB, Adaptive Multi Rate-Wide Band) audio coding, respectively, and the terminal responds according to the audio and video media capability conditions thereof, respectively, to determine a final video media negotiation result. That is, the media negotiation scheme applied by the current color ring application inherits the existing basic SDP offer/answer model media negotiation scheme, and the media negotiation scheme is mainly designed for the session service scenes between the user equipments such as audio and video calls, and in these service scenes, the user equipments of the participating parties generally have the audio and video input and output capabilities and the real-time audio and video encoding and decoding capabilities, so that the method for negotiating the audio and video encoding capabilities respectively between the participating parties can meet the requirements of the service scenes such as the audio and video calls.

In the application of the color ring back tone service, a platform generally plays a media file of color ring back tone content to a terminal, and an audio coding format and a video coding format in the media file are both fixed, that is, a corresponding relationship exists between the audio coding format and the video coding format, but because a media negotiation scheme of the current color ring back tone application inherits an existing basic media negotiation scheme, a mechanism for respectively negotiating audio and video media stream capabilities cannot indicate the corresponding relationship in an SDP (service data set) and cannot apply the corresponding relationship to a response processing requirement of a response party, a function of quickly completing the media negotiation capable of expressing the corresponding relationship cannot be realized, and the function has obvious limitation.

In the initial stage of service development, due to the limitations of terminal and network factors, the audio and video coding formats of the media file are fixed, the coding capability requirement is fixed, and the corresponding relation is unique. Therefore, under the background of correspondingly stipulating the coding and decoding capability and the media negotiation requirement through the specification, the media negotiation (hereinafter, referred to as "color ring media negotiation" for short) of the color ring application adopts the fixed audio and video media stream coding and decoding capability for negotiation, and can meet the initial service requirement.

However, with the upgrading of terminals, networks and audio and video encoding and decoding technologies and the spreading of new audio and video encoding standards, in order to improve the service experience of the application of the color ring back tone service and cope with the impact of the increasing bandwidth requirements on the networks brought by the improvement of the service experience, the media files of the color ring back tone content also need to introduce new audio and video encoding standards to manage the media file production standard and the production specification ("the media file production specification" is simply referred to as "specification", the same below). Correspondingly, the color ring media negotiation scheme also needs to increase the support for negotiation of the coding and decoding capabilities of the new audio and video coding standard formats.

The polyphonic ringtone application service platform needs to construct a polyphonic ringtone media negotiation SDP offer according to all audio and video coding capability requirements contained in the media files of all contents which are possibly to be played, and finally, after the polyphonic ringtone media negotiation is completed, the media files of the contents which meet the audio and video coding and decoding capability requirements of the negotiation result are selected according to the negotiation result to be played to the user terminal equipment. Correspondingly, payload type media format description information lines (abbreviated as "PT lines") of multiple coding standards need to be introduced into the audio and video media stream descriptions of the polyphonic ringtone media negotiation SDP offer, respectively.

Under this background, if the mechanism of separately negotiating the audio and video media capabilities is continuously used to perform media negotiation processing, the media negotiation result requirement that the first negotiation handshake cannot complete the service layer will probably occur at a high rate, that is, the problem that the playable content media file cannot be selected according to the result of separately negotiating the audio and video media capabilities will occur, and the following effects will occur:

first, if media files of all specifications are not made for each piece of content, but a way of renegotiation or transcoding playing is adopted to solve the problem, user service experience and network bandwidth resource waste are obviously affected, or huge cost is brought and user service experience is affected. Namely:

the playing delay of the color ring back tone service is sensitive, and the time consumption of media negotiation needs to be reduced as much as possible. If the polyphonic ringtone platform combines the content media files, and adds the capability of another media to perform secondary handshake negotiation according to the negotiation result of one media in the negotiation result, the problem that handshake negotiation needs to be continued may still occur, even the negotiation is unsuccessful, thereby significantly affecting the service experience of the user. In addition, each negotiation, the terminal applies for resources and bandwidth to the network according to the negotiation result, initially defaults to apply for the resources and the bandwidth according to the higher coding and decoding capability requirement supported by the service, and negotiations are carried out for multiple times, so that impact on the network due to high bandwidth requirements can be brought, or impact and waste on the network processing capability due to the operation of applying for the resources and the bandwidth required by the negotiations for multiple times can be caused, and the possibility of processing problems can be increased, so that the network is impacted, the network resources are wasted, and the service experience is influenced. Furthermore, in this mechanism, the problem becomes more pronounced in the case where two or more media or multiple media are present.

The playing amount of the color ring back tone service is huge, and transcoding needs to be avoided to reduce the performance requirement of the system. If the color ring back tone platform performs transcoding playing according to the negotiation result, the audio and video transcoding processing can improve the performance requirement of the system by tens of times, thereby bringing great cost, and meanwhile, the time delay and quality loss introduced by transcoding playing and the playing effect are not better than that of the optimal content media file playing without transcoding selected by the user, which all affect the service experience of the color ring back tone.

Secondly, if the problems are solved by adopting a mode of manufacturing and distributing media files of all specifications for each piece of content instead of sending renegotiation or transcoding playing by the color ring platform, the manufacturing and storage costs are high, the optimal content playing cannot be selected for the user, sustainable development cannot be achieved, and the like, and actual operability is not achieved. Namely:

the content volume of the polyphonic ringtone service is huge, and with the application of a new audio and video coding standard, the number of content media file production specifications with different audio and video coding and capacity requirements is large in the future and can be increased all the time. Therefore, the way of creating and distributing media files of all specifications for each piece of content can bring huge creation and storage costs, and although the scheme can theoretically ensure that specific content can always be played when negotiation is successful, the scheme is limited by the technical characteristics of the content, the video quality of the media files of various specifications can be different, and the service playing effect is not better than the implementation way of selecting corresponding media files which meet the negotiation result and only provide appropriate alternative content of a small number of standard media files.

In addition, the scheme can not well solve the problem of sustainable development caused by additionally manufacturing new-specification media files for old contents when the media file manufacturing specifications required by the audio and video coding and decoding capacity are newly added, so that the scheme also has no practical operability.

In summary, for the media negotiation of the current color ring back tone service, if the requirement of the multi-PT media negotiation is not introduced, the development of the application and service of the new technology is hindered. If the requirement of multi-PT media negotiation is introduced, but the scheme of respectively negotiating the media capabilities under different media streams is not changed, the problems of cost, service experience, network resource waste, network impact, service management and the like can be caused.

Of course, the above-mentioned problems exist in the media negotiation process of more than video polyphonic ring tones, and also exist in other media negotiation processes such as audio and video calls if there is a business correspondence between media types or media in different forms.

Referring to fig. 2, fig. 2 is a flowchart illustrating a media negotiation method according to an embodiment of the present invention, where the method is applied to a first communication device, and includes the following steps:

step 21: sending offer information aiming at a target service to second communication equipment, wherein the offer information comprises each media format information of each form of media in each media stream related to the target service and grouping information of the media formats, the grouping information can indicate the corresponding relation among each media format of each form of media in each media stream related to the target service, and the corresponding relation is determined by the target service;

step 22: and receiving response information sent by the second communication equipment according to the offer information.

The grouping table group rule in the embodiment of the application is as follows:

for each media stream description of the same or different media types in the SDP, the grouping rule of payload type media capability description lines (abbreviated as "PT lines", the same below) of the respective media of the same or different form is:

1) wherein all PT rows of different media with same or different forms and common corresponding relation under the description of each media stream of all same or different media types are all programmed into a group expressing corresponding common corresponding relation or a plurality of groups equivalent to the group, and each PT row forms a group under the group according to the media stream and the media stream with different forms. That is, each PT row having a common correspondence relationship should be grouped into one packet, or logically grouped into one packet and then divided into a plurality of PT rows corresponding to any media of some form under description of any media stream to group into different packets, and the corresponding packet is further divided into a plurality of packets by an equivalent combination and division method, and so on, and divided into more packets. (principle of grouping)

For example (example 1): in the service, a PT line corresponding to H264/CHP coding under the description of a certain video (video) media stream, a PT line corresponding to H264/CBP coding, a PT line corresponding to AMR-WB coding under the description of a certain audio (audio) media stream, and a PT line corresponding to a telephone-event telephone event form have a common corresponding relationship, and then the PT lines are grouped into a group, wherein the first two PT lines serve as a group, the third PT line serves as a group, and the fourth PT line serves as a group. Or equivalently, the PT line corresponding to the H264/CHP coding under the description of the video media stream, the PT line corresponding to the AMR-WB coding under the description of the audio media stream, and the PT line corresponding to the telephone-event telephony event form are organized into a packet, and the PT line corresponding to the H264/CBP coding under the description of the video media stream, the PT line corresponding to the AMR-WB coding under the description of the audio media stream, and the PT line corresponding to the telephone-event telephony event form are organized into a packet, wherein three PT lines in the two packets respectively serve as a small group.

2) If there is no corresponding relationship between all PT lines of a certain form of media (such as AMR-WB coding) described by a certain media stream of a certain media type (video or audio), all PT lines of the form of media may not be grouped, or may be regarded as having independent corresponding relationship, but be grouped as a group as a whole, or be logically grouped as a group and then be grouped into different groups by splitting all PT lines of the form of media, and then all existing groups are further split into a plurality of groups by an equivalent combination splitting method, and by analogy, split into more groups.

In addition, it can also impose the corresponding relation with other groups, and integrate it into all the existing groups, or logically integrate into all the existing groups, and then split all the PT rows of the media in the form to integrate into different groups, and then split all the existing groups into multiple groups by the equivalent method of combining and splitting, and so on, and split into more groups.

For example (example 2): assuming that there is no correspondence between the PT line in the form of telephone-event telephony event described in example 1 and all other PT lines, the PT line may not be grouped or may be independently grouped, but the PT line in the form of telephone-event telephony event described in the example 1 may be grouped into one packet, i.e., the PT line in the form of H264/CHP code, the PT line in the form of H264/CBP code, the PT line in the form of AMR-WB code, and the PT line in the form of telephone-event telephony event described in the example 1. Or equivalently, the PT line corresponding to the H264/CHP coding under the description of the video media stream, the PT line corresponding to the AMR-WB coding under the description of the audio media stream, and the PT line corresponding to the telephone-event telephony event form are grouped into one packet, and the PT line corresponding to the H264/CBP coding under the description of the video media stream, the PT line corresponding to the AMR-WB coding under the description of the audio media stream, and the PT line corresponding to the telephone-event telephony event form are grouped into one packet.

3) If a PT line or PT lines of a certain form of media (e.g., H265/MP code) under a certain media stream description of a certain media type (video or audio) needs to be grouped due to correspondence with one or more PT lines of another form of media under a certain same or other media stream description, all PT lines under the certain form of media must be grouped into a certain packet or packets expressing the correspondence for confirming the actually determined correspondence, and the packets are each split into a plurality of peer-to-peer packets in an equivalent splitting manner. In other words, if some not-grouped PT lines in the formal media are not grouped, their associated various correspondences cannot be presented normally due to the restriction caused by the grouping restriction of the grouped PT lines in the same formal media, and they cannot be used by the service even if they are present in the SDP under the corresponding formal media, i.e. they should not be present in the corresponding media if they are not grouped, and they should be ignored in subsequent negotiations if they are present.

For example (example 3): in the service SDP, the unique video media stream description contains H265/MP coded PT lines, H264/CHP coded PT lines and H264/CBP coded PT lines, and the unique audio media stream description contains EVS coded PT lines, AMR-WB coded PT lines and PT lines corresponding to telephone-event telephone event forms. If the H264/CHP encoded PT line, the H264/CBP encoded PT line and the AMR-WB encoded PT line are grouped into one packet, then the H265/MP encoded PT line of the same-format media stream, the EVS encoded PT line of the same-format media stream, respectively, of the audio media stream, should be correspondingly presented with their respective possible correspondence, which may be the case if the H265/MP encoded PT line and the EVS encoded PT line, the AMR-WB encoded PT line together form one packet, and the packet needs to be preferred over the previous packet. Also, AMR-WB encoded PT lines under audio-only media streams must also be grouped separately to represent this correspondence, since they cannot appear alone in the negotiation result as needed because they have already been included in the preamble two packets to be used independently in the context of traffic downgrade to audio. In addition, since no PT line in the form of a telephone-event telephony event in an audio media stream is grouped, the PT line does not necessarily have to correspond to the PT line of the audio/video media in service, and thus should be handled as in example 2.

Optionally, the grouping information further includes ordering information, where the ordering information is used to indicate, but not limited to, the following precedence preference order, and the precedence preference order is determined by the target service:

in the grouping information of the media format, the priority order among the groups indicated by the sorting information among the groups belonging to the same non-mutually independent group set;

the priority order among the formal media indicated by the sorting information among the formal media groups in the grouping of the media format;

the priority order among the media formats indicated by the sorting information among the media formats in the formal media groups in the grouping of the media formats;

wherein one of said packets is capable of forming a direct non-mutually independent relationship with another of said packets due to at least one formal media subgroup thereof being identical to said other of said packets, or one of said packets is capable of forming an indirect non-mutually independent relationship with another of said packets not having a direct non-mutually independent relationship therewith via one or more of said packets having a direct non-mutually independent relationship with each other; non-independent relationships, i.e., non-independent relationships;

all of said packets having these direct and indirect non-mutually independent relationships collectively comprise said set of non-mutually independent packets;

one of the non-mutually independent packet sets logically corresponds to a relatively independent service domain; the relatively independent service domain is also called a service domain;

the grouping information of the media format includes the grouping in one or more non-mutually independent grouping sets, and the correspondence relationship is that the correspondence relationship in one or more service domains in which the one or more non-mutually independent grouping sets respectively correspond one to one.

The formal media group is a group consisting of all media formats belonging to the same formal media in the same media stream in one of the packets.

In the grouping information of the media format, the groups which do not have direct and indirect non-mutually independent relations belong to different non-mutually independent group sets, and the groups which belong to the different non-mutually independent group sets have mutually independent relations; independent relationships among each other, that is, independent relationships among each other;

in the grouping information of the media format, the relative ordering among the groups with the mutually independent relationship does not indicate the precedence preference order among the groups, so that the relative ordering among the groups can be freely adjusted without reference when the groups are respectively processed; the corresponding relations in different service domains in the corresponding relations are logically relatively independent, and the priority order determined by the target service does not exist.

The precedence preference order among the packets of the set of non-mutually independent packets is a first dimension for indicating an outermost preference relationship; the precedence preference order among the formal media sub-groups in the grouping is in a second dimension and is used for indicating the preference relationship of each intermediate layer in the outermost layer; the precedence preference sequence among the media formats in the formal media group is in a third dimension and is used for indicating the preference relationship of the innermost layer in each intermediate layer in the outermost layer;

and in the non-mutually independent grouping concentration, part or all of the first dimension precedence preference relations can be equivalently converted into third dimension precedence preference relations. When all first-dimension preference relationships in one non-mutually independent grouping set can be equivalently converted into a third-dimension precedence preference relationship, namely when only one grouping exists in the non-mutually independent grouping set after conversion, the non-mutually independent grouping set in form does not have the first-dimension precedence preference relationship, and when each non-mutually independent grouping set in the grouping information in form does not have the first-dimension precedence preference relationship, the grouping information in form does not have the first-dimension precedence preference relationship; when a plurality of said packets exist in one said non-mutually independent packet set, there is a first dimension precedence preference relationship in said non-mutually independent packet set and said packet information formally;

when one non-mutually independent grouping set only has an independent grouping or the grouping equivalent to the independent grouping, formally the non-mutually independent grouping set does not have a second dimension precedence preference relationship, and when each non-mutually independent grouping set in the grouping information has no second dimension precedence preference relationship, formally the grouping information does not have a second dimension precedence preference relationship; when a plurality of groups exist in one non-mutually independent group set, the non-mutually independent group set and the group information have a second dimension precedence preference relationship in form;

when one of the non-mutually independent grouping sets only has an independent grouping and only has one media in the media group with the unique form, the non-mutually independent grouping set formally has no third-dimensional precedence preference relationship, and when each non-mutually independent grouping set in the grouping information formally has no third-dimensional precedence preference relationship, the grouping information formally has no third-dimensional precedence preference relationship; when more than one media format in the media formats of the media in the forms of the media streams of the target service related to the grouping in one non-mutually independent grouping set belongs to the same form of media, a third-dimensional precedence preference relationship exists among the non-mutually independent grouping set and the grouping information in the form.

All media formats of a formal media in a media stream related to all the packets in one non-mutually independent packet set are all media formats of the formal media in a corresponding media stream related to the target service.

The packet ordering rule in the embodiment of the invention is as follows:

the ordering rule for all the packets grouped according to the service in the SDP offer, the various formal media groups in the packets, and the various payload type media capability description lines (abbreviated as "PT lines", the same below) of the various formal media groups in the packets is as follows:

1) the PT row packets in the SDP are in a one-dimensional sequence structure (the PT row packets are in an arrangement relationship), and each packet is used for representing the corresponding relationship among the PT rows of some media or some media types related under some media stream description supported by one service; the PT line grouping is a two-layer structure, the first layer is a one-dimensional sequence structure of each form of media described by different or same media streams in the grouping (the combination relationship among the media in each form is an arrangement relationship), and the second layer is a one-dimensional sequence structure of each PT line of each form of media (the arrangement relationship among the PT lines of each form of media);

2) and sequencing the packets according to the precedence preference sequence of the 'PT line combination set' of the packets indicated by the corresponding relation among the PT lines of the media in various forms under the description of the media streams represented by the packets relative to the 'PT line combination set' of all the packets in the SDP applied to the service. Wherein:

the grouped 'PT line combination set' refers to that a PT line is taken from each PT line under each form of media in the group, and combined together according to the order of each form of media group to obtain a 'PT line combination' (which may be the result of media negotiation response on the responder), and so on, and the set of all possible 'PT line combinations' of the group is the so-called grouped 'PT line combination set'.

In processing, if the preference relationship of a partial subset of the "PT row combination set" of a packet is higher than that of partial subsets or all of the "PT row combination set" of other packets, and the preference relationship of the partial subset is lower than that of the partial subsets or all of the "PT row combination set" of other packets, it is necessary to perform equivalent splitting on related packets, adjust relative ordering, and so on until the precedence order of each packet and its corresponding "PT row combination set" is consistent with the precedence preference order in the service.

3) And ordering the media form groups described by different or same media streams in the grouping according to the order of the media form groups to which the PT rows belong, which is calculated according to the order of precedence preference of the PT rows in the PT row combination set of the grouping by the service. The preferred location of the subgroup of forms of media in the group can also be determined generally according to a preferred strategy established by the service for each form of media in the group, such as service definition "video form media preferred over audio form media with audio and then preferred over subtitle form media with subtitles". The preceding formal media subgroup in the group is in a preferred position, followed by a next preference, and so on, until the last formal media subgroup, with the lowest preference level, is ranked.

4) And sequencing each PT row of each grouped media group according to the sequence of the PT rows calculated by the sequence preference sequence of each PT row combination in the PT row combination set of the service pair group. In general, in order to be compatible with devices that do not support packet negotiation, the priority order of the PT lines of each formal media group is defaulted to be consistent with the order of the PT lines of each formal media under the description of the corresponding media stream in the SDP. The PT row ranked first in the formal media subgroup is in the preferred position, followed by the next preference, and so on until the PT row ranked last, with the lowest preference level.

In processing, for a 'PT group combination set' of packets obtained by calculating the packet order, the order of each 'PT group combination' in the 'PT group combination set' needs to be determined according to the service relation, and for a 'PT group combination' that needs to have the same form of media set and the service order is adjacent, the operation of equivalently combining the corresponding 'PT group combination' into packets according to the service order can be performed according to the meaning of the preferred relation of the PT groups under each form of media in the packets, and after the processing is completed, the order of each packet and each form of media group therein and the order of each PT group in each form of media can be determined.

5) All PT lines of media in various forms under various media stream descriptions in the SDP are respectively and independently organized into a group or organized into a plurality of groups equivalent to the group, and the PT lines of the corresponding media in the PT line groups and/or the PT line groups are ordered according to the same sequence of various media stream descriptions, various media in various forms, various PT lines under various media in various forms and the like in the SDP, so that the grouping and the non-grouping are completely equivalent.

6) The preference relationship of each formal media and the preference relationship of PT rows under each formal media in the group means that the application order of the negotiation results is that after selecting a PT row under the formal media group at the relatively preferred position and selecting a PT row under the formal media group at the relatively less selected position immediately thereafter, if the combination of the two cannot be applied, it is necessary to replace a PT under the formal media group at the relatively less selected position, confirm whether the PT can be applied after the combination, and so on, if the PT cannot be applied all the time, only when the next PT selectable under the formal media group at the relatively less selected position is used for the combination, it is possible to replace the next PT under the formal media group at the relatively preferred position, and continue to select PT under the formal media group at the relatively less selected position from the front to the back in order, the PT group is applied and so on, until a combination that can be applied is obtained, or until the traversal is completed and no combination that can be applied is found.

Optionally, before the step of sending offer information for the target service to the second communication device, the method further includes:

and grouping and sequencing the media formats of the media in various forms in the media streams related to the target service according to the corresponding relation and the sequence preference order to obtain the grouping information, wherein the grouping information comprises the grouping and the sequencing information.

Optionally, the step of grouping and sorting the media formats of the media of different forms in the media streams related to the target service according to the correspondence and the precedence preference order includes:

compiling the media formats with the same corresponding relation into one group or a plurality of groups equivalent to the group;

the groupings include individual correspondence groupings and multi-correspondence groupings.

Wherein the content of the first and second substances,

the media formats with the same corresponding relation are at least partial media formats of one or more types of media in each media stream related to the target service corresponding to the media formats;

the situation of at least part of the media formats of one form of media in the corresponding media streams is called as an individual corresponding relationship, and the correspondingly compiled groups are called as individual corresponding relationship groups, namely individual groups;

the situation of corresponding to at least part of the media formats of two or more types of media in each media stream is called non-individual correspondence or multivariate correspondence, and the correspondingly organized groups are called multivariate correspondence groups and non-individual correspondence groups, i.e. multivariate groups and non-individual groups.

The equivalence relation of the compiled one of the groups and the compiled equivalent of a plurality of the groups is embodied as:

the corresponding relation and the precedence preference sequence indicated by one group and the corresponding sorting information and the corresponding relation and the precedence preference sequence indicated by a plurality of groups and corresponding sorting information which are coded and equivalent are the same.

The compiled formal media groups of one of the groups have the same ranking information as the formal media groups of the group, the media formats related to the formal media groups and the ranking information thereof, and the ranking information of the formal media groups of the groups equivalent to the compiled formal media groups and the media groups of the groups, the media formats related to the formal media groups, and the media format ranking information related to the formal media groups, which is characterized by the relative ranking information of the formal media groups and the relative ranking information of the media formats related to the media groups.

Optionally, the step of compiling the media formats having the same correspondence into one packet or compiling into a plurality of packets equivalent to the packet comprises:

grouping the corresponding second media formats according to the non-individual correspondence determined according to the target service, that is, according to the ordering information of the one or a plurality of groups in the form of the corresponding second media formats determined according to the service domain precedence preference order of the service domain where the non-individual correspondence is located, first incorporating the first second media format into the corresponding form media group to be grouped into the one or a plurality of groups equivalent to the one, and then incorporating the second media formats of the media in other forms of the same or different media streams having the same non-individual correspondence into the corresponding form media groups in sequence according to the relative precedence preference order to be grouped into the first second media format;

alternatively, the first and second electrodes may be,

and according to the individual corresponding relation determined according to the target service, incorporating the corresponding unique second media format into the corresponding individual form media group to compile the group or a plurality of groups equivalent to the group.

And simultaneously, according to the ranking information of the media formats in the one or a plurality of grouped formal media subgroups equivalent to the one or the plurality of grouped media subgroups equivalent to the one or the one of grouped media subgroups equivalent to the one or the plurality of grouped media subgroups equivalent to the one of the group corresponding relationship to the group to the one of the group to the one of the group to the one or the group to the one of the group to the one of the group is equivalent to the one of the group to the group.

Wherein the content of the first and second substances,

the second media format is a part or all media formats of a form of media under one media stream related to the target service; the second media formats of the same form of media are all related to the media format of the form of media under one media stream related to the target service.

The service domain priority order is determined by the target service, namely by the priority order rule of the service domain of the target service, and is determined according to the service domain priority order, namely according to the priority order rule, the service domain priority order can be generated as follows:

ranking information of the one or a plurality of equivalent grouped formal media subgroups corresponding to each corresponding relation in the service domain, ranking information of media formats in the one or a plurality of equivalent grouped formal media subgroups, and relative ranking information among the equivalent plurality of the equivalent grouped formal media subgroups;

the service domain corresponds to the ranking information of the formal media subgroups in the non-mutually independent grouping sets, the ranking information of the media formats in the grouped formal media subgroups and the ranking information among the subgroups.

The priority order rule of the service domain may include a priority order between different classes of corresponding relations of the service domain, a priority order between media in different forms of each media stream related to each corresponding relation in the service domain, and a priority order between media formats in each form of media.

And according to the correspondence determined according to the target service, each second media format having media of the same format as the corresponding second media format may be compiled with one or more other second media formats corresponding to the second media format into the packet, or may be compiled separately into the packet only including the second media format.

Optionally, the step of grouping and sorting the media formats of the media of different forms in the media streams related to the target service according to the correspondence and the precedence preference order may further include:

dividing at least two media formats in a first divisible form of a first group of media into at least two groups in a manner that their relative adjacency order is unchanged according to the ranking information of the first group, and:

when the first grouping is a multi-element corresponding relation grouping, sequentially compiling the at least two groups of divided media formats and the media formats of the media subgroups in other forms in the first grouping into at least two groups equivalent to the first grouping according to the relative adjacent sequence between the at least two groups of divided media formats;

alternatively, the first and second electrodes may be,

and when the first grouping is an independent corresponding relation grouping, sequentially taking the at least two groups of divided media formats and directly compiling the at least two groups of divided media formats into at least two groups equivalent to the first grouping according to the relative adjacent sequence between the at least two groups of divided media formats.

And in the same way, at least two groups equivalent to the first group are continuously divided at most until each second group equivalent to the first group.

Wherein the content of the first and second substances,

the first grouping refers to the grouping which can be divided into at least two groups equivalent to at least two groups by adopting the method in a mode that the media formats of at least two of the at least one divisible formal media subgroup are unchanged according to the relative adjacent sequence;

the second packet refers to the packet, which is not repartitionable by itself, containing only one media format in each of its formal media subgroups.

Each first packet in the non-mutually independent packet set can be divided into equivalent packets to arrange the sequencing information and the relative sequence of each packet so as to obtain the correspondence and the precedence preference sequence indicated by the packet information consistent with the correspondence and the precedence preference sequence determined by the service;

the basic implementation idea of dividing each first packet in a non-mutually independent packet set into packets equivalent to the first packet to arrange the sequence information of each packet and the relative sequence between the packets is as follows:

a first packet is divided into said packets equivalent thereto so as to be respectively inserted before or after one or more of said packets into other said packets in the non-mutually independent set of packets in which they are not fully contained and which are adjacent before or after one or more of said packets in relative order. The other groups are other first groups and other second groups which can execute the inserting operation without continuous division in the non-mutually independent group set where the first group is located, and the first group and the second group which can execute the inserting operation without continuous division in the groups which are divided from the other first groups and are equivalent to the first groups;

dividing a first packet into equivalent packets to eliminate the packets completely contained in the previously processed packet information, and inserting one or more packets not completely contained in the previously processed packet information before or after the packets in the previously processed packet information according to a relative ordering adjacency relationship. Wherein the packets in the packet information are other first packets and other second packets which can perform the inserting operation without continuous division in the non-independent packet set where the first packet is located, and other first packets and other packets which can perform the inserting operation without continuous division in the equivalent packets divided by the other first packets;

and repeating the steps until the finally obtained corresponding relation and the precedence preference sequence indicated by the grouping information are consistent with the corresponding relation and the precedence preference sequence determined by the service.

grouping two or more groups which are not mutually independent and are adjacent in a relative sequencing way into a first group which is adjacent together according to the relative sequencing adjacent order of the groups and has the same media formats in other media groups with the same media formats, wherein the first group is not changed in the media formats in the other media groups with the same media formats, and the second group is joined to a position where the joining is required to be stopped, and the third group is joined to a position where the joining is required to be stopped at most until the situation that any two groups which are not mutually independent and are adjacent in the relative sequencing way in the partial/whole groups and have different media formats or the situation that the media formats involved in the two or more media groups are different exists although the media groups with the same formats .

Each group which is not mutually independent and is relatively ordered and adjoined together in the group set can be combined into a first group according to the corresponding relation indicated by the group set and the principle that the relative precedence order is consistent, so that the finally obtained group information contains fewer or least groups of the groups.

for the packets in one non-mutually independent packet set, processing the packets corresponding to the corresponding relations in the corresponding service domain or a plurality of packets equivalent to the corresponding relations, namely, sequencing and de-duplicating the adopted packets according to the service domain precedence order corresponding to the non-mutually independent packet set, so that all the packets and sequencing information in the finally generated non-mutually independent packet set meet the following requirements:

the all groups may correspond to all correspondences of the service domains corresponding to the non-mutually independent group sets, and all correspondences of the service domains corresponding to the non-mutually independent group sets may also correspond to all groups;

the all sequencing information indicates the priority of the service domains;

when all the groups are represented by one or more equivalent second groups, the second groups are not repeated with each other;

when all the groups are represented by one or more equivalent second groups, the one or more equivalent second groups of each group in all the groups should be adjacent together in sequence, and the relative sequence of the groups should meet the precedence order requirement of the service domain.

Wherein the content of the first and second substances,

Optionally, the step of compiling the media formats having the same correspondence into one packet or equivalently compiling into a plurality of packets includes:

the relative precedence preference order of the form media to which the second media formats corresponding to the non-individual corresponding relations belong, which is determined according to the target service, is determined by the relative precedence preference order of the media format combinations in the media format combination set corresponding to the non-individual corresponding relations;

the relative precedence preference order of each media format in the media in the form corresponding to the second media format corresponding to the non-independent/independent corresponding relation determined according to the target service is also determined by the relative precedence preference order of each media format combination in the media format combination set corresponding to the non-independent corresponding relation;

wherein the content of the first and second substances,

the media format combination set of the corresponding relation is a complete set of the media format combination obtained by respectively taking one media format from each media format under each form of media related to the corresponding relation and combining the media formats;

the media format combination set of one group corresponding to the same corresponding relation and a plurality of groups equivalent to the group is the same as the media format combination set of the same corresponding relation.

The grouping of one media format combination corresponding to the same corresponding relationship and one or more media format combination groups equivalent to a plurality of groups equivalent to the grouping of the same corresponding relationship refer to that the media format of each form of media in each media format combination set of the same corresponding relationship is respectively used as the media format of each form of media in each media format combination group, and the one or more media format combination groups are obtained according to the relative precedence preference sequence of each form of media related to the same corresponding relationship, which is determined by the precedence preference sequence of each media format combination in the media format combination set of each corresponding relationship corresponding to all corresponding relationships under the same service domain and determined according to the target service, as the sequence of the form media group of each media format group.

The grouped media format combination set is a set of media format combinations obtained by respectively taking one media format from each media format under each grouped form media and combining the media formats according to the sequence of the form media groups.

Optionally, the offer information may further include:

a first media format that does not require grouping;

the first media formats have independent relations, each first media format is all media formats of a media in a form of a media stream related to the target service, and relative sequencing information among corresponding media format descriptions in media stream description information of the media formats is directly used for indicating the priority order among the media format descriptions;

the independent relation means that any one of all media formats of each first media format and any one of media formats of other media streams of the same or different media streams related to the target service can be considered to have no corresponding relation.

Optionally, the groups include a single independent relationship group;

the step of compiling the media formats with the same corresponding relation into one group or equivalently compiling into a plurality of groups comprises the following steps:

the first media format is separately compiled into one single independent relation group or a plurality of equivalent single independent relation groups;

the first media format is all media formats of one form of media of one media stream related to the target service, and the first media format has no corresponding relation with any one of media formats of other forms of media under the same or different media streams related to the target service.

Optionally, there may be only one said group in a non-mutually independent group set and only one formal media subgroup in the group information or all said groups may be merged into one said group only having one formal media subgroup, and then the only group in the non-mutually independent group set and only one formal media subgroup or all said groups merged together into one said group only having one formal media subgroup are independent individual groups;

that is, all media formats of the unique form media in the independent individual grouping have an independent relationship, all media formats of the unique form media in the independent individual grouping are all media formats of one form media of one media stream related to the target service, and relative ordering information among all media formats of the unique form media in the independent individual grouping is used for indicating a precedence order among the media formats;

therefore, if the relative sorting information among all media formats of the unique form media in the independent individual packet is the same as the relative sorting information among corresponding media format descriptions in the media stream description information where the media formats are located, that is, the precedence preference order represented by the two media formats is the same, the independent individual packet in the packet information can be deleted, and at this time, the whole media formats of the unique form media in the deleted independent individual packet are the first media format;

the independent grouping which can be deleted and the first media format which has the same precedence preference sequence with the independent grouping are two equivalent expression forms, and the mutual conversion between the independent grouping which can be deleted and the first media format can be freely carried out by deleting and adding the independent grouping and keeping the precedence preference sequence before and after the deletion and the addition operations unchanged according to the media negotiation processing requirement;

optionally, when one of the packets in the non-mutually independent packet set has only one formal media group, and the non-mutually independent packet set also has the packets formed by media groups of other forms except the formal media group, the direct or indirect non-mutually independent relationship which the packet having only one formal media group has with the other packets in the non-mutually independent packet set is called a separate formal media dependent relationship; correspondingly, such packets having separate dependent relationships are referred to as dependent independent packets.

Therefore, the packets into which the non-independent individual packets can be divided, that is, the packets into which they can be merged, are all non-independent individual packets; the packets into which independent individual packets can be divided, i.e. the packets that can be merged into them, are all non-independent individual packets, only being independent individual packets themselves.

Optionally, before the step of sending the offer information for the target service to the second communication device, the method may further include:

according to the line set Cartesian product operation rule, a corresponding relation determined for the artificially eliminated target service or a corresponding relation artificially introduced is eliminated, and one non-mutually independent packet set which does not only comprise independent groups is divided into two or more non-mutually independent packet sets;

and merging two or more non-mutually independent packet sets into one non-mutually independent packet set for finding back the corresponding relation determined by the artificially eliminated target service or artificially introducing the corresponding relation.

Wherein, for each of the packets obtained after the non-mutually independent packet sets not only including the independent individual packets complete all splitting, de-duplication and converging operations, each of the formal media subgroups thereof includes all media formats of the formal media under the corresponding media stream related to the target service.

The packet representation rule in the embodiment of the invention is as follows:

for PT lines of the respective forms of media under each media stream description of all the same or different media types (video or audio) grouped and ordered according to traffic needs, marking and grouping needs to be done in SDP or local contract configurations. Wherein:

1) when the working mode (abbreviated as "protocol extension mode", the same below) of marking and grouping PT lines of various forms of media under description of various media streams to be grouped and sorted in SDP is adopted, the packet marking rule is as follows:

A. for each PT row of each form of media under the description of each media stream that needs to be grouped and sorted according to the grouping rule, only the identification information of the PT row needs to be represented. Therefore, the encoding manner of the identification information is not particularly limited as long as the uniqueness of the identification information in the SDP can be embodied, the identification information can be marked according to the order of the identification information in the SDP, the marking manner can simply represent the relative order number information among the PT lines, and can also represent the order number of the media stream description in which the PT lines are located relative to the media stream description related to the PT line group, the order number of the media in the corresponding form of the media stream description relative to each media in the form related to the PT line group in the media stream, and the order number of the PT lines in the media in the corresponding form relative to each PT line required to be grouped. Take the way of marking PT rows that simply represents the relative sequence number information between these PT rows as an example:

PT lines can be labeled in a form similar to "a ═ ptid: 1", where "a ═ ptid:" is a fixed identification of the PT line label, and the number "1" is the PT line label value, and can be expressed as a positive integer of the relative sequence number information between PT lines, and the values are unique throughout the SDP.

B. For the PT row packet, it is necessary to indicate identification information of the PT row packet, information of each formal media group to which each PT row constituting the packet belongs, and flag information corresponding to each PT row. Therefore, the encoding method of the identification information is not particularly limited as long as the uniqueness in the SDP can be achieved. Taking as an example that the PT row group identification information only simply represents the marking mode of the relative sequence number in the service, and the identification information of the PT row also inherits the PT row marking mode in the a section:

PT row packets may be labeled like "a ═ ptgroup: 11, 2; 3; 4,5 ", wherein: "a ═ ptgroup:" is a fixed identification of the PT line group marker, and the next "1" is the PT line group marker value, which can be expressed as a positive integer of the PT line group relative sequence number information, and is unique in this SDP. Followed by "1, 2; 3; 4, 5': a semicolon (i.e., ") is a separator between forms of media portlets. Commas (i.e., ") are separators between PT line markers in each media subgroup, where the numbers are PT line marker values;

and PT line marking information is listed in the corresponding PT line associated attribute in the SDP, and PT line grouping information is listed in the SDP session level information according to the preferred sequence of the PT line grouping.

And the small group sequence in the PT row grouping represents the sequence of processing media in different forms, represents the preferred sequence of the media in different forms and implies the preferred relation of media types described by media streams corresponding to the media in different forms. In order to be compatible with the processing that does not support the packet negotiation situation, the order is generally consistent with the overall relative order of each form of media in the SDP, and the service also generally determines the order of the media streams in the SDP according to the required preference relationship of the media stream descriptions of each media type, thereby affecting the relative order of each form of media.

The relative order of the PT row marker values in the formal media subgroups in the PT row group represents the relative preference order among the PT rows, and the relative order of the PT row marker values in the formal media subgroups in the PT row group further combines the relative order of the formal media in the PT row group to collectively represent the relative preference order of the PT row combinations in the PT row combination set.

F. In general, the SDP answer is not limited to having the same PT line tag value of the corresponding PT line and PT line group tag value of the corresponding PT line group or subset thereof in the SDP offer, and may have its relative order re-valued in the SDP answer, but for the sake of human comprehension, it is generally suggested that the SDP answer has the same value as the PT line tag value of the corresponding PT line and PT line group tag value of the corresponding PT line group in the SDP offer.

G. Generally, for the resource reservation confirmation processing after the media negotiation, the SDP offer should adopt the same value as the PT row flag value of the corresponding PT row and the PT row packet flag value of the corresponding PT row packet in the SDP answer in the previous media negotiation process, so as to avoid that the opposite end misunderstands that the media change has occurred.

H. Generally speaking, it is also not limited that in the same service processing procedure, subsequent renegotiation (especially renegotiation initiated by the original negotiation answer side) inherits the same value as the PT row flag value of the corresponding PT row in the SDP offer and/or the SDP answer in the previous negotiation, but when a new change and the original media negotiation have an inheritance relationship (i.e., a change is made within the range of the original media negotiation SDP offer or SDP answer), it is recommended to inherit the same value as the PT row flag value of the corresponding PT row in the SDP offer or SDP answer in the previous negotiation and the PT row packet flag value of the corresponding PT row packet. In addition, the subsequent renegotiation in the same service processing process can also be changed into the realization without adopting a packet negotiation mechanism.

2) When a local contract configuration is adopted to describe a working mode (referred to as a "contract configuration mode" for short) of marking and grouping PT rows of various media types under various media streams to be grouped and sequenced, the mode is suitable for a service mode and a stable change, that is, PT rows of various media types under various media stream descriptions possibly occurring in service are basically fixed, the corresponding relationship is basically fixed, and the change in the future is not quick, and the whole system can conveniently perform a scene of global configuration management, wherein the grouping identification and the configuration rule are as follows:

A. the local contract configuration is configured according to the service, can use the service flow mark as the service configuration identifier, can exclusively indicate whether the configuration is the default configuration of all services (i.e. it is effective when the corresponding service configuration does not exist or is closed), and can include the PT row grouping configuration set required by the corresponding service and the PT row configuration set organized by using the media flow configuration under the configuration, and can carry other attribute configurations such as service configuration switch attribute, PT row grouping configuration processing policy attribute, PT row configuration processing policy attribute, etc. according to the needs.

This service configuration may indicate PT row packets that the service expects to be likely to occur, media streams involved in and out of the PT row packets, and PT rows of various forms of media under the description of media streams of various media types involved in and out of the PT row packets, and sequence information for these configurations.

And B, the PT row configuration is organized according to the media stream configuration, and each media stream configuration comprises attributes such as media stream identification, media type, optional local terminal transceiving direction and the like and the PT row configuration below the attribute. Each PT row configuration consists of PT row identification information, PT row sequence marks, PT row validation switch information and a negotiation parameter attribute set thereof. Wherein:

the unique identification information of each PT row can be represented in the same form as in the protocol extension mode, that is, by using a "PT row marker" attribute and a corresponding attribute value "PT row marker value". PT rows may be marked in a form similar to "a ═ ptid: 1", or a variant representation thereof, where "a ═ ptid:" is a fixed identification of PT row markers, and the number "1" is a PT row marker value, which may be represented as a positive integer of relative sequence number information among PT rows, and is unique among PT row marker values in the entire service configuration.

Each PT row negotiation parameter attribute set must contain a media encoding format and a sampling rate, and a negotiation parameter and a minimum decomposition attribute configuration set thereof corresponding to each necessary negotiation parameter with specificity (meaning that different values thereof will generate different PT row parameters or decomposition attributes thereof) corresponding to the media encoding format, a negotiation parameter and a minimum decomposition attribute configuration set thereof corresponding to an optional negotiation parameter without specificity, and a negotiation parameter and a minimum decomposition attribute configuration set thereof corresponding to an optional negotiation parameter with specificity, wherein:

parameters that are specific and not-separable, and parameters that are not separable with specific attributes generally give in their entirety (actually not decomposed) the decomposed configuration attributes and the specified values of the decomposed configuration attributes that may be used for a particular PT row; the overall specificity, but the negotiation parameters with and without specificity attribute can be decomposed, and need to be decomposed into a plurality of decomposition configuration attributes, and given the decomposition configuration attribute with specificity and the assigned value of the decomposition configuration attribute which may be used by the specific PT, for the decomposition configuration attribute without specificity, default value, value range, discrete value set or unassigned value can be assigned. Also, the specific resolution property, which is insensitive to the application, suggests that the negotiation be constant, i.e. that its changes not be allowed to elicit multiple PTs, for use in the negotiation and this service configuration.

And the PT row grouping configuration consists of identification information of the PT row grouping, information of various media groups to which the PT rows forming the PT row grouping belong and marking information corresponding to the PT rows, and the information is listed in a PT row grouping configuration set in the service configuration according to the preferred sequence of the PT row grouping. Therefore, the encoding method of the identification information is not particularly limited as long as the uniqueness in the service configuration can be realized. Taking as an example that the PT row group identification information only simply represents the marking mode of the relative sequence number in the service configuration, and the identification information of the PT row inherits the PT row marking mode in the section B:

PT row packets may be labeled like "a ═ ptgroup: 11, 2; 3; 4,5 "or a variant thereof represents a form wherein: "a ═ ptgroup:" is a fixed identification of the PT line group tag, and the next "1" is a PT line group tag value, which can be expressed as a positive integer of the PT line group relative sequence number information, and is unique among the PT line group tag values in this SDP. Followed by "1, 2; 3; 4, 5': a semicolon (i.e., ") is a separator between forms of media portlets. Commas (i.e., ") are separators between PT line markers in each media subgroup, where the numbers are PT line marker values;

and sequentially configuring the media groups in each form in the PT row grouping configuration to show the processing sequence of the media in each form in the grouping indicated by the PT row grouping configuration, show the preferred sequence of the media in different forms and imply the preferred relation of the media types described by the media streams corresponding to the media in different forms.

Therefore, the sequential configuration of the media groups in various forms in the PT group allocation configuration is determined according to the service requirements and the preference relationship between the media types/media in various forms described by the media streams corresponding to the PT groups. In addition, for the purpose of more intuitive business logic embodiment, the sequential configuration is generally consistent with the overall relative order of various forms of media in the business configuration PT row configuration set.

The relative sequential arrangement of PT row marker values in the various types of media subgroups in the PT row group arrangement represents an independent relative order of preference among the PT rows. Thus, the sequential configuration is generally consistent with the relative order of PT rows under each type of media in the service configuration PT row configuration set;

the relative order of the PT row tag values of the various media subgroups in the PT row group allocation further combines the relative order of the various media groups in the PT row group allocation, and together indicates the relative order of preference of the various PT row combinations in the PT row combination set.

F. In order to support the service baseline requirement, the PT column grouping configuration and the PT column configuration must include the PT column grouping configuration and the corresponding PT column grouping configuration of each media type of media stream required by the service baseline, and in general, the PT column grouping configuration and the PT column configuration required by the service baseline are arranged at non-preferred positions as required, and the service normal baseline attribute can be marked in the corresponding PT column grouping configuration;

G. in order to compatibly support the service degradation scene requirements of video service degradation to audio service and the like, the grouping configuration of the PT lines, which is formed by the PT lines of each media type of media stream required by the service degradation required by the service requirement, must be included in the grouping configuration of the PT lines, and the corresponding service degradation configuration attribute and the service degradation baseline attribute can also be marked in the corresponding grouping configuration of the PT lines;

H. in order to be compatible with the processing requirements when the opposite end initiates the media negotiation process based on the protocol extension mode, and to be compatible with the processing requirements of each media type media stream (for which the service application of the upper layer is known) and each PT row (for which the processing capability of the underlying system supporting the service application already has) of each form of media below the media stream (for which the service application of the upper layer is known) that are not covered by the current service configuration, the compatibility policy configuration may be performed in the service level configuration. It is generally believed that:

the former is actually a PT line packet processing policy, and when the service configuration is started, there may be a policy of operating in a manner of ignoring protocol extension information (i.e., regardless of whether there is a working mode that does not support protocol extension but uses the service configuration PT line packet configuration, a working mode that does not need to support protocol extension itself, a default mode), operating in a manner of preferentially using a PT line packet of protocol extension (i.e., if there is a PT line packet that uses protocol extension, otherwise, using a working mode that uses a PT line packet of service configuration, a working mode that needs to support protocol extension itself may be selected), operating in a manner of closing packet negotiation, and the like;

the latter is actually a PT line processing policy, and when the service configuration is started, there may be policies such as operating in a way of ignoring PT lines/formal media/media streams other than the service configuration, operating in a way of processing all processable PT lines except the PT lines which must be given a grouping relationship according to the actual underlying capability of the system of the service, where the PT lines which must be given a grouping relationship means that PT lines are grouped under the isomorphic media of these PT lines, but when the PT line grouping policy is used, PT lines whose grouping relationship cannot be given, which may cause a problem that the PT line grouping policy is configured to operate in a way of ignoring protocol extension information, and the SDP includes a case where PT lines are grouped under the isomorphic media and there are PT lines which exceed the PT line configuration range under the isomorphic media.

The packet negotiation rules in the embodiments of the present invention are as follows:

the negotiation rule for performing media negotiation on the payload type media capability description line (abbreviated as "PT line", the same below) of each form of media under each media stream description of all the same or different media types in the SDP offer according to the partial or complete grouping and sorting of the services is as follows:

1) (preparation and overall processing sequence rule) when the responder supports packet negotiation, after finding out the packet related information in the SDP offer according to its own support capability, firstly confirming each PT line which needs to be answered and is contained in each form of media under each media stream description in each packet according to the sequence of the packets for each packet actually existing in the SDP offer, then confirming each PT line which needs to be answered and is contained in each form of media under each media stream description which does not relate to the packet actually existing in the SDP offer, then generating corresponding answers for each media stream description and all PT lines which need to be answered as a whole in the SDP answer, and adding the packet related information in the SDP answer according to the own support capability of the responder, and then completing the addition of answer results required for other negotiation or non-negotiation processing except PT line negotiation in the SDP offer, and generating a complete SDP answer for answering.

Wherein, for the acquisition of the packet related information in the SDP offer:

A. if the responder does not support the protocol extension mode and only supports the agreement configuration mode, namely the responder configures the PT line grouping processing strategy of the agreement service configuration as default to ignore the agreement extension mode because only supports the agreement configuration mode, the responder matches the PT line configuration in the service configuration through the PT line information in the SDP offer and combines the PT line strategy to correct and obtain effective PT line grouping information no matter whether the responder supports the grouping negotiation and whether the agreement extension mode is supported;

B. if the offeror and the responder both support the protocol extension mode and the responder does not support the protocol extension service configuration, or the protocol extension mode is supported to close the protocol extension service configuration or configure the PT row packet processing strategy of the opened protocol extension service configuration as the protocol extension mode is preferred, directly acquiring the packet related information in the SDP offer, and when the PT row packet processing strategy of the opened protocol extension service configuration is configured as the protocol extension mode is preferred, correcting to obtain the effective PT row packet information in combination with the PT row processing strategy of the protocol extension service configuration;

C. if the offeror supports the agreement configuration mode or the offeror does not support the packet negotiation, the responder supports the protocol extension mode and configures the PT row packet processing strategy configured by the opened agreement service into the protocol extension mode with priority, the situation is equivalent to the situation that the corresponding responder does not support the protocol extension mode and only supports the agreement configuration mode;

D. if the offeror supports the agreement configuration mode or the offeror does not support the packet negotiation, and the responder only supports the protocol extension mode, that is, the responder only supports the protocol extension mode and closes the agreement service configuration, the responder processes the situation that the responder does not support the packet negotiation function and the responder closes the packet negotiation function.

In summary, there are three processing situations for the responder, that is, both parties operate in the protocol extension mode, the responder only supports the negotiation configuration mode, and the responder does not support the packet negotiation mode.

2) (packet handling/answering rules under SDP) the answering party confirms in turn whether each packet and its respective form of media can be answered. When the responder confirms whether the packet and each form of media can respond and the PT line which needs to be responded under the corresponding each form of media:

if each formal media in the corresponding grouping can possibly answer under the grouping, the corresponding grouping and each formal media can answer can be confirmed, and only each PT row which is confirmed as can answer in each formal media in the corresponding grouping needs to be answered under the grouping can be confirmed;

if one formal media in the corresponding grouping can not answer under the grouping, the corresponding grouping and each formal media can be confirmed to not answer, and the PT rows which do not need to be answered under the grouping in each formal media under the corresponding grouping can be confirmed;

3) (rules for processing formal media under packet) the responder confirms in turn whether each formal media under packet is likely to be replicable under the packet. The processing requirements of the responder on whether the corresponding form media can possibly respond under the corresponding packet and on confirming the PT line which can respond under the responding media are as follows:

when the responder adopts a working mode (referred to as a "general working mode" for short) for responding to all PT lines which can be supported in various types of media described in various media streams, the responder needs to sequentially confirm whether each PT line contained in the corresponding type of media can respond, and when at least one PT line which can respond is contained in the PT lines, the media in the type can be considered to possibly respond under the group;

when the responder adopts a working mode (referred to as a "1/N working mode" for short) for responding only to the unique PT row preferentially supported in each form of media described by each media stream, if the form of media under which the corresponding form of media is the same can respond under the corresponding group in the processing of some other group, the form of media is considered not to respond under the group, otherwise, the responder needs to sequentially confirm whether each PT row contained in the corresponding form of media can respond, when a PT row capable of responding is found, the remaining PT rows do not need to be processed continuously, that is, the form of media can possibly respond under the group, otherwise, when the corresponding form of media does not contain the PT row capable of responding, that is, the form of media cannot respond.

The responding PT row is a PT row that can respond to the PT row itself according to the negotiation requirement of the corresponding media format, and according to the service or media stream constraint, if the same or other media streams are required to have a PT row that can respond to some or several other media, the media stream in which the PT row is located in the negotiation result is not rejected, and the conclusion of the PT row that can respond to the PT row can be obtained only under the condition that the media stream in which the PT row is located is confirmed not to be rejected.

In addition, in the above processing procedure, if it is found that the PT line corresponding to the PT line marker value in the packet does not exist in each media format under each media stream description, the processing of the PT line may be directly ignored and skipped.

4) After the packet processing is finished, the responder needs to refer to the processing sequence and rules of the basic negotiation flow, describe the formal media by the media stream, find out the formal media only containing the PT rows which are not programmed into the packet, and respectively confirm the media rows which need to be responded. The processing requirements of the responder for confirming the PT line which needs to be responded by the corresponding media are as follows:

when the responder works in a general working mode, the responder needs to sequentially confirm whether each PT row contained in the corresponding form media can respond or not, judge the PT rows which can respond and need to respond, and when the PT rows which can respond exist, determine that the form media can respond;

when the responder works in the 1/N working mode, the responder needs to sequentially confirm whether each PT row contained in the corresponding form media can respond, when a PT row capable of responding is found, the remaining PT rows do not need to be processed continuously, the PT rows needing to be responded by the PT row are determined, and the form media can be responded, otherwise, when the corresponding form media does not contain the PT rows capable of responding, the form media can be determined not to be responded.

5) Then, the response results to the types of media in the offer are generated in order of PT rows of the media. The specific treatment is as follows:

the responder generates response results for each media stream description, and generates response results corresponding to the PT rows for the formal media which is determined to be capable of responding under each media stream description, that is, the PT rows which need to respond of the formal media with the PT rows which need to respond generate the response results corresponding to the PT rows according to the negotiation response rules of the corresponding media format and the formal media.

6) Meanwhile, when packet information and PT packet identification information for each PT line are explicitly provided in SDP offer, if the responder also supports explicit carrying these information:

the responder adds PT row identification information for the corresponding PT row in the response result;

the responder should sequentially list PT row group identification information of each group considered to be capable of responding and PT row marking value list information of each PT row needing to respond organized according to various forms of media groups in SDP offer and the sequence of each PT row below the media groups in the session level information in response according to the processing sequence of the packets, namely packet response result information of the packet information;

7) furthermore, the responder still needs to refer to the basic negotiation rules and other service and media stream constraints to complete the generation and processing of the response results of the session level and the media stream description level, and implement the response result generation function required by other negotiation or non-negotiation processing except the PT negotiation.

For example, when there is no PT line that needs to be responded to in a certain form of media, the media stream description to which the media stream description belongs is rejected and the PT line response is represented in a compatible manner according to the representation method of the PT line response in the scene (for example, PT line related attribute information of the PT line response to the PT line is deleted or retained), or according to the requirements of the upper layer protocol, the service is interrupted by rejecting all the media stream descriptions.

8) In addition, when the responder and the offeror in the media negotiation process perform subsequent processing of the same service processing process according to the requirements of upper-layer services and protocols, if no special requirements exist, the responder and the offeror should inherit the packet negotiation mechanism to work.

For example, for the resource reservation confirmation process that may occur after the media negotiation process, the media stream description and PT line description information in the SDP offer/answer information should also be consistent with the result of the packet media negotiation.

For another example, when the terminal initiates a media change and resource reservation confirmation, the corresponding packet information of some or all media streams due to rejection should not appear in the negotiation result, and the audio media stream is not rejected, so that the packet information originally existing for service compatibility and simply including the PT row required by the audio media stream baseline and the packet identifier information of the corresponding PT row need to continuously appear in the negotiation result.

For another example, in the playing process of the coloring ring back tone service content, when the network condition of the terminal changes (e.g. the mobile terminal has EPS fallback), and the terminal side initiates a media change, a new SDP offer meeting the above-mentioned packet negotiation principle may also be generated according to the packet negotiation answer rule in combination with the network condition change and the previous answer, and perform packet negotiation with the service platform, so as to obtain better service experience.

9) In addition, when the responder and the offerer in the media negotiation process perform subsequent processing of the same service processing process, the responder and the offerer should also be able to accept processing of the basic negotiation mechanism of the SDP offer negotiation request that does not need to perform packet negotiation processing in conjunction with PT packet information, so as to ensure that service negotiation processing can be converged quickly when service and network abnormality occur.

For example, for the application of the ring back tone service, when the responder does not support the packet negotiation or negotiations are wrong, resulting in no or no PT group information and PT group identification information in the response, the PT group information in the response is inconsistent with the PT group information and the corresponding relationships of the services cannot be embodied, or when the negotiation cannot be completed through one handshake due to other negotiation factors in the packet negotiation framework, the responder may re-initiate the existing SDP offer carrying only one PT group that can be supported by the baseline capability of the responder in the video media stream description and the audio media stream description to perform the basic media negotiation, thereby ensuring that the media negotiation can be converged quickly.

For another example, for the application of the color ring back tone service, in the process of completing negotiation to play a content media file to the mobile terminal, when SRVCC occurs in the mobile terminal, the network side needs to initiate a media update to the service platform, so that only an audio play scene is reserved, the network side can initiate the existing SDP offer carrying only one PT line that can be supported by the network baseline capability in the description of the audio media stream for performing the basic media negotiation, thereby ensuring that the service platform can also quickly converge the media negotiation and basically properly handle the service requirements of continuing playing the audio part of the content media file according to the scene service requirements, reducing the service support requirements for the network side, and avoiding the problem that the network side introduces a complicated cache and a mechanism for continuing the subsequent negotiation in the previous negotiation process and cannot better improve the service experience.

10) Under the condition that the responder does not support the group negotiation function due to various reasons, the responder respectively carries out response processing of each PT line of each media stream in each form according to the basic negotiation rule, completes generation processing of response results of media stream description primary according to the basic negotiation rule and the constraint of other services and media streams, and realizes the response result generation function required by other negotiation or non-negotiation processing except the PT line negotiation.

Meanwhile, in the case where the packet information and the PT packet identification information for each PT line are explicitly provided in the SDP offer, the PT line packet information and the PT line packet identification information should generally be removed from the response in accordance with the compatibility requirement.

The result application rule in the embodiment of the invention is as follows:

the rule for performing service processing on the payload type media capability description line (abbreviated as "PT line", the same below) of each form of media under each media stream description of all the same or different media types in the SDP answer, wherein the media stream description line is partially or completely grouped and sorted, or is not grouped, is as follows:

1) (preparation and overall processing sequence rules) the offerer finds out and processes the packet related information in the SDP answer and the PT line related information of each media type under each media stream, firstly finds out and processes each optimized packet and each PT line of each media type under each media stream description corresponding to the optimized packet from each packet actually existing in the SDP answer, then processes each PT line of each media type under each media stream description not related to the packet actually existing in the SDP answer, and simultaneously processes other negotiated or non-negotiated contents except the packet and PT line negotiated result processing in the SDP answer, and finally finishes the service application processing of the SDP answer.

2) The method comprises the steps that an offerer decomposes all found groups into equivalent groups (PT row combination type groups for short, the same below) which only contain one PT row under each form of media in the groups according to a group equivalent splitting and sorting rule, and then sequentially finds out the first group without intersection of each form of media set according to the sequence, namely, each preferred group in the response.

The offerer matches with the media PT rows of the forms of the optimized groups in turn according to the priority order of the corresponding relation of the business media formats required by the business, and the business media format corresponding relation which is completely matched with the optimized groups firstly is the content of the business which needs actual service.

The group which is usually at the head after the decomposition is a preferred group, the group which is not intersected with the formal media set is also a preferred group, the group which is not intersected with the formal media set of all the prior preferred groups is also a preferred group, and the like is repeated until all the decomposed groups are processed, and all the preferred groups can be found. The formal media set non-intersection refers to that the formal media in the two groups are not certain formal media described by the same media stream in the SDP between every two media.

3) The first PT line of each form of media under the description of each media stream not related to the packet is taken as an independent preferred PT line by the offeror, the offeror matches each independent preferred PT line in turn according to the precedence preference order of each completely independent correspondence of the service requirements, and the independent service media format that matches these independent preferred PT lines first is also the content that the service needs to actually serve.

4) Meanwhile, the responder processes other negotiated or non-negotiated contents in the SDP answer, synthesizes the rules of the service to obtain the contents of the service which need actual service, and directly provides the service contents under the non-Precondition flow, and after confirming that the resource reservation confirmation result is received under the Precondition flow, the service contents are provided according to the requirement, thereby completing the service processing of the SDP answer.

The method of the embodiment of the invention can meet the service requirements that the corresponding relation exists between the PT lines of each form of media in each media stream description in the media negotiation SDP on the service and the negotiation result needs to be synchronized in the negotiation result according to the requirement of keeping the corresponding relation through one-time negotiation. Has the following technical advantages:

1. the negotiation is completed through fast convergence (user experience and good experience), the service negotiation delay is greatly saved, and the error probability caused by repeated negotiation is avoided. The timeliness and success rate of the service reaching the user are guaranteed, and the service experience is improved;

2. (platform support, low cost) fast convergence completes negotiation, and does not involve making a large amount of content or transcoding playing. The service experience is best, the system support requirement is reasonable, and the cost of content production and quality control, content storage equipment, media playing equipment and the like is lowest;

3. the content operation can be continued, the playable content can be accurately determined through fast negotiation, and the content can ensure the playing of the high-quality file according to the conditions of the terminal and the network only by making a few high-quality standard media files according to the service requirements. The service experience is best, the content management is flexible, the service operation can be focused, and the sustainable development can be realized;

4. the method has the advantages that (network guarantee and good efficiency) the played content is accurately approved through fast negotiation, network resources and bandwidth are accurately applied according to requirements, and waste of the network resources and network impact caused by first virtual height and multiple negotiations are avoided.

Referring to fig. 3, fig. 3 is a flowchart illustrating a media negotiation method according to a second embodiment of the present invention, where the method is applied to a second communication device, and includes the following steps:

step 31: receiving offer information aiming at a target service, which is sent by first communication equipment, wherein the offer information comprises information of each media format of each form of media in each media stream related to the target service and grouping information of the media formats, the grouping information can indicate a corresponding relation of each media format of each form of media in each media stream related to the target service, and the corresponding relation is determined by the target service;

step 32: generating response information according to the grouping information of the media formats, wherein the response information comprises the media formats required to be responded in each grouping;

step 33: and sending the response information to the first communication equipment.

Optionally, the step of generating response information according to the grouping information of the media format includes:

determining whether the media format that needs to be acknowledged exists within each packet; and/or the presence of a gas in the gas,

determining whether the media format not grouped in the offer information is a media format that needs to be answered;

the reply information includes the media formats that need to be replied to that are not grouped.

Optionally, the step of determining whether the media format required to be answered exists in each packet includes:

determining whether the media formats required to be responded exist in each group according to the grouping information and the sequencing information of the media formats;

the sequencing information is determined according to the target service, and the sequencing information is used for indicating at least one item in the following sequence preference orders:

the priority order among the formal media indicated by the sorting information among the formal media groups in the grouping information of the media format;

the priority order among the media formats indicated by the sorting information among the media formats in the formal media group in the grouping information of the media formats;

wherein the content of the first and second substances,

one of said packets having at least one formal media subgroup in common with another of said packets forming a direct non-mutually independent relationship therewith, or one of said packets being capable of forming an indirect non-mutually independent relationship with another of said packets having no direct non-mutually independent relationship therewith, via one or more of said packets having a direct non-mutually independent relationship therewith;

the grouping information of the media format includes the grouping in one or more non-mutually independent grouping sets, and the corresponding relationship is the corresponding relationship in one or more service domains corresponding to the one or more non-mutually independent grouping sets one to one;

the formal media group is a group consisting of all media formats belonging to the same formal media in the same media stream in one group;

in the grouping information of the media format, the groups which do not have direct and indirect non-mutually independent relations belong to different non-mutually independent group sets, and the groups which belong to the different non-mutually independent group sets have mutually independent relations;

in the grouping information of the media format, the relative ordering among the groups with the mutually independent relationship does not indicate the precedence preference order among the groups, so that the relative ordering among the groups can be freely adjusted when the groups are respectively processed; the corresponding relations in different service domains in the corresponding relations are logically relatively independent, and the priority order determined by the target service does not exist.

Referring to fig. 4, fig. 4 is a flowchart illustrating a media negotiation configuration method according to a third embodiment of the present invention, where the method is applied to a first communication device, and includes the following steps:

step 41: sending configuration information to the second communication device;

Referring to fig. 5, fig. 5 is a flowchart illustrating a media negotiation configuration method according to a fourth embodiment of the present invention, where the method is applied to a first communication device, and includes the following steps:

step 51: receiving configuration information sent by second communication equipment;

Referring to fig. 6, fig. 6 is a flowchart illustrating a media negotiation method according to a fifth embodiment of the present invention, where the method is applied to a media negotiation system, where the media negotiation system includes a first communication device and a second communication device, and includes the following steps:

step 61: the method comprises the steps that first communication equipment sends offer information aiming at target services to second communication equipment, wherein the offer information comprises information of each media format of each form of media in each media stream related to the target services and grouping information of the media formats, the grouping information can indicate corresponding relations of each media format of each form of media in each media stream related to the target services, and the corresponding relations are determined by the target services;

step 62: the second communication equipment receives offer information aiming at the target service sent by the first communication equipment;

and step 63: the second communication equipment generates response information according to the grouping information of the media formats, wherein the response information comprises the media formats required to be responded in each group;

step 64: the second communication equipment sends the response information to the first communication equipment;

step 65: and the first communication equipment receives response information sent by the second communication equipment according to the offer information.

Specifically, please refer to the first and second embodiments, which are not described herein again.

Referring to fig. 7, fig. 7 is a schematic structural diagram of a first communication device according to a sixth embodiment of the present invention, where the first communication device 70 includes:

an offer sending module 71, configured to send offer information for a target service to a second communication device, where the offer information includes information of each media format of each type of media in each media stream related to the target service and grouping information of the media formats, and the grouping information can indicate a correspondence relationship of each media format of each type of media in each media stream related to the target service, and the correspondence relationship is determined by the target service;

a response receiving module 72, configured to receive response information sent by the second communication device according to the offer information.

The first communication device provided in the embodiment of the present application can implement each process implemented in the method embodiment of fig. 2, and achieve the same technical effect, and for avoiding repetition, details are not described here again.

Referring to fig. 8, fig. 8 is a schematic structural diagram of a second communication device according to a seventh embodiment of the present invention, where the second communication device 80 includes:

an offer receiving module 81, configured to receive offer information for a target service, sent by a first communication device, where the offer information includes information of each media format of each type of media in each media stream related to the target service and grouping information of the media formats, where the grouping information can indicate a correspondence relationship of each media format of each type of media in each media stream related to the target service, and the correspondence relationship is determined by the target service;

a response generating module 82, configured to generate response information according to the grouping information of the media formats, where the response information includes the media formats that need to be responded in each grouping;

a response sending module 83, configured to send the response information to the first communication device.

The second communication device provided in the embodiment of the present application can implement each process implemented in the method embodiment of fig. 3, and achieve the same technical effect, and is not described here again to avoid repetition.

Referring to fig. 9, fig. 9 is a schematic structural diagram of a media negotiation system according to an eighth embodiment of the present invention, where the media negotiation system 90 includes: a first communication device 91 and a second communication device 92;

the first communication device 91 is described in the sixth embodiment, and the second communication device 92 is described in the seventh embodiment, which are not described herein again.

Referring to fig. 10, fig. 10 is a schematic structural diagram of a first communication device according to a ninth embodiment of the present invention, where the first communication device 100 includes:

a configuration sending module 101, configured to send configuration information to a second communication device;

The first communication device provided in the embodiment of the present application can implement each process implemented in the method embodiment of fig. 4, and achieve the same technical effect, and for avoiding repetition, details are not described here again.

Referring to fig. 11, fig. 11 is a schematic structural diagram of a first communication device according to a tenth embodiment of the present invention, where the first communication device 110 includes:

a configuration receiving module 111, configured to receive configuration information sent by the second communication device;

The first communication device provided in the embodiment of the present application can implement each process implemented in the method embodiment of fig. 5, and achieve the same technical effect, and for avoiding repetition, details are not described here again.

Referring to fig. 12, an embodiment of the present invention further provides a communication device 120, which includes a processor 121, a memory 122, and a computer program stored in the memory 122 and capable of running on the processor 121, where the computer program, when executed by the processor 121, implements each process of the media negotiation method embodiment executed by the first communication device or the second communication device, or implements each process of the media negotiation configuration method embodiment executed by the first communication device or the second communication device, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here.

An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the foregoing media negotiation method embodiment, or implements each process of the foregoing media negotiation configuration method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A media negotiation method applied to a first communication device, the method comprising:

2. The method according to claim 1, wherein the grouping information further includes ranking information, and the ranking information is used to indicate a following precedence preference order, and the precedence preference order is determined by the target service:

wherein one of said packets is capable of forming a direct non-mutually independent relationship with another of said packets due to at least one formal media subgroup thereof being identical to said other of said packets, or one of said packets is capable of forming an indirect non-mutually independent relationship with another of said packets not having a direct non-mutually independent relationship therewith via one or more of said packets having a direct non-mutually independent relationship with each other;

one of the non-mutually independent packet sets logically corresponds to a relatively independent service domain;

3. The method of claim 2, wherein the step of sending offer information for the target service to the second communication device is preceded by the step of:

4. The method according to claim 3, wherein the step of grouping and sorting the media formats of the media of different forms in the media streams related to the target service according to the correspondence and the precedence preference order comprises:

compiling the media formats with the same corresponding relation into one group or equivalent multiple groups;

the grouping comprises an individual correspondence grouping and a multivariate correspondence grouping;

wherein, the media formats with the same kind of corresponding relation are at least partial media formats of one or more media in different media streams related to the target service;

the condition of corresponding to at least part of the media formats of one form of media in each media stream is called an individual corresponding relationship, and the correspondingly compiled groups are called individual corresponding relationship groups;

the condition of corresponding to at least part of media formats of two or more types of media in each media stream is called non-individual corresponding relation or multi-element corresponding relation, and the correspondingly compiled grouping is called non-individual corresponding relation grouping or multi-element corresponding relation grouping;

the equivalence relation of the grouped one and the grouped equivalent is embodied as:

the corresponding relation and the precedence preference sequence indicated by one group and the corresponding sorting information are the same as the corresponding relation and the precedence preference sequence indicated by a plurality of groups and corresponding sorting information which are coded to be equivalent to the group and the corresponding sorting information.

5. The method according to claim 4, wherein the step of formatting the media having the same correspondence into one packet or into a plurality of equivalent packets comprises:

grouping the corresponding second media formats according to the non-independent corresponding relation determined according to the target service, namely, according to the sequencing information of the grouped or equivalent media groups in the form that the corresponding second media formats are required to be included, which is determined according to the service domain precedence preference sequence of the service domain where the non-independent corresponding relation is located, firstly, incorporating the first second media format into the corresponding media group to be grouped into one grouped or equivalent media groups, and then, incorporating the second media formats of other media in the same or different forms of the same or different media streams with the same non-independent corresponding relation into the corresponding media groups according to the relative precedence preference sequence to be grouped into the first second media format;

alternatively, the first and second electrodes may be,

according to the individual corresponding relation determined according to the target service, incorporating the corresponding unique second media format into the corresponding individual form media group to compile one group or a plurality of equivalent groups;

simultaneously, according to ranking information of media formats in one or a plurality of equivalent grouped formal media groups into which corresponding second media formats need to be brought, which is determined according to the service domain precedence preference order of the service domain where the non-individual or individual corresponding relationship is located and determined by the target service, and/or relative ranking information among a plurality of equivalent grouped formal media groups, ranking the media formats in each corresponding formal media group in each group of the second media formats corresponding to the non-individual/individual corresponding relationship, and/or ranking the plurality of equivalent grouped media;

wherein, the second media format is a part or all media formats of a form of media under a media stream related to the target service;

the priority order of the service domains is determined by the target service, that is, the following contents are determined by the priority order rule of the service domains of the target service:

ranking information of one or a plurality of equivalent grouped formal media subgroups corresponding to each corresponding relation in the service domain, ranking information of media formats in one or a plurality of equivalent grouped formal media subgroups, and relative ranking information among a plurality of equivalent subgroups;

the service domain corresponds to the ordering information of the formal media groups in the non-mutually independent grouping set, the ordering information of the media formats in the grouped formal media groups and the ordering information among the groups;

the priority preference order rule of the service domain comprises the priority preference order among the different corresponding relations of the service domain, the priority preference order among the media in each form of each media stream related to each corresponding relation in the service domain, and the priority preference order among the media formats in each form of media.

6. The method according to claim 3, wherein the step of grouping and sorting the media formats of the media of different forms in the media streams related to the target service according to the correspondence and the precedence preference order further comprises:

when the first grouping is a multi-element corresponding relation grouping, sequentially taking the at least two groups of divided media formats and compiling the at least two groups of divided media formats and each other-form media subgroup in the first grouping into at least two groups equivalent to the first grouping according to the relative adjacent sequence between the at least two groups of divided media formats;

alternatively, the first and second electrodes may be,

when the first grouping is a grouping with an individual corresponding relationship, sequentially taking the at least two groups of divided media formats and directly compiling the at least two groups of divided media formats into at least two groups equivalent to the first grouping according to the relative adjacent sequence between the at least two groups of divided media formats;

by analogy, at least two groups equivalent to a first group are continuously divided until at most second groups equivalent to the first group;

wherein, the first grouping is the grouping which is divided into at least two groups equivalent to at least two groups by the method in a mode that the relative adjacency sequence of the media formats of at least two of the media subgroups in at least one divisible form is unchanged;

7. The method according to claim 3, wherein the step of grouping and sorting the media formats of the media of different forms in the media streams related to the target service according to the correspondence and the precedence preference order further comprises:

dividing each first packet in a non-mutually independent packet set into equivalent packets to arrange the sequencing information and the relative sequence of each packet so as to obtain the correspondence and the precedence preference sequence indicated by the packet information consistent with the correspondence and the precedence preference sequence determined by the service;

wherein dividing each first packet in the non-mutually independent packet set into equivalent packets to sort the sequence information of each packet and the relative sequence therebetween comprises:

dividing a first packet into said packets equivalent thereto so as to insert respectively before or after one or more of said packets other of said packets in said set of non-mutually independent packets in which they are not fully contained and which are adjacent before or after one or more of said packets in relative order; the other groups are other first groups and other second groups which can execute the inserting operation without continuous division in the non-mutually independent group set where the first group is located, and the first group and the second group which can execute the inserting operation without continuous division in the groups which are divided from the other first groups and are equivalent to the first groups;

dividing a first packet into equivalent packets to eliminate the packets completely contained in the previously processed packet information, and then inserting one or more packets not completely contained in the previously processed packet information before or after the packets in the packet information according to a relative sorting adjacency relationship, wherein the other packets are the first packet and the second packet which can perform the inserting operation without continuously dividing in the non-mutually independent packet set where the first packet is located, and the first packet and the second packet which can perform the inserting operation without continuously dividing in the equivalent packets divided by the other first packets;

8. The method according to claim 3, wherein the step of grouping and sorting the media formats of the media of different forms in the media streams related to the target service according to the correspondence and the precedence preference order further comprises:

grouping two or more media subgroups which are not mutually independent and are adjacent in a relative sequencing way in a grouping set, wherein the two or more media subgroups have the same form and only have different media formats related in the same form of media subgroup, and grouping the two or more groups into a first group which has different media formats and is adjacent together, and has the same related media formats, wherein the related media formats are not changed in each form of media subgroup with the same related media format, and so on, at most, the first group is grouped until any two groups which are adjacent in the relative sequencing way in the grouping set are different in form media subgroup or the related media formats of the two or more forms of media subgroups are different although the two or more groups have the same form media subgroup;

and combining the groups which are not mutually independent and are relatively sequenced and adjoined together into a first group according to the corresponding relation indicated by the groups and the principle that the relative precedence preference order is consistent, so that the finally obtained group information contains fewer or least groups of the groups.

9. The method according to claim 3, wherein the step of grouping and sorting the media formats of the media of different forms in the media streams related to the target service according to the correspondence and the precedence preference order further comprises:

all the groups correspond to all the corresponding relations of the service domains corresponding to the non-mutually independent group sets, and all the corresponding relations of the service domains corresponding to the non-mutually independent group sets also correspond to all the groups;

the all sequencing information indicates the priority of the service domains;

when all the groups are represented by one or more equivalent second groups, the one or more equivalent second groups of each group in all the groups should be adjacent together in sequence, and the relative sequence of the second groups should meet the priority order requirement of the service domain;

wherein, the service domain priority order is determined by the target service, that is, determined by the priority order rule of the service domain of the target service:

10. The method according to claim 4, wherein the step of formatting the media having the same correspondence into one packet or into a plurality of equivalent packets comprises:

the relative precedence preference order of each media format in the media in the form corresponding to the second media format corresponding to the non-independent or independent corresponding relation determined according to the target service is determined by the relative precedence preference order of each media format combination in the media format combination set corresponding to the non-independent corresponding relation;

wherein the content of the first and second substances,

the media format combination set of one group corresponding to the same corresponding relation and a plurality of groups equivalent to the group is the same as the media format combination set of the same corresponding relation;

the grouping of one media format combination corresponding to the same corresponding relation and one or more media format combination groups equivalent to a plurality of groups equivalent to the grouping of the same corresponding relation refer to that the media format of each form of media in each media format combination in the media format combination set of the same corresponding relation is respectively used as the media format of each form of media in each media format combination group, and the one or more media format combination groups are obtained according to the relative precedence preference sequence of each form of media related to the same corresponding relation, which is determined by the precedence preference sequence of each media format combination in the media format combination set of each corresponding relation corresponding to all corresponding relations under the same service domain and determined according to the target service;

the grouped equivalent single media format combination grouping set is a set of the media format combination obtained by respectively taking one media format from the media formats under each form of media of the grouping and combining.

11. A media negotiation method applied to a second communication device, the method comprising:

and sending the response information to the first communication equipment.

12. A first communications device, comprising:

13. A second communications device, comprising:

14. A communication device comprising a memory, a processor, and a program stored on the memory and executable on the processor; characterized in that the processor implements the steps in the media negotiation method according to any one of claims 1 to 10 or implements the steps in the media negotiation method according to claim 11 when executing the program.

15. A readable storage medium, having stored thereon a program, which, when being executed by a processor, carries out the steps of the media negotiation method according to one of the claims 1 to 10 or the steps of the media negotiation method according to claim 11.