CN114302353B

CN114302353B - Media negotiation method, communication device and readable storage medium

Info

Publication number: CN114302353B
Application number: CN202111664710.0A
Authority: CN
Inventors: 侯冠军
Original assignee: China Mobile Communications Group Co Ltd; MIGU Music Co Ltd; MIGU Culture Technology Co Ltd
Current assignee: China Mobile Communications Group Co Ltd; MIGU Music Co Ltd; MIGU Culture Technology Co Ltd
Priority date: 2021-12-31
Filing date: 2021-12-31
Publication date: 2023-10-20
Anticipated expiration: 2041-12-31
Also published as: CN114302353A

Abstract

The invention provides a media negotiation method, a communication device and a readable storage medium, belonging to the technical field of communication, wherein the media negotiation method applied to a first communication device comprises the following steps: the method comprises the steps that offer information aiming at a target service is sent to second communication equipment, the offer information comprises information of each media format of each form of media in each media stream related to the target service and grouping information of the media formats, the grouping information can indicate corresponding relations of each media format of each form of media in each media stream related to the target service, and the corresponding relations are determined by the target service; and receiving response information sent by the second communication equipment according to the offer information. The invention can rapidly negotiate the media negotiation result meeting the service requirement.

Description

Media negotiation method, communication device and readable storage medium

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a media negotiation method, a communications device, and a readable storage medium.

Background

The current media negotiation method is generally a mode of negotiating each media type or each form of media respectively, but the negotiated result of the negotiation mode sometimes cannot meet the service requirement. For example, in the video color ring service, the audio coding format and the video coding format in the media file of the video color ring content are fixed, that is, there is a corresponding relationship between the two, if the audio media stream capability and the video media stream capability are adopted to respectively negotiate, the corresponding relationship cannot be transferred and expressed in the negotiation process. This easily causes a problem that the audio media format and the video media format in the negotiation result do not correspond to the media file of the video color ring class content to be played. Particularly, under the condition that the audio coding format and the video coding format in the media file of the video color ring content are respectively multiple, the probability that the negotiated result cannot meet the playing of the media file of the video color ring content is higher.

Disclosure of Invention

In view of the above, the present invention provides a media negotiation method, a communication device, and a readable storage medium, which are used for solving the problem that the negotiation result is easy to occur and the service requirement cannot be satisfied in the current media negotiation mode of each media type or each form of media.

In order to solve the above technical problem, in a first aspect, the present invention provides a media negotiation method, which is applied to a first communication device, and includes:

the method comprises the steps that offer information aiming at a target service is sent to second communication equipment, the offer information comprises information of each media format of each form of media in each media stream related to the target service and grouping information of the media formats, the grouping information can indicate corresponding relations of each media format of each form of media in each media stream related to the target service, and the corresponding relations are determined by the target service;

and receiving response information sent by the second communication equipment according to the offer information.

In a second aspect, the present invention further provides a media negotiation method, applied to a second communication device, including:

receiving offer information for a target service sent by a first communication device, wherein the offer information comprises information of each media format of each form of media in each media stream related to the target service and grouping information of the media formats, the grouping information can indicate a corresponding relation of each media format of each form of media in each media stream related to the target service, and the corresponding relation is determined by the target service;

Generating response information according to the grouping information of the media formats, wherein the response information comprises the media formats which need to be responded in each grouping;

and sending the response information to the first communication equipment.

In a third aspect, the present invention further provides a media negotiation configuration method, applied to a first communication device, including:

transmitting configuration information to the second communication device; or alternatively, the process may be performed,

receiving configuration information sent by second communication equipment;

wherein the configuration information comprises a grouping configuration information set and a media format configuration information set;

the grouping configuration information set and the media format configuration information set are used for indicating each media format of each form of media in each media stream related to a target service and grouping information of the media format;

the grouping information can indicate the corresponding relation of each media format of each form of media in each media stream related to the target service, and the corresponding relation is determined by the target service.

In a fourth aspect, the present invention also provides a first communication device, comprising:

an offer sending module, configured to send offer information for a target service to a second communication device, where the offer information includes information of each media format of each form of media in each media stream related to the target service and packet information of the media formats, where the packet information can indicate a correspondence relationship between each media format of each form of media in each media stream related to the target service, where the correspondence relationship is determined by the target service;

And the response receiving module is used for receiving response information sent by the second communication equipment according to the offer information.

In a fifth aspect, the present invention also provides a second communication device, including:

an offer receiving module, configured to receive offer information for a target service sent by a first communication device, where the offer information includes information of each media format of each form of media in each media stream related to the target service and packet information of the media formats, where the packet information can indicate a correspondence relationship between each media format of each form of media in each media stream related to the target service, and the correspondence relationship is determined by the target service;

the response generation module is used for generating response information according to the grouping information of the media formats, wherein the response information comprises the media formats which need to be responded in each grouping;

and the response sending module is used for sending the response information to the first communication equipment.

In a sixth aspect, the present invention also provides a first communication device, comprising:

the configuration sending module is used for sending configuration information to the second communication equipment; or alternatively, the process may be performed,

the configuration receiving module is used for receiving configuration information sent by the second communication equipment;

In a seventh aspect, the present invention also provides a communication device comprising a memory, a processor, and a program stored on the memory and executable on the processor; the processor, when executing the program, implements the steps of the method in the first aspect, the second aspect or the third aspect.

In an eighth aspect, the present invention also provides a readable storage medium having stored thereon a program which when executed by a processor performs the steps in the method of the first, second or third aspects described above.

The technical scheme of the invention has the following beneficial effects:

in the embodiment of the invention, a grouping negotiation mechanism is superimposed on the basis of a basic media negotiation scheme, specifically, an offerer carries grouping information of media formats determined according to the service correspondence of the target service in offer information so as to transmit the correspondence of each media format of each form of media in each media stream related to the target service in the target service to a responder. Alternatively, the grouping information may be preconfigured. The responder can generate a response result capable of meeting the service corresponding relation of the target service according to the grouping information, so that the service requirement of accurately realizing the corresponding relation on the service among the media formats of the media in each form in each media stream in the target service through one-time negotiation and synchronizing the negotiation result according to the requirement of maintaining the corresponding relation in the negotiation result can be met. The negotiation is completed by rapid convergence, so that service negotiation time delay is greatly saved, error probability caused by repeated negotiation is avoided, timeliness and success rate of service reaching a user are ensured, and service experience of the user is improved; the negotiation is completed by rapid convergence, a large amount of contents are not involved, transcoding playing is not involved, the service experience is best, the system support requirement is reasonable, and the cost of content production, quality control, content storage equipment, media playing equipment and the like is lowest; the fast negotiation accurately approves the playing content, and the content can ensure the playing of the high-quality file according to the terminal and network conditions by only manufacturing fewer high-quality media files according to the service requirements; the service experience is best, and meanwhile, the content management is flexible, the service operation can be focused, and the sustainable development can be realized; the fast negotiation accurately approves the play content, and accurately applies network resources and bandwidth as required, thereby avoiding network resource waste and network impact caused by the first virtual height and multiple negotiations.

Drawings

Fig. 1 is a schematic illustration of a video color ring back tone media negotiation flow under a Precondition flow;

fig. 2 is a flow chart of a media negotiation method according to a first embodiment of the invention;

fig. 3 is a flow chart of a media negotiation method in a second embodiment of the present invention;

fig. 4 is a flow chart of a media negotiation configuration method in the third embodiment of the present invention;

fig. 5 is a flow chart of a media negotiation configuration method in a fourth embodiment of the present invention;

fig. 6 is a flow chart of a media negotiation method in a fifth embodiment of the present invention;

fig. 7 is a schematic structural diagram of a first communication device in a sixth embodiment of the present invention;

fig. 8 is a schematic structural diagram of a second communication device in a seventh embodiment of the present invention;

fig. 9 is a schematic diagram of a media negotiation system according to an eighth embodiment of the present invention;

fig. 10 is a schematic structural diagram of a first communication device according to a ninth embodiment of the present invention;

fig. 11 is a schematic structural diagram of a first communication device according to a tenth embodiment of the present invention;

fig. 12 is a schematic structural diagram of a communication device in accordance with an eleventh embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention more clear, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. It will be apparent that the described embodiments are some, but not all, embodiments of the invention. All other embodiments, which are obtained by a person skilled in the art based on the described embodiments of the invention, fall within the scope of protection of the invention.

In the related art, in the field of communication services such as audio and video call, related audio and video color ring, audio and video notification, media negotiation such as audio and video is generally performed based on a standard session description protocol (SDP, session Description Protocol) offer/answer (answer) model, and a service side and a terminal side respectively negotiate media capabilities such as audio and video to play service media contents such as audio and video color ring.

Taking the ring back tone media negotiation of video ring back tone AS an example, please refer to fig. 1 for the negotiation flow, wherein, the ring back tone service platform (CAT AS, customized Alerting Tone Application Server) initiates a first Update (Update) message of the video ring back tone media negotiation to the calling terminal (UE-a), and the terminal responds according to the self-voice and video media capability conditions to determine the final video ring back tone media negotiation result, wherein, the video media stream description and the audio media stream description generally only carry H264/CBP (limited baseline configuration (CBP, constrained Baseline Profile)) video coding and wideband adaptive multi-rate voice (AMR-WB, adaptive Multi Rate-Wide Band) audio coding respectively. That is, the media negotiation scheme of the current color ring application inherits the media negotiation scheme of the SDP offer/answer model of the existing foundation, and the media negotiation scheme is mainly designed for session service scenes between user equipment such as audio and video calls, and in the service scenes, the user equipment of the participant generally corresponds to the service scenes with audio and video input and output capability and real-time audio and video coding and decoding capability, so that the method for negotiating voice and video coding capability between the participants respectively can meet the service scene requirements such as audio and video calls.

In the application of the polyphonic ringtone service, the platform generally plays the media file of the polyphonic ringtone content to the terminal, and the audio coding format and the video coding format in the media file are both fixed, namely, the corresponding relation exists between the media file and the media file, but because the media negotiation scheme of the current polyphonic ringtone service inherits the media negotiation scheme of the current foundation, the mechanism of respectively negotiating the audio and video media stream capability cannot indicate the corresponding relation in the SDP and cannot act on the response processing requirement of a responder, the function of quickly completing the media negotiation capable of expressing the corresponding relation cannot be realized, and the method has obvious limitation.

In the early stage of business development, because of the limitation of terminals, network factors and the like, the audio and video coding formats of the media files are fixed into one type, the coding capability requirement is also relatively fixed, and the corresponding relation is also unique. Therefore, under the background that the coding and decoding capability and the media negotiation requirement are correspondingly agreed through the specifications, the media negotiation of the CRBT class application (hereinafter referred to as "CRBT media negotiation", hereinafter referred to as the same) adopts the fixed audio and video media stream coding and decoding capability to carry out negotiation, so that the initial service requirement can be met.

However, with the upgrade of terminals, networks and audio/video encoding and decoding technologies, and with the spreading of new audio/video encoding standards, in order to improve the service experience of the polyphonic service application and cope with the impact of increasing bandwidth demands on the network caused by the improvement of the service experience, the media files of the polyphonic content also need to introduce new audio/video encoding standards to manage the media file making standards and making specifications ("media file making specifications" are abbreviated as "specifications", and the following is also needed). Correspondingly, the color ring media negotiation scheme also needs to increase the support of the negotiation of the encoding and decoding capabilities of the new audio and video coding standard formats.

The CRBT type application service platform constructs a CRBT media negotiation SDP according to all audio and video coding capability requirements required by audio and video coding contained in media files of all contents to be played, and finally selects the media files of the contents meeting the audio and video coding capability requirements of the negotiation result according to the negotiation result to play to the user terminal equipment after the CRBT media negotiation is completed. Correspondingly, the description of the audio and video media streams of the SDP offer needs to be respectively introduced with the payload type media format description information row (called as PT row for short) of various coding standards.

Under the background, the media negotiation processing is continuously carried out by adopting a mechanism of respectively negotiating the audio and video media capabilities, so that the media negotiation result requirement that the first negotiation handshake cannot finish the service layer can possibly occur, namely, the problem that playable content media files cannot be selected according to the results of respectively negotiating the audio and video media capabilities can not occur, and the following effects can be generated:

firstly, if media files of all specifications are not manufactured for each piece of content, but a mode of renegotiation or transcoding playing is adopted by the color ring platform to solve the problem, the user service experience is obviously affected, the network bandwidth resource waste is caused, or huge cost is brought, and the user service experience is affected. Namely:

the color ring service is sensitive to play delay, and the time consumption of media negotiation needs to be reduced as much as possible. If the color ring platform combines the content media files, according to the negotiation result of one media, adding the capability of the other media to carry out the secondary handshake negotiation, the problem that the handshake negotiation still needs to be continued may still occur, even the unsuccessful negotiation occurs, thereby significantly affecting the user service experience. In addition, each time of negotiation, the terminal applies for resources and bandwidth to the network according to the negotiation result, and initially defaults to apply for resources and bandwidth according to the higher coding and decoding capability requirement of service support, and negotiates for multiple times, the impact on the network is caused by the high bandwidth requirement, or the impact and waste on the network processing capability are caused by the requirement of the resource and bandwidth application operation of multiple times of negotiation, and the possibility of processing problems is increased, so that the network is impacted, the network resource waste is caused, and the service experience is affected. Moreover, with this mechanism, the problem is more pronounced in the case of more than two media or multiple media.

The color ring service has huge play volume, and transcoding needs to be avoided to reduce the system performance requirement. If transcoding playing is performed by the CRBT platform according to the negotiation result, the transcoding processing of the audio and video can improve the performance requirement of the system by several times and ten times, so that huge cost is brought, and meanwhile, the time delay and the quality loss introduced by transcoding playing are not longer than those of the playing effect, and the service experience of the CRBT can be influenced if the user selects the best content media file playing without transcoding.

Secondly, if the renegotiation or transcoding playing is not initiated by the polyphonic ringtone platform, but the problem is solved by adopting a mode of making and distributing media files with all specifications for each piece of content, the problems of high making and storing cost, inability to select the optimal content playing for users, inability to sustainability and the like are caused, and the practical operability is not achieved. Namely:

the content of the color ring service is huge, and with the application of new audio and video coding standards, the number of the content media file manufacturing specifications with different audio and video coding and capability requirements in the future is numerous, and the number of the content media file manufacturing specifications is always increased. Therefore, the manner of creating and distributing all the specifications of media files for each piece of content brings about huge creating and storing costs, and although the scheme can theoretically ensure that the specific content can always be played when the negotiation is successful, the scheme is limited by the technical characteristics of the content, the video quality of the media files with various specifications is also irregular, and the service playing effect is not necessarily better than the implementation manner of selecting the corresponding media files which meet the negotiation result and only provide suitable alternative contents of a small number of standard media files.

In addition, the scheme also can not well solve the problem of sustainable development caused by adding and manufacturing new-specification media files for old contents when the media file manufacturing specifications required by the new audio and video encoding and decoding capabilities are increased, so that the scheme also has no practical operability.

In summary, for the media negotiation of the current color ring service, if the requirement of multi-PT line media negotiation is not introduced, the application of the new technology and the development of the service are hindered. If the requirement of multi-PT line media negotiation is introduced, but the scheme of the current media stream media capability difference negotiation is not changed, the problems of cost, service experience, network resource waste, network impacted, service management and the like are brought.

Of course, the above problems exist in the media negotiation process of not only video color ring, but also in other media negotiation processes such as audio-video call, if there is a corresponding relation on the business between each media type or each form of media.

Referring to fig. 2, fig. 2 is a flowchart of a media negotiation method according to a first embodiment of the present invention, the method is applied to a first communication device, and includes the following steps:

step 21: the method comprises the steps that offer information aiming at a target service is sent to second communication equipment, the offer information comprises information of each media format of each form of media in each media stream related to the target service and grouping information of the media formats, the grouping information can indicate a corresponding relation among each media format of each form of media in each media stream related to the target service, and the corresponding relation is determined by the target service;

Step 22: and receiving response information sent by the second communication equipment according to the offer information.

The grouping table set rule in the embodiment of the application is as follows:

the grouping rule for the payload type media description line (abbreviated as "PT line", hereinafter the same) of the same or different forms of media under each media stream description of the same or different media types in SDP is:

1) The PT rows of all media of the same or different forms with common correspondence under the description of each media stream of the same or different media types are all organized into a group expressing the corresponding common correspondence or a plurality of groups equivalent to the same group, and the PT rows form groups under the groups according to the media streams and the media streams of different forms. Each PT line with a common corresponding relation should be encoded into one packet, or after being logically encoded into one packet, the corresponding PT lines corresponding to any certain form of media under any certain media stream description are split to be encoded into different packets, and the corresponding packets are further split into a plurality of packets by an equivalent combination splitting method, and the like, so that more packets can be split. (principle of grouping)

For example (example 1): the PT lines corresponding to H264/CHP codes under the description of a certain video (video) media stream, the PT lines corresponding to H264/CBP codes under the description of a certain audio (audio) media stream and the PT lines corresponding to AMR-WB codes under the description of a certain audio (audio) media stream have a common corresponding relationship, and the PT lines corresponding to the event form of a telephone-event are organized into a group, wherein the first two PT lines are taken as a group, the third PT line is taken as a group, and the fourth PT line is taken as a group. Or equivalently, the PT line corresponding to the H264/CHP coding under the corresponding video media stream description, the PT line corresponding to the AMR-WB coding under the corresponding audio media stream description and the PT line corresponding to the text-event telephone event form are grouped into one group, and the PT line corresponding to the H264/CBP coding under the corresponding video media stream description, the PT line corresponding to the AMR-WB coding under the corresponding audio media stream description and the PT line corresponding to the text-event form are grouped into one group, wherein three PT lines in two groups are respectively used as one group.

2) If there is no correspondence between all PT rows of a certain form of media (such as AMR-WB encoding) under a certain media stream description of a certain media type (video or audio), all PT rows of the form of media may not be grouped, may be regarded as having an independent correspondence, and may be integrally grouped into one group, or may be logically integrally grouped into one group, and then, by splitting all PT rows of the form of media into different groups, all existing groups may be re-decomposed into a plurality of groups by an equivalent combination splitting method, and may be so divided into more groups.

In addition, it can be forced to be generally corresponding to other all the packets, and the existing packets can be integrally organized into all the existing packets, or logically, after all the existing packets are integrally organized into all the existing packets, all the existing packets can be re-decomposed into a plurality of packets by splitting all PT lines of the form medium into different packets in an equivalent combination splitting method, and the like, and the packets can be split into more packets.

For example (example 2): assuming that the PT line in the form of a text-event telephone event and all other PT lines do not have a correspondence in the description of the audio media stream in example 1, the PT line may not be grouped or may be independently grouped, but the PT line in the form of the text-event telephone event, the PT line in the description of the audio media stream, the PT line in the form of the text-event telephone event may be grouped into one group. Or equivalently, the PT line corresponding to the H264/CHP code under the corresponding video media stream description, the PT line corresponding to the AMR-WB code under the corresponding audio media stream description and the PT line corresponding to the text-event telephone event form are grouped into one packet, and the PT line corresponding to the H264/CBP code under the corresponding video media stream description, the PT line corresponding to the AMR-WB code under the corresponding audio media stream description and the PT line corresponding to the text-event telephone event form are grouped into one packet.

3) Wherein a PT line or lines of a certain form of media (e.g. H265/MP encoded) under a certain media stream description of a certain media type (video or audio), if a correspondence needs to be grouped with one or more PT lines of another form of media under a certain same or other media stream description, all PT lines under the form of media must be grouped into a certain packet or packets expressing these correspondences for confirming that they are actually determined, and the equivalent splitting manner of each of these packets into a plurality of peer packets is the same as before. In other words, if some PT rows not yet grouped under the formal media are selected not to be grouped, due to the constraint of grouping constraint of PT rows grouped under the formal media, various corresponding relations related to the PT rows cannot be normally presented, and even if the PT rows appear under the corresponding formal media in the SDP, the PT rows cannot be used by services, i.e. if the PT rows are not grouped, the PT rows cannot appear under the corresponding formal media, and even if the PT rows appear, the PT rows are ignored in subsequent negotiations.

For example (example 3): the unique video media stream description in the service SDP comprises an H265/MP encoded PT line, an H264/CHP encoded PT line and an H264/CBP encoded PT line, and the unique audio media stream description comprises an EVS encoded PT line, an AMR-WB encoded PT line and a PT line corresponding to a telephone-event type. If the H264/CHP encoded PT line, the H264/CBP encoded PT line and the AMR-WB encoded PT line are encoded as one packet, then the other H265/MP encoded PT line of the form media in which the video media stream occurs, the other EVS encoded PT line of the form media in which the audio media stream occurs, must be declared their respective possible correspondence by the packet, one possible case being that the H265/MP encoded PT line and the EVS encoded PT line, the AMR-WB encoded PT line together constitute one packet, and the packet needs to be preferred over the previous packet. Furthermore, AMR-WB encoded PT rows under audio media stream only have to be grouped separately to represent this correspondence, since they are to be used independently in a scenario where traffic is degraded to audio, since they have been incorporated into the first two packets and thus cannot appear alone in the negotiation result as needed. In addition, PT rows in the form of a telephone-event-type PT stream of audio media should be treated as in example 2 because no other PT rows of the form of media are grouped, and the PT rows do not necessarily have to have a correspondence with the PT rows of audio-video media on the service.

Optionally, the packet information further includes ordering information, where the ordering information is used to indicate a precedence order including, but not limited to, a precedence order determined by the target service:

in the grouping information of the media format, the priority sequence among the grouping indicated by the sorting information among the grouping belonging to the same non-mutually independent grouping set;

a priority sequence among the form media indicated by the ordering information among the form media subgroups in the grouping of the media format;

a precedence order among the media formats indicated by ordering information among media formats in a formal media team in the grouping of media formats;

wherein one of said packets forms a direct non-mutually independent relationship with another of said packets due to at least one of said packets being identical to said other of said packets, or one of said packets can form an indirect non-mutually independent relationship with another of said packets that does not form a direct non-mutually independent relationship with one or more of said packets that have a direct non-mutually independent relationship with one another; a relationship that is not independent of each other, i.e., a relationship that is not independent of each other;

All of the packets having these direct and indirect non-mutually independent relationships together comprise the non-mutually independent packet set;

one of the non-mutually independent sets of packets logically corresponds to a relatively independent service domain; the relatively independent service domain is also called a service domain;

the grouping information in the media format includes one or more of the groups in the non-mutually independent grouping set, and the corresponding relationship is that the one or more non-mutually independent grouping sets respectively correspond to one or more service domains one by one.

The formal media team is a team made up of all media formats belonging to the same formal media in the same media stream in one of the groupings.

In the grouping information of the media format, the grouping without direct and indirect non-mutually independent relations belongs to different non-mutually independent grouping sets, and the grouping without direct and indirect non-mutually independent relations belongs to the grouping in the different non-mutually independent grouping sets and has mutually independent relations; mutually independent relations, namely mutually independent relations;

in the grouping information of the media format, the relative ordering among the groupings with mutually independent relations does not indicate the sequence of preference among the groupings, so that the relative ordering among the groupings can be freely adjusted without reference when the groupings are respectively processed; the corresponding relations in different service domains in the corresponding relations are logically independent, and the priority order determined by the target service does not exist.

The precedence order among the packets of the non-mutually independent sets of packets is a first dimension for indicating the precedence relationship of the outermost layer; the precedence order among the formal media subgroups in the grouping is of a second dimension, and is used for indicating the precedence relation of each middle layer in the outermost layer; the precedence order among the media formats in the formal media team is third-dimensional and is used for indicating the precedence relation of the innermost layer in each middle layer in the outermost layer;

the non-mutually independent grouping sets, and part or all of the first-dimension precedence preference relations can be equivalently converted into third-dimension precedence preference relations. When all first-dimension preferential relationships in one non-mutually independent grouping set can be equivalently converted into third-dimension preferential relationships, namely, only one grouping in the non-mutually independent grouping set is converted, the non-mutually independent grouping set does not have the first-dimension preferential relationships in the form, and when all the non-mutually independent grouping sets in the grouping information do not have the first-dimension preferential relationships in the form, the grouping information does not have the first-dimension preferential relationships in the form; when a plurality of groups exist in one non-mutually independent group set, the non-mutually independent group set and the group information have a first-dimension priority relation in a form;

When only independent groups or the groups equivalent to the independent groups exist in one non-mutually independent group set, the non-mutually independent group set does not have a second-dimension priority relation in a form, and when each non-mutually independent group set does not have a second-dimension priority relation in the group information in the form, the non-mutually independent group set does not have a second-dimension priority relation in the group information in the form; when a plurality of groups exist in one non-mutually independent group set, the non-mutually independent group set and the group information have a second-dimensional precedence preference relationship in a form;

when only independent grouping exists in one non-independent grouping set and only one media exists in a unique form of the media group, the non-independent grouping set does not have a third-dimensional precedence preference relationship in form, and when each non-independent grouping set does not have the third-dimensional precedence preference relationship in the grouping information in form, the grouping information does not have the third-dimensional precedence preference relationship in form; when more than one media format exists in each media format of each media stream of each target service related to the packet in one non-mutually independent packet set belongs to the same media format, the non-mutually independent packet set and the packet information have a third-dimensional priority relation in form.

All media formats of a form of media in a media stream related to all of said packets in one of said non-mutually independent sets of packets shall be all media formats of that form of media in the corresponding media stream related to said target service.

The packet ordering rule in the embodiment of the invention is as follows:

the ranking rule for all packets in SDP offer that have been grouped according to the service, each form of media group in the packet, each payload type media description line (abbreviated as "PT line", below) of each form of media group in the packet is:

1) A one-dimensional sequence structure (arrangement relation among PT line groups) is arranged among the PT line groups in the SDP, and each group is used for representing the corresponding relation among PT lines of a certain or a plurality of forms of media related under a certain or a plurality of media stream descriptions supported by a service; the PT line group is a two-layer structure, the first layer is a one-dimensional sequence structure of each form of media described by different or same media streams in the group (the combination relationship between each form of media is actually an arrangement relationship), and the second layer is a one-dimensional sequence structure of each PT line of each form of media (the arrangement relationship between each PT line of each form of media);

2) The packets are sequenced according to the priority sequence of the PT line combination set of the packets indicated by the corresponding relation among PT lines of the media in each form under each media stream description of the packet representation relative to the application sequence of the PT line combination set of all the packets in the SDP. Wherein:

the "PT line combination set" of the packet refers to a PT line taken from each PT line under each form of media in the packet, and a "PT line combination" is obtained by combining the PT lines in the order of the form of media groups (possibly as a result of negotiation response of the responder media), and so on, and the obtained set of all possible "PT line combinations" of the packet is called "PT line combination set" of the packet.

In the processing, if the partial subset preference relation of the "PT line combination set" of the packet is higher than the partial subset or all of the "PT line combination set" of the other packets, and the partial subset preference relation is lower than the partial subset or all of the "PT line combination set" of the other packets, then the related packets need to be equivalently split, the relative ordering is adjusted, and so on until the sequence of each packet and the corresponding "PT line combination set" is consistent with the sequence preference sequence in the service.

3) And ordering the media subgroups of different or same media stream descriptions in the groups according to the sequence of media subgroups of each PT row calculated according to the sequence of preference of each PT row combination in the PT row combination set of the group by the service. The preferred locations of the groups of forms of media in the group may also be determined, generally in accordance with a preferred policy established by the service for each form of media in the group, such as the service being defined as "video form media for video is preferred over audio form media for audio and then subtitle form media for subtitle". The former formal media group in the group is in the preferred position, next preferred, and so on until the last formal media group is ranked lowest.

4) And sorting the PT rows of each media subgroup in each form according to the sequence of the PT rows calculated by the sequence preference sequence of each PT row combination in the PT row combination set of the grouping according to the service. In general, for compatibility of devices that do not support packet negotiation, the order of priority of PT rows of each formal media group is default to be consistent with the order of PT rows under each formal media under the corresponding media stream description in SDP. The PT rows in the formal media group that are ranked first are in the preferred position, then next preferred, and so on until the last PT row is ranked the lowest.

In the processing, for the "PT line combination set" of the packet obtained by calculating the packet sequence, the sequence of each "PT line combination" in the packet needs to be determined according to the service relationship, and for the "PT line combination" which needs to have the same media set and is adjacent to the service sequence, the operation of equivalently combining the corresponding "PT line combination" into the packet can be performed according to the service sequence according to the meaning of the preferential relationship between each type of media in the packet and each type of media, and after the processing is completed, the sequence of each packet and each type of media group and the sequence of each PT line in each type of media can be determined.

5) All PT lines of media in various forms under various media stream descriptions in SDP are independently organized into a group or are organized into a plurality of groups equivalent to the groups, and the groups of the PT lines and/or the PT lines of media in corresponding forms in the groups of the PT lines are ordered according to the same sequence of the media stream descriptions in SDP, the media in various forms, the PT lines of media in various forms and the like, so that the grouping and the non-grouping are completely equivalent.

6) The preference relation of each form media and the preference relation of PT rows under each form media in the grouping mean that the application sequence of the negotiation result is that after one PT row is selected under the form media subgroup at the relatively preferred position and one PT row is selected under the form media subgroup at the relatively next position immediately after that, if the combination of the two PT rows cannot be applied, the one PT needs to be selected under the form media subgroup at the relatively next position, after combination, whether the application can be performed is confirmed, and so on, if the application cannot be performed all the time, the next PT can be selected under the form media subgroup at the relatively next preferred position only when the next selectable PT is used for combination, and the PT is sequentially selected from front to back under the form media subgroup at the relatively next preferred position, the combination is formed for application attempt, and so on until the applicable combination is obtained, or until the applicable combination is not found until the traversal is completed.

Optionally, before the step of sending the offer information for the target service to the second communication device, the method further includes:

and grouping and sequencing each media format of each form of media in each media stream related to the target service according to the corresponding relation and the sequence preference order to obtain grouping information, wherein the grouping information comprises the grouping information and the sequencing information.

Optionally, the step of grouping and ordering the media formats of the media in each form in each media stream related to the target service according to the corresponding relationship and the precedence order includes:

the media formats with the same corresponding relation are organized into one group or a plurality of groups equivalent to the grouping;

the grouping includes an individual correspondence grouping and a multi-element correspondence grouping.

Wherein, the liquid crystal display device comprises a liquid crystal display device,

the media formats with the same corresponding relation are at least partial media formats of one or more forms of media in each media stream related to the target service corresponding to the media formats;

the situation of at least partial media format corresponding to one form of media in each media stream is called as single corresponding relation, and the corresponding group is called as single corresponding relation group, namely single group;

The situation of at least partial media formats corresponding to two or more media in each media stream is called as non-independent correspondence or multi-element correspondence, and the corresponding group is called as multi-element correspondence group or non-independent correspondence group, namely multi-element group or non-independent group.

The equivalent relationship of the organized one of the groupings and the organized plurality of groupings equivalent thereto is embodied as:

the corresponding relation and the sequence preference sequence indicated by the grouped corresponding to the corresponding ordering information are the same as the corresponding relation and the sequence preference sequence indicated by the grouped corresponding to the equivalent grouping corresponding to the ordering information.

The ranking information of the form media subgroups of the group and the form media subgroups of the group, the media format related to each form media subgroup and the ranking information thereof are the same as the ranking information of the form media subgroups of the group and the form media subgroups of the group, the media format commonly related to each form media subgroup, the relative ranking information of the group and the relative ranking information of the form media subgroups and the media format commonly related to each form media subgroup, and the relative ranking information of the media format commonly related to each form media subgroup are characterized by the group and the equivalent to the group.

Optionally, the step of grouping media formats having the same correspondence into one group or a plurality of groups equivalent thereto includes:

grouping the corresponding second media formats according to the non-independent corresponding relation determined according to the target service, namely sequentially including the corresponding second media formats of the same or different media streams with the same non-independent corresponding relation into the corresponding form media subgroups according to the relative priority sequence of the service domain where the non-independent corresponding relation is located;

or alternatively, the process may be performed,

and according to the independent corresponding relation determined according to the target service, the corresponding unique second media format is incorporated into the corresponding independent form media group to be organized into one group or a plurality of groups equivalent to the one group.

And sequencing each media format of each corresponding form media subgroup in each grouping of each second media format corresponding to the non-independent or independent corresponding relation according to sequencing information of media formats in each grouping or a plurality of equivalent grouping form media subgroups which are required to be included according to the service domain sequencing preference sequence of the service domain of the non-independent or independent corresponding relation determined according to the target service and/or relative sequencing information among the plurality of equivalent groupings, and/or sequencing each media format of each corresponding form media subgroup in each grouping of each second media format corresponding to the non-independent or independent corresponding relation.

the second media format is part or all of one form of media in one media stream related to the target service; the second media formats of the same form of media collectively refer to all media formats of the form of media that are one form of media in one media stream to which the target service relates.

The service domain precedence order is determined by the target service, that is, by a precedence order rule of the service domain of the target service, and is determinable according to the service domain precedence order, that is, is generatable according to the precedence rule:

The corresponding relation in the service domain corresponds to the sorting information of the group or the equivalent groups of the group form media, the sorting information of the group or the equivalent groups of the group form media format, and the relative sorting information among the equivalent groups of the group form media;

the service domain corresponds to the sorting information of the media subgroups in the forms in the groups, the sorting information of the media formats in the media subgroups in the forms of the groups and the sorting information among the groups in the non-mutually independent groups.

The precedence order rule of the service domain may include precedence order among different types of corresponding relations of the service domain, precedence order among media of each form of each media stream related to each corresponding relation in the service domain, precedence order among respective media formats in each form of media.

And according to the correspondence determined according to the target service, each second media format having the same form of media corresponding to the second media format is grouped with one or more other second media formats corresponding to the second media format into the group, and also may be independently grouped into the group only including the second media format.

Optionally, the step of grouping and ordering each media format of each form of media in each media stream related to the target service according to the corresponding relationship and the precedence order may further include:

at least two media formats in a first divisible group of forms of media are divided into at least two groups in a manner that their relative contiguous order is unchanged according to a first grouping of ordering information, and:

when the first grouping is a multi-element corresponding relation grouping, sequentially taking the at least two groups of media formats divided into at least two groups equivalent to the first grouping according to the relative adjacent sequence among the at least two groups of media formats;

or alternatively, the process may be performed,

when the first grouping is an independent corresponding relation grouping, the at least two groups of media formats are sequentially selected according to the relative adjacent sequence among the at least two groups of media formats, and the at least two groups of media formats are directly coded into at least two groups equivalent to the first grouping.

And so on, continuing to divide at least two of the packets equivalent to the first packet up to the respective second packet equivalent to the first packet.

the first grouping means that the grouping of at least two of the groupings can be divided into at least two groupings equivalent thereto by dividing the media formats of each of at least two of its at least one divisible form of media groupings in such a way that their relative contiguous order is unchanged;

the second packet refers to the packet which is not itself subdivided and which contains only one media format in its respective media team.

The first groups in the non-mutually independent group sets can be divided into groups equivalent to the first groups so as to arrange the ordering information of the groups and the relative sequence between the first groups, so that the corresponding relation and the sequence preference sequence indicated by the finally obtained group information are consistent with the corresponding relation and the sequence preference sequence determined by the service;

the basic implementation idea of dividing each first packet in the non-mutually independent packet set into equivalent packets to arrange the sequence information of each packet and the relative sequence between the packets is as follows:

a first packet is divided into said packets equivalent thereto so as to be inserted in the non-mutually independent sets of packets in which it is located, respectively, immediately preceding or following one or more of the packets, not fully contained by them, and relatively ordered immediately preceding or following one or more of the packets. The other packets are a first packet, a second packet and an equivalent packet, wherein the first packet, the second packet and the equivalent packet can be used for executing the inserting operation without continuing to divide, and the first packet and the second packet can be used for executing the inserting operation without continuing to divide, wherein the other packets are in a non-mutually independent packet set where the first packet is located;

Dividing a first packet into the packets equivalent thereto to eliminate the packets entirely contained in the packet information which has been previously processed, and inserting one or more of the packets not entirely contained in the packet information which has been previously processed respectively before or after the packets in the packet information which has been previously processed in a relative ordering adjacency relationship. The packets in the packet information are first packets which can execute the inserted operation without continuing to divide in other packets which are not independent of each other and are equivalent to the first packets and other second packets which can execute the inserted operation without continuing to divide in other packets which are divided by other first packets;

and the same is repeated until the finally obtained corresponding relation and sequence preference sequence indicated by the grouping information are consistent with the corresponding relation and sequence preference sequence determined by the service.

Merging two or more groups of mutually independent groups that are not mutually independent and have the same form of media group and that differ only in the form of media group that are involved in the group, into a first group that is not of the same form of media group that is mutually adjacent in the relative ordering adjacency order of the groups that is the different form of media group, within each form of media group that is the same as the remaining involved media groups, and so on, to a position where the merging needs to be stopped, up to a point in the set of mutually independent groups where it is visible that any two of the groups that have been determined that are mutually adjacent in part/all of the groups that are mutually ordered have different form of media groups, or that are mutually different in the form of media groups that are mutually adjacent in part/all of the groups.

The packets which are not mutually independent and are adjacent to each other in a relative ordering manner in a set can be combined into a first packet according to the principle that the corresponding relation and the relative priority sequence indicated by the packets are consistent, so that the finally obtained packet information contains fewer or least packets.

for the packets in one non-mutually independent packet set, the packets corresponding to each corresponding relation in the corresponding service domain or a plurality of equivalent packets are adopted to process, namely, the adopted packets are sequenced and de-duplicated according to the service domain priority sequence corresponding to the non-mutually independent packet set, so that all the packets and sequencing information in the finally generated non-mutually independent packet set meet the following requirements:

all the packets may correspond to all the correspondence of the service domain corresponding to the non-mutually independent packet set, and all the correspondence of the service domain corresponding to the non-mutually independent packet set may also correspond to all the packets;

the all sequencing information indicates the service domain priority sequence;

when all the packets are expressed by equivalent one or more second packets, the second packets are not repeated;

When all the packets are expressed by equivalent one or more second packets, the equivalent one or more second packets of each packet in all the packets should be adjacent together in order, and their relative order should meet the priority order requirement of the service domain.

Optionally, the step of grouping media formats having the same correspondence into one group, or into a plurality of equivalent groups includes:

the relative priority sequence of the form media of each second media format corresponding to the non-independent corresponding relation determined according to the target service is determined by the relative priority sequence of each media format combination in the media format combination set corresponding to the non-independent corresponding relation;

the relative priority sequence of each media format in the media corresponding to the second media format corresponding to the non-independent/independent corresponding relation determined according to the target service is also determined by the relative priority sequence of each media format combination in the media format combination set corresponding to the non-independent corresponding relation;

the media format combination set of the corresponding relation is a complete set of the media format combinations obtained by respectively taking one media format from each media format of each form of media related by the corresponding relation;

And the media format combination set of one grouping corresponding to the same corresponding relation and a plurality of groupings equivalent to the grouping is the same as the media format combination set of the same corresponding relation.

And the media format of each media format combination in the same corresponding relation media format combination set is respectively used as the media format of each media format combination in each media format combination group, and the relative preference sequence of each media format related to each media format combination in the same corresponding relation is determined according to the preference sequence of each media format combination in the union of the media format combination sets of each corresponding relation in the same service domain, which is determined according to the target service, and is used as the sequence of each media format group in each media format combination group, so as to obtain the one or more media format combination groups.

The grouped media format combination set is a set of media format combinations obtained by respectively taking one media format from each media format of each form of media of the group and combining the media formats according to the sequence of the form media groups.

Optionally, the offer information may further include:

a first media format that does not require grouping;

the first media formats have independent relations, each first media format is all media formats of one form of media of one media stream related to the target service, and relative ordering information among corresponding media format descriptions in media stream description information of the media formats is directly used for indicating a priority sequence among the media formats;

the independent relationship refers to that any one of all media formats of each first media format can be considered to have no corresponding relationship with any one of the media formats of other forms of media under the same or different media streams related to the target service.

Optionally, the grouping includes a separate independent relation grouping;

the step of grouping media formats having the same correspondence into one group or into a plurality of equivalent groups comprises:

separately grouping the first media formats into one of said separate independent relationship groupings or an equivalent plurality of said separate independent relationship groupings;

the first media format is all media formats of one form of media of one media stream related to the target service, and no corresponding relation exists between the first media format and any one of the media formats of other forms of media in the same or different media streams related to the target service.

Alternatively, there may be only one packet in a non-mutually independent packet set and having only one form of media group or all the packets may be pooled into one packet having only one form of media group, and then the packets in the non-mutually independent packet set and having only one form of media group or the packets having only one form of media group pooled together by all the packets are independent individual packets;

that is, the overall media formats of the unique form media in the independent individual packets have independent relationships, and all media formats of the unique form media in the independent individual packets are all media formats of one form media of one media stream related to the target service, and the relative ordering information among all media formats of the unique form media in the independent individual packets is used for indicating the priority order among them;

therefore, when the relative ordering information among all media formats of the media in the unique form in the independent groups is the same as the relative ordering information among the corresponding media format descriptions in the media stream description information where the media formats are located, that is, when the priority order of the two representations is the same, the independent groups in the group information can be deleted, and at the moment, the whole media format of the media in the unique form in the deleted independent groups is the first media format;

The independent grouping which can be deleted and the first media format with the same priority sequence are two equivalent expression forms, and the mutual conversion between the independent grouping and the first media format can be freely carried out by deleting and adding the independent grouping and keeping the priority sequence before and after the deleting and adding operation unchanged according to the media negotiation processing requirement;

optionally, when one of the packets in the non-independent packet set has only one form of media subgroup and the non-independent packet set also contains the packets formed by other form of media subgroups except the form of media subgroup, the direct or indirect non-independent relationship between the packets in the non-independent packet set and the packets in the non-independent packet set, which the packets having only one form of media subgroup have, is called independent form of media non-independent relationship; correspondingly, such a packet with an individual dependent relationship is referred to as a dependent individual packet.

Therefore, the packets from which dependent individual packets can be divided, that is, the packets into which they are aggregated, are dependent individual packets; the packets from which independent individual packets can be divided, i.e., the packets into which they are aggregated, are all dependent individual packets, only being independent individual packets themselves.

Optionally, before the step of sending the offer information for the target service to the second communication device, the method may further include:

according to the Cartesian product operation rule of the line set, the corresponding relation determined for the target service which is eliminated manually or the corresponding relation which is eliminated manually is eliminated, and the non-mutually independent grouping set which does not only contain independent grouping is split into two or more non-mutually independent grouping sets;

and combining two or more than two non-mutually independent packet sets into one non-mutually independent packet set for finding the corresponding relation determined by the target service which is eliminated manually or introducing the corresponding relation manually.

And when all the packets obtained after all the splitting, de-duplication and merging operations are completed for the non-mutually independent packet sets which do not only comprise independent individual packets, all the media formats of the media in the form are contained in all the media groups in the form corresponding to the media streams related to the target service.

The packet representation rule in the embodiment of the invention is as follows:

for PT rows of various forms of media under each media stream description of all the same or different media types (video or audio) grouped and ordered according to service needs, marking and grouping needs to be done in SDP or local subscription configuration. Wherein:

1) When each PT line of each form of media under each media stream description requiring grouping and ordering is marked in SDP and the working mode of grouping is listed (abbreviated as "protocol extension mode", the following is the same), the grouping marking rule is as follows:

A. for each PT line of each form of media under each media stream description that needs to be grouped and ordered according to the grouping rule, only the identification information of the PT line needs to be represented. Therefore, the coding mode of the identification information is not particularly limited, so long as the uniqueness of the identification information in the SDP can be represented, the identification information can be marked according to the sequence of the identification information in the SDP, the marking mode can only represent the relative sequence number information among the PT rows, or represent the sequence number of the media stream description of the PT rows relative to the media stream description related to the PT rows, the sequence number of the corresponding form media of the media stream description relative to each form media related to the PT rows in the media stream, and the sequence number of the corresponding PT rows relative to the PT rows needing to be grouped in the form media. Taking a PT row marking method of only representing the relative sequence number information among PT rows as an example:

PT rows may be marked in a form similar to "a=ptid: 1", where "a=ptid:" is a fixed identifier of PT row mark, and the number "1" is a PT row mark value, which may be expressed as a positive integer of PT inter-row relative sequence number information, and is unique in the whole SDP.

B. For PT line grouping, identification information indicating PT line grouping, information of each type of media group to which each PT line constituting the grouping belongs, and tag information corresponding to each PT line are required. Therefore, the encoding method of the identification information is not particularly limited as long as the uniqueness of the identification information in the SDP can be expressed. Taking the mark mode that the mark information of the PT line grouping only purely represents the relative sequence number of the PT line grouping in the service, and the mark information of the PT line inherits the mark mode of the PT line in the A section as an example:

PT row packets may be labeled like "a=ptgroup: 1,2;3, a step of; 4,5", wherein: "a=ptgroup:" is a fixed identifier of the PT line packet flag, and the following "1" is a PT line packet flag value, which may be expressed as a positive integer of PT line packet relative sequence number information, and is unique in this SDP. The following "1,2;3, a step of; 4, 5': the semicolons (i.e., ";" are separators between groups of media of each type). Commas (i.e., ") are separators between PT line marks in each media group of each format, and the numbers in the commas are PT line mark values;

and C, PT line marking information is listed in the associated attribute of the corresponding PT line in the SDP, and PT line grouping information is listed in the SDP session level information according to the preferable sequence of the PT line grouping.

The group order in the PT line grouping represents the sequence of processing each form of media, which represents the preferred order of the different forms of media and implies the preferred relation of the media types of the media stream descriptions corresponding to the different forms of media. In order to be compatible with the process of not supporting the packet negotiation, the sequence is generally consistent with the overall relative sequence of the media in the SDP, and the service will also determine the media stream sequence in the SDP according to the required preferred relationship of the media stream descriptions of the media types, so as to affect the relative sequence of the media in the SDP.

The relative sequence of PT line marking values in each form of media subgroup in the PT line group represents the relative preferred sequence among PT lines, and the relative sequence among PT line marking values in each form of media subgroup in the PT line group is further combined with the relative sequence of each form of media in the PT line group, so that the relative preferred sequence of each PT line combination in the PT line combination set is represented together.

F. In general, the SDP answer is not limited to the same value as the PT line marking value of the corresponding PT line in the SDP offer and the PT line grouping marking value of the corresponding PT line grouping or a subset thereof, but may be the same value as the PT line marking value of the corresponding PT line in the SDP offer and the PT line grouping marking value of the corresponding PT line grouping, but for the convenience of human understanding, it is generally recommended that the SDP answer be the same value as the SDP line marking value of the corresponding PT line in the SDP offer and the PT line grouping marking value of the corresponding PT line grouping.

G. In general, for the resource reservation confirmation process after the media negotiation, the SDP offer should use the same value as the PT row mark value corresponding to the PT row and the PT row packet mark value corresponding to the PT row packet in the SDP answer of the previous media negotiation process, so as to avoid that the opposite end mistakes that the media change occurs.

H. In general, the same value of PT row flag values for PT rows and PT row packet flag values for PT rows in SDP offer and/or SDP answer in the previous negotiation is not limited to the subsequent renegotiation (in particular, renegotiation initiated by the original negotiation answer) in the same service processing procedure, but in the case where the new change and the original media negotiation have an inheritance relationship (i.e., change is made in the original media negotiation SDP offer or SDP answer), the same value of PT row flag values for PT rows and PT row packet flag values for PT rows in SDP offer or SDP answer in the previous negotiation is recommended. In addition, subsequent renegotiations in the same traffic handling process may also be changed to implementations that do not employ packet negotiation mechanisms.

2) When local deal configuration is adopted to mark and group the PT rows of various forms of media under various media stream descriptions needing grouping and sequencing (abbreviated as a deal configuration mode, the following is the same), the mode is suitable for a scene that a service mode and changes are stable, namely, the PT rows of various forms of media under various media stream descriptions of various media types where the service possibly appears are basically fixed, the corresponding relation is basically fixed, the future changes are not fast, and the whole system can conveniently carry out global configuration management, and the grouping identification and configuration rules are as follows:

A. The local association configuration is configured according to the service, a service flow mark can be used as a service configuration identifier, the configuration can exclusively indicate whether the configuration is the default configuration of all the services (namely, the configuration can be effective when the corresponding service configuration does not exist or is closed), a PT line grouping configuration set corresponding to the service needs and a PT line configuration set organized by using a media flow configuration can be contained under the configuration, and other attribute configurations such as a service configuration switch attribute, a PT line grouping configuration processing strategy attribute, a PT line configuration processing strategy attribute and the like can be carried as required.

This service configuration may indicate PT line packets in which the service is expected to occur, media streams related to the inside and outside of the PT line packets, PT lines of various forms of media under the description of the media streams of various media types related to the inside and outside of the PT line packets, and sequence information of these configurations.

And B, configuring PT lines according to media stream configuration organization, wherein each media stream configuration consists of attributes such as media stream identification, media type, optional local terminal receiving and transmitting direction and the like and PT line configuration below the media stream identification, the media type and the optional local terminal receiving and transmitting direction. Each PT row configuration consists of its PT row identification information, PT row sequence flag, PT row effective switch information and its negotiation parameter attribute set. Wherein:

the unique identification information of each PT line can be expressed in the same form as in the "protocol extension mode", that is, expressed by a "PT line mark" attribute and a corresponding attribute value "PT line mark value". PT rows may be marked in a form similar to "a=ptid: 1" or a variant representation thereof, wherein "a=ptid:" is a fixed identifier of PT row mark, and the number "1" is a PT row mark value, which may be expressed as a positive integer of relative sequence number information between PT rows, and is unique in PT row mark value in the whole service configuration.

Each PT row negotiation parameter attribute set must include a media coding format and a sampling rate, and each necessary negotiation parameter and its minimum decomposition attribute configuration set corresponding to the media coding format (meaning that the parameters or the decomposition attributes of different PT rows are generated if the values of the parameters and the sampling rates are different), and optional negotiation parameter and its minimum decomposition attribute configuration set corresponding to the negotiation parameter without specificity, and optional negotiation parameter and its minimum decomposition attribute configuration set corresponding to the negotiation parameter with specificity, wherein:

parameters with specificity and non-splittability, and parameters without specificity attributes are generally given in their entirety (without actually splitting) a split configuration attribute and a specified value of that split configuration attribute that a specific PT row may use; the negotiation parameters with specificity and without specificity can be decomposed, the negotiation parameters need to be decomposed into a plurality of decomposition configuration attributes, and given the decomposition configuration attributes with specificity and the appointed value of the decomposition configuration attributes possibly used by a specific PT, the default value, the range of values, the discrete value set or the unspecified value can be appointed for the decomposition configuration attributes without specificity. And the decomposition attribute with specificity, which is insensitive to the application, is recommended to take a constant value in the negotiation, i.e. the change is not allowed to lead out a plurality of PTs, and the PTs are used in the negotiation and the service configuration.

The PT line grouping configuration consists of identification information of the PT line grouping, information of each media group of each form to which each PT line forming the PT line grouping belongs and marking information corresponding to each PT line, and the PT line grouping configuration is entered into a PT line grouping configuration set in the service configuration according to the preferential sequence of each PT line grouping. Therefore, the encoding method of the identification information is not particularly limited as long as the uniqueness in the service configuration can be represented. Taking the mark mode that the PT line grouping identification information only purely represents the relative sequence number in service configuration, and the mark mode that the PT line identification information inherits the PT line mark mode in the section B as an example:

PT row packets may be labeled like "a=ptgroup: 1,2;3, a step of; 4,5 "or variants thereof, wherein: "a=ptgroup:" is a fixed identifier of the PT line packet flag, and the following "1" is a PT line packet flag value, which may be expressed as a positive integer of PT line packet relative sequence number information, and the PT line packet flag value in this SDP is unique. The following "1,2;3, a step of; 4, 5': the semicolons (i.e., ";" are separators between groups of media of each type). Commas (i.e., ") are separators between PT line marks in each media group of each format, and the numbers in the commas are PT line mark values;

The sequence configuration of each form of media group in the PT line grouping configuration represents the sequence of processing each form of media in the grouping indicated by the PT line grouping configuration, which represents the preferred sequence of different forms of media and implies the preferred relation of media types of media stream descriptions corresponding to the different forms of media.

Therefore, the sequential configuration of each type of media group in the PT line grouping configuration should be determined according to the preferred relationship of each media type/each type of media described in each media stream to which each PT line belongs in the service requirement. In addition, for the business logic to be more intuitive, the sequence configuration is generally consistent with the overall relative sequence of the media in each form in the business configuration PT line configuration set.

The relative order configuration of PT line marker values in each form of media group in the PT line grouping configuration represents the independent relative order of preference between PT lines. Thus, the order configuration generally coincides with the relative order of PT rows in each form of media in the traffic configuration PT row configuration set;

the relative order among the PT line marking values of each type of media group in the PT line grouping configuration is further combined with the relative order of each type of media in the PT line grouping configuration, and the relative preferred order of each PT line combination in the PT line combination set is shown together.

F. In order to support the service baseline requirement, the PT line grouping configuration and the PT line grouping configuration must include each PT line configuration and corresponding PT line grouping configuration of each media type of each media stream of the service baseline requirement, and in general, the PT line grouping configuration and the PT line configuration of the baseline requirement are arranged at non-preferred positions as required, and the normal baseline attribute of the service can also be marked in the corresponding PT line grouping configuration;

G. in order to be compatible with the service degradation scene requirements of supporting video service degradation to audio service and the like, the PT line grouping configuration must contain PT line grouping configuration formed by PT lines of various forms of media of various media type media streams required by service degradation of the service requirements, and corresponding service degradation configuration attributes and service degradation baseline attributes can also be marked in the corresponding PT line grouping configuration;

H. in order to be compatible with the processing requirements when the opposite terminal initiates the media negotiation process based on the protocol extension mode, and the processing requirements of each media type media stream (for the application purpose of the known upper layer service) uncovered by the current service configuration and each PT row (for which the processing capability of the underlying system supporting the service application already has) of each form of media (for the application purpose of the known upper layer service) below the media type media stream, the compatibility policy configuration can be performed in the service level configuration. It is generally considered that:

The former is actually a PT line packet processing policy, and when the service configuration is started, the policies may be working in a manner of ignoring protocol expansion information (i.e. a working manner of using the service configuration PT line packet configuration regardless of whether the SDP has a working manner of not supporting protocol expansion, and not supporting protocol expansion by itself, a default manner), working in a manner of preferentially using the protocol expansion PT line packet (i.e. a working manner of using the protocol expansion PT line packet if there is a case, or else using the service configuration PT line packet, and only a working manner of supporting protocol expansion by itself may be selected), working in a manner of closing packet negotiation, etc.;

the latter is actually a PT row processing policy, and when the service configuration is started, the policies may be working in a manner of ignoring PT rows/form media/media streams except the service configuration, working in a manner of processing all processable PT rows except PT rows which cannot be given with a given grouping relation according to the actual bottom layer capability of the service system, etc., where PT rows which must be given with a grouping relation refer to PT rows grouped under the form of PT rows, but when the PT rows are processed according to the PT row grouping policy, PT rows whose grouping relation cannot be given, which problem may be caused to work in a manner of ignoring protocol extension information when the PT row grouping policy is configured, and SDP includes cases that PT rows are grouped under the form of PT rows and PT rows beyond the configuration range of PT rows under the form of the media.

The packet negotiation rule in the embodiment of the invention is as follows:

the negotiation rules for performing media negotiation on the payload type media capability description line (abbreviated as "PT line", hereinafter the same) of each form of media under each media stream description of all the same or different media types in SDP offer, which have been partially or fully grouped and ordered according to the service, are:

1) When the responder supports packet negotiation (preparation and overall processing order rule), after finding out packet related information in the SDP offer according to its own supporting capability, firstly confirming each PT row to be responded contained in each form of media under each media stream description in each packet according to the sequence of the packet, secondly confirming each PT row to be responded contained in each form of media under each media stream description not related to the packet actually existing in the SDP offer, and then generating corresponding responses in the SDP answer according to the overall media stream description and all PT rows to be responded, and attaching packet related information in the SDP answer according to the supporting capability of the responder, and then generating complete SDP answer by completing the addition of response results required by other negotiations or non-negotiating processes except for PT row negotiations in the SDP offer.

Wherein, for the acquisition of packet related information in SDP offer:

A. if the responder does not support the protocol expansion mode and only supports the deal configuration mode, namely the responder configures the PT line grouping processing strategy of deal service configuration to ignore the deal expansion mode by default because of only supporting the deal configuration mode, the responder is matched with the PT line configuration in the service configuration through PT line information in SDP offer and combines the PT line strategy to correct and obtain effective PT line grouping information whether the offerer supports grouping negotiation or not and whether the deal expansion mode is supported or not;

B. if the offerer and the responder both support a protocol expansion mode, and the responder does not support the configuration of the agreement service, or closes the configuration of the agreement service because of supporting the protocol expansion mode, or configures a PT line grouping processing strategy of the opened configuration of the agreement service as the priority of the protocol expansion mode, directly acquiring grouping related information in SDP offer, and when the PT line grouping processing strategy of the opened configuration of the agreement service is configured as the priority of the protocol expansion mode, combining the PT line processing strategy of the configuration of the agreement service, and correcting to obtain effective PT line grouping information;

C. if the offeror supports the agreement configuration mode or the offeror does not support the packet negotiation, the responder supports the protocol expansion mode and configures the PT line packet processing strategy of the opened agreement service configuration to be preferential in the protocol expansion mode, the situation is equivalent to the situation that the corresponding responder does not support the protocol expansion mode and only supports the agreement configuration mode;

D. If the offerer supports the agreement configuration mode or the offerer does not support the packet negotiation, the responder only supports the protocol extension mode, i.e. the responder closes the agreement service configuration because only supports the protocol extension mode, the processing of the responder in this case is the same as the case where the responder does not support the packet negotiation function and the responder closes the packet negotiation function.

In summary, for the responder, there are three processing situations, that is, both sides operate in a protocol extension mode, the responder only supports the configuration mode to operate, and the responder does not support the packet negotiation mode to operate.

2) The (SDP-sub-packet processing/answering rules) answering party confirms in turn whether each packet and its respective form of media can answer. When a responder confirms whether a packet and each form of media thereof can be responded or not and a PT line which corresponds to each form of media and needs to be responded, the responder performs confirmation processing:

if each form of media in the corresponding packet is possible to answer under the packet, the corresponding packet and each form of media can be confirmed to answer, and only PT rows, which are confirmed to be answered under the packet, of each form of media in the corresponding packet can be confirmed;

If one form of media in the corresponding packet can not answer under the packet, the corresponding packet and each form of media can be confirmed to be not answerable, and PT rows which need not be answered under the packet in each form of media under the corresponding packet can be confirmed;

3) The (under-packet form media handling rules) responder in turn confirms whether each form of media under the packet is likely to be available for reply under the packet. The processing requirements of the responder for whether the corresponding form of media is possible to respond under the corresponding packet and for confirming the PT line which can respond under the corresponding form of media are as follows:

when the responder adopts a working mode (abbreviated as a general working mode) for replying PT rows which can be supported in various forms of media described by various media streams, the responder needs to sequentially confirm whether each PT row contained in the corresponding form of media can be replied, and when at least one PT row which can be replied is contained in the corresponding form of media, the responder can consider that the form of media can be replied possibly under the group;

when the responder adopts an operation mode (1/N operation mode for short) of only answering the only PT row preferably supported in each form of media described by each media stream, if the form media which is the same form of media as the corresponding form media can answer under the corresponding packet already confirmed in the processing of other certain packet before, the form media will be considered to be unable to answer under the packet, otherwise, the responder needs to confirm whether each PT row contained in the corresponding form media can answer in turn, when one PT row capable of answer is found, the rest PT row does not need to be processed continuously, so that the form media can be considered to answer under the packet, otherwise, when the PT row capable of answer is not contained in the corresponding form media, the form media can be considered to be unable to answer.

The PT line capable of answering refers to a PT line capable of answering itself according to a negotiation requirement of a corresponding media format, and according to service or media stream constraint, if one or several other forms of media in the same or other media streams are required to have PT lines capable of answering, when the media stream in the PT line is not rejected in the negotiation result, the conclusion of the PT line capable of acknowledging the PT line capable of answering can be obtained only when the media stream in the PT line is acknowledged and not rejected.

In addition, in the processing procedure, if the PT line corresponding to the PT line mark value in the packet is found to be not existed in each form of media under each media stream description, the processing of the PT line is directly ignored and skipped.

4) After the packet processing is finished, the responder needs to refer to the processing sequence and rules of the basic negotiation flow, describe the form-by-form media by media flow, find out the form media only comprising PT lines which are not embedded with the packet, and respectively confirm the media lines which need to be responded. The processing requirements of the responder for confirming the PT line which needs to be responded by the corresponding form of media are as follows:

when the responder works in a general working mode, the responder needs to sequentially confirm whether each PT line contained in the corresponding form media can respond or not, judge the PT line which can respond and need to respond when the PT line which can respond exists in the PT line, and judge that the form media can respond when the PT line which can respond exists in the PT line;

When the responder works in the 1/N working mode, the responder needs to sequentially confirm whether each PT line contained in the corresponding form medium can respond or not, and when a PT line capable of responding is found, the responder does not need to continuously process the rest PT lines, and confirms the PT line of which the PT line needs to respond, and confirms that the form medium can respond at the same time, otherwise, when the corresponding form medium does not contain the PT line capable of responding, the form medium can not be considered to respond.

5) Then, the response results to the PT rows of each media stream in each form are sequentially generated according to the order of each PT row of each media stream in the offer. The specific treatment is as follows:

the responder generates a response result for each media stream description, and generates a response result corresponding to the PT line for the form media which is judged to be capable of responding under each media stream description, namely the PT line which needs to be responded of the form media with the PT line which needs to be responded according to the corresponding media format and the negotiation response rule of the form media.

6) Meanwhile, when packet information and PT packet identification information for each PT line are explicitly provided in SDP offer, if the responder also supports to explicitly carry these information, then:

the responder shall attach its PT row identification information for the corresponding PT row in the response result;

The answering party shall list in sequence the grouping in the session level information in the answer, the grouping answer result information which is the grouping information and contains the PT line grouping identification information of each grouping considered to be answered and the PT line marking value list information of each PT line which needs to answer and is organized according to each form of media group in SDP offer and each PT line sequence below;

7) And the responder still needs to refer to basic negotiation rules and other services and media stream constraint to complete the generation processing of the response results of the session level and the media stream description level, and realize the generation function of the response results required by other negotiation or non-negotiation processing except PT line negotiation.

For example, when a certain form of media has no PT line needing to be responded, the description of the media stream to which the media stream belongs is refused and compatible, the representation of the PT line response is carried out according to the representation method of the PT line response under the scene (such as deleting or retaining the PT line related attribute information of the PT line response), or the processing of interrupting the service is carried out according to the requirement of an upper layer protocol because all the media stream descriptions are refused.

8) In addition, when the answering party and the offeror in the media negotiation process carry out the subsequent processing of the same service processing process according to the upper layer service and protocol requirements, if no special requirements exist, the answering party and the offeror should inherit to work by adopting a packet negotiation mechanism.

For example, for the resource reservation confirmation processing that may occur after the media negotiation processing, the media flow description and PT line description information in the SDP offer/answer information should also be consistent with the result of the packet media negotiation.

For another example, when the terminal initiates media change and resource reservation confirmation, the corresponding packet information of some or all media streams may not appear in the negotiation result, and the audio media streams are not rejected, so that the packet information which is originally existed for service compatibility and simply contains the audio media stream baseline requirement PT line and the packet identification information corresponding to the PT line need to appear in the negotiation result.

For example, in the process of playing the content of the color ring back tone service, when the network condition of the terminal changes (for example, the mobile terminal generates an EPS fallback), the terminal side may also combine the network condition change and the previous response, generate a new SDP offer meeting the packet negotiation rule according to the packet negotiation response rule, and perform packet negotiation with the service platform to obtain better service experience.

9) In addition, when the responder and the offeror in the media negotiation process perform subsequent processing of the same service processing process, the responder and the offeror should also be able to accept the processing of the basic negotiation mechanism of the SDP offer negotiation request that does not need to perform packet negotiation processing in combination with PT packet information, so as to ensure that the service negotiation processing can converge rapidly when causes such as service and network anomalies occur.

For example, for the application of the color ring service, when the answering party does not support packet negotiation or negotiation error, and there is no or PT line packet information and PT line packet identification information in the answer, the corresponding relation of various services cannot be reflected, the PT line packet information in the answer is inconsistent with the PT line information and the corresponding relation of various services cannot be reflected, or when the negotiation cannot be completed through one handshake due to other negotiation factors under the packet negotiation framework, the offerer can also reinitiate the existing SDP offer of the PT line which can be supported by the baseline capability of one answering party in the video media stream description and the audio media stream description to carry out basic media negotiation, thereby guaranteeing the rapid convergence of the media negotiation.

For another example, for the application of the color ring service, when the mobile terminal generates SRVCC and needs the network side to initiate media update to the service platform in the process of playing the content media file to the mobile terminal, so as to keep only the audio playing scene, the network side can initiate the existing SDP offer carrying only one PT line which can be supported by the network baseline capability in the audio media stream description to carry out basic media negotiation, thereby ensuring that the service platform can also quickly converge the media negotiation and properly handle the service requirements of continuously playing the audio part of the content media file and the like according to the scene service requirement, reducing the service support requirement of the network side, and avoiding the problems that the network side introduces complex buffering and inherits the mechanism of the former negotiation process to carry out the subsequent negotiation and can not better promote the service experience.

10 Under the condition that the answering party does not support the grouping negotiation function due to the various reasons, the answering party respectively carries out the answer processing of each PT line of each form of media in each media stream according to the basic negotiation rule, completes the answer result generation processing of the media stream description level according to the basic negotiation rule and other services and media stream constraint, and realizes the answer result generation function required by other negotiation or non-negotiation processing except the PT line negotiation.

Meanwhile, in the case where packet information and PT packet identification information for each PT line are explicitly provided in SDP offer, the PT line packet information and PT line packet identification information should generally be removed in response according to compatibility requirements.

The rule of applying the result in the embodiment of the invention is as follows:

the rules for performing service processing on the payload type media description line (abbreviated as "PT line" hereinafter) of each form of media under each media stream description of all the same or different media types, which are partially or fully grouped and ordered, or not grouped, in the SDP answer are:

1) The offerer finds out the packet related information in SDP answer and the PT line related information of the media of each form in each media stream, processes the packet related information, the PT lines of the media of each form under each media stream description corresponding to the packet related information, and processes the PT lines of the media of each form under each media stream description not related to the packet, and processes other negotiation or non-negotiation content except the negotiation result of the packet and the PT lines in the SDP answer, and finally completes the service application processing of SDP answer response.

2) The offerer first breaks up all found packets into equivalent packets containing only one PT line under each form of media in the packets (abbreviated as "PT line combination form packets", the same applies hereinafter) and arranges the packets according to the packet equivalent splitting and ordering rules, and then sequentially finds out the first packet without intersection of each form of media sets according to the sequence, namely, each preferred packet in the response.

The offerer matches with each media PT row of each form of the preferred grouping according to the priority sequence of each business media format corresponding relation of the business requirement, and the business media format corresponding relation which is completely matched with each preferred grouping is the content of the business which needs to be actually served.

Wherein, the first group is the preferred group after decomposition, the group without intersection with the form of media set is the preferred group, and the like, until all the decomposed groups are processed, all the preferred groups can be found. Formal media set no-intersection refers to each formal media in two packets, neither of which is a formal media under the same media stream description in SDP.

3) And the offerer takes the first PT line of each form of media under the description of each media stream which does not relate to the grouping as an independent preferable PT line, and sequentially matches each independent preferable PT line according to the sequence of each complete independent corresponding relation of the service requirement, and the independent service media format which is firstly matched with each independent preferable PT line is the content of the service which needs to be actually served.

4) Meanwhile, the responder processes other negotiated or non-negotiated contents in the SDP answer, synthesizes the rules of the service itself to obtain the contents of the service to be actually served, directly provides the service contents under the non-Precondition flow, and provides the service contents as required after confirming the receipt of the resource reservation confirmation result under the Precondition flow, thereby completing the service processing of the SDP answer response.

The method of the embodiment of the invention can meet the business requirement that the corresponding relation exists among PT rows of each form of media in each media stream description in the media negotiation SDP on business through one negotiation, and the negotiation result is required to be synchronized according to the requirement of maintaining the corresponding relation in the negotiation result. Has the following technical advantages:

1. the negotiation is completed by fast convergence (user experience is good), so that service negotiation time delay is greatly saved, and error probability caused by repeated negotiation is avoided. The timeliness and success rate of the service reaching the user are guaranteed, and the service experience is improved;

2. The negotiation is completed by rapid convergence (supported by a platform, low in cost), and the negotiation does not involve the production of a large amount of content or transcoding play. The service experience is best, the system support requirement is reasonable, and the cost of content production, quality control, content storage equipment, media playing equipment and the like is lowest;

3. the (content operation, sustainable) fast negotiation accurately approves the playing content, and the content can ensure the playing of the high-quality files according to the terminal and network conditions by only manufacturing fewer high-quality media files according to the service requirements. The service experience is best, and meanwhile, the content management is flexible, the service operation can be focused, and the sustainable development can be realized;

4. the (network guarantee, good effect) fast negotiation accurately approves the play content, and accurately applies network resources and bandwidth as required, thereby avoiding network resource waste and network impact caused by first virtual high and multiple negotiations.

Referring to fig. 3, fig. 3 is a flowchart of a media negotiation method according to a second embodiment of the present invention, the method is applied to a second communication device, and includes the following steps:

step 31: receiving offer information for a target service sent by a first communication device, wherein the offer information comprises information of each media format of each form of media in each media stream related to the target service and grouping information of the media formats, the grouping information can indicate a corresponding relation of each media format of each form of media in each media stream related to the target service, and the corresponding relation is determined by the target service;

Step 32: generating response information according to the grouping information of the media formats, wherein the response information comprises the media formats which need to be responded in each grouping;

step 33: and sending the response information to the first communication equipment.

Optionally, the step of generating response information according to the grouping information of the media format includes:

determining whether the media format to be answered exists within each packet; and/or the number of the groups of groups,

determining whether the media format which is not grouped in the offer information is a media format which needs to be responded;

the reply message includes the media formats that need to be replied to that are not grouped.

Optionally, the step of determining whether the media format to be answered exists in each packet includes:

determining whether the media formats to be responded exist in each group according to the grouping information and the ordering information of the media formats;

the ordering information is determined according to the target service, and the ordering information is used for indicating at least one of the following sequential preference orders:

The precedence order among the form media indicated by the ordering information among the form media subgroups in the grouping information of the media format;

a priority sequence among the media formats indicated by the ordering information among the media formats in the form media group in the grouping information of the media formats;

one of said groupings being in direct non-independent relationship with another of said groupings by virtue of at least one of said groupings being identical to another of said groupings, or one of said groupings being capable of being in indirect non-independent relationship with another of said groupings not being in direct non-independent relationship with one another by virtue of one or more of said groupings having a direct non-independent relationship with one another;

the grouping information in the media format comprises one or more groups in the non-mutually independent grouping sets, namely, the corresponding relation in one or more service domains corresponding to the one or more non-mutually independent grouping sets one by one respectively;

The form media group is a group formed by all media formats belonging to the same form media in the same media stream in one group;

in the grouping information of the media format, the grouping without direct and indirect non-mutually independent relations belongs to different non-mutually independent grouping sets, and the grouping without direct and indirect non-mutually independent relations belongs to the grouping in the different non-mutually independent grouping sets and has mutually independent relations;

in the grouping information of the media format, the relative ordering among the groupings with mutually independent relations does not indicate the priority sequence among the groupings, so that the relative ordering among the groupings can be freely adjusted when the groupings are respectively processed; the corresponding relations in different service domains in the corresponding relations are logically independent, and the priority order determined by the target service does not exist.

Referring to fig. 4, fig. 4 is a flowchart of a media negotiation configuration method according to a third embodiment of the present invention, the method is applied to a first communication device, and includes the following steps:

step 41: transmitting configuration information to the second communication device;

Referring to fig. 5, fig. 5 is a flowchart of a media negotiation configuration method according to a fourth embodiment of the present invention, the method is applied to a first communication device, and includes the following steps:

step 51: receiving configuration information sent by second communication equipment;

Referring to fig. 6, fig. 6 is a flowchart of a media negotiation method according to a fifth embodiment of the present invention, the method is applied to a media negotiation system, and the media negotiation system includes a first communication device and a second communication device, and includes the following steps:

step 61: the method comprises the steps that a first communication device sends offer information aiming at a target service to a second communication device, wherein the offer information comprises information of each media format of each form of media in each media stream related to the target service and grouping information of the media formats, the grouping information can indicate a corresponding relation of each media format of each form of media in each media stream related to the target service, and the corresponding relation is determined by the target service;

step 62: the second communication equipment receives offer information aiming at target service and sent by the first communication equipment;

step 63: the second communication equipment generates response information according to the grouping information of the media formats, wherein the response information comprises the media formats which need to be responded in each grouping;

step 64: the second communication device sends the response information to the first communication device;

Step 65: the first communication device receives response information sent by the second communication device according to the offer information.

In particular, please refer to the first and second embodiments, and the description thereof is omitted.

Referring to fig. 7, fig. 7 is a schematic structural diagram of a first communication device according to a sixth embodiment of the present application, where the first communication device 70 includes:

an offer sending module 71, configured to send, to a second communication device, offer information for a target service, where the offer information includes information of each media format of each form of media in each media stream related to the target service and packet information of the media format, where the packet information can indicate a correspondence relationship between each media format of each form of media in each media stream related to the target service, where the correspondence relationship is determined by the target service;

and a response receiving module 72, configured to receive response information sent by the second communication device according to the offer information.

The first communication device provided in the embodiment of the present application can implement each process implemented by the method embodiment of fig. 2, and achieve the same technical effects, so that repetition is avoided, and no further description is given here.

Referring to fig. 8, fig. 8 is a schematic structural diagram of a second communication device according to a seventh embodiment of the present application, where the second communication device 80 includes:

An offer receiving module 81, configured to receive offer information for a target service sent by a first communication device, where the offer information includes information of each media format of each form of media in each media stream related to the target service and packet information of the media format, where the packet information can indicate a correspondence relationship between each media format of each form of media in each media stream related to the target service, and the correspondence relationship is determined by the target service;

a reply generation module 82, configured to generate reply information according to the packet information of the media format, where the reply information includes the media format that needs to be replied in each packet;

a reply transmitting module 83, configured to transmit the reply information to the first communication device.

The second communication device provided in the embodiment of the present application can implement each process implemented by the method embodiment of fig. 3, and achieve the same technical effects, so that repetition is avoided, and no further description is given here.

Referring to fig. 9, fig. 9 is a schematic structural diagram of a media negotiation system according to an eighth embodiment of the present application, where the media negotiation system 90 includes: a first communication device 91 and a second communication device 92;

The first communication device 91 is described in the sixth embodiment, and the second communication device 92 is described in the seventh embodiment, which is not described herein.

Referring to fig. 10, fig. 10 is a schematic structural diagram of a first communication device according to a ninth embodiment of the present application, where the first communication device 100 includes:

a configuration sending module 101, configured to send configuration information to the second communication device;

The first communication device provided in the embodiment of the present application can implement each process implemented by the method embodiment of fig. 4, and achieve the same technical effects, so that repetition is avoided, and no further description is given here.

Referring to fig. 11, fig. 11 is a schematic structural diagram of a first communication device according to a tenth embodiment of the present application, where the first communication device 110 includes:

A configuration receiving module 111, configured to receive configuration information sent by the second communication device;

The first communication device provided in the embodiment of the present application can implement each process implemented by the method embodiment of fig. 5, and achieve the same technical effects, so that repetition is avoided, and no further description is given here.

Referring to fig. 12, an embodiment of the present application further provides a communication device 120, including a processor 121, a memory 122, and a computer program stored in the memory 122 and capable of running on the processor 121, where the computer program when executed by the processor 121 implements each process of the media negotiation method embodiment executed by the first communication device or the second communication device, or implements each process of the media negotiation configuration method embodiment executed by the first communication device or the second communication device, and the same technical effects can be achieved, and will not be repeated here.

The embodiment of the invention also provides a computer readable storage medium, on which a computer program is stored, where the computer program when executed by a processor implements each process of the above media negotiation method embodiment, or implements each process of the above media negotiation configuration method embodiment, and the same technical effects can be achieved, so that repetition is avoided, and no further description is given here. Wherein the computer readable storage medium is selected from Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.

The embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present invention and the scope of the claims, which are to be protected by the present invention.

Claims

1. A media negotiation method applied to a first communication device, comprising:

the method comprises the steps that offer information aiming at a target service is sent to second communication equipment, the offer information comprises information of each media format of each form of media in each media stream related to the target service, the information of each media format comprises grouping information of media formats, the grouping information can indicate the corresponding relation of each media format of each form of media in each media stream related to the target service in the target service, and the corresponding relation is determined by the target service;

2. The method of claim 1, wherein the packet information further comprises ordering information indicating a precedence order determined by the target service:

wherein one of said packets forms a direct non-mutually independent relationship with another of said packets due to at least one of said packets being identical to said other of said packets, or one of said packets can form an indirect non-mutually independent relationship with another of said packets that does not form a direct non-mutually independent relationship with one or more of said packets that have a direct non-mutually independent relationship with one another;

one of the non-mutually independent sets of packets logically corresponds to a relatively independent service domain;

3. The method of claim 2, wherein prior to the step of transmitting offer information for the target service to the second communication device, further comprising:

4. A method according to claim 3, wherein said step of grouping and ordering each of said media formats of each form of media in each media stream related to said target service according to said correspondence and said precedence order comprises:

The media formats with the same corresponding relation are organized into one group or are organized into a plurality of equivalent groups;

the grouping comprises an independent corresponding relation grouping and a multi-element corresponding relation grouping;

the media formats with the same corresponding relation are at least partial media formats of one or more forms of media in each media stream related to the target service;

the situation of at least partial media format corresponding to one form of media in each media stream is called as single corresponding relation, and the corresponding group is called as single corresponding relation group;

the condition of corresponding at least part of media formats of two or more forms of media in each media stream is called as non-independent corresponding relation or multi-element corresponding relation, and the corresponding group is called as non-independent corresponding relation group or multi-element corresponding relation group;

the equivalent relationship of the one grouped as well as the plurality of grouped as equivalent thereto is embodied as:

5. The method of claim 4, wherein the step of grouping media formats having the same correspondence as one of the groups, or as an equivalent plurality of the groups, comprises:

grouping the corresponding second media formats according to the non-independent corresponding relation determined according to the target service, namely sequentially grouping the second media formats of the other forms of media of the same or different media streams with the same non-independent corresponding relation into corresponding form media subgroups according to the sequencing information of the form media subgroups of one group or the equivalent multiple groups, which are required to be included, of the corresponding second media formats determined according to the service domain sequence preference sequence of the service domain where the non-independent corresponding relation is located, firstly grouping the first second media format into the corresponding form media subgroup into one group or the equivalent multiple groups, and then sequentially grouping the second media formats of the other forms of media of the same or different media streams with the same non-independent corresponding relation into the corresponding form media subgroup according to the relative sequence preference sequence so as to be coded into the coded group of the first second media format;

or alternatively, the process may be performed,

according to the independent corresponding relation determined according to the target service, the corresponding unique second media format is incorporated into the corresponding independent form media group to be organized into one group or a plurality of equivalent groups;

Meanwhile, sorting the media formats of the second media formats corresponding to the non-independent/independent corresponding relation in the corresponding form of media subgroups in each subgroup and/or sorting the equivalent multiple of subgroups according to sorting information of the media formats of the corresponding form of media subgroups in one subgroup or the equivalent multiple of the subgroup which are determined according to the service domain priority sequence of the service domain where the non-independent or independent corresponding relation is located and determined according to the target service;

wherein the second media format is a partial or complete media format of one form of media in one media stream related to the target service;

the service domain precedence order is determined by the target service, that is, the following is determined by the precedence order rule of the service domain of the target service:

the corresponding relation in the service domain corresponds to the sorting information of one grouping or a plurality of equivalent grouping form media subgroups, the sorting information of the media format in one grouping or a plurality of equivalent grouping form media subgroups and the relative sorting information among a plurality of equivalent groupings respectively;

The service domain corresponds to the sorting information of the media subgroups in the forms in the groups, the sorting information of the media formats in the media subgroups in the forms of the groups and the sorting information among the groups in the non-mutually independent groups;

the precedence order rule of the service domain comprises precedence orders among different types of corresponding relations of the service domain, precedence orders among media of each type of media of each media stream related to each corresponding relation in the service domain, and precedence orders among respective media formats in each type of media.

6. The method of claim 3, wherein the step of grouping and ordering each of the media formats of each of the media streams related to the target service according to the correspondence and the precedence order further comprises:

when the first grouping is a multi-element corresponding relation grouping, according to the relative adjacent sequence between at least two groups of divided media formats, sequentially taking the at least two groups of divided media formats to be respectively combined with each other form of media subgroup in the first grouping to form at least two groups equivalent to the first grouping;

Or alternatively, the process may be performed,

when the first grouping is an independent corresponding relation grouping, sequentially taking the at least two groups of media formats divided into at least two groups equivalent to the first grouping according to the relative adjacent sequence between the at least two groups of media formats;

and so on, continuing to divide at least two of the packets equivalent to the first packet up to each second packet equivalent to the first packet;

wherein said first grouping means said grouping into at least two said groupings equivalent thereto by dividing the media formats of each at least two of its at least one divisible form of media subgroups into at least two groups in a manner that their relative contiguous order is unchanged;

7. The method of claim 3, wherein the step of grouping and ordering each of the media formats of each of the media streams related to the target service according to the correspondence and the precedence order further comprises:

Dividing each first group in the non-mutually independent group set into groups equivalent to the first group so as to arrange the ordering information of each group and the relative sequence between the grouping information, so that the finally obtained corresponding relation and the sequence preference sequence indicated by the group information are consistent with the corresponding relation and the sequence preference sequence determined by the service;

wherein dividing each first packet in the non-mutually independent packet set into packets equivalent thereto to sort order information of each packet therein and a relative order therebetween includes:

dividing a first packet into said packets equivalent thereto for inserting, respectively, in front of or behind one or more of the packets, other said packets in their non-mutually independent sets of packets that are not fully contained by them and are relatively ordered in front of or behind one or more of the packets; the other packets are a first packet, a second packet and an equivalent packet, wherein the first packet, the second packet and the equivalent packet can be used for executing the inserting operation without continuing to divide, and the first packet and the second packet can be used for executing the inserting operation without continuing to divide, wherein the other packets are in a non-mutually independent packet set where the first packet is located;

Dividing a first packet into the packets equivalent to the first packet, removing the packets which are completely contained in the packet information processed before, and inserting one or more packets which are not completely contained in the packet information processed before or after the packets in the packet information respectively according to the relative sequencing adjacency relation, wherein the other packets are the first packet, the other second packet and the other first packet which are not independent of each other and can be subjected to the insertion operation, and the first packet and the second packet which are not continuously divided and can be subjected to the insertion operation in the packets equivalent to the first packet;

8. The method of claim 3, wherein the step of grouping and ordering each of the media formats of each of the media streams related to the target service according to the correspondence and the precedence order further comprises:

Merging two or more groups of mutually independent groups that are not mutually independent groups that are mutually adjacent in relative ordering, and that differ only in the format of the media that they are involved in the same format of the group of media, into a first group that is mutually adjacent in the different format of the media that is mutually adjacent, and that is not changed in the format of the media that is involved in each of the remaining groups of mutually independent groups that are mutually identical, and so on, up to the point that any two of the groups that are mutually independent groups that are mutually adjacent in relative ordering have different format of the group of media, or that, although having the same format of the group of media, there are two or more different formats of the media that are involved in the group of mutually independent groups;

and the packets which are not mutually independent and are adjacently arranged in a relative sequence are assembled into a first packet according to the principle that the corresponding relation and the relative sequence preference sequence indicated by the packets are consistent, so that the finally obtained packet information contains fewer or least packets.

9. The method of claim 3, wherein the step of grouping and ordering each of the media formats of each of the media streams related to the target service according to the correspondence and the precedence order further comprises:

all the packets correspond to all the corresponding relations of the service domains corresponding to the non-mutually independent packet sets, and all the corresponding relations of the service domains corresponding to the non-mutually independent packet sets also correspond to all the packets;

the all sequencing information indicates the service domain priority sequence;

when all the packets are expressed according to one or more equivalent second packets, the one or more equivalent second packets of each packet in all the packets should be adjacent together in order, and the relative order should meet the order of preference requirement of the service domain;

The service domain precedence order is determined by the target service, that is, by a precedence order rule of the service domain of the target service:

10. The method of claim 4, wherein the step of grouping media formats having the same correspondence as one of the groups, or as an equivalent plurality of the groups, comprises:

the relative priority sequence of each media format in the media corresponding to the second media format corresponding to the non-independent or independent corresponding relation determined according to the target service is determined by the relative priority sequence of each media format combination in the media format combination set corresponding to the non-independent corresponding relation;

one grouping corresponding to the same corresponding relation and a plurality of equivalent grouping media format combination sets are the same as the same corresponding relation media format combination sets;

the media format of each media format combination in the same corresponding relation media format combination set is respectively used as the media format of each media format combination packet, and the relative preference sequence of each media format related to each media format combination in the same corresponding relation is determined according to the preference sequence of each media format combination in the union of the media format combination sets of each corresponding relation in the same service domain, which is determined according to the target service, and is used as the sequence of each media format combination group of each media format combination set, so as to obtain the one or more media format combination packets;

The grouping equivalent single media format combination grouping set is a set of media format combinations obtained by respectively taking one media format from each media format under each form of media of the grouping.

11. A media negotiation method applied to a second communication device, comprising:

receiving offer information for a target service sent by a first communication device, wherein the offer information comprises information of each media format of each form of media in each media stream related to the target service, the information of each media format comprises grouping information of media formats, the grouping information can indicate a corresponding relation of each media format of each form of media in each media stream related to the target service in the target service, and the corresponding relation is determined by the target service;

and sending the response information to the first communication equipment.

12. A first communication device, comprising:

an offer sending module, configured to send offer information for a target service to a second communication device, where the offer information includes information of each media format of each form of media in each media stream related to the target service, the information of each media format includes packet information of each media format, and the packet information can indicate a correspondence of each media format of each form of media in each media stream related to the target service in the target service, where the correspondence is determined by the target service;

13. A second communication device, comprising:

an offer receiving module, configured to receive offer information for a target service sent by a first communication device, where the offer information includes information of each media format of each form of media in each media stream related to the target service, the information of each media format includes packet information of each media format, and the packet information can indicate a correspondence of each media format of each form of media in each media stream related to the target service in the target service, where the correspondence is determined by the target service;

14. A communication device comprising a memory, a processor, and a program stored on the memory and executable on the processor; wherein the processor, when executing the program, implements the steps of the media negotiation method according to any one of claims 1 to 10 or the steps of the media negotiation method according to claim 11.

15. A readable storage medium, having stored thereon a program, characterized in that the program, when executed by a processor, implements the steps of the media negotiation method according to any one of claims 1 to 10 or the steps of the media negotiation method according to claim 11.