WO2017045568A1 - 一种媒体流传输方法、设备及系统 - Google Patents

一种媒体流传输方法、设备及系统 Download PDF

Info

Publication number
WO2017045568A1
WO2017045568A1 PCT/CN2016/098585 CN2016098585W WO2017045568A1 WO 2017045568 A1 WO2017045568 A1 WO 2017045568A1 CN 2016098585 W CN2016098585 W CN 2016098585W WO 2017045568 A1 WO2017045568 A1 WO 2017045568A1
Authority
WO
WIPO (PCT)
Prior art keywords
media
fec
stream
conference server
configuration information
Prior art date
Application number
PCT/CN2016/098585
Other languages
English (en)
French (fr)
Inventor
范燕平
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2017045568A1 publication Critical patent/WO2017045568A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Definitions

  • Embodiments of the present invention relate to the field of communications, and in particular, to a media stream transmission method, device, and system.
  • multi-party video conferencing solutions use centralized conference server forwarding to reduce terminal bandwidth and CPU consumption (English full name: Central Processing Unit, Chinese full name: central processing unit).
  • the conference server receives the RTP (Real-time Transport Protocol, full name: real-time transport protocol) media stream from the participant, and then the conference server integrates the operation into a suitable RTP stream through hybrid transcoding and other operations to send to other participants.
  • the decoding re-encoding of the conference server usually introduces additional delays.
  • the media sender usually sends media resources to multiple media receivers simultaneously through multi-stream forwarding.
  • the multi-stream forwarding means that the media sender simultaneously sends multiple RTP media streams of different encoding versions for the same media resource. These RTP media streams differ in frame rate, resolution, codec type, etc., and correspond to the capabilities of different media receivers.
  • the conference server only needs to select the RTP media stream to be forwarded to other media receivers according to a certain policy.
  • forward error correction FEC is used in the prior art (English name: ForwardErrorCorrection, Chinese: Forward error correction) packet loss processing method, because the media receiver can reconstruct the lost data packet while receiving the data packet, and does not need the media sender to retransmit, so it is an effective and practical choice. .
  • Step 1 The media sender sends a media stream to the conference server, and generates a corresponding FEC stream for the media sender to the conference server path state (such as packet loss).
  • Step 2 After receiving the media stream and the FEC stream, the conference server recovers the packet lost by the media stream according to the FEC stream.
  • Step 3 The conference server forwards the restored media stream to other media receivers, and generates a corresponding FEC stream for the path state of the conference server to other media receivers.
  • the FEC streams corresponding to other media receivers are independent of each other, because the existing conference server needs to mix the media streams. Coding or transcoding, so the FEC mechanism at both ends of the conference server is completely independent decoupled: the conference server recovers the lost packets from the media sender to the conference server path according to the FEC stream sent by the media sender, and the conference server is in the media stream.
  • an independent FEC stream is generated for each media receiver; that is, in the multi-stream forwarding scenario, the conference server only forwards the media stream, and the FEC still adopts the above mechanism, due to the FEC encoding and decoding.
  • the packet cache consumes a large amount of resources of the conference server.
  • the process of generating a separate FEC stream for each media receiver of the conference server increases the end-to-end transmission delay of the media stream, affecting the number of users of the conference server service and the final user experience.
  • Embodiments of the present invention provide a media stream transmission method, device, and system, which can reduce resource consumption of a server, thereby reducing end-to-end transmission delay of a media stream.
  • a method for media stream transmission including:
  • the conference server receives the FEC configuration information sent by the media sending terminal, where the FEC configuration information includes an identifier of the FEC stream supported by the media stream;
  • the conference server generates a first mapping relationship table according to the FEC configuration information, where the first mapping relationship table includes a correspondence between an identifier of the FEC stream and an identifier of the media receiving terminal;
  • the FEC configuration information further includes a redundancy level of each FEC stream supported by the media stream;
  • the method further includes:
  • the conference server generates FEC flow profile configuration information of the media stream according to the path state information of the media sending terminal to each media receiving terminal and the redundancy level of each FEC stream supported by the media stream, and reconfigures the configuration a first mapping relationship table, where the FEC flow profile configuration information includes: a redundancy level of the FEC stream corresponding to the media streams sent by the conference server to each media receiving terminal;
  • the conference server sends the FEC flow profile configuration information and the first mapping relationship table of the conference server reconfiguration to After the media is sent to the terminal, the method further includes:
  • the first mapping relationship table adjusts the FEC flow profile configuration information and the first mapping relationship table stored by the conference server
  • the conference server acquires path state information of the media sending terminal to each media receiving terminal, including:
  • the conference server acquires path state information of the media sending terminal to each media receiving terminal according to the path state information of the media sending terminal to the conference server and the path state information of each media receiving terminal to the conference server. .
  • the path state information includes a packet loss ratio
  • the conference server generates the FEC flow profile configuration information of the media stream according to the path state information of the media sending terminal to the media receiving terminal and the redundancy level of each FEC stream supported by the media stream, including:
  • the redundancy level range is redundancy of each FEC stream supported by the media stream An interval formed by a maximum redundancy and a minimum redundancy in the redundancy level, and one of the redundancy levels corresponds to a range of a packet loss rate range;
  • the first packet loss rate is within the current redundancy level range, determining whether the first packet loss rate causes the division of the redundancy level to be reduced, where the first packet loss rate belongs to the Determining the first redundancy level in the division of the redundancy level, and determining whether the first redundancy rate includes a packet loss rate corresponding to any current FEC stream and the first packet loss rate The packet loss rate causes the division of the redundancy level to be reduced;
  • the first packet loss rate causes the division of the redundancy level to be reduced, the first packet loss rate is re-matched with the redundancy level of all current FEC streams, and any redundancy is deleted. Degree level.
  • the fifth possible implementation if the first packet loss ratio If the division of the redundancy level is not required to be reduced, determining whether the first packet loss rate causes the redundancy level to be re-divided; wherein when the first packet loss rate does not belong to the redundancy level Determining the first packet loss rate causes the redundancy level to be re-divided when any of the redundancy levels is divided;
  • the division of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios.
  • the first packet loss rate is not in the current redundancy level range, determining, according to the redundancy level of each FEC stream supported by the media stream sent by the media sending terminal, whether to support adding a new FEC stream; If the redundancy level corresponding to the first packet loss rate is not included in the redundancy level of each FEC stream supported by the media stream, it is determined that adding a new FEC stream is not supported;
  • the allocation of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios
  • the FEC stream corresponding to the first packet loss rate is added, and the corresponding redundancy level is set.
  • the method further includes: if it is supported to add a new FEC stream, determining whether the bandwidth of the media sending terminal supports adding a new one. An FEC stream; wherein when the remaining bandwidth of the media sending terminal is greater than a bandwidth required by the newly added FEC stream, determining to support adding a new FEC stream;
  • the division of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios
  • bandwidth of the media sending terminal supports adding a new FEC stream, increase the FEC stream corresponding to the first packet loss rate, and set a corresponding redundancy level.
  • a media stream transmission method including:
  • the media sending terminal sends the FEC configuration information to the conference server, where the FEC configuration information includes an identifier of the FEC stream supported by the media stream, so that the conference server generates a first mapping relationship table according to the FEC configuration information, where the first mapping is performed.
  • the relationship table includes a correspondence between an identifier of the FEC stream and an identifier of the media receiving terminal;
  • the conference server sends, to the conference server, the media stream and the FEC stream generated according to the FEC configuration information, so that the conference server sends the media stream to each media receiving terminal, and according to the first mapping relationship table
  • the FEC stream is sent to the corresponding media receiving terminal.
  • the FEC configuration information further includes a redundancy level of each FEC stream supported by the media stream; the method further includes:
  • the FEC flow profile configuration information includes: the media stream corresponding to the media stream sent by the conference server to each media receiving terminal The redundancy level of the FEC stream;
  • the FEC generated according to the FEC flow profile configuration information of the conference server is sent to the conference server. flow.
  • the media sending terminal confirms that the FEC flow profile configuration information and the first mapping of the conference server reconfiguration are not supported. And updating the FEC flow profile configuration information and the first mapping relationship table of the conference server reconfiguration; and sending, to the conference server, the FEC flow profile configuration information generated by the media sending terminal to generate the FEC flow profile configuration information.
  • FEC stream ;
  • a conference server including:
  • a receiving unit configured to receive FEC configuration information sent by the media sending terminal, where the FEC configuration information includes an identifier of an FEC stream supported by the media stream;
  • a processing unit configured to generate, according to the FEC configuration information that is received by the receiving unit, a first mapping relationship table, where the first mapping relationship table includes a correspondence between an identifier of the FEC stream and an identifier of the media receiving terminal;
  • the receiving unit is further configured to receive a media stream sent by the media sending terminal and an FEC stream generated by the media sending terminal according to the FEC configuration information;
  • a sending unit configured to send the media stream received by the receiving unit to each media receiving terminal, and send the FEC stream received by the receiving unit according to a correspondence between the identifier of the FEC stream and the identifier of the media receiving terminal To the media receiving terminal.
  • the FEC configuration information further includes a redundancy level of each FEC stream supported by the media stream;
  • the conference server further includes: an obtaining unit, configured to acquire path state information of the media sending terminal to each media receiving terminal;
  • the processing unit is further configured to generate, according to the path state information of the media sending terminal to each media receiving terminal acquired by the acquiring unit, and the redundancy level of each FEC stream supported by the media stream received by the receiving unit, Defining the information of the FEC stream of the media stream and reconfiguring the first mapping relationship table, where the FEC stream profile configuration information includes: redundancy of the FEC stream corresponding to the media streams sent by the conference server to each media receiving terminal Grade
  • the sending unit is further configured to send the FEC stream profile configuration information generated by the processing unit and the first mapping relationship table reconfigured by the processing unit of the conference server to the media sending terminal;
  • the receiving unit is further configured to receive a media stream sent by the media sending terminal and an FEC stream generated by the media sending terminal according to the FEC stream profile configuration information sent by the conference server.
  • the receiving unit is further configured to receive updated FEC flow profile configuration information and the media sent by the media sending terminal a first mapping relationship table that is sent by the terminal
  • the processor is further configured to: adjust, according to the FEC stream file configuration information that is updated by the media sending terminal and the first mapping relationship table that is updated by the media sending terminal, that is received by the receiving unit FEC flow profile configuration information and a first mapping relationship table stored by the conference server;
  • the receiving unit is further configured to receive a media stream sent by the media sending terminal and an FEC stream generated by the media sending terminal according to the FEC stream profile configuration information updated by the media sending terminal.
  • the acquiring unit is specifically configured to obtain path state information of the media sending terminal to the conference server, and acquire each media receiving terminal to The path status information of the conference server; obtaining the media sending terminal to each media receiving according to the path state information of the media sending terminal to the conference server and the path state information of each media receiving terminal to the conference server Path status information of the terminal.
  • the path state information includes a packet loss ratio
  • the processing unit is specifically configured to:
  • the redundancy level range is redundancy of each FEC stream supported by the media stream An interval formed by a maximum redundancy and a minimum redundancy in the redundancy level, and one of the redundancy levels corresponds to a range of a packet loss rate range;
  • the first packet loss rate is within the current redundancy level range, determining whether the first packet loss rate causes the division of the redundancy level to be reduced, where the first packet loss rate belongs to the Determining the first redundancy level in the division of the redundancy level, and determining whether the first redundancy rate includes a packet loss rate corresponding to any current FEC stream and the first packet loss rate The packet loss rate causes the division of the redundancy level to be reduced;
  • the first packet loss rate causes the division of the redundancy level to be reduced, the first packet loss rate is re-matched with the redundancy level of all current FEC streams, and any redundancy is deleted. Degree level.
  • the processing unit is further configured to: if the first packet loss rate does not result in the division of the redundancy level If the reduction is required, determining whether the first packet loss rate causes the redundancy level to be re-divided; wherein when the first packet loss rate does not belong to the redundancy level Determining the first packet loss rate causes the redundancy level to be re-divided;
  • the division of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios.
  • the processing unit is further configured to:
  • the first packet loss rate is not in the current redundancy level range, determining, according to the redundancy level of each FEC stream supported by the media stream sent by the media sending terminal, whether to support adding a new FEC stream; If the redundancy level corresponding to the first packet loss rate is not included in the redundancy level of each FEC stream supported by the media stream, it is determined that adding a new FEC stream is not supported;
  • the allocation of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios
  • the FEC stream corresponding to the first packet loss rate is added, and the corresponding redundancy level is set.
  • the processing unit is further configured to: if the new FEC stream is supported, determine whether the bandwidth of the media sending terminal is Supporting the addition of a new FEC stream; wherein when the remaining bandwidth of the media sending terminal is greater than the bandwidth required by the newly added FEC stream, it is determined to support adding a new FEC stream;
  • the division of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios
  • bandwidth of the media sending terminal supports adding a new FEC stream, increase the FEC stream corresponding to the first packet loss rate, and set a corresponding redundancy level.
  • a fourth aspect provides a media sending terminal, including:
  • a sending unit configured to send, to the conference server, the FEC configuration information, where the FEC configuration information includes an identifier of the FEC stream supported by the media stream, so that the conference server generates a first mapping relationship table according to the FEC configuration information, where A mapping relationship table includes a correspondence between an identifier of the FEC stream and an identifier of the media receiving terminal;
  • the sending unit is further configured to send the media stream and the FEC stream generated according to the FEC configuration information to the conference server, so that the conference server sends the media stream to each media receiving terminal, and according to the The first mapping relationship table sends the FEC stream to a corresponding media receiving terminal.
  • the FEC configuration information further includes a redundancy level of each FEC stream supported by the media stream;
  • the media sending terminal further includes: a receiving unit and a processing unit ;
  • a receiving unit configured to receive FEC flow profile configuration information sent by the conference server, and the conference server reconfiguration a first mapping relationship table, where the FEC flow profile configuration information includes: a redundancy level of the FEC stream corresponding to the media stream sent by the conference server to each media receiving terminal;
  • the sending unit is further configured to send, according to the conference server, the conference server to the conference server when the processing unit confirms that the FEC stream configuration information and the FEC stream configuration corresponding to the first mapping relationship table reconfigured by the conference server are supported.
  • the FEC stream is generated by the FEC stream profile configuration information.
  • the processing unit is further configured to confirm that the FEC flow profile configuration information and the conference server reconfiguration are not supported Updating the FEC stream profile configuration information and the first mapping relationship table of the conference server reconfiguration when the FEC stream configuration corresponding to the first mapping relationship table is configured;
  • the sending unit is further configured to send, to the conference server, an FEC stream generated according to the FEC stream profile configuration information updated by the media sending terminal;
  • the sending unit is further configured to send the FEC stream file configuration information updated by the processing unit of the media sending terminal and the first mapping relationship table updated by the processing unit of the media sending terminal to the conference server.
  • a fifth aspect provides a conference server, including: a processor, a first interface circuit, a second interface circuit, a memory, and a bus; wherein the processor, the first interface circuit, the second interface circuit, and the memory are connected by using the bus And complete communication with each other;
  • a first interface circuit configured to receive FEC configuration information sent by the media sending terminal, where the FEC configuration information includes an identifier of the FEC stream supported by the media stream;
  • a processor configured to generate, according to the FEC configuration information received by the first interface circuit, a first mapping relationship table, where the first mapping relationship table includes a correspondence between an identifier of the FEC stream and an identifier of the media receiving terminal ;
  • the first interface circuit is further configured to receive a media stream sent by the media sending terminal and an FEC stream generated by the media sending terminal according to the FEC configuration information;
  • a second interface circuit configured to send the media stream received by the first interface circuit to each media receiving terminal, and receive the receiving unit according to a correspondence between the identifier of the FEC stream and the identifier of the media receiving terminal The FEC stream is sent to the media receiving terminal.
  • the FEC configuration information further includes a redundancy level of each FEC stream supported by the media stream;
  • the processor is further configured to acquire path state information of the media sending terminal to each media receiving terminal;
  • the processor is further configured to generate the media stream according to path state information of the media sending terminal to each media receiving terminal, and a redundancy level of each FEC stream supported by the media stream received by the first interface circuit.
  • the second interface circuit is further configured to send the FEC flow profile configuration information generated by the processor and the first mapping relationship table of the processor reconfiguration of the conference server to the media sending terminal;
  • the first interface circuit is further configured to receive a media stream sent by the media sending terminal and an FEC stream generated by the media sending terminal according to the FEC stream profile configuration information sent by the conference server.
  • the first interface circuit is further configured to receive updated FEC flow profile configuration information and information sent by the media sending terminal a first mapping relationship table updated by the media sending terminal, where the processor is further configured to: according to the FEC stream file configuration information updated by the media sending terminal and the first updated by the media sending terminal, received by the first interface circuit
  • the mapping relationship table adjusts the FEC flow profile configuration information and the first mapping relationship table stored by the conference server;
  • the first interface circuit is further configured to receive a media stream sent by the media sending terminal and an FEC stream generated by the media sending terminal according to the FEC stream profile configuration information updated by the media sending terminal.
  • the processor is specifically configured to obtain path state information of the media sending terminal to the conference server, and acquire each media receiving terminal to The path status information of the conference server; obtaining the media sending terminal to each media receiving according to the path state information of the media sending terminal to the conference server and the path state information of each media receiving terminal to the conference server Path status information of the terminal.
  • the path state information includes a packet loss ratio
  • the processor is specifically configured to:
  • the redundancy level range is redundancy of each FEC stream supported by the media stream An interval formed by a maximum redundancy and a minimum redundancy in the redundancy level, and one of the redundancy levels corresponds to a range of a packet loss rate range;
  • the first packet loss rate is within the current redundancy level range, determining whether the first packet loss rate causes the division of the redundancy level to be reduced, where the first packet loss rate belongs to the Determining the first redundancy level in the division of the redundancy level, and determining whether the first redundancy rate includes a packet loss rate corresponding to any current FEC stream and the first packet loss rate The packet loss rate causes the division of the redundancy level to be reduced;
  • the first packet loss rate causes the division of the redundancy level to be reduced, the first packet loss rate is re-matched with the redundancy level of all current FEC streams, and any redundancy is deleted. Degree level.
  • the processor specifically And if: if the first packet loss rate does not cause the division of the redundancy level to be reduced, determining whether the first packet loss rate causes the redundancy level to be re-divided; When a packet loss rate does not belong to any redundancy level of the redundancy level, determining that the first packet loss rate causes the redundancy level to be re-divided;
  • the division of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios.
  • the processor is specifically configured to:
  • the first packet loss rate is not in the current redundancy level range, determining, according to the redundancy level of each FEC stream supported by the media stream sent by the media sending terminal, whether to support adding a new FEC stream; If the redundancy level corresponding to the first packet loss rate is not included in the redundancy level of each FEC stream supported by the media stream, it is determined that adding a new FEC stream is not supported;
  • the allocation of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios
  • the FEC stream corresponding to the first packet loss rate is added, and the corresponding redundancy level is set.
  • the processor is further configured to: if the new FEC stream is supported, determine whether the bandwidth of the media sending terminal is Supporting the addition of a new FEC stream; wherein when the remaining bandwidth of the media sending terminal is greater than the bandwidth required by the newly added FEC stream, it is determined to support adding a new FEC stream;
  • the division of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios
  • bandwidth of the media sending terminal supports adding a new FEC stream, increase the FEC stream corresponding to the first packet loss rate, and set a corresponding redundancy level.
  • a media transmitting terminal includes: a first interface circuit, a memory, and a bus; and the first interface circuit and the memory are connected through the bus and complete communication with each other;
  • the first interface circuit is configured to send the FEC configuration information to the conference server, where the FEC configuration information includes an identifier of the FEC stream supported by the media stream, so that the conference server generates a first mapping relationship table according to the FEC configuration information.
  • the first mapping relationship table includes a correspondence between an identifier of the FEC stream and an identifier of the media receiving terminal;
  • the first interface circuit is further configured to send the media stream and the FEC stream generated according to the FEC configuration information to the conference server, so that the conference server sends the media stream to each media receiving terminal, and And sending the FEC stream to the corresponding media receiving terminal according to the first mapping relationship table.
  • the FEC configuration information further includes a redundancy level of each FEC stream supported by the media stream;
  • the media sending terminal further includes: connecting to the bus Second interface circuit and processor;
  • a second interface circuit configured to receive FEC flow profile configuration information sent by the conference server and a first mapping relationship table of the conference server reconfiguration, where the FEC flow profile configuration information includes: the conference server sends to each media Receiving a redundancy level of the FEC stream corresponding to the media stream of the terminal;
  • the first interface circuit is further configured to send, to the conference server, when the processor confirms that the FEC flow profile configuration information and the FEC flow configuration corresponding to the first mapping relationship table reconfigured by the conference server are supported.
  • An FEC stream generated according to FEC flow profile configuration information of the conference server.
  • the processor is further configured to confirm that the FEC flow profile configuration information and the conference server reconfiguration are not supported Updating the FEC stream profile configuration information and the first mapping relationship table of the conference server reconfiguration when the FEC stream configuration corresponding to the first mapping relationship table is configured;
  • the first interface circuit is further configured to send, to the conference server, an FEC stream generated according to FEC flow profile configuration information updated by the media sending terminal;
  • the first interface circuit is further configured to send, to the conference, the FEC flow profile configuration information updated by the processor of the media sending terminal and the first mapping relationship table updated by the processor of the media sending terminal. server.
  • a seventh aspect a communication system, comprising: the conference server according to any one of the foregoing third aspect or the third aspect, and any one of the foregoing fourth or fourth aspect The medium transmitting terminal described in the implementation manner;
  • the conference server according to any one of the foregoing fifth aspect or the fifth aspect, and the media transmission terminal according to any one of the sixth aspect or the sixth aspect.
  • the media sending terminal can send the FEC configuration information to the conference server, so that the conference server generates the first mapping relationship table according to the FEC configuration information; the conference server receives the After the media sending terminal sends the EFC stream of the media stream generated by the FEC configuration information, the conference server can send the received FEC stream to the corresponding media receiving terminal according to the first mapping relationship table; thereby avoiding FEC encoding and decoding and packet buffering. Consuming a large amount of resources of the conference server can reduce the resource consumption of the server, thereby reducing the end-to-end transmission delay of the media stream.
  • FIG. 1 is a schematic structural diagram of a communication system according to an embodiment of the present invention.
  • FIG. 2 is a schematic flowchart of a media stream transmission method according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a process of generating FEC flow profile configuration information of a media stream according to an embodiment of the present invention
  • FIG. 4 is a schematic structural diagram of a conference server according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a conference server according to another embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of a media sending terminal according to an embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of a conference server according to still another embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of a media sending terminal according to another embodiment of the present invention.
  • GSM Global System of Mobile communication
  • CDMA Code Division Multiple Access
  • WCDMA Wideband Code Division Multiple Access
  • GPRS General Packet Radio Service
  • LTE Long Term Evolution
  • FDD Frequency Division Duplex
  • TDD Time Division Duplex
  • UDD Universal Mobile Telecommunication System
  • WiMAX Global System of Mobile communication
  • the media sending/receiving terminal provided by the embodiment of the present invention may be a cellular phone, a cordless phone, a session initiation protocol (English name: Session Initiation Protocol, SIP), and a wireless local loop.
  • Full name: Wireless Local Loop, English abbreviation: WLL) Station personal digital processing (English full name: Personal Digital Assistant, English abbreviation: PDA), wireless communication capabilities of handheld devices, car devices, wearable devices, computing devices or connected to User equipment of the wireless modem (English full name: User Equipment, English abbreviation: UE).
  • the conference server provided by the embodiment of the present invention may be a server that is connected to each terminal by wire or wirelessly, and is not limited in the embodiment of the present invention.
  • a communication system provided by an embodiment of the present invention includes a conference server Server and at least two terminals (D1, D2, D3, . . . Dn), wherein the at least two terminals include one media receiving terminal. D1 and at least one media receiving terminal (D2, D3, ... Dn), wherein the media receiving terminal distributes the media stream to the at least one media receiving terminal through the conference server.
  • An embodiment of the present invention provides a media stream transmission method.
  • the application and the foregoing communication system, as shown in FIG. 2, include the following steps:
  • the conference server receives the FEC configuration information sent by the media sending terminal.
  • the media sending terminal can be implemented by using a SDP (Syntax Description Protocol, Session Description Protocol) session negotiation process.
  • the specific media sending terminal can carry the FEC configuration information in the SDP offer (SDP request).
  • the conference server After receiving the SDP offer, the conference server sends a feedback SDP Answer (SDP Response) to the media as the response message.
  • SDP Structure Description Protocol
  • SDP Response feedback SDP Answer
  • the FEC configuration information includes an identifier of the FEC stream supported by the media stream, where the identifier of the FEC stream may be a PT (English full name: Payload types, Chinese full name: payload type) value, where the media stream may correspond to multiple FEC streams, and the media stream
  • the correspondence with the FEC stream may be associated with the identifier of the media stream (such as the PT value of the media stream) and the identifier of the FEC stream (the PT value of the FEC stream).
  • the conference server generates a first mapping relationship table according to the FEC configuration information.
  • the first mapping relationship table includes a correspondence between an identifier of the FEC stream and an identifier of the media receiving terminal, where the identifier of the media receiving terminal may be an ID (identity) for the initial state, because the conference server is in the initial state.
  • the path status of the media sending terminal to the media receiving terminal cannot be obtained. Therefore, the conference server can only forward the FEC stream randomly generated by the media sending terminal to each media receiving terminal. At this time, the media sending terminal can only provide one FEC of the media stream to the conference server.
  • the identifier of the flow is not a limitation of the present invention.
  • the media sending terminal may also send the identifier of the multiple FEC streams supported by the media stream to the conference server.
  • the exemplary media stream with the PT value of 97 may be generated as follows. First mapping relationship table (Table 1):
  • the media transmitting terminal in Table 1 provides only the FEC stream with the PT value of 109 for the media stream with the PT value of 97, and the FEC stream with the PT value of 109 simultaneously corresponds to the three media receiving terminals with the IDs of D1, D2, and D3.
  • the media sending terminal generates an FEC stream according to the FEC configuration information.
  • the media sending terminal in step 101 only provides the identifier of the FEC stream of the media stream to the conference server, that is, the same FEC stream is used for all the media receiving terminals, as shown in Table 1, the media sending terminal only generates the media stream. An FEC stream. At the same time, the media sending terminal sends the media stream and the corresponding FEC stream to the conference server.
  • the conference server sends the media stream to the media receiving terminal, and sends the FEC stream generated in step 103 according to the correspondence between the identifier of the FEC stream and the identifier of the media receiving terminal in the first mapping relationship table generated in step 102. To each media receiving terminal.
  • the conference server may separately send the FEC stream with the PT value of 109 to each media receiving terminal by referring to the ID of each media receiving terminal in Table 1.
  • the media sending terminal randomly generates the FEC stream in the initial solution. This does not reflect the actual state of the path of the media sending terminal and the media receiving terminal. Therefore, the preferred solution is to generate only one FEC stream for the media stream, and avoid the waste of the resource generated by the sending terminal for generating more than two FEC streams for the media stream.
  • the present application does not limit the initial state that the media transmitting terminal only provides one FEC stream of the media stream to the conference server.
  • the media sending terminal may provide the conference server with the identifiers of the two or more FEC streams of the media stream.
  • Table 2 below provides another exemplary first mapping relationship table:
  • the media sending terminal in Table 2 provides two FEC streams with PT values of 109 and 110 for the media stream with the PT value of 97, and the FEC streams with the PT value of 109 simultaneously correspond to the two media receiving terminals with the IDs D1 and D2.
  • the FEC stream with a PT value of 110 corresponds to the media receiving terminal with the ID D3.
  • the conference server can directly forward the FEC stream corresponding to each media receiving terminal provided by the media sending terminal according to the first mapping relationship table, thereby avoiding the FEC encoding and decoding and the packet buffering, which consumes a large amount of resources of the conference server, and can reduce the server. The resource consumption, thereby reducing the end-to-end transmission delay of the media stream.
  • the FEC configuration information further includes a redundancy level of each FEC stream supported by the media stream.
  • the FEC configuration information may also include the maximum number of FEC streams supported by the media stream, and the supported FEC algorithm.
  • the FEC configuration information may be carried by defining a new media attribute line in the SDP session negotiation process in step 101, and the format is as follows:
  • Red_level_info L1/L2/L3;
  • Algorithm A1/A2/A3;
  • FEC_capability indicates the FEC capacity, and the number of FEC streams is assigned by num;
  • red_level_info indicates the supported redundancy level information, and the supported redundancy level may have multiple values, such as: L1, L2, and L3;
  • algorithm indicates the supported FEC algorithm type. Can contain multiple values, such as A1, A2, A3.
  • the usage of this attribute line includes the following two types:
  • the above parameters can be used for m rows corresponding to all media streams, and only num and algorithm parameters are filled, indicating the total maximum FEC stream number supported by all media streams corresponding to the m row and the supported FEC algorithm type;
  • the above parameters can also be used for a certain media stream in the m line.
  • the num and red_level_info parameters are filled in, indicating that the FEC stream that can be simultaneously generated for the media stream is the largest. The number, and the corresponding redundancy level.
  • the structure of the rtpmap attribute line is as follows:
  • step 101-104 only one FEC stream is generated for the media stream, and the association between the media stream and the FEC stream is completed through the media_group attribute line.
  • SDP offer instance is provided below (only some related lines are included):
  • This session is initiated by alice.
  • the session ID is 2362969037
  • the version number is 2362969040
  • the network is initernet
  • the address type is IPv4
  • the specific address is 192.0.2.156.
  • the current description is as follows: the media stream type is video, the receiving media port is 49300, the transmission protocol type is RTP, and the two media formats are 97 and 110; the a line is described by the media sending terminal for the PT value of 97 media stream.
  • the FEC capability information is: maximum support for generating 2 FEC streams, redundancy includes 10%/20%/30%, supported FEC algorithms include 1d-interleaved-parityfec and RS; media stream video payload format with PT value of 97 is H.264/90000; the 1d-interleaved-parityfec algorithm used by the FEC stream with a PT value of 110, the redundancy is 10%; the media stream with the PT value of 97 has a corresponding FEC stream with a PT value of 110.
  • the media_group attribute line completes the association of the media stream and the FEC stream.
  • the conference server After completing the SDP negotiation with the media sending terminal, the conference server saves the FEC configuration information sent by the media sending terminal.
  • the conference server obtains path state information of the media sending terminal to the conference server.
  • the path state information includes a packet loss rate and a delay. Because the data packet transmission process of the SDP session negotiation has been performed between the media sending terminal and the conference server in the foregoing process, and the media sending terminal has started to send the media stream and the FEC stream to the conference server in the form of a data packet, the specific steps are performed.
  • the conference server in the 105 may collect the path state information of the media sending terminal to the conference server according to the data packet sent by the received media sending terminal. Step 105 may start at the same time as the SDP session negotiation process in step 101 above.
  • the conference server acquires path state information of each media receiving terminal to the conference server.
  • the media receiving terminal periodically reports to the conference server through the RTCP (English full name: Real-Time Transport Control Protocol) RR (English name: ReceiverReport, Chinese: Receiver Report) message. Status information of the path from the conference server to the media receiving terminal, including packet loss rate, delay, and so on.
  • RTCP Real-Time Transport Control Protocol
  • RR English name: ReceiverReport, Chinese: Receiver Report
  • the conference server obtains path state information of the media sending terminal to each media receiving terminal according to the path state information of the media sending terminal to the conference server and the path state information of each media receiving terminal to the conference server.
  • step 105 since the path state information of the media sending terminal to the conference server is obtained in step 105, the path state information of each media receiving terminal to the conference server is obtained in step 106, so step 107 is specifically to send the media to the conference to the conference.
  • the path state information of the server is integrated with the path state information of each media receiving terminal to the conference server to obtain path state information of the media sending terminal to each media receiving terminal.
  • the conference server generates FEC flow profile configuration information of the media stream according to the path state information of the media sending terminal to the media receiving terminal and the redundancy level of each FEC stream supported by the media stream, and reconfigures the first mapping relationship table.
  • the FEC flow profile configuration information includes a redundancy level of the FEC stream corresponding to the media streams sent by the conference server to each media receiving terminal. Exemplary provides the following Table 3,
  • the broadband capability of the media sending terminal may be considered in the step 108.
  • the step 108 is specifically the path information of the conference server according to the media sending terminal to the media receiving terminal, and the redundancy of each FEC stream supported by the media stream.
  • the redundancy level and the broadband capability of the media transmitting terminal generate FEC flow profile configuration information of the media stream and reconfigure the first mapping relationship table.
  • the conference server divides each media receiving terminal into several grades according to the path state information of the media sending terminal to the plurality of media receiving terminals.
  • the conference server is configured according to the FEC configuration information of the media sending terminal (the number of existing FEC streams, that is, the number of EFC streams generated by the media sending terminal during the initialization of steps 101 to 104; and the maximum number of supported FEC streams) and The bandwidth condition of the media transmitting terminal (considered in the case where the information is available) determines whether the media receiving terminal of the different grades above can provide different FEC streams, and if supported, updates the media receiving terminal corresponding to the FEC stream of the media stream.
  • the corresponding profile configuration information if not fully supported, considers merging part of the media receiving terminal grades, and reduces the number of FEC streams so that some media receiving terminals share the same FEC stream, because the media receiving terminals and media that share the same FEC stream are sent.
  • the path states between the terminals are not completely the same, so the path state between the media receiving terminal and the media transmitting terminal sharing the same FEC stream can be weighed to adjust the redundancy of the shared FEC stream, refer to Table 2 above and Table 3, where F2 corresponds to a FEC stream with a PT value of 109, and D3 corresponds to an FEC stream with a PT value of 110, if necessary, D2 and When D3 is classified as the same grade to reduce the FEC stream, the redundancy corresponding to the FEC stream with the PT value of 109 is L1, and the redundancy of the FEC stream with the PT value of 110 is L2, so if the PT value is 110 The FEC stream is canceled, and the FEC stream with the PT value of 109 shared by D2 and D3 needs to adjust the redundancy L1 corresponding to the FEC stream with the PT value of 109.
  • the conference server analyzes that the packet loss rate of the path from the media sending terminal to the media receiving terminal 2 is too large, and the existing FEC stream cannot be used.
  • the media receiving terminal needs to be divided into 2 categories.
  • the media sending terminal supports two FEC streams for the FEC capability information of the media stream, and the conference server updates the number of FEC streams of the media stream to 2, and sets a new redundancy parameter for the new FEC stream (the parameter is from the media sending terminal).
  • the previous capability information is selected in a centralized manner, and the FEC flow profile configuration information of the media stream is generated and the first mapping relationship table is reconfigured.
  • the FEC flow profile configuration information of the generated media stream in step 108 is implemented by the following process:
  • S1 Determine whether the first packet loss rate of the media sending terminal to the first media receiving terminal is not within the current redundancy level range.
  • the redundancy level range is an interval formed by a maximum redundancy and a minimum redundancy in a redundancy level of each FEC stream supported by the media stream, and one redundancy level corresponds to a range of a packet loss rate range.
  • the first packet loss rate belongs to a redundancy level in the division of the redundancy level, and any redundancy level does not include the packet loss rate and the first packet loss rate corresponding to any current FEC stream, Determining the first packet loss rate results in a reduction in the division of redundancy levels.
  • S3 Rematch the first packet loss rate with the redundancy level of all current FEC streams, and delete any of the redundancy levels.
  • S4 Determine whether the first packet loss rate causes a redundancy level to be re-divided.
  • determining the first packet loss rate results in redundancy level re-division.
  • step S1 if the first packet loss rate is not within the current redundancy level range, the following steps are performed:
  • S7 Determine, according to the redundancy level of each FEC stream supported by the media stream sent by the media sending terminal, whether to support adding a new FEC stream.
  • the redundancy level corresponding to the first packet loss rate is not included in the redundancy level of each FEC stream supported by the media stream, it is determined that the addition of the new FEC stream is not supported.
  • step S5 is performed.
  • the following specifically includes:
  • step S5 is performed.
  • step S8 is performed.
  • Redundancy level Media receiving terminal 0 to 10% D1 20 to 30% D2, D3
  • the first packet loss rate may be determined to be within a range of 0 to 10% of the current redundancy level. Therefore, there is no need to adjust the current redundancy level range, and the FEC stream corresponding to the first packet loss rate is increased according to the existing configuration operation, that is, the above step S6.
  • the current first packet loss rate is 23%, corresponding to the path state of the media sending terminal to the first media receiving terminal D1
  • the original redundancy level 0-10% can not meet the requirements. It is necessary to adjust D1 to the level of redundancy level 20 ⁇ 30%, and the original redundancy level 0 ⁇ 10% does not correspond to the media receiving terminal. It is deleted, that is, the above step S3.
  • the mapping of the media receiving terminal and the redundancy is adjusted as shown in Table 5 below:
  • the current first packet loss rate is 13%, corresponding to the path state of the media sending terminal to the first media receiving terminal D1
  • D1 originally corresponds to The redundancy level 0-10% can not meet the requirements, and the 20 ⁇ 30% grade is too high. Therefore, the current redundancy level information needs to be adjusted here, and the original redundancy level 0-10% is adjusted to 20 ⁇ . 30%, that is, the above step S5.
  • the mapping of the media receiving terminal and the redundancy is adjusted as shown in Table 6 below:
  • the mapping of the media receiving terminal and the redundancy is adjusted as shown in Table 7 below:
  • FEC redundancy level Recipient 0 to 10% D1 20 to 30% D3 30 to 40% D2
  • the conference server sends the FEC flow profile configuration information and the first mapping relationship table reconfigured by the conference server to the media sending terminal.
  • the conference server may initiate a new O/A (Request Response) negotiation to the media sending terminal, and send an SDP offer to the media sending terminal.
  • O/A Request Response
  • the O/A is used to send a terminal notification to the media, and generate two FEC streams for the media stream, where each FEC stream corresponds to a PT value, and the SDP offer instance is as follows (only some related lines are included):
  • the o line is described as follows: The session is initiated by alice, the session ID is 2362969037, the version number is 2362969040, the network is initernet, the address type is IPv4, and the specific address is 192.0.2.200; the s line indicates the session name, where each session There must be one and only one session name in the description; the m line is described as: the media stream type is video, the receiving media port is 49300, the transmission protocol type is RTP, and the two media formats are 97, 110, and 111; The description is as follows: For a media stream with a PT value of 97, two FEC streams are generated, one of which has a PT value of 110, another FEC stream of 111, and a 1d-interleaved-parityfec algorithm used by an FEC stream with a PT value of 110.
  • the corresponding redundancy is 10%, and the 1d-interleaved-parityfec algorithm used by the FEC stream with a PT value of 111 corresponds to a redundancy of 20%.
  • the media stream with the PT value of 97 and the FEC stream with the PT value of 110 are associated through the media_group attribute line.
  • the media stream with the PT value of 97 and the FEC stream with the PT value of 111 are also associated through the media_group attribute line.
  • the FEC stream configuration corresponding to the table is configured to generate an FEC stream according to the FEC stream file configuration information sent by the conference server.
  • the answer example of the SDP offer in the above step 109 is as follows (only some related lines are included):
  • the description of the a line is as follows: support for the media stream with the PT value of 97, and generate two FEC streams, one of which is FEC stream.
  • the PT value is 110
  • the other FEC stream is 111
  • the 1d-interleaved-parityfec algorithm used by the FEC stream with a PT value of 110 corresponds to a redundancy of 10%
  • the 1d-interleaved-parityfec used by the FEC stream with a PT value of 111 corresponds to a redundancy of 20%.
  • the media stream with the PT value of 97 and the FEC stream with the PT value of 110 are associated through the media_group attribute line.
  • the media stream with the PT value of 97 and the FEC stream with the PT value of 111 are also associated through the media_group attribute line.
  • the media sending terminal confirms the FEC flow profile configuration information of the media stream generated by the conference server in step 108 and the reconfigured first mapping relationship table, so the media sending terminal sends the media stream and the step to the conference server.
  • the conference server receives the media stream sent by the media sending terminal and the FEC stream generated by the step 110, and then sends the media stream to each media receiving terminal, and according to the first mapping relationship reconfigured by the conference server in step 108.
  • the table sends the received FEC streams to the corresponding media receiving terminals. The specific reference for the sending of each FEC stream is not described here.
  • the media sending terminal confirms that the FEC flow profile configuration information and the FEC flow configuration corresponding to the first mapping relationship table reconfigured by the conference server are not supported, the FEC flow profile configuration information and the first mapping relationship table reconfigured by the conference server are updated.
  • the EFC configuration information of the media sending terminal may change due to the change of the network state and the resource configuration of the media sending terminal.
  • a solution is: The changed EFC configuration information is resent to the conference server through the SDP negotiation process in the above step 101.
  • the media sending terminal directly updates the FEC flow profile configuration information and the first mapping relationship table of the conference server reconfiguration according to the changed EFC configuration information, according to the EFC configuration information in the foregoing process.
  • the content of the EFC configuration information mainly causes the redundancy level of each FEC stream supported by the media stream and the maximum number of supported FEC streams to change.
  • the FEC stream profile configuration information is mainly for updating the redundancy of each FEC stream.
  • the first level mapping relationship of the re-configuration of the conference server is to adjust the correspondence between the identifier of the FEC stream and the identifier of the media receiving terminal. For example, the number of the maximum FEC stream supported by the media stream needs to be canceled.
  • the FEC stream with a PT value of 112 exists in the first mapping relationship table of the server reconfiguration, and the corresponding media receiving terminal is D4; if the redundancy of the FEC stream with the PT value of 112 is 43%, the corresponding redundancy level 40-50%; when the EFC configuration information changes, the maximum redundancy level supported by the media sending terminal is 30-40%; then the first mapping needs to be canceled.
  • PT is present FEC media stream reception terminal 112 corresponding relationship table D4, or the configuration of a lower level of redundancy D4.
  • the media sending terminal sends the updated FEC stream file configuration information and the first mapping relationship table updated by the media sending terminal to the conference server.
  • the answer to the SDP offer in the above step 110 is as follows (only some related lines are included):
  • the description of the o, s, and m lines refer to the above example, and the description of the a line is as follows: support for the media stream with the PT value of 97, and generate an FEC stream with a corresponding PT value of 110.
  • the 1d-interleaved-parityfec algorithm used has a corresponding redundancy of 20%.
  • the media stream with the PT value of 97 has a corresponding FEC stream with a PT value of 110, and the media stream and the FEC stream are associated through the media_group attribute line.
  • the conference server receives the updated FEC stream profile configuration information sent by the media sending terminal and the first mapping relationship table updated by the media sending terminal, and according to the FEC stream profile configuration information updated by the media sending terminal and the first mapping updated by the media sending terminal.
  • the relationship table adjusts the FEC flow profile configuration information and the first mapping relationship table stored by the conference server.
  • the media sending terminal generates an FEC stream corresponding to the media stream according to the FEC stream file configuration information updated by the media sending terminal, and sends the FEC stream corresponding to the media stream to the conference server.
  • step 113 the association between the FEC stream and the media stream is completed by defining a new media attribute media_group, which is convenient for the conference server to forward.
  • the conference server sends the media stream to each media receiving terminal, and sends each FEC stream to the corresponding media receiving terminal according to the correspondence between the identifier of the FEC stream and the identifier of the media receiving terminal in the adjusted first mapping relationship table. .
  • the conference server needs to complete the FEC packet.
  • the PT value is modified, specifically, the conference server modifies the value of the PT field in the RTP header to a new PT value.
  • the process in which the media sending terminal sends the media stream to the conference server may adopt the prior art such as the retransmission technology or the FEC technology, and the present application is not specifically limited.
  • the media sending terminal can send the FEC configuration information to the conference server, so that the conference server generates the first mapping relationship table according to the FEC configuration information; the conference server receives the media transmission terminal according to the After the EFC stream of the media stream generated by the FEC configuration information, the conference server can send the received FEC stream to the corresponding media receiving terminal according to the first mapping relationship table; thereby avoiding the FEC encoding and decoding and the packet buffering, which consumes a large number of conference servers.
  • the resource can reduce the resource consumption of the server, thereby reducing the end-to-end transmission delay of the media stream; and can also according to the path state information of the media sending terminal to each media receiving terminal, the bandwidth of the media sending terminal, and the FEC configuration information of the media sending terminal.
  • the change of the FEC stream file configuration information and the first mapping relationship table is updated in real time, and the matching accuracy of the EFC stream and the media stream is improved.
  • An embodiment of the present invention provides a conference server, which is used to implement the foregoing media stream transmission method. Referring to FIG. 4, the method includes:
  • the receiving unit 41 is configured to receive FEC configuration information that is sent by the media sending terminal, where the FEC configuration information includes an identifier of the FEC stream supported by the media stream.
  • the processing unit 42 is configured to generate, according to the FEC configuration information received by the receiving unit 41, a first mapping relationship table, where the first mapping relationship table includes a correspondence between an identifier of the FEC stream and an identifier of the media receiving terminal. ;
  • the receiving unit 41 is further configured to receive a media stream sent by the media sending terminal and an FEC stream generated by the media sending terminal according to the FEC configuration information;
  • the sending unit 43 is configured to send the media stream received by the receiving unit 41 to each media receiving terminal, and receive the receiving unit 41 according to the correspondence between the identifier of the FEC stream and the identifier of the media receiving terminal.
  • the FEC stream is sent to the media receiving terminal.
  • the conference server provided by the embodiment of the present invention can receive the FEC configuration information sent by the media sending terminal, and generate a first mapping relationship table according to the FEC configuration information; and receive the EFC of the media stream generated by the media sending terminal according to the FEC configuration information.
  • the conference server can send the received FEC stream to the corresponding media receiving terminal according to the first mapping relationship table; thereby avoiding the FEC encoding and decoding and the packet buffering, which consumes a large amount of resources of the conference server, and can reduce the resource consumption of the server. Thereby reducing the end-to-end transmission delay of the media stream.
  • the FEC configuration information further includes a redundancy level of each FEC stream supported by the media stream.
  • the conference server further includes: an obtaining unit 44, configured to acquire Path status information of the media sending terminal to each media receiving terminal;
  • the processing unit 42 is further configured to: according to the path state information of the media sending terminal to each media receiving terminal acquired by the acquiring unit 44, and the redundancy level of each FEC stream supported by the media stream received by the receiving unit 41, Generating the FEC stream profile configuration information of the media stream and reconfiguring the first mapping relationship table, where the FEC stream profile configuration information includes: an FEC stream corresponding to the media streams respectively sent by the conference server to each media receiving terminal Redundancy level
  • the sending unit 43 is further configured to send the FEC stream file configuration information generated by the processing unit 42 and the first mapping relationship table reconfigured by the processing unit 42 of the conference server to the media sending terminal;
  • the receiving unit 41 is further configured to receive a media stream sent by the media sending terminal and an FEC stream generated by the media sending terminal according to the FEC stream profile configuration information sent by the conference server.
  • the receiving unit 41 is further configured to receive updated FEC stream file configuration information sent by the media sending terminal and a first mapping relationship table that is updated by the media sending terminal
  • the processing unit is 42 is further configured to adjust FEC flow profile configuration information stored by the conference server according to the FEC flow profile configuration information updated by the media sending terminal and the first mapping relationship table updated by the media sending terminal received by the receiving unit 41.
  • First mapping relationship table ;
  • the receiving unit 41 is further configured to receive a media stream sent by the media sending terminal and an FEC stream generated by the media sending terminal according to the FEC stream profile configuration information updated by the media sending terminal.
  • the obtaining unit 44 is configured to obtain path state information of the media sending terminal to the conference server, and obtain path state information of each media receiving terminal to the conference server; The path state information of the sending terminal to the conference server and the path state information of each media receiving terminal to the conference server acquire path state information of the media sending terminal to each media receiving terminal.
  • path state information includes a packet loss rate
  • the processing unit 42 is specifically configured to:
  • the redundancy level range is redundancy of each FEC stream supported by the media stream An interval formed by a maximum redundancy and a minimum redundancy in the redundancy level, and one of the redundancy levels corresponds to a range of a packet loss rate range;
  • the first packet loss rate is within the current redundancy level range, determining whether the first packet loss rate causes the division of the redundancy level to be reduced, where the first packet loss rate belongs to the Determining the first redundancy level in the division of the redundancy level, and determining whether the first redundancy rate includes a packet loss rate corresponding to any current FEC stream and the first packet loss rate The packet loss rate causes the division of the redundancy level to be reduced;
  • the first packet loss rate causes the division of the redundancy level to be reduced, the first packet loss rate and the current location are The redundancy level of some FEC streams is re-matched, and any of the redundancy levels are deleted.
  • processing unit 42 is further configured to: if the first packet loss rate does not cause the division of the redundancy level to be reduced, determine whether the first packet loss rate is Causing the redundancy level to be re-divided; wherein when the first packet loss rate does not belong to any one of the redundancy level partitions, determining the first packet loss rate results in the Redundancy level re-division;
  • the division of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios.
  • processing unit 42 is specifically configured to:
  • the first packet loss rate is not in the current redundancy level range, determining, according to the redundancy level of each FEC stream supported by the media stream sent by the media sending terminal, whether to support adding a new FEC stream; If the redundancy level corresponding to the first packet loss rate is not included in the redundancy level of each FEC stream supported by the media stream, it is determined that adding a new FEC stream is not supported;
  • the allocation of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios
  • the FEC stream corresponding to the first packet loss rate is added, and the corresponding redundancy level is set.
  • processing unit 42 is further configured to: if it is supported to add a new FEC stream, determine whether the bandwidth of the media sending terminal supports adding a new FEC stream; wherein when the media is sent When the remaining bandwidth of the terminal is greater than the bandwidth required by the newly added FEC stream, it is determined to support adding a new FEC stream;
  • the division of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios
  • bandwidth of the media sending terminal supports adding a new FEC stream, increase the FEC stream corresponding to the first packet loss rate, and set a corresponding redundancy level.
  • the conference server can also update the FEC stream profile configuration information and the first time according to the path state information of the media sending terminal to each media receiving terminal, the bandwidth of the media sending terminal, and the FEC configuration information of the media sending terminal.
  • the mapping relationship table improves the accuracy of the matching between the EFC stream and the media stream.
  • the receiving unit 41 in this embodiment may be an interface circuit having a receiving function on the conference server, such as a receiver or an information receiving interface;
  • the sending unit 43 may be an interface circuit having a transmitting function on the conference server, such as transmitting. Machine or information sending interface.
  • the processing unit 42 and the obtaining unit 44 may be separately set up processors, or may be implemented in one processor of the conference server, or may be stored in the memory of the conference server in the form of program code, by the conference server.
  • a certain processor calls and executes the functions of the above processing unit 42 and the obtaining unit 44.
  • the processor described here can be a central processing unit (English full name: Central Processing Unit, English abbreviation:
  • the CPU is either a specific integrated circuit (English name: ASIC) or one or more integrated circuits configured to implement the embodiments of the present invention.
  • an embodiment of the present invention provides a media sending terminal, which is used to implement the foregoing media stream transmission method, and includes:
  • the sending unit 61 is configured to send the FEC configuration information to the conference server, where the FEC configuration information includes an identifier of the FEC stream supported by the media stream, so that the conference server generates a first mapping relationship table according to the FEC configuration information, where The first mapping relationship table includes a correspondence between an identifier of the FEC stream and an identifier of the media receiving terminal;
  • the sending unit 61 is further configured to send the media stream and the FEC stream generated according to the FEC configuration information to the conference server, so that the conference server sends the media stream to each media receiving terminal, and according to The first mapping relationship table sends the FEC stream to a corresponding media receiving terminal.
  • the media sending terminal provided by the embodiment of the present invention can send the FEC configuration information to the conference server, so that the conference server generates a first mapping relationship table according to the FEC configuration information; and the conference server receives the generated by the media sending terminal according to the FEC configuration information.
  • the conference server can send the received FEC stream to the corresponding media receiving terminal according to the first mapping relationship table; thereby avoiding FEC encoding and decoding and packet caching, which consumes a large amount of resources of the conference server, and can reduce the server.
  • the resource consumption thereby reducing the end-to-end transmission delay of the media stream.
  • the FEC configuration information further includes a redundancy level of each FEC stream supported by the media stream.
  • the media sending terminal further includes: a receiving unit 62 and a processing unit. 63;
  • the receiving unit 62 is configured to receive the FEC flow profile configuration information sent by the conference server and the first mapping relationship table of the conference server reconfiguration, where the FEC flow profile configuration information includes: the conference server sends to each media receiving The redundancy level of the FEC stream corresponding to the media stream of the terminal;
  • the sending unit 61 is further configured to: when the processing unit 63 confirms that the FEC stream configuration information and the FEC stream configuration corresponding to the first mapping relationship table reconfigured by the conference server are supported, send, to the conference server, according to the The FEC stream generated by the FEC stream file configuration information of the conference server.
  • processing unit 63 is further configured to: when confirming that the FEC stream configuration information and the FEC stream configuration corresponding to the first mapping relationship table of the conference server reconfiguration are not supported, Defining FEC flow profile configuration information and a first mapping relationship table of the conference server reconfiguration;
  • the sending unit 61 is further configured to send, to the conference server, an FEC stream generated according to the FEC stream profile configuration information updated by the media sending terminal;
  • the sending unit 61 is further configured to send the FEC stream file configuration information updated by the processing unit 63 of the media sending terminal and the first mapping relationship table updated by the processing unit 63 of the media sending terminal to the conference server.
  • the media sending terminal can also update the FEC stream file configuration information and the first mapping relationship table in real time, thereby improving The accuracy of the matching between the EFC stream and the media stream.
  • the receiving unit 62 in this embodiment may be an interface circuit having a receiving function on the conference server, such as a receiver or an information receiving interface;
  • the sending unit 61 may be an interface circuit having a transmitting function on the conference server, such as transmitting.
  • Machine or information sending interface may be a separately set processor, or may be implemented in one processor of the conference server, or may be stored in the memory of the conference server in the form of program code, by a processor of the conference server. The functions of the above processing unit 63 are called and executed.
  • the processor described herein may be a central processing unit (English name: Central Processing Unit, English abbreviation: CPU), or a specific integrated circuit (English name: Application Specific Integrated Circuit, English abbreviation: ASIC), or configured One or more integrated circuits implementing embodiments of the present invention.
  • CPU Central Processing Unit
  • ASIC Application Specific Integrated Circuit
  • an embodiment of the present invention provides a conference server for implementing the foregoing media stream transmission method, including: a processor 71, a first interface circuit 72, a second interface circuit 73, a memory 74, and a bus 75.
  • the processor 71, the first interface circuit 72, the second interface circuit 73, and the memory 74 are connected through the bus 75 and complete communication with each other;
  • the processor 71 herein may be a processor or a collective name of multiple processing elements.
  • the processor may be a central processing unit CPU, or a specific integrated circuit ASIC, or one or more integrated circuits configured to implement embodiments of the present invention, such as one or more microprocessors (English full name) : digitalsingnal processor, English abbreviation: DSP), or one or more field programmable gate arrays (English full name: Field Programmable Gate Array, English abbreviation: FPGA).
  • the memory 74 may be a storage device or a collective name of a plurality of storage elements, and is used to store executable program code or parameters, data, and the like required for operation of the access network management device.
  • the memory 74 may include a random access memory (English name: Random-Access Memory, English abbreviation: RAM), and may also include non-volatile memory (English name: non-volatile memory, English abbreviation: NVRAM), such as disk storage, flash memory. (Flash) and so on.
  • the bus 75 can be an industry standard architecture (English name: Industry Standard Architecture, English abbreviation: ISA) bus, external device interconnection (English full name: Peripheral Component, English abbreviation: PCI) bus or extended industry standard architecture (English full name: Extended Industry Standard Architecture, English abbreviation: EISA) bus.
  • the bus 75 can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 7, but it does not mean that there is only one bus or one type of bus.
  • the first interface circuit 72 is configured to receive FEC configuration information sent by the media sending terminal, where the FEC configuration information includes an identifier of the FEC stream supported by the media stream;
  • the processor 71 is configured to generate, according to the FEC configuration information received by the first interface circuit 72, a first mapping relationship table, where the first mapping relationship table includes an identifier between the FEC stream and an identifier of the media receiving terminal.
  • first mapping relationship table includes an identifier between the FEC stream and an identifier of the media receiving terminal.
  • the first interface circuit 72 is further configured to receive a media stream sent by the media sending terminal and the media sending terminal An FEC stream generated according to the FEC configuration information;
  • the second interface circuit 73 is configured to send the media stream received by the first interface circuit 72 to each media receiving terminal, and receive the receiving according to a correspondence between the identifier of the FEC stream and the identifier of the media receiving terminal.
  • the FEC stream received by the unit is sent to the media receiving terminal.
  • the conference server provided by the embodiment of the present invention can receive the FEC configuration information sent by the media sending terminal, and generate a first mapping relationship table according to the FEC configuration information; and receive the EFC of the media stream generated by the media sending terminal according to the FEC configuration information.
  • the conference server can send the received FEC stream to the corresponding media receiving terminal according to the first mapping relationship table; thereby avoiding the FEC encoding and decoding and the packet buffering, which consumes a large amount of resources of the conference server, and can reduce the resource consumption of the server. Thereby reducing the end-to-end transmission delay of the media stream.
  • the FEC configuration information further includes a redundancy level of each FEC stream supported by the media stream;
  • the processor 71 is further configured to acquire path state information of the media sending terminal to each media receiving terminal;
  • the processor 71 is further configured to generate, according to path state information of the media sending terminal to each media receiving terminal, and a redundancy level of each FEC stream supported by the media stream received by the first interface circuit 72. Defining the information of the FEC stream of the media stream and reconfiguring the first mapping relationship table, where the FEC stream profile configuration information includes: redundancy of the FEC stream corresponding to the media streams sent by the conference server to each media receiving terminal grade;
  • the second interface circuit 73 is further configured to send the FEC flow profile configuration information generated by the processor 71 and the first mapping relationship table reconfigured by the processor 71 of the conference server to the media sending terminal;
  • the first interface circuit 72 is further configured to receive a media stream sent by the media sending terminal and an FEC stream generated by the media sending terminal according to the FEC stream profile configuration information sent by the conference server.
  • the first interface circuit 72 is further configured to receive updated FEC flow profile configuration information sent by the media sending terminal and a first mapping relationship table updated by the media sending terminal, where The processor is further configured to adjust the FEC stream file stored by the conference server according to the FEC stream profile configuration information updated by the media sending terminal received by the first interface circuit 72 and the first mapping relationship table updated by the media sending terminal.
  • the first interface circuit 72 is further configured to receive a media stream sent by the media sending terminal and an FEC stream generated by the media sending terminal according to the FEC stream file configuration information updated by the media sending terminal.
  • the processor 71 is configured to obtain path state information of the media sending terminal to the conference server, and obtain path state information of each media receiving terminal to the conference server; The path state information of the sending terminal to the conference server and the path state information of each media receiving terminal to the conference server acquire path state information of the media sending terminal to each media receiving terminal.
  • path state information includes a packet loss rate
  • the processor 71 is specifically configured to:
  • the redundancy level range is redundancy of each FEC stream supported by the media stream An interval formed by a maximum redundancy and a minimum redundancy in the redundancy level, and one of the redundancy levels corresponds to a range of a packet loss rate range;
  • the first packet loss rate is within the current redundancy level range, determining whether the first packet loss rate causes the division of the redundancy level to be reduced, where the first packet loss rate belongs to the Determining the first redundancy level in the division of the redundancy level, and determining whether the first redundancy rate includes a packet loss rate corresponding to any current FEC stream and the first packet loss rate The packet loss rate causes the division of the redundancy level to be reduced;
  • the first packet loss rate causes the division of the redundancy level to be reduced, the first packet loss rate is re-matched with the redundancy level of all current FEC streams, and any redundancy is deleted. Degree level.
  • processor 71 is further configured to: if the first packet loss rate does not cause the division of the redundancy level to be reduced, determine whether the first packet loss rate is Causing the redundancy level to be re-divided; wherein when the first packet loss rate does not belong to any one of the redundancy level partitions, determining the first packet loss rate results in the Redundancy level re-division;
  • the division of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios.
  • processor 71 is further configured to:
  • the first packet loss rate is not in the current redundancy level range, determining, according to the redundancy level of each FEC stream supported by the media stream sent by the media sending terminal, whether to support adding a new FEC stream; If the redundancy level corresponding to the first packet loss rate is not included in the redundancy level of each FEC stream supported by the media stream, it is determined that adding a new FEC stream is not supported;
  • the allocation of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios
  • the FEC stream corresponding to the first packet loss rate is added, and the corresponding redundancy level is set.
  • processor 71 is further configured to: if it is supported to add a new FEC stream, determine whether the bandwidth of the media sending terminal supports adding a new FEC stream; wherein when the media is sent When the remaining bandwidth of the terminal is greater than the bandwidth required by the newly added FEC stream, it is determined to support adding a new FEC stream;
  • the division of the redundancy level corresponding to the FEC stream is adjusted according to the distribution of all packet loss ratios
  • the bandwidth of the media sending terminal supports adding a new FEC stream, increase the FEC stream corresponding to the first packet loss rate, and Set the corresponding redundancy level.
  • the conference server can also update the FEC stream profile configuration information and the first time according to the path state information of the media sending terminal to each media receiving terminal, the bandwidth of the media sending terminal, and the FEC configuration information of the media sending terminal.
  • the mapping relationship table improves the accuracy of the matching between the EFC stream and the media stream.
  • an embodiment of the present invention provides a media sending terminal, which is used to implement the foregoing media stream transmission method, including: a first interface circuit 81, a memory 82, and a bus 83; the first interface circuit 81, The memory 82 is connected through the bus 83 and completes communication with each other;
  • the memory 82 may be a storage device or a collective name of a plurality of storage elements, and is used to store executable program code or parameters, data, and the like required for the operation of the access network management device.
  • the memory 82 may include a random access memory (English name: Random-Access Memory, English abbreviation: RAM), and may also include non-volatile memory (English name: non-volatile memory, English abbreviation: NVRAM), such as disk storage, flash memory. (Flash) and so on.
  • the bus 83 can be an industry standard architecture (English name: Industry Standard Architecture, English abbreviation: ISA) bus, external device interconnection (English full name: Peripheral Component, English abbreviation: PCI) bus or extended industry standard architecture (English full name: Extended Industry Standard Architecture, English abbreviation: EISA) bus.
  • the bus 83 can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 8, but it does not mean that there is only one bus or one type of bus.
  • the first interface circuit 81 is configured to send the FEC configuration information to the conference server, where the FEC configuration information includes an identifier of the FEC stream supported by the media stream, so that the conference server generates a first mapping relationship table according to the FEC configuration information.
  • the first mapping relationship table includes a correspondence between an identifier of the FEC stream and an identifier of the media receiving terminal;
  • the first interface circuit 81 is further configured to send the media stream and the FEC stream generated according to the FEC configuration information to the conference server, so that the conference server sends the media stream to each media receiving terminal, And sending the FEC stream to the corresponding media receiving terminal according to the first mapping relationship table.
  • the media sending terminal provided by the embodiment of the present invention can send the FEC configuration information to the conference server, so that the conference server generates a first mapping relationship table according to the FEC configuration information; and the conference server receives the generated by the media sending terminal according to the FEC configuration information.
  • the conference server can send the received FEC stream to the corresponding media receiving terminal according to the first mapping relationship table; thereby avoiding FEC encoding and decoding and packet caching, which consumes a large amount of resources of the conference server, and can reduce the server.
  • the resource consumption thereby reducing the end-to-end transmission delay of the media stream.
  • the FEC configuration information further includes a redundancy level of each FEC stream supported by the media stream.
  • the media sending terminal further includes: The second interface circuit 84 and the processor 85; the processor 85 herein may be a processor or a collective name of a plurality of processing elements.
  • the processor may be a central processing unit CPU, or may be a specific integrated circuit ASIC, or may be configured to implement one embodiment of the present invention.
  • One or more integrated circuits such as: one or more microprocessors (English full name: digital singnal processor, English abbreviation: DSP), or one or more field programmable gate arrays (English full name: Field Programmable Gate Array, English abbreviation: FPGA).
  • the second interface circuit 84 is configured to receive the FEC flow profile configuration information sent by the conference server and the first mapping relationship table of the conference server reconfiguration, where the FEC flow profile configuration information includes: the conference server sends to each The redundancy level of the FEC stream corresponding to the media stream of the media receiving terminal;
  • the first interface circuit 81 is further configured to: when the processor 85 confirms that the FEC flow profile configuration information and the FEC flow configuration corresponding to the first mapping relationship table reconfigured by the conference server are supported, to the conference The server sends an FEC stream generated according to the FEC flow profile configuration information of the conference server.
  • processor 85 is further configured to: when confirming that the FEC stream configuration information and the FEC stream configuration corresponding to the first mapping relationship table of the conference server reconfiguration are not supported, Defining FEC flow profile configuration information and a first mapping relationship table of the conference server reconfiguration;
  • the first interface circuit 81 is further configured to send, to the conference server, an FEC stream generated according to FEC flow profile configuration information updated by the media sending terminal;
  • the first interface circuit 81 is further configured to send, to the FEC flow profile configuration information updated by the processor 85 of the media sending terminal, and the first mapping relationship table updated by the processor 85 of the media sending terminal to The conference server.
  • the media sending terminal can also update the FEC stream file configuration information and the first mapping relationship table in real time, thereby improving the matching accuracy of the EFC stream and the media stream.
  • a computer readable medium comprising computer readable instructions that, when executed, perform the operations of 101 to 115, S1 to S9 of the method in the above embodiments.
  • a computer program product including the computer readable medium described above.
  • the size of the sequence numbers of the above processes does not mean the order of execution, and the order of execution of each process should be determined by its function and internal logic, and should not be taken to the embodiments of the present invention.
  • the implementation process constitutes any limitation.
  • the disclosed systems, devices, and methods may be implemented in other manners.
  • the device embodiments described above are merely illustrative, for example, the division of the units, For the division of only one logical function, the actual implementation may have another division manner, for example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical, mechanical or otherwise.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product.
  • the technical solution of the present invention which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including
  • the instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read only memory (English abbreviation: ROM, English full name: Read-Only Memory), a random access memory (English abbreviation: RAM, English full name: Random Access Memory), magnetic A variety of media that can store program code, such as a disc or a disc.

Abstract

本发明的实施例提供一种媒体流传输方法、设备及系统,涉及通信领域,能够降低服务器的资源消耗,从而减小媒体流端到端的传输时延。包括:会议服务器接收媒体发送终端发送的FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;所述会议服务器根据所述FEC配置信息,生成第一映射关系表,第一映射关系表包含FEC流的标识与媒体接收终端的标识之间的对应关系;接收媒体发送终端发送的媒体流和媒体发送终端根据FEC配置信息生成的FEC流;将媒体流发送至各个媒体接收终端,并根据FEC流的标识与媒体接收终端的标识之间的对应关系将FEC流发送至媒体接收终端。本发明的实施例用于媒体流传输。

Description

一种媒体流传输方法、设备及系统
本申请要求于2015年9月15日提交中国专利局、申请号为201510587455.2、发明名称为“一种媒体流传输方法、设备及系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本发明的实施例涉及通信领域,尤其涉及一种媒体流传输方法、设备及系统。
背景技术
通常多方视频会议解决方案都是用集中的会议服务器转发来减少终端的带宽和CPU(英文全称:Central Processing Unit,中文全称:中央处理器)消耗。会议服务器接收来自于参与者的RTP(英文全称:Real-time Transport Protocol,中文全称:实时传输协议)媒体流,然后会议服务器通过混合转码等操作整合修改成合适的RTP流发送给其他的参与者,但是会议服务器的解码重编码通常会引入额外的时延。在多方视频会议中,媒体发送者通常通过多流转发同时向多个媒体接收者发送媒体资源,多流转发是指对于同一个媒体资源,媒体发送者同时发送多个不同编码版本的RTP媒体流,这些RTP媒体流在帧率、分辨率、编解码类型等方面存在差异,分别对应不同媒体接收者的能力要求。会议服务器只需要按照一定的策略选择RTP媒体流转发给其他的媒体接收者。
对于视频会议等多媒体应用,在丢包严重的恶劣网络环境下,对于大量的丢包数据进行重传会加剧网络的拥塞,因此现有技术中多采用向前纠错FEC(英文全称:ForwardErrorCorrection,中文:前向纠错)丢包处理方式,由于媒体接收者在接收到数据包的同时,能够重构丢失掉的数据包,不需要媒体发送者重传,因此是一种有效且实用的选择。
基于上述的技术,现有技术提供的媒体流传输方法具体流程如下:
步骤一:媒体发送者向会议服务器发送媒体流,并针对媒体发送者到会议服务器路径状态(比如丢包)生成对应的FEC流。
步骤二:会议服务器接收到媒体流和FEC流后,根据FEC流对媒体流丢失的包进行恢复。
步骤三:会议服务器将恢复后的媒体流转发给其他媒体接收者,并针对会议服务器到其他媒体接收者的路径状态生成对应的FEC流。
其他媒体接收者对应的FEC流是相互独立的,由于现有会议服务器需要对媒体流进行混 合编码或转码,所以会议服务器两端的FEC机制是完全独立解耦的:会议服务器根据媒体发送者发送的FEC流恢复媒体发送者到会议服务器路径上丢失的包,同时会议服务器在将媒体流发送给媒体接收者时会为每个媒体接收者生成独立的FEC流;即在多流转发场景下,会议服务器对媒体流仅作转发,而对于FEC还是采用上面的机制,由于FEC的编码解码和包缓存会消耗会议服务器大量资源,会议服务器每个媒体接收者生成独立的FEC流的过程会增加媒体流端到端的传输时延,影响会议服务器服务的用户数和最终的用户体验。
发明内容
本发明的实施例提供一种媒体流传输方法、设备及系统,能够降低服务器的资源消耗,从而减小媒体流端到端的传输时延。
第一方面,提供一种媒体流传输方法,包括:
会议服务器接收媒体发送终端发送的FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;
所述会议服务器根据所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识之间的对应关系;
接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述FEC配置信息生成的FEC流;
将所述媒体流发送至各个媒体接收终端,并根据所述FEC流的标识与媒体接收终端的标识之间的对应关系将所述FEC流发送至媒体接收终端。
结合第一方面,在第一种可能的实现方式中,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;
所述方法还包括:
所述会议服务器获取所述媒体发送终端到各个媒体接收终端的路径状态信息;
所述会议服务器根据所述媒体发送终端到各个媒体接收终端的路径状态信息、所述媒体流支持的各个FEC流的冗余度等级,生成所述媒体流的FEC流档次配置信息并重新配置所述第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流分别对应的FEC流的冗余度等级;
所述会议服务器将所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表发送至所述媒体发送终端;
接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述会议服务器发送的 FEC流档次配置信息生成的FEC流。
结合第一方面的第一种可能的实现方式,在第二种可能的实现方式中,所述会议服务器将所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表发送至所述媒体发送终端后,所述方法还包括:
接收所述媒体发送终端发送的更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表,并根据所述媒体发送终端更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表调整所述会议服务器存储的FEC流档次配置信息和第一映射关系表;
接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述媒体发送终端更新的FEC流档次配置信息生成的FEC流。
结合第一方面第一种可能的实现方式,在第三种可能的实现方式中,所述会议服务器获取所述媒体发送终端到各个媒体接收终端的路径状态信息,包括:
所述会议服务器获取媒体发送终端到所述会议服务器的路径状态信息;
所述会议服务器获取各个媒体接收终端到所述会议服务器的路径状态信息;
所述会议服务器根据所述媒体发送终端到所述会议服务器的路径状态信息、以及各个媒体接收终端到所述会议服务器的路径状态信息,获取所述媒体发送终端到各个媒体接收终端的路径状态信息。
结合第一方面第一种可能的实现方式,在第四种可能的实现方式中,所述路径状态信息包括丢包率;
所述会议服务器根据所述媒体发送终端到媒体接收终端的路径状态信息、所述媒体流支持的各个FEC流的冗余度等级,生成媒体流的FEC流档次配置信息,包括:
判断所述媒体发送终端到第一媒体接收终端的第一丢包率是否不在当前的冗余度等级范围内;其中,所述冗余度等级范围为所述媒体流支持的各个FEC流的冗余度等级中最大冗余度与最小冗余度构成的区间,一个所述冗余度等级对应一个丢包率范围的区间;
若所述第一丢包率在当前的冗余度等级范围内,则判断该第一丢包率是否导致所述冗余度等级的划分需要缩减,其中当所述第一丢包率属于所述冗余度等级的划分中的一个冗余度等级,并且任一冗余度等级不包含当前的任一FEC流对应的丢包率及所述第一丢包率时,确定所述第一丢包率导致所述冗余度等级的划分需要缩减;
若所述第一丢包率导致所述冗余度等级的划分需要缩减,则将所述第一丢包率与当前所有的FEC流的冗余度等级重新匹配,删除所述任一冗余度等级。
结合第一方面第四种可能的实现方式,在第五种可能的实现方式中,若所述第一丢包率 不导致所述冗余度等级的划分需要缩减,则判断所述第一丢包率是否导致所述冗余度等级重新划分;其中当所述第一丢包率不属于所述冗余度等级的划分中的任一冗余度等级时,确定所述第一丢包率导致所述冗余度等级重新划分;
若所述第一丢包率导致所述冗余度等级重新划分,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分。
结合第一方面第四种可能的实现方式,在第六种可能的实现方式中,
若所述第一丢包率不在当前的冗余度等级范围内,则根据所述媒体发送终端发送的媒体流支持的各个FEC流的冗余度等级判断是否支持增加新的FEC流;其中若所述媒体流支持的各个FEC流的冗余度等级中不包括所述第一丢包率对应的冗余度等级,则确定不支持增加新的FEC流;
若不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
若支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
结合第一方面第六种可能的实现方式,在第七种可能的实现方式中,所述方法还包括:若支持增加新的FEC流,则判断所述媒体发送终端的带宽是否支持增加新的FEC流;其中当所述媒体发送终端的剩余带宽大于所述新增的FEC流所需的带宽时,确定支持增加新的FEC流;
若所述媒体发送终端的带宽不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
若所述媒体发送终端的带宽支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
第二方面,提供一种媒体流传输方法,包括:
媒体发送终端向会议服务器发送FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;以便所述会议服务器根据所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识的对应关系;
向所述会议服务器发送所述媒体流和根据所述FEC配置信息生成的FEC流,以便所述会议服务器将所述媒体流发送至各个媒体接收终端,并根据所述第一映射关系表将所述FEC流发送至对应的媒体接收终端。
结合第二方面,在第一种可能的实现方式中,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;所述方法还包括:
接收所述会议服务器发送的FEC流档次配置信息和所述会议服务器重配置的第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流对应的FEC流的冗余度等级;
在确认支持所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表对应的FEC流配置时,向所述会议服务器发送根据所述会议服务器的FEC流档次配置信息生成的FEC流。
结合第二方面的第一种可能的实现方式,在第二种可能的实现方式中,所述媒体发送终端在确认不支持所述FEC流档次配置信息和所述会议服务器重配置的第一映射关系表对应的FEC流配置时,更新所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表;并向所述会议服务器发送根据媒体发送终端更新的FEC流档次配置信息生成的FEC流;
将所述媒体发送终端更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表发送至所述会议服务器。
第三方面,提供一种会议服务器,包括:
接收单元,用于接收媒体发送终端发送的FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;
处理单元,用于根据所述接收单元接收的所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识之间的对应关系;
所述接收单元,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述FEC配置信息生成的FEC流;
发送单元,用于将所述接收单元接收的媒体流发送至各个媒体接收终端,并根据所述FEC流的标识与媒体接收终端的标识之间的对应关系将所述接收单元接收的FEC流发送至媒体接收终端。
结合第三方面,在第一种可能的实现方式中,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;
所述会议服务器还包括:获取单元,用于获取所述媒体发送终端到各个媒体接收终端的路径状态信息;
所述处理单元,还用于根据所述获取单元获取的媒体发送终端到各个媒体接收终端的路径状态信息、所述接收单元接收的媒体流支持的各个FEC流的冗余度等级,生成所述媒体流的FEC流档次配置信息并重新配置所述第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流分别对应的FEC流的冗余度等级;
所述发送单元,还用于将所述处理单元生成的FEC流档次配置信息和所述会议服务器的处理单元重新配置的第一映射关系表发送至所述媒体发送终端;
所述接收单元,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述会议服务器发送的FEC流档次配置信息生成的FEC流。
结合第三方面的第一种可能的实现方式,在第二种可能的实现方式中,所述接收单元,还用于接收所述媒体发送终端发送的更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表,所述处理器还用于根据所述接收单元接收的所述媒体发送终端更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表调整所述会议服务器存储的FEC流档次配置信息和第一映射关系表;
所述接收单元,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述媒体发送终端更新的FEC流档次配置信息生成的FEC流。
结合第三方面第一种可能的实现方式,在第三种可能的实现方式中,所述获取单元,具体用于获取媒体发送终端到所述会议服务器的路径状态信息;获取各个媒体接收终端到所述会议服务器的路径状态信息;根据所述媒体发送终端到所述会议服务器的路径状态信息、以及各个媒体接收终端到所述会议服务器的路径状态信息,获取所述媒体发送终端到各个媒体接收终端的路径状态信息。
结合第三方面第一种可能的实现方式,在第四种可能的实现方式中,所述路径状态信息包括丢包率;
所述处理单元,具体用于:
判断所述媒体发送终端到第一媒体接收终端的第一丢包率是否不在当前的冗余度等级范围内;其中,所述冗余度等级范围为所述媒体流支持的各个FEC流的冗余度等级中最大冗余度与最小冗余度构成的区间,一个所述冗余度等级对应一个丢包率范围的区间;
若所述第一丢包率在当前的冗余度等级范围内,则判断该第一丢包率是否导致所述冗余度等级的划分需要缩减,其中当所述第一丢包率属于所述冗余度等级的划分中的一个冗余度等级,并且任一冗余度等级不包含当前的任一FEC流对应的丢包率及所述第一丢包率时,确定所述第一丢包率导致所述冗余度等级的划分需要缩减;
若所述第一丢包率导致所述冗余度等级的划分需要缩减,则将所述第一丢包率与当前所有的FEC流的冗余度等级重新匹配,删除所述任一冗余度等级。
结合第三方面第四种可能的实现方式,在第五种可能的实现方式中,所述处理单元,具体还用于:若所述第一丢包率不导致所述冗余度等级的划分需要缩减,则判断所述第一丢包率是否导致所述冗余度等级重新划分;其中当所述第一丢包率不属于所述冗余度等级的划分 中的任一冗余度等级时,确定所述第一丢包率导致所述冗余度等级重新划分;
若所述第一丢包率导致所述冗余度等级重新划分,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分。
结合第三方面第四种可能的实现方式,在第六种可能的实现方式中,所述处理单元,具体还用于:
若所述第一丢包率不在当前的冗余度等级范围内,则根据所述媒体发送终端发送的媒体流支持的各个FEC流的冗余度等级判断是否支持增加新的FEC流;其中若所述媒体流支持的各个FEC流的冗余度等级中不包括所述第一丢包率对应的冗余度等级,则确定不支持增加新的FEC流;
若不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
若支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
结合第一方面第六种可能的实现方式,在第七种可能的实现方式中,所述处理单元,具体还用于:若支持增加新的FEC流,则判断所述媒体发送终端的带宽是否支持增加新的FEC流;其中当所述媒体发送终端的剩余带宽大于所述新增的FEC流所需的带宽时,确定支持增加新的FEC流;
若所述媒体发送终端的带宽不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
若所述媒体发送终端的带宽支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
第四方面,提供一种媒体发送终端,包括:
发送单元,用于向会议服务器发送FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;以便所述会议服务器根据所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识的对应关系;
所述发送单元,还用于向所述会议服务器发送所述媒体流和根据所述FEC配置信息生成的FEC流,以便所述会议服务器将所述媒体流发送至各个媒体接收终端,并根据所述第一映射关系表将所述FEC流发送至对应的媒体接收终端。
结合第四方面,在第一种可能的实现方式中,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;所述媒体发送终端还包括:接收单元和处理单元;
接收单元,用于接收所述会议服务器发送的FEC流档次配置信息和所述会议服务器重配 置的第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流对应的FEC流的冗余度等级;
所述发送单元还用于在处理单元确认支持所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表对应的FEC流配置时,向所述会议服务器发送根据所述会议服务器的FEC流档次配置信息生成的FEC流。
结合第四方面的第一种可能的实现方式,在第二种可能的实现方式中,所述处理单元,还用于在确认不支持所述FEC流档次配置信息和所述会议服务器重配置的第一映射关系表对应的FEC流配置时,更新所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表;
所述发送单元还用于向所述会议服务器发送根据媒体发送终端更新的FEC流档次配置信息生成的FEC流;
所述发送单元,还用于将所述媒体发送终端的处理单元更新的FEC流档次配置信息和所述媒体发送终端的处理单元更新的第一映射关系表发送至所述会议服务器。
第五方面,提供一种会议服务器,包括:处理器、第一接口电路、第二接口电路、存储器和总线;所述处理器、第一接口电路、第二接口电路、存储器通过所述总线连接并完成相互间的通信;
第一接口电路,用于接收媒体发送终端发送的FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;
处理器,用于根据所述第一接口电路接收的所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识之间的对应关系;
所述第一接口电路,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述FEC配置信息生成的FEC流;
第二接口电路,用于将所述第一接口电路接收的媒体流发送至各个媒体接收终端,并根据所述FEC流的标识与媒体接收终端的标识之间的对应关系将所述接收单元接收的FEC流发送至媒体接收终端。
结合第五方面,在第一种可能的实现方式中,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;
所述处理器,还用于获取所述媒体发送终端到各个媒体接收终端的路径状态信息;
所述处理器,还用于根据所述媒体发送终端到各个媒体接收终端的路径状态信息、所述第一接口电路接收的媒体流支持的各个FEC流的冗余度等级,生成所述媒体流的FEC流档次 配置信息并重新配置所述第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流分别对应的FEC流的冗余度等级;
所述第二接口电路,还用于将所述处理器生成的FEC流档次配置信息和所述会议服务器的处理器重新配置的第一映射关系表发送至所述媒体发送终端;
所述第一接口电路,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述会议服务器发送的FEC流档次配置信息生成的FEC流。
结合第五方面的第一种可能的实现方式,在第二种可能的实现方式中,所述第一接口电路,还用于接收所述媒体发送终端发送的更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表,所述处理器还用于根据所述第一接口电路接收的所述媒体发送终端更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表调整所述会议服务器存储的FEC流档次配置信息和第一映射关系表;
所述第一接口电路,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述媒体发送终端更新的FEC流档次配置信息生成的FEC流。
结合第五方面第一种可能的实现方式,在第三种可能的实现方式中,所述处理器,具体用于获取媒体发送终端到所述会议服务器的路径状态信息;获取各个媒体接收终端到所述会议服务器的路径状态信息;根据所述媒体发送终端到所述会议服务器的路径状态信息、以及各个媒体接收终端到所述会议服务器的路径状态信息,获取所述媒体发送终端到各个媒体接收终端的路径状态信息。
结合第五方面第一种可能的实现方式,在第四种可能的实现方式中,所述路径状态信息包括丢包率;
所述处理器,具体用于:
判断所述媒体发送终端到第一媒体接收终端的第一丢包率是否不在当前的冗余度等级范围内;其中,所述冗余度等级范围为所述媒体流支持的各个FEC流的冗余度等级中最大冗余度与最小冗余度构成的区间,一个所述冗余度等级对应一个丢包率范围的区间;
若所述第一丢包率在当前的冗余度等级范围内,则判断该第一丢包率是否导致所述冗余度等级的划分需要缩减,其中当所述第一丢包率属于所述冗余度等级的划分中的一个冗余度等级,并且任一冗余度等级不包含当前的任一FEC流对应的丢包率及所述第一丢包率时,确定所述第一丢包率导致所述冗余度等级的划分需要缩减;
若所述第一丢包率导致所述冗余度等级的划分需要缩减,则将所述第一丢包率与当前所有的FEC流的冗余度等级重新匹配,删除所述任一冗余度等级。
结合第五方面第四种可能的实现方式,在第五种可能的实现方式中,所述处理器,具体 还用于:若所述第一丢包率不导致所述冗余度等级的划分需要缩减,则判断所述第一丢包率是否导致所述冗余度等级重新划分;其中当所述第一丢包率不属于所述冗余度等级的划分中的任一冗余度等级时,确定所述第一丢包率导致所述冗余度等级重新划分;
若所述第一丢包率导致所述冗余度等级重新划分,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分。
结合第五方面第四种可能的实现方式,在第六种可能的实现方式中,所述处理器,具体还用于:
若所述第一丢包率不在当前的冗余度等级范围内,则根据所述媒体发送终端发送的媒体流支持的各个FEC流的冗余度等级判断是否支持增加新的FEC流;其中若所述媒体流支持的各个FEC流的冗余度等级中不包括所述第一丢包率对应的冗余度等级,则确定不支持增加新的FEC流;
若不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
若支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
结合第一方面第六种可能的实现方式,在第七种可能的实现方式中,所述处理器,具体还用于:若支持增加新的FEC流,则判断所述媒体发送终端的带宽是否支持增加新的FEC流;其中当所述媒体发送终端的剩余带宽大于所述新增的FEC流所需的带宽时,确定支持增加新的FEC流;
若所述媒体发送终端的带宽不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
若所述媒体发送终端的带宽支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
第六方面,提供一种媒体发送终端,包括:第一接口电路、存储器和总线;所述第一接口电路、存储器通过所述总线连接并完成相互间的通信;
第一接口电路,用于向会议服务器发送FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;以便所述会议服务器根据所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识的对应关系;
所述第一接口电路,还用于向所述会议服务器发送所述媒体流和根据所述FEC配置信息生成的FEC流,以便所述会议服务器将所述媒体流发送至各个媒体接收终端,并根据所述第一映射关系表将所述FEC流发送至对应的媒体接收终端。
结合第六方面,在第一种可能的实现方式中,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;所述媒体发送终端还包括:与所述总线连接的第二接口电路和处理器;
第二接口电路,用于接收所述会议服务器发送的FEC流档次配置信息和所述会议服务器重配置的第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流对应的FEC流的冗余度等级;
所述第一接口电路,还用于在所述处理器确认支持所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表对应的FEC流配置时,向所述会议服务器发送根据所述会议服务器的FEC流档次配置信息生成的FEC流。
结合第六方面的第一种可能的实现方式,在第二种可能的实现方式中,所述处理器,还用于在确认不支持所述FEC流档次配置信息和所述会议服务器重配置的第一映射关系表对应的FEC流配置时,更新所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表;
所述第一接口电路还用于向所述会议服务器发送根据媒体发送终端更新的FEC流档次配置信息生成的FEC流;
所述第一接口电路还用于,还用于将所述媒体发送终端的处理器更新的FEC流档次配置信息和所述媒体发送终端的处理器更新的第一映射关系表发送至所述会议服务器。
第七方面,提供一种通信系统,包括:如上述第三方面或第三方面中任意一种可能的实现方式所述的会议服务器,及如上述第四方面或第四方面中任意一种可能的实现方式所述的媒体发送终端;
或者,
如上述第五方面或第五方面中任意一种可能的实现方式所述的会议服务器,及如上述第六方面或第六方面中任意一种可能的实现方式所述的媒体发送终端。
本发明的实施例提供的媒体流传输方法、设备及系统,媒体发送终端能够将FEC配置信息发送至会议服务器,以使得会议服务器根据FEC配置信息生成第一映射关系表;会议服务器在接收到由媒体发送终端根据FEC配置信息生成的媒体流的EFC流后,会议服务器能根据第一映射关系表将收到的FEC流发送至对应的媒体接收终端;从而避免了FEC的编码解码和包缓存会消耗会议服务器大量资源,能够降低服务器的资源消耗,从而减小媒体流端到端的传输时延。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1为本发明的实施例提供的一种通信系统的结构示意图;
图2为本发明的实施例提供的一种媒体流传输方法的流程示意图;
图3为本发明的实施例提供的媒体流的FEC流档次配置信息的生成过程示意图;
图4为本发明的实施例提供的一种会议服务器的结构示意图;
图5为本发明的另一实施例提供的一种会议服务器的结构示意图;
图6为本发明的实施例提供的一种媒体发送终端的结构示意图;
图7为本发明的又一实施例提供的一种会议服务器的结构示意图;
图8为本发明的另一实施例提供的一种媒体发送终端的结构示意图。
具体实施方式
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
应理解,本发明实施例的技术方案可以应用于各种通信系统,例如:全球移动通讯(英文全称:Global System of Mobile communication,英文简称:GSM)系统、码分多址(英文全称:Code Division Multiple Access,英文简称:CDMA)系统、宽带码分多址(英文全称:Wideband Code Division Multiple Access,英文简称:WCDMA)系统、通用分组无线业务(英文全称:General Packet Radio Service,GPRS)、长期演进(英文全称:Long Term Evolution,英文简称:LTE)系统、LTE频分双工(英文全称:Frequency Division Duplex,英文简称:FDD)系统、LTE时分双工(英文全称:Time Division Duplex,英文简称:TDD)、通用移动通信系统(英文全称:Universal Mobile Telecommunication System,英文简称:UMTS)或全球互联微波接入(英文全称:Worldwide Interoperability for Microwave Access,英文简称:WiMAX)通信系统等。
本发明的实施例提供的媒体发送/接收终端可以为是蜂窝电话、无绳电话、会话启动协议(英文全称:Session Initiation Protocol,英文缩写:SIP)电话、无线本地环路(英文 全称:Wireless Local Loop,英文缩写:WLL)站、个人数字处理(英文全称:Personal Digital Assistant,英文缩写:PDA)、具有无线通信功能的手持设备、车载设备、可穿戴设备、计算设备或连接到无线调制解调器的用户设备(英文全称:User Equipment,英文缩写:UE)。本发明的实施例提供的会议服务器可以为通过有线或无线方式与各个终端连接的服务器,本发明实施例中并不限定。
参照图1所示,本发明的实施例提供的通信系统包括会议服务器Server、以及至少两个终端(D1、D2、D3、……Dn),其中,该至少两个终端中包括一个媒体接收终端D1及至少一个媒体接收终端(D2、D3、……Dn),其中媒体接收终端通过会议服务器向至少一个媒体接收终端分发媒体流。
本发明的实施例提供一种媒体流传输方法,应用与上述的通信系统,参照图2所示,包括如下步骤:
101、会议服务器接收媒体发送终端发送的FEC配置信息。
具体的步骤101中媒体发送终端可以通过与一个SDP(英文全称:Session Description Protocol,中文:会话描述协议)会话协商过程实现,具体的媒体发送终端可以在SDP offer(SDP请求)中携带FEC配置信息;会议服务器在收到SDP offer后,向媒体发送终端反馈SDP Answer(SDP响应)作为应答信息。其中,FEC配置信息包含媒体流支持的FEC流的标识,其中FEC流的标识可以为PT(英文全称:Payload types,中文全称:载荷类型)值,其中媒体流可以对应多个FEC流,媒体流与FEC流的对应关系,可以通过媒体流的标识(如媒体流的PT值)与FEC流的标识(FEC流的PT值)进行关联。
102、会议服务器根据FEC配置信息,生成第一映射关系表。
该第一映射关系表包含FEC流的标识与媒体接收终端的标识之间的对应关系;其中媒体接收终端的标识可以为其ID(identity,身份标识)针对初始状态,由于在初始状态会议服务器并不能获取媒体发送终端到各个媒体接收终端的路径状态,因此会议服务器只能向各个媒体接收终端转发媒体发送终端随机生成的FEC流,此时媒体发送终端可以只向会议服务器提供媒体流的一个FEC流的标识,当然这并不是对本发明的一种限制,媒体发送终端也可以向会议服务器发送媒体流所支持的多个FEC流的标识,示例性的针对PT值为97的媒体流可以生成如下第一映射关系表(表1):
表1:
  FEC流的PT值 媒体接收终端的ID
1 109 D1
2 109 D2
3 109 D3
其中,表1中媒体发送终端针对PT值为97的媒体流仅提供PT值为109的FEC流,并且PT值为109的FEC流同时对应ID为D1、D2和D3的三个媒体接收终端。
103、媒体发送终端根据FEC配置信息生成FEC流。
其中步骤101中媒体发送终端若只向会议服务器提供媒体流的一个FEC流的标识,即针对所有媒体接收终端均采用同一个FEC流,如表1的映射关系,媒体发送终端针对媒体流只生成一条FEC流。同时,媒体发送终端将媒体流和对应的FEC流发送至会议服务器。
104、会议服务器将媒体流发送至媒体接收终端,并根据步骤102中生成的第一映射关系表中FEC流的标识与媒体接收终端的标识之间的对应关系将步骤103中生成的FEC流发送至各个媒体接收终端。
具体的,步骤104中会议服务器可以参照表1中各个媒体接收终端的ID将PT值为109的FEC流分别发送至各个媒体接收终端,当然以上方案中由于初始状态中媒体发送终端随机生成FEC流,这并不能反映媒体发送终端与各个媒体接收终端路径的实际状态,因此优选方案是针对媒体流仅生成一个FEC流,避免发送终端针对媒体流生成两个以上的FEC流对资源的浪费,当然本申请并不限定初始状态媒体发送终端只向会议服务器提供媒体流的一个FEC流。当需要生成两个以上的FEC流时,媒体发送终端可以向会议服务器提供媒体流的两个以上的FEC流的标识,如下表2提供另一种示例性的第一映射关系表:
表2:
  FEC流的PT值 媒体接收终端的ID
1 109 D1
2 109 D2
3 110 D3
其中,表2中媒体发送终端针对PT值为97的媒体流提供PT值为109和110的两个FEC流,并且PT值为109的FEC流同时对应ID为D1、D2的两个媒体接收终端,PT值为110的FEC流对应ID为D3的媒体接收终端。上述步骤101-104由于会议服务器可以直接按照第一映射关系表转发媒体发送终端提供的对应各个媒体接收终端的FEC流,避免了FEC的编码解码和包缓存会消耗会议服务器大量资源,能够降低服务器的资源消耗,从而减小媒体流端到端的传输时延。
进一步的,FEC配置信息还包括媒体流支持的各个FEC流的冗余度等级。其中FEC配置信息还可以包括媒体流支持的最大FEC流数目,以及支持的FEC算法。
具体的,可以通过在步骤101中SDP会话协商过程中定义一个新的媒体属性行来携带上述FEC配置信息,格式如下:
a=FEC_capability:num=×;
red_level_info=L1/L2/L3;
algorithm=A1/A2/A3;
FEC_capability表示FEC容量,通过num为FEC流数目赋值;red_level_info表示支持的冗余度等级信息,支持的冗余度等级可以有多个值,如:L1、L2、L3;algorithm表示支持的FEC算法类型,可以包含多个值,如A1、A2、A3。该属性行的用法包括以下两种:
第一:上述参数可以用于所有媒体流对应的m行,只填写num和algorithm参数,表示针对该m行对应的所有媒体流支持的总的最大FEC流数目和支持的FEC算法类型;
第二:上述参数也可以用于m行下的某一条媒体流,紧随在该媒体流对应的a行之后,填写num和red_level_info参数,表示针对该条媒体流能够同时生成的FEC流的最大数目,以及分别对应的冗余度等级。
FEC流对应的rtpmap属性行需要在编码参数中增加设置的冗余度信息,具体定义为red=冗余度。其中,rtpmap属性行的结构如下:
a=rtpmap:<负载类型><编码名>/<时钟速率>[/<编码参数>]
其中,在步骤101-104中在初始的SDP offer中针对媒体流只生成一条FEC流,并通过media_group属性行完成媒体流和FEC流的关联。
下面提供一个SDP offer实例(仅包含部分相关行):
Figure PCTCN2016098585-appb-000001
其中:o行具体形式为:o=<username><session id><version><network type><address type><address>,表示会话的发起者信息(用户名、主机地址),以及会话标识和会话版本号。描述为:本会话由alice发起,会话标识为2362969037,版本号为2362969040,网络为initernet,地址类型为IPv4,具体地址为192.0.2.156;s行表示会话名称,其中每个会话描述中必须有 且仅有一个会话名;m行为对媒体流的描述。其形式为:m=<media><port><transport><fmt list>。当前描述为:该媒体流类型为视频,接收媒体的端口为49300,传输协议类型为RTP,使用两种媒体格式为97和110;a行的描述为媒体发送终端针对PT值为97媒体流的FEC能力信息是:最大支持生成2个FEC流,冗余度包括10%/20%/30%,支持的FEC算法包括1d-interleaved-parityfec和RS;PT值为97的媒体流视频载荷格式为H.264/90000;PT值为110的FEC流使用的1d-interleaved-parityfec算法,冗余度为10%;PT值为97的媒体流有一个对应的PT值为110的FEC流,是通过media_group属性行完成媒体流和FEC流的关联。
会议服务器在完成和媒体发送终端的SDP协商后,保存媒体发送终端发送的FEC配置信息。
105、会议服务器获取媒体发送终端到会议服务器的路径状态信息。
其中,路径状态信息包括丢包率、时延。由于在上述过程中媒体发送终端与会议服务器之间已经进行了SDP会话协商的数据包传输过程,并且媒体发送终端已经开始以数据包的形式向会议服务器发送媒体流和FEC流,因此具体的步骤105中会议服务器可以根据接收到的媒体发送终端发送的数据包统计媒体发送终端到会议服务器的路径状态信息。其中步骤105可以与上述步骤101中SDP会话协商过程同时开始。
106、会议服务器获取各个媒体接收终端到会议服务器的路径状态信息。
具体的步骤106中,媒体接收终端具体通过RTCP(英文全称:Real-Time Transport Control Protocol,中文全称:实时传输控制协议)RR(英文全称:ReceiverReport,中文:接收者报告)消息定期向会议服务器上报会议服务器到媒体接收终端路径的状态信息,包括丢包率,时延等。
107、会议服务器根据媒体发送终端到会议服务器的路径状态信息、以及各个媒体接收终端到会议服务器的路径状态信息,分别获取媒体发送终端到各个媒体接收终端的路径状态信息。
具体的,由于在步骤105中获取了媒体发送终端到会议服务器的路径状态信息,在步骤106中获取了各个媒体接收终端到会议服务器的路径状态信息,因此步骤107具体为将媒体发送终端到会议服务器的路径状态信息分别与各个媒体接收终端到会议服务器的路径状态信息进行整合,以获取媒体发送终端到各个媒体接收终端的路径状态信息。
108、会议服务器根据媒体发送终端到各个媒体接收终端的路径状态信息、媒体流支持的各个FEC流的冗余度等级,生成媒体流的FEC流档次配置信息并重新配置第一映射关系表。
其中,FEC流档次配置信息包括会议服务器发送至各个媒体接收终端的媒体流分别对应的FEC流的冗余度等级。示例性的提供下表3,
表3:
  FEC流的PT值 冗余度等级
1 109 L1
2 110 L2
可选的,步骤108中还可同时考虑媒体发送终端的宽带能力,这种情况下步骤108具体为会议服务器根据媒体发送终端到媒体接收终端的路径状态信息、媒体流支持的各个FEC流的冗余度等级以及媒体发送终端的宽带能力,生成媒体流的FEC流档次配置信息并重新配置第一映射关系表。
具体的,会议服务器根据媒体发送终端到多个媒体接收终端的路径状态信息将各媒体接收终端划分成几个档次。此外,会议服务器根据媒体发送终端的FEC配置信息(当前已有FEC流个数,即步骤101至104初始化过程中媒体发送终端生成的EFC流的个数;以及支持的最大FEC流个数)和媒体发送终端的带宽情况(在可获得该信息的情况下考虑)判断是否能够为上面不同档次的媒体接收终端提供不同的FEC流,如果能够支持则更新该媒体流的FEC流对应的媒体接收终端对应的档次配置信息,如果不能完全支持,则考虑合并部分媒体接收终端档次,缩减FEC流个数以使得部分媒体接收终端共用同一个FEC流,由于共用同一个FEC流的媒体接收终端与媒体发送终端之间的路径状态并不完全相同,因此可以权衡所有共用同一个FEC流的媒体接收终端与媒体发送终端之间的路径状态调整该共用的FEC流的冗余度,参照上述的表2和表3,其中D2对应的PT值为109的FEC流,D3对应PT值为110的FEC流,如需要将D2和D3划为同一个档次以缩减FEC流时,由于PT值为109的FEC流对应的冗余度为L1,PT值为110的FEC流对应的冗余度为L2,因此若将PT值为110的FEC流取消,将D2和D3共用PT值为109的FEC流则需要将PT值为109的FEC流对应的冗余度L1进行调整。
此外,若当前场景下,初始状态只包含一个FEC流,会议服务器分析发现媒体发送终端到媒体接收终端2路径的丢包率太大,使用现有FEC流无法对抗,需要将媒体接收终端划分成2类。媒体发送终端针对该媒体流的FEC能力信息支持2条FEC流,则会议服务器更新该媒体流的FEC流数目为2,对于新的FEC流设置新的冗余参数(该参数是从媒体发送终端之前的能力信息集中选择),生成媒体流的FEC流档次配置信息并重新配置第一映射关系表。
具体的参照图3所示,步骤108中生成媒体流的FEC流档次配置信息通过如下流程实现:
S1:判断媒体发送终端到第一媒体接收终端的第一丢包率是否不在当前的冗余度等级范围内。
其中,冗余度等级范围为媒体流支持的各个FEC流的冗余度等级中最大冗余度与最小冗余度构成的区间,一个冗余度等级对应一个丢包率范围的区间。
若所述第一丢包率在当前的冗余度等级范围内,则执行以下步骤:
S2:判断该第一丢包率是否导致所述冗余度等级的划分需要缩减。
其中当第一丢包率属于冗余度等级的划分中的一个冗余度等级,并且任一冗余度等级不包含当前的任一FEC流对应的丢包率及第一丢包率时,确定第一丢包率导致冗余度等级的划分需要缩减。
若第一丢包率导致冗余度等级的划分需要缩减,则执行以下步骤:
S3:将第一丢包率与当前所有的FEC流的冗余度等级重新匹配,删除上述任一冗余度等级。
若第一丢包率不导致所述冗余度等级的划分需要缩减,则执行以下步骤:
S4:判断所述第一丢包率是否导致冗余度等级重新划分。
其中当第一丢包率不属于冗余度等级的划分中的任一冗余度等级时,确定第一丢包率导致冗余度等级重新划分。
若第一丢包率导致冗余度等级重新划分,则执行以下步骤:
S5:按照所有丢包率的分布调整FEC流对应的冗余度等级的划分。
若第一丢包率不导致冗余度等级重新划分,则执行以下步骤:
S6:保持现有冗余度等级的划分。
根据步骤S1的判断结果,若第一丢包率不在当前的冗余度等级范围内,则执行以下步骤:
S7:根据媒体发送终端发送的媒体流支持的各个FEC流的冗余度等级判断是否支持增加新的FEC流。
其中,若媒体流支持的各个FEC流的冗余度等级中不包括第一丢包率对应的冗余度等级,则确定不支持增加新的FEC流。
若媒体流支持的各个FEC流的冗余度等级不支持增加新的FEC流,则执行步骤S5。
若媒体流支持的各个FEC流的冗余度等级支持增加新的FEC流,则执行以下步骤:
S8:增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
在考虑发送媒体发送终端支持的带宽时,具体还包括:
若媒体流支持的各个FEC流的冗余度等级支持增加新的FEC流,则执行如下步骤:
S9:判断媒体发送终端的带宽是否支持增加新的FEC流。
其中当媒体发送终端的剩余带宽大于新增的FEC流所需的带宽时,确定支持增加新的FEC 流。
若媒体发送终端的带宽不支持增加新的FEC流,则执行步骤S5。
若媒体发送终端的带宽支持增加新的FEC流,则执行步骤S8。
针对上述步骤S1-S9提供的方法,(假设初始状态,由第一映射关系表和FEC流档次配置信息确定的媒体接收终端和冗余度的映射情况如下表4所示),通过以下四种示例进行说明:
表4:
冗余度等级 媒体接收终端
0~10% D1
20~30% D2,D3
示例一:
如果当前的第一丢包率为3%,对应媒体发送终端到第一媒体接收终端D1的路径状态,则可以判断该第一丢包率在当前的冗余度等级0~10%范围内,因此对当前冗余度等级范围无需做调整,按照现有配置运作增加第一丢包率对应的FEC流,即上述步骤S6。
示例二:
如果当前的第一丢包率为23%,对应媒体发送终端到第一媒体接收终端D1的路径状态,可以判断第一丢包率在当前的冗余度等级20~30%范围内,但是D1原来对应的冗余度等级0-10%不能满足要求,需要将D1调整到冗余度等级20~30%的档次,而原来冗余度等级0~10%没有对应媒体接收终端了,可将其删除掉,即上述步骤S3。此时媒体接收终端和冗余度的映射情况调整为如下表5:
表5:
冗余度等级 接收者
20~30% D1,D2,D3
示例三:
如果当前的第一丢包率为13%,对应媒体发送终端到第一媒体接收终端D1的路径状态,可以判断该第一丢包率在当前的冗余度等级范围内,但是D1原来对应的冗余度等级0-10%不能满足要求,20~30%的档次又太高,所以这里需要对当前的冗余度等级信息进行调整,将原来冗余度等级0-10%调整为20~30%,即上述步骤S5。此时媒体接收终端和冗余度的映射情况调整为如下表6:
表6:
FEC冗余度等级 接收者
10~20% D1
20~30% D2,D3
示例四:
如果当前的第一丢包率为35%,对应媒体发送终端到第一媒体接收终端D2的路径状态,可以判断该第一丢包率不在当前的冗余度等级范围内,需要增加新的FEC流,并对应增加冗余等级为30~40%,对应S8,媒体接收终端和冗余度的映射情况调整如下表7:
表7:
FEC冗余度等级 接收者
0~10% D1
20~30% D3
30~40% D2
109、会议服务器将FEC流档次配置信息和会议服务器重新配置的第一映射关系表发送至媒体发送终端。
其中步骤109中,会议服务器可以通过向媒体发送终端发起新的O/A(请求应答)协商,向媒体发送终端发送SDP offer。该O/A用于向媒体发送终端通知,针对媒体流生成两个FEC流,其中每个FEC流对应一个PT值,该SDP offer实例如下(仅包含部分相关行):
o=as 2362969037 2362969040IN IP4 192.0.2.200
s=Simulcast Enabled Unified Plan Client
m=video 49300RTP/AVP 97 110 111
a=rtpmap:97H264/90000
a=rtpmap:110 1d-interleaved-parityfec/90000/red=0.1
a=rtpmap:111 1d-interleaved-parityfec/90000/red=0.2
a=media_group:FEC-FR 97 110
a=media_group:FEC-FR 97 111
具体描述:o行描述为:本会话由alice发起,会话标识为2362969037,版本号为2362969040,网络为initernet,地址类型为IPv4,具体地址为192.0.2.200;s行表示会话名称,其中每个会话描述中必须有且仅有一个会话名;m行描述为:该媒体流类型为视频,接收媒体的端口为49300,传输协议类型为RTP,使用两种媒体格式为97、110和111;a行的描述为针对PT值为97的媒体流,生成两个FEC流,其中一个FEC流的PT值为110,另一个FEC流的111,PT值为110的FEC流使用的1d-interleaved-parityfec算法对应的冗余度为10%,PT值为111的FEC流使用的1d-interleaved-parityfec算法对应的冗余度为20%。PT值为97的媒体流与PT值为110的FEC流是通过media_group属性行完成关联,PT值为97的媒体流与PT值为111的FEC流也是通过media_group属性行完成关联。
110、若媒体发送终端确认支持FEC流档次配置信息和会议服务器重新配置的第一映射关 系表对应的FEC流配置,则根据会议服务器发送的FEC流档次配置信息生成FEC流。
具体对于上述步骤109中SDP offer的答复实例如下(仅包含部分相关行):
o=alice 2362969037 2362969040IN IP4 192.0.2.156
s=Simulcast Enabled Unified PlaClient
m=video 49300RTP/AVP 97 110 111
a=rtpmap:97H264/90000
a=rtpmap:110 1d-interleaved-parityfec/90000/red=0.1
a=rtpmap:111 1d-interleaved-parityfec/90000/red=0.2
a=media_group:FEC-FR 97 110
a=media_group:FEC-FR 97 111
具体描述:针对o、s、m行的描述参考上述的示例,这里不再赘述;针对a行的描述为:支持针对PT值为97的媒体流,生成两个FEC流,其中一个FEC流的PT值为110,另一个FEC流的111,PT值为110的FEC流使用的1d-interleaved-parityfec算法对应的冗余度为10%;PT值为111的FEC流使用的1d-interleaved-parityfec算法对应的冗余度为20%。PT值为97的媒体流与PT值为110的FEC流是通过media_group属性行完成关联,PT值为97的媒体流与PT值为111的FEC流也是通过media_group属性行完成关联。
具体的在步骤110之后,由于媒体发送终端确认支持步骤108中会议服务器生成的媒体流的FEC流档次配置信息和重新配置的第一映射关系表,因此媒体发送终端向会议服务器发送媒体流和步骤110生成的FEC流,并且会议服务器接收媒体发送终端发送的媒体流和步骤110生成的FEC流后,将媒体流发送至各个媒体接收终端,并根据步骤108中会议服务器重新配置的第一映射关系表将接收到的各个FEC流发送至对应的媒体接收终端,具体针对每一个FEC流的发送参照步骤104这里不再赘述。
111、若媒体发送终端确认不支持FEC流档次配置信息和会议服务器重新配置的第一映射关系表对应的FEC流配置,则更新FEC流档次配置信息和会议服务器重新配置的第一映射关系表。
这里针对步骤111需要说明的是,由于媒体发送终端的网络状态和资源配置情况可能发生变化,因此媒体发送终端的EFC配置信息可能发生变化,在EFC配置信息发生变化时,一种方案是:可以通过上述步骤101中的SDP协商过程将发生变化后的EFC配置信息重新发送至会议服务器。另一种方案是:媒体发送终端直接根据变化后的EFC配置信息更新FEC流档次配置信息和会议服务器重新配置的第一映射关系表,具体的根据上述过程中EFC配置信息 的内容,可知EFC配置信息的变化主要会引起媒体流支持的各个FEC流的冗余度等级、以及支持的最大FEC流数目发生变化;因此更新FEC流档次配置信息主要为更新各个FEC流的冗余度等级,更新会议服务器重新配置的第一映射关系表主要为调整FEC流的标识与媒体接收终端的标识之间的对应关系,例如:媒体流支持的最大FEC流数目减少时需要取消第一映射关系表中的若干条FEC流的标识与媒体接收终端的标识,其中取消的原则可以依EFC配置信息发生变化后媒体流所支持的各个FEC流的冗余度等级,示例性的,在会议服务器重配置的第一映射关系表中存在PT值为112的FEC流,其对应的媒体接收终端为D4;若PT值为112的FEC流的冗余度为43%,对应的冗余度等级为40-50%;而在EFC配置信息发生变化时,媒体发送终端支持的最大的冗余度等级为30-40%;则需要取消第一映射关系表中存在PT值为112的FEC流与媒体接收终端为D4的对应关系,或者为D4配置较低的冗余度等级。
112、媒体发送终端将更新的FEC流档次配置信息和媒体发送终端更新的第一映射关系表发送至会议服务器。
具体对于上述步骤110中SDP offer的答复answer实例如下(仅包含部分相关行):
o=alice 2362969037 2362969040IN IP4 192.0.2.156
s=Simulcast Enabled Unified Plan Client
m=video 49300RTP/AVP 97 110
a=rtpmap:97H264/90000
a=rtpmap:110 1d-interleaved-parityfec/90000/red=0.2
a=media_group:FEC-FR 97 110
具体描述:针对o、s、m行的描述参考上述的示例,这里不再赘述;针对a行的描述为:支持针对PT值为97的媒体流,生成一个FEC流,对应PT值为110,使用的1d-interleaved-parityfec算法,对应的冗余度为20%。并且PT值为97的媒体流有一个对应的PT值为110的FEC流,是通过media_group属性行完成媒体流和FEC流的关联。
113、会议服务器接收媒体发送终端发送的更新的FEC流档次配置信息和媒体发送终端更新的第一映射关系表,并根据媒体发送终端更新的FEC流档次配置信息和媒体发送终端更新的第一映射关系表调整会议服务器存储的FEC流档次配置信息和第一映射关系表。
114、媒体发送终端根据媒体发送终端更新的FEC流档次配置信息生成媒体流对应的FEC流,并连同媒体流发送至会议服务器。
步骤113中通过定义一个新的媒体属性media_group完成FEC流和媒体流之间的关联,便于会议服务器进行转发。
115、会议服务器将媒体流发送至各个媒体接收终端,并根据调整的第一映射关系表中FEC流的标识与媒体接收终端的标识之间的对应关系将各个FEC流发送至对应的媒体接收终端。
需要说明的是,如果某个媒体接收终端的FEC流是发生变化的,为了避免会议服务器和媒体接收终端之间发起重新的O/A协商来修改FEC流对应的PT,会议服务器需要完成FEC包的PT值修改,具体为会议服务器将RTP包头中PT字段的值修改为新的PT值。上述过程中,媒体发送终端向会议服务器发送媒体流的过程可以采用重传技术或FEC技术等现有技术本申请并不做具体限定。
本发明的实施例提供的媒体流传输方法,媒体发送终端能够将FEC配置信息发送至会议服务器,以使得会议服务器根据FEC配置信息生成第一映射关系表;会议服务器在接收到由媒体发送终端根据FEC配置信息生成的媒体流的EFC流后,会议服务器能根据第一映射关系表将收到的FEC流发送至对应的媒体接收终端;从而避免了FEC的编码解码和包缓存会消耗会议服务器大量资源,能够降低服务器的资源消耗,从而减小媒体流端到端的传输时延;同时能够根据媒体发送终端到各个媒体接收终端的路径状态信息、媒体发送终端的带宽以及媒体发送终端的FEC配置信息的变化实时更新FEC流档次配置信息和第一映射关系表,提高了EFC流与媒体流的匹配度精度。
本发明的实施例提供一种会议服务器,用于实施上述的媒体流传输方法,参照图4所示,包括:
接收单元41,用于接收媒体发送终端发送的FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;
处理单元42,用于根据所述接收单元41接收的所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识之间的对应关系;
所述接收单元41,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述FEC配置信息生成的FEC流;
发送单元43,用于将所述接收单元41接收的媒体流发送至各个媒体接收终端,并根据所述FEC流的标识与媒体接收终端的标识之间的对应关系将所述接收单元41接收的FEC流发送至媒体接收终端。
本发明的实施例提供的会议服务器,能够接受媒体发送终端发送的FEC配置信息,并根据FEC配置信息生成第一映射关系表;在接收到由媒体发送终端根据FEC配置信息生成的媒体流的EFC流后,会议服务器能根据第一映射关系表将收到的FEC流发送至对应的媒体接收终端;从而避免了FEC的编码解码和包缓存会消耗会议服务器大量资源,能够降低服务器的资源消耗,从而减小媒体流端到端的传输时延。
一种可选的方案为,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;参照图5所示,所述会议服务器还包括:获取单元44,用于获取所述媒体发送终端到各个媒体接收终端的路径状态信息;
所述处理单元42,还用于根据所述获取单元44获取的媒体发送终端到各个媒体接收终端的路径状态信息、所述接收单元41接收的媒体流支持的各个FEC流的冗余度等级,生成所述媒体流的FEC流档次配置信息并重新配置所述第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流分别对应的FEC流的冗余度等级;
所述发送单元43,还用于将所述处理单元42生成的FEC流档次配置信息和所述会议服务器的处理单元42重新配置的第一映射关系表发送至所述媒体发送终端;
所述接收单元41,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述会议服务器发送的FEC流档次配置信息生成的FEC流。
一种可选的方案为,所述接收单元41,还用于接收所述媒体发送终端发送的更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表,所述处理单元42还用于根据所述接收单元41接收的所述媒体发送终端更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表调整所述会议服务器存储的FEC流档次配置信息和第一映射关系表;
所述接收单元41,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述媒体发送终端更新的FEC流档次配置信息生成的FEC流。
一种可选的方案为,所述获取单元44,具体用于获取媒体发送终端到所述会议服务器的路径状态信息;获取各个媒体接收终端到所述会议服务器的路径状态信息;根据所述媒体发送终端到所述会议服务器的路径状态信息、以及各个媒体接收终端到所述会议服务器的路径状态信息,获取所述媒体发送终端到各个媒体接收终端的路径状态信息。
一种可选的方案为,所述路径状态信息包括丢包率;
所述处理单元42,具体用于:
判断所述媒体发送终端到第一媒体接收终端的第一丢包率是否不在当前的冗余度等级范围内;其中,所述冗余度等级范围为所述媒体流支持的各个FEC流的冗余度等级中最大冗余度与最小冗余度构成的区间,一个所述冗余度等级对应一个丢包率范围的区间;
若所述第一丢包率在当前的冗余度等级范围内,则判断该第一丢包率是否导致所述冗余度等级的划分需要缩减,其中当所述第一丢包率属于所述冗余度等级的划分中的一个冗余度等级,并且任一冗余度等级不包含当前的任一FEC流对应的丢包率及所述第一丢包率时,确定所述第一丢包率导致所述冗余度等级的划分需要缩减;
若所述第一丢包率导致所述冗余度等级的划分需要缩减,则将所述第一丢包率与当前所 有的FEC流的冗余度等级重新匹配,删除所述任一冗余度等级。
一种可选的方案为,所述处理单元42,具体还用于:若所述第一丢包率不导致所述冗余度等级的划分需要缩减,则判断所述第一丢包率是否导致所述冗余度等级重新划分;其中当所述第一丢包率不属于所述冗余度等级的划分中的任一冗余度等级时,确定所述第一丢包率导致所述冗余度等级重新划分;
若所述第一丢包率导致所述冗余度等级重新划分,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分。
一种可选的方案为,所述处理单元42,具体还用于:
若所述第一丢包率不在当前的冗余度等级范围内,则根据所述媒体发送终端发送的媒体流支持的各个FEC流的冗余度等级判断是否支持增加新的FEC流;其中若所述媒体流支持的各个FEC流的冗余度等级中不包括所述第一丢包率对应的冗余度等级,则确定不支持增加新的FEC流;
若不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
若支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
一种可选的方案为,所述处理单元42,具体还用于:若支持增加新的FEC流,则判断所述媒体发送终端的带宽是否支持增加新的FEC流;其中当所述媒体发送终端的剩余带宽大于所述新增的FEC流所需的带宽时,确定支持增加新的FEC流;
若所述媒体发送终端的带宽不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
若所述媒体发送终端的带宽支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
其中,由于上述方案中会议服务器同时还能够根据媒体发送终端到各个媒体接收终端的路径状态信息、媒体发送终端的带宽以及媒体发送终端的FEC配置信息的变化实时更新FEC流档次配置信息和第一映射关系表,提高了EFC流与媒体流的匹配度精度。
需要说明的是,本实施例中的接收单元41可以为会议服务器上具备接收功能的接口电路,如接收机或信息接收接口;发送单元43可以为会议服务器上具备发射功能的接口电路,如发射机或信息发送接口。处理单元42、获取单元44可以为单独设立的处理器,也可以集成在会议服务器的某一个处理器中实现,此外,也可以以程序代码的形式存储于会议服务器的存储器中,由会议服务器的某一个处理器调用并执行以上处理单元42、获取单元44的功能。这里所述的处理器可以是一个中央处理器(英文全称:Central Processing Unit,英文简称: CPU),或者是特定集成电路(英文全称:Application Specific Integrated Circuit,英文简称:ASIC),或者是被配置成实施本发明实施例的一个或多个集成电路。
参照图6所示,本发明的实施例提供一种媒体发送终端,用于实施上述的媒体流传输方法,包括:
发送单元61,用于向会议服务器发送FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;以便所述会议服务器根据所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识的对应关系;
所述发送单元61,还用于向所述会议服务器发送所述媒体流和根据所述FEC配置信息生成的FEC流,以便所述会议服务器将所述媒体流发送至各个媒体接收终端,并根据所述第一映射关系表将所述FEC流发送至对应的媒体接收终端。
本发明的实施例提供的媒体发送终端能够将FEC配置信息发送至会议服务器,以使得会议服务器根据FEC配置信息生成第一映射关系表;会议服务器在接收到由媒体发送终端根据FEC配置信息生成的媒体流的EFC流后,会议服务器能根据第一映射关系表将收到的FEC流发送至对应的媒体接收终端;从而避免了FEC的编码解码和包缓存会消耗会议服务器大量资源,能够降低服务器的资源消耗,从而减小媒体流端到端的传输时延。
一种可选的方案为,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;参照图6所示,所述媒体发送终端还包括:接收单元62和处理单元63;
接收单元62,用于接收所述会议服务器发送的FEC流档次配置信息和所述会议服务器重配置的第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流对应的FEC流的冗余度等级;
所述发送单元61还用于在处理单元63确认支持所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表对应的FEC流配置时,向所述会议服务器发送根据所述会议服务器的FEC流档次配置信息生成的FEC流。
一种可选的方案为,所述处理单元63,还用于在确认不支持所述FEC流档次配置信息和所述会议服务器重配置的第一映射关系表对应的FEC流配置时,更新所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表;
所述发送单元61还用于向所述会议服务器发送根据媒体发送终端更新的FEC流档次配置信息生成的FEC流;
所述发送单元61,还用于将所述媒体发送终端的处理单元63更新的FEC流档次配置信息和所述媒体发送终端的处理单元63更新的第一映射关系表发送至所述会议服务器。
上述方案中媒体发送终端还能够实时更新FEC流档次配置信息和第一映射关系表,提高 了EFC流与媒体流的匹配度精度。
需要说明的是,本实施例中的接收单元62可以为会议服务器上具备接收功能的接口电路,如接收机或信息接收接口;发送单元61可以为会议服务器上具备发射功能的接口电路,如发射机或信息发送接口。处理单元63可以为单独设立的处理器,也可以集成在会议服务器的某一个处理器中实现,此外,也可以以程序代码的形式存储于会议服务器的存储器中,由会议服务器的某一个处理器调用并执行以上处理单元63的功能。这里所述的处理器可以是一个中央处理器(英文全称:Central Processing Unit,英文简称:CPU),或者是特定集成电路(英文全称:Application Specific Integrated Circuit,英文简称:ASIC),或者是被配置成实施本发明实施例的一个或多个集成电路。
参照图7所示,本发明的实施例提供一种会议服务器,用于实施上述的媒体流传输方法,包括:处理器71、第一接口电路72、第二接口电路73、存储器74和总线75;所述处理器71、第一接口电路72、第二接口电路73、存储器74通过所述总线75连接并完成相互间的通信;
需要说明的是,这里的处理器71可以是一个处理器,也可以是多个处理元件的统称。例如,该处理器可以是中央处理器CPU,也可以是特定集成电路ASIC,或者是被配置成实施本发明实施例的一个或多个集成电路,例如:一个或多个微处理器(英文全称:digitalsingnal processor,英文简称:DSP),或,一个或者多个现场可编程门阵列(英文全称:Field Programmable Gate Array,英文简称:FPGA)。
存储器74可以是一个存储装置,也可以是多个存储元件的统称,且用于存储可执行程序代码或接入网管理设备运行所需要参数、数据等。且存储器74可以包括随机存储器(英文全称:Random-Access Memory,英文简称:RAM),也可以包括非易失性存储器(英文全称:non-volatile memory,英文简称:NVRAM),例如磁盘存储器,闪存(Flash)等。
总线75可以是工业标准体系结构(英文全称:Industry Standard Architecture,英文简称:ISA)总线、外部设备互连(英文全称:Peripheral Component,英文简称:PCI)总线或扩展工业标准体系结构(英文全称:Extended Industry Standard Architecture,英文简称:EISA)总线等。该总线75可以分为地址总线、数据总线、控制总线等。为便于表示,图7中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。
第一接口电路72,用于接收媒体发送终端发送的FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;
处理器71,用于根据所述第一接口电路72接收的所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识之间的对应关系;
所述第一接口电路72,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端 根据所述FEC配置信息生成的FEC流;
第二接口电路73,用于将所述第一接口电路72接收的媒体流发送至各个媒体接收终端,并根据所述FEC流的标识与媒体接收终端的标识之间的对应关系将所述接收单元接收的FEC流发送至媒体接收终端。
本发明的实施例提供的会议服务器,能够接受媒体发送终端发送的FEC配置信息,并根据FEC配置信息生成第一映射关系表;在接收到由媒体发送终端根据FEC配置信息生成的媒体流的EFC流后,会议服务器能根据第一映射关系表将收到的FEC流发送至对应的媒体接收终端;从而避免了FEC的编码解码和包缓存会消耗会议服务器大量资源,能够降低服务器的资源消耗,从而减小媒体流端到端的传输时延。
一种可选的方案为,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;
所述处理器71,还用于获取所述媒体发送终端到各个媒体接收终端的路径状态信息;
所述处理器71,还用于根据所述媒体发送终端到各个媒体接收终端的路径状态信息、所述第一接口电路72接收的媒体流支持的各个FEC流的冗余度等级,生成所述媒体流的FEC流档次配置信息并重新配置所述第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流分别对应的FEC流的冗余度等级;
所述第二接口电路73,还用于将所述处理器71生成的FEC流档次配置信息和所述会议服务器的处理器71重新配置的第一映射关系表发送至所述媒体发送终端;
所述第一接口电路72,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述会议服务器发送的FEC流档次配置信息生成的FEC流。
一种可选的方案为,所述第一接口电路72,还用于接收所述媒体发送终端发送的更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表,所述处理器还用于根据所述第一接口电路接收72的所述媒体发送终端更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表调整所述会议服务器存储的FEC流档次配置信息和第一映射关系表;
所述第一接口电路72,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述媒体发送终端更新的FEC流档次配置信息生成的FEC流。
一种可选的方案为,所述处理器71,具体用于获取媒体发送终端到所述会议服务器的路径状态信息;获取各个媒体接收终端到所述会议服务器的路径状态信息;根据所述媒体发送终端到所述会议服务器的路径状态信息、以及各个媒体接收终端到所述会议服务器的路径状态信息,获取所述媒体发送终端到各个媒体接收终端的路径状态信息。
一种可选的方案为,所述路径状态信息包括丢包率;
所述处理器71,具体用于:
判断所述媒体发送终端到第一媒体接收终端的第一丢包率是否不在当前的冗余度等级范围内;其中,所述冗余度等级范围为所述媒体流支持的各个FEC流的冗余度等级中最大冗余度与最小冗余度构成的区间,一个所述冗余度等级对应一个丢包率范围的区间;
若所述第一丢包率在当前的冗余度等级范围内,则判断该第一丢包率是否导致所述冗余度等级的划分需要缩减,其中当所述第一丢包率属于所述冗余度等级的划分中的一个冗余度等级,并且任一冗余度等级不包含当前的任一FEC流对应的丢包率及所述第一丢包率时,确定所述第一丢包率导致所述冗余度等级的划分需要缩减;
若所述第一丢包率导致所述冗余度等级的划分需要缩减,则将所述第一丢包率与当前所有的FEC流的冗余度等级重新匹配,删除所述任一冗余度等级。
一种可选的方案为,所述处理器71,具体还用于:若所述第一丢包率不导致所述冗余度等级的划分需要缩减,则判断所述第一丢包率是否导致所述冗余度等级重新划分;其中当所述第一丢包率不属于所述冗余度等级的划分中的任一冗余度等级时,确定所述第一丢包率导致所述冗余度等级重新划分;
若所述第一丢包率导致所述冗余度等级重新划分,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分。
一种可选的方案为,所述处理器71,具体还用于:
若所述第一丢包率不在当前的冗余度等级范围内,则根据所述媒体发送终端发送的媒体流支持的各个FEC流的冗余度等级判断是否支持增加新的FEC流;其中若所述媒体流支持的各个FEC流的冗余度等级中不包括所述第一丢包率对应的冗余度等级,则确定不支持增加新的FEC流;
若不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
若支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
一种可选的方案为,所述处理器71,具体还用于:若支持增加新的FEC流,则判断所述媒体发送终端的带宽是否支持增加新的FEC流;其中当所述媒体发送终端的剩余带宽大于所述新增的FEC流所需的带宽时,确定支持增加新的FEC流;
若所述媒体发送终端的带宽不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
若所述媒体发送终端的带宽支持增加新的FEC流,则增加第一丢包率对应的FEC流,并 设置对应的冗余度等级。
其中,由于上述方案中会议服务器同时还能够根据媒体发送终端到各个媒体接收终端的路径状态信息、媒体发送终端的带宽以及媒体发送终端的FEC配置信息的变化实时更新FEC流档次配置信息和第一映射关系表,提高了EFC流与媒体流的匹配度精度。
参照图8所示,本发明的实施例提供一种媒体发送终端,用于实施上述的媒体流传输方法,包括:第一接口电路81、存储器82和总线83;所述第一接口电路81、存储器82通过所述总线83连接并完成相互间的通信;
需要说明的是,存储器82可以是一个存储装置,也可以是多个存储元件的统称,且用于存储可执行程序代码或接入网管理设备运行所需要参数、数据等。且存储器82可以包括随机存储器(英文全称:Random-Access Memory,英文简称:RAM),也可以包括非易失性存储器(英文全称:non-volatile memory,英文简称:NVRAM),例如磁盘存储器,闪存(Flash)等。
总线83可以是工业标准体系结构(英文全称:Industry Standard Architecture,英文简称:ISA)总线、外部设备互连(英文全称:Peripheral Component,英文简称:PCI)总线或扩展工业标准体系结构(英文全称:Extended Industry Standard Architecture,英文简称:EISA)总线等。该总线83可以分为地址总线、数据总线、控制总线等。为便于表示,图8中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。
第一接口电路81,用于向会议服务器发送FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;以便所述会议服务器根据所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识的对应关系;
所述第一接口电路81,还用于向所述会议服务器发送所述媒体流和根据所述FEC配置信息生成的FEC流,以便所述会议服务器将所述媒体流发送至各个媒体接收终端,并根据所述第一映射关系表将所述FEC流发送至对应的媒体接收终端。
本发明的实施例提供的媒体发送终端能够将FEC配置信息发送至会议服务器,以使得会议服务器根据FEC配置信息生成第一映射关系表;会议服务器在接收到由媒体发送终端根据FEC配置信息生成的媒体流的EFC流后,会议服务器能根据第一映射关系表将收到的FEC流发送至对应的媒体接收终端;从而避免了FEC的编码解码和包缓存会消耗会议服务器大量资源,能够降低服务器的资源消耗,从而减小媒体流端到端的传输时延。
一种可选的方案为,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;参照图8所示,所述媒体发送终端还包括:与所述总线连接的第二接口电路84和处理器85;这里的处理器85可以是一个处理器,也可以是多个处理元件的统称。例如,该处理器可以是中央处理器CPU,也可以是特定集成电路ASIC,或者是被配置成实施本发明实施例的一 个或多个集成电路,例如:一个或多个微处理器(英文全称:digital singnal processor,英文简称:DSP),或,一个或者多个现场可编程门阵列(英文全称:Field Programmable Gate Array,英文简称:FPGA)。
第二接口电路84,用于接收所述会议服务器发送的FEC流档次配置信息和所述会议服务器重配置的第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流对应的FEC流的冗余度等级;
所述第一接口电路81,还用于在所述处理器85确认支持所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表对应的FEC流配置时,向所述会议服务器发送根据所述会议服务器的FEC流档次配置信息生成的FEC流。
一种可选的方案为,所述处理器85,还用于在确认不支持所述FEC流档次配置信息和所述会议服务器重配置的第一映射关系表对应的FEC流配置时,更新所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表;
所述第一接口电路81还用于向所述会议服务器发送根据媒体发送终端更新的FEC流档次配置信息生成的FEC流;
所述第一接口电路81还用于,还用于将所述媒体发送终端的处理器85更新的FEC流档次配置信息和所述媒体发送终端的处理器85更新的第一映射关系表发送至所述会议服务器。
上述方案中媒体发送终端还能够实时更新FEC流档次配置信息和第一映射关系表,提高了EFC流与媒体流的匹配度精度。
此外,还提供一种计算可读媒体(或介质),包括在被执行时进行以下操作的计算机可读指令:执行上述实施例中的方法的101至115、S1至S9的操作。
另外,还提供一种计算机程序产品,包括上述计算机可读介质。
应理解,在本发明的各种实施例中,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本发明实施例的实施过程构成任何限定。
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、设备和方法,可以通过其它的方式实现。例如,以上所描述的设备实施例仅仅是示意性的,例如,所述单元的划分, 仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,设备或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(英文简称:ROM,英文全称:Read-Only Memory)、随机存取存储器(英文简称:RAM,英文全称:Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应所述以权利要求的保护范围为准。

Claims (34)

  1. 一种媒体流传输方法,其特征在于,包括:
    会议服务器接收媒体发送终端发送的FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;
    所述会议服务器根据所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识之间的对应关系;
    接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述FEC配置信息生成的FEC流;
    将所述媒体流发送至各个媒体接收终端,并根据所述FEC流的标识与媒体接收终端的标识之间的对应关系将所述FEC流发送至媒体接收终端。
  2. 根据权利要求1所述的方法,其特征在于,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;
    所述方法还包括:
    所述会议服务器获取所述媒体发送终端到各个媒体接收终端的路径状态信息;
    所述会议服务器根据所述媒体发送终端到各个媒体接收终端的路径状态信息、所述媒体流支持的各个FEC流的冗余度等级,生成所述媒体流的FEC流档次配置信息并重新配置所述第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流分别对应的FEC流的冗余度等级;
    所述会议服务器将所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表发送至所述媒体发送终端;
    接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述会议服务器发送的FEC流档次配置信息生成的FEC流。
  3. 根据权利要求2所述的方法,其特征在于,所述会议服务器将所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表发送至所述媒体发送终端后,所述方法还包括:
    接收所述媒体发送终端发送的更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表,并根据所述媒体发送终端更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表调整所述会议服务器存储的FEC流档次配置信息和第一映射关系表;
    接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述媒体发送终端更新 的FEC流档次配置信息生成的FEC流。
  4. 根据权利要求2所述的方法,其特征在于,所述会议服务器获取所述媒体发送终端到各个媒体接收终端的路径状态信息,包括:
    所述会议服务器获取媒体发送终端到所述会议服务器的路径状态信息;
    所述会议服务器获取各个媒体接收终端到所述会议服务器的路径状态信息;
    所述会议服务器根据所述媒体发送终端到所述会议服务器的路径状态信息、以及各个媒体接收终端到所述会议服务器的路径状态信息,获取所述媒体发送终端到各个媒体接收终端的路径状态信息。
  5. 根据权利要求2所述的方法,其特征在于,所述路径状态信息包括丢包率;
    所述会议服务器根据所述媒体发送终端到媒体接收终端的路径状态信息、所述媒体流支持的各个FEC流的冗余度等级,生成媒体流的FEC流档次配置信息,包括:
    判断所述媒体发送终端到第一媒体接收终端的第一丢包率是否不在当前的冗余度等级范围内;其中,所述冗余度等级范围为所述媒体流支持的各个FEC流的冗余度等级中最大冗余度与最小冗余度构成的区间,一个所述冗余度等级对应一个丢包率范围的区间;
    若所述第一丢包率在当前的冗余度等级范围内,则判断该第一丢包率是否导致所述冗余度等级的划分需要缩减,其中当所述第一丢包率属于所述冗余度等级的划分中的一个冗余度等级,并且任一冗余度等级不包含当前的任一FEC流对应的丢包率及所述第一丢包率时,确定所述第一丢包率导致所述冗余度等级的划分需要缩减;
    若所述第一丢包率导致所述冗余度等级的划分需要缩减,则将所述第一丢包率与当前所有的FEC流的冗余度等级重新匹配,删除所述任一冗余度等级。
  6. 根据权利要求5所述的方法,其特征在于,若所述第一丢包率不导致所述冗余度等级的划分需要缩减,则判断所述第一丢包率是否导致所述冗余度等级重新划分;其中当所述第一丢包率不属于所述冗余度等级的划分中的任一冗余度等级时,确定所述第一丢包率导致所述冗余度等级重新划分;
    若所述第一丢包率导致所述冗余度等级重新划分,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分。
  7. 根据权利要求5所述的方法,其特征在于,
    若所述第一丢包率不在当前的冗余度等级范围内,则根据所述媒体发送终端发送的媒体流支持的各个FEC流的冗余度等级判断是否支持增加新的FEC流;其中若所述媒体流支持的各个FEC流的冗余度等级中不包括所述第一丢包率对应的冗余度等级,则确定不支持增加新 的FEC流;
    若不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
    若支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
  8. 根据权利要求7所述的方法,其特征在于,所述方法还包括:若支持增加新的FEC流,则判断所述媒体发送终端的带宽是否支持增加新的FEC流;其中当所述媒体发送终端的剩余带宽大于所述新增的FEC流所需的带宽时,确定支持增加新的FEC流;
    若所述媒体发送终端的带宽不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
    若所述媒体发送终端的带宽支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
  9. 一种媒体流传输方法,其特征在于,包括:
    媒体发送终端向会议服务器发送FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;以便所述会议服务器根据所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识的对应关系;
    向所述会议服务器发送所述媒体流和根据所述FEC配置信息生成的FEC流,以便所述会议服务器将所述媒体流发送至各个媒体接收终端,并根据所述第一映射关系表将所述FEC流发送至对应的媒体接收终端。
  10. 根据权利要求9所述的方法,其特征在于,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;所述方法还包括:
    接收所述会议服务器发送的FEC流档次配置信息和所述会议服务器重配置的第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流对应的FEC流的冗余度等级;
    在确认支持所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表对应的FEC流配置时,向所述会议服务器发送根据所述会议服务器的FEC流档次配置信息生成的FEC流。
  11. 根据权利要求10所述的方法,其特征在于,
    所述媒体发送终端在确认不支持所述FEC流档次配置信息和所述会议服务器重配置的第一映射关系表对应的FEC流配置时,更新所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表;并向所述会议服务器发送根据媒体发送终端更新的FEC流档次配置信 息生成的FEC流;
    将所述媒体发送终端更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表发送至所述会议服务器。
  12. 一种会议服务器,其特征在于,包括:
    接收单元,用于接收媒体发送终端发送的FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;
    处理单元,用于根据所述接收单元接收的所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识之间的对应关系;
    所述接收单元,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述FEC配置信息生成的FEC流;
    发送单元,用于将所述接收单元接收的媒体流发送至各个媒体接收终端,并根据所述FEC流的标识与媒体接收终端的标识之间的对应关系将所述接收单元接收的FEC流发送至媒体接收终端。
  13. 根据权利要求12所述的会议服务器,其特征在于,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;
    所述会议服务器还包括:获取单元,用于获取所述媒体发送终端到各个媒体接收终端的路径状态信息;
    所述处理单元,还用于根据所述获取单元获取的媒体发送终端到各个媒体接收终端的路径状态信息、所述接收单元接收的媒体流支持的各个FEC流的冗余度等级,生成所述媒体流的FEC流档次配置信息并重新配置所述第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流分别对应的FEC流的冗余度等级;
    所述发送单元,还用于将所述处理单元生成的FEC流档次配置信息和所述会议服务器的处理单元重新配置的第一映射关系表发送至所述媒体发送终端;
    所述接收单元,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述会议服务器发送的FEC流档次配置信息生成的FEC流。
  14. 根据权利要求13所述的会议服务器,其特征在于,
    所述接收单元,还用于接收所述媒体发送终端发送的更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表,所述处理器还用于根据所述接收单元接收的所述媒体发送终端更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表调整所述会议服务器存储的FEC流档次配置信息和第一映射关系表;
    所述接收单元,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述媒体发送终端更新的FEC流档次配置信息生成的FEC流。
  15. 根据权利要求13所述的会议服务器,其特征在于,所述获取单元,具体用于获取媒体发送终端到所述会议服务器的路径状态信息;获取各个媒体接收终端到所述会议服务器的路径状态信息;根据所述媒体发送终端到所述会议服务器的路径状态信息、以及各个媒体接收终端到所述会议服务器的路径状态信息,获取所述媒体发送终端到各个媒体接收终端的路径状态信息。
  16. 根据权利要求13所述的会议服务器,其特征在于,所述路径状态信息包括丢包率;
    所述处理单元,具体用于:
    判断所述媒体发送终端到第一媒体接收终端的第一丢包率是否不在当前的冗余度等级范围内;其中,所述冗余度等级范围为所述媒体流支持的各个FEC流的冗余度等级中最大冗余度与最小冗余度构成的区间,一个所述冗余度等级对应一个丢包率范围的区间;
    若所述第一丢包率在当前的冗余度等级范围内,则判断该第一丢包率是否导致所述冗余度等级的划分需要缩减,其中当所述第一丢包率属于所述冗余度等级的划分中的一个冗余度等级,并且任一冗余度等级不包含当前的任一FEC流对应的丢包率及所述第一丢包率时,确定所述第一丢包率导致所述冗余度等级的划分需要缩减;
    若所述第一丢包率导致所述冗余度等级的划分需要缩减,则将所述第一丢包率与当前所有的FEC流的冗余度等级重新匹配,删除所述任一冗余度等级。
  17. 根据权利要求16所述的会议服务器,其特征在于,所述处理单元,具体还用于:若所述第一丢包率不导致所述冗余度等级的划分需要缩减,则判断所述第一丢包率是否导致所述冗余度等级重新划分;其中当所述第一丢包率不属于所述冗余度等级的划分中的任一冗余度等级时,确定所述第一丢包率导致所述冗余度等级重新划分;
    若所述第一丢包率导致所述冗余度等级重新划分,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分。
  18. 根据权利要求16所述的会议服务器,其特征在于,所述处理单元,具体还用于:
    若所述第一丢包率不在当前的冗余度等级范围内,则根据所述媒体发送终端发送的媒体流支持的各个FEC流的冗余度等级判断是否支持增加新的FEC流;其中若所述媒体流支持的各个FEC流的冗余度等级中不包括所述第一丢包率对应的冗余度等级,则确定不支持增加新的FEC流;
    若不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
    若支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
  19. 根据权利要求18所述的会议服务器,其特征在于,所述处理单元,具体还用于:若支持增加新的FEC流,则判断所述媒体发送终端的带宽是否支持增加新的FEC流;其中当所述媒体发送终端的剩余带宽大于所述新增的FEC流所需的带宽时,确定支持增加新的FEC流;
    若所述媒体发送终端的带宽不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
    若所述媒体发送终端的带宽支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
  20. 一种媒体发送终端,其特征在于,包括:
    发送单元,用于向会议服务器发送FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;以便所述会议服务器根据所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识的对应关系;
    所述发送单元,还用于向所述会议服务器发送所述媒体流和根据所述FEC配置信息生成的FEC流,以便所述会议服务器将所述媒体流发送至各个媒体接收终端,并根据所述第一映射关系表将所述FEC流发送至对应的媒体接收终端。
  21. 根据权利要求20所述的媒体发送终端,其特征在于,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;所述媒体发送终端还包括:接收单元和处理单元;
    接收单元,用于接收所述会议服务器发送的FEC流档次配置信息和所述会议服务器重配置的第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流对应的FEC流的冗余度等级;
    所述发送单元还用于在处理单元确认支持所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表对应的FEC流配置时,向所述会议服务器发送根据所述会议服务器的FEC流档次配置信息生成的FEC流。
  22. 根据权利要求21所述的媒体发送终端,其特征在于,
    所述处理单元,还用于在确认不支持所述FEC流档次配置信息和所述会议服务器重配置的第一映射关系表对应的FEC流配置时,更新所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表;
    所述发送单元还用于向所述会议服务器发送根据媒体发送终端更新的FEC流档次配置信息生成的FEC流;
    所述发送单元,还用于将所述媒体发送终端的处理单元更新的FEC流档次配置信息和所 述媒体发送终端的处理单元更新的第一映射关系表发送至所述会议服务器。
  23. 一种会议服务器,其特征在于,包括:处理器、第一接口电路、第二接口电路、存储器和总线;所述处理器、第一接口电路、第二接口电路、存储器通过所述总线连接并完成相互间的通信;
    第一接口电路,用于接收媒体发送终端发送的FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;
    处理器,用于根据所述第一接口电路接收的所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识之间的对应关系;
    所述第一接口电路,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述FEC配置信息生成的FEC流;
    第二接口电路,用于将所述第一接口电路接收的媒体流发送至各个媒体接收终端,并根据所述FEC流的标识与媒体接收终端的标识之间的对应关系将所述接收单元接收的FEC流发送至媒体接收终端。
  24. 根据权利要求23所述的会议服务器,其特征在于,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;
    所述处理器,还用于获取所述媒体发送终端到各个媒体接收终端的路径状态信息;
    所述处理器,还用于根据所述媒体发送终端到各个媒体接收终端的路径状态信息、所述第一接口电路接收的媒体流支持的各个FEC流的冗余度等级,生成所述媒体流的FEC流档次配置信息并重新配置所述第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流分别对应的FEC流的冗余度等级;
    所述第二接口电路,还用于将所述处理器生成的FEC流档次配置信息和所述会议服务器的处理器重新配置的第一映射关系表发送至所述媒体发送终端;
    所述第一接口电路,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根据所述会议服务器发送的FEC流档次配置信息生成的FEC流。
  25. 根据权利要求24所述的会议服务器,其特征在于,
    所述第一接口电路,还用于接收所述媒体发送终端发送的更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表,所述处理器还用于根据所述第一接口电路接收的所述媒体发送终端更新的FEC流档次配置信息和所述媒体发送终端更新的第一映射关系表调整所述会议服务器存储的FEC流档次配置信息和第一映射关系表;
    所述第一接口电路,还用于接收所述媒体发送终端发送的媒体流和所述媒体发送终端根 据所述媒体发送终端更新的FEC流档次配置信息生成的FEC流。
  26. 根据权利要求24所述的会议服务器,其特征在于,所述处理器,具体用于获取媒体发送终端到所述会议服务器的路径状态信息;获取各个媒体接收终端到所述会议服务器的路径状态信息;根据所述媒体发送终端到所述会议服务器的路径状态信息、以及各个媒体接收终端到所述会议服务器的路径状态信息,获取所述媒体发送终端到各个媒体接收终端的路径状态信息。
  27. 根据权利要求24所述的会议服务器,其特征在于,所述路径状态信息包括丢包率;
    所述处理器,具体用于:
    判断所述媒体发送终端到第一媒体接收终端的第一丢包率是否不在当前的冗余度等级范围内;其中,所述冗余度等级范围为所述媒体流支持的各个FEC流的冗余度等级中最大冗余度与最小冗余度构成的区间,一个所述冗余度等级对应一个丢包率范围的区间;
    若所述第一丢包率在当前的冗余度等级范围内,则判断该第一丢包率是否导致所述冗余度等级的划分需要缩减,其中当所述第一丢包率属于所述冗余度等级的划分中的一个冗余度等级,并且任一冗余度等级不包含当前的任一FEC流对应的丢包率及所述第一丢包率时,确定所述第一丢包率导致所述冗余度等级的划分需要缩减;
    若所述第一丢包率导致所述冗余度等级的划分需要缩减,则将所述第一丢包率与当前所有的FEC流的冗余度等级重新匹配,删除所述任一冗余度等级。
  28. 根据权利要求27所述的会议服务器,其特征在于,所述处理器,具体还用于:若所述第一丢包率不导致所述冗余度等级的划分需要缩减,则判断所述第一丢包率是否导致所述冗余度等级重新划分;其中当所述第一丢包率不属于所述冗余度等级的划分中的任一冗余度等级时,确定所述第一丢包率导致所述冗余度等级重新划分;
    若所述第一丢包率导致所述冗余度等级重新划分,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分。
  29. 根据权利要求27所述的会议服务器,其特征在于,所述处理器,具体还用于:
    若所述第一丢包率不在当前的冗余度等级范围内,则根据所述媒体发送终端发送的媒体流支持的各个FEC流的冗余度等级判断是否支持增加新的FEC流;其中若所述媒体流支持的各个FEC流的冗余度等级中不包括所述第一丢包率对应的冗余度等级,则确定不支持增加新的FEC流;
    若不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
    若支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
  30. 根据权利要求29所述的会议服务器,其特征在于,所述处理器,具体还用于:若支持增加新的FEC流,则判断所述媒体发送终端的带宽是否支持增加新的FEC流;其中当所述媒体发送终端的剩余带宽大于所述新增的FEC流所需的带宽时,确定支持增加新的FEC流;
    若所述媒体发送终端的带宽不支持增加新的FEC流,则按照所有丢包率的分布调整FEC流对应的冗余度等级的划分;
    若所述媒体发送终端的带宽支持增加新的FEC流,则增加第一丢包率对应的FEC流,并设置对应的冗余度等级。
  31. 一种媒体发送终端,其特征在于,包括:第一接口电路、存储器和总线;所述第一接口电路、存储器通过所述总线连接并完成相互间的通信;
    第一接口电路,用于向会议服务器发送FEC配置信息,所述FEC配置信息包含媒体流支持的FEC流的标识;以便所述会议服务器根据所述FEC配置信息,生成第一映射关系表,所述第一映射关系表包含FEC流的标识与媒体接收终端的标识的对应关系;
    所述第一接口电路,还用于向所述会议服务器发送所述媒体流和根据所述FEC配置信息生成的FEC流,以便所述会议服务器将所述媒体流发送至各个媒体接收终端,并根据所述第一映射关系表将所述FEC流发送至对应的媒体接收终端。
  32. 根据权利要求31所述的媒体发送终端,其特征在于,所述FEC配置信息还包括所述媒体流支持的各个FEC流的冗余度等级;所述媒体发送终端还包括:与所述总线连接的第二接口电路和处理器;
    第二接口电路,用于接收所述会议服务器发送的FEC流档次配置信息和所述会议服务器重配置的第一映射关系表,所述FEC流档次配置信息包括:所述会议服务器发送至各个媒体接收终端的媒体流对应的FEC流的冗余度等级;
    所述第一接口电路,还用于在所述处理器确认支持所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表对应的FEC流配置时,向所述会议服务器发送根据所述会议服务器的FEC流档次配置信息生成的FEC流。
  33. 根据权利要求32所述的媒体发送终端,其特征在于,
    所述处理器,还用于在确认不支持所述FEC流档次配置信息和所述会议服务器重配置的第一映射关系表对应的FEC流配置时,更新所述FEC流档次配置信息和所述会议服务器重新配置的第一映射关系表;
    所述第一接口电路还用于向所述会议服务器发送根据媒体发送终端更新的FEC流档次配 置信息生成的FEC流;
    所述第一接口电路还用于,还用于将所述媒体发送终端的处理器更新的FEC流档次配置信息和所述媒体发送终端的处理器更新的第一映射关系表发送至所述会议服务器。
  34. 一种通信系统,其特征在于,包括:如权利要求12-19任一项所述的会议服务器,及如权利要求20-22任一项所述的媒体发送终端;
    或者,
    如权利要求23-30任一项所述的会议服务器,及如权利要求31-33任一项所述的媒体发送终端。
PCT/CN2016/098585 2015-09-15 2016-09-09 一种媒体流传输方法、设备及系统 WO2017045568A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510587455.2 2015-09-15
CN201510587455.2A CN106534760B (zh) 2015-09-15 2015-09-15 一种媒体流传输方法、设备及系统

Publications (1)

Publication Number Publication Date
WO2017045568A1 true WO2017045568A1 (zh) 2017-03-23

Family

ID=58288153

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/098585 WO2017045568A1 (zh) 2015-09-15 2016-09-09 一种媒体流传输方法、设备及系统

Country Status (2)

Country Link
CN (1) CN106534760B (zh)
WO (1) WO2017045568A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115086285A (zh) * 2022-06-02 2022-09-20 深圳市欢太科技有限公司 一种数据处理方法、装置、存储介质及电子设备
CN115208864A (zh) * 2022-08-12 2022-10-18 阿波罗智联(北京)科技有限公司 数据传输方法、装置、设备、车辆及存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111757043A (zh) * 2020-06-30 2020-10-09 中科远见(重庆)科技有限公司 一种数据传输系统及传输方法
CN114554136B (zh) * 2022-04-25 2022-07-29 浙江华创视讯科技有限公司 视频会议实现方法、多点控制单元、设备及可读存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101636983A (zh) * 2007-03-14 2010-01-27 微软公司 减少视频传输时的分组丢失的影响
CN104205698A (zh) * 2012-02-27 2014-12-10 三星电子株式会社 使用前向纠错方案的分组发送/接收装置和方法
CN104639866A (zh) * 2013-11-14 2015-05-20 中兴通讯股份有限公司 一种调节会议终端通话质量的方法及装置
WO2015105764A1 (en) * 2014-01-08 2015-07-16 Dolby Laboratories Licensing Corporation Detecting conference call performance issue from aberrant behavior

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5265383B2 (ja) * 2005-09-07 2013-08-14 ヴィドヨ,インコーポレーテッド 低遅延かつ分散した会議アプリケーション向けコンファレンスサーバアーキテクチャのためのシステムおよび方法
AU2006330457B2 (en) * 2005-12-22 2011-07-14 Vidyo, Inc. System and method for videoconferencing using scalable video coding and compositing scalable video conferencing servers
KR101546509B1 (ko) * 2008-04-29 2015-08-21 톰슨 라이센싱 무선 네트워크를 통한 멀티캐스트에서의 정방향 오류 정정을 적응시키기 위한 방법 및 시스템
US8612819B2 (en) * 2009-08-25 2013-12-17 Radvision Ltd. Systems, methods, and media for checking available bandwidth using forward error correction
US8819513B2 (en) * 2012-01-13 2014-08-26 Microsoft Corporation Lost real-time media packet recovery
CN104735034B (zh) * 2013-12-24 2018-06-26 中国移动通信集团公司 媒体流的传输方法、装置及系统
CN103957222A (zh) * 2014-05-20 2014-07-30 艾诺通信系统(苏州)有限责任公司 一种基于fec算法的视频传输自适应方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101636983A (zh) * 2007-03-14 2010-01-27 微软公司 减少视频传输时的分组丢失的影响
CN104205698A (zh) * 2012-02-27 2014-12-10 三星电子株式会社 使用前向纠错方案的分组发送/接收装置和方法
CN104639866A (zh) * 2013-11-14 2015-05-20 中兴通讯股份有限公司 一种调节会议终端通话质量的方法及装置
WO2015105764A1 (en) * 2014-01-08 2015-07-16 Dolby Laboratories Licensing Corporation Detecting conference call performance issue from aberrant behavior

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115086285A (zh) * 2022-06-02 2022-09-20 深圳市欢太科技有限公司 一种数据处理方法、装置、存储介质及电子设备
CN115208864A (zh) * 2022-08-12 2022-10-18 阿波罗智联(北京)科技有限公司 数据传输方法、装置、设备、车辆及存储介质
CN115208864B (zh) * 2022-08-12 2024-02-06 阿波罗智联(北京)科技有限公司 数据传输方法、装置、设备、车辆及存储介质

Also Published As

Publication number Publication date
CN106534760A (zh) 2017-03-22
CN106534760B (zh) 2020-07-28

Similar Documents

Publication Publication Date Title
CN111406415B (zh) 多播和广播服务的方法和系统
JP6648211B2 (ja) マルチキャスト通信またはブロードキャスト通信において拡張したファイル配信を行う方法および装置
US10069719B2 (en) Method and apparatus for multipath media delivery
CN102859943B (zh) 向应用提供获知接入网络出现的方法和系统
JP6591567B2 (ja) サービスレート調整方法及び装置
US10470000B2 (en) Methods and apparatus for enhanced MBMS content provisioning and content ingestion
WO2017045568A1 (zh) 一种媒体流传输方法、设备及系统
CN103563475A (zh) 用于利用多描述编码的移动多媒体服务的多路径管理架构和协议
WO2020107751A1 (zh) 一种数据传输方法及装置、终端
JP6774957B2 (ja) マルチメディアブロードキャストマルチキャストサービスに基づくフレキシブルブロードキャストサービスのための方法及び装置
WO2020042848A1 (zh) 一种网络切片管理方法及装置
WO2021037271A1 (zh) 通信方法、设备及系统
CN112003937A (zh) 卫星数据传输方法、装置、计算机设备、存储介质
EP3881459B1 (en) Method and apparatus for efficient delivery of source and forward error correction streams in systems supporting mixed unicast multicast transmission
WO2015149351A1 (zh) 监控服务器、解析服务器、请求设备及节点选择方法
WO2022147836A1 (zh) 一种连接建立方法及装置、网络设备
WO2019233381A1 (zh) 用户面数据处理方法及装置
WO2021087729A1 (zh) 一种指示解压缩对象的方法及装置、通信设备
WO2017023302A1 (en) System and method for delivery of unicast content in hybrid networks
WO2023185692A1 (zh) 一种通信方法、装置及设备
WO2017101043A1 (zh) 一种数据传输方法及设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16845682

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16845682

Country of ref document: EP

Kind code of ref document: A1