WO2015034405A1 - Adaptation de paramètre de codec multimédia adaptatif - Google Patents

Adaptation de paramètre de codec multimédia adaptatif Download PDF

Info

Publication number
WO2015034405A1
WO2015034405A1 PCT/SE2013/051032 SE2013051032W WO2015034405A1 WO 2015034405 A1 WO2015034405 A1 WO 2015034405A1 SE 2013051032 W SE2013051032 W SE 2013051032W WO 2015034405 A1 WO2015034405 A1 WO 2015034405A1
Authority
WO
WIPO (PCT)
Prior art keywords
multimedia
indicator value
quality indicator
channel quality
values
Prior art date
Application number
PCT/SE2013/051032
Other languages
English (en)
Inventor
Markus Andersson
Fredrik Jansson
Original Assignee
Telefonaktiebolaget L M Ericsson (Publ)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Telefonaktiebolaget L M Ericsson (Publ) filed Critical Telefonaktiebolaget L M Ericsson (Publ)
Priority to PCT/SE2013/051032 priority Critical patent/WO2015034405A1/fr
Publication of WO2015034405A1 publication Critical patent/WO2015034405A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/0001—Systems modifying transmission characteristics according to link quality, e.g. power backoff
    • H04L1/0015—Systems modifying transmission characteristics according to link quality, e.g. power backoff characterised by the adaptation strategy
    • H04L1/0019—Systems modifying transmission characteristics according to link quality, e.g. power backoff characterised by the adaptation strategy in which mode-switching is based on a statistical approach
    • H04L1/002—Algorithms with memory of the previous states, e.g. Markovian models
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/0001—Systems modifying transmission characteristics according to link quality, e.g. power backoff
    • H04L1/0015—Systems modifying transmission characteristics according to link quality, e.g. power backoff characterised by the adaptation strategy
    • H04L1/0017—Systems modifying transmission characteristics according to link quality, e.g. power backoff characterised by the adaptation strategy where the mode-switching is based on Quality of Service requirement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/25—Flow control; Congestion control with rate being modified by the source upon detecting a change of network conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/752—Media network packet handling adapting media to network capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/762—Media network packet handling at the source 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W28/00—Network traffic management; Network resource management
    • H04W28/02—Traffic management, e.g. flow control or congestion control
    • H04W28/0231—Traffic management, e.g. flow control or congestion control based on communication conditions
    • H04W28/0236—Traffic management, e.g. flow control or congestion control based on communication conditions radio quality, e.g. interference, losses or delay
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W28/00—Network traffic management; Network resource management
    • H04W28/02—Traffic management, e.g. flow control or congestion control
    • H04W28/0252—Traffic management, e.g. flow control or congestion control per individual bearer or channel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/0001—Systems modifying transmission characteristics according to link quality, e.g. power backoff
    • H04L1/0023—Systems modifying transmission characteristics according to link quality, e.g. power backoff characterised by the signalling
    • H04L1/0026—Transmission of channel quality indication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/12—Arrangements for detecting or preventing errors in the information received by using return channel
    • H04L1/16—Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
    • H04L1/1607—Details of the supervisory signal
    • H04L1/1671—Details of the supervisory signal the supervisory signal being transmitted together with control information
    • H04L1/1678—Details of the supervisory signal the supervisory signal being transmitted together with control information where the control information is for timing, e.g. time stamps
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/20—Arrangements for detecting or preventing errors in the information received using signal quality detector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0823—Errors, e.g. transmission errors
    • H04L43/0829—Packet loss
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852—Delays
    • H04L43/0858—One way delays

Definitions

  • Embodiments presented herein relate to multimedia communications sessions, and particularly to a method, an electronic device, a computer program, and a computer program product for determining multimedia codec parameters for a multimedia communications session.
  • the multimedia stream is adapted with the goal to suit present conditions of the communications channel.
  • the end-user equipment and/ or the network nodes of the communications network measures the perceived end-user quality or other Quality of Service (QoS) parameters such as packet loss or jitter that may have a correlation with the perceived end-user quality.
  • QoS Quality of Service
  • a multimedia communications session such as a video conferencing service.
  • An object of embodiments herein is to provide improved bandwidth consumption and/ or end-user quality during a multimedia communications session, such as a video conferencing service.
  • the inventors of the enclosed embodiments have through a combination of practical experimentation and theoretical derivation discovered that it may be advantageous to, instead of having static rules for how to spend available bits, have adaptive rules for how to spend the available bits during a multimedia communications session.
  • a particular object is therefore to provide improved bandwidth consumption during a multimedia communications session, such as a video conferencing service, wherein the bandwidth consumption is adapted to varying network conditions in an efficient way.
  • a method for determining multimedia codec parameters for a multimedia communications session is performed by an electronic device.
  • the method comprises acquiring a channel quality indicator value representing current throughput characteristics of a communications channel used for the multimedia communications session.
  • the method comprises comparing the channel quality indicator value to a previous channel quality indicator value of the communications channel.
  • the method comprises determining, based on said comparing, whether to delay adaptation of values of a set of multimedia codec parameters to be used by a multimedia codec during said multimedia communications session or not, and which values of said set of multimedia codec parameters to adapt.
  • this provides improved bandwidth consumption during a multimedia communications session.
  • this may improve network efficiency for multimedia services.
  • this may improve the Quality of Service, and thus the end-user experience.
  • this may enable network costs to be reduced.
  • an electronic device for determining multimedia codec parameters for a multimedia communications session.
  • the electronic device comprises a processing unit.
  • the processing unit is arranged to acquire a channel quality indicator value representing current throughput characteristics of a communications channel used for the multimedia communications session.
  • the processing unit is arranged to compare the channel quality indicator value to a previous channel quality indicator value of the communications channel.
  • the processing unit is arranged to determine, based on said comparing, whether to delay adaptation of values of a set of multimedia codec parameters to be used by a multimedia codec during said multimedia communications session or not, and which values of said set of multimedia codec parameters to adapt.
  • the electronic device is an end-user equipment. According to another embodiment the electronic devices is a server.
  • a vehicle According to a third aspect there is presented a vehicle.
  • the vehicle
  • the computer program comprises computer program code which, when run on an electronic device, causes the electronic device to perform a method according to the first aspect.
  • a computer program product comprising a computer program according to the fourth aspect and a computer readable means on which the computer program is stored.
  • any feature of the first, second, third, fourth, and fifth aspects may be applied to any other aspect, wherever appropriate.
  • any advantage of the first aspect may equally apply to the second, third, fourth and/or fifth aspect, respectively, and vice versa.
  • Other objectives, features and advantages of the enclosed embodiments will be apparent from the following detailed disclosure, from the attached dependent claims as well as from the drawings.
  • Fig 1 schematically illustrates a communications network according to an embodiment
  • Figs 2a and 2b schematically illustrate examples of electronic devices according to embodiments
  • Fig 3 schematically illustrates a computer program product according to an embodiment
  • Fig 4 schematically illustrates a vehicle according to an embodiment
  • Fig 5 schematically illustrates a video parameter mapper according to an embodiment
  • Fig 6 schematically illustrates a user interface of an electronic device according to an embodiment
  • Figs 7 and 8 are flowcharts of methods according to embodiments.
  • Figs 9 and 10 schematically illustrate examples of throughput/ quality over time.
  • Fig 1 shows a schematic overview of an exemplifying communications network 11 where embodiments presented herein can be applied.
  • the communications network 11 comprises a network node (NN) 13 providing network coverage over cells (not shown).
  • An electronic device (ED) 12a, positioned in a particular cell is thus provided network service by the network node 13 serving that particular cell.
  • the communications network 11 may comprise a plurality of network nodes 13 and a plurality of UEs 12a operatively connected to at least one of the plurality of network nodes 13.
  • the network node 13 is operatively connected to a core network 14.
  • the core network 14 may provide services and data to the electronic device 12a operatively connected to the network node 13 from an external Internet Protocol (IP) packet switched data network 15.
  • IP Internet Protocol
  • At least parts of the communications network 11 may generally comply with any one or a combination of W-CDMA (Wideband Code Division Multiplex), LTE (Long Term Evolution), EDGE (Enhanced Data Rates for GSM Evolution, Enhanced GPRS (General Packet Radio Service)), CDMA2000 (Code
  • An electronic device(ED) 12b may further have a wired connection to the external IP packet switched data network 15.
  • Examples of electronic devices 12a, 12b include, but are not limited to end-user equipment such as mobile phones, tablet computers, laptop computers, and stationary computers.
  • the electronic device 12a, 12b may alternatively be a server.
  • an electronic device 12a, 12b as herein disclosed may have either a wireless connection, or a wired connection, or both a wireless connection and a wired connection to the IP packet switched network 15.
  • the communications network 11 may comprise any combinations of purely wirelessly connected electronic devices 12a, purely wired connected electronic devices 12b, and electronic devices 12a, 12b with both wireless and wired connections.
  • multimedia communications One example of services and data which may be communicated through the communications system 31 is multimedia communications.
  • multimedia communications multimedia streams are communicated between two electronic devices 12a, 12b (such as from electronic device 12a to electronic device 12b, or vice versa) or between a server of the IP network 15 and at least one electronic device 12a, 12b (such as from the server to at least one electronic device 12a, 12b or from a at least one electronic device 12a, 12b to the server).
  • the multimedia stream may comprise payload data in the form of audio and video content.
  • the audio and video content may be synchronized.
  • the multimedia streams may comprise further payload data.
  • a transmitting electronic device 12a transmits a multimedia stream comprising encoded video over a non-ideal channel and a receiving electronic device 12b intended to receive the encoded multimedia stream measures the quality of the received bit stream.
  • the results of the measurement maybe translated into a bit rate request that is provided to the transmitting electronic device 12a. For example, if the receiving electronic device 12b detects that the bit rate used for transmitting the multimedia stream most likely is too high it will transmit a bit rate request to the transmitting electronic device 12a to lower its bit rate.
  • Common parameters to measure are inter-arrival delay, jitter and packet loss.
  • the receiving electronic device 12b may transmit the measurement results to the transmitting electronic device 12a, and the transmitting electronic device 12a may then by itself obtain a corresponding bit rate request from the
  • the transmitting electronic device 12a has to decide on how to allocate the available number of bits for a given time slot. For example, the transmitting electronic device 12a maybe arranged to determine how many bits to allocate for audio content and how many bits to allocate for video content. For example, the transmitting electronic device 12a maybe arranged to determine how many bits to allocate for different video and/or audio codec parameters. For example, the video bit rate could be lowered by using a coarser quantization in the video encoder but it can also be lowered by reducing the resolution and/or the video frame rate.
  • the electronic devices 12a, 12b have fixed rules for how to adapt the parameters of the multimedia codec to produce a bit stream for a given bit rate.
  • Fel! Hittar inte referenskalla.Table 1 shows an example of this.
  • the resolution of the video is set to 640 by 480 pixels at a frame rate of 25 Hz.
  • having such fixed rules may neither be optimal from the end-user experience perspective, nor from the bandwidth consumption of the electronic devices 12a, 12b.
  • the embodiments disclosed herein relate to determining multimedia codec parameters for a multimedia communications session.
  • an electronic device a method performed by the electronic device, a computer program comprising code, for example in the form of a computer program product, that when run on an electronic device, causes the electronic device to perform the method.
  • Fig 2a schematically illustrates, in terms of a number of functional modules, the components of an electronic device 12a, 12b according to an embodiment.
  • a processing unit 22 is provided using any combination of one or more of a suitable central processing unit (CPU), multiprocessor, microcontroller, digital signal processor (DSP), application specific integrated circuit (ASIC), field programmable gate arrays (FPGA) etc., capable of executing software instructions stored in a computer program product 31 (as in Fig 3), e.g. in the form of a storage medium 24.
  • the storage medium 24 may also comprise persistent storage, which, for example, can be any single one or combination of magnetic memory, optical memory, solid state memory or even remotely mounted memory.
  • the electronic device 12a, 12b may further comprise communications interface 23 for receiving and transmitting data to another device.
  • the communications interface 23 may thus comprise one or more transmitters and receivers, comprising analogue and digital components and a suitable number of antennae for radio communication and/ or ports for wired communication.
  • the electronic device 12a, 12b may further comprise a multimedia unit 25.
  • the multimedia unit 25 may be arranged to encode and/ or render a multimedia stream, such as a video stream and/or an audio stream.
  • the processing unit 22 controls the general operation of the electronic device 12a, 12b, e.g. by sending control signals to, and receiving control signals from, the communications interface 23 and the multimedia unit 25, and by retrieving stored data and instructions from the storage medium 24, as well as writing data to the storage medium 24.
  • Other components, as well as the related functionality, of the electronic device 12a, 12b are omitted in order not to obscure the concepts presented herein.
  • Fig 2b schematically illustrates, in terms of a number of functional units, the components of an electronic device 12a, 12b according to an embodiment.
  • the electronic device 12a, 12b of Fig 2b comprises a number of functional units; an acquiring unit 22a, a comparing unit 22b, and a determining unit 22c.
  • the electronic device 12a, 12b of Fig 2b may further comprises a number of optional functional units, such as an adapting unit 22d.
  • the functionality of each functional unit 22a-d will be further disclosed below in the context of which the functional units may be used. In general terms, each functional unit 22a-d maybe implemented in hardware or in software.
  • the processing unit 22 may thus be arranged to from the storage medium 24 fetch
  • the electronic device 12a, 12b maybe provided as a standalone device or as a part of a further device.
  • the electronic device 12a, 12b may be provided in a vehicle 41.
  • Fig 4 illustrates a vehicle 41 comprising at least one electronic device 12a, 12b as herein disclosed.
  • the electronic device 12a, 12b maybe provided as an integral part of the vehicle 41. That is, the components of the electronic device 12a, 12b may be integrated with other components of the vehicle 41; some components of the vehicle 41 and the electronic device 12a, 12b maybe shared.
  • the vehicle 41 as such comprises a processing unit, this processing unit maybe arranged to perform the actions of the processing unit 22 associated with the electronic device 12a, 12b.
  • the electronic device 12a, 12b maybe provided as a separate unit in the vehicle 41.
  • the vehicle 41 may be a vehicle for land transportation, such as a car, a truck, a motorcycle, or the like, a vehicle for water
  • Figs 9 and 10 are flow charts illustrating embodiments of methods for determining multimedia codec parameters for a multimedia communications session.
  • the methods are performed by the electronic device 12a, 12b.
  • the methods are advantageously provided as computer programs 32.
  • Fig 3 shows one example of a computer program product 31 comprising computer readable means 33.
  • a computer program 32 can be stored, which computer program 33 can cause the processing unit 22 and thereto operatively coupled entities and devices, such as the storage medium 24 , the communications interface 23, and/ or the multimedia unit 25 to execute methods according to embodiments described herein.
  • the computer program 32 and/ or computer program product 31 may thus provide means for performing any steps as herein disclosed.
  • the computer program product 31 is illustrated as an optical disc, such as a CD (compact disc) or a DVD (digital versatile disc) or a Blu-Ray disc.
  • the computer program product 31 could also be embodied as a memory, such as a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or an electrically erasable programmable read-only memory (EEPROM) and more particularly as a non- volatile storage medium of a device in an external memory such as a USB (Universal Serial Bus) memory.
  • RAM random access memory
  • ROM read-only memory
  • EPROM erasable programmable read-only memory
  • EEPROM electrically erasable programmable read-only memory
  • the computer program 32 is here schematically shown as a track on the depicted optical disk, the computer program 32 can be stored in any way which is suitable for the computer program product 31.
  • the enclosed embodiments relate to an electronic device 12a, 12b (the transmitting electronic device) that is arranged to generate a multimedia stream comprising e.g., audio and video content, such as audio-visual conversational data, and to communicate this multimedia stream over a communications channel to another electronic device 12a, 12b (the receiving electronic device).
  • a multimedia stream comprising e.g., audio and video content, such as audio-visual conversational data
  • the processing unit 22 of the electronic device 12a, 12b is arranged to, in a step S106, acquire a channel quality indicator value representing current throughput characteristics of the communications channel.
  • the acquiring maybe performed by executing functionality of the acquiring unit 22a.
  • the computer program 32 and/or computer program product 31 may thus provide means for this acquiring.
  • the thus acquired channel quality indicator value may be associated with a time stamp indicating the point in time at which the channel quality indicator value was indicated and then stored in the storage medium 24.
  • the processing unit 22 of the electronic device 12a, 12b is further arranged to, in a step S108, compare the channel quality indicator value to a previous channel quality indicator value.
  • the comparing may be performed by executing functionality of the comparing unit 22b.
  • the computer program 32 and/or computer program product 31 may thus provide means for this comparing. This enables the electronic device 12a, 12b to determine whether or not (and if so: how much) any characteristics of the communications channel changes over time.
  • the processing unit 22 of the electronic device 12a, 12b is further arranged to, in a step S112, determine whether to delay adaptation of values of a set of multimedia codec parameters to be used by a multimedia codec during the multimedia communications session or not.
  • the processing unit 22 of the electronic device 12a, 12b is further arranged to, also in step S112, determine which values of the set of multimedia codec parameters to adapt. These two determinations are based on a result of the comparison made in step S108.
  • the determining may be performed by executing functionality of the determining unit 22c.
  • the computer program 32 and/or computer program product 31 may thus provide means for this determining.
  • the electronic device 12a, 12b is thereby arranged to, based on current and previous channel quality indicator values determine if, when, and how multimedia codec parameters to be used by a multimedia codec during the multimedia communications session are to be adapted. This enables adaptive adaptation of the multimedia codec parameters, and hence of the bit budget allocated to the multimedia communications session.
  • the multimedia codec parameters represent parameters associated with the multimedia codec for encoding multimedia of the multimedia communications session. For example, according to an
  • the multimedia codec parameters represent a total bit budget to be used by the multimedia codec for encoding multimedia of the multimedia communications session.
  • the multimedia codec parameters represent a frame rate to be used by the multimedia codec for encoding multimedia of the multimedia
  • the multimedia codec parameters represent a resolution to be used by the multimedia codec for encoding multimedia of the multimedia
  • the multimedia codec parameters are a combination of a total bit budget, a frame rate, and a resolution to be used by the multimedia codec for encoding multimedia of the multimedia communications session.
  • Adapted values of the set of multimedia codec parameters may be provided to the multimedia codec used for encoding multimedia of the multimedia communications session.
  • the channel quality indicator value is based on a bit rate request and/or a measured channel throughput.
  • the bit rate request may be generated and transmitted by the receiving electronic device 12b to the transmitting electronic device 12a.
  • the channel throughput maybe measured and transmitted by the receiving electronic device 12b to the transmitting electronic device 12a.
  • bit rate request is generated as a function of measurements on the received data.
  • measured parameters e.g. arrival time and packet loss
  • some type of hysteresis on the generation of the bit rate request may be needed to give a stable behavior. This means that the bit rate request may not only depend on a measurement made on the last received
  • the channel quality indicator value is a short-term channel indicator.
  • the end-user quality can be improved by considering a larger portion of the past channel variations into account.
  • Such measurements may be regarded as a long-term history of the channel throughput.
  • the previous channel quality indicator value thus is based on a long-term channel indicator value.
  • the channel quality indicator value thus is a short-term channel indicator and the previous channel quality indicator value thus is based on a long-term channel indicator value.
  • the short-term channel indicator values represent data in shorter time spans than the long- term channel indicator values.
  • the long-term channel quality indicator value may be based on a plurality of acquired short-term channel quality indicator values. Further, the long-term channel quality indicator may be associated with more multimedia frames, data packets, received bit rate requests, and/or channel throughput measurements pertaining to the multimedia communications session than the short-term channel quality indicator.
  • the processing unit 22 of the electronic device 12a, 12b is arranged to, in an optional step S102, acquire a long-term channel indicator value representing long-term throughput characteristics of the communications channel; and in an optional step S104 determine the previous channel quality indicator value based on the long- term channel indicator value.
  • the acquiring may be performed by executing functionality of the acquiring unit 22a.
  • the computer program 32 and/or computer program product 31 may thus provide means for this acquiring.
  • the determining may be performed by executing functionality of the determining unit 22c.
  • the computer program 32 and/or computer program product 31 may thus provide means for this determining.
  • the long-term channel quality indicator value may be based on at least one from a group of estimated, predicted, and occurred behaviour of the communications channel.
  • the influence of the short term history may be handled by conventional signal processing means, for example by low pass filtering the measurement data.
  • the long term history could be handled in the same way. Alternatives regarding how to consider the long term history will be provided below.
  • the adaptation is delayed if a large positive channel deviation is determined.
  • the processing unit 22 of the electronic device 12a, 12b maybe arranged to, in an optional step Sii2a, in a case the channel quality indicator value positively deviates more than a predetermined amount from said previous channel quality indicator value, adapt the values based on the channel quality indicator value once the channel quality indicator value has positively deviated more than the predetermined amount from the previous channel quality indicator value during a pre-determined amount of time.
  • the adapting may be performed by executing functionality of the adapting unit 22d.
  • the computer program 32 and/or computer program product 31 may thus provide means for this adapting.
  • the adaptation is delayed if the channel quality is already above a certain limit.
  • the processing unit 22 of the electronic device 12a, 12b maybe arranged to, in an optional step Sii2b, in a case the channel quality indicator value is above a predetermined limit, adapt the values based on the channel quality indicator value once the channel quality indicator value has been above the predetermined limit during a predetermined amount of time.
  • the adapting may be performed by executing functionality of the adapting unit 22d.
  • the computer program 32 and/or computer program product 31 may thus provide means for this adapting.
  • the adaptation is performed directly if a small positive deviation or a negative deviation (small or large) is determined.
  • the processing unit 22 of the electronic device 12a, 12b may be arranged to, in an optional step Sii2c, in a case a positive deviation of the channel quality indicator value is within the predetermined amount or in a case the channel quality indicator value is lower than the previous channel quality indicator value, directly adapt values of the set of multimedia codec parameters based on the channel quality indicator value.
  • the adapting may be performed by executing functionality of the adapting unit 22d.
  • the computer program 32 and/or computer program product 31 may thus provide means for this adapting.
  • the processing unit 22 of the electronic device 12a, 12b maybe l6 arranged to, in an optional step Sii2d, in a case the channel quality indicator value negatively deviates more than the predetermined amount from the previous channel quality indicator value, adapt values of the set of
  • This adaptation may include, but is not limited to, lowering a frame rate and keeping a resolution of the multimedia codec. An example of this will be provided below.
  • the adapting may be performed by executing functionality of the adapting unit 22d.
  • the computer program 32 and/or computer program product 31 may thus provide means for this adapting.
  • the processing unit 22 of the electronic device 12a, 12b maybe arranged to, in an optional step Sii2e, in a case the channel quality indicator value negatively still deviates more than the predetermined amount from the previous channel quality indicator value after the pre-determined amount of time, adapt values of the set of multimedia codec parameters.
  • This adaptation may include, but is not limited to, increasing the lowered frame rate and lowering the resolution of the multimedia codec. An example of this will be provided below.
  • the adapting may be performed by executing functionality of the adapting unit 22d.
  • the computer program 32 and/or computer program product 31 may thus provide means for this adapting.
  • the values of the set of multimedia codec parameters may be adapted less than indicated by the channel indicator value.
  • the determination of if, when, and how multimedia codec parameters to be used by a multimedia codec during the multimedia communications session are to be adapted may be based on further parameters.
  • the processing unit 22 of the electronic device 12a, 12b is arranged to, in an optional step Siioa, acquire multimedia content information.
  • the multimedia content information is acquired from the multimedia unit 25.
  • the multimedia content information may relate to movement of an object between video coding frames generated by the multimedia unit during the multimedia communications session. Such movement of an object between video coding frames maybe obtained from motion vector parameters.
  • the multimedia content information may relate to speech activity in an audio segment recorded by the multimedia unit during the multimedia communications session. Such speech activity in an audio segment maybe obtained from voice activity detection (VAD) flags.
  • VAD voice activity detection
  • the processing unit 22 of the electronic device 12a, 12b is then arranged to, in an optional step Sii2f, adapt the values of the set of multimedia codec parameters based also on the acquired multimedia content information.
  • the adapting may be performed by executing functionality of the adapting unit 22d.
  • the computer program 32 and/or computer program product 31 may thus provide means for this adapting.
  • the processing unit 22 of the electronic device 12a, 12b is arranged to, in an optional step Snob, acquire at least one rendering parameter of the multimedia communications session.
  • the multimedia content information is acquired from the receiving electronic device 12b rendering the received multimedia stream during the multimedia communications session.
  • the processing unit 22 of the electronic device 12a, 12b is then arranged to, in an optional step Sii2g, adapt the values of the set of multimedia codec parameters based also on the acquired at least one rendering parameter.
  • the adapting may be performed by executing functionality of the adapting unit 22d.
  • the computer program 32 and/or computer program product 31 may thus provide means for this adapting.
  • Fig 5 schematically illustrates a video parameter mapper 51 according to an embodiment.
  • the video parameter mapper 51 may be implemented in hardware, or software, or any combination thereof. Hence, the functionality of the video parameter mapper 51 may be stored in the storage medium 24 or l8 be part of the computer program 33 and be performed by the processing unit 22 implementing functional modules 22a, 22b, 22c, and 22c.
  • the video parameter mapper 51 comprises inputs 52 and one output 53.
  • the video parameter mapper 51 is arranged to as input receive a channel quality indicator value representing current throughput characteristics of the communications channel, a previous channel quality indicator value, and optionally a long-term channel indicator value, multimedia content information, or at least one rendering parameter of the multimedia communications session.
  • the video parameter mapper 51 is arranged to as output provide control signals relating to if, when, and how to adapt values of a set of multimedia codec parameters to a multimedia codec.
  • the video parameter mapper 51 maybe enabled to receive channel quality indicator values and to combine the channel quality indicator values with a bit rate request, information about rendering as received from the receiving electronic device 12b as well as information from speech and video encoders about activity/movement to create a parameter setting for the multimedia codec.
  • Table 2 shows an example of a mapping from the input parameters to the frame rate and resolution settings of the encoder. As the skilled person understands, these are just examples of multimedia codec parameters and how these can be adapted.
  • Table 2 Example of input parameters and output multimedia codec parameters
  • the multimedia codec is to encode multimedia of the multimedia session at a used bitrate of 250 kb/s, with a frame rate of 25 Hz and a resolution of 320 by 240 pixels.
  • Fig 6 schematically illustrates an exemplary exterior of an electronic device 12a, 12b according to an embodiment.
  • the exterior of the electronic device 12a, 12b comprises a display screen 62 for displaying visual multimedia components, such video content, images, text, graphics, etc.
  • the exterior of the electronic device 12a, 12b comprises a microphone 63 for recording audio.
  • the exterior of the electronic device 12a, 12b comprises a loudspeaker 64 for playing out audio.
  • a first visual multimedia component 65, a second visual multimedia component 66, and a third visual multimedia component 67 are illustrated. As the skilled person understands, these are just examples of visual multimedia components which may be displayed by the display screen 62.
  • a moving object (representing a mouth) is schematically identified at reference numeral 68. It is for illustrative purposes assumed that the first visual multimedia component 65 represents a fullscreen object, that the second visual multimedia component 66 represents a thumbnail object, and that the third visual multimedia component 67 represents a thumbnail object. It is for illustrative purposes assumed that each of the visual multimedia components represent video content of a multimedia stream.
  • Fig 6 h is the height of the display screen
  • 1 is the length of the first visual multimedia component 65
  • L is the width of the display
  • D denotes the diameter of the display 62.
  • the first scenario is based on the understanding that short time glimpses of high quality multimedia rendering during a longer multimedia communications session with medium quality multimedia rendering may actually degrade the total end-user experience, i.e., the end- user experience as a whole when considering the complete multimedia communications session.
  • Fig 9 schematically illustrates a first example of available throughput 91 of the communications channel for the multimedia communications session as a function of time together with the quality 92 of the rendered multimedia content (as a consequence of the multimedia codec using certain multimedia codec values) as a function of time. Also the highest allowable quality of the rendered multimedia content is illustrated at 93.
  • the quality is adapted to increase with the throughput if the throughput increases no more than a maximum channel deviation value. Otherwise the quality is only allowed to be increased after an adaptation delay. Further, the quality is only allowed to be increased by a maximum adaptation range. Further, the quality is only allowed to be increased to the highest allowable quality 93 - regardless of the available throughput.
  • the transmitting electronic device 12a is arranged to perform steps S106, S108 and S112 as outlined above. Further, the
  • transmitting electronic device 12a is arranged to, in the present exemplary first scenario, perform at least steps Sii2a, Sii2b and Sii2c as outlined above.
  • steps Sii2a, Sii2b and Sii2c there are three periods of high throughput; one shorter and two longer. If the bit rate of the multimedia session is adapted accordingly (i.e., to closely follow the throughput behavior also for the high throughput) the end-user's will perceive the medium quality present in the rest of the multimedia session as of low quality. In order to mitigate such a negative impact on the end-user's perception of the quality, the quality is only increased if the throughput is increased for a long period (i.e., to make sure that the peak is not just temporary), as in step Sii2a.
  • the quality is adapted so as to never exceed the highest allowable quality 93.
  • the second scenario is based on the understanding that during short time glimpses of reduced throughput it may, from an end- user perspective be better to lower the frame rate than the resolution.
  • Fig 10 schematically illustrates a second example of available throughput 101 of the communications channel for the multimedia communications session as a function of time together with the quality 102 of the rendered
  • the transmitting electronic device 12a is arranged to perform steps S106, S108 and S112 as outlined above. Further, the
  • transmitting electronic device 12a is arranged to, in the present exemplary second scenario, perform at least steps Sii2c, Sii2d and Sii2e as outlined above.
  • the multimedia codec parameters are adapted so as to lower the bit rate and thus the quality of the multimedia stream.
  • a lowering of the video resolution could be a preferably choice if the throughput limitation would last for a longer period. If the lasting of the throughput dip is short it may however be better from a user perception point of view to keep the (high) resolution during the dip by lowering the frame rate, thus accepting a quality degradation due to uneven playback, Switching between resolutions, especially if this leads to a change in the video display size, may from a user experience point of view, be more annoying than temporarily lowering the frame rate.
  • step Sii2c and step Sii2d the frame rate is lowered, as in step Sii2c and step Sii2d, and during the long dip first the frame rate is lowered, and then the frame rate is increased but the resolution is lowered, as in step Sii2e.
  • the adaptation may involve keeping a high frame rate but lowering the bit rate by changing the quantization or reducing the resolution.
  • the multimedia codec be encoded with both a low frame rate and a low resolution, depending on the content and/ or context of the multimedia communications session.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Artificial Intelligence (AREA)
  • Physics & Mathematics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

L'invention concerne la détermination de paramètres de codec multimédia pour une session de communication multimédia. Une valeur d'indicateur de qualité de canal représentant des caractéristiques de débit courant d'un canal de communication utilisé pour la session de communication multimédia est acquise. La valeur d'indicateur de qualité de canal est comparée à une valeur d'indicateur de qualité de canal précédente du canal de communication. Il est déterminé, sur la base de la comparaison, s'il faut ou non retarder l'adaptation de valeurs d'un ensemble de paramètres de codec multimédia devant être utilisés par un codec multimédia durant la session de communication multimédia, et les valeurs de l'ensemble de paramètres de codec multimédia à adapter.
PCT/SE2013/051032 2013-09-05 2013-09-05 Adaptation de paramètre de codec multimédia adaptatif WO2015034405A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/SE2013/051032 WO2015034405A1 (fr) 2013-09-05 2013-09-05 Adaptation de paramètre de codec multimédia adaptatif

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/SE2013/051032 WO2015034405A1 (fr) 2013-09-05 2013-09-05 Adaptation de paramètre de codec multimédia adaptatif

Publications (1)

Publication Number Publication Date
WO2015034405A1 true WO2015034405A1 (fr) 2015-03-12

Family

ID=49301589

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2013/051032 WO2015034405A1 (fr) 2013-09-05 2013-09-05 Adaptation de paramètre de codec multimédia adaptatif

Country Status (1)

Country Link
WO (1) WO2015034405A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3992743A1 (fr) 2020-11-03 2022-05-04 Volkswagen Aktiengesellschaft Véhicule, appareil pour un véhicule, programme informatique et procédé de traitement d'informations de communication lors d'une session de conduite télécommandée

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070032198A1 (en) * 2003-04-17 2007-02-08 Sharp Kabushiki Kaisha Transmitter, receiver, wireless system, control method, control program, and computer-readable recording medium containing the program
US20070124625A1 (en) * 2005-11-30 2007-05-31 Microsoft Corporation Predicting degradation of a communication channel below a threshold based on data transmission errors
WO2010012066A1 (fr) * 2008-07-28 2010-02-04 Vantrix Corporation Adaptation de débit pour une connexion de capacité variable dans le temps

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070032198A1 (en) * 2003-04-17 2007-02-08 Sharp Kabushiki Kaisha Transmitter, receiver, wireless system, control method, control program, and computer-readable recording medium containing the program
US20070124625A1 (en) * 2005-11-30 2007-05-31 Microsoft Corporation Predicting degradation of a communication channel below a threshold based on data transmission errors
WO2010012066A1 (fr) * 2008-07-28 2010-02-04 Vantrix Corporation Adaptation de débit pour une connexion de capacité variable dans le temps

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3992743A1 (fr) 2020-11-03 2022-05-04 Volkswagen Aktiengesellschaft Véhicule, appareil pour un véhicule, programme informatique et procédé de traitement d'informations de communication lors d'une session de conduite télécommandée
CN114449021A (zh) * 2020-11-03 2022-05-06 大众汽车股份公司 载具、用于载具的装置、计算机程序以及处理在遥控操作式驾驶会话中传送的信息的方法
US11814071B2 (en) 2020-11-03 2023-11-14 Volkswagen Aktiegensellschaft Vehicle, apparatus for a vehicle, computer program, and method for processing information for communication in a tele-operated driving session

Similar Documents

Publication Publication Date Title
EP3382992B1 (fr) Diffusion en continu http adaptative optimisée de couches croisées
CN108370378B (zh) 对音频流进行编码的方法、系统和计算机可读存储介质
EP2904757B1 (fr) Limitation d'un flux multimédia pour la transmission par un réseau d'accès radio
US10116715B2 (en) Adapting encoded bandwidth
CN107211116B (zh) 用于无线装置中的多视图视频的系统和方法
WO2008110930A2 (fr) Procédé de transmission de données dans un système de communication
EP3304844B1 (fr) Procédés, dispositif de communication radio et dispositif de station de base pour gérer un flux multimédia
US9729287B2 (en) Codec with variable packet size
US9800625B2 (en) Video calling method and device based on voice over long-term evolution and video over long-term evolution, and mobile terminal
US8830853B2 (en) Signal processing
US10855737B2 (en) Control of media transcoding during a media session
US20160277467A1 (en) Adapting Encoded Bandwidth
EP2779565B1 (fr) Procédé et dispositif basés sur un service de diffusion de données multimédias en continu, pour améliorer le débit d'une cellule
WO2015034405A1 (fr) Adaptation de paramètre de codec multimédia adaptatif
US10313276B2 (en) Managing a jitter buffer size
US9584759B2 (en) Determination of bit rate request
US8791981B2 (en) Bit rate control apparatus and method thereof
CN102164124A (zh) 多媒体分配方法和系统以及终端
WO2016149227A1 (fr) Procédé, appareil et produit de programme informatique permettant d'adapter de manière dynamique la largeur de bande en fonction des états de canal et de la contrainte de la largeur de bande
CN113555025B (zh) 一种静音描述帧发送、协商方法及装置
WO2014087764A1 (fr) Terminal et système de communication
Ye et al. Backward-shifted coding (bsc) based on scalable video coding for HAS
KR20150027040A (ko) 고속 및 저속 장치의 균형을 맞추기 위한 cpu 사용 제어
WO2014087830A1 (fr) Système et procédé de commande d'acheminement de paquets
WO2016149229A1 (fr) Adaptation d'une largeur de bande encodée

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13771645

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13771645

Country of ref document: EP

Kind code of ref document: A1