WO2011150643A1 - Procédé et dispositif d'adaptation en ligne d'un contenu multimédia - Google Patents

Procédé et dispositif d'adaptation en ligne d'un contenu multimédia Download PDF

Info

Publication number
WO2011150643A1
WO2011150643A1 PCT/CN2010/079913 CN2010079913W WO2011150643A1 WO 2011150643 A1 WO2011150643 A1 WO 2011150643A1 CN 2010079913 W CN2010079913 W CN 2010079913W WO 2011150643 A1 WO2011150643 A1 WO 2011150643A1
Authority
WO
WIPO (PCT)
Prior art keywords
media content
user
predicted
cache
transcoding
Prior art date
Application number
PCT/CN2010/079913
Other languages
English (en)
Chinese (zh)
Inventor
张鹏
赵华
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201080004692.7A priority Critical patent/CN102217278B/zh
Priority to PCT/CN2010/079913 priority patent/WO2011150643A1/fr
Publication of WO2011150643A1 publication Critical patent/WO2011150643A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/2866—Architectures; Arrangements
    • H04L67/30—Profiles
    • H04L67/306—User profiles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/38—Flow control; Congestion control by adapting coding or compression rate

Definitions

  • the present invention relates to the field of streaming media technologies, and in particular, to a method and device for online adaptation of media content.
  • streaming media refers to the media format that is played on the Internet and the intranet by means of streaming.
  • the user can provide an online playing service, and the client can watch the online after the multimedia file is completely downloaded, which brings great convenience to the user.
  • a disadvantage of the pre-storage method is that more storage resources are needed to store copies of media content at different bit rates/resolutions, which are costly to store, and have limited adaptability to network bandwidth and changes in terminal devices.
  • the prior art may use a method of generating media content copies of different code rates/resolutions online.
  • the user may be generated by online adaptation on the edge nodes. Quality media content is required to achieve smooth quality changes.
  • this method of online adaptation requires online adaptation of the media content, and the adaptation process is usually triggered after receiving the user request, and after receiving the media content that meets the requirements, the response is returned to the user.
  • the time required for this adaptation process will increase the response delay requested by the user.
  • the requested media content is a slice with a duration of 2 seconds and a rate of 512 kbps.
  • after receiving the user request first query whether there is a cache in the cache. The user requests the appropriate media content. If not, the corresponding media content needs to be requested from the original server, or the media content in the cache is transcoded, and then the response is returned to the user. In any case, there is a delay in the response to the user request. Summary of the invention
  • the embodiment of the invention provides a method and a device for online media content adaptation, which can reduce the response delay caused by the online adaptation process to the user request.
  • An online adaptation method for media content including:
  • the obtained media content is returned to the user.
  • a media content online adaptation device comprising:
  • a prediction unit configured to predict a media content required by the user before the non-first user request arrives
  • an obtaining unit configured to acquire the media content required by the predicted user
  • a response unit configured to: when the user request arrives, return the obtained media content to the user if the media content actually requested by the user is the same as the media content required by the predicted user.
  • the media content required by the user can be predicted before the user requests, and if the prediction is accurate, the response to the user request can be directly returned to the user. Obviously, the response delay of the user request can be greatly reduced as compared to the manner in which the corresponding media content is prepared after receiving the user request.
  • FIG. 1 is a flowchart of a method according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a device according to an embodiment of the present invention
  • 4 is a flowchart of another apparatus according to an embodiment of the present invention
  • FIG. 5 is a schematic diagram of an acquiring unit in an apparatus according to an embodiment of the present invention. detailed description
  • the client in the process of playing the same media file, the client usually needs to send a user request to the media server multiple times, and each time a part of the media file is sent. Among them, a part of the media content requested by the user each time is called a slice of the media file, in other words, the client requests one slice of the media file each time.
  • the client sends a user request, it carries the information such as the bit rate, code rate, or resolution of the requested fragment.
  • the server needs to return the media content of the corresponding bit rate for the user request.
  • the server may first prepare the corresponding media content and then return a response to the user. While returning the response, before the second user request arrives, the media content required by the second user request can be predicted and the predicted media content can be obtained, so that when the second user request arrives,
  • the predicted media content parameters (for convenience of description, the following are all introduced by bit rate), compared with the bit rate of the media content carried in the second user request, if the same, the prediction is accurate, And directly using the predicted media content that has been obtained to return the response information for the second user request.
  • the media content requested by the third user request may be predicted and the predicted media content may be obtained, so that after the third user request arrives,
  • the bit rate of the predicted media content can be compared with the bit rate of the media content carried in the third user request. If the same, the predicted media content that has been obtained is directly used to return a request for the third user. Response information, and so on.
  • the media content required by the user may be predicted before the user requests, and if the prediction is accurate, the user may directly return the request for the request. response.
  • the response delay of the user request can be greatly reduced as compared to the manner in which the corresponding media content is prepared after receiving the user request.
  • the media actually carried in the request may be re-prepared.
  • the content of the content matches the media content, and then returns a response to the user request, while predicting the media content needed in the next user request.
  • the media file and its bit rate are briefly introduced.
  • the client receives the media content for decoding and playing, and the smoothness of the playback is related to the state of the client (including bandwidth, hardware and software configuration, network link status, etc.) and the bit rate used when transmitting the media content. .
  • the state of the client if the state of the client is different, the fluency of the media files played on the client is different.
  • the ability of different client states to receive the bit rate is different under the premise of ensuring smooth play. When the actual bit rate exceeds the maximum bit rate that the client's current state can withstand, the client may not play smoothly.
  • bit rate is not as small as possible, because the bit rate reduction is usually at the cost of reducing the amount of information transmitted per unit time, which means for the client, the clarity, resolution or audio of the video.
  • the quality of the playback is declining. It can be seen that if the user selects a suitable bit rate according to the specific conditions of the client and comprehensively considers the smoothness and clarity of the playback, a higher quality playback effect can be obtained for the client.
  • the media content required by the user in the next user request may be predicted according to the current network bandwidth condition and/or the virtual buffer status of the user player.
  • the network bandwidth condition and/or the virtual buffer status of the user player and the bit rate of the media content may be established according to experience or other means. For specific prediction, you can first obtain the current network bandwidth condition and/or the virtual buffer status of the user player, and then according to the advance The established correspondence acquires the bit rate of the corresponding media content, and uses it as the predicted bit rate of the media content required by the user.
  • the current network bandwidth condition and the virtual buffer status of the user player may be reported to the server by the client, or may be obtained through a separate mechanism to obtain the current network bandwidth condition and the virtuality of the user player. Buffer status information.
  • the above method for predicting the media content required by the user is not unique. In practical applications, other methods can also be used for prediction. For example, the prediction may be performed according to the current media content of the user and the previously requested media content, that is, the rule of the media content required by the user is obtained from the historical user request, and the media content required by the user in the next user request is predicted by using the rule. .
  • the server may first query the cache of the server. If the user has previously requested the part of the media content, and has not been deleted or has not been replaced by other content, the server caches. This part of the media content is already stored. At this time, it is equivalent to the media content that meets the requirements in the cache. After receiving the user request, if the predicted result is the same as the bit rate of the media content requested by the user, the media content is directly taken out from the cache as a response of the user. Return to the user.
  • the method may be used to obtain the prediction by using the method requested by the upper server or by transcoding the media content existing in the cache.
  • the method of requesting the upper-level server is equivalent to making a request to the original server where the media content is located, and the original server stores multiple copies of the same media content, and each copy has the same content but different bits. Rate; When it is predicted that a fragment with a certain bit rate is needed, the fragment of the bit rate can be requested from the original server, and the original server will return the corresponding fragment.
  • the method of transcoding the media content existing in the cache is equivalent to when the fragment that needs to have a certain bit rate is predicted, the fragment of the bit rate does not exist in the cache, but the other bit rate is used. Fragmentation, at this time, other bit rates can be converted to the required bit rate by transcoding to obtain the desired media content.
  • the number of shards and the size of the shards for the same media file It is usually predetermined by the server, and each slice has its own slice identifier.
  • the sharding mode between the individual splicings is the same, and the sharding identities of the shards are also corresponding.
  • a media file has three copies: copy A, copy B, copy C, each of which has M shards, and the shard identifiers for each shard in each copy are 1, 2, 3... ... M, then the content of the same slice in the three copies is the same, that is, when the client plays the slice of the same slice in the three copies (assuming smooth Under the premise of playing), the content that the user sees is the same, but the definition will be different.
  • the client When sending a user request, the client carries the fragmentation identifier of the fragment in addition to the bit rate of the fragment; and the fragments of the media file are sequentially arranged, so, for predicting the media required by the next user request In terms of content, only the required bit rate needs to be predicted. For the fragmentation identifier, only the next fragmentation needs to be taken on the basis of the fragmentation identifier in the current user request.
  • the slice identifier requested by the next user should be 3; and the next user is predicted.
  • the bit rate of the requested fragment is 512 kbps
  • the server can find the fragment with the bit rate of 512 kbps in the fragment with the fragment identifier of 3 in the cache. If it does not exist, it can request the branch from the upper server.
  • the slice is identified as a slice with a bit rate of 512 kbps, or a slice of another bit rate existing in the buffer is identified as a slice of 3, and is converted into a slice having a bit rate of 512 kbps.
  • the media content that is predicted by the user may be obtained by using any of the foregoing methods.
  • whether the same content already exists in the cache may be used. However, factors such as fragmentation of different bit rates, transcoding delay, request delay of the upper server request, transcoding load, user level, etc., determine whether to use the request of the upper server or use the cache.
  • the existing media content is transcoded to obtain the predicted media content required by the user.
  • the user's level is transcoded, and the high bit rate media content existing in the cache is transcoded into the predicted content.
  • the transcoding delay of the media content required by the user is less than the delay of the request from the upper server, the media content that is predicted by the user is obtained by transcoding the media content existing in the cache; otherwise, the superior is used.
  • the way the server requests the predicted media content required by the user.
  • the fragmentation identifier of the next fragment of the currently requested fragment is 3, and the bit rate of the media content required by the next user request is predicted according to the network bandwidth condition and the virtual buffer status of the user player.
  • the steps to obtain the predicted media content required by the user can be as shown in Figure 2:
  • step S201 determining whether there is a fragmentation identifier in the cache, and a media content having a bit rate of 512 kbps exists, if yes, ending the acquisition process; otherwise, proceeding to step S202;
  • bit rate is usually at the expense of reducing the amount of information transmitted per unit time, that is, low bit rate media content is transmitted per unit time relative to high bit rate media content.
  • the amount of information will be relatively small. Therefore, for the fragmentation of the same content, it is relatively easy to convert from a high bit rate to a low bit rate, as long as some information is deleted from the high bit rate media content; otherwise, if it is from Converting a low bit rate to a high bit rate may mean that operations such as restoration of information are required, which is relatively complicated.
  • the conversion from the high bit rate to the low bit rate only when there is media content higher than the predicted bit rate in the cache, that is, the buffer is cached.
  • the media content of other bit rate existing in the conversion manner is obtained, and the predicted media content required by the user is obtained. Otherwise, the predicted media content required by the user is obtained in a manner requested from the upper server.
  • step S203 determining whether the user's level can be transcoded, if yes, proceeding to step S204, no, and proceeding to step S208;
  • S204 Calculate a transcoding delay required for transcoding from a high bit rate to a 512 kbps slice according to an average transcoding delay and a current transcoding load condition;
  • the current transcoding load refers to the transcoding load of the transcoder. Since the server may provide streaming media services to multiple users at the same time, the transcoder may perform multiple transcoding processes at the same time. When the transcoding load is high, The time it takes to complete a new transcoding task will be longer.
  • step S205 determining whether the transcoding delay is less than the delay required by the upper server request, if not, proceeding to step S206, otherwise proceeding to step S208;
  • S206 Submit a transcoding task to the transcoder; For example, if the bit rate of the high bit rate media content existing in the cache is lmbps, the transcoding task submitted to the transcoder is: the slice is identified as 3, the media content of the bit rate is lmbps, and the bit rate is transcoded. Media content of 512kbps.
  • the transcoder writes the transcoded media content to a cache of the server
  • the upper server requests the media content whose slice identifier is 3 and the bit rate is 512 kbps.
  • the above method of selecting media content is not unique, and the system can be used in practical applications. For example, first, it is checked whether the predicted media content has been stored in the cache. If there is no storage, the upper-level server is queried whether the media content is stored, and if it is already stored, it is obtained from the upper-level server; if the predicted media content is not in the upper-level server, For storage, the query caches whether there is suitable media content for transcoding, and whether the transcoder has the ability to perform transcoding, and if the conditions are met, the transcoding is performed.
  • the cache management system may determine whether to store the transcoded media content or the media content obtained from the superior content server in the cache according to a certain cache management policy.
  • the specific cache management strategy is not the focus of the present invention, and therefore will not be described again.
  • a media content online adaptation device see FIG. 3, the device comprises:
  • the predicting unit 301 is configured to predict a media content required by the user before the non-first user request arrives;
  • the obtaining unit 302 is configured to obtain the predicted media content required by the user
  • the response unit 303 is configured to: when the user request arrives, return the obtained media content to the user if the media content actually requested by the user is the same as the media content required by the predicted user.
  • the prediction unit 301 is specifically configured to: predict the media content required by the user according to the network bandwidth condition and/or the virtual buffer status of the user player.
  • the obtaining unit 302 may include:
  • the query subunit 3021 is configured to query, from the cache, the media content that matches the predicted media content required by the user.
  • the requesting sub-unit 3022 is configured to: when the media content that matches the media content required by the predicted user does not exist in the cache, obtain the media content required by the predicted user by using a manner requested by the upper server;
  • the transcoding sub-unit 3023 is configured to: when the media content that matches the media content required by the predicted user does not exist in the cache, use the method of transcoding the media content existing in the cache to obtain the predicted The user needs the media content.
  • the obtaining unit 302 may further include:
  • the selecting subunit 3024 is configured to determine, according to whether the same content in the cache but the different bit rate, the fragmentation delay, the request delay requested by the upper server, the transcoding load condition, and/or the user level, determine the acquisition of the prediction. The way the user needs the media content.
  • the selection subunit 3024 can include:
  • the first determining sub-unit 30241 is configured to determine whether there is media content in the cache that is higher than a bit rate of the media content required by the predicted user; if not, the method may be used to obtain the predicted content in a manner requested by the upper server. Media content required by the user;
  • a second determining sub-unit 30242 configured to determine, if the determination result of the first determining sub-unit is yes, whether the level of the user can be transcoded; if not, the method can be used to obtain the predicted result by using the request of the upper-level server Media content required by the user;
  • a third determining sub-unit 30243 configured to: if the determination result of the second determining sub-unit is yes, determine that the high-bit rate media content existing in the cache is transcoded into the predicted media required by the user Whether the transcoding delay of the content is less than the delay of the request from the upper server; if not less than, the media content required by the predicted user may be obtained by using the request of the upper server;
  • the transcoding determination sub-unit 30244 is configured to: if the determination result of the third determining sub-unit is YES, obtain the predicted user by using the media content that is stored in the cache to be transcoded The media content needed.
  • the media content required by the user can be predicted before the non-first-time user request arrives, and if the prediction is accurate, the response to the user request can be directly returned to the user. Obviously, the response delay of the user request can be greatly reduced as compared to the manner in which the corresponding media content is prepared after receiving the user request.
  • the method includes the following steps: predicting media content required by the user before the non-first user request arrives; obtaining the predicted media content required by the user; and when the user request arrives, if the user actually requests the media content and the location If the predicted media content required by the user is the same, the obtained media content is returned to the user.
  • the storage medium is as follows:

Abstract

Un procédé et un dispositif d'adaptation en ligne d'un contenu multimédia, le procédé consistant à: prévoir le contenu multimédia demandé par un utilisateur avant de recevoir la demande d'un non-premier utilisateur; obtenir le contenu multimédia prévu; renvoyer le contenu multimédia obtenu à l'utilisateur lors de la réception de la demande de l'utilisateur si le contenu multimédia demandé couramment par l'utilisateur et le contenu multimédia prévu correspondent. Grâce à cette invention, on peut réduire le délai de réponse à une demande traitée par adaptation en ligne effectuée par un utilisateur.
PCT/CN2010/079913 2010-12-17 2010-12-17 Procédé et dispositif d'adaptation en ligne d'un contenu multimédia WO2011150643A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201080004692.7A CN102217278B (zh) 2010-12-17 2010-12-17 一种媒体内容在线适配方法及装置
PCT/CN2010/079913 WO2011150643A1 (fr) 2010-12-17 2010-12-17 Procédé et dispositif d'adaptation en ligne d'un contenu multimédia

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2010/079913 WO2011150643A1 (fr) 2010-12-17 2010-12-17 Procédé et dispositif d'adaptation en ligne d'un contenu multimédia

Publications (1)

Publication Number Publication Date
WO2011150643A1 true WO2011150643A1 (fr) 2011-12-08

Family

ID=44746756

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2010/079913 WO2011150643A1 (fr) 2010-12-17 2010-12-17 Procédé et dispositif d'adaptation en ligne d'un contenu multimédia

Country Status (2)

Country Link
CN (1) CN102217278B (fr)
WO (1) WO2011150643A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013078597A1 (fr) * 2011-11-28 2013-06-06 华为技术有限公司 Procédé, dispositif et système de détermination d'une demande d'un utilisateur
CN110213616B (zh) * 2018-05-15 2021-12-28 腾讯科技（深圳）有限公司 视频提供方法、获取方法、装置及设备
CN111526379B (zh) * 2019-02-03 2021-06-29 华为技术有限公司 数据传输方法和数据传输装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6016520A (en) * 1995-07-14 2000-01-18 Microsoft Corporation Method of viewing at a client viewing station a multiple media title stored at a server and containing a plurality of topics utilizing anticipatory caching
CN1655547A (zh) * 2004-09-09 2005-08-17 上海川海信息科技有限公司 一种流媒体传输系统中的速率控制方法
CN101075957A (zh) * 2007-06-26 2007-11-21 上海大学 Avs流媒体传输控制方法
CN101075952A (zh) * 2006-05-16 2007-11-21 卡乐迷迪有限公司 一种流媒体在线播放的方法

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8078695B2 (en) * 2008-07-16 2011-12-13 Sony Corporation Media on demand using an intermediary device to output media from a remote computing device
CN101656869A (zh) * 2008-08-21 2010-02-24 华为技术有限公司 频道切换方法、装置及系统
CN101848205A (zh) * 2010-03-16 2010-09-29 深圳市同洲电子股份有限公司 一种基于rtsp的移动终端播放流媒体的方法及系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6016520A (en) * 1995-07-14 2000-01-18 Microsoft Corporation Method of viewing at a client viewing station a multiple media title stored at a server and containing a plurality of topics utilizing anticipatory caching
CN1655547A (zh) * 2004-09-09 2005-08-17 上海川海信息科技有限公司 一种流媒体传输系统中的速率控制方法
CN101075952A (zh) * 2006-05-16 2007-11-21 卡乐迷迪有限公司 一种流媒体在线播放的方法
CN101075957A (zh) * 2007-06-26 2007-11-21 上海大学 Avs流媒体传输控制方法

Also Published As

Publication number Publication date
CN102217278B (zh) 2014-07-16
CN102217278A (zh) 2011-10-12

Similar Documents

Publication Publication Date Title
US9247276B2 (en) System and method for progressive delivery of media content
JP7275033B2 (ja) 適応ビットレートストリーミングの間の複数のコンテンツ配信ネットワーク間の適応切替のためのシステムおよび方法
US10142405B2 (en) Multi-CDN digital content streaming
CN101203827B (zh) 用于媒体流的流量控制
US9015779B2 (en) Streaming video server with segment length control and methods for use therewith
US8850054B2 (en) Hypertext transfer protocol live streaming
US20190082199A1 (en) Distributed multi-datacenter video packaging system
WO2011150794A1 (fr) Procédé, système et client pour service de diffusion de contenu multimédia en flux continu
US20040003101A1 (en) Caching control for streaming media
WO2010088490A1 (fr) Programmateur de réseau de transport sensible à l'application, à l'utilisation et à la liaison radio
JP2006506738A (ja) トランスコード可能なキャッシングプロキシおよびその方法
KR20150083793A (ko) 클라이언트 단말기에서, 멀티미디어 컨텐츠의 세그먼트의 다가오는 시퀀스를 다운로딩하는 방법, 및 대응하는 단말기
GB2477642A (en) Selection of a streaming server which stores the required content in the highest (fastest access) hierarchical storage layer.
WO2011054319A1 (fr) Procédé, dispositif et système permettant de réaliser une demande hiérarchique de contenu dans un système de diffusion http
JP2021522718A (ja) ライブブロードキャスティングに対する適応ビットレート方法
US20200413112A1 (en) Delivering video in a content delivery network
US9665646B1 (en) Method and system for providing bit rate adaptaion to video files having metadata
WO2011144176A1 (fr) Procédé, appareil et système adaptés pour contrôler une livraison de contenu d'un réseau de livraison de contenu
WO2011150643A1 (fr) Procédé et dispositif d'adaptation en ligne d'un contenu multimédia
US9294821B2 (en) Scrubbing noise remover and methods for use therewith
WO2011143916A1 (fr) Procédé et appareil d'adaptation multimédia
KR102304476B1 (ko) 적응적 스트리밍 서비스를 위한 다중 경로 기반 블록 전송 시스템 및 스트리밍 방법
WO2013097184A1 (fr) Procédé, dispositif et système de distribution de services
WO2013071517A1 (fr) Procédé d'envoi de flux multimédia et serveur
KR101888982B1 (ko) 적응형 컨텐츠 제공을 위한 컨텐츠 캐싱 서비스 제공 방법 및 이를 위한 로컬 캐싱 장치

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201080004692.7

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10852438

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10852438

Country of ref document: EP

Kind code of ref document: A1