KR20120029299A - Method for media presentation description of a plurality of content component in http streaming service - Google Patents

Method for media presentation description of a plurality of content component in http streaming service Download PDF

Info

Publication number
KR20120029299A
KR20120029299A KR1020100091866A KR20100091866A KR20120029299A KR 20120029299 A KR20120029299 A KR 20120029299A KR 1020100091866 A KR1020100091866 A KR 1020100091866A KR 20100091866 A KR20100091866 A KR 20100091866A KR 20120029299 A KR20120029299 A KR 20120029299A
Authority
KR
South Korea
Prior art keywords
mpd
composition
media presentation
representation
presentation description
Prior art date
Application number
KR1020100091866A
Other languages
Korean (ko)
Other versions
KR101803965B1 (en
Inventor
유성열
황서영
송재연
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Publication of KR20120029299A publication Critical patent/KR20120029299A/en
Application granted granted Critical
Publication of KR101803965B1 publication Critical patent/KR101803965B1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43Querying
    • G06F16/438Presentation of query results
    • G06F16/4387Presentation of query results by the use of playlists
    • G06F16/4393Multimedia presentations, e.g. slide shows, multimedia albums
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Mathematical Physics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

PURPOSE: A recommendation method about content elements in an HTTP(Hypertext Transfer Protocol) streaming service is provided to continuously reproduce a video by selecting the fragment of representation having high bandwidth. CONSTITUTION: An MPD(Media Presentation Description) from which an MPD analyzer is received is analyzed. The MPD analyzer selects a group according to a network condition, device capability, and user preference. The MPD analyzer confirms composition which consists of service representation and group. The composition supplies information about a network condition, device capability, and user preference.

Description

HTTP 스트리밍 서비스에서 복수 개의 컨텐트 요소에 대한 구성 가능한 조합 추천 방법{METHOD FOR MEDIA PRESENTATION DESCRIPTION OF A PLURALITY OF CONTENT COMPONENT IN HTTP STREAMING SERVICE}METHOOD FOR MEDIA PRESENTATION DESCRIPTION OF A PLURALITY OF CONTENT COMPONENT IN HTTP STREAMING SERVICE}

본 발명은 3GPP AHS(3rd Generation Partnership Project Adaptive HTTP Streaming)를 baseline으로 하는 Adaptive Streaming 기술에 관한 것이다.The present invention relates to an adaptive streaming technology based on 3GPP AHS (3rd Generation Partnership Project Adaptive HTTP Streaming).

3GPP AHS는 동일한 content, content component를 각기 다른 조건(network bandwidth, resolution, codec등)으로 encoding한 representation들과 전체 길이를 여러 등분의 period로 나누고 다시 period를 충분히 짧은 시간(예를 들어, 1초~10초 정도)의 세그먼트로 나누고(세그먼테이션) 각 세그먼트의 파일명, sequence number, 시작시간, 길이 등을 명시하고 있는 MPD(Multimedia Presentation Description; Manifest 파일역할)로 이루어진다.3GPP AHS divides the representation of the same content and content component under different conditions (network bandwidth, resolution, codec, etc.), and divides the total length into several equal periods, and then divides the period into short enough periods (e.g. It is divided into segments (about 10 seconds) (segmentation), and consists of MPD (Multimedia Presentation Description) which specifies the file name, sequence number, start time, and length of each segment.

세그먼트는 해당 representation을 적절히 decode할 수 있도록 decoder configuration을 위한 정보를 갖는 initialisation segment와 segmentation된 content component들을 포함하는 media segment들로 구성된다.The segment consists of an initialisation segment with information for the decoder configuration and media segments containing segmented content components so as to properly decode the representation.

클라이언트는 MPD를 먼저 받고 어떤 representation이 구비되어있는지 확인한 후 클라이언트 장치의 성능, capability, 네트워크 속도 등을 판단해 적합한 representation을 골라 fragment를 순서대로 download 하여 재생을 시작한다.The client first receives the MPD, checks which representation is installed, determines the performance, capability, and network speed of the client device, selects an appropriate representation, downloads fragments in order, and starts playback.

만약 network bandwidth와 같이 변경 가능한 변수들이 변화하면, 즉 네트워크 속도가 높아지면 더 높은 bandwidth로 작성된 representation의 fragment를 골라 재생하며 결과적으로 네트워크의 속도에 따라 화질이 달라지지만 재생은 끊어지지 않고 지속되는 효과를 얻을 수 있다.If the changeable variables such as network bandwidth change, that is, when the network speed increases, the fragments of the representation written in higher bandwidth are selected and played back. As a result, the image quality varies depending on the speed of the network, but the playback does not stop. You can get it.

본 발명이 해결하려는 과제는 HTTP 스트리밍 서비스에서 복수 개의 컨텐트 요소에 대한 구성 가능한 조합 추천 방법을 제공하는 것이다.An object of the present invention is to provide a configurable combination recommendation method for a plurality of content elements in an HTTP streaming service.

본 발명은 HTTP streaming service에서 Media Presentation Description을 제공하는 방법으로, 하나의 MPD에서 기술하는 복수 개의 content component들을 이용하여, 제공 가능한 media presentation(content)의 정보를 제공하는 방법을 제공한다.The present invention provides a method for providing a media presentation description in an HTTP streaming service, and provides a method for providing information of a media presentation (content) that can be provided using a plurality of content components described in one MPD.

본 발명에 따르면 높은 bandwidth로 작성된 representation의 fragment를 골라 재생함으로써 네트워크의 속도에 따라 화질이 달라지지만 재생은 끊어지지 않고 지속되는 효과를 얻을 수 있다.According to the present invention, by selecting and reproducing a fragment of a representation created with a high bandwidth, the image quality may vary depending on the speed of the network, but the reproduction may be effected without interruption.

도 1은 본 발명의 실시예에 따른 HTTP 스트리밍 서비스에서 Media Presentation Description을 제공하는 절차를 도시한 것이다.
도 2는 본 발명의 실시예에 따른 HTTP 스트리밍 서비스에서 Media Presentation Description을 제공하는 절차를 도시한 것이다.
도 3은 본 발명의 실시예에 따른 HTTP 스트리밍 서비스에서 Media Presentation Description을 제공하는 절차를 도시한 것이다.
1 illustrates a procedure for providing a media presentation description in an HTTP streaming service according to an embodiment of the present invention.
2 illustrates a procedure for providing a media presentation description in an HTTP streaming service according to an embodiment of the present invention.
3 illustrates a procedure for providing a media presentation description in an HTTP streaming service according to an embodiment of the present invention.

하기 본 발명에서 설명되는 모든 내용은 각 실시예들 간에 서로 참조될 수 있으며, 각 실시예들의 조합도 가능하다.
All of the contents described in the present invention may be referred to each other among the embodiments, and combinations of the embodiments may be possible.

[Term definition][Term definition]

* AHS: Adaptive Http StreamingAHS: Adaptive Http Streaming

* DASH: Dynamic Adaptive Streaming over HTTP* DASH: Dynamic Adaptive Streaming over HTTP

* 컨텐트: 영화,음악, 뉴스 등의 창작물, 그의 저장 형태* Content: creations such as movies, music and news and their storage forms

* 컨텐트 컴포넌트: 컨텐트를 구성하는 구성 요소 (예를 들어, 비디오, 오디오, 자막, 메타 데이터, auxiliary information stream 등)Content component: the components that make up the content (e.g. video, audio, subtitles, metadata, auxiliary information stream, etc.)

* Representation: 일(1) 표현형태. 낮은 화질, 높은 화질의 representation들이 존재 가능하나 context는 동일
Representation: One (1) representation. Low and high quality representations can exist but the context is the same

본 발명은 HTTP streaming service에서 Media Presentation Description을 제공하는 방법으로, 하나의 MPD에서 기술하는 복수 개의 content component들을 이용하여, 제공 가능한 media presentation(content)의 정보를 제공하는 방법을 설명한다. The present invention describes a method of providing a media presentation description in an HTTP streaming service, and provides a method of providing information of a media presentation (content) that can be provided using a plurality of content components described in one MPD.

제공 가능한 media presentation은 복수 개의 content component들을 이용하여 구성되는 것이므로, 이는 composition(content의 구성 또는 조합)이라 하고, composition들의 list를 제공할 수 있다.  Since the media presentation that can be provided is composed of a plurality of content components, this is called composition (composition or combination of content) and can provide a list of compositions.

composition은; composition 각각은 id 등의 attribute 등을 통하여 identify가능하다. composition is; Each composition can be identified through attributes such as id.

MPD내에서 content component들을 기술하는 representation 및 group을 중 composition하고자 하는 representation 및 group을 참조하는 정보를 포함한다. Includes information referring to the representation and group to be composed of the representation and group describing the content components in the MPD.

composition에서 참조하는 representation 및 group을 보다 상세히 기술하는 다양한 정보가 더 제공될 수 있다. 예를 들어, network condition, user preference, device capability등에 대한 정보가 될 수 있다. compostion에서 참조하는 group에서 설명하는 추가 정보들은 실제 해당 group에 속하는 모든 representation에 공통적으로 적용되는 정보들이다. 또한 특정 representation만을 지목하여 추가정보를 제공하는 방법 또한 가능하다.Various information describing the representation and the group referenced in the composition may be further provided. For example, it can be information about network conditions, user preferences, and device capabilities. The additional information described in the group referred to in the compostion is information that is commonly applied to all representations belonging to the group. It is also possible to provide additional information by specifying only a specific representation.

Network condition은 bandwidth, fluctuation, 지연 등의 정보가 될 수 있으며, 본 발명의 영역에서 통상적으로 사용되는 network condition의 다양한 인자들이 포함될 수 있다.The network condition may be information such as bandwidth, fluctuation, delay, etc., and may include various factors of network conditions commonly used in the scope of the present invention.

user preference는 rating, language, DRM을 비롯한 본 발명의 영역에서 통상적으로 사용되는 user preference의 다양한 인자들이 포함될 수 있다. The user preferences may include various factors of user preferences commonly used in the scope of the present invention, including rating, language, DRM.

Device capability 역시 screen, display의 resolution, width, height, diagonal, 메모리, 처리속도, 입출력 장치 및 방법, DRM 등 본 발명의 영역에서 통상적으로 사용되는 Device capability의 다양한 인자들이 포함될 수 있다.Device capability may also include various factors of device capability commonly used in the scope of the present invention, such as screen, display resolution, width, height, diagonal, memory, processing speed, input / output devices and methods, and DRM.

- <groupInfoRef=1, a1, a2, a3/>-<groupInfoRef = 1, a1, a2, a3 />

- <group id=1, a1, a2, a3/> (a1, a2, a3는 상기에서 설명한 추가 정보들로 구성될 수 있다)
<group id = 1, a1, a2, a3 /> (a1, a2, a3 may be configured with the additional information described above)

이때, composition은 서비스 제공자가 제공가능한 여러 개의 MPD로부터 구성가능한 content component들로 구성될 수도 있고, 여러 개의 MPD로부터 구성 가능한 content component들로부터 composition하는 경우, 하나의 composition을 구성하는 content component들을 포함하는 MPD간의 time line은 동일하도록 설정할 수도 있다. Time line을 공통으로 가질 경우, 각 MPD간의 switching도 가능할 수 있다. In this case, the composition may be composed of content components configurable from a plurality of MPDs that can be provided by the service provider, and in the case of composition from content components configurable from a plurality of MPDs, the MPD includes content components constituting a composition. The time lines can be set to be the same. If the time line is common, switching between each MPD may be possible.

하나의 MPD에서 기술하는 복수 개의 content component들로부터 가능한 다양한 composition을 서술할 수도 있다.
Various compositions possible from multiple content components described in one MPD may be described.

composition은 MPD 내부에 서술될 수도 있고, MPD 외부에 별도의 file로 서술될 수 있다.The composition may be described inside the MPD or may be described as a separate file outside the MPD.

일 실시예로 별도의 file로 서술되는 경우에, composition이 entry 포인트가 되어 서비스될 수 있다.In one embodiment, when described as a separate file, the composition may serve as an entry point.

별도의 file로 서술되는 경우, composition이 별도의 파일로 관리되고 해석될 수도 있고, MPD 내부에서 link 또는 pointing 또는 refer하여 서술할 수도 있다. When described as a separate file, the composition may be managed and interpreted as a separate file, or may be described by linking, pointing, or refering within the MPD.

link 또는 pointing 또는 refer하는 방법으로 다양한 기술로 xpath, xclude 등이 사용될 수 있다. xpath, xclude, etc. can be used in various techniques, such as by linking, pointing, or referencing.

composition이 별도의 파일로 관리되고 해석될 경우, composition은 모든 period들에 공통으로 사용될 수도 있다.If the composition is managed and interpreted as a separate file, the composition may be used in common for all periods.

composition 정보가 수정되거나 update될 경우, version 등의 정보를 이용하여, composition file의 변경을 notice할 수 있다.When the composition information is modified or updated, the change of the composition file may be noticed using information such as a version.

composition이 MPD 내부에 서술되는 경우, MPD는 여러 개의 Period 상위에서 MPD내에 존재하는 Period들에 모두 적용되도록 기술될 수도 있고, Period 각각의 composition들을 기술할 수도 있다. When a composition is described inside an MPD, the MPD may be described to apply to all of the Periods existing in the MPD above several Periods, or may describe compositions of each Period.

composition switching을 할 때, 별도의 file을 다시 읽거나 할 필요가 없다.When you do composition switching, you don't have to reread a separate file.

composition id를 가지고, MPD가 update되거나, Period가 변경될 경우, 내가 수행하던 composition을 찾아서 계속 서비스를 수신할 수 있다. With the composition id, if the MPD is updated or the period is changed, I can find the composition I was running and continue to receive the service.

period가 바뀔 경우, composition의 적용/선택은 다음과 같은 procedure를 통하여 수행하는 것도 가능하다. When the period is changed, application / selection of the composition can be performed through the following procedure.

1. MPD 수신1. MPD reception

2. MPD parser가 MPD 해석2. MPD parser parses MPD

3. MPD parser(client device임)는 network condition, device capability, user preference 등에 따라 서비스/구성 가능한 representation 및 group을 선택한다. 선택되지 않은 representation은 eliminate될 수도 있다. 3. The MPD parser (which is a client device) selects a service / configurable representation and group based on network conditions, device capabilities, user preferences, etc. Unselected representations may be eliminated.

4. MPD parser는 서비스 가능한 representation 및 group으로만 이루어진 composition을 확인한다. 4. The MPD parser identifies compositions that consist only of serviceable representations and groups.

5. composition에서는 network condition, device capability, user preference에 대한 정보를 추가로 더 제공할 수 있으며, 사용자는 해당 정보를 바탕으로 자신이 소비자고자 하는 composition을 선택할 수 있다.5. Compositions can provide additional information about network conditions, device capabilities, and user preferences, and users can select the composition they want to consume based on that information.

6. 선택된 compostion을 구성하는 representation 및 group 정보를 바탕으로 소비되는 content component들의 실제 data가 요청되어, 수신된다. 6. Actual data of content components consumed based on the representation and group information constituting the selected compostion is requested and received.

7. 해당 Period의 available time이 경과하면, 7. When the available time of the period elapses,

8. new Period의 MPD를 수신한다. 8. Receive the MPD of the new period.

9. client device및 사용자의 network condition, device capability, user preference에 별도의 변경이 없을 경우, 이전 Period에서 사용된 composition의 id와 동일한 composition을 찾아 계속 서비스한다. 이때, composition이 갱신될 수 있는 경우, version등의 정보가 동일한 것을 전제로 할 수도 있다. 9. If there is no change in the client device and the user's network condition, device capability, and user preference, find the same composition as the id of the previous period and continue service. In this case, when the composition can be updated, it may be assumed that information such as version is the same.

composition id를 이용하여, Period간에 같은 composition을 제공하는 경우, period가 바뀔 때마다, 처음부터 다시 모든 selection procedure를 다시 함으로써 발생하는 단말의 selection complexity를 줄일 수 있다,
When using the composition id to provide the same composition between periods, it is possible to reduce the selection complexity of the terminal by re-running all selection procedures from the beginning whenever the period changes.

composition을 이용하여 selection을 수행하는 것은, top- to bottom, bottom to top의 두 가지가 가능하며, top to bottom의 경우, Performing a selection using a composition is available in two ways: top-to-bottom and bottom-to-top.

1. composition정보를 먼저 확인하여, 자신이 서비스 가능한 composition을 선택한 다음,1. Check the composition information first, select a composition that can be serviced by itself,

2. 해당 composition을 구성하는 representation 및 group을 확인하여2. Check the representation and group that compose the composition

3. 소비하고자 하는 content component들의 실제 data를 요청한다. 3. Request the actual data of the content components you want to consume.

top to bottom 방식의 경우, composition별로 각각의 MPD를 구성할 수도 있고, 하나의 MPD의 가능한 composition들이 기술될 수도 있고, 여러 MPD들로부터 다양한 composition들이 기술될 수도 있다In the case of the top to bottom method, each MPD may be configured for each composition, possible compositions of one MPD may be described, and various compositions may be described from several MPDs.

bottom to top의 경우,for bottom to top,

1. MPD 내의 representation 및 group에서 자신이 서비스 가능한 content component를 확인한 다음, 1. Identify the content component that can be serviced from the representation and group in the MPD,

2. 서비스 가능한 content component들로만 구성된 composition들 중에서, 소비하고자 하는 composition을 선택하여, 2. From the compositions consisting only of serviceable content components, choose the composition you want to consume,

3. 해당 composition의 content component들의 실제 data를 요청한다.3. Request the actual data of the content components of the composition.

Claims (1)

HTTP 스트리밍 서비스에서 MPD(Media Presentation Description)을 제공하는 방법에 있어서,
하나의 MPD에서 기술하는 복수 개의 컨텐트 요소들을 이용하여, 제공 가능한 media presentation의 정보를 제공하는 방법.
In the method for providing a media presentation description (MPD) in the HTTP streaming service,
A method for providing information of a media presentation that can be provided using a plurality of content elements described in one MPD.
KR1020100091866A 2010-09-16 2010-09-17 Method and apparatus for http streaming service KR101803965B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR20100091303 2010-09-16
KR1020100091303 2010-09-16

Publications (2)

Publication Number Publication Date
KR20120029299A true KR20120029299A (en) 2012-03-26
KR101803965B1 KR101803965B1 (en) 2017-12-01

Family

ID=46133827

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020100091866A KR101803965B1 (en) 2010-09-16 2010-09-17 Method and apparatus for http streaming service

Country Status (1)

Country Link
KR (1) KR101803965B1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021174219A1 (en) * 2020-02-28 2021-09-02 Hulu, LLC Identification of elements in a group for dynamic element replacement
US11765421B2 (en) 2020-02-28 2023-09-19 Hulu, LLC Client based storage of remote element resolutions

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021174219A1 (en) * 2020-02-28 2021-09-02 Hulu, LLC Identification of elements in a group for dynamic element replacement
US11647252B2 (en) 2020-02-28 2023-05-09 Hulu, LLC Identification of elements in a group for dynamic element replacement
US11765421B2 (en) 2020-02-28 2023-09-19 Hulu, LLC Client based storage of remote element resolutions

Also Published As

Publication number Publication date
KR101803965B1 (en) 2017-12-01

Similar Documents

Publication Publication Date Title
US11785289B2 (en) Receiving device, transmitting device, and data processing method
US9871844B2 (en) Method and apparatus for transmitting and receiving adaptive streaming mechanism-based content
US8719442B2 (en) System and method for providing and transmitting condensed streaming content
US7743161B2 (en) Digital content buffer for adaptive streaming
US10149020B2 (en) Method for playing a media stream in a browser application
KR102009124B1 (en) Establishing a streaming presentation of an event
CN103141115B (en) For the client of media stream, content creator entity and method thereof
US10904642B2 (en) Methods and apparatus for updating media presentation data
JP5709900B2 (en) Method and apparatus for supporting content playout
US20140317306A1 (en) Fragment Interface Into Dynamic Adaptive Streaming Over Hypertext Transfer Protocol Presentations
CN108933764B (en) Method and device for realizing quick broadcast starting
EP2873249A1 (en) Method and apparatus for interacting with a media presentation description that describes a summary media presentation and an original media presentation
EP3352469A1 (en) Transmission device, reception device, and data processing method
KR100927731B1 (en) Package metadata and targeting and synchronization service provision system using it
KR20120029299A (en) Method for media presentation description of a plurality of content component in http streaming service
US20230336842A1 (en) Information processing apparatus, information processing method, and program for presenting reproduced video including service object and adding additional image indicating the service object
JP2016072858A (en) Media data generation method, media data reproduction method, media data generation device, media data reproduction device, computer readable recording medium and program
KR101695032B1 (en) A plurality of contents splicing method in hyper text transfer protocol apative sreaming service
Molnar et al. Educational content delivery: An experimental study assessing student preference for multimedia content when monetary cost is involved
Cruz et al. A personalized HTTP adaptive streaming WebTV
KR101744974B1 (en) Method and apparatus for representing common attribute for a plurality of content elements in hypertext transfer protocol streaming service
EP3352463A1 (en) Transmission device, reception device, and data processing method
CN113364728B (en) Media content receiving method, device, storage medium and computer equipment
KR101773186B1 (en) Method for providing and playing subset for http streaming service
Babu et al. Real Time Implementation on Media Presentation Description for MPEG-DASH

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E90F Notification of reason for final refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant