CN103222277B - The method and apparatus of self adaptation streaming based on the multiple elements for determining content quality - Google Patents

Abstract

Providing a kind of method and apparatus performing adaptive streaming according to stream environment for information based on the multiple elements about the quality for determining multiple media data, the plurality of media data is about same content.

Description

The method and apparatus of self adaptation streaming based on the multiple elements for determining content quality

Technical field

The method and apparatus consistent with one exemplary embodiment relates to carrying out self adaptation according to the fluctuation in stream environment Ground streaming media data.

Background technology

The example of the method sending media data by network includes method for down loading and stream method.In stream side In method, server sends media data in real time, and client reproduces received media number in real time According to.

It is different from the download side just starting to reproduce media data after sending and receiving all media datas Method, stream method comprise by between server and client side arrange logic channel send in real time and connect Receive media data and reproduce this media data so that require a kind of method and apparatus, come by processing stream ring Fluctuation in border and keep reproducing the service quality (QoS) that media data reproduces.

Summary of the invention

Solution

One or more embodiments can provide a kind of for being adaptively adjusted according to stream environment and hold The method and apparatus of row streaming (i.e. the transmission of media data and reception).

One or more embodiments can also provide a kind of computer readable recording medium storing program for performing, is recorded on For performing the program of the method.

Beneficial effect

According to embodiment described here, by using existing agreement not change server and/or client The configuration of end, can carry out adaptive streaming according to stream environment, whereby can with low cost formed with The adaptive streaming system that various types of media formats are compatible.

Accompanying drawing explanation

Describing one exemplary embodiment in detail by referring to accompanying drawing, above-mentioned and/or other aspects will become more clear Chu, wherein:

Fig. 1 is the figure of the streaming system according to one exemplary embodiment；

Fig. 2 A and 2B is the flow chart for describing the stream method according to one exemplary embodiment；

Fig. 3 is the figure of the file comprising the information about content according to an one exemplary embodiment；

Fig. 4 A shows the information for defining multiple media data according to an one exemplary embodiment；

Fig. 4 B shows the information of the head about media data according to an one exemplary embodiment；

Fig. 4 C illustrate according to an one exemplary embodiment about multiple media datas each include to The information of a few fragment；

Fig. 5 A and 5B is the flow chart for describing the stream method according to other one exemplary embodiment；

Fig. 6 is the figure of the file comprising the information about content according to another one exemplary embodiment；

Fig. 7 illustrates the information about content according to an one exemplary embodiment；

Fig. 8 A and 8B is the figure of the media presentation description according to one exemplary embodiment；

Fig. 9 A to 9H illustrates the media presentation description according to one exemplary embodiment；

Figure 10 A to 10C is each illustrates the multiple media datas according to one exemplary embodiment；

Figure 11 A and 11B is the flow chart for describing the stream method according to other one exemplary embodiment；

Figure 12 A to 12C is each illustrates the multiple media datas according to other one exemplary embodiment；

Figure 13 A to 13G illustrates the media presentation description according to other one exemplary embodiment；

Figure 14 A to 14D illustrates the media presentation description according to other one exemplary embodiment；

Figure 15 is the figure of the media presentation description according to another one exemplary embodiment；

Figure 16 is the figure of the media data dispensing device of the server according to one exemplary embodiment；And

Figure 17 is the figure of the media data reception apparatus of the client according to an one exemplary embodiment. Preferred embodiment of the present invention

One side according to one exemplary embodiment, it is provided that a kind of method of receiving media data, the method Including: receiving file from server, wherein this document comprises about passing through with different quality predetermined content The information of the multiple media datas encoded and produce；And based on this document, receive the plurality of media number According at least one central media data, wherein said file includes each of the plurality of media data Frame per second.

Described file can include multiple first label, each including about the plurality of media data At least one of title, type, resolution and bit rate, and the plurality of first label each in Each frame per second of the plurality of media data can be included.

Described file can include about the letter for determining the order of priority in the middle of multiple elements of quality Breath, and should may be embodied in as described many about the information of the order of priority in the middle of the plurality of element In second label of the higher label of individual first label.

The plurality of element can include resolution, bit rate and frame per second.

The described information about the order of priority in the middle of multiple elements can include being respectively allocated to described many Individual element the symbol (sign) according to prioritizing.

The described information about the order of priority in the middle of multiple elements can include about the plurality of element In the middle of there is the information of an element of high-precedence.

The operation receiving at least one media data described can include working as based on about the plurality of element In the information of order of priority, select and receive at least one media data of the plurality of media data Operation.

Described second label can define the reproduction period of described content.

The plurality of media data each can include by research content to have predetermined quality And at least one of the content after coding and multiple fragments of producing is divided according to the time period.

Another aspect according to one exemplary embodiment, it is provided that a kind of method sending media data, the party Method includes the operation sending file to client, and wherein this document comprises about passing through with different quality in advance The information of the multiple media datas determining research content and produce；And according to from client based on being sent out Send the request of file, send the behaviour of at least one media data of the plurality of media data to client Making, wherein said file includes each frame per second of the plurality of media data.

Another aspect according to one exemplary embodiment, it is provided that a kind of media data reception apparatus, this device Including information receiving unit, for receiving file from server, wherein this document comprise about by with The information of multiple media datas that predetermined content coding is produced by different quality；And media data reception list Unit, at least one media data based on the plurality of media data of described file reception, Qi Zhongsuo State file and include each frame per second of the plurality of media data.

Another aspect according to one exemplary embodiment, it is provided that a kind of media data dispensing device, including: Information transmitting unit, for sending file to client, wherein this document is containing about by with different quality The information of multiple media datas that predetermined content coding is produced；And media data transmitting element, according to From the request based on sent file of client, send the plurality of media data extremely to client A few media data, wherein said file includes each frame per second of the plurality of media data.

Another aspect according to one exemplary embodiment, it is provided that a kind of computer readable recording medium storing program for performing, at it On have recorded and send or the program of method of receiving media data for performing.

Embodiments of the present invention

Hereinafter, one exemplary embodiment is more fully described with reference to the accompanying drawings, similar throughout accompanying drawing Reference number refers to similar element.Hereinafter, when the expression position of such as " ... at least one " Time after a column element, being permutation element rather than modify the individual element in these row of modification.

Fig. 1 is the figure of the streaming system 100 according to one exemplary embodiment.

With reference to Fig. 1, streaming system 100 includes encoding device 110, server 120 and client 130.

Encoding device 110 produces by encoding input content to have multiple different quality and one Multiple media datas that individual input content is corresponding.Server 120 is to client 130 streaming media data The stream environment at place can change.Such as, the bandwidth for the network 140 of streaming can change, or It is permissible for the hardware source of receiving media data that person's server 120 is used for sending media data or client Change.

Therefore, encoding device 110 encodes have different quality to enable basis to a content Fluctuation stream environment and carry out adaptive streaming.One content can be entered by adjusting a factor Row coding is to have different quality, and such as bit rate, sample frequency, resolution, frame per second etc. are extremely Few one.Such as, by with different resolution one picture material coding can be produced 500Kbps, Multiple media datas of 1000Kbps and 2000Kbps.

Multiple media datas with different quality are sent to server 120.At this time it is also possible to service Device 120 sends the information about described content and the information about each media data.About described content Information can include the title of this content about the metadata as this content, summary, content identification The information of at least one of symbol (ID), content uniform resource finger URL (URL) etc..About each The information of media data can include at least one of the quality of each media data, type, ID etc., And will describe in detail below in reference to Fig. 4 A to 4C.

Client 130 receives the information about content and at least one of the information about each media data Person, and send at least for the plurality of media data based on the information received to server 120 The request of person.Client 130 determines or estimates to flow environment, and based on described in estimated stream environmental selection At least one of multiple media datas.Can select in estimated stream environment, to keep suitably clothes At least one media data of business quality (QoS).Then, client 130 can send hypertext biography Transmission protocol (HTTP) is asked, and request server 120 sends at least one selected media data.

When stream ecological deterioration, and receive high-quality media data but media data can not be reproduced continuously Time, low quality media data can be asked in the middle of the plurality of media data.When stream improvement of environment, and And when receiving high-quality media data and media data can be reproduced continuously, can be from the plurality of media Continue in the middle of data to ask this high-quality media data.

While receiving a media data, client 130 can send difference with request server 120 Media data.Such as, in the stream environment deteriorated, request and receiving low-quality first media The client 130 of data, along with the improvement of stream environment, can send request to send to server 120 There is the second media data than the first higher quality of media data.Stream method according to association area, After server 120 and client 130 arrange a kind of quality while initially set stream channel, even Send continuously and receiving media data keeps same quality.But, according to current one exemplary embodiment, The streaming being adapted to flow environment can be carried out, even if because client 130 is receiving about same content The first media data while also be able to ask the second media data.

Client 130 can bandwidth based on such as network 140 and at least one of hardware resource, pass through Any method estimating stream environment is used to estimate to flow environment, wherein server 120 and client 130 At least one can use hardware resource.Such as, client 130 can be based on the media data received Timestamp and bit error rate (BER) estimate flow environment.When by checking the media data received Timestamp, find that the speed of receiving media data is when being slower than reproduction speed, it may be determined that stream ecological deterioration ?.Alternatively, when the BER of the media data received increases, it may be determined that stream ecological deterioration ?.

When client 130 request server 120 sends at least one media data according to stream environment, clothes Business device 120 sends the media data asked to client 130.Server 120 can be to client 130 Send the media data asked as the http response to described HTTP request.

Each media data can include by encoding content under different quality and dividing volume At least one of content after Ma and multiple fragments of producing.In other words, by encoding device 110 to institute State that content carries out encoding and each media data of producing can include at least one that divide based on the time Fragment.Server 120 by becoming multiple fragment and sending the plurality of fragment respectively by described division of teaching contents Send described content rather than this research content become a stream and sends this content continuously.Can lead to Cross the scheduled time unit of the unit that this division of teaching contents is become such as 10 or 20 seconds to produce the plurality of Section.Can be provided as dividing the described time on the basis of described content based on picture group (GOP). The media data corresponding with the picture of one or more GOP can be set to a fragment.

Such as, when the content of streaming has two kinds of quality, the first media data can include by right Described research content produces at least with the content after having the first mass and dividing coding based on the time One fragment, and the second media data can include by described content is encoded have the second matter Amount at least one fragment produced based on the content after time division coding.

Adaptive streaming is allowed for by dividing media data based on the time.Such as, stream is worked as When transmission starts, server 120 sends corresponding with 0 to 20 second of low-quality first media data One fragment.Then, when determining after 20 seconds that stream improvement of environment and client 130 ask more high-quality Media data time, server 120 can send and 20 to 40 seconds of high-quality second media data A corresponding fragment.Because media data being divided into multiple fragment based on the time, even if so at stream During transmission, it is also possible to send the fragment of different media data according to stream environment.

Fig. 2 A is the flow chart for describing the stream method according to an one exemplary embodiment.

With reference to Fig. 2 A, in operation 210, client 130 sends request to send pass to server 120 Information in predetermined content.Such as, show from the screen of client 130 as the user of client 130 User interface when have selected predetermined content, client 130 sends request to send pass to server 120 Information in selected content.Client 130 can send HTTP request to send to server 120 Information about predetermined content.

Once receiving this request from client 130, server 120 sends about institute to client 130 State the information of predetermined content.Server 120 can send this information about predetermined content as to client The http response of the HTTP request of end 130.Can should be according to opening about the information of predetermined content The access to content descriptor (CAD) of IPTV forum (OIPF) standard.Retouch in detail now with reference to Fig. 3 State the information about predetermined content.

Fig. 3 is the figure of the file including the information about content according to an one exemplary embodiment.This document Can be CAD, it is possible to be extensible markup language (XML) file.Label described separately and Attribute, but obvious to those skilled in the art, can be by belonging to by the project of tag definition Property definition, and can be by tag definition by the project of attribute definition.

With reference to Fig. 3, " Title(title) " should can be included about the information of content, " Synopsis(is general Want) ", " OriginSite(original site) " and " ContentURL(content URL) " label.

Because the streaming of the media data of correlation technique is pre-by encoding a content to have Fixed quality produces a media data, so the information about content of correlation technique is (specifically, CAD according to OIPF) do not include about by encoding described content there is different quality and The information of the multiple media datas produced.

But, according to current exemplary embodiment, the information about content includes about by one Hold the information of the multiple media datas carrying out encoding that there is different quality and produce, and corresponding in Fig. 3 " Tracks(track) ", " RefData(reference data) " and " Fragments(fragment) " label.

Fig. 4 A shows the information for defining multiple media data according to one exemplary embodiment.

With reference to Fig. 4 A, " Tracks(track) " label is for having by encoding content Different quality and multiple media datas of producing carry out the information classified.Should include point by " Tracks " label " ID " attribute of each media data of dispensing, " Type(type) " attribute and " Bitrate(bit rate) " Attribute.

It is somebody's turn to do " ID " attribute definition (the most sequentially) and distributes to the identifier of the plurality of media data, and Should " Type(type) " attribute definition media data whether corresponding to voice data, video data, sound Frequently/video data, or caption data.Such as, it is " Packed(packing) " when this " Type " attribute Time, this media data is audio/video data, and when should " Type " attribute be " Video(video) " Time, this media data is video data.Should " Bitrate(bit rate) " attribute definition for these media Data carry out the bit rate encoded.

Fig. 4 B shows the information of the head about media data according to one exemplary embodiment.

With reference to Fig. 4 B, " RefData " label includes " Type " attribute and " ID " attribute.It is somebody's turn to do " Type " The media formats of attribute definition head.Such as, when this " Type " attribute is " HEAD-TS ", should Head is the head of transport stream format.It is somebody's turn to do the media data I D of " ID " attribute definition head.Such as, when this When " ID " attribute is " 1 ", this head is the head with the media data that media data I D is " 1 ".Additionally, The information pointing to head, and the position of " URL " tag definition head should be comprised, i.e. by " RefData " label The URL of head.

Should " RefData " label be optional element.That is, when head independent of media data as independent literary composition In the presence of part, should be included in about in the information of content by " RefData " label, and when this head and these media When data merge, should can be not included in about in the information of content by " RefData " label.

Fig. 4 C illustrate according to an one exemplary embodiment about multiple media datas each include to The information of a few fragment.

With reference to Fig. 4 C, " Fragment " label as the subtab of " Fragments " label comprises about institute State the information of each at least one fragment included of multiple media data.

" NextFragmentsXMLURL(next fragment XML should be included by " Fragments " label URL) " attribute.When completing after the streaming of a content content after streaming continuously, In the case of transmitting at live TV stream, permissible when client 130 knows the information closing content later Seamlessly content below described in streaming.Therefore, should " Fragments " label by this pass later in The information definition held is " NextFragmentsXMLURL " attribute.Can be by about the content after described The URL of multiple media datas be defined as this " NextFragmentsXMLURL " attribute.

The information of at least one fragment about Current Content should be comprised by " Fragment(fragment) " label. With reference to Fig. 4 C, constitute by research content becomes the first mass as the first matchmaker with " URL " tag definition Volume data and the URL information of " slice1-1.as " of the first fragment that produces, and with " RefPointer(joins Examine pointer) " ID of tag definition correspondence head.Additionally, with " the StartTime(time started) " attribute Define the time started of this first fragment, and the most a piece of with " Duration(persistent period) " attribute definition The persistent period of section.Quality with this first media data of " BitRate " attribute definition.

In figure 4 c, " Fragments " label illustrates that each media data only includes a fragment.But, As described above with reference to Figure 1, the most obviously, when by each media number According to when being divided into multiple fragment, " Fragments " label may contain information about the letter of at least two fragment Breath.

Referring back to Fig. 2 A, in operation 220, client 130 sends request to send out to server 120 Send at least one of the plurality of media data.By a research content is produced to have different quality Raw the plurality of media data.Client 130 selects to be encoded to tool in the middle of the plurality of media data There is at least one media data being suitable for flowing the quality of environment, and ask to server 120 selected At least one media data.The pass that client 130 can include based on the information about described content In the information of the plurality of media data, send HTTP request to server 120.

Above with reference to described in Fig. 4 C, the information about content can include " Fragments " label.At this In the case of Zhong, client 130 is based on the URL information request service comprised in this " Fragments " label Device 120 sends selected media data.

Server 120 sends described media data according to the request of client 130.Server 120 is permissible At least one fragment of the media data asked is sent to client 130.Server 120 can be to visitor Family end 130 sends the media data asked as the http response about HTTP request.

Fig. 2 B is the flow chart for describing the stream method according to another one exemplary embodiment.Fig. 2 B shows Go out when head is as independent of the stream method in the presence of the file of media data.

With reference to Fig. 2 B, in operation 212, client 130 request server 120 sends about making a reservation for The information held, and server 120 sends this information about content.Operation 212 is corresponding to Fig. 2 A Operation 210.As an example, receive include with reference to Fig. 4 B above-mentioned " RefData " label about The information of content.

Operation 222 in, client 130 based on operation 212 in receive the information about content, The head of the media data that request selects in the middle of multiple media datas.Based on receive in operation 212 In the middle of the plurality of media data, at least one being suitable for flowing environment is have selected about the information of content Media data, and ask the head of at least one media data of this selection.Such as, by with reference to behaviour Make " RefData " label that in 212, the information about content of reception includes, selected by request at least The head of one media data.

Server 120 sends the head asked to client 130.Can send to client 130 and make Header File for XML file.

In operation 232, client 130 based on operation 212 in receive the information about content and The head received in operation 222, request server 120 sends selected media data.Client 130 request servers 120 send at least one sheet produced by dividing media data based on the time Section, and at least one fragment that server 120 is asked to client 130 transmission.

Fig. 5 A is the flow chart for describing the stream method according to another one exemplary embodiment.

With reference to Fig. 5 A, in operation 510, client 130 sends request to send pass to server 120 In the information of predetermined content, and server 120 sends this information about predetermined content.Such as, visitor Family end 130 sends HTTP request and sends this information about content for request server 120, and connects Receive this information about content as the http response to this HTTP request.Should be about the information of content It can be XML file.The information about content that client 130 receives in operation 510 is different from The information about content that client 130 receives in the operation 210 of Fig. 2, now with reference to Fig. 6 and 7 are described.

Fig. 6 is the figure of the file comprising the information about content according to another one exemplary embodiment.

With reference to Fig. 6, according to the information about content of current exemplary embodiment can include " Title ", " Synopsis ", " OriginSite " and " ContentURL " label is the same with in Fig. 3.

But, in figure 3, about content information by include " Tracks ", " RefData " and " Fragments " label and comprise the information about the plurality of media data, and in figure 6, replace in Comprise the information about the plurality of media data, be somebody's turn to do the information definition about content and comprise about described The URL of the file (hereinafter referred to as media presentation description) of the information of multiple media datas.Should " ContentURL " label can define the URL of media presentation description.

By the URL of this media presentation description being inserted as shown in Figure 6 about in the information of content, The compatibility with various media data format can be kept while performing the streaming being adapted to flow environment Property, without the pattern significantly changing the file comprising the information about content in correlation technique.

As shown in Figure 6, the information relating to stream method can be comprised about the information of content, and do not comprise Information about the plurality of media data.In other words, " ContentURL " label can include definition stream The form of the media data used between transmission period " MediaFormat(media formats) " attribute, and fixed The type of justice media data " MIMEType(MIME type) " attribute.

Especially, it is somebody's turn to do " ContentURL " label and can include defining the service involved by streaming of content " TransferType(transport-type) " attribute.Such as, should can define by " TransferType " attribute Whether the streaming of content relates to content transmission (CoD) service, direct broadcast service, the live clothes of self adaptation stream Business, self adaptation stream CoD service etc..

Fig. 7 illustrates the information about content according to an one exemplary embodiment.Fig. 7 can be according to OIPF The CAD of standard.

With reference to Fig. 7, can be at " ContentURL " according to the information about content that the style of Fig. 6 generates The URL of media presentation description defined in label.“http://asexample.com/vod/ Movies/18888/Meta/MainMeta.xml " it is the URL of media presentation description.Equally, as with reference to figure Described in 6, can be at " MediaFormat " attribute, " MIMEType " defined in this " ContentURL " label Attribute and " TransferType " attribute.

Refer back to Fig. 5 A, in operation 520 client 130 based on operation 510 receives about The information of content, sends the request for the information about the plurality of media data to server 120. Client 130 can ask media presentation description by HTTP request from this server 120, and can To receive this media presentation description as http response.

The information about content that client 130 receives from server 120 in operation 510 can include Such as the URL with reference to the media presentation description as described in Fig. 6 and 7.In this case, client 130 By " ContentURL " label with reference to the information about content, ask from server 120 and receive This media presentation description.This matchmaker is described in detail now with reference to Fig. 8 A and 8B and Fig. 9 A to 9H Body presents description.

Fig. 8 A and 8B is the figure of the media presentation description according to one exemplary embodiment.This media presentation is retouched State and can follow OIPF standard.

With reference to Fig. 8 A, include about multiple media according to the media presentation description of current exemplary embodiment The template label of the URL of data, for defining the label of the position of head, relating to for defining streaming And service label, for define media data Container Format label and for defining the plurality of matchmaker The label of volume data.

The public portion of the URL of the plurality of media data of " urlTemplate(url template) " tag definition Point.Such as, if " http://example.com/vod/movie/18888/Track/{TrackID}/ Segments/{SegmentID} " be URL template, then can be by respectively with the ID of each media data ID replacement " TrackID " and " SegmentID with at least one fragment that each media data includes (fragment ID) " define the URL of media data.

" headerUrl(head Url) " label is corresponding to " RefData " label described with reference to Fig. 4 B. In other words, the URL of the head of the plurality of media data of " headerUrl " tag definition it is somebody's turn to do.

" isLive(is live) " tag definition relates to the service of streaming.Such as, mark as this " isLive " When label are defined as " Live(is live) ", this streaming relates to direct broadcast service, and when should " isLive " label When being defined as " CoD ", this streaming relates to CoD service.

The container of the media data used during " contentType(content type) " tag definition streaming Form.Should " contentType " label may indicate that this Container Format be whether MP4 form or MPEG2-TS form.Although it will appreciated by the skilled person that this Container Format is not limited to this, And any Container Format for sending media data can be used, but at this this Container Format be MP4 form or MPEG2-TS form.Such as, this container lattice can should be defined by " contentType " label Formula follows MPEG media transmission (MMT) standard.

" Stream(stream) " label is generated for each media data and defines each media data. In order to define each media data by a research content is produced to have different quality, should " Stream " label includes " streamName(flows title) " attribute, " type(type) " attribute, " bitrate (bit rate) " attribute, " startTime(time started) " attribute, " between firstIntervalNum(first Every sequence number) " attribute, " duration(persistent period) " attribute and " intervalCount(gap count) " Attribute.

The title of " streamName " attribute definition media data, and can be the ID of media data. The type of " type " attribute definition media data, such as, as voice data, video data or audio frequency/ Video data.When media data only includes the data about the I frame for special play-back (trick play) Time, can be in this information defined in " type " attribute.

The bit rate of " Bitrate " attribute definition media data, " startTime " attribute definition is used for specifying media The timestamp of the time started of data, and the initially starting fragment of " firstIntervalNum " attribute definition Sequence number.

The persistent period of the fragment that " duration " attribute definition media data includes, and The sum of at least one fragment that " intervalCount " attribute definition media data includes.

" Segment(fragment) " label is the subtab of " Stream " label, and as it has been described above, works as matchmaker Volume data includes by content being encoded into predetermined quality and based on the content after time division coding During at least one fragment produced, define each of this at least one fragment.

The sequence number of " IntNum(integer number) " attribute definition fragment, and " StartTime " attribute definition is corresponding The time started of fragment.The persistent period of " Duration " attribute definition homologous segment, and " url " attribute is fixed The URL of justice homologous segment.

Should " Segment " label can be selective label, and if can be from " Stream " label Other inferred from attributes goes out the information of at least one fragment included about this media data, then media in This " Segment " label can not be included in now describing.In other words, when determining from " Stream " label " startTime ", " firstIntervalNum ", " duration " and " intervalCount " inferred from attributes of justice goes out During the content of " Segment " label, media presentation description can not include " Segment " label.Equally, If in predetermined template defined in " urlTemplate ", then " Segment " label can not be included " url " attribute, and by including with each ID and each media data of the plurality of media data The ID of at least one fragment replace defined pre-solid plate, infer the URL of fragment.

With reference to Fig. 8 B, may further include according to the media presentation description of another one exemplary embodiment " nextManifestURL(next display URL) " label.As it has been described above, worked as a content After streaming continuously streaming content below time, the feelings such as inserted in live TV stream transmission or advertisement Under condition, client 130 is known a priori by the information about content behind, in order to seamlessly streaming is below Content.Therefore, it can with " nextManifestURL " tag definition will after Current Content streaming The URL of the media presentation description of content behind.

Fig. 9 A to 9H illustrates the media presentation description according to one exemplary embodiment.

With reference to Fig. 9 A, include that " URLTemplate " marks according to the media presentation description of one exemplary embodiment Sign, " RefDataURL(reference data URL) " label and define the multiple of multiple media data respectively Label.

" URLTemplate " label of Fig. 9 A and " RefDataURL " label correspond respectively to Fig. 8 A and " urlTemplate " label of 8B and " RefDataURL " label.

" ID " attribute of Fig. 9 A, " Type " attribute, " BitRate " attribute, " StartTime " attribute, " SegmentDuration " attribute, " SegmentStartID " attribute and " SegmentCount(Fragment Count) " Attribute corresponds respectively to " streamName " attribute of " Stream " label of Fig. 8 A and 8B, " type " belongs to Property, " bitrate " attribute, " startTime " attribute, " duration " attribute of " Stream " label, " Stream " " firstIntervalNum " attribute of label and " intervalCount " attribute.

The media presentation description of Fig. 9 A comprises about by producing research content to have different quality Three video datas information, about the information of a voice data with about by being used only for spy The information of the media data that the I frame that skill is play encodes and produces.

With reference to Fig. 9 B, farther include according to the media presentation description of an one exemplary embodiment " NextAdaptiveControlURL(next Self Adaptive Control URL) " label.Should " NextAdaptiveControlURL " label is corresponding to " nextManifestURL " label of Fig. 8 B.Cause This, after can reproducing with " NextAdaptiveControlURL " tag definition after Current Content The URL of the media presentation description of face content.

Fig. 9 C illustrates that " NextAdaptiveControlURL " tag definition when using Fig. 9 B will be in current Below reproducing after appearance during the URL of media presentation description of content, the media of described content behind in Now describe.The media presentation description of comparison diagram 9B and 9C, it can be seen that " StartTime " attribute is different from The media presentation description of the Current Content of Fig. 9 B, because the media presentation description of Fig. 9 C is with later Content.

Fig. 9 D and 9E illustrate according to one exemplary embodiment, want to hold for optionally controlling user The media presentation description that the high-quality video of row reproduces.Fig. 9 D illustrate when by a research content with Media presentation description when there are 5 kinds of different qualities and produce multiple media data.Here, pass is being comprised In being encoded to have the media presentation description of Fig. 9 D and 9E in the label of the information of high-quality video Difference, " StartTime " attribute and " SegmentCount " i.e. with the media data of " ID " attribute " 5 " belong to Property.

In this one exemplary embodiment, server 120 is according to the user gradation (rating) of client 130 Optionally send media presentation description or the media presentation description of Fig. 9 E of Fig. 9 D.When client 130 User gradation height time (such as, when client 130 is paid for user), send Fig. 9 D media in Now describe and make freely render high quality video；And when the user gradation of client 130 is low (such as, When client 130 is free users), send the media presentation description of Fig. 9 E so that regard from high-quality The time of " StartTime " attribute definition in Pin starts to reproduce the sheet of " SegmentCount " attribute definition Section.

Fig. 9 F illustrate according to one exemplary embodiment, media presentation when inserting advertisements into content retouches State.With reference to Fig. 9 F, this media presentation description may contain information about the information of ad content and main contents, Ad content and main contents have different " StartTime " attributes.This media presentation description can comprise pass Information in ad content and the information about main contents, from " 00:00:00 " and to " 00:02:00 " with The bit rate render advertising content of " 500000 ", from " 00:02:00 " start with " 1000000 ", The bit rate of " 2000000 ", " 3000000 " or " 4000000 " reproduces main contents.If server 120 By providing this ad content to client 130 to ad content coding having a kind of bit rate, and Main contents is provided to main contents coding to client 130 by the bit rate different by four kinds, main interior Container has " StartTime " attribute different from ad content, then can be from server 120 to client 130 Send the media presentation description of Fig. 9 F.

Fig. 9 G illustrates according to one exemplary embodiment, the media presentation that comprises the information about ad content Describe.For providing the server of main contents and for providing the server of ad content can be different.Example As, when client 130 receives main contents and outside server 120 from the server 120 of Fig. 5 A When server receives ad content, the media presentation description of Fig. 9 G can include the URL of ad content. As shown in Fig. 9 G, this media presentation description can include the advertisement being encoded to have a kind of quality The URL of content.

Below with reference to Figure 13 A to 23 describe a kind of according to various one exemplary embodiment, spreading By ad content being injected the method reproducing this ad content in this main contents while defeated main contents And device.

Fig. 9 H illustrate according to one exemplary embodiment, comprise language and the media presentation description of caption information. With reference to Fig. 9 H, voice data may contain information about the information of polyglot.This media presentation description is permissible Comprising the information of the voice data about polyglot, wherein " ID " attribute is " 4 " or " 5 "；Or close In the information of the captions of polyglot, wherein " ID " attribute is " 6 " or " 7 ".

Because being possible not only to voice data according to the time, captions can be divided into multiple fragment, institute Voice data and captions can be become during streaming voice data and the captions of another kind of language.

Referring back to Fig. 5 A, client 130 sends request to send out to server 120 in operation 530 Send at least one of the plurality of media data.Client 130 is by with reference to about the plurality of media number According to information, select to be encoded to have at least one media data being suitable for flowing the quality of environment, and At least one selected media data is asked to server 120.Client 130 can send HTTP Request sends predetermined media data for request server 120.Server 120 is according to client 130 Request send described media data.Alternatively, server can send by right to client 130 Research content with have predetermined quality and based on the time divide coding after content and produce at least one Fragment.Server 120 can send the media data asked as to described HTTP to client 130 The http response of request.

Fig. 5 B is the flow chart for describing the stream method according to another one exemplary embodiment.

With reference to Fig. 5 B, client 130 sends request to send pass to server 120 in operation 512 In the information of predetermined content, and receive this information about predetermined content from server 120.Such as, Client 130 can send HTTP request and send the letter about predetermined content for request server 120 Breath, and receive this information about predetermined content as the http response to this HTTP request.Institute The information about predetermined content of stating may be embodied in XML file.

Operation 522 in, client 130 based on operation 512 in receive the information about predetermined content, Request is sent to send the information about multiple media datas to server 120.Such as, client 130 The request for media presentation description can be sent by HTTP request to server 120, and reception should Media presentation description is as http response.

Operation 532 in, client 130 ask based on operation 522 in receive about multiple media numbers According to information and the head of media data that selects.Based on reception in operation 522 about the plurality of The information of media data selects at least one matchmaker being suitable for flowing environment in the middle of the plurality of media data Volume data, and the head of at least one media data selected by request.By with reference in operation 522 The information about the plurality of media data received, the head of at least one media data selected by request Mark.Server 120 in response to the request of client 130, to client 130 send selected at least The file of the head of one media data.

Operation 542 in, client 130 based on operation 522 in receive about the plurality of media number According to information and operation 532 in receive head, to server 120 send request with send selected by Media data.Client 130 to server 120 send request with send by research content to have Predetermined quality at least one fragment produced based on the content after time division coding, and server 120 send, to client 130, at least one fragment asked.

Figure 10 A to 10C each one the multiple media datas according to one exemplary embodiment are shown.Such as, figure Each one of 10A to 10C illustrate that server 120 includes for performing the stream according to Fig. 5 A and 5B Multiple media datas of method.

With reference to Figure 10 A, server 120 can include by a research content to have multiple difference Quality and multiple media datas 1010 to 1030 of producing, for being adapted to flow the streaming of environment. " Track1(track 1) " to " TrackN(track N) " represent the plurality of media data 1010 to 1030. Additionally, the plurality of media data 1010 to 1030 each can include by dividing this based on the time many Individual media data 1010 to 1030 each and at least one fragment of producing.“Slice1-1.as”、 “Slice1-2.as”、“Slice1-3.as”、“Slice2-1.as”、“Slice2-2.as”、“Slice2-3.as”、 " SliceN-1.as ", " SliceN-2.as " and " SliceN-3.as " represents at least one fragment.

Server 120 can comprise client 130 and arrive in order to access the plurality of media data 1010 The information 1040 of 1030.Server 120 can include as the information about content " CadMeta.xml " file, as the information about the plurality of media data 1010 to 1030 " MainMeta.xml " file and the Header File as the plurality of media data 1010 to 1030 " Head1.ref " file, " Head2.ref " file etc..Here, " Head1.ref " file can be " Track1 " Header File, and " Head2.ref " file can be the Header File of " Track2 ".

" CadMeta.xml " file can be the cad file according to OIPF standard, and " MainMeta.xml " file can be above-mentioned media presentation description.Additionally, " Head1.ref " and " Head2.ref " file is optional element, and arrives when head is included in the plurality of media data 1010 Time in 1030, " Head1.ref " and " Head2.ref " file can not exist.

With reference to Figure 10 B, client 1030 is used for accessing the plurality of media data 1010 to 1030 Information 1042 may further include " NextMeta.xml " file.As it has been described above, be somebody's turn to do " NextMeta.xml " File can be intended to the media presentation description of the content behind reproduced after Current Content.As it has been described above, The media presentation description of Current Content, i.e. " MainMeta.xml " file, including content behind media in The URL now described, therefore client 130 can access based on this " MainMeta.xml " file " NextMeta.xml " file.

With reference to Figure 10 C, the Header File of the plurality of media data 1010 to 1030 may reside in one In individual Header File 1050.Exist instead of each of the plurality of media data 1010 to 1030, Described Header File can exist as a Header File 1050, and can be included in for accessing In the information 1044 of the plurality of media data 1010 to 1030.

Such as, a such as basis is each corresponded to when the plurality of media data 1010 to 1030 When substantially the flowing of basic stream of MPEG-2, the Header File of the plurality of media data 1010 to 1030 Can be to include Program Association Table (PAT) and the Header File 1050 of Program Map Table (PMT).Institute At least one stating PAT and PMT is separated from the plurality of media data 1010 to 1030 with standard For this Header File 1050, and media presentation description can comprise the letter pointing to this Header File 1050 Breath.Such as, the information of described sensing Header File 1050 can be the URL of this Header File 1050 Information, or specify mpeg 2 transport stream (TS) to include the information of packet of Header File 1050. The Header File 1050 of at least one of the described PAT of including and PMT is initial segment, and can be Forward direction client 130 including the fragment of payload data sends, in order to start the plurality of media number According to the reproduction of 1010 to 1030.

Refer back to the operation 532 of Fig. 5 B, client 130 can by reference medium present description and Obtain the information pointing to Header File 1050, and can be based on the information pointing to this Header File 1050 And ask Header File 1050.Based on pointing to the information request of Header File 1050 and receiving Header File After 1050, at least one selection institute based on PAT and PMT that this Header File 1050 includes State at least one of multiple media data 1010 to 1030, and ask selected from server 120 At least one media data.Described PAT and PMT can separate as Header File 1050 or include In the plurality of media data 1010 to 1030, and no matter PAT and PMT position where, It is basic that described PAT and PMT can include that the plurality of media data 1010 to 1030 includes The whole list of stream.

Different according to basic stream according to the packet ID (PID) defined in MPEG-2, PAT and PMT. Therefore, each PID distributing to the plurality of media data 1010 to 1030 can be different.Replace Ground, according to another one exemplary embodiment, because by producing a research content to have different quality Raw the plurality of media data 1010 to 1030 is the basic stream of same content, it is possible to arrange phase Same PID.

When the plurality of media data 1010 to 1030 is corresponding to the multiple basic stream according to MPEG-2 Time, each fragment that the plurality of media data 1010 to 1030 includes can include that at least one is even The basic stream (PES) of continuous packetizing.But, a PES is included in a fragment.In other words, One PES is not included in the fragment that two different.

Because be by a research content to be produced multiple media data to have different quality, so can The presentation time stamp (PTS) included with the PES according to the plurality of media data of recovery time alignment At least one with decoded time stamp (DTS).In other words, if initial p ES of the first media data The content simultaneously reproduced with initial p ES of the second media data, then can similarly arrange PTS and At least one of DTS.

Additionally, when by according to stream environment change media data while reproducing the first media data again During existing second media data, at least one of PTS and DTS that can align continuously so that continuously Reproduce the first and second media datas.In other words, when reproducing the first media by changing media data When reproducing the second media data while data, the PTS of PES last before changing can be continuously provided With at least one of DTS and at least one of PTS and DTS changing rear first PES.

The timestamp of at least one definition video data of described PTS and DTS.Therefore, as mentioned above The plurality of media data of recovery time alignment according to the plurality of media data about video data Timestamp.The alignment of so based on the recovery time timestamp can be equally applied to voice data. In other words, as the timestamp about multiple media datas of video data, it is also possible to according to when reproducing Between the timestamp of multiple media datas that aligns about voice data for self adaptation streaming.

Figure 11 A is the flow chart for describing the stream method according to another one exemplary embodiment.

With reference to Figure 11 A, in operation 1110, client 130 is asked about multiple matchmakers from server 120 The information of volume data.Such as, client 130 can ask matchmaker via HTTP request from server 120 Body presents description, and can receive this media presentation description as http response.Client 130 to Server 120 sends for about by producing a research content to have multiple different quality The request of the information of multiple media datas, and receive described information, in order to perform to be adapted to flow environment Streaming.The place of the stream method that the stream method of Figure 11 A is different from Fig. 5 A is: does not ask and receives About the information of content, and ask and receive the information about the plurality of media data.

In operation 1120, client 130 sends request to send the plurality of matchmaker to server 120 At least one of volume data.Client 130 is by with reference to the information about the plurality of media data, choosing Select and ask to be encoded to that there is at least one media data being suitable for flowing the quality of environment, and from clothes Business device 120 receives at least one media data asked.

Figure 11 B is the flow chart for describing the stream method according to another one exemplary embodiment.

With reference to Figure 11 B, in operation 1112, client 130 sends request to send to server 120 About the information of multiple media datas, and receive described about many from server 120 in response to this request The information of individual media data.Such as, client 130 can be by HTTP request to server 120 Send the request for media presentation description, and receive this media presentation description as http response.

Operation 1122 in, client 130 ask based on operation 1112 in receive about the plurality of The head of the media data selected by the information of media data.Client 130 is by with reference to operation 1112 The information about the plurality of media data of middle reception, asks according to the media data selected by stream environment Head.In response to this request, server 120 sends to client 130 and includes selected media number According to the file of head.

In operation 1132, client 130 request server 120 sends and receives based in operation 1112 The information about the plurality of media data and operation 1122 in the head that receives and the media number that selects According to.Client 130 to server 120 send request with send by by predetermined quality to research content And divide the content after coding and at least one fragment of producing based on the time, and server 120 is to visitor Family end 130 sends at least one fragment asked.

Figure 12 A to 12C each one the multiple media datas according to other one exemplary embodiment are shown.Such as, Figure 12 A to 12C each one illustrate that server 120 includes, for performing the stream of Figure 11 A and 11B Multiple media datas of method.

With reference to Figure 12 A, server 120 can include by a research content to have multiple difference Multiple media datas 1010 to 1030 that quality produces for being adapted to flow the streaming of environment, such as figure Shown in 10A.

Here, multiple media datas 1010 to 1030 of Figure 12 A are different from multiple media of Figure 10 A The place of data 1010 to 1030 is: client 130 is used for accessing the plurality of media data 1010 Information 1240 to 1030, wherein server 120 comprise about the plurality of media data 1010 to The information of 1030, and do not comprise the information about content, unlike the one exemplary embodiment of Figure 10 A.This In, client 130 can receive the information about content from another entity replacing server 120, and And can access, based on the information about content received, multiple media numbers that server 120 includes According to 1010 to 1030.

With reference to Figure 12 B, can be by further " NextMeta.xml " file being included the letter of Figure 12 A Breath 1240 prepares client 130 for accessing the letter of the plurality of media data 1010 to 1030 Breath 1242.

With reference to Figure 12 C, the Header File of the plurality of media data 1010 to 1030 may reside in one In individual Header File 1250.Header File is not each of the plurality of media data 1010 to 1030 And exist, but can be included in for accessing the plurality of media number as a Header File 1250 In information 1244 according to 1010 to 1030.This Header File 1250 is corresponding to the Header File of Figure 10 C 1050。

Figure 13 A to 13G illustrates the media presentation description according to other one exemplary embodiment.Figure 13 A arrives 13G illustrates the media presentation description comprising the information about multiple media datas, according to Fig. 5 A and 5B And the stream method of 11A and 11B sends and receives described between server 120 and client 130 Multiple media datas.

At the operation 520 of Fig. 5 A, the operation 522 of Fig. 5 B, the operation 1110 or Figure 11 B of Figure 11 A Operation 1112 in, client 130 from server 120 receive media according to Figure 13 A to 13G in Now describe, and select to be suitable in the middle of the plurality of media data based on the media presentation description received At least one media data in stream environment.Afterwards, in operation 530, the operation of Fig. 5 B of Fig. 5 A 542, in the operation 1132 of the operation 1120 or Figure 11 B of Figure 11 A, client 130 is to server 120 send the request at least one selected media data, and receive institute in response to this request State at least one media data.

With reference to Figure 13 A, it is relatively low that this media presentation description includes as " MPD " corresponding with the highest label Label " ProgramInformation(programme information) " label." ProgramInformation " label Including " Period(period) " label of as lower label, reproduction period for dividing flow content, And should " Period " label include with can be at multiple media datas pair of corresponding reproduction period streaming Answer " Representation(presents) " label.Although Figure 13 A to 13G respectively illustrates " Representation " label, but if multiple media number can be reproduced in predetermined reproduction period According to, the most obviously can define respectively corresponding to multiple media datas Multiple " Representation " label.

Additionally, as it has been described above, each media data can include based on time division one or more Section, and the one or more fragment can be defined with " SegmentInfo(sheet segment information) " label.

" Representation " label of Figure 13 A includes as attribute to define the quality of media data " bandwidth(bandwidth) ", " resolution(resolution) " and " framerate(frame per second) " at least One." bandwidth " attribute definition is for sending and receive the bandwidth of this media data, and can be The bit rate of this media data.The resolution of " resolution " this media data of attribute definition, and if This media data is video data, then should " resolution " attribute can define this video data level and Vertical dimension.

The frame per second of " framerate " this media data of attribute definition.If this media data is video data, It is somebody's turn to do the frame number that " framerate " attribute can define each unit interval and reproduce, and if this media data It is voice data, should can define sample frequency by " framerate " attribute.

As it has been described above, determine that the element of the quality of media data can include various element, including bit rate, Sample frequency, resolution or frame per second.The media presentation description of Figure 13 A is different from Fig. 9 A's to 9H The place of media presentation description is, the media presentation description of Figure 13 A includes in the middle of described various element Frame per second.

Typically, along with the increase of frame per second, the size of this media data increases；And along with frame per second reduces, should The size of media data reduces.Additionally, this media number can be limited according to the hardware capabilities of client 130 According to reproduction frame per second.Accordingly, it is considered to the self adaptation streaming of stream environment can use and it is provided with difference Multiple media datas of frame per second.For using the self adaptation streaming of frame per second, media presentation description " Representation " label includes " framerate " attribute as shown in FIG. 13A.

Figure 13 B illustrates the media presentation description of the media data with constant frame per second.Frame per second can be permanent Fixed, or can change according to media data encoding method.Figure 13 B illustrates about having constant The media presentation description of the media data of frame per second, wherein " framerate " of " Representation " label belongs to Property is defined as " CRF/30 " to indicate this media data to have the constant frame per second of 30.

Figure 13 C illustrates the media presentation description of the media data with variable frame rate.Using variable frame rate In the case of coming media data encoding, " framerate " attribute of " Representation " label is defined For " VFR/30 " to indicate this media data to have variable frame rate.Here, " 30 " can be that this has can Become the average frame per second of the media data of frame per second.

With reference to Figure 13 B and 13C, by using " CFR " or " VFR " by the frame per second of media data clearly It is defined as constant or variable.But it is also possible to by using only one numeral as shown in Figure 13 D Definition frame per second.In the case of defining " framerate " attribute as shown in Figure 13 D, if media data Frame per second be constant, should " framerate " attribute indicate constant frame per second be " 30 ", and if these media The frame per second of data is change, then average frame per second should be indicated to be " 30 " by " framerate " attribute.

Figure 13 E corresponds to such a case, the wherein media presentation when the frame per second of media data is variable Describe by using " minframerate(minimum frame per second) " and " maxframerate(maximum frame per second) " The maximum frame per second of definition and minimum frame per second.

Figure 13 F and 13G illustrate when the bit rate of media data be constant or variable time media presentation retouch State.As shown in Figure 13 F, by by " bandwidth " attribute definition of " Representation " label For " CBR/250kbps ", may indicate that this media data has the constant bit rate of " 250kbps ", and As shown in Figure 13 G, by being " VBR/250kbps " by " bandwidth " attribute definition, can refer to Show that this media data has variable bit rate." 250kbps " instruction of Figure 13 G has variable bit rate The mean bit rate of media data be " 250kbps ".

Figure 14 A to 14D illustrates the media presentation description according to other one exemplary embodiment.

Figure 14 A to 14D illustrates the media presentation description comprising the information about multiple media datas, root Send out between server 120 and client 130 according to the stream method of Fig. 5 A and 5B and 11A and 11B Send and receive the plurality of media data.

In other words, in the operation 520 of Fig. 5 A, the operation 522 of Fig. 5 B, the operation 1110 of Figure 11 A Or in the operation 1112 of Figure 11 B, client 130 receives according to Figure 14 A to 14D from server 120 Media presentation description, and based on the media presentation description received in the middle of the plurality of media data Select at least one media data being suitable for flowing environment.Afterwards, at operation 530, Fig. 5 B of Fig. 5 A Operation 542, Figure 11 A operation 1120 or Figure 11 B operation 1132 in, client 130 to Server 120 asks at least one selected media data, and in response to this request receive described in extremely A few media data.

Being similar to the media presentation description of Figure 13 A, the media presentation description of Figure 14 A to 14D includes relating to And for determining multiple attributes of an element of content quality, i.e. " bandwidth ", " resolution " and " framerate " attribute.

In order to effectively further perform adaptive spreading while the deterioration minimizing picture quality Defeated, it is necessary to divide the order of priority of the plurality of element.Therefore, according to the media presentation of the present embodiment The information of order of priority between comprising about the plurality of element for determining content quality is described.

In the case of streaming content relates to news, screen there is no the movement of a lot of object, though therefore So the deterioration of frame per second reduction still picture quality is less.Therefore, compared with frame per second, for determining the institute of quality State the bit rate in the middle of multiple element and resolution have impact on the quality of described content more.But, In the case of streaming content relates to sports, screen has the movement of a lot of object, if so frame The deterioration that rate reduces then this picture quality is bigger.Therefore, compared with bit rate or resolution, it is used for determining matter Frame per second in the middle of the plurality of element of amount have impact on the quality of described content more.

In self adaptation streaming, when client 130 selects to be suitable for flowing ring in the middle of multiple media datas The media data in border and when server 120 asks this media data, for determining the described many of quality Order of priority in the middle of individual element can work as important selection standard.Therefore, according to this reality Execute example Figure 14 A to 14D media presentation description by use " qualitydependency(mass depends on Lean on) " attribute defines about the information for determining the order of priority in the middle of the plurality of element of quality, Make client 130 can select the optimal media data being suitable for flowing environment.

Can be at the higher label as " Representation " label relevant to media data " qualitydependency " attribute defined in " Period " label.As it has been described above, use " Period " label Divide reproduction period.Because at " qualitydependency " attribute defined in " Period " label, so Client 130 can be by with reference to selecting multiple media data by " qualitydependency " attribute One, wherein can reproduce institute in the reproduction period corresponding with " Period " label of media presentation description State multiple media data.

Figure 14 A to 14D is shown in the example of " qualitydependency " attribute defined in " Period " label Son.But, the plurality of element for determining quality need not be defined for this " Period " label and work as In order of priority, therefore can not in " Period " label but as with the plurality of media number It is somebody's turn to do according to defined in any label of the higher label of corresponding " Representation " label " qualitydependency " attribute.Such as, if being used for determining described content in all reproduction period Quality multiple elements in the middle of order of priority identical, then can be at " ProgramInformation " label Or should " qualitydependency " attribute defined in " MPD ".

Figure 14 A illustrates the media of " Period " label including defining " qualitydependency " attribute Present description.With reference to Figure 14 A, " Period " label defines " qualitydependency " and " start " together Attribute so that be somebody's turn to do in " Period " tag definition reproduction period by this " start " tag definition be used for determining Order of priority in the middle of multiple elements of quality.

With reference to Figure 14 B, " qualitydependency " attribute can be defined in such a way and make specifically Ground describes the order of priority in the middle of multiple elements.As shown in Figure 14 B, can be by using the sign of inequality Describe in detail as be used for determine quality multiple elements " Resolution ", " Bandwidth " and Order of priority in the middle of " Framerate ".

With reference to Figure 14 C, can be by defining " qualitydependency " according to prioritizing symbol Attribute, gives symbol described in multiple Elemental partition the most respectively.In this respect, " Resolution " can be given Distribution " 1 ", can be " Bandwidth " distribution " 2 " to bit rate, can give " Framerate " distribution " 3 ", Can be so " 123 " by " qualitydependency " attribute definition.Being used for of definition according to Figure 14 C Determine that the order of priority in the middle of the plurality of element of quality is confirmed as the same with Figure 14 B “Resolution>Bandwidth>Framerate”.Can be according between client 130 and server 120 The pre-defined rule arranged performs the coupling between described element and described symbol.

With reference to Figure 14 D, can be by describing the only one in the middle of multiple elements with high-precedence Unit usually defines " qualitydependency " attribute.In the example of Figure 14 C, can be by using " qualitydependency " attribute defines in the middle of " Resolution ", " Bandwidth " and " Framerate " Confrontation measurer has the element of maximum effect.In the example of Figure 14 D, definition " Framerate " is as confrontation Measurer has the element of maximum effect.

Figure 15 is the figure of the media presentation description according to another one exemplary embodiment.

With reference to Figure 15, include as the label about reproduction period according to the media presentation description of the present embodiment " Period " label, and define aforementioned " qualitydependency " attribute as this " Period " label An attribute.Definition should for determine order of priority in the middle of multiple elements of quality " qualitydependency " attribute is defined as character string.

This character string can be as above by using the sign of inequality multiple to be specifically described with reference to Figure 14 B The character string of the order of priority in the middle of element, or can be the most above-mentioned according to order of priority with reference to Figure 14 C The character string of the symbol of multiple element is distributed in arrangement.Equally, with reference to Figure 14 D as it has been described above, this character String can be the character string describing the only one element in the middle of multiple elements with high-precedence.

Figure 16 is the figure of the media data dispensing device 1600 of the server 120 according to one exemplary embodiment.

With reference to Figure 16, the media data dispensing device 1600 of server 120 includes information transmitting unit 1610 With media data transmitting element 1620.

Information transmitting unit 1610 receives the request of the transmission about predetermined information from client 130, and And the information asked is sent in response to this request.Information transmitting unit 1610 receives from client 130 For the information about content or the request of the transmission of the information about multiple media datas, and to client The information that end 130 transmission is asked.According to the embodiment of Fig. 2 A, 2B, 5A, 5B, 11A and 11B, Information transmitting unit 1610 receives for the information about content or about multiple matchmakers from client 130 The HTTP request of the transmission of the information of volume data, and send asked information as http response.

The information about the plurality of media data sent to client 130 from server 120 can be Media presentation description, and this media presentation description can be with reference to Fig. 9 A to 9H, 13A to 13G, And the those described above of 14A to 14D.

Therefore, with reference to Figure 13 A to 13G as it has been described above, media presentation description can include for determining Multiple elements of content quality, and the plurality of element can include bit rate, differentiate from, frame per second etc.. Equally, with reference to Figure 14 A to 14D as it has been described above, media presentation description may contain information about the plurality of The information of the order of priority in the middle of element.

Media data transmitting element 1620 receives for according to flowing environment from the plurality of from client 130 The request of the transmission of at least one media data selected in the middle of media data, and to client 130 Send asked media data.Media data transmitting element 1620 receives for based on about the plurality of The request of the transmission of the media data that the information of media data selects, from information transmitting unit 1610 to Client 130 sends the described information about the plurality of media data.Server 120 can be from coding Equipment 110 receives the multiple media datas being encoded to have different quality, and can be to client 130 send the media data asked.Additionally, ask according to the transmission from client 130, service Device 120 from encoding device 110 receiving media data in real time, and can pass to client 130 Pass this media data.

According to the media presentation description sent from information transmitting unit 1610, client 130 can be asked It is suitable for the content of streaming content, and described media presentation description can include being previously discussed for really Determine multiple elements of quality so that client 130 can select to be suitable for streaming based on the plurality of element At least one media data of content, and can ask this at least to media data transmitting element 1620 One media data.As it has been described above, in the case of there is order of priority in the middle of the plurality of element, visitor Family end 130 can select to be suitable at least one of streaming content based on the information about this order of priority Media data, and this at least one media data can be asked to media data transmitting element 1620.

Figure 17 is the figure of the media data reception apparatus 1700 of the client 130 according to one exemplary embodiment.

With reference to Figure 17, include according to the media data reception apparatus 1700 of the client 130 of the present embodiment Information receiving unit 1710 and media data reception unit 1720.

Information receiving unit 1710 sends the request of the transmission for predetermined information to server 120, and And receive the information asked from server 120 in response to this request.Information receiving unit 1710 is to clothes Business device 120 sends asking of the transmission for the information about content or the information about multiple media datas Ask, and receive the information asked from server 120.According to Fig. 2 A, 2B, 5A, 5B, 11A With the embodiment of 11B, information receiving unit 1710 sends for the letter about content to server 120 Breath or the HTTP request of transmission of the information about multiple media datas, and receive asked letter Breath is as http response.

Client 130 can be matchmaker from the information about the plurality of media data that server 120 receives Body presents description, and this media presentation description can be reference Fig. 9 A to 9H, 13A to 13G, with And the those described above of 14A to 14D.

Therefore, with reference to Figure 13 A to 13G as it has been described above, media presentation description can include for determining Multiple elements of content quality, and the plurality of element can include bit rate, resolution, frame per second etc.. Equally, with reference to Figure 14 A to 14D as it has been described above, media presentation description may contain information about the plurality of The information of the order of priority in the middle of element.

Media data reception unit 1720 sends for sending according to stream environment from described to server 120 The request of at least one media data selected in the middle of multiple media datas, and receive from server 120 The media data asked.Media data reception unit 1720 send request, this request with send based on The media data selected about the information of the plurality of media data is relevant, by information receiving unit 1710 The described information about multiple media datas is received from server 120.

According to the media presentation description sent from server 120, media data reception unit 1720 is permissible Request is suitable for the content of streaming content, and this media presentation description can include above-mentioned for determining Multiple elements of quality so that media data reception unit 1720 can select suitable based on the plurality of element Together at least one media data of streaming content, and can send for this extremely to server 120 The request of a few media data.As it has been described above, there are the feelings of order of priority in the middle of the plurality of element Under condition, media data and receive unit 1720 can based on about this order of priority information select be suitable for In at least one media data of streaming content, and can send for this at least to server 120 The request of one media data.

According to embodiment described here, by using existing agreement not change server and/or client The configuration of end, can carry out adaptive streaming according to stream environment, whereby can with low cost formed with The adaptive streaming system that various types of media formats are compatible.

One exemplary embodiment described here can also be implemented as on computer readable recording medium storing program for performing Computer readable code.

Such as, the stream device of server and the stream device of client according to one exemplary embodiment can include It is couple to the bus of each unit of the device of Figure 16 and 17, and is connected at least one of this bus Reason device.Additionally, described stream device may further include the storage being couple at least one processor described Device, in order to storage order, the message received or produced message, wherein this at least one process Device is connected to described bus to perform described order.

The example of computer readable recording medium storing program for performing includes read only memory (ROM), random access memory (RAM), CD-ROM, tape, floppy disk, optical data storage equipment etc..This computer-readable is remembered Recording medium can also is that the network coupled computer system of distribution so that storing in a distributed way and transporting Row computer-readable code.

Although be particularly shown and described one exemplary embodiment, but those of ordinary skill in the art It should be understood that various change can be carried out in terms of form and details without deviating from being determined by the claims that follow The spirit and scope of present inventive concept.

Claims (14)

1. a method for receiving media data, the method includes:

Receiving file from server, wherein this document comprises about by compiling predetermined content with different quality Code and the information of multiple media datas that produces；And

Based on this document, receive at least one media data of the plurality of media data,

Wherein said file include for the plurality of media data each frame per second and about for Determine that in the middle of multiple elements of quality, the information of order of priority and instruction determine the every of multiple elements of quality The order of priority of the importance associated of one element.

2. method as claimed in claim 1, wherein file includes that each for multiple media datas is many Individual first label, each of the plurality of first label includes at least one of title, type, resolution, And

The plurality of first label each include frame per second.

3. method as claimed in claim 2, wherein said file includes as the plurality of first label more Second label of high label, wherein about the letter for determining the order of priority in the middle of multiple elements of quality Breath is included in the second label.

4. method as claimed in claim 3, plurality of element includes resolution, bit rate and frame per second.

5. method as claimed in claim 3, wherein about the information of the order of priority in the middle of the plurality of element Including being respectively allocated to the plurality of element and the multiple symbols according to prioritization.

6. method as claimed in claim 3, wherein about the information of the order of priority in the middle of the plurality of element Including about the information from the element with high-precedence in the middle of the plurality of element.

7. method as claimed in claim 3, farther includes:

After server receives described file, based on about the order of priority in the middle of the plurality of element Information, selects at least one media data of the plurality of media data；And

Described receiving step includes at least one the media number received selected in the plurality of media data According to.

8. method as claimed in claim 3, wherein the second tag definition reproduction period of described content.

9. method as claimed in claim 2, each including by institute of wherein said multiple media datas State research content with have predetermined quality and according to the time period divide coding after content and produce multiple At least one of fragment.

10. the method sending media data, the method includes:

Sending file to client, wherein this document comprises about by compiling predetermined content with different quality Code and the information of multiple media datas that produces；And

According to the request based on sent file from client, send the plurality of media to client At least one media data of data,

Wherein said file include for the plurality of media data each frame per second and about for Determine that in the middle of multiple elements of quality, the information of order of priority and instruction determine the every of multiple elements of quality The order of priority of the importance associated of one element.

The method of 11. such as claim 10, it is each that wherein said file includes for multiple media datas Individual multiple first labels, each of the plurality of first label includes title, type, resolution, and And

The plurality of first label each include frame per second.

The method of 12. such as claim 11, wherein file include as the plurality of first label higher Second label of label, wherein should be about the letter for determining the order of priority in the middle of multiple elements of quality Breath is included in the second label.

13. 1 kinds of media data reception apparatus, including:

Information receiving unit, receives file from server,

Wherein this document comprises about the multiple matchmakers by producing so that predetermined content is encoded by different quality The information of volume data；And

Media data reception unit, at least one matchmaker based on the plurality of media data of described file reception Volume data,

Wherein said file include for the plurality of media data each frame per second and about for Determine that in the middle of multiple elements of quality, the information of order of priority and instruction determine the every of multiple elements of quality The order of priority of the importance associated of one element.

14. 1 kinds of media data dispensing devices, including:

Information transmitting unit, sends file to client,

Wherein this document comprises about the multiple matchmakers by producing so that predetermined content is encoded by different quality The information of volume data；And

Media data transmitting element, according to the request based on sent file from client, to client End sends at least one media data of the plurality of media data,

Wherein said file include for the plurality of media data each frame per second and about for Determine that in the middle of multiple elements of quality, the information of order of priority and instruction determine the every of multiple elements of quality The order of priority of the importance associated of one element.