WO2011144097A2 - Procédé, appareil et système de réarrangement et d'extraction de données multimédias dans un segment - Google Patents

Procédé, appareil et système de réarrangement et d'extraction de données multimédias dans un segment Download PDF

Info

Publication number
WO2011144097A2
WO2011144097A2 PCT/CN2011/074716 CN2011074716W WO2011144097A2 WO 2011144097 A2 WO2011144097 A2 WO 2011144097A2 CN 2011074716 W CN2011074716 W CN 2011074716W WO 2011144097 A2 WO2011144097 A2 WO 2011144097A2
Authority
WO
WIPO (PCT)
Prior art keywords
sub
segment
attribute
information
rearrangement
Prior art date
Application number
PCT/CN2011/074716
Other languages
English (en)
Chinese (zh)
Other versions
WO2011144097A3 (fr
Inventor
惠宇
张园园
石腾
乐培玉
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201180000721.7A priority Critical patent/CN102217313B/zh
Priority to PCT/CN2011/074716 priority patent/WO2011144097A2/fr
Publication of WO2011144097A2 publication Critical patent/WO2011144097A2/fr
Publication of WO2011144097A3 publication Critical patent/WO2011144097A3/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Definitions

  • the present invention relates to the field of media data processing, and in particular, to a method, a device and a system for rearranging and extracting media data in a slice.
  • the server compresses and encodes multimedia information through MVC (Multiview Video Coding), SVC (Scalable Video Coding), or AVC (Advanced Video Coding) encoding techniques.
  • MVC Multiview Video Coding
  • SVC Scalable Video Coding
  • AVC Advanced Video Coding
  • FIG. 1 is a schematic diagram of the structure of the Segment.
  • the Segment includes several Movie Fragments.
  • Movie Fragment is composed of Moof (Movie Fragment box, collectively referred to as description structure) and Media Data (Media Data). Moof is used to describe the time information and storage byte size of Media Data.
  • the storage unit of Media Data is Samples are stored one by one and stored at the decoding time.
  • the Sample consists of a NAL (Network Abstraction Layer) representing a single video frame or a series of video frames in the video stream. In a Sample, several consecutive NAL units with the same specified attributes form a Sub-sample.
  • NAL Network Abstraction Layer
  • the client When the client performs certain operations, it only needs to request some discretely stored media data in the fragment. For example, when performing fast forward operations, the client only needs to display media data at a certain rate (for example, 4 times). However, since these media data are discretely stored in the slice according to the decoding time.
  • One way of processing is that the client requests the entire fragment from the server, and then proposes the media data that it needs. The method requests a large amount of redundant media data other than the media data required by the client, resulting in waste of bandwidth and time.
  • the other is that the client first calculates the byte range of each discrete media data, and then requests the required media data from the server according to the calculated byte range. This method will require multiple requests to get the media data you need, which is slower and less efficient. Summary of the invention
  • the present invention provides a method, device, and system for rearranging and extracting media data in a slice.
  • the technical solution is as follows:
  • a method for rearranging media data in a tile comprising:
  • the index information of the sub-segment is added, and the index information includes rearrangement attribute information and location information of the sub-segment.
  • a server for rearranging media data in a fragment includes: a slicing module, a rearrangement module, and an adding module;
  • the slicing module is configured to slice media content
  • the rearrangement module is configured to physically store the media data in the segment that meets the rearrangement attribute in the process of the slice, and form a sub-segment corresponding to the rearrangement attribute, where the media data is
  • the adding module is configured to add index information of the sub-segment, where the index information includes rearrangement attribute information and location information of the sub-segment.
  • a method for extracting media data in a tile comprising:
  • index information of the sub-segment where the index information includes re-arrangement attribute information and location information of the sub-segment; and calculating, according to the index information, a byte range of the sub-segment corresponding to the predetermined re-arrangement attribute;
  • a client the client includes: an acquisition module, a calculation module, a request module, and a receiving module
  • the obtaining module is configured to obtain index information of a sub-segment, where the index information includes re-arrangement attribute information and location information of the sub-segment;
  • the calculating module is configured to calculate, according to the index information, a byte range of a sub-segment corresponding to a predetermined re-arrangement attribute, where the requesting module is configured to obtain, according to the byte range request, the predetermined re-arrangement attribute
  • the receiving module is configured to receive the media data in the sub-segment corresponding to the predetermined rearrangement attribute.
  • a system for rearranging and extracting media data in a tile comprising a server and a client;
  • the server includes:
  • a slicing module for slicing media content
  • a rearrangement module configured to physically store the media data in the segment within the segment that satisfies the rearrangement attribute in a process of slicing, to form a sub-segment corresponding to the rearrangement attribute, where the media data is sampled Or subsample composition;
  • An adding module configured to add index information of the sub-segment, where the index information includes re-arrangement attribute information and location information of the sub-segment;
  • a sending module configured to send, to the client, the media data in the sub-segment corresponding to the predetermined re-sorting attribute; the client includes:
  • An obtaining module configured to acquire, by the server, index information of a sub-segment, where the index information includes rearrangement attribute information and location information of the sub-segment;
  • a calculation module configured to calculate a byte range of the sub-segment corresponding to the predetermined re-arrangement attribute according to the index information
  • a requesting module configured to request, according to the byte range, the obtained re-arrangement attribute from the server Corresponding sub-segment
  • a receiving module configured to receive media data in the sub-segment corresponding to the predetermined re-sorting attribute sent by the server.
  • the technical solution provided by the embodiment of the present invention has the beneficial effects of: constituting a sub-segment corresponding to the rearrangement attribute by physically storing the media data satisfying the rearrangement attribute among the segments in the fragment; Implementing the technical solution of the index information of the sub-segment, and arranging the media data in the segment in the fragment according to different rearrangement attributes to form a sub-segment corresponding to different rearrangement attributes; acquiring index information of the sub-segment; The index information calculates a byte range of the sub-segment corresponding to the predetermined rearrangement attribute; the sub-segment corresponding to the predetermined rearrangement attribute is obtained according to the byte range request; and the sub-segment corresponding to the predetermined rearrangement attribute is obtained
  • the implementation of the technical solution of the media data can quickly and accurately extract the media data corresponding to the predetermined rearrangement attribute in the slice.
  • FIG. 1 is a schematic structural view of a segment provided in the background art of the present invention.
  • FIG. 2 is a flowchart of a method for rearranging media data in a slice according to Embodiment 1 of the present invention
  • FIG. 3 is a block diagram of a server device according to Embodiment 2 of the present invention.
  • FIG. 5 is a flowchart of a method for extracting media data in a slice according to Embodiment 4 of the present invention.
  • FIG. 6 is a block diagram of a device of a client according to Embodiment 5 of the present invention.
  • FIG. 7 is a schematic diagram of a system for rearranging and extracting media data in a slice according to Embodiment 6 of the present invention. detailed description
  • a method for re-arranging media data in a fragment the execution body of the method includes a content preparation module, an HTTP streaming server, or a distribution server.
  • the present invention does not specifically limit this, as shown in FIG. 2, Specific steps are as follows:
  • Step 101 Slice the media content, and package the slice content into a format that meets the requirements (such as 3GP format) to form a slice;
  • the media content is sliced according to a predetermined data block size
  • each Movie Fragment in Segment is composed of Moof (Movie Fragment Box) and Media Data of media data, and the media data is Sample or Sub-sample. (Subsample) Composition, in the implementation, Sample or Sub-sample is stored in Track.
  • the description item Traf (Track Fragment Box) of the track fragment in Moof is used to describe the media data in the corresponding Track Fragment.
  • the track fragment operation description item Trun (Track Fragment Run Box) in Traf is used. Describes the time information of the Sample in the Track Fragment, such as the decoding time and the synthesis time.
  • the sub-sample information item Subs (Sub-sample Information Box) is used to describe the storage byte size of all Sub-samples that make up a Sample in the Track Fragment.
  • this embodiment uses the example of rearranging the media data in a Track Fragment in the Movie Fragment as an example, and the method of rearranging the media data in the other Track Fragment in the Movie Fragment is the same;
  • Step 102 Physically reordering the media data satisfying the rearrangement attribute in the Movie Fragment of the Segment, so that the media data satisfying the rearrangement attribute is physically stored continuously, and the level corresponding to the rearrangement attribute is formed ( a sub-segment), wherein the media data is composed of Sample or Sub-sample;
  • the reordering attribute is a single attribute or a combination of any attributes.
  • the attributes include a video view, a video quality, and a frame rate.
  • the original Movie Fragment structure includes the moof and the Track Fragment, which stores a sample of 2D video; then, according to a single attribute, such as 2, 4 and 8 frame rate, the sample stored in the Track Fragment Performing rearrangement, specifically, physically storing the I frame samples of the 2x frame rate stored in the Track Fragment continuously to form a sub-segment corresponding to the 2x frame rate, and storing the 4x frame rate I frame samples stored in the Track Fragment Physically contiguous storage, forming a sub-segment corresponding to a frame rate of 4 times, physically storing the I frame samples of the 8x frame rate stored in the Track Fragment continuously, forming a sub-segment corresponding to the 8x frame rate, in the Track Fragment
  • the remaining samples stored are treated as a sub-segment.
  • the segment stores media data of multiple views as a Track Fragment, and each Sample contains multiple view video frames at the same time, and each view video frame can constitute a Sub-sample;
  • the Sample in the Track Fragment is stored in the decoding order. Where the Sample consists of multiple Sub-samples, the Sample structure in the Track Fragment is as follows:
  • the Trun in the description item Traf corresponding to the Track fragment describes the decoding time of the Sample in the Track fragment according to the decoding order, that is, the decoding time of all Sub-samples belonging to the same Sample, and the media data Sample in Trun.
  • the description order is as follows: Trun [sampleO, samplel, sample2, , sampleN] ;
  • Subs in Traf describes the storage byte size of each Sub-sample in each Sample according to the decoding order of Sample.
  • the contents of Subs are as follows:
  • the Sub-sample belonging to the same Sample has the same time information.
  • the sampleO decoding time is the first (seconds), then the subsample sub-sample (0, 0), sub- in SampleO.
  • the decoding time of sample (0, 1) , ..., sub-sample (0, k) is the first Is, and the time information of Samplel is 1.
  • Is, the subsample sub-sample (1, 0) in Samplel , sub-sample (1, 1) , •••sub-sample (1, m) decoding time is 1.
  • the decoding time of N, 1) and -sub-sample (N, n) is the xth second;
  • the sub-samples of the same reordering attribute are physically contiguously stored to form a sub-segment, and the sub-samplings in the sub-segment are still stored according to the decoding order of the original samples, for example, as described above, the same weight is
  • the sub-sample (0, 0) of the row attribute belongs to SampleO, the decoding time is 1 second; the sub-sample (1, 0) belongs to the 1.
  • sub-sample ( ⁇ , ⁇ ) belongs to SampleN,
  • the decoding time is the xth second; in the sub-segment, the sub-samples with the same rearrangement attribute are stored in the order of sub-sample (0, 0), sub-sample (1, 0), •••sub -sample (N, 0);
  • pair () represents a sub-segment
  • the step further includes: using a first description item in the description structure Moof in the fragment, such as a track fragment operation description item, according to a decoding order of the samples to which the sub-sample belongs Describe the decoding order of the subsamples;
  • the first description item Trim describes the structure unchanged, and still follows
  • the decoding order of the original Sample describes the time information of the Sample, that is, all Sub-samples belonging to the Sample have the same time information, the storage order of the Sub-sample in a sub-segment and the storage order of the Sample before the sorting. Still consistent.
  • the Subs can obtain the correspondence between Sample and Sub-sample, so use the Sample time letter.
  • the second description item in the description structure Moof in the fragment such as the sub-sample information description item, describes the storage byte size of the sub-sample according to the decoding order of the samples to which the sub-sample belongs;
  • the second description item Subs describes the structure unchanged, and still describes the byte storage size of each Sub-sample in the Sample according to the decoding order of the original Sample.
  • the third description item is used to identify the physical storage structure of the Sub-sample, and is defined as follows:
  • the fourth new description item in Moof describes the correspondence between the sub-sample and the sub-segment to which the sub-sample belongs according to the decoding order of the samples to which the sub-sample belongs.
  • the fourth description item is used to describe the correspondence between the Sub-sample and the sub-segment level to which it belongs.
  • the fourth description item is as follows:
  • SubsToLevelBox extends Ful lBox ( ' stlf, , version, 0) ⁇ unsigned int (32) entry— count ;
  • the fourth description item is similar to the structure of Subs, and the order of description of sub-sample is the same, and is still described in the order in which Sub-samples are stored in the Sample.
  • the structure parameter level_ident defines the identifier of the level to which each Sub-sample belongs. The identifier can start from a predetermined value (such as 1) and is incremented by the predetermined value in the order in which the order is stored. It should be noted that, when there is a Sub-sample that does not belong to any level, the level- identify corresponding to the Sub-sample that does not belong to any level is 0.
  • the parameter level_ identify takes a value from 1
  • the following structure describes the correspondence between each Sub-sample and level of the two levels obtained above, that is, the first Sub-sample in each Sample. Belonging to the first level, the other Sub-sample belongs to the second level, then the structure of the fourth description item is as follows:
  • SampleO contains subsamples Sub-sample (0, 1) and Sub-sample (0, 2), and these two subsamples correspond to sub-segments levell and level2, respectively
  • Samplel contains sub-samples Sub-sample (1, 1) and Sub-sample (1, 2), and these two subsamples correspond to the sub-segments levell and level2 respectively.
  • Subs describes the decoding time of the subsample, it also describes the information of the subsegment to which the subsample belongs. Then, at this time, the fourth description item may not be defined.
  • the embodiment of the present invention supports the case of rearranging media data according to a combination of any attributes.
  • each Sample contains multiple view video frames at the same time, and each view video frame can constitute a Sub-sample.
  • a plurality of sub-segments are formed; for example, a sub-sample of an I frame representing a frame rate of 2 times of the view angle 1 is physically stored continuously to form a sub-segment, and an I representing a frame rate of 4 times of the angle of view 1 is formed.
  • the sub-sample of the frame is physically stored contiguously, forming another sub-segment, and so on.
  • Step 103 Add index information to the sub-segment, where the index information includes attribute information and location information of the sub-segment; what is needed is that, in a Segment, some tracks of the Movie Fragment may be followed according to certain rearrangement attributes.
  • the Sample in Fragment performs physical reordering, and the Sample that satisfies the reordering property continuously stored after physical reordering constitutes several sub-segments level; and Sub-sample in other Track Fragment of Movie Fragment can also be followed according to some reordering attributes.
  • Physical reordering, Sub-Sample satisfying the rearrangement attribute continuously stored after physical reordering may constitute several sub-segment levels;
  • a slice contains a number of Movie Fragments, and may also include a slice index item Sidx.
  • Sub-slice index item Ssix (SubsSubsegmentlndexBox) and other index items, which are used to describe the index information of the Movie Fragment in the fragment.
  • Ssix can be used to describe the location information and reordering attribute information of level; in the specific operation, these index items can also be extracted separately and stored in an index file.
  • adding index information for the sub-segment specifically includes:
  • Table 1 exemplarily shows the position information of the level described in the sub-slice index item Ssix, as follows:
  • SubsegmentlndexBox extends Ful lBox ( 'Ssix' , 0, 0) Unsigned int (32) Subsegment count;
  • Table 2 exemplarily shows the reordering attribute information describing level in Ssix in the fragment, as follows:
  • the position information of the sub-segment level and the method of adding the rearrangement attribute letter in the index item Sidx in the slice may be the same as the position information and the rearrangement attribute information added in the Ssix level, and will not be described here.
  • Table 3 exemplarily shows the attribute information of the level added in the MPD, as follows:
  • the index information of the level can also be added in the index file.
  • the addition method is similar to the method of adding the level index information in Ssix, and will not be described here.
  • the embodiment of the present invention physically stores the media data satisfying the rearrangement attribute in the segments in the fragment to form a sub-segment corresponding to the rearrangement attribute; and implements the technical solution of adding the index information of the sub-segment
  • the media data in the segment in the segment is arranged according to different rearrangement attributes to form a sub-segment corresponding to different rearrangement attributes, and the rearrangement attribute of the sub-segment is a single attribute or a combination of attributes, so that the user can quickly and accurately
  • the index information of the sub-segments of the different rearrangement attributes the sub-segments of the required rearrangement attributes are found, and the media data is obtained therefrom.
  • a server may be a media data preparation module, an HTTP streaming server, or a distribution server.
  • the present invention does not specifically limit the present invention, and includes: a slicing module 200, a reordering module 201, and an adding Module 202, the following describes each functional module in detail:
  • a slicing module 200 configured to slice media content
  • the rearrangement module 201 is configured to physically store the media data satisfying the rearrangement attribute in the segments in the fragment in a slicing process to form a sub-segment corresponding to the rearrangement attribute;
  • the media data consists of samples or subsamples
  • the reordering attribute is a single attribute or a combination of any attributes, and specifically one attribute includes a video view, a video quality, and a frame rate.
  • the adding module 202 is configured to add index information of the sub-segment, where the index information includes re-arrangement attribute information and location information of the sub-segment. Specifically, the adding module 202 includes:
  • a first adding unit 2021 configured to add index information of the sub-segment in the index item in the fragment;
  • a second adding unit 2022 configured to add reordering attribute information of the sub-segment in the media presentation description MPD, and add location information of the sub-segment in the index file;
  • a third adding unit 2023 configured to add reordering attribute information of the sub-segment in the media presentation description MPD, and add location information of the sub-segment in the index item in the fragment;
  • the fourth adding unit 2024 is configured to add index information of the sub-segment in the index file.
  • the server when the rearrangement module 201 is configured to physically store the media data satisfying the rearrangement attribute among the segments in the fragment to form a sub-segment corresponding to the rearrangement attribute, and the media data is composed of the sub-sample, the server also includes:
  • a first description module 203 configured to describe, by using a first description item in the description structure Moof in the fragment, a decoding order of the sub-sample according to a decoding order of the samples to which the sub-sample belongs;
  • a second description module 204 configured to describe, by using a second description item in the description structure Moof in the fragment, a storage byte size of the subsample according to a decoding order of the samples to which the subsample belongs;
  • the third description module 205 is configured to identify a physical storage structure of the subsample by using a third description item added in the description structure Moof in the fragment.
  • the fourth description unit 206 is configured to describe, by using the fourth description item in the description structure in the fragment, the correspondence between the sub-sample and the sub-segment to which the sub-sample belongs according to the decoding order of the sample to which the sub-sample belongs.
  • the embodiment of the present invention physically stores the media data satisfying the rearrangement attribute in the segments in the fragment to form a sub-segment corresponding to the rearrangement attribute; and implements the technical solution of adding the index information of the sub-segment , the media data in the segment in the fragment is made into a sub-segment of different rearrangement attributes, and the rearrangement attribute of the sub-segment is a single attribute or a combination of attributes, so that the user can quickly and accurately according to the child of the different rearrangement attribute.
  • the index information of the fragment finds the sub-segment of the desired reordering attribute and obtains the media data therefrom.
  • a method for extracting media data in a fragment includes any client, such as a mobile phone, a PC, etc., and the present invention does not specifically limit this, and the details are as follows:
  • Step 301 Obtain index information of the sub-segment, where the index information includes re-arrangement attribute information and location information of the sub-segment;
  • Step 302 calculate, according to the index information, a byte range of the sub-segment corresponding to the predetermined re-arrangement attribute;
  • Step 303 Request a sub-segment corresponding to the predetermined reordering attribute according to the byte range;
  • Step 304 Receive media data in a sub-segment corresponding to the predetermined rearrangement attribute.
  • the media data consists of samples or subsamples;
  • the reordering attribute is a single attribute or a combination of any attributes.
  • the attributes include a video view, a video quality, and a frame rate.
  • the embodiment of the present invention calculates a byte range of a sub-segment corresponding to a predetermined rearrangement attribute according to the index information; and obtains the sub-segment corresponding to the predetermined rearrangement attribute according to the byte range request; receiving the predetermined
  • the implementation of the technical solution of the media data in the sub-segment corresponding to the rearrangement attribute, the client can quickly and accurately extract the media data corresponding to the predetermined rearrangement attribute in the fragment.
  • a method for extracting media data in a fragment the execution body of the method includes any client, such as a mobile phone, a PC, etc., and the present invention does not specifically limit this, and the specific steps are as follows:
  • Step 401 Send an MPD request to the server
  • the client obtains a URL (Uniform Resource Locator) of the MPD (Media Presentation Description) through the external connection, and sends an MPD request to the distribution server through the URL; the server receives the MPD request. After that, the MPD information is sent to the client;
  • a URL Uniform Resource Locator
  • MPD Media Presentation Description
  • Step 402 Receive MPD information sent by the server, and obtain a segment address from the MPD information.
  • Step 403 Obtain index information of a sub-segment level in the slice, where the index information includes level re-arrangement attribute information and location.
  • the reordering attribute is a single attribute or a combination of any attributes.
  • the attributes include a video view, a video quality, and a frame rate.
  • obtaining index information of the level in the fragment includes:
  • the range is preferably a byte range of 0 to 1000;
  • Step 404 Obtaining the index file according to the address of the index file in the MPD, and acquiring the index file from the server according to the obtained address file to obtain the index information of the level stored in the index file.
  • Step 404 Obtain a byte range of a level corresponding to the predetermined rearrangement attribute according to the index information. Specifically, obtaining a byte range of the level corresponding to the predetermined rearrangement attribute according to the index information, including: rearranging the acquired sub-segment In the attribute information, the re-arrangement attribute information of the sub-segment level matching the predetermined re-arrangement attribute is found;
  • the location information of the obtained sub-segment is searched according to the re-arrangement attribute information of the level matching the predetermined re-arrangement attribute;
  • Step 405 Request a level corresponding to the predetermined reordering attribute from the server according to the calculated byte range.
  • the request is sent to the server according to the calculated byte range and the fragment address; after receiving the request, the server sends the level in the byte range corresponding to the fragment address to the client.
  • Step 406 Receive the level returned by the server and obtain media data from it.
  • the embodiment of the present invention calculates a byte range of a sub-segment corresponding to a predetermined rearrangement attribute according to the index information; and requests the sub-segment corresponding to the predetermined rearrangement attribute according to the byte range; receiving the predetermined weight
  • the implementation of the technical solution of the media data in the sub-segment corresponding to the row attribute can quickly and accurately acquire the media data corresponding to the predetermined rearrangement attribute in the fragment.
  • a client which may be a user terminal such as a mobile phone or a PC, is not specifically limited in the present invention, and includes: an obtaining module 501, a calculating module 502, a requesting module 503, and a receiving module 504. The following describes each function module in detail:
  • the obtaining module 501 is configured to obtain index information of the sub-segment, where the index information includes re-arrangement attribute information and location information of the sub-segment;
  • the calculating module 502 is configured to calculate, according to the index information, a byte range of the sub-segment corresponding to the predetermined re-arrangement attribute; the requesting module 503, configured to obtain, according to the byte range request, the sub-segment corresponding to the predetermined re-arrangement attribute;
  • the receiving module 504 is configured to receive media data in a sub-segment corresponding to the predetermined re-arrangement attribute.
  • the reordering attribute is a single attribute or a combination of any attributes.
  • the attributes include a video view, a video quality, and a frame rate.
  • the obtaining module 501 includes:
  • a first obtaining unit 5011 configured to acquire index information of a sub-segment stored in an index item in the fragment
  • a second obtaining unit 5012 configured to acquire re-arrangement attribute information of the sub-segment stored in the media presentation description MPD, and Acquiring the location information of the sub-segment stored in the index entry in the fragment, so as to obtain the index information of the sub-segment
  • the third obtaining unit 5013 configured to acquire the re-arrangement attribute information of the sub-segment stored in the media presentation description MPD, and obtain Indexing the location information of the sub-segments stored in the file, thereby obtaining index information of the sub-segments; or
  • the fourth obtaining unit 5014 is configured to obtain index information of the sub-segments stored in the index file.
  • the calculation module 502 includes:
  • the first searching unit 5021 is configured to: in the reordering attribute information of the sub-segment, search for re-arrangement attribute information of the sub-segment matching the predetermined re-arrangement attribute;
  • the second searching unit 5022 is configured to: in the location information of the sub-segment, search for location information of the sub-segment matching the predetermined re-arrangement attribute according to the re-arrangement attribute information of the sub-segment matching the predetermined re-arrangement attribute;
  • the calculating unit 5023 is configured to calculate a byte range of the sub-segment matching the predetermined rearrangement attribute according to the position information of the sub-segment matching the predetermined re-arrangement attribute.
  • the embodiment of the present invention calculates a byte range of a sub-segment corresponding to a predetermined rearrangement attribute according to the index information; and requests the sub-segment corresponding to the predetermined rearrangement attribute according to the byte range; receiving the predetermined weight
  • the implementation of the technical solution of the media data in the sub-segment corresponding to the row attribute can quickly and accurately acquire the media data corresponding to the predetermined rearrangement attribute in the fragment.
  • an embodiment of the present invention provides a system for rearranging and extracting media data in a fragment.
  • the system includes a server 61 and a client 62.
  • the server 61 may specifically be a media data preparation module and an HTTP stream.
  • the client can be a user terminal such as a mobile phone or a PC. The following system is described in detail below:
  • the server 61 includes:
  • a slicing module 610 configured to slice media content
  • the rearrangement module 611 is configured to physically store the media data in the segment that meets the rearrangement attribute in the process of the slice, to form a sub-segment corresponding to the rearrangement attribute, and the media data is sampled or subsampled Constitute
  • the adding module 612 is configured to add index information of the sub-segment, where the index information includes re-arrangement attribute information and location information of the sub-segment;
  • the sending module 613 is configured to send, to the client, the media data in the sub-segment corresponding to the predetermined re-sorting attribute; the client 62 includes:
  • the obtaining module 621 is configured to obtain index information of the sub-segment from the server, where the index information includes re-arrangement attribute information and location information of the sub-segment; a calculation module 622, configured to calculate, according to the index information, a byte range of the sub-segment corresponding to the predetermined re-arrangement attribute; the requesting module 623, configured to request, from the server, the sub-segment corresponding to the predetermined re-arrangement attribute according to the byte range; The module 624 is configured to receive media data in the sub-segment corresponding to the predetermined re-sorting attribute sent by the server.
  • the embodiment of the present invention physically stores the media data satisfying the rearrangement attribute in the segments in the fragment to form a sub-segment corresponding to the rearrangement attribute; and implements the technical solution of adding the index information of the sub-segment And arranging the media data in the segment in the fragment according to different rearrangement attributes to form a sub-segment corresponding to different rearrangement attributes; acquiring index information of the sub-segment; and calculating, according to the index information, a corresponding to the predetermined rearrangement attribute a byte range of the sub-segment; requesting the sub-segment corresponding to the predetermined re-arrangement attribute according to the byte range; implementing the technical solution of receiving the media data in the sub-segment corresponding to the predetermined re-arrangement attribute, the client
  • the media data corresponding to the predetermined rearrangement attribute can be obtained in the slice quickly and accurately.

Abstract

La présente invention porte sur un procédé, un appareil et un système de réarrangement et d'extraction de données multimédias dans un segment, qui appartiennent au domaine du traitement de données multimédias. Le procédé de réarrangement consiste à : segmenter un contenu multimédia; durant le processus de segmentation, stocker de façon continue et physique des données multimédias satisfaisant un attribut de réarrangement dans les fragments du segment, et composer des sous-fragments correspondant à l'attribut de réarrangement, les données multimédias étant composées d'échantillons ou de sous-échantillons; ajouter des informations d'index des sous-fragments, les informations d'index comprenant les informations d'attribut de réarrangement et des informations d'emplacement du sous-fragment; obtenir les informations d'index des sous-fragments, les informations d'index comprenant les informations d'attribut de réarrangement et des informations d'emplacement du sous-fragment; calculer la plage d'octet des sous-fragments correspondant à un attribut de réarrangement prédéterminé conformément aux informations d'index; et demander et recevoir les sous-fragments correspondant à l'attribut de réarrangement prédéterminé conformément à la plage de l'octet. Cela permet au client d'obtenir les données multimédias correspondant à l'attribut de réarrangement dans les segments de manière rapide et précise.
PCT/CN2011/074716 2011-05-26 2011-05-26 Procédé, appareil et système de réarrangement et d'extraction de données multimédias dans un segment WO2011144097A2 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201180000721.7A CN102217313B (zh) 2011-05-26 2011-05-26 重排、抽取分片中媒体数据的方法、设备及系统
PCT/CN2011/074716 WO2011144097A2 (fr) 2011-05-26 2011-05-26 Procédé, appareil et système de réarrangement et d'extraction de données multimédias dans un segment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2011/074716 WO2011144097A2 (fr) 2011-05-26 2011-05-26 Procédé, appareil et système de réarrangement et d'extraction de données multimédias dans un segment

Publications (2)

Publication Number Publication Date
WO2011144097A2 true WO2011144097A2 (fr) 2011-11-24
WO2011144097A3 WO2011144097A3 (fr) 2012-04-26

Family

ID=44746764

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/074716 WO2011144097A2 (fr) 2011-05-26 2011-05-26 Procédé, appareil et système de réarrangement et d'extraction de données multimédias dans un segment

Country Status (2)

Country Link
CN (1) CN102217313B (fr)
WO (1) WO2011144097A2 (fr)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140111280A (ko) * 2012-01-09 2014-09-18 톰슨 라이센싱 시간-시프트 데이터의 관리
KR102304687B1 (ko) 2013-07-22 2021-09-27 소니그룹주식회사 정보 처리 장치 및 방법
WO2015123861A1 (fr) * 2014-02-21 2015-08-27 华为技术有限公司 Procédé de traitement de vidéo, terminal et serveur
WO2016127862A1 (fr) * 2015-02-13 2016-08-18 上海交通大学 Procédé de mise en œuvre de présentation personnalisée de contenu multimédia associé, et application
CN106027337B (zh) * 2016-05-11 2019-04-05 百度在线网络技术（北京）有限公司 智能家居平台、应用于其中的网络供应商选择方法和装置
CN107071548B (zh) * 2017-04-20 2020-08-28 北京搜狐新媒体信息技术有限公司 一种视频处理方法及系统
CN108769789B (zh) * 2018-05-31 2021-07-30 海能达通信股份有限公司 一种基于切片的rtp流媒体存储、读取方法及装置
WO2019227366A1 (fr) * 2018-05-31 2019-12-05 海能达通信股份有限公司 Procédé et dispositif de stockage de support de diffusion en continu rtp basé sur une tranche, et procédé et dispositif de lecture de support de diffusion en continu rtp basé sur une tranche
CN116744007A (zh) * 2022-04-22 2023-09-12 腾讯科技（深圳）有限公司 点云媒体的编解码方法及相关产品

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040019901A1 (en) * 2002-04-29 2004-01-29 The Boeing Company Methodology for display/distribution of multiple content versions based on demographics
CN1650624A (zh) * 2002-04-26 2005-08-03 松下电器产业株式会社 逆多路复用装置
US20100318600A1 (en) * 2009-06-15 2010-12-16 David Furbeck Methods and apparatus to facilitate client controlled sessionless adaptation

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1650624A (zh) * 2002-04-26 2005-08-03 松下电器产业株式会社 逆多路复用装置
US20040019901A1 (en) * 2002-04-29 2004-01-29 The Boeing Company Methodology for display/distribution of multiple content versions based on demographics
US20100318600A1 (en) * 2009-06-15 2010-12-16 David Furbeck Methods and apparatus to facilitate client controlled sessionless adaptation

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
'Technical Specification, 3rd Generation Partnership Project, Technical Specification Group Services and System Aspects, Transparent end-to-end' 3GPP TS 26.234 V9.3.0 June 2010, *

Also Published As

Publication number Publication date
CN102217313A (zh) 2011-10-12
WO2011144097A3 (fr) 2012-04-26
CN102217313B (zh) 2013-10-02

Similar Documents

Publication Publication Date Title
WO2011144097A2 (fr) Procédé, appareil et système de réarrangement et d'extraction de données multimédias dans un segment
RU2681086C1 (ru) Способ, устройство и компьютерная программа для инкапсуляции масштабируемых разделенных данных мультимедиа с временной привязкой
JP6665126B2 (ja) マルチメディアシステムにおけるメディアパケット復号方法及び復号装置
JP6177839B2 (ja) データ伝送方法及び装置、並びにデータ受信方法及び装置
JP6058677B2 (ja) ネットワークを通じてのメディアデータのストリーミングに関するセグメントの特徴のシグナリング
US9532114B2 (en) Optimizing caches for media streaming
CN103069769B (zh) 用于经译码视频数据的网络串流传输的特技模式
US8898228B2 (en) Methods and systems for scalable video chunking
JP5953307B2 (ja) クライアント、コンテンツクリエータエンティティ及びそれらがメディアストリーミングする方法
WO2018014691A1 (fr) Procédé et dispositif d'acquisition de données multimédia
TW201711478A (zh) 用於儲存媒體片段之基於目錄限制之系統及方法
CN1764974A (zh) 存储多媒体数据的存储介质和再现多媒体数据的方法和设备
CN103843301A (zh) 经译码多媒体数据的网络串流期间的表示之间的切换
WO2009131286A1 (fr) Système de fourniture et de reproduction de vidéo extensible et procédés associés
TW201909007A (zh) 使用用於檔案格式邏輯框之一通用描述符處理媒體資料
WO2012162995A1 (fr) Procédé et dispositif pour la transmission de données multimédias diffusées en continu
WO2015123861A1 (fr) Procédé de traitement de vidéo, terminal et serveur
CN108810567B (zh) 一种音频与视频视角匹配的方法、客户端和服务器
WO2018014545A1 (fr) Procédé et appareil de traitement de données de flux de code
WO2012071932A1 (fr) Méthode et système de lancement rapide d'une émission segmentée
WO2013021167A1 (fr) Procédés et systèmes de fourniture de données de fichier pour des fichiers vidéo
CN115396647A (zh) 一种沉浸媒体的数据处理方法、装置、设备及存储介质
KR20110129064A (ko) 콘텐트 가상 세그멘테이션 방법과, 이를 이용한 스트리밍 서비스 제공 방법 및 시스템
TW202236856A (zh) 媒體資料的後台資料流量分配
CN104080013A (zh) 特效播放方法及装置

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201180000721.7

Country of ref document: CN

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11783014

Country of ref document: EP

Kind code of ref document: A2