WO2019131200A1 - Décodeur, procédé de décodage et programme - Google Patents

Décodeur, procédé de décodage et programme Download PDF

Info

Publication number
WO2019131200A1
WO2019131200A1 PCT/JP2018/046020 JP2018046020W WO2019131200A1 WO 2019131200 A1 WO2019131200 A1 WO 2019131200A1 JP 2018046020 W JP2018046020 W JP 2018046020W WO 2019131200 A1 WO2019131200 A1 WO 2019131200A1
Authority
WO
WIPO (PCT)
Prior art keywords
web resource
web
media segment
metabox
segment
Prior art date
Application number
PCT/JP2018/046020
Other languages
English (en)
Japanese (ja)
Inventor
五十嵐　卓也
高林　和彦
山岸　靖明
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Publication of WO2019131200A1 publication Critical patent/WO2019131200A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments

Definitions

  • the present disclosure relates to a decrypting device, a decrypting method, and a program, and more particularly, to a decrypting device and a decrypting method capable of improving convenience when streaming distribution content using MPEG-DASH, MPEG-CMAF or the like. , And the program.
  • MPEG-DASH Moving Picture Experts Group-Dynamic Adaptive Streaming over HTTP
  • MPEG-CMAF Moving Picture Experts Group-Common Media Application Format for Segmented Media
  • a metabox of ISO Base Media File Format (ISOBMFF) is used to configure a Web application such as HTML5 (HyperText Markup Language 5) or JavaScript (registered trademark).
  • ISOBMFF's MetaBox is disclosed in Non-Patent Document 1
  • MPEG-CMAF is formulated in Non-Patent Document 2.
  • Part 12 ISO base media file format (ISO / IEC 14496-12: 2015) Information technology-Multimedia application forma .
  • Part 19 Common media application format for segmented media (ISO / IEC 23000-19: 2018)
  • the present disclosure has been made in view of such a situation, and is intended to improve convenience when streaming distribution content using MPEG-DASH, MPEG-CMAF, or the like.
  • the decryption apparatus refers to the Item Information Entry stored in the MetaBox of the initialization segment in which the Web Resource of the delivery content is distributed and disposed in a plurality of media segments and used in the delivery content. And an access unit for accessing the Web Resource stored in the identified media segment to be accessed.
  • the decryption device is configured such that the Web Resource of the delivery content is distributed and disposed in a plurality of media segments, and Item Information stored in MetaBox of the initialization segment used in the delivery content Referencing the Entry, and accessing the Web Resource stored in the identified media segment to be accessed.
  • the program according to one aspect of the present disclosure is an item in which the Web Resource of the distribution content is distributed to a plurality of media segments and arranged in the computer of the decryption apparatus, and stored in the MetaBox of the initialization segment used in the distribution content.
  • Information decryption is performed by referring to Information Entry and accessing the Web Resource stored in the identified media segment to be accessed.
  • the Web Resource of the distribution content is distributed and disposed in a plurality of media segments, and the Item Information Entry stored in the MetaBox of the initialization segment used in the distribution content is referred to and accessed.
  • the Web Resource stored in the specified media segment to be targeted is accessed.
  • FIG. 6 is a diagram showing an example of a web application that changes the display in accordance with the playback time of A / V content. It is a figure which shows the example of a display of "index. html.” It is a figure explaining an ISOBMFF file. It is a figure which shows the structure of the media segment file which is PT0S. It is a figure which shows the structure of the media segment file which is PT60S. It is a figure explaining an initialization segment.
  • FIG. 1 is a block diagram illustrating a configuration example of an embodiment of a delivery system to which the present technology is applied.
  • FIG. 16 is a first flowchart illustrating a process of randomly accessing Web Resource.
  • FIG. It is a flowchart explaining an Extent read-in process.
  • It is a 2nd flow chart explaining processing to access Web Resource at random.
  • It is the 3rd flowchart which explains the processing which randomizes to Web Resource.
  • Fig. 21 is a block diagram illustrating a configuration example of an embodiment of a computer to which the present technology is applied.
  • FIG. 1 shows an example of the configuration of an ISOBMFF file and a client terminal.
  • FIG. 1 shows an example of an ISOBMFF file in which two Web Resources of “index.htm” and “image1.jpg” and “image2.jpg” are recorded in MetaBox.
  • DataReferenceEntryURL instead of LocationInformationBox ('iloc') in MetaBox of the ISOBMFF file, it is also possible to reference Web Resource placed on a server of the Internet from Item Information Entry ('infe').
  • an ISOBMFF file containing both A / V content and a web application is distributed via, for example, the Internet, storage media, and the like.
  • the client terminal 11 is configured to include a web engine 12, an A / V player 13, an image superimposing unit 14, an audio mixing unit 15, a display 16, and a speaker 17.
  • the client terminal 11 is configured by mounting the web engine 12 and the A / V player 13 on a smartphone, a television receiver, or the like.
  • the client terminal 11 After an image obtained by processing the ISOBMFF file by the web engine 12 and the A / V player 13 is supplied to the image superimposing unit 14, and the respective images are superimposed in the image superimposing unit 14, It is displayed on the display 16. Similarly, in the client terminal 11, the audio obtained by processing the ISOBMFF file by the web engine 12 and the A / V player 13 is supplied to the audio mixing unit 15, and the respective sounds are mixed by the audio mixing unit 15. After that, it is outputted from the speaker 17.
  • index. Html is recorded as a Primary Resource indicated by a Primary Item Box ('pitm), and an entry of a Web application started at the start of A / V content playback. Indicates that it is Page.
  • ISOBMFF files obtained by fragmenting ISOBMFF files are often used as MPEG-DASH contents.
  • MPEG-DASH treats a group of fragments consisting of one or more MovieFragmentBox (moof) and MediaDataBox (mdat) pairs (pairs) as a media segment, and encodes a media segment encoded at multiple bit rates described by MPD. By preparing it, bandwidth adaptive streaming is realized.
  • FIG. 2 shows an example in which Web Resources recorded in MovieFragmentBox (moof) of each media segment are distributed and arranged.
  • “index.html” and “image1.jpg” are delivered when the first playback start time (0 second), which is the beginning of A / V content, is started, and the web engine 12 Display “and“ image1.jpg ”on the display 16. After that, the second playback start time (60 seconds) is reached, and “image2.jpg” is delivered at the timing when “image2.jpg” is used, and the web engine 12 replaces “image1.jpg” with “image2 “. jpg” is displayed on the display 16. Then, the web engine 12 hides “image2.jpg” at the timing when the third reproduction start time (90 seconds) is reached.
  • the ISOBMFF file is assumed to be used in such a web application.
  • FIG. 2 An example of the web application which changes a display according to the reproduction time of A / V content as shown in FIG. 2 is shown by FIG. 2, and FIG. 4 shows the web engine 12 of such a web application.
  • the example of display of "index. Html” by processing is shown. That is, as shown in FIG. 4, when “image1.jpg” is displayed from the reproduction time 0 on the display 16 when it is superimposed on file.mp4 processed by the A / V player 13 and the reproduction time is 60 seconds. It is changed from "image1.jpg” to "image2.jpg” and “image2.jpg” is displayed up to 90 seconds.
  • processing can be efficiently performed when performing streaming reproduction continuously from the first reproduction start time (0 second) which is the head of A / V content.
  • playback is performed from the second playback start time (for example, 60 seconds) other than the head of the A / V content or the third playback start time (for example, 90 seconds)
  • the second playback start time for example, 60 seconds
  • the third playback start time for example, 90 seconds
  • the Web Resource update date and expiration date were not known.
  • the client terminal 11 could not efficiently perform caching of Web Resources. In other words, there is a need for the client terminal 11 to use the cached Web Resource without receiving the Web Resource that has not been updated or expired. Therefore, it is required to be able to determine whether the Web Resource recorded in the ISOBMFF file is updated or expired.
  • the configuration example of the ISOBMFF file described below enables random access, achieves uniform bit rates, and does not waste bandwidth in carousel transmission.
  • the purpose is to realize quick start-up and enable determination of update and expiration of Web Resource recorded in the ISOBMFF file.
  • FIG. 5 shows an example of the configuration of an ISOBMFF file that enables random access.
  • the ISOBMFF file shown in FIG. 5 is distributed to each media segment of the ISOBMFF file used for the MPEG-DASH content, and Web Resources are arranged in “Just In Time Delivery”. Then, in the ISOBMFF file, the recording of the MetaBox is performed in the ItemLocatoinBox ('iloc') of the DataReferenceBox ('dref') corresponding thereto.
  • a URL (Uniform Resource Locator) in the DataReferenceBox ('dref') of MetaBox directly refers to the Web Resource of each media segment, or an Item in the media segment at the file level as follows: Indirect reference is performed using Information Entry.
  • the ISOBMFF file is configured such that the Web Resource of each media segment can be accessed from the Item Information Entry of the file level MetaBox.
  • the DataReferenceBox is used to directly refer to the Web Resource of each media segment in the URL, or an indirect reference using the MetaBox of the moof of each media segment is used. To be done.
  • a method of recording Web Resource in a media segment will be described by taking MPEG-DASH content in which the media segment includes moof and mdat as an example.
  • FIG. 6 shows the structure of a media segment file whose Earliest Presentation Time is PT0S when the ISOBMFF file is divided into a plurality of media segment files, that is, the structure of the media segment file at the beginning of the A / V content. It is done.
  • a MetaBox is arranged in moof, and the MetaBox records a Handler Box (hdlr), a Primary Item Box (pitm), an Information Location Box (iloc), and an Item Information Box (iinf) in addition to an Audio track.
  • hdlr Handler Box
  • pitm Primary Item Box
  • iloc Information Location Box
  • iinf Item Information Box
  • data_reference_index 0 it is indicated that the Extent of this Item is recorded in the same file.
  • the base-data-offset-present of moof Track Fragment Header Boxes 0
  • set default-base_is_moof 1
  • set moof and It is offset by the relative position within the segment consisting of mdat pairs.
  • the byte offset B0 from the beginning of the media segment file to index.html actually recorded in mdat is specified in the extent_offset of the extent of index.html.
  • L0 which is a file size of index. Html is recorded in extent_length.
  • the byte offset B1 is specified in extent_offset of extent of image1.jpg
  • L1 which is the file size of image1.jpg is recorded in extent_length.
  • an Item to be loaded first in the HTML web application is specified.
  • the web engine 12 loads index.html first.
  • FIG. 7 shows the structure of the media segment file whose Earliest Presentation Time is PT60S, that is, the structure of the media segment to be played back after 60 seconds when playback is started from the beginning of the A / V content.
  • the Web Resource can be recorded in each media segment by MetaBox that can be realized by the ISOBMFF standard. Then, in the present embodiment, as described below, the MetaBox is recorded in the initialization segment (header). This enables random access to the web resource of the media segment.
  • the iBox of MetaBox arranged in moov and the item of Web Resource placed in each media segment are recorded in a total of three Item Information Box Entries, and item_name is index.html, image1.jpg , Image2.jpg.
  • item_name is index.html, image1.jpg , Image2.jpg.
  • the storage location of each Item is recorded in iloc, and other than 0 is specified in data reference, which arranges dinf (DataInformationBox) so that other files can be referred to indirectly by URL. Make it
  • This is a URL meaning that it refers indirectly to an Item called index.html in which Earliest Presentation Time of the media segment of the ISOBMFF file is in Track_1 of PT0S.
  • This is a URL that means that Earliest Presentation Time of the media segment of the ISOBMFF file directly refers to the segment file of PT0S.
  • a non-zero value is specified in extent_offset described in iloc of the Item of the corresponding Item of the MetaBox of the reference source initialization segment It will be
  • the web engine 12 will Random access to Web Resources included in the segment is possible.
  • the method of referring to the Web Resource recorded in MetaBox of the media segment shown in FIG. 8 by the URL is the playback time of the playback time such as Timed text tracks and Timed metadata track specified in ISO / IEC 14496-30. It is also available as a Web Resource (called "Timed Web Assets”) with timing information.
  • Extent of Image2.jpg is substantially equally divided into three partial extents (division data).
  • the file size of the first portion Extent is B2-1 bytes, and Earliest Presentation Time is stored in a media segment of 60 seconds.
  • the file size of the second portion Extent is B2-2 bytes, and is stored in a media segment whose Earliest Presentation Time is 61 seconds.
  • the file size of the third portion Extent is B2-3 bytes, and the Earliest Presentation Time is stored in the media segment of 62 seconds.
  • FIG. 12 shows an example of the MetaBox of the initialization segment in a configuration in which Extents of Web Resource are arranged in a plurality of media segments.
  • the web engine 12 of FIG. 1 obtains image2.jpg by acquiring extents of items including item2.name from item_name from three segments whose Earliest presentation times are 60S, 61S, and 62S. can do.
  • MPEG-DASH Live Profile is used, and each media segment will be transmitted as a separate file. Although it is possible to record the Web resource of the Web application in this media segment, random access can not be performed because of one-way transmission.
  • the unit of aggregation of index. Html, image1.jpg, image2.jpg is repeatedly transmitted.
  • the index. Html of the interactive Web application linked to the broadcast service. Can be launched.
  • the client terminal 11 waits until receiving the media segment including the index.html, which causes a delay in activation of the Web application.
  • Bundle Item Information Box extended Item Information Box is provided, and it is possible to explicitly indicate that items stored in the subsequent media segment are to be used collectively. Let's do it.
  • FIG. 14 shows the format of the Bundle Information Box.
  • the Bundle Information Box is placed in the MetaBox together with the Item Information Box. And when using this Item Information Box, it is to be used together when the Web Resource indicated by item_name written in Bundle ItemInfoEntry is received by Item in Item Information Item of the subsequent media segment. It shows.
  • FIG. 15 shows an example of a media segment including a bundle information box.
  • a segment file with an Earliest presentation time of 0 seconds has a Primary Item Box, and an Item of index.html is shown in the Primary Item Box.
  • the item of image1.jpg is shown in BundleInformationBox (binf). Therefore, the web engine 12 of the client terminal 11 loads index.html after receiving image1.jpg contained in the next one-second segment file to start index.html.
  • a media segment file of MPEG-DASH is applied to a target advertisement of broadcasting.
  • a target advertisement of broadcasting For example, when they are stored as a Web Resource in an ISOBMFF file, they have a Bundle Information Box together with Item Information including the top segment file of the segment file group corresponding to the advertisement period. Then, by listing other segment files in the item as a Bundle Information Entry, it is possible to replace the advertisement only when all segment files of the advertisement period have been received.
  • the Web application displays an advertisement while all segment files can not be received, it is assumed that a significant problem occurs because the advertisement can not be displayed correctly. On the other hand, occurrence of such a problem can be avoided by using the media segment including the Bundle Information Box as described above.
  • FIG. 16 shows an example of ItemInfoEntry expanded to indicate that the Web Resource stored in the ISOBMFF file has been updated if it has been updated.
  • ItemInfoEntry is extended to be able to record values equivalent to the Last_Modified and RFC-7243 Expires headers specified in RFC 7232 of the IETF.
  • FIG. 17 shows an example of a media segment in which the Information Box (iinf) is expanded.
  • the URL (Reference URL) of dinf is specified as https: //example/log/image2.jpg.
  • the web engine 12 when the web engine 12 is connected to the Internet, it is updated by specifying Last_modifed recorded in item entry info in the "If Modifed-Since" header in the HTTP GET request to the URL. You can only get files provided by other devices on the Internet. It is also possible to invalidate the cached file by notifying the web engine 12 of Expires of item entry info, and replace the cached data with a new file.
  • the client terminal 11 which is a DASH player may or may not reproduce Web Resource by the Web engine 12 when reproducing the A / V content of this MPD.
  • it is an EssentialProperty, it indicates that the Web Resource must be played back to play the Period.
  • DASH players that do not support web engine 12 need to either skip Period playback or play their entire MPD.
  • the Web Resource specified in the Primary Item Box in the MetaBox of the ISOBMFF initialization file is loaded by the Web engine 12 as an Entry Page.
  • the first Period indicates an example of SupplementalProperty.
  • this EssentialProperty can optionally have an attribute called value, and the value shows that Web Resources other than Primary Item written in Meta Box of the initialization segment are loaded as Entry Page ing.
  • the Web resource named index2.html recorded in the media segment whose Earliest Presentation Time in the media segment of Period is 60 seconds is entered It shows that it starts. For example, if a Supplemental Property of url: mpeg: EmbeddedEntrypageURL "is placed in the Adaptation Set, it is possible to change the Entry Page for each language of the Adaptation Set.
  • the third Period has a ScehemeIdUrl of url: mpeg: EntrypageURL "as a SupplementalProperty, which is stored in ISOBMFF and not provided by Web Resource, but is provided from an Internet Web server and is defined as Web Resource as Entry page. Even in DASH content that does not include Web Resource, Web Application can be played simultaneously with A / V content.
  • the network distribution system 21 is configured by connecting the client terminal 11 to the server device 23 via the network 22. Then, in the network distribution system 21, the distribution data generated by the distribution data generation device 24 is distributed to the client terminal 11 by the server device 23.
  • the client terminal 11 includes a decryption unit 31 that decrypts MPEG-DASH content.
  • the decryption unit 31 includes the media segment identification unit 32 and the Web Resource in addition to the web engine 12 and the A / V player 13 shown in FIG. It comprises the access part 33 and is comprised.
  • the media segment specifying unit 32 is a media segment requested according to the playback time of the MPEG-DASH content by the web engine 12 (for example, a media segment in which a web resource to be subjected to random access by the web resource access unit 33 is arranged) Identify).
  • the Web Resource access unit 33 accesses the Web Resource disposed in the media segment identified by the media segment identification unit 32 (for example, the media segment identified with reference to Item Information Entry stored in the MetaBox). .
  • the processing performed by the media segment identification unit 32 and the Web Resource access unit 33 will be described with reference to the flowcharts of FIGS.
  • the server device 23 is configured to distribute the corresponding Web Resource at the timing when the Web engine 12 of the client terminal 11 uses the Web Resource.
  • the delivery data generation device 24 includes an encoding unit 41 that encodes MPEG-DASH content, and the encoding unit 41 includes a segment file generation unit 42 and a media segment processing unit 43.
  • the segment file generation unit 42 generates a segment file as described above, and the media segment processing unit 43 divides the Web Resource into, for example, a predetermined number of divided data substantially equally, and the predetermined Earliest Presentation Time is continuous. Perform processing such as arranging in a number of media segments.
  • the distribution data generation device 24 uploads the MPEG-DASH content, for which the segment file generation unit 42 has generated a segment file and the media segment processing unit 43 has processed the media segment, to the server device 23 and distributes it. .
  • the initialization segment and the media segment are stored in one ISOBMFF file, and the segment index is used at the ISOBMFF file level.
  • Web resource random access is performed when the decryption unit 31 in FIG. 19 indirectly refers to the Item referred to by the MetaBox of the initialization segment from the Item referred to by the MetaBox of the segment file. The process to be performed will be described.
  • the decryption unit 31 starts processing when the Web engine 12 requests a Web Resource designated by a URL (for example, image2.jpg or the like) indicating item_name. Then, in step S11, the media segment identification unit 32 recognizes a URL indicating item_name of the Web Resource.
  • a URL for example, image2.jpg or the like
  • step S12 the media segment identification unit 32 reads the MetaBox from the ISOBMFF file or the moof of the ISOBMFF file.
  • step S13 the media segment identification unit 32 searches for items that match the URL recognized in step S11 from the item information entry (infe) recorded in the item information box (iinf) in the MetaBox read out in step S12. Do.
  • step S14 the media segment identification unit 32 determines whether or not infe matching the URL recognized in step S11 has been detected as a result of the search in step S13.
  • step S14 when the media segment identification unit 32 determines that the infe that matches the URL recognized in step S11 can not be detected, the process proceeds to step S15. Then, in step S15, the media segment identification unit 32 returns an error response code (for example, 404 Not Found) indicating no detection to the web engine 12, and the process is ended.
  • error response code for example, 404 Not Found
  • step S14 determines in step S14 that the infe matching the URL recognized in step S11 has been detected.
  • step S16 the Web Resource access unit 33 performs an extent reading process (see FIG. 21) for reading the extent based on the infe detected by the media segment identification unit 32 in step S13.
  • step S17 the Web Resource access unit 33 causes the web engine 12 to read the data read in the Extent read process of step S16 together with the normal response code (for example, OK 200 etc.), ie, the web resource specified by the web engine 12. After returning, the process ends.
  • the normal response code for example, OK 200 etc.
  • FIG. 21 is a flowchart for explaining the Extent reading process performed in step S16 of FIG.
  • step S21 the Web Resource access unit 33 searches the item location box in the MetaBox for an item having an item_id that matches the Item Information Entry (infe) identified by the media segment identification unit 32.
  • step S22 as a result of the search in step S21, the Web Resource access unit 33 determines whether or not an item having an item_id that matches the infe identified by the media segment identification unit 32 has been detected.
  • step S22 the Web Resource access unit 33 determines that the item having the item_id that matches the infe specified by the media segment specification unit 32 can not be detected, the process proceeds to step S15 of FIG. Is done.
  • step S22 when the Web Resource access unit 33 determines that the item having the item_id that matches the detected infe has been detected, the processing proceeds to step S23.
  • step S23 the Web Resource access unit 33 determines whether the data_reference_index of the detected item is 0 or not.
  • step S23 when the Web Resource access unit 33 determines that the data_reference_index of the detected item is 0, the process proceeds to step S24.
  • step S24 the Web Resource access unit 33 reads data for extent_length from the byte position of the extent_offset of the file, and after setting it as extent, the process proceeds to step S17 in FIG. 20 and the above-described process is performed.
  • step S23 when the Web Resource access unit 33 determines that the data_reference_index of the detected item is not 0, the processing proceeds to step S31 in FIG.
  • the media segment identification unit 32 reads the URL of the DataReference immediately preceding data_reference_index (data_reference_index-1) from DataInformationBox (dinf) in the MetaBox.
  • step S32 the media segment identification unit 32 determines whether the URL of the DataReference read in step S31 is a reference URL including # presentation Time.
  • step S32 when the media segment specifying unit 32 determines that the URL of DataReference is not a reference URL including # presentation Time, the process proceeds to step S33.
  • step S33 the Web Resource access unit 33 reads the file of the DataReference URL identified by the media segment identification unit 32 from the Internet using HTTPS (Hypertext Transfer Protocol Secure). Then, the media segment identification unit 32 sets the read file as the corresponding Web Resource.
  • HTTPS Hypertext Transfer Protocol Secure
  • step S34 the Web Resource access unit 33 determines whether the reading of the file in step S33 has succeeded.
  • step S34 when the Web Resource access unit 33 determines that reading of the file in step S33 is successful, the process proceeds to step S17 in FIG. 20, and the above-described process is performed.
  • step S34 determines in step S34 that the reading of the file in step S33 has not succeeded (failed)
  • the process proceeds to step S35.
  • step S35 after the media segment identification unit 32 returns an HTTP error code to the web engine 12, the process is terminated.
  • step S32 when the media segment specifying unit 32 determines that the URL of the DataReference is a reference URL including #presentationTime in step S32, the process proceeds to step S41 of FIG.
  • the media segment identification unit 32 refers to the segment index of the ISOBMFF file and sets it as the media segment target of the range specified by # presentation_item and duration (range information).
  • step S42 the media segment identification unit 32 reads the MetaBox of the target media segment from the ISOBMFF file.
  • step S43 the media segment identification unit 32 searches the Item Information Entry ('infe') of the Information Box (iinf) in the MetaBox for a item whose item_name matches the URL. At this time, the media segment identification unit 32 ignores the symbol after the # symbol of item_name.
  • step S44 the media segment specifying unit 32 determines whether or not infe in which item_name matches the URL has been detected as a result of the search in step S43.
  • step S44 when the media segment specifying unit 32 determines that the item in which item_name matches the URL can not be detected, the process proceeds to step S15 in FIG. 20, and the above-described process is performed.
  • step S44 determines in step S44 that the infe in which the item_name matches the URL has been detected.
  • step S45 the Web Resource access unit 33 performs the same extent read processing as described above with reference to FIG. 21, and sets the corresponding web resource as a partial extent.
  • step S46 the media segment identification unit 32 determines whether all target media segments have been processed.
  • step S46 If it is determined in step S46 that the media segment identification unit 32 does not process all target media segments, the process returns to step S42, and the same process is repeated.
  • step S46 determines in step S46 that all the target media segments have been processed
  • step S47 the Web Resource access unit 33 combines the partial extents read by repeating the processing from step S42 to step S45, and after acquiring the entire extent of the Web Resource, the process proceeds to step S17 of FIG. The process proceeds as described above.
  • the decryption unit 31 The process of will be described.
  • step S12 of FIG. 20 and the process of step S41 of FIG. are performed similarly.
  • step S12 of FIG. 20 processing for reading the MetaBox from the ISOBMFF file or the moof of the ISOBMFF file is performed.
  • step S12 of FIG. 20 processing for reading the MetaBox from the ISOBMFF file or the moof of the ISOBMFF file is performed.
  • step S12 of FIG. 20 processing for reading the MetaBox from the ISOBMFF file or the moof of the ISOBMFF file is performed.
  • step S12 of FIG. 20 processing for reading the MetaBox from the ISOBMFF file or the moof of the ISOBMFF file is performed.
  • the Live Profile processing is performed to read out the MetaBox of the Initization Segment file indicated by the MPD of MPEG-DASH.
  • step S41 of FIG. 23 processing is performed for media segments in the range designated by # presentation_item and duration with reference to Segment Index of the ISOBMFF file.
  • the MPD of the MPEG-DASH is referred to, the URL of the media segment file in the range designated by # presentation_item and the duration is specified, and the processing targeting these media segments is performed.
  • the series of processes (decoding method) described above can be performed by hardware or software.
  • the various functions are executed by installing a computer in which a program constituting the software is incorporated in dedicated hardware or various programs.
  • the program can be installed, for example, on a general-purpose personal computer from a program recording medium on which the program is recorded.
  • FIG. 24 is a block diagram showing an example of a hardware configuration of a computer that executes the series of processes described above according to a program.
  • a central processing unit (CPU) 101 a read only memory (ROM) 102, and a random access memory (RAM) 103 are mutually connected by a bus 104.
  • CPU central processing unit
  • ROM read only memory
  • RAM random access memory
  • the input / output interface 105 is connected to the bus 104.
  • the input / output interface 105 includes an input unit 106 including a keyboard, a mouse and a microphone, an output unit 107 including a display and a speaker, a storage unit 108 including a hard disk and a non-volatile memory, and a communication unit 109 including a network interface.
  • a drive 110 for driving a removable medium 111 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is connected.
  • the CPU 101 loads the program stored in the storage unit 108 into the RAM 103 via the input / output interface 105 and the bus 104 and executes the program. Processing is performed.
  • the program executed by the computer (CPU 101) is, for example, a magnetic disk (including a flexible disk), an optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.), a magneto-optical disk, or a semiconductor It is recorded on a removable medium 111 which is a package medium including a memory or the like, or is provided via a wired or wireless transmission medium such as a local area network, the Internet, and digital satellite broadcasting.
  • the program can be installed in the storage unit 108 via the input / output interface 105 by mounting the removable media 111 in the drive 110.
  • the program can be received by the communication unit 109 via a wired or wireless transmission medium and installed in the storage unit 108.
  • the program can be installed in advance in the ROM 102 or the storage unit 108.
  • the present technology can also have the following configurations.
  • the Web Resource of the distribution content is distributed and arranged in a plurality of media segments, and the Item Information Entry stored in the MetaBox of the initialization segment used in the distribution content is referred to, and the identified target to be accessed
  • a decryption apparatus comprising: an access unit for accessing the Web Resource stored in a media segment.
  • the delivery content is an MP4 file format, and The decryption apparatus according to (1), wherein the Item Information Entry is stored in an Information Box in the Meta Box.
  • the decryption apparatus includes information for indirectly referring to Item Information Entry in the MetaBox of the plurality of media segments used for the delivery content.
  • the decryption apparatus according to any one of (1) to (3), further comprising: a media segment identification unit that identifies the media segment in which the Web Resource to be accessed is arranged.
  • the decryption apparatus according to (4), wherein the access unit randomly accesses the Web Resource identified by the media segment identification unit.
  • the media on which the Web Resource is arranged so that the Item Information Entry stored in the MetaBox of the media segment of the reference destination can be accessed Information indicating the Earliest Presentation Time applicable to the segment is described,
  • the decryption apparatus according to any one of (1) to (5), wherein the access unit accesses the Web Resource using information indicating the Earliest Presentation Time.
  • the information indicating the Earliest Presentation Time is recorded as a URL (Uniform Resource Locator) of the DataReferenceBox in the MetaBox of the reference source, The decryption apparatus according to (6), wherein the access unit accesses the Web Resource using the URL.
  • a media segment identification unit that identifies the media segment to be accessed based on the Earliest Presentation Time described in the URL and information on the delivery content
  • the decryption apparatus accesses the Web Resource from a MetaBox stored in the media segment identified by the media segment identification unit.
  • the Web Resource is divided substantially equally into a predetermined number of divided data, and each of the divided data is arranged in a predetermined number of the media segments in which Earliest Presentation Time is continuous,
  • the decryption apparatus according to any one of (1) to (8), wherein the access unit acquires the entire Web Resource by collecting and combining the divided data.
  • the MetaBox indicating the byte offset and byte size in the media segment is recorded,
  • (13) When the Web Resource used when launching a Web Application and the Web Resource not used when launching are recorded and transmitted in separate Media Segments, In the Primary Item Box of the MetaBox, the Web Resource to be activated first is specified, and in the Meta Box, information indicating the other Web Resources necessary at the time of activation is listed.
  • the decryption unit according to any one of (1) to (12), wherein the access unit activates the Web Application after acquiring all of the plurality of Web Resources required at startup from the corresponding media segment.
  • Information indicating that the Web Resource has been updated or revoked is recorded in the Item Information Entry,
  • the decryption apparatus according to any one of (1) to (13), wherein the access unit accesses the Web Resource based on the information recorded in the Item Information Entry.
  • the decryption device according to (14), wherein the information indicating that the Web Resource has been updated or revoked is information corresponding to “Last Modified” and “Expires” headers defined by HTTP (Hypertext Transfer Protocol).
  • the access unit accesses the Web Resource provided from another device on the Internet indicated by the Reference URL corresponding to the Item Information Entry, when the Web Resource is updated or expired.
  • Decoding device 17.
  • the decryption device The Web Resource of the distribution content is distributed and arranged in a plurality of media segments, and the Item Information Entry stored in the MetaBox of the initialization segment used in the distribution content is referred to, and the identified target to be accessed
  • a decryption method comprising: accessing the Web Resource stored in a media segment.
  • the Web Resource of the distribution content is distributed and arranged in a plurality of media segments, and the Item Information Entry stored in the MetaBox of the initialization segment used in the distribution content is referred to, and the identified target to be accessed
  • a media segment processing unit that distributes and arranges web resources of distribution content into a plurality of media segments;
  • a segment file generation unit which stores Item Information Entry stored in the MetaBox of an initialization segment used in the distribution content in the media segment to be specified as an access target.
  • the delivery content is an MP4 file format
  • the encoding apparatus according to (20) wherein the segment file generation unit stores the Item Information Entry in an Information Box in the Meta Box.
  • the Web resource so that the segment file generation unit can access the Item Information Entry stored in the MetaBox of the media segment to be referred to in the Item Information Entry of the reference source stored in the initialization segment.
  • the coding apparatus according to any one of the above (20) to (22), which describes information indicating Earliest Presentation Time that corresponds to the media segment in which is placed.
  • the encoding apparatus (23), wherein the segment file generation unit records the information indicating the Earliest Presentation Time as a URL (Uniform Resource Locator) of a DataReferenceBox in the MetaBox of the reference source.
  • the media segment processing unit arranges each of the divided data in a predetermined number of media segments in which Earliest Presentation Time is continuous such that the Web Resource is divided substantially equally into the predetermined number of divided data.
  • the encoding apparatus as described in (20).
  • the segment file generation unit is configured to associate the Earliest of each of the media segments in which a predetermined number of divided data pieces into which the Web Resource is divided is arranged in the URL for the Item Information Entry of the MetaBox referred to by the initialization segment.
  • the encoding device including range information of Presentation Time.
  • the segment file generation unit records the divided data in the Web Resource in each of the predetermined number of media segments when one of the Web Resources is divided into the predetermined number of divided data and arranged in the media segment.
  • the encoding apparatus which records the MetaBox indicating a byte offset and a byte size in the media segment in the range.
  • the segment file generation unit is configured to indicate, in the MetaBox, a byte offset of the divided data in the Web Resource and an entire byte of the Web Resource to indicate which part of the Web Resource divided into a predetermined number.
  • the encoding device which records the size.
  • the segment file generation unit designates, in the Primary Item Box of the MetaBox, the Web Resource to be activated first, and enumerates, in the Meta Box, information indicating the other Web Resources necessary for activation.
  • the encoding device as described in 2.).
  • the information indicating that the Web Resource has been updated or revoked is the information corresponding to the "Last Modified" and "Expires" headers defined in HTTP (Hypertext Transfer Protocol).
  • the encoding apparatus according to (30) above .
  • (32) The Web Resource of the distribution content is distributed and arranged in a plurality of media segments, and the Item Information Entry stored in the MetaBox of the initialization segment used in the distribution content is referred to, and the identified target to be accessed
  • the delivery content is an MP4 file format, and The server apparatus according to (32), wherein the Item Information Entry is stored in an Information Box in the Meta Box.
  • (34) Delivering the Web Resource specified with reference to the Item Information Entry including information for indirectly referencing Item Information Entry in the MetaBox of a plurality of media segments used for the delivery content described in (32) above Server device.
  • the server apparatus which distributes the Web Resource that is identified and accessed based on the Earliest Presentation Time described in the URL and information related to the distribution content.
  • the web resource is divided substantially equally into a predetermined number of divided data, and each of the divided data is arranged in a predetermined number of the media segments in which Earliest Presentation Time is continuous.
  • Server device In the URL for the Item Information Entry of the MetaBox referred to by the initialization segment, range information of the Earliest Presentation Time of each of the media segments in which a predetermined number of divided data pieces into which the Web Resource is divided is arranged Included,
  • the server apparatus according to (38), which distributes the Web Resource accessed to the media segment corresponding to the range information.
  • each of the predetermined number of media segments is within the range in which the divided data in the Web Resource is recorded.
  • the MetaBox indicating the byte offset and byte size in the media segment is recorded,
  • the server apparatus according to (39) which delivers the Web Resource accessed using the MetaBox.
  • a byte offset of the divided data in the Web Resource and an entire byte size of the Web Resource are recorded to indicate which part of the Web Resource divided into a predetermined number is configured.

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

La présente invention concerne un décodeur, une méthode de décodage et un programme avec lequel il est possible d'améliorer la commodité de la diffusion en continu du contenu. Une ressource web de contenu de livraison est distribuée parmi une pluralité de segments multimédias, une entrée d'informations d'article stockée dans une métaboîte d'un segment d'initialisation qui est utilisé dans le contenu de livraison est désignée, et un objet à accéder est spécifié. L'accès aléatoire de la ressource web stockée dans le segment multimédia spécifié est effectué. La présente invention peut être appliquée, par exemple, à un service pour diffuser en continu un contenu sur internet à l'aide de MPEG-DASH, MPEG-CMAF, etc.
PCT/JP2018/046020 2017-12-28 2018-12-14 Décodeur, procédé de décodage et programme WO2019131200A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017254899 2017-12-28
JP2017-254899 2017-12-28

Publications (1)

Publication Number Publication Date
WO2019131200A1 true WO2019131200A1 (fr) 2019-07-04

Family

ID=67067241

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/046020 WO2019131200A1 (fr) 2017-12-28 2018-12-14 Décodeur, procédé de décodage et programme

Country Status (2)

Country Link
TW (1) TW201937938A (fr)
WO (1) WO2019131200A1 (fr)

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
QUALCOMM INCORPORATED: "Serlnter: Status of MPEG Interactivity Track", 3GPP TSG-SA4 MEETING #95 S4-170789, 9 October 2017 (2017-10-09), XP051348627, Retrieved from the Internet <URL:http://www.3gpp.org/ftp/TSG_SA/WG4_CODEC/TSGS4_95/Docs/S4-170789.zip(S4-170789.doc> [retrieved on 20190125] *

Also Published As

Publication number Publication date
TW201937938A (zh) 2019-09-16

Similar Documents

Publication Publication Date Title
US10523726B2 (en) Real-time or near real-time streaming
US10244272B2 (en) Systems and methods for playing back alternative streams of protected content protected using common cryptographic information
JP5748765B2 (ja) メインコンテンツに他のコンテンツを挿入して動作するストリーミング方法及び装置
US9426543B1 (en) Server-based video stitching
US8887215B2 (en) Targeted high-value content in HTTP streaming video on demand
US20170171094A1 (en) Playlists for real-time or near real-time streaming
KR101955363B1 (ko) 상부 레벨 인덱스 파일들을 자동적으로 생성하기 위한 시스템들 및 방법들
KR101535366B1 (ko) 실시간 또는 준 실시간 스트리밍을 위한 재생 리스트
ES2528406T3 (es) Método, terminal y servidor para realizar una reproducción rápida denominada trickplay
JP6088439B2 (ja) マルチメディアストリーミングシステムにおけるコンテンツの格納及び再生のための装置及びその方法
US20170195744A1 (en) Live-stream video advertisement system
WO2012096372A1 (fr) Dispositif de reproduction du contenu, procédé de reproduction de contenu, système de diffusion, programme de reproduction de contenu, support d&#39;enregistrement, et structure de données
KR20140019449A (ko) 실시간 또는 준 실시간 스트리밍을 위한 재생 리스트
TW201123795A (en) System, method and apparatus for dynamic media file streaming
CN105657443A (zh) 一种直播时移播放方法和系统
KR102499231B1 (ko) 수신 장치, 송신 장치 및 데이터 처리 방법
US20090024925A1 (en) System and method for creating and distributing derivative media work
KR102085192B1 (ko) 렌더링 시간 제어
WO2017185601A1 (fr) Procédé et dispositif permettant de fournir et de télécharger une vidéo
CN104410901A (zh) 一种m3u8格式直播流的播放方法及播放装置
US10284894B2 (en) Methods and apparatus for naming video content chunks
JP2022019932A (ja) 情報処理装置および情報処理方法
CN105992022A (zh) 一种在线录制下载方法及系统
JP2017069636A (ja) 情報処理装置、配信方法、及びプログラム
KR20080006443A (ko) 멀티미디어 편집/재생 시스템 및 그 동작방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18893538

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18893538

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP