WO2021052198A1 - Procédé et dispositif de lecture de contenu multimédia interactif - Google Patents

Procédé et dispositif de lecture de contenu multimédia interactif Download PDF

Info

Publication number
WO2021052198A1
WO2021052198A1 PCT/CN2020/113597 CN2020113597W WO2021052198A1 WO 2021052198 A1 WO2021052198 A1 WO 2021052198A1 CN 2020113597 W CN2020113597 W CN 2020113597W WO 2021052198 A1 WO2021052198 A1 WO 2021052198A1
Authority
WO
WIPO (PCT)
Prior art keywords
plot
branch
scenario
media content
content
Prior art date
Application number
PCT/CN2020/113597
Other languages
English (en)
Chinese (zh)
Inventor
闫旭伟
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2021052198A1 publication Critical patent/WO2021052198A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44222—Analytics of user selections, e.g. selection of programs or purchase activity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/437—Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk

Definitions

  • the embodiments of the present application relate to, but are not limited to, the field of interactive digital television, and more specifically to a method and device for playing interactive media content.
  • the current interactive digital TV field provides users with more and clearer digital media content, like traditional TV media content, users cannot really experience the joy of interactive movie watching, and most of the media content is limited to a single The viewing experience of the movie, that is, the content that all users watch has the same plot and ending, and users can only choose to watch different content according to their personal preferences.
  • some media content service providers have provided media content that can be selected for plot development, most of them are realized through customized application software, which has not been able to form a unified standardized process for use in the digital TV field. .
  • an embodiment of the present application provides a method for playing interactive media content, including: the client displays the plot branch options of the interactive media content, and different plot branches correspond to different plot content; when it is detected that the user selects all
  • the scenario content corresponding to the first scenario branch is requested from the streaming media server; the scenario content corresponding to the first scenario branch returned by the streaming media server is received and played.
  • the embodiment of the present application also provides a device for playing interactive media content, which is applied to the client, and includes: a display unit for the client to display the plot branch options of the interactive media content. Different plot branches correspond to different plot content.
  • Request unit used to request the streaming media server for the story content corresponding to the first story branch when it is detected that the user selects the first story branch in the branch option; the playing unit is used to receive and play the stream The story content corresponding to the first story branch returned by the media server.
  • An embodiment of the present application also provides a device for playing interactive media content, including a memory, a processor, and a computer program stored on the memory and running on the processor, and the computer program is processed by the processor.
  • the above method of playing interactive media content is realized when the device is executed.
  • the embodiment of the present application also provides a computer-readable storage medium having an information processing program stored on the computer-readable storage medium, and when the information processing program is executed by a processor, the steps of the above method for playing interactive media content are implemented .
  • FIG. 1 is a schematic flowchart of a method for playing interactive media content according to an embodiment of the application
  • FIG. 2 is a schematic flowchart of a method for playing interactive media content according to another embodiment of the application
  • FIG. 3 is a schematic diagram of multiple branches and multiple endings of interactive media content provided in an embodiment of this application;
  • FIG. 4 is a schematic flowchart of a method for playing interactive media content according to another embodiment of the application.
  • Fig. 5 is a schematic structural diagram of a device for playing interactive media content provided by an embodiment of the application.
  • Fig. 1 is a schematic flowchart of a method for playing interactive media content according to an embodiment of the application. As shown in Fig. 1, the method includes:
  • Step 101 The client displays the plot branch options of the interactive media content, and different plot branches correspond to different plot content;
  • Step 102 When it is detected that the user selects the first scenario branch among the branch options, request the streaming media server for the scenario content corresponding to the first scenario branch;
  • Step 103 Receive and play the plot content corresponding to the first plot branch returned by the streaming media server.
  • scenario branch options of the interactive media content displayed by the client include:
  • the scenario branch option corresponding to the first scenario selection point is displayed.
  • the method further includes:
  • the streaming media server saves the interactive media content including different plot branches produced by a media content provider
  • the index files of different plot branches of the interactive media content are sent to the client according to the streaming media protocol negotiated with the client.
  • the index file is a media presentation description MPD file
  • the index file is an M3U8 file.
  • the display of the scenario branch options of the interactive media content corresponding to the first scenario selection point includes:
  • the client parses the index file, and displays the indexes of different plot branches corresponding to the first plot selection point in a preset format.
  • the preset form is a dialog box or a picture; the dialog box or picture corresponds to the index of different story branches corresponding to the first story selection point.
  • the request to the streaming media server for the plot content corresponding to the first plot branch includes:
  • the streaming media server According to the index of the first scenario branch, request the streaming media server for the scenario content corresponding to the first scenario branch.
  • the method also includes:
  • the scenario branch options corresponding to the second scenario selection point are displayed;
  • the client When detecting that the user selects the second scenario branch in the scenario branch options corresponding to the second scenario selection point, the client requests the streaming media server for the scenario content corresponding to the second scenario branch;
  • FIG. 2 is a schematic flowchart of a method for playing interactive media content according to another embodiment of the application. As shown in FIG. 2, the method includes:
  • Step 201 The media content provider publishes interactive media content to the streaming media server;
  • interactive media content means that the same media content can have different plot trends and even endings.
  • different plot branches may lead to the same ending.
  • each plot selection point can be set with different plot branch options, and different plot branches correspond to different plot content.
  • FIG 3 there are options 1-1 and 1-2 at plot selection point 1, corresponding to different plot branches 1 and 2, respectively; at plot selection point 2, there are options 2-1 and 2-2, respectively corresponding to different The plot branches of 1-1 and 1-2, 1-2 go to branch 3-1; at plot selection point 3, there are options 3-1 and 3-2, which correspond to different plot branches 3-1 and 3-2 respectively;
  • the plot branch 1-1 corresponds to ending 1
  • the plot branch 3-1 corresponds to ending 2
  • the plot branch 3-2 corresponds to ending 3.
  • the media content provider can design and produce interactive media content according to the plot in Figure 3, and then publish it to the streaming media server.
  • Step 202 The streaming media server saves the interactive media content, and sends index files of different plot branches in the interactive media content to the client according to the streaming media protocol negotiated with the client;
  • the streaming media server encapsulates the corresponding interactive media content into a network data packet through an encoder, and transmits it through the network to all mobile phones, set-top boxes, smart TVs and other clients that subscribe to the media content.
  • the end user can choose the media content independently. Interact with the client.
  • the index file is a media presentation description MPD file
  • the index file is an M3U8 file.
  • Step 203 The client starts to play the interactive media content, and when the first scenario selection point is played, the scenario branch option corresponding to the first scenario selection point is displayed;
  • the client parses the index file, and displays the indexes of different plot branches corresponding to the first plot selection point in a preset format
  • the preset form is a dialog box or picture, etc.; the dialog box or picture corresponds to the index of the different story branches corresponding to the first story selection point.
  • Step 204 When the client detects that the user selects the first scenario branch corresponding to the first scenario selection point, it requests the streaming media server for the scenario content corresponding to the first scenario branch according to the index of the first scenario branch;
  • the user can select a branch of interest according to the scenario branch options displayed by the client.
  • the client After the client detects the branch selected by the user, the client requests the streaming media server for corresponding scenario content according to the index corresponding to the branch.
  • Step 205 After receiving the request, the streaming media server returns the plot content corresponding to the first plot branch to the client;
  • Step 206 The client terminal receives and plays the plot content corresponding to the first plot branch returned by the streaming media server.
  • the method also includes:
  • the scenario branch options corresponding to the second scenario selection point are displayed;
  • the client When it is detected that the user selects the second scenario branch in the scenario branch options corresponding to the second scenario selection point, the client requests the streaming media server to correspond to the second scenario branch according to the index of the second scenario branch Content of the plot;
  • the client is responsible for playing interactive media content, and showing the branch options to the user when the plot is selected; the user only needs to select the corresponding option according to personal preference at the plot selection point to play different plots content.
  • the technical solution provided by this embodiment is different from the traditional TV media content with only a single ending, which limits users to the same media content, and can realize the playback of multi-story, multiple endings and interactive media content, so that users can play in the media content. Choose on key nodes to get a different viewing experience.
  • FIG. 4 is a schematic flowchart of a method for playing interactive media content according to another embodiment of the application. As shown in FIG. 4, the method includes:
  • Step 401 The media content provider publishes interactive media content to the streaming media server;
  • the media content provider system can provide interactive media content with different plot branches and different endings to the streaming media server. For example, it is shown in Figure 3, which will not be repeated here.
  • Step 402 The streaming media server saves the interactive media content, and sends index files of different plot branches in the interactive media content to the client according to the streaming media protocol negotiated with the client;
  • the streaming media server may store the interactive media content in the form of data fragments.
  • the streaming media server re-encodes the interactive media content provided by the media content provider into network data packets, and stores the data in the form of fragments in the server, and finally selects the following protocol to carry the data according to actual needs. Packets are transmitted:
  • DASH Dynamic Adaptive Streaming over HTTP, HyperText Transfer Protocol, HyperText Transfer Protocol dynamic adaptive streaming
  • the DASH protocol uses MPD (Media Presentation Description) files to describe the composition of the code stream in the media content.
  • MPD Media Presentation Description
  • the document is organized in the form of XML (eXtensible Markup Language).
  • XML eXtensible Markup Language
  • MultiSessions are customized in the file to describe different data fragment address index files, that is, different plot branches.
  • “MultiSessions” field describe the content of the options of different branches for the client to display, as shown below:
  • HLS HTTP Live Streaming, HyperText Transfer Protocol, Hypertext Transfer Protocol live streaming
  • the HLS protocol uses M3U8 (a text file customized by the HLS protocol) to describe the composition of the code stream in the media content.
  • M3U8 a text file customized by the HLS protocol
  • the description format of media fragment data is as follows:
  • the protocol is extended to customize the special field "#EXT-CHOICES" to describe different data fragment address index files when the plot branch is selected. As follows:
  • Step 403 The client starts to play the interactive media content, and when the first scenario selection point is played, the scenario branch option corresponding to the first scenario selection point is displayed;
  • the client when the client plays this type of media content, it parses the M3U8 or MPD file according to the above-mentioned custom protocol content.
  • the client is responsible for displaying the content of the branch option when the plot branch is selected, and at the same time responds to the user's option to the server Request the corresponding media content to continue playing.
  • the content of the branch option can be displayed in the form of a dialog box or a picture with a hyperlink.
  • the user can select the interactive media content through the remote control (for set-top boxes, smart TVs) or mobile phones (for smart phones), etc.; the client determines whether there are historical bookmarks in the interactive media content according to the user's selection, and if so , The media data will be played after requesting the bookmark location from the streaming media server. Otherwise, start playing from the beginning.
  • the branch options are displayed through dialog boxes or pictures; the user judges the branch options, and if the first plot branch is selected through the remote control or mobile phone, step 404 is entered; if the selection is abandoned , The branch option 1 is selected by default, and step 404 is entered; if return is selected, step 407 is entered.
  • Step 404 When the client detects that the user selects the first plot branch corresponding to the first plot selection point, it requests the streaming media server for the plot content corresponding to the first plot branch according to the index of the first plot branch;
  • Step 405 After receiving the request, the streaming media server returns the plot content corresponding to the first plot branch to the client;
  • Step 406 The client terminal receives and plays the plot content corresponding to the first plot branch returned by the streaming media server;
  • step 407 the client terminal exits this play, records the historical bookmarks, and directly displays the branch option during the next play.
  • the method may further include:
  • the scenario branch options corresponding to the second scenario selection point are displayed;
  • the client When it is detected that the user selects the second scenario branch in the scenario branch options corresponding to the second scenario selection point, the client requests the streaming media server to correspond to the second scenario branch according to the index of the second scenario branch Content of the plot;
  • the technical solutions provided by the embodiments of this application extend the streaming media protocol and formulate a set of protocol standards for the server and client to collaborate together, which saves the workload of media content providers.
  • open interactive media content also helps operations Merchants or platforms increase user viscosity and improve user experience.
  • Fig. 5 is a schematic structural diagram of a device for playing interactive media content provided by an embodiment of the application. As shown in Fig. 5, the device includes:
  • the display unit is used for the client side to display the plot branch options of interactive media content, and different plot branches correspond to different plot content;
  • the request unit is configured to, when it is detected that the user selects the first scenario branch in the branch options, request the scenario content corresponding to the first scenario branch from the streaming media server;
  • the playing unit is configured to receive and play the story content corresponding to the first story branch returned by the streaming media server.
  • the display unit is configured to display the scenario branch option corresponding to the first scenario selection point when the interactive media content starts to be played, when the first scenario selection point is played.
  • the device also includes:
  • the receiving unit is configured to receive the index files of different plot branches of the interactive media content sent by the streaming media server according to the streaming media protocol negotiated with the streaming media server before the client starts to play the interactive media content.
  • the index file is a media presentation description MPD file
  • the index file is an M3U8 file.
  • the display unit is configured to parse the index file, and display the index of the different scenario branches corresponding to the first scenario selection point in a preset format.
  • the preset form is a dialog box or a picture; the dialog box or picture corresponds to the index of different story branches corresponding to the first story selection point.
  • the request unit is configured to request, from the streaming media server, the plot content corresponding to the first plot branch according to the index of the first plot branch.
  • An embodiment of the present application also provides a device for playing interactive media content, including a memory, a processor, and a computer program stored on the memory and running on the processor, and the computer program is processed by the processor.
  • the method for playing interactive media content described in any one of the above items is implemented when the device is executed.
  • the embodiment of the present application also provides a computer-readable storage medium having an information processing program stored on the computer-readable storage medium, and when the information processing program is executed by a processor, the interactive media playback described in any one of the above is implemented The steps of the content method.
  • Such software may be distributed on a computer-readable medium, and the computer-readable medium may include a computer storage medium (or a non-transitory medium) and a communication medium (or a transitory medium).
  • the term computer storage medium includes volatile and non-volatile data implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Sexual, removable and non-removable media.
  • Computer storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or Any other medium used to store desired information and that can be accessed by a computer.
  • communication media usually contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as carrier waves or other transmission mechanisms, and may include any information delivery media. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

L'invention concerne un procédé et un dispositif de lecture de contenu multimédia interactif. Le procédé consiste : à afficher, par un client, une option de branche de représentation graphique d'un contenu multimédia interactif, et différentes branches de représentation graphique correspondant à différents contenus de représentation graphique ; lorsqu'il est détecté qu'un utilisateur sélectionne une première branche de représentation graphique dans l'option de branche, à demander à un serveur multimédia de diffusion en continu un contenu de représentation graphique correspondant à la première branche de représentation graphique ; et à recevoir et à lire le contenu de représentation graphique correspondant à la première branche de représentation graphique qui est renvoyée par le serveur multimédia de diffusion en continu.
PCT/CN2020/113597 2019-09-19 2020-09-04 Procédé et dispositif de lecture de contenu multimédia interactif WO2021052198A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910888989.7A CN112533062A (zh) 2019-09-19 2019-09-19 播放交互式媒体内容的方法及装置
CN201910888989.7 2019-09-19

Publications (1)

Publication Number Publication Date
WO2021052198A1 true WO2021052198A1 (fr) 2021-03-25

Family

ID=74883888

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/113597 WO2021052198A1 (fr) 2019-09-19 2020-09-04 Procédé et dispositif de lecture de contenu multimédia interactif

Country Status (2)

Country Link
CN (1) CN112533062A (fr)
WO (1) WO2021052198A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113423003A (zh) * 2021-06-10 2021-09-21 山东云缦智能科技有限公司 播放互动视频的方法
CN116304133B (zh) * 2023-05-23 2023-07-25 深圳市人马互动科技有限公司 一种图片生成方法及相关装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030221014A1 (en) * 2002-05-24 2003-11-27 David Kosiba Method for guaranteed delivery of multimedia content based on terminal capabilities
US20120166667A1 (en) * 2010-12-22 2012-06-28 Edward Hall Streaming media
CN104574469A (zh) * 2014-12-22 2015-04-29 北京像素软件科技股份有限公司 剧情动画的实现方法及装置
CN105828125A (zh) * 2016-03-31 2016-08-03 北京奇艺世纪科技有限公司 一种视频推送方法及装置
CN106250007A (zh) * 2016-07-21 2016-12-21 北京乐动卓越科技有限公司 一种实现分支选择播放的系统和方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030221014A1 (en) * 2002-05-24 2003-11-27 David Kosiba Method for guaranteed delivery of multimedia content based on terminal capabilities
US20120166667A1 (en) * 2010-12-22 2012-06-28 Edward Hall Streaming media
CN104574469A (zh) * 2014-12-22 2015-04-29 北京像素软件科技股份有限公司 剧情动画的实现方法及装置
CN105828125A (zh) * 2016-03-31 2016-08-03 北京奇艺世纪科技有限公司 一种视频推送方法及装置
CN106250007A (zh) * 2016-07-21 2016-12-21 北京乐动卓越科技有限公司 一种实现分支选择播放的系统和方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
WU, HUA ET AL.: "Techniques of Video Streaming over DASH and HLS", KEY TECHNOLOGIES FOR THE NEW GENERATION OF ONLINE STREAMING MEDIA SERVICES AND ROUTING, 30 November 2017 (2017-11-30), pages 1 - 70, XP055793137 *

Also Published As

Publication number Publication date
CN112533062A (zh) 2021-03-19

Similar Documents

Publication Publication Date Title
US11570234B2 (en) Connected-media end user experience using an overlay network
US11736778B2 (en) Retrieving supplemental content
US10306293B2 (en) Systems and methods of server based interactive content injection
US9344517B2 (en) Downloading and adaptive streaming of multimedia content to a device with cache assist
AU2015374505B2 (en) Systems and methods for pre-caching media content
CN105681912A (zh) 一种视频播放方法和装置
EP2493191B1 (fr) Procédé, dispositif et système permettant de réaliser une demande hiérarchique de contenu dans un système de diffusion http
AU2010294783B2 (en) Method and device for providing complementary information
US20220060532A1 (en) Method for transmitting resources and electronic device
US20170026451A1 (en) Apparatus and method for providing streaming content
EP2873249A1 (fr) Procédé et appareil pour interagir avec une description de présentation multimédia qui décrit une présentation multimédia de résumé et une présentation multimédia d'origine
WO2021052198A1 (fr) Procédé et dispositif de lecture de contenu multimédia interactif
JP6382943B2 (ja) 放送通信システムにおける付加情報を送信及び受信する方法及び装置
US20180139490A1 (en) Reception apparatus, transmission apparatus, and data processing method
US20120136934A1 (en) Device, server, and method for sharing deep links over social network
US20150026711A1 (en) Method and apparatus for video content distribution
US11368730B2 (en) Apparatus and method for transmitting broadcast content based on ATSC 3.0, and apparatus and method for receiving broadcast content based ATSC 3.0
KR20210025508A (ko) Atsc 3.0 기반의 방송 콘텐츠 전송 장치 및 방법과, 방송 콘텐츠 수신 장치 및 방법
KR20160086121A (ko) Iptv 컨텐츠의 사운드 편집 방법, 서버 및 컴퓨터 프로그램

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20864495

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20864495

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 26/08/2022)