WO2021012665A1 - 一种交互式音视频播放的方法及装置 - Google Patents

一种交互式音视频播放的方法及装置 Download PDF

Info

Publication number
WO2021012665A1
WO2021012665A1 PCT/CN2020/074964 CN2020074964W WO2021012665A1 WO 2021012665 A1 WO2021012665 A1 WO 2021012665A1 CN 2020074964 W CN2020074964 W CN 2020074964W WO 2021012665 A1 WO2021012665 A1 WO 2021012665A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
video
segment
url
playback
Prior art date
Application number
PCT/CN2020/074964
Other languages
English (en)
French (fr)
Inventor
陈燕鹏
Original Assignee
网宿科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 网宿科技股份有限公司 filed Critical 网宿科技股份有限公司
Priority to GB2101362.8A priority Critical patent/GB2590018A/en
Priority to PCT/CN2020/114082 priority patent/WO2021013272A1/zh
Publication of WO2021012665A1 publication Critical patent/WO2021012665A1/zh
Priority to US17/169,345 priority patent/US20210160577A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection
    • H04N21/4825—End-user interface for program selection using a list of items to be played back in a given order, e.g. playlists
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8541—Content authoring involving branching, e.g. to different story endings
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Definitions

  • the embodiments of the present application relate to the technical field of video playback, and in particular, to a method and device for interactive audio and video playback.
  • the audience in the traditional streaming media on-demand playback method is still a single receiver, and the introduction of interactive video allows traditional on-demand viewers to participate in the interaction related to the video content when watching the video content, enhance the interactive interest, and achieve more Value video on demand.
  • the current audio and video playback scene on the mobile terminal only performs a series of steps of reading from start to end, decoding, audio and video rendering, and audio and video synchronization for a single media stream or file.
  • the current audio and video playback scene does not yet support interactive mode Play.
  • the embodiments of the present application provide a method and device for interactive audio and video playback, which are used to implement interactive audio and video playback on mobile devices.
  • An embodiment of the application provides an interactive audio and video playback method, including:
  • the mobile device obtains directory information of the audio and video to be played, where the directory information includes path information and play mode;
  • the mobile device determines that the play mode is interactive preview play, determine the interactive tree relationship and its corresponding audio and video list according to the path information;
  • the mobile device performs interactive audio and video playback according to the interactive tree relationship and its corresponding audio and video list and audio and video clips selected by the user.
  • the mobile device after the mobile device parses out the interactive tree relationship and its corresponding audio and video list, it can perform interactive audio and video playback based on the interactive tree relationship, the audio and video list, and the audio and video clips selected by the user.
  • the interactive tree relationship can reflect the association relationship of each audio and video clip, during audio and video playback, it can show the user other audio and video clips associated with the currently playing audio and video clip, so that interactive audio and video can be realized on mobile devices
  • the playback of fragments solves the problem that the current audio and video playback scenes of mobile devices are only played against a single audio and video stream.
  • the method further includes:
  • the mobile device determines that the playback mode is the mainline preview playback, it determines the mainline tree relationship and its corresponding audio and video list according to the path information;
  • the mobile device performs mainline audio and video playback according to the mainline tree relationship and its corresponding audio and video list.
  • the mainline audio and video playback can be performed according to the mainline tree relationship and the corresponding audio and video list, thereby realizing two playback modes.
  • the mobile device performs mainline audio and video playback according to the mainline tree relationship and its corresponding audio and video list, including:
  • the mobile device determines the URL of the first audio and video segment from the audio and video list corresponding to the main-line tree relationship according to the segment identifier of the first audio and video segment;
  • the mobile device creates a player according to the URL of the first audio and video segment to perform mainline audio and video playback, and adds the player to the pre-loaded player queue.
  • the preview of audio and video clips can be realized by preloading, which saves system resources.
  • the method further includes:
  • the mobile device obtains the segment identifier of the next audio and video segment of the currently played audio and video segment, and determines the URL of the next audio and video segment from the audio and video list corresponding to the mainline tree relationship;
  • the mobile device determines, according to the URL of the next audio and video segment, whether there is a player in the preloaded player queue that plays the URL of the next audio and video segment, and if not, creates and plays the next audio and video segment
  • the URL of the player and the player added to the pre-loaded player queue, and continue to obtain the segment identifier of the audio-video segment after the next audio-video segment; until the number of players in the pre-loaded player queue It is greater than the preloading threshold and/or the number of audio and video loaded by the players in the preloading player queue is greater than the number threshold.
  • the method further includes:
  • the mobile device After the mobile device determines that the playback of the currently played audio and video fragment is over, it determines the next audio and video fragment of the currently played audio and video fragment as the currently played audio and video fragment to perform the main-line audio and video playback, Until the audio and video in the main-line tree relationship is completed or the user's instruction to stop playing is received.
  • the main-line audio and video playback can be realized by preloading, which further saves system resources.
  • the mobile device performs interactive audio and video playback according to the interactive tree relationship and its corresponding audio and video list and audio and video clips selected by the user, including:
  • the mobile device determines the URL of the audio and video segment corresponding to the root node from the audio and video list corresponding to the interactive tree relationship according to the segment identifier of the audio and video segment corresponding to the root node, and according to the The URL of the audio and video segment corresponding to the root node performs interactive video playback;
  • the mobile device parses all sub-nodes of the root node to obtain the segment identifiers of the audio and video segments corresponding to all the sub-nodes; according to the segment identifiers of the audio and video segments corresponding to all the sub-nodes from the interactive tree
  • the URLs of the audio and video clips corresponding to all the child nodes are determined in the audio and video list corresponding to the relationship, and are added to the list of play addresses to be interactively selected for preloading, where the number of players in the preloaded player queue is greater than The preloading threshold and/or the number of audio and video loaded by the players in the preloading player queue is greater than the number threshold.
  • the method further includes:
  • the mobile device determines that the playback of the currently played audio and video fragment is over, it shows the user the problem of the currently played audio and video fragment and the audio and video fragments corresponding to each sub-node in the play address list to be interactively selected URL options to enable the user to select the corresponding audio and video clips;
  • the mobile device determines the URL of the audio and video fragment selected by the user from the list of playback addresses to be interactively selected according to the fragment identifier of the audio and video fragment selected by the user to continue the interactive video playback, and parses
  • the child node of the audio/video segment selected by the user obtains the segment identifier of the audio/video segment corresponding to the child node of the audio/video segment selected by the user, according to the audio/video segment corresponding to the child node of the audio/video segment selected by the user
  • the segment identifier determines the URL of the audio and video segment corresponding to the sub node of the audio and video segment selected by the user from the audio and video categories corresponding to the interactive tree relationship, and adds it to the list of play addresses to be interactively selected Pre-loading is performed in the interactive tree until the audio and video clips in the interactive tree relationship are all played or the user's instruction to stop playing is received.
  • the audio/video segment selected by the user is determined from the audio/video category corresponding to the interactive tree relationship based on the segment identifier of the audio/video segment corresponding to the child node of the audio/video segment selected by the user.
  • the URL of the audio and video clip corresponding to the child node of the video clip is added to the list of playback addresses to be interactively selected for preloading, including:
  • the URL of the audio and video segment corresponding to the child node of the audio and video segment selected by the user is determined in the play address list to be interactively selected, and the URL of the audio and video segment in the play address list to be interactively selected can be realized Perform deduplication and removal, so that there is no repeated removal and preloading, reducing bandwidth and system resource waste.
  • an interactive audio and video playback device including:
  • An obtaining unit configured to obtain directory information of the audio and video to be played, the directory information including path information and playing mode;
  • the processing unit is configured to determine an interactive tree relationship and its corresponding audio and video list according to the path information when it is determined that the playback mode is interactive preview playback; and according to the interactive tree relationship and its corresponding The audio and video list and the audio and video clips selected by the user are played interactively.
  • processing unit is further configured to:
  • the processing unit is specifically configured to:
  • processing unit is further configured to:
  • the segment identifier of the next audio-video segment of the currently-played audio-video segment is obtained, and the next audio-video list is determined from the audio-video list corresponding to the main-line tree relationship.
  • the URL of the next audio and video segment determine whether there is a player in the preloaded player queue that plays the URL of the next audio and video segment; if not, create a playback that plays the URL of the next audio and video segment And add to the preloaded player queue, and continue to obtain the segment identifiers of the audio and video clips after the next audio and video clip; until the number of players in the preloaded player queue is greater than the preload threshold And/or until the number of audio and video loaded by the players in the preloaded player queue is greater than the number threshold.
  • processing unit is further configured to:
  • the main-line audio and video playback After the main-line audio and video playback is performed, after it is determined that the playback of the currently played audio and video fragment is over, the next audio and video fragment of the currently played audio and video fragment is determined to be the currently played audio and video fragment.
  • the main-line audio and video are played until the audio and video in the main-line tree relationship is finished or the user's instruction to stop playing is received.
  • the processing unit is specifically configured to:
  • the URL of the audio and video segment corresponding to the root node is determined from the audio and video list corresponding to the interactive tree relationship, and according to the corresponding root node URL of audio and video clips for interactive video playback;
  • the URLs of the audio and video clips corresponding to all the child nodes are determined in the list and added to the list of play addresses to be interactively selected for preloading, where the number of players in the preloaded player queue is greater than the preloading threshold and/ Or the number of audio and video loaded by the players in the preloaded player queue is greater than the number threshold.
  • processing unit is further configured to:
  • the interactive video playback is performed according to the URL of the audio and video fragment corresponding to the root node, when it is determined that the playback of the currently played audio and video fragment is over, the problem of the currently played audio and video fragment is shown to the user and The option of the URL of the audio and video segment corresponding to each sub-node in the play address list to be interactively selected, so that the user can select the corresponding audio and video segment;
  • the URL of the audio and video segment selected by the user is determined from the play address list to be interactively selected to continue the interactive video playback, and the user selection is analyzed
  • the sub-node of the audio-visual segment of the user selects the audio-video segment corresponding to the sub-node of the audio-video segment selected by the user, and the audio-video segment corresponding to the sub-node of the audio-video segment selected by the user is obtained from
  • the URL of the audio and video segment corresponding to the sub-node of the audio and video segment selected by the user is determined from the audio and video categories corresponding to the interactive tree relationship, and is added to the list of play addresses to be interactively selected for preloading , Until the audio and video clips in the interactive tree relationship are all played or the user's instruction to stop playing is received.
  • processing unit is further configured to:
  • an embodiment of the present application also provides a computing device, including:
  • Memory used to store program instructions
  • the processor is configured to call the program instructions stored in the memory and execute the above interactive audio and video playback method according to the obtained program.
  • the embodiments of the present application also provide a computer-readable non-volatile storage medium, including computer-readable instructions.
  • the computer reads and executes the computer-readable instructions, the computer executes the interactive audio The method of video playback.
  • FIG. 1 is a schematic diagram of a system architecture provided by an embodiment of the application
  • FIG. 2 is a schematic flowchart of an interactive audio and video playback method provided by an embodiment of the application
  • FIG. 3 is a schematic structural diagram of an interactive audio and video playback device provided by an embodiment of the application.
  • FIG. 1 is a system architecture to which an embodiment of the application is applicable.
  • the system architecture may be a mobile device 100, including a radio frequency (RF) circuit 110, a memory 120, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, and wireless fidelity (wireless fidelity). , WiFi) module 170 and processor 180.
  • the mobile device 100 can be used to generate interactive audio and video.
  • the mobile device 100 shown in FIG. 1 is only an example and not a limitation.
  • the mobile device 100 may also include more or less components than those shown in the figure, or combine certain components, or Different component arrangements.
  • the RF circuit 110 can be used to receive and send signals during the process of sending and receiving data or during a call.
  • the received audio and video streams are sent to the processor 180 for processing.
  • the memory 120 may be used to store software programs and modules.
  • the processor 180 executes various functional applications and data processing of the mobile device 100 by running the software programs and modules stored in the memory 120.
  • the memory 120 may mainly include a program storage area and a data storage area.
  • the program storage area may store an operating system, an application program required by at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data (such as audio data, phone book, etc.) created by the use of the mobile device 100, etc.
  • the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.
  • the input unit 130 may be used to receive input numeric or character information, and generate key signals related to user settings and function control of the mobile device 100.
  • the input unit 130 may include a touch panel 131, a camera 132, and other input devices 133.
  • the display unit 140 can be used to display information input by the user or information provided to the user and various menus of the mobile device 100.
  • the display unit 140 may include a display panel 141.
  • the display panel 141 may be configured in the form of a liquid crystal display unit (LCD, Liquid Crystal Display), an organic light emitting diode (OLED, Organic Light-Emitting Diode), etc.
  • the touch panel 131 can cover the display panel 141. When the touch panel 131 detects a touch operation on or near it, it transmits it to the processor 180 to determine the type of the touch event, and then the processor 180 responds to the touch event. The type provides corresponding visual output on the display panel 141.
  • the mobile device 100 may further include at least one sensor 150, such as an attitude sensor, a distance sensor, and other sensors.
  • at least one sensor 150 such as an attitude sensor, a distance sensor, and other sensors.
  • the audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the mobile device 100.
  • the audio circuit 160 may transmit the converted electrical signal of the received audio data to the processor 180 for language recognition.
  • WiFi is a short-distance wireless transmission technology.
  • the mobile device 100 can help users send and receive emails, browse webpages, and access streaming media (such as live video), etc. It provides users with wireless broadband Internet access.
  • the processor 180 is the control center of the mobile device 100. It uses various interfaces and lines to connect the various parts of the entire mobile device 100, runs or executes software programs and/or modules stored in the memory 120, and calls and stores them in the memory 120. , Execute various functions of the mobile device 100 and process data, so as to monitor the mobile device 100 as a whole.
  • FIG. 2 exemplarily shows the flow of a method for interactive audio and video playback provided by an embodiment of the present application.
  • the flow can be executed by an interactive audio and video playback device, which can be located in FIG. 1
  • the mobile device 100 shown may also be the mobile device 100.
  • the process specifically includes:
  • Step 201 The mobile device obtains directory information of the audio and video to be played.
  • the directory information may include path information and a play mode, where the path information may be the path of the directory of the audio and video to be played, or may be a URL.
  • the path can be a local path, and if the source of the audio and video clip is remote, it is the URL where the current audio and video clip is stored on the remote mobile device.
  • the play mode can be divided into two modes: interactive preview play and mainline preview play. Among them, the interactive preview mode can interact with the user. In the specific implementation process, the play mode can be identified by setting the flag. For example, when the flag is 1, the play mode is interactive preview play, and when the flag is 0, the play mode is mainline preview play.
  • Step 202 When the mobile device determines that the play mode is interactive preview play, it determines the interactive tree relationship and its corresponding audio and video list according to the path information.
  • the mobile device can obtain the interactive tree relationship and its corresponding audio and video list according to the path information. For example, to obtain the path of JSON, and parse the JSON to obtain 2 objects: tree and videos, corresponding respectively: interactive tree relationship and audio and video list.
  • Step 203 The mobile device performs interactive audio and video playback according to the interactive tree relationship and its corresponding audio and video list and audio and video clips selected by the user.
  • interactive audio and video playback can be carried out. Specifically, the segment identifier of the audio and video fragment corresponding to the root node of the interactive tree relationship can be obtained, and then based on the corresponding root node The segment identifier of the audio and video segment determines the URL of the audio and video segment corresponding to the root node from the audio and video list corresponding to the interactive tree relationship, and performs interactive video playback according to the URL of the audio and video segment corresponding to the root node.
  • the URL of the corresponding audio and video clip is added to the list of play addresses to be interactively selected for preloading.
  • the preload threshold and the number threshold may be based on Experience setting.
  • the mobile device determines that the currently playing audio and video clip is over, it can show the user the problem of the currently playing audio and video clip and the option of the URL of the audio and video clip corresponding to each sub-node in the play address list to be interactively selected. , So that the user can select the corresponding audio and video clips.
  • the URL of the audio and video segment selected by the user can be determined from the play address list to be interactively selected to continue the interactive video playback, and the child nodes of the audio and video segment selected by the user can be parsed ,
  • To obtain the segment identifier of the audio and video segment corresponding to the sub node of the audio and video segment selected by the user, and from the audio and video categories corresponding to the interactive tree relationship according to the segment identifier of the audio and video segment corresponding to the sub node of the audio and video segment selected by the user Determine the URL of the audio and video clip corresponding to the child node of the audio and video clip selected by the user, and add it to the list of play addresses to be interactively selected for preloading until the audio and video clips in the interactive tree relationship are all played or received Until the user's instruction to stop playing.
  • the root node of the tree is parsed, video_id (fragment identifier) is obtained, videos (audio and video list) are traversed, and the player address of the object with the same video_id is obtained for "single fragment preview" to play.
  • “single clip preview” can be to get the clip selected by the user to be previewed, traverse JSON to get the player path of the current clip, if the interactive video source is made locally, it is the local path, if the interactive video source is remote, it is the remote terminal Store the URL of the current video. At this time, you can call the path or URL of the player to play the segment.
  • Analyze the children (child node) field of the currently playing node if it exists, get the video_id of n child nodes, and traverse videos to determine the list of player addresses to be interactively selected after the playback of the currently playing node ends. Create players one by one, initialize the list of player addresses to be interactively selected, and store them in the preloaded player array, and configure the amount of preloaded data.
  • the amount of preloaded data can be set based on experience.
  • the amount of preloaded data is the aforementioned preload threshold.
  • the question corresponding to the currently playing node will pop up, and the answer of each child node in the player address list to be interactively selected will be displayed. After the user's selection is completed, the corresponding player is taken out of the preloaded player array and played directly. If it does not exist, the player is recreated and the current playback address is played.
  • the player addresses contained in all child nodes of the currently playing node are compared with the playback addresses of the players contained in the pre-loaded player array. If they match, they will be retained, otherwise the player will be removed from the array and combined Release (de-duplication).
  • the child nodes of node 1 are 2 and 3; the child nodes of node 2 are 4 and 5.
  • node 1 When node 1 is playing, the child nodes 2 and 3 of node 1 have been added to the player address list to be interactively selected for preloading. At this time, when interacting with the user, the user selects node 2, then the audio and video clips of node 2 are played. Since there is node 3 in the player address list to be interactively selected, node 3 needs to be removed at this time, and then node 4 and Node 5 is put into the list of player addresses to be interactively selected for preloading.
  • the child nodes of node 1 are 2, 3, and 4, the child nodes of node 2 are 3 and 5.
  • node 1 When node 1 is playing, the child nodes 2, 3, and 4 of node 1 have been added to the list of player addresses to be interactively selected for preloading. At this time, when interacting with the user, the user selects node 2, and the audio and video clips of node 2 are played. Since there are nodes 3 and 4 in the list of player addresses to be interactively selected, node 3 needs to be removed at this time, and then Node 5 is put into the list of player addresses to be interactively selected for preloading. And node 4 does not need to be removed, only node 5 needs to be preloaded, which can save system resources.
  • the mobile device determines the play mode as the mainline preview, it can determine the mainline tree relationship and its corresponding audio and video list according to the path information, and finally according to the mainline tree relationship and its corresponding audio and video List for main-line audio and video playback.
  • the segment identifier of the first audio and video segment in the main-line tree relationship can be obtained, and the first audio-video segment is determined from the audio and video list corresponding to the main-line tree relationship according to the segment identifier of the first audio and video segment.
  • a URL of an audio and video segment and then create a player based on the URL of the first audio and video segment to perform mainline audio and video playback, and add the player to the pre-loaded player queue.
  • the mobile device can obtain the segment identifier of the next audio-video segment of the currently playing audio-video segment, and determine the URL of the next audio-video segment from the audio-video list corresponding to the main-line tree relationship. According to the URL of the next audio and video clip, it is determined whether there is a player in the preloaded player queue that plays the URL of the next audio and video clip. If not, a player that plays the URL of the next audio and video clip is created and added to the pre-loaded player queue.
  • the preload threshold and the quantity threshold can be set based on experience, for example, the preload threshold can be the amount of preloaded data.
  • the mobile device determines that the currently playing audio and video clip is over, it can determine the next audio and video clip of the currently playing audio and video clip as the currently playing audio and video clip for main-line audio and video playback until the main-line tree relationship The audio and video in the video are played until the end or the user's stop playing instruction is received.
  • main_thread and videos which correspond to the main thread tree relationship and the audio and video list respectively.
  • Obtain the first index object of main_thread traverse videos through the video_id of the object to obtain the player address of the object with the same video_id to create a player, and add it to the preloaded player queue. Traverse the player objects in the pre-loaded player queue through the current playback address, and find a matching player for preview playback.
  • Get the next index object of the currently playing audio and video clip traverse videos through the video_id of the object to obtain the player address of the object with the same video_id. If the player's playback address matches with the pre-loaded player queue, you don't need to create it, otherwise create a playback And initialize the playback address of the audio and video clip of the next index object, store it in the preload player queue, and configure the amount of preload data.
  • the player to be added to the pre-loaded player queue determines whether there is a player with the same playback address in the queue. If it exists, it will not be added and released. If it does not exist, it will be added to the queue.
  • the above embodiment shows that the mobile device obtains the directory information of the audio and video to be played.
  • the directory information includes path information and play mode.
  • the play mode is determined to be interactive preview play
  • the interactive tree relationship and its corresponding relationship are determined according to the path information.
  • the audio and video list based on the interactive tree relationship and its corresponding audio and video list, and the audio and video clips selected by the user for interactive audio and video playback.
  • interactive audio and video playback can be performed according to the interactive tree relationship, the audio and video list, and the audio and video clips selected by the user. Due to the interactive tree relationship It can reflect the association relationship of various audio and video clips.
  • audio and video playback it can show the user other audio and video clips associated with the currently playing audio and video clips, so that interactive audio and video clips can be played on mobile devices, which solves the current problem.
  • the audio and video playback scenes of mobile devices are only for a single audio and video stream.
  • FIG. 3 exemplarily shows the structure of an interactive audio and video playback device provided by an embodiment of the present application.
  • the device can execute the interactive audio and video playback process.
  • the device can be located in FIG. 1
  • the mobile device 100 shown may also be the mobile device 100.
  • the device specifically includes:
  • the obtaining unit 301 is configured to obtain directory information of audio and video to be played, where the directory information includes path information and playing mode;
  • the processing unit 302 is configured to determine an interactive tree relationship and its corresponding audio and video list according to the path information when it is determined that the play mode is interactive preview playback; according to the interactive tree relationship and its corresponding The audio and video list and the audio and video clips selected by the user can be played interactively.
  • processing unit 302 is further configured to:
  • processing unit 302 is specifically configured to:
  • processing unit 302 is further configured to:
  • the segment identifier of the next audio-video segment of the currently-played audio-video segment is obtained, and the next audio-video list is determined from the audio-video list corresponding to the main-line tree relationship.
  • the URL of the next audio and video segment determine whether there is a player in the preloaded player queue that plays the URL of the next audio and video segment; if not, create a playback that plays the URL of the next audio and video segment And add to the preloaded player queue, and continue to obtain the segment identifiers of the audio and video clips after the next audio and video clip; until the number of players in the preloaded player queue is greater than the preload threshold And/or until the number of audio and video loaded by the players in the preloaded player queue is greater than the number threshold.
  • processing unit 302 is further configured to:
  • the main-line audio and video playback After the main-line audio and video playback is performed, after it is determined that the playback of the currently played audio and video fragment is over, the next audio and video fragment of the currently played audio and video fragment is determined to be the currently played audio and video fragment.
  • the main-line audio and video are played until the audio and video in the main-line tree relationship is finished or the user's instruction to stop playing is received.
  • processing unit 302 is specifically configured to:
  • the URL of the audio and video segment corresponding to the root node is determined from the audio and video list corresponding to the interactive tree relationship, and according to the corresponding root node URL of audio and video clips for interactive video playback;
  • the URLs of the audio and video clips corresponding to all the child nodes are determined in the video list and added to the list of play addresses to be interactively selected for preloading, where the number of players in the preloaded player queue is greater than the preloading threshold and /Or the number of audio and video loaded by the players in the preloaded player queue is greater than the number threshold.
  • processing unit 302 is further configured to:
  • the interactive video playback is performed according to the URL of the audio and video fragment corresponding to the root node, when it is determined that the playback of the currently played audio and video fragment is over, the problem of the currently played audio and video fragment is shown to the user and The option of the URL of the audio and video segment corresponding to each sub-node in the play address list to be interactively selected, so that the user can select the corresponding audio and video segment;
  • the URL of the audio and video segment selected by the user is determined from the play address list to be interactively selected to continue the interactive video playback, and the user selection is analyzed
  • the sub-node of the audio-visual segment of the user selects the audio-video segment corresponding to the sub-node of the audio-video segment selected by the user, and the audio-video segment corresponding to the sub-node of the audio-video segment selected by the user is obtained from
  • the URL of the audio and video segment corresponding to the sub-node of the audio and video segment selected by the user is determined from the audio and video categories corresponding to the interactive tree relationship, and is added to the list of play addresses to be interactively selected for preloading , Until the audio and video clips in the interactive tree relationship are all played or the user's instruction to stop playing is received.
  • processing unit 302 is further configured to:
  • an embodiment of the present application also provides a computing device, including:
  • Memory used to store program instructions
  • the processor is configured to call the program instructions stored in the memory and execute the above interactive audio and video playback method according to the obtained program.
  • the embodiments of the present application also provide a computer-readable non-volatile storage medium, including computer-readable instructions.
  • the computer reads and executes the computer-readable instructions, the computer is caused to perform the aforementioned interactions.
  • These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment.
  • the instructions provide steps for implementing functions specified in a flow or multiple flows in the flowchart and/or a block or multiple blocks in the block diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Television Signal Processing For Recording (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请公开了一种交互式音视频播放的方法及装置，该方法包括移动设备获取待播放音视频的目录信息（201）；移动设备在确定所述播放模式为交互式预览播放时，根据路径信息确定出交互式树形关系及其对应的音视频列表（202）；移动设备根据交互式树形关系及其对应的音视频列表以及用户选中的音视频片段进行交互式音视频播放（203）。

Description

一种交互式音视频播放的方法及装置
交叉引用
本申请引用于2019年07月25日递交的名称为“一种交互式音视频播放的方法及装置”的第201910676150.7号中国专利申请，其通过引用被全部并入本申请。
技术领域
本申请实施例涉及视频播放技术领域，尤其涉及一种交互式音视频播放的方法及装置。
背景技术
随着移动互联网的高速发展及终端设备性能的不断提升，使用移动设备随时随地在线观看直播和点播视频的行为越来越普及，而直播由于具备实时性可以实现良好的主播与观众互动，点播由于没有实时性就无法实现互动。
传统的流媒体点播的播放方式中的观众还是单一的接收方，而互动视频的引入可以让传统的点播观众在观看视频内容时还能参与与视频内容相关的互动，提升互动趣味，实现更有价值的视频点播。
当前移动端音视频播放的场景，仅对单一的媒体流或者文件执行从头到尾的读取、解码与音视频渲染、音视频同步的一系列步骤，目前的音视频播放场景尚不支持互动模式的播放。
发明内容
本申请实施例提供一种交互式音视频播放的方法及装置，用以在移动设 备上实现互动模式的音视频播放。
本申请实施例提供的一种交互式音视频播放的方法，包括：
移动设备获取待播放音视频的目录信息，所述目录信息包括路径信息和播放模式；
所述移动设备在确定所述播放模式为交互式预览播放时，根据所述路径信息确定出交互式树形关系及其对应的音视频列表；
所述移动设备根据所述交互式树形关系及其对应的音视频列表以及用户选中的音视频片段进行交互式音视频播放。
上述技术方案中，移动设备在解析出交互式树形关系及其对应的音视频列表之后，就可以依据该交互式树形关系、音视频列表以及用户选中的音视频片段进行交互式音视频播放，由于交互式树形关系可以体现各音视频片段的关联关系，在进行音视频播放是可以向用户展示当前播放音视频片段关联的其他音视频片段，从而可以在移动设备实现交互式的音视频片段的播放，解决了当前移动设备音视频播放的场景仅对单一音视频流播放的问题。
在一个实施例中，所述方法还包括：
所述移动设备在确定所述播放模式为主线式预览播放时，根据所述路径信息确定出主线式树形关系及其对应的音视频列表；
所述移动设备根据所述主线式树形关系及其对应的音视频列表，进行主线式音视频播放。
上述技术方案中，当确定播放模式为主线式预览播放时，可以依据主线式树形关系及其对应的音视频列表进行主线式音视频播放，从而实现了两种播放模式。
在一个实施例中，所述移动设备根据所述主线式树形关系及其对应的音视频列表，进行主线式音视频播放，包括：
所述移动设备获取所述主线式树形关系中的第一个音视频片段的片段标识；
所述移动设备根据所述第一个音视频片段的片段标识，从所述主线式树形关系对应的音视频列表中确定出所述第一音视频片段的URL；
所述移动设备根据所述第一音视频片段的URL创建播放器进行主线式音视频播放，以及将所述播放器加入预加载播放器队列。
上述技术方案中，通过预加载可以实现对音视频片段的预览，节省系统资源。
在一个实施例中，在所述移动设备进行主线式音视频播放之后，还包括：
所述移动设备获取当前播放的音视频片段的下一个音视频片段的片段标识，并从所述主线式树形关系对应的音视频列表中确定出所述下一个音视频片段的URL；
所述移动设备根据下一个音视频片段的URL判断所述预加载播放器队列中是否存在播放所述下一个音视频片段的URL的播放器，若否，则创建播放所述下一个音视频片段的URL的播放器以及添加到所述预加载播放器队列，并继续获取位于所述下一个音视频片段之后的音视频片段的片段标识；直到所述预加载播放器队列中的播放器的数量大于预加载阈值和/或所述预加载播放器队列中的播放器加载的音视频的数量大于数量阈值为止。
上述技术方案中，通过设置预加载阈值和数量阈值，可以节省系统的资源。
在一个实施例中，在所述移动设备进行主线式音视频播放之后，还包括：
所述移动设备在确定当前播放的音视频片段播放结束之后，将所述当前播放的音视频片段的下一个音视频片段确定为所述当前播放的音视频片段进行所述主线式音视频播放，直到所述主线式树形关系中的音视频播放完毕或接收到所述用户的停止播放指令为止。
上述技术方案中，通过预加载的方式可以实现主线式音视频播放，进一步节省系统资源。
在一个实施例中，所述移动设备根据所述交互式树形关系及其对应的音 视频列表以及用户选中的音视频片段进行交互式音视频播放，包括：
所述移动设备获取所述交互式树形关系的根节点对应的音视频片段的片段标识；
所述移动设备根据所述根节点对应的音视频片段的片段标识，从所述交互式树形关系对应的音视频列表中确定出所述根节点对应的音视频片段的URL，并根据所述根节点对应的音视频片段的URL进行交互式视频播放；
所述移动设备解析所述根节点的所有子节点，得到所述所有子节点对应的音视频片段的片段标识；根据所述所有子节点对应的音视频片段的片段标识从所述交互式树形关系对应的音视频列表中确定出所述所有子节点对应的音视频片段的URL，并添加到待交互选择的播放地址列表进行预加载，其中预加载的播放器队列中的播放器的数量大于预加载阈值和/或所述预加载播放器队列中的播放器加载的音视频的数量大于数量阈值。
上述技术方案中，通过对交互式树形关系的解析，得到根节点的所有子节点并进行预加载，可以节省系统资源。
在一个实施例中，在所述移动设备根据所述根节点对应的音视频片段的URL进行交互式视频播放之后，还包括：
所述移动设备在确定当前播放的音视频片段播放结束时，向所述用户展示所述当前播放的音视频片段的问题以及所述待交互选择的播放地址列表中各子节点对应的音视频片段的URL的选项，以使所述用户选择相应的音视频片段；
所述移动设备根据所述用户选中的音视频片段的片段标识，从所述待交互选择的播放地址列表确定出所述用户选中的音视频片段的URL继续进行所述交互式视频播放，并解析所述用户选中的视音频片段的子节点，得到所述用户选中的音视频片段的子节点对应的音视频片段的片段标识，根据所述用户选中的音视频片段的子节点对应的音视频片段的片段标识从所述交互式树形关系对应的音视频类别中确定出所述用户选中的音视频片段的子节点对应的音视 频片段的URL，并添加到所述待交互选择的播放地址列表中进行预加载，直到所述交互式树形关系中的音视频片段全部播放完毕或接收到所述用户的停止播放指令为止。
上述技术方案中，通过与用户交互的互动方式进行交互式音视频播放，可以解决当前移动设备音视频播放的场景仅对单一音视频流播放的问题。
在一个实施例中，所述根据所述用户选中的音视频片段的子节点对应的音视频片段的片段标识从所述交互式树形关系对应的音视频类别中确定出所述用户选中的音视频片段的子节点对应的音视频片段的URL，并添加到所述待交互选择的播放地址列表中进行预加载，包括：
确定所述待交互选择的播放地址列表中是否存在所述用户选中的音视频片段的子节点对应的音视频片段的URL，若存在，则不添加，若不存在，则将不存在的子节点对应的音视频片段的URL添加到所述待交互选择的播放地址列表中进行预加载；以及将所述待交互选择的播放地址列表中不属于所述用户选中的音视频片段的子节点对应的音视频片段的URL删除。
上述技术方案中，通过判断待交互选择的播放地址列表中是否存在用户选中的音视频片段的子节点对应的音视频片段的URL，可以实现对待交互选择的播放地址列表中的音视频片段的URL进行去重和移除，从而使得不会重复移除和预加载，减少带宽和系统资源浪费。
第二方面，本申请实施例提供一种交互式音视频播放的装置，包括：
获取单元，用于获取待播放音视频的目录信息，所述目录信息包括路径信息和播放模式；
处理单元，用于在确定所述播放模式为交互式预览播放时，根据所述路径信息确定出交互式树形关系及其对应的音视频列表；根据所述交互式树形关系及其对应的音视频列表以及用户选中的音视频片段进行交互式音视频播放。
在一个实施例中，所述处理单元还用于：
在确定所述播放模式为主线式预览播放时，根据所述路径信息确定出主线 式树形关系及其对应的音视频列表；
根据所述主线式树形关系及其对应的音视频列表，进行主线式音视频播放。
在一个实施例中，所述处理单元具体用于：
获取所述主线式树形关系中的第一个音视频片段的片段标识；
根据所述第一个音视频片段的片段标识，从所述主线式树形关系对应的音视频列表中确定出所述第一音视频片段的URL；
根据所述第一音视频片段的URL创建播放器进行主线式音视频播放，以及将所述播放器加入预加载播放器队列。
在一个实施例中，所述处理单元还用于：
在所述进行主线式音视频播放之后，获取当前播放的音视频片段的下一个音视频片段的片段标识，并从所述主线式树形关系对应的音视频列表中确定出所述下一个音视频片段的URL；
根据下一个音视频片段的URL判断所述预加载播放器队列中是否存在播放所述下一个音视频片段的URL的播放器，若否，则创建播放所述下一个音视频片段的URL的播放器以及添加到所述预加载播放器队列，并继续获取位于所述下一个音视频片段之后的音视频片段的片段标识；直到所述预加载播放器队列中的播放器的数量大于预加载阈值和/或所述预加载播放器队列中的播放器加载的音视频的数量大于数量阈值为止。
在一个实施例中，所述处理单元还用于：
在所述进行主线式音视频播放之后，在确定当前播放的音视频片段播放结束之后，将所述当前播放的音视频片段的下一个音视频片段确定为所述当前播放的音视频片段进行所述主线式音视频播放，直到所述主线式树形关系中的音视频播放完毕或接收到所述用户的停止播放指令为止。
在一个实施例中，所述处理单元具体用于：
获取所述交互式树形关系的根节点对应的音视频片段的片段标识；
根据所述根节点对应的音视频片段的片段标识，从所述交互式树形关系对应的音视频列表中确定出所述根节点对应的音视频片段的URL，并根据所述根节点对应的音视频片段的URL进行交互式视频播放；
解析所述根节点的所有子节点，得到所述所有子节点对应的音视频片段的片段标识；根据所述所有子节点对应的音视频片段的片段标识从所交互式树形关系对应的音视频列表中确定出所述所有子节点对应的音视频片段的URL，并添加到待交互选择的播放地址列表进行预加载，其中预加载的播放器队列中的播放器的数量大于预加载阈值和/或所述预加载播放器队列中的播放器加载的音视频的数量大于数量阈值。
在一个实施例中，所述处理单元还用于：
在所述根据所述根节点对应的音视频片段的URL进行交互式视频播放之后，在确定当前播放的音视频片段播放结束时，向所述用户展示所述当前播放的音视频片段的问题以及所述待交互选择的播放地址列表中各子节点对应的音视频片段的URL的选项，以使所述用户选择相应的音视频片段；
根据所述用户选中的音视频片段的片段标识，从所述待交互选择的播放地址列表确定出所述用户选中的音视频片段的URL继续进行所述交互式视频播放，并解析所述用户选中的视音频片段的子节点，得到所述用户选中的音视频片段的子节点对应的音视频片段的片段标识，根据所述用户选中的音视频片段的子节点对应的音视频片段的片段标识从所述交互式树形关系对应的音视频类别中确定出所述用户选中的音视频片段的子节点对应的音视频片段的URL，并添加到所述待交互选择的播放地址列表中进行预加载，直到所述交互式树形关系中的音视频片段全部播放完毕或接收到所述用户的停止播放指令为止。
在一个实施例中，所述处理单元还用于：
确定所述待交互选择的播放地址列表中是否存在所述用户选中的音视频片段的子节点对应的音视频片段的URL，若存在，则不添加，若不存在，则将不存在的子节点对应的音视频片段的URL添加到所述待交互选择的播放地址 列表中进行预加载；以及将所述待交互选择的播放地址列表中不属于所述用户选中的音视频片段的子节点对应的音视频片段的URL删除。
第三方面，本申请实施例还提供了一种计算设备，包括：
存储器，用于存储程序指令；
处理器，用于调用所述存储器中存储的程序指令，按照获得的程序执行上述交互式音视频播放的方法。
第四方面，本申请实施例还提供了一种计算机可读非易失性存储介质，包括计算机可读指令，当计算机读取并执行所述计算机可读指令时，使得计算机执行上述交互式音视频播放的方法。
附图说明
为了更清楚地说明本申请实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简要介绍，显而易见地，下面描述中的附图仅是本申请的一些实施例，对于本领域的普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本申请实施例提供的一种系统架构的示意图；
图2为本申请实施例提供的一种交互式音视频播放的方法的流程示意图；
图3为本申请实施例提供的一种交互式音视频播放的装置的结构示意图。
具体实施方式
为了使本申请的目的、技术方案和优点更加清楚，下面将结合附图对本申请作详细描述，显然，所描述的实施例仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例，都属于本申请保护的范围。
图1为本申请实施例所适用的系统架构。参考图1所示，该系统架构可以为移动设备100，包括射频(Radio Frequency，RF)电路110、存储器120、输入单元130、显示单元140、传感器150、音频电路160、无线保真(wireless fidelity，WiFi)模块170以及处理器180等部件。该移动设备100可以用于生成交互式音视频。
其中，本领域技术人员可以理解，图1中示出的移动设备100结构仅为示例而非限定，移动设备100还可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
RF电路110可用于在收发数据或通话过程中，信号的接收和发送，特别地，将接收到的音视频流，给处理器180处理。
其中，存储器120可用于存储软件程序以及模块，处理器180通过运行存储在存储器120的软件程序以及模块，从而执行移动设备100的各种功能应用以及数据处理。存储器120可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(如声音播放功能、图像播放功能等)等；存储数据区可存储根据移动设备100的使用所创建的数据(如音频数据、电话本等)等。此外，存储器120可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
输入单元130可用于接收输入的数字或字符信息，以及产生与移动设备100的用户设置以及功能控制有关的键信号。具体地，输入单元130可包括触控面板131、摄像设备132以及其他输入设备133。
其中，显示单元140可用于显示由用户输入的信息或提供给用户的信息以及移动设备100的各种菜单。显示单元140可包括显示面板141，可选的，可以采用液晶显示单元(LCD，Liquid Crystal Display)、有机发光二极管(OLED，Organic Light-Emitting Diode)等形式来配置显示面板141。进一步的，触控面板131可覆盖显示面板141，当触控面板131检测到在其上或附近 的触摸操作后，传送给处理器180以确定触摸事件的类型，随后处理器180根据触摸事件的类型在显示面板141上提供相应的视觉输出。
另外，移动设备100还可包括至少一种传感器150，比如姿态传感器、距离传感器、以及其他传感器。
音频电路160、扬声器161，传声器162可提供用户与移动设备100之间的音频接口。音频电路160可将接收到的音频数据转换后的电信号，传输到处理器180进行语种识别。
WiFi属于短距离无线传输技术，移动设备100通过WiFi模块170可以帮助用户收发电子邮件、浏览网页和访问流式媒体(如视频直播)等，它为用户提供了无线的宽带互联网访问。
处理器180是移动设备100的控制中心，利用各种接口和线路连接整个移动设备100的各个部分，通过运行或执行存储在存储器120内的软件程序和/或模块，以及调用存储在存储器120内的数据，执行移动设备100的各种功能和处理数据，从而对移动设备100进行整体监控。
基于上述描述，图2示例性的示出了本申请实施例提供的一种交互式音视频播放的方法的流程，该流程可以由交互式音视频播放的装置执行，该装置可以位于图1所示的移动设备100内，也可以是该移动设备100。
如图2所示，该流程具体包括：
步骤201，移动设备获取待播放音视频的目录信息。
在本申请实施例中，该目录信息可以包括路径信息和播放模式，其中路径信息可以为待播放音视频的目录的路径，或者可以为URL。其中，如果音视频片段来源为本地制作时，该路径可以为本地路径，如果音视频片段来源为远程，则为远程移动设备存储当前音视频片段的URL。该播放模式可以分为交互式预览播放和主线式预览播放两种模式，其中，交互式预览模式可以与用户进行交互沟通。在具体实施过程中，可以通过设置标识位来识别播放模式，比如，标识位为1时，播放模式是交互式预览播放，标识位为0时，播放模式是主线 式预览播放。
步骤202，所述移动设备在确定所述播放模式为交互式预览播放时，根据所述路径信息确定出交互式树形关系及其对应的音视频列表。
当确定了播放模式为交互式预览播放时，移动设备可以依据路径信息得到交互式树形关系及其对应的音视频列表。例如，获取JSON的路径，解析该JSON得到2个对象：tree和videos，分别对应：交互式树形关系和音视频列表。
步骤203，所述移动设备根据所述交互式树形关系及其对应的音视频列表以及用户选中的音视频片段进行交互式音视频播放。
在得到交互式树形关系及其音视频列表之后，就可以进行交互式音视频播放，具体的，可以获取交互树形关系的根节点对应的音视频片段的片段标识，然后根据根节点对应的音视频片段的片段标识，从交互式树形关系对应音视频列表中确定出根节点对应的音视频片段的URL，并根据根节点对应的音视频片段的URL进行交互式视频播放。再解析根节点的所有子节点，得到所有子节点对应的音视频片段的片段标识，根据所有子节点对应的音视频片段的片段标识从交互式树形关系对应音视频列表中确定出所有子节点对应的音视频片段的URL，并添加到待交互选择的播放地址列表进行预加载。其中预加载的播放器队列中的播放器的数量大于预加载阈值和/或所述预加载播放器队列中的播放器加载的音视频的数量大于数量阈值，该预加载阈值和数量阈值可以依据经验设置。
此外，当移动设备在确定当前播放的音视频片段播放结束时，可以向用户展示当前播放的音视频片段的问题以及待交互选择的播放地址列表中各子节点对应的音视频片段的URL的选项，以使用户选择相应的音视频片段。然后就可以根据用户选中的音视频片段的片段标识，从待交互选择的播放地址列表确定出用户选中的音视频片段的URL继续进行交互式视频播放，并解析用户选中的视音频片段的子节点，得到用户选中的音视频片段的子节点对应的音视频片段的片段标识，根据用户选中的音视频片段的子节点对应的音视频片段 的片段标识从交互式树形关系对应的音视频类别中确定出用户选中的音视频片段的子节点对应的音视频片段的URL，并添加到待交互选择的播放地址列表中进行预加载，直到交互式树形关系中的音视频片段全部播放完毕或接收到用户的停止播放指令为止。
其中，添加到待交互选择的播放地址列表中进行预加载时，可以先确定待交互选择的播放地址列表中是否存在用户选中的音视频片段的子节点对应的音视频片段的URL，若存在，则不添加，若不存在，则将不存在的子节点对应的音视频片段的URL添加到待交互选择的播放地址列表中进行预加载；以及将待交互选择的播放地址列表中不属于用户选中的音视频片段的子节点对应的音视频片段的URL删除。
举例来说，解析tree(交互式树形关系)的根节点，获取video_id(片段标识)，遍历videos(音视频列表)，获取video_id一致的对象的播放器地址进行“单片段预览”进行播放。其中，“单片段预览”可以为获取用户选中的待预览片段，遍历JSON得到当前片段的播放器路径，如果是交互视频来源是本地制作则为本地路径，如果是交互视频来源远程则为远程终端存储当前视频的URL，此时可以调用播放器播放片段的路径或URL。
解析当前播放的节点的children(子节点)字段，若存在，则拿到n个子节点的video_id，并遍历videos，确定出当前播放的节点播放结束后的待交互选择的播放器地址列表。依次创建播放器并初始化待交互选择的播放器地址列表，并存储到预加载播放器数组中，并配置预加载数据量。该预加载数据量可以依据经验设置。该预加载数据量即为上述预加载阈值。
当前播放的节点播放完毕时，弹出当前播放的节点对应的问题，并展示待交互选择的播放器地址列表中各子节点的答案。待用户选择完成后从预加载播放器数组中取出相应播放器直接进行播放，若不存在，则重新创建播放器并播放当前播放地址。
遍历选择完成后的当前播放的节点的所有子节点所包含的播放器地址 与预加载播放器数组所包含的播放器的播放地址对比，若匹配则保留，否则将播放器从数组中移除并释放(去重)。
重复上述步骤，直到上述待交互选择的播放器地址列表为空，或者是用户下发停止播放的指令为止。
举例来说，节点1的子节点为2、3；节点2的子节点为4、5。当节点1在播放的过程中，节点1的子节点2和3已经添加到待交互选择的播放器地址列表中进行预加载。此时与用户交互时，用户选中了节点2，则播放节点2的音视频片段，由于待交互选择的播放器地址列表中有节点3，此时需要将节点3移除，然后将节点4和节点5放入待交互选择的播放器地址列表中进行预加载。
若节点1的子节点为2、3、4，节点2的子节点为3、5。当节点1在播放的过程中，节点1的子节点2、3和4已经添加到待交互选择的播放器地址列表中进行预加载。此时与用户交互时，用户选中了节点2，则播放节点2的音视频片段，由于待交互选择的播放器地址列表中有节点3和节点4，此时需要将节点3移除，然后将节点5放入待交互选择的播放器地址列表中进行预加载。而节点4无需移除，只需要预加载节点5即可，可以节省系统资源。
需要说明的是，当移动设备确定播放模式为主线式预览播放时，可以根据路径信息确定出主线式树形关系及其对应的音视频列表，最后根据主线式树形关系及其对应的音视频列表，进行主线式音视频播放。
具体的，可以获取主线式树形关系中的第一个音视频片段的片段标识，根据第一个音视频片段的片段标识，从主线式树形关系对应的音视频列表中确定出所述第一音视频片段的URL，然后根据第一音视频片段的URL创建播放器进行主线式音视频播放，以及将播放器加入预加载播放器队列。
在进行主线式播放时，移动设备可以获取当前播放的音视频片段的下一个音视频片段的片段标识，并从主线式树形关系对应的音视频列表中确定出下一个音视频片段的URL，在根据下一个音视频片段的URL判断预加载播放器 队列中是否存在播放下一个音视频片段的URL的播放器，若否，则创建播放下一个音视频片段的URL的播放器以及添加到预加载播放器队列，并继续获取位于下一个音视频片段之后的音视频片段的片段标识，直到预加载播放器队列中的播放器的数量大于预加载阈值和/或所述预加载播放器队列中的播放器加载的音视频的数量大于数量阈值为止。其中，预加载阈值和数量阈值可以依据经验设置，比如预加载阈值可以是预加载数据量。
当移动设备确定当前播放的音视频片段播放结束之后，就可以将当前播放的音视频片段的下一个音视频片段确定为当前播放的音视频片段进行主线式音视频播放，直到主线式树形关系中的音视频播放完毕或接收到用户的停止播放指令为止。
举例来说，获取JSON的路径之后，解析JSON得到2个对象：main_thread和videos，分别对应了主线式树形关系和音视频列表。
获取main_thread首次索引对象，通过该对象的video_id遍历videos获取video_id一致的对象的播放器地址创建播放器，加入预加载播放器队列。通过当前播放地址遍历预加载播放器队列中播放器的对象，查找到匹配的播放器进行预览播放。
获取当前播放音视频片段下一个索引对象，过该对象的video_id遍历videos获取video_id一致的对象的播放器地址，若预加载播放器队列存在播放器播放地址与之匹配，则无需创建，否则创建播放器并初始化下一个索引对象的音视频片段的播放地址，并存储到预加载播放器队列中，并配置预加载数据量。
当前音视频片段播放结束后，若当前播放的音视频片段的地址与main_thread的当前索引之后的音视频片段的播放地址匹配，则添加到队列中，不匹配则释放(重用)。当前音视频片段播放结束后，待添加到预加载播放器队列的播放器判断队列中是否存在一致的播放地址的播放器，存在则不添加并释放，若不存在则添加到队列中。
当前音视频片段播放结束后，取main_thread下一个索引设置为当前播放的音视频片段。重复上述步骤，直到主线式树形关系中的音视频播放完毕或接收到用户的停止播放指令为止。
上述实施例表明，移动设备获取待播放音视频的目录信息，目录信息包括路径信息和播放模式，在确定播放模式为交互式预览播放时，根据路径信息确定出交互式树形关系及其对应的音视频列表，根据交互式树形关系及其对应的音视频列表以及用户选中的音视频片段进行交互式音视频播放。在解析出交互式树形关系及其对应的音视频列表之后，就可以依据该交互式树形关系、音视频列表以及用户选中的音视频片段进行交互式音视频播放，由于交互式树形关系可以体现各音视频片段的关联关系，在进行音视频播放是可以向用户展示当前播放音视频片段关联的其他音视频片段，从而可以在移动设备实现交互式的音视频片段的播放，解决了当前移动设备音视频播放的场景仅对单一音视频流播放的问题。
基于相同的技术构思，图3示例性的示出了本申请实施例提供的一种交互式音视频播放的装置的结构，该装置可以执行交互式音视频播放的流程，该装置可以位于图1所示的移动设备100内，也可以是该移动设备100。
如图3所示，该装置具体包括：
获取单元301，用于获取待播放音视频的目录信息，所述目录信息包括路径信息和播放模式；
处理单元302，用于在确定所述播放模式为交互式预览播放时，根据所述路径信息确定出交互式树形关系及其对应的音视频列表；根据所述交互式树形关系及其对应的音视频列表以及用户选中的音视频片段进行交互式音视频播放。
在一个实施例中，所述处理单元302还用于：
在确定所述播放模式为主线式预览播放时，根据所述路径信息确定出主线式树形关系及其对应的音视频列表；
根据所述主线式树形关系及其对应的音视频列表，进行主线式音视频播放。
在一个实施例中，所述处理单元302具体用于：
获取所述主线式树形关系中的第一个音视频片段的片段标识；
根据所述第一个音视频片段的片段标识，从所述主线式树形关系对应的音视频列表中确定出所述第一音视频片段的URL；
根据所述第一音视频片段的URL创建播放器进行主线式音视频播放，以及将所述播放器加入预加载播放器队列。
在一个实施例中，所述处理单元302还用于：
在所述进行主线式音视频播放之后，获取当前播放的音视频片段的下一个音视频片段的片段标识，并从所述主线式树形关系对应的音视频列表中确定出所述下一个音视频片段的URL；
根据下一个音视频片段的URL判断所述预加载播放器队列中是否存在播放所述下一个音视频片段的URL的播放器，若否，则创建播放所述下一个音视频片段的URL的播放器以及添加到所述预加载播放器队列，并继续获取位于所述下一个音视频片段之后的音视频片段的片段标识；直到所述预加载播放器队列中的播放器的数量大于预加载阈值和/或所述预加载播放器队列中的播放器加载的音视频的数量大于数量阈值为止。
在一个实施例中，所述处理单元302还用于：
在所述进行主线式音视频播放之后，在确定当前播放的音视频片段播放结束之后，将所述当前播放的音视频片段的下一个音视频片段确定为所述当前播放的音视频片段进行所述主线式音视频播放，直到所述主线式树形关系中的音视频播放完毕或接收到所述用户的停止播放指令为止。
在一个实施例中，所述处理单元302具体用于：
获取所述交互式树形关系的根节点对应的音视频片段的片段标识；
根据所述根节点对应的音视频片段的片段标识，从所述交互式树形关系对 应的音视频列表中确定出所述根节点对应的音视频片段的URL，并根据所述根节点对应的音视频片段的URL进行交互式视频播放；
解析所述根节点的所有子节点，得到所述所有子节点对应的音视频片段的片段标识；根据所述所有子节点对应的音视频片段的片段标识从所述交互式树形关系对应的音视频列表中确定出所述所有子节点对应的音视频片段的URL，并添加到待交互选择的播放地址列表进行预加载，其中预加载的播放器队列中的播放器的数量大于预加载阈值和/或所述预加载播放器队列中的播放器加载的音视频的数量大于数量阈值。
在一个实施例中，所述处理单元302还用于：
在所述根据所述根节点对应的音视频片段的URL进行交互式视频播放之后，在确定当前播放的音视频片段播放结束时，向所述用户展示所述当前播放的音视频片段的问题以及所述待交互选择的播放地址列表中各子节点对应的音视频片段的URL的选项，以使所述用户选择相应的音视频片段；
根据所述用户选中的音视频片段的片段标识，从所述待交互选择的播放地址列表确定出所述用户选中的音视频片段的URL继续进行所述交互式视频播放，并解析所述用户选中的视音频片段的子节点，得到所述用户选中的音视频片段的子节点对应的音视频片段的片段标识，根据所述用户选中的音视频片段的子节点对应的音视频片段的片段标识从所述交互式树形关系对应的音视频类别中确定出所述用户选中的音视频片段的子节点对应的音视频片段的URL，并添加到所述待交互选择的播放地址列表中进行预加载，直到所述交互式树形关系中的音视频片段全部播放完毕或接收到所述用户的停止播放指令为止。
在一个实施例中，所述处理单元302还用于：
确定所述待交互选择的播放地址列表中是否存在所述用户选中的音视频片段的子节点对应的音视频片段的URL，若存在，则不添加，若不存在，则将不存在的子节点对应的音视频片段的URL添加到所述待交互选择的播放地址列表中进行预加载；以及将所述待交互选择的播放地址列表中不属于所述用户 选中的音视频片段的子节点对应的音视频片段的URL删除。
基于相同的技术构思，本申请实施例还提供了一种计算设备，包括：
存储器，用于存储程序指令；
处理器，用于调用所述存储器中存储的程序指令，按照获得的程序执行上述交互式音视频播放的方法。
基于相同的技术构思，本申请实施例还提供了一种计算机可读非易失性存储介质，包括计算机可读指令，当计算机读取并执行所述计算机可读指令时，使得计算机执行上述交互式音视频播放的方法。
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管已描述了本申请的部分实施例，但本领域内的技术人员一旦得知了基本创造性概念，则可对这些实施例作出另外的变更和修改。所以，所附权利要求意欲解释为包括上述部分实施例以及落入本申请范围的所有变更和修改。
显然，本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样，倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内，则本申请也意图包含这些改动和变型在内。

Claims (18)

  1. 一种交互式音视频播放的方法，包括：
    移动设备获取待播放音视频的目录信息，所述目录信息包括路径信息和播放模式；
    所述移动设备在确定所述播放模式为交互式预览播放时，根据所述路径信息确定出交互式树形关系及其对应的音视频列表；
    所述移动设备根据所述交互式树形关系及其对应的音视频列表以及用户选中的音视频片段进行交互式音视频播放。
  2. 如权利要求1所述的方法，其中，所述方法还包括：
    所述移动设备在确定所述播放模式为主线式预览播放时，根据所述路径信息确定出主线式树形关系及其对应的音视频列表；
    所述移动设备根据所述主线式树形关系及其对应的音视频列表，进行主线式音视频播放。
  3. 如权利要求2所述的方法，其中，所述移动设备根据所述主线式树形关系及其对应的音视频列表，进行主线式音视频播放，包括：
    所述移动设备获取所述主线式树形关系中的第一个音视频片段的片段标识；
    所述移动设备根据所述第一个音视频片段的片段标识，从所述主线式树形关系对应的音视频列表中确定出所述第一音视频片段的URL；
    所述移动设备根据所述第一音视频片段的URL创建播放器进行主线式音视频播放，以及将所述播放器加入预加载播放器队列。
  4. 如权利要求3所述的方法，其中，在所述移动设备进行主线式音视频播放之后，还包括：
    所述移动设备获取当前播放的音视频片段的下一个音视频片段的片段标识，并从所述主线式树形关系对应的音视频列表中确定出所述下一个音视频片 段的URL；
    所述移动设备根据下一个音视频片段的URL判断所述预加载播放器队列中是否存在播放所述下一个音视频片段的URL的播放器，若否，则创建播放所述下一个音视频片段的URL的播放器以及添加到所述预加载播放器队列，并继续获取位于所述下一个音视频片段之后的音视频片段的片段标识；直到所述预加载播放器队列中的播放器的数量大于预加载阈值和/或所述预加载播放器队列中的播放器加载的音视频的数量大于数量阈值为止。
  5. 如权利要求3所述的方法，其中，在所述移动设备进行主线式音视频播放之后，还包括：
    所述移动设备在确定当前播放的音视频片段播放结束之后，将所述当前播放的音视频片段的下一个音视频片段确定为所述当前播放的音视频片段进行所述主线式音视频播放，直到所述主线式树形关系中的音视频片段播放完毕或接收到所述用户的停止播放指令为止。
  6. 如权利要求1至5任一项所述的方法，其中，所述移动设备根据所述交互式树形关系及其对应的音视频列表以及用户选中的音视频片段进行交互式音视频播放，包括：
    所述移动设备获取所述交互式树形关系的根节点对应的音视频片段的片段标识；
    所述移动设备根据所述根节点对应的音视频片段的片段标识，从所述交互式树形关系对应的音视频列表中确定出所述根节点对应的音视频片段的URL，并根据所述根节点对应的音视频片段的URL进行交互式视频播放；
    所述移动设备解析所述根节点的所有子节点，得到所述所有子节点对应的音视频片段的片段标识；根据所述所有子节点对应的音视频片段的片段标识从所述交互式树形关系对应的音视频列表中确定出所述所有子节点对应的音视频片段的URL，并添加到待交互选择的播放地址列表进行预加载，其中预加载的播放器队列中的播放器的数量大于预加载阈值和/或所述预加载播放器队列 中的播放器加载的音视频的数量大于数量阈值。
  7. 如权利要求6所述的方法，其中，在所述移动设备根据所述根节点对应的音视频片段的URL进行交互式视频播放之后，还包括：
    所述移动设备在确定当前播放的音视频片段播放结束时，向所述用户展示所述当前播放的音视频片段的问题以及所述待交互选择的播放地址列表中各子节点对应的音视频片段的URL的选项，以使所述用户选择相应的音视频片段；
    所述移动设备根据所述用户选中的音视频片段的片段标识，从所述待交互选择的播放地址列表确定出所述用户选中的音视频片段的URL继续进行所述交互式视频播放，并解析所述用户选中的视音频片段的子节点，得到所述用户选中的音视频片段的子节点对应的音视频片段的片段标识，根据所述用户选中的音视频片段的子节点对应的音视频片段的片段标识从所述交互式树形关系对应的音视频类别中确定出所述用户选中的音视频片段的子节点对应的音视频片段的URL，并添加到所述待交互选择的播放地址列表中进行预加载，直到所述交互式树形关系中的音视频片段全部播放完毕或接收到所述用户的停止播放指令为止。
  8. 如权利要求7所述的方法，其中，所述根据所述用户选中的音视频片段的子节点对应的音视频片段的片段标识从所述交互式树形关系对应的音视频类别中确定出所述用户选中的音视频片段的子节点对应的音视频片段的URL，并添加到所述待交互选择的播放地址列表中进行预加载，包括：
    确定所述待交互选择的播放地址列表中是否存在所述用户选中的音视频片段的子节点对应的音视频片段的URL，若存在，则不添加，若不存在，则将不存在的子节点对应的音视频片段的URL添加到所述待交互选择的播放地址列表中进行预加载；以及将所述待交互选择的播放地址列表中不属于所述用户选中的音视频片段的子节点对应的音视频片段的URL删除。
  9. 一种交互式音视频播放的装置，包括：
    获取单元，用于获取待播放音视频的目录信息，所述目录信息包括路径信息和播放模式；
    处理单元，用于在确定所述播放模式为交互式预览播放时，根据所述路径信息确定出交互式树形关系及其对应的音视频列表；根据所述交互式树形关系及其对应的音视频列表以及用户选中的音视频片段进行交互式音视频播放。
  10. 如权利要求9所述的装置，其中，所述处理单元还用于：
    在确定所述播放模式为主线式预览播放时，根据所述路径信息确定出主线式树形关系及其对应的音视频列表；
    根据所述主线式树形关系及其对应的音视频列表，进行主线式音视频播放。
  11. 如权利要求10所述的装置，其中，所述处理单元具体用于：
    获取所述主线式树形关系中的第一个音视频片段的片段标识；
    根据所述第一个音视频片段的片段标识，从所述主线式树形关系对应的音视频列表中确定出所述第一音视频片段的URL；
    根据所述第一音视频片段的URL创建播放器进行主线式音视频播放，以及将所述播放器加入预加载播放器队列。
  12. 如权利要求11所述的装置，其中，所述处理单元还用于：
    在所述进行主线式音视频播放之后，获取当前播放的音视频片段的下一个音视频片段的片段标识，并从所述主线式树形关系对应的音视频列表中确定出所述下一个音视频片段的URL；
    根据下一个音视频片段的URL判断所述预加载播放器队列中是否存在播放所述下一个音视频片段的URL的播放器，若否，则创建播放所述下一个音视频片段的URL的播放器以及添加到所述预加载播放器队列，并继续获取位于所述下一个音视频片段之后的音视频片段的片段标识；直到所述预加载播放器队列中的播放器的数量大于预加载阈值和/或所述预加载播放器队列中的播放器加载的音视频的数量大于数量阈值为止。
  13. 如权利要求11所述的装置，其中，所述处理单元还用于：
    在所述进行主线式音视频播放之后，在确定当前播放的音视频片段播放结束之后，将所述当前播放的音视频片段的下一个音视频片段确定为所述当前播放的音视频片段进行所述主线式音视频播放，直到所述主线式树形关系中的音视频片段播放完毕或接收到所述用户的停止播放指令为止。
  14. 如权利要求9至13任一项所述的装置，其中，所述处理单元具体用于：
    获取所述交互式树形关系的根节点对应的音视频片段的片段标识；
    根据所述根节点对应的音视频片段的片段标识，从所述交互式树形关系对应音视频列表中确定出所述根节点对应的音视频片段的URL，并根据所述根节点对应的音视频片段的URL进行交互式视频播放；
    解析所述根节点的所有子节点，得到所述所有子节点对应的音视频片段的片段标识；根据所述所有子节点对应的音视频片段的片段标识从所述交互式树形关系对应的音视频列表中确定出所述所有子节点对应的音视频片段的URL，并添加到待交互选择的播放地址列表进行预加载，其中预加载的播放器队列中的播放器的数量大于预加载阈值和/或所述预加载播放器队列中的播放器加载的音视频的数量大于数量阈值。
  15. 如权利要求14所述的装置，其中，所述处理单元还用于：
    在所述根据所述根节点对应的音视频片段的URL进行交互式视频播放之后，在确定当前播放的音视频片段播放结束时，向所述用户展示所述当前播放的音视频片段的问题以及所述待交互选择的播放地址列表中各子节点对应的音视频片段的URL的选项，以使所述用户选择相应的音视频片段；
    根据所述用户选中的音视频片段的片段标识，从所述待交互选择的播放地址列表确定出所述用户选中的音视频片段的URL继续进行所述交互式视频播放，并解析所述用户选中的视音频片段的子节点，得到所述用户选中的音视频片段的子节点对应的音视频片段的片段标识，根据所述用户选中的音视频片段 的子节点对应的音视频片段的片段标识从所述交互式树形关系对应的音视频类别中确定出所述用户选中的音视频片段的子节点对应的音视频片段的URL，并添加到所述待交互选择的播放地址列表中进行预加载，直到所述交互式树形关系中的音视频片段全部播放完毕或接收到所述用户的停止播放指令为止。
  16. 如权利要求15所述的装置，其中，所述处理单元还用于：
    确定所述待交互选择的播放地址列表中是否存在所述用户选中的音视频片段的子节点对应的音视频片段的URL，若存在，则不添加，若不存在，则将不存在的子节点对应的音视频片段的URL添加到所述待交互选择的播放地址列表中进行预加载；以及将所述待交互选择的播放地址列表中不属于所述用户选中的音视频片段的子节点对应的音视频片段的URL删除。
  17. 一种计算设备，包括：
    存储器，用于存储程序指令；
    处理器，用于调用所述存储器中存储的程序指令，按照获得的程序执行权利要求1至8任一项所述的方法。
  18. 一种计算机可读非易失性存储介质，包括计算机可读指令，当计算机读取并执行所述计算机可读指令时，使得计算机执行如权利要求1至8任一项所述的方法。
PCT/CN2020/074964 2019-07-25 2020-02-12 一种交互式音视频播放的方法及装置 WO2021012665A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
GB2101362.8A GB2590018A (en) 2019-07-25 2020-09-08 Video playback method, electronic device, and storage medium
PCT/CN2020/114082 WO2021013272A1 (zh) 2019-07-25 2020-09-08 一种视频播放方法、电子设备以及存储介质
US17/169,345 US20210160577A1 (en) 2019-07-25 2021-02-05 Method for playing video, electronic device and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910676150.7A CN110381384A (zh) 2019-07-25 2019-07-25 一种交互式音视频播放的方法及装置
CN201910676150.7 2019-07-25

Publications (1)

Publication Number Publication Date
WO2021012665A1 true WO2021012665A1 (zh) 2021-01-28

Family

ID=68255978

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/074964 WO2021012665A1 (zh) 2019-07-25 2020-02-12 一种交互式音视频播放的方法及装置

Country Status (4)

Country Link
US (1) US20210160577A1 (zh)
CN (2) CN110381384A (zh)
GB (1) GB2590018A (zh)
WO (1) WO2021012665A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113347503A (zh) * 2021-06-15 2021-09-03 广州酷狗计算机科技有限公司 音视频播放方法、装置、计算机设备及存储介质
CN114900740A (zh) * 2022-04-14 2022-08-12 北京奇艺世纪科技有限公司 一种多媒体对象的连播控制方法、系统及装置

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110381384A (zh) * 2019-07-25 2019-10-25 网宿科技股份有限公司 一种交互式音视频播放的方法及装置
WO2021013272A1 (zh) * 2019-07-25 2021-01-28 网宿科技股份有限公司 一种视频播放方法、电子设备以及存储介质
CN111464861B (zh) * 2020-03-06 2022-06-17 深圳千舟云格科技有限公司 一种交互方法及交互系统
CN111935548A (zh) * 2020-08-11 2020-11-13 深圳市前海手绘科技文化有限公司 一种交互式手绘视频制作方法
CN112631752B (zh) * 2020-12-28 2024-04-19 中金数据（武汉）超算技术有限公司 一种基于操作优先度的列表操作方法及装置
CN116017040A (zh) * 2022-12-02 2023-04-25 北京奇艺世纪科技有限公司 一种多媒体内容播放方法、装置、电子设备及存储介质
CN116567353B (zh) * 2023-07-10 2023-09-12 湖南快乐阳光互动娱乐传媒有限公司 一种视频投放方法及装置、存储介质及电子设备

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127867A (zh) * 2006-08-16 2008-02-20 任峰 可选择情节的视频播放方法
CN102917258A (zh) * 2012-10-12 2013-02-06 深圳Tcl新技术有限公司 基于视频内容的视频播放方法、终端及系统
US20140270708A1 (en) * 2013-03-12 2014-09-18 Fuji Xerox Co., Ltd. Video clip selection via interaction with a hierarchic video segmentation
CN105472456A (zh) * 2015-11-27 2016-04-06 北京奇艺世纪科技有限公司 一种视频播放方法及装置
US20170345460A1 (en) * 2014-04-10 2017-11-30 JBF Interlude 2009 LTD Systems and methods for creating linear video from branched video
CN109982142A (zh) * 2017-12-28 2019-07-05 优酷网络技术（北京）有限公司 视频播放方法及装置
CN110381384A (zh) * 2019-07-25 2019-10-25 网宿科技股份有限公司 一种交互式音视频播放的方法及装置

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9009619B2 (en) * 2012-09-19 2015-04-14 JBF Interlude 2009 Ltd—Israel Progress bar for branched videos
CN103888790B (zh) * 2012-12-21 2017-02-15 中国科学院声学研究所 一种epg适配系统及方法
US8977113B1 (en) * 2013-10-25 2015-03-10 Joseph Rumteen Mobile device video decision tree
CN103986977A (zh) * 2014-04-15 2014-08-13 上海聚力传媒技术有限公司 用于在内容分发网络中预加载视频的方法与设备
CN105430509B (zh) * 2015-11-27 2018-10-30 北京奇艺世纪科技有限公司 一种多媒体文件播放方法及装置
CN106851162A (zh) * 2017-02-17 2017-06-13 成都依能科技股份有限公司 视频录制方法及装置
CN106803993B (zh) * 2017-03-01 2020-04-07 腾讯科技（深圳）有限公司 一种实现视频分支选择播放的方法及装置
US10327040B1 (en) * 2017-09-28 2019-06-18 Twitch Interactive, Inc. Forward error correction for low latency streaming
CN107948751A (zh) * 2017-11-24 2018-04-20 互影科技（北京）有限公司 分支剧情视频的播放方法及装置
CN108260014A (zh) * 2018-04-12 2018-07-06 腾讯科技（上海）有限公司 一种视频播放方法和终端以及存储介质
CN108521589A (zh) * 2018-04-25 2018-09-11 北京比特智学科技有限公司 视频处理方法和装置
CN108429932A (zh) * 2018-04-25 2018-08-21 北京比特智学科技有限公司 视频处理方法和装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127867A (zh) * 2006-08-16 2008-02-20 任峰 可选择情节的视频播放方法
CN102917258A (zh) * 2012-10-12 2013-02-06 深圳Tcl新技术有限公司 基于视频内容的视频播放方法、终端及系统
US20140270708A1 (en) * 2013-03-12 2014-09-18 Fuji Xerox Co., Ltd. Video clip selection via interaction with a hierarchic video segmentation
US20170345460A1 (en) * 2014-04-10 2017-11-30 JBF Interlude 2009 LTD Systems and methods for creating linear video from branched video
CN105472456A (zh) * 2015-11-27 2016-04-06 北京奇艺世纪科技有限公司 一种视频播放方法及装置
CN109982142A (zh) * 2017-12-28 2019-07-05 优酷网络技术（北京）有限公司 视频播放方法及装置
CN110381384A (zh) * 2019-07-25 2019-10-25 网宿科技股份有限公司 一种交互式音视频播放的方法及装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113347503A (zh) * 2021-06-15 2021-09-03 广州酷狗计算机科技有限公司 音视频播放方法、装置、计算机设备及存储介质
CN114900740A (zh) * 2022-04-14 2022-08-12 北京奇艺世纪科技有限公司 一种多媒体对象的连播控制方法、系统及装置
CN114900740B (zh) * 2022-04-14 2024-02-23 北京奇艺世纪科技有限公司 一种多媒体对象的连播控制方法、系统及装置

Also Published As

Publication number Publication date
CN111787406B (zh) 2022-11-18
US20210160577A1 (en) 2021-05-27
GB2590018A (en) 2021-06-16
CN111787406A (zh) 2020-10-16
GB202101362D0 (en) 2021-03-17
CN110381384A (zh) 2019-10-25

Similar Documents

Publication Publication Date Title
WO2021012665A1 (zh) 一种交互式音视频播放的方法及装置
US20240154835A1 (en) Providing Synchronous Content and Supplemental Experiences
US11417341B2 (en) Method and system for processing comment information
WO2017181594A1 (zh) 一种视频显示方法及装置
CN109257631B (zh) 视频轮播播放方法、装置、计算机设备及存储介质
WO2021012664A1 (zh) 一种基于移动端交互式音视频生成的方法及装置
CN108174280B (zh) 一种音视频在线播放方法及系统
WO2017096983A1 (zh) 切换视频播放终端的方法和终端设备
CN106791988B (zh) 多媒体数据轮播方法和终端
WO2017181597A1 (zh) 视频播放方法及装置
WO2016123158A1 (en) Custom media channels
US11778286B2 (en) Systems and methods for summarizing missed portions of storylines
US20170078766A1 (en) Channel classification methods and devices
WO2019114330A1 (zh) 一种视频播放方法、装置和终端设备
WO2017101418A1 (zh) 多路流媒体播放方法及设备
US20160294903A1 (en) Method and device for pushing resources to mobile communication terminal by smart television
WO2017181595A1 (zh) 一种视频显示方法及装置
CN107205177A (zh) 视频播放方法及装置
CN111541905B (zh) 一种直播方法、装置、计算机设备和存储介质
CN113132194A (zh) 一种信息流转方法、装置、设备、服务器及存储介质
TWI501631B (zh) 即時串流媒體之播放方法
US20220167040A1 (en) Voice control of a video playback system
US20180176631A1 (en) Methods and systems for providing an interactive second screen experience
US20170285912A1 (en) Methods, systems, and media for media guidance
US20210029420A1 (en) Method and apparatus for generating interactive audio-video based on mobile terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20843559

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20843559

Country of ref document: EP

Kind code of ref document: A1