WO2021012664A1 - 一种基于移动端交互式音视频生成的方法及装置 - Google Patents

一种基于移动端交互式音视频生成的方法及装置 Download PDF

Info

Publication number
WO2021012664A1
WO2021012664A1 PCT/CN2020/074963 CN2020074963W WO2021012664A1 WO 2021012664 A1 WO2021012664 A1 WO 2021012664A1 CN 2020074963 W CN2020074963 W CN 2020074963W WO 2021012664 A1 WO2021012664 A1 WO 2021012664A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
audio
node
interactive
tree
Prior art date
Application number
PCT/CN2020/074963
Other languages
English (en)
French (fr)
Inventor
陈燕鹏
Original Assignee
网宿科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 网宿科技股份有限公司 filed Critical 网宿科技股份有限公司
Priority to EP20725764.3A priority Critical patent/EP3790008A4/en
Priority to US16/882,355 priority patent/US20210029420A1/en
Publication of WO2021012664A1 publication Critical patent/WO2021012664A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection
    • H04N21/4825—End-user interface for program selection using a list of items to be played back in a given order, e.g. playlists
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Definitions

  • the embodiments of the present application relate to the field of video playback technology, and in particular to a method and device based on interactive audio and video generation on a mobile terminal.
  • the audience in the traditional streaming media on-demand playback method is still a single receiver, and the introduction of interactive video allows traditional on-demand viewers to participate in the interaction related to the video content when watching the video content, enhance the interactive interest, and achieve more Value video on demand.
  • the embodiments of the present application provide a method and device based on mobile terminal interactive audio and video generation, so as to realize the generation and production of interactive interactive video on mobile equipment.
  • an embodiment of the present application provides a method for interactive audio and video generation based on a mobile terminal, including:
  • the mobile device obtains the name of the interactive audio and video to be generated and the corresponding audio and video fragments, and creates an interactive audio and video directory according to the name of the interactive audio and video to be generated;
  • the mobile device determines the video list and tree fields in the interactive audio and video directory according to the audio and video clips;
  • the mobile device draws the tree relationship in the interactive audio and video directory according to the tree field, and edits the tree relationship according to the video list;
  • the mobile device generates the interactive audio and video according to the video list and the tree relationship in the interactive audio and video directory.
  • the mobile device can draw the tree relationship in the interactive audio and video catalog, and edit the tree relationship, so as to realize the interactive association relationship, so as to realize the production and generation of interactive audio and video on the mobile device. It solves the problem that existing mobile devices cannot realize interactive video content.
  • the mobile device determines the video list and tree fields in the interactive audio and video directory according to the audio and video clips, including:
  • the mobile device puts the audio and video segment into the video list, generates the tree field, and fills the root node;
  • the mobile device puts the audio and video segment into the video list and fills in the leaf nodes of the tree field.
  • the corresponding relationship between the audio and video clips and each node can be realized by filling the nodes in the tree field.
  • the tree relationship includes an interactive tree relationship and a mainline tree relationship
  • the mobile device draws the tree relationship in the interactive audio and video directory according to the tree field, and edits the tree relationship according to the video list, including:
  • the mobile device traverses the root node and the leaf node in the tree field, and draws the interactive tree relationship in the interactive audio and video directory according to the interactive audio and video interaction rule information issued by the user, and downloads it from the Determining the main-line tree relationship in the interactive tree relationship;
  • the mobile device edits the audio and video clips corresponding to each node in the interactive tree relationship and the association relationship between the nodes according to the interaction rule information and the audio and video clips in the video list; and edits the Correspondence between each node in the main-line tree relationship and audio and video clips;
  • association relationship includes interactive description and multiple options.
  • the method further includes:
  • the mobile device obtains the node modification information issued by the user
  • the mobile device creates a new child node and modifies the association relationship of the new child node
  • the mobile device deletes the deleted node according to the identifier of the deleted node
  • the mobile device modifies the association relationship of the modification node according to the identifier of the modification node.
  • the management of each node in the tree relationship can be realized by obtaining the node modification information issued by the user.
  • the method further includes:
  • the mobile device obtains the audio and video clips to be deleted issued by the user;
  • the mobile device determines whether the audio and video segment to be deleted is associated with the node of the tree relationship, and if not, deletes the audio and video segment to be deleted, otherwise it is not deleted.
  • the management of the audio and video segments can be realized by judging the audio and video segments to be deleted.
  • the mobile device generating the interactive audio and video according to the video list and the tree relationship in the interactive audio and video directory includes:
  • the mobile device uploads the audio and video clips in the video list, and determines the URL of each of the audio and video clips;
  • the mobile device updates the video list in the interactive audio and video catalog according to the URL of each audio and video segment;
  • the mobile device uploads the updated interactive audio and video catalog, and determines the URL of the interactive audio and video catalog.
  • the URL corresponding to each audio and video clip is obtained by uploading the audio and video clips in the video list, so that the audio and video clips can be published.
  • an embodiment of the present application provides a mobile terminal interactive audio and video generation device, including:
  • the obtaining unit is configured to obtain the name of the interactive audio and video to be generated and the corresponding audio and video fragments, and create an interactive audio and video catalog according to the name of the interactive audio and video to be generated;
  • the processing unit is configured to determine the video list and tree field in the interactive audio and video directory according to the audio and video clips; draw the tree relationship in the interactive audio and video directory according to the tree field, and according to The video list edits the tree relationship; the interactive audio and video are generated according to the video list and the tree relationship in the interactive audio and video directory.
  • the processing unit is specifically configured to:
  • the tree relationship includes an interactive tree relationship and a mainline tree relationship
  • the processing unit is specifically used for:
  • association relationship includes interactive description and multiple options.
  • processing unit is further configured to:
  • node modification information is a new node, create a new child node and modify the association relationship of the new child node;
  • the node modification information is a deleted node, delete the deleted node according to the identifier of the deleted node;
  • the association relationship of the modification node is modified according to the identifier of the modification node.
  • processing unit is further configured to:
  • the processing unit is specifically configured to:
  • an embodiment of the present application also provides a computing device, including:
  • Memory used to store program instructions
  • the processor is configured to call the program instructions stored in the memory, and execute the above-mentioned method based on mobile terminal interactive audio and video generation according to the obtained program.
  • the embodiments of the present application also provide a computer-readable non-volatile storage medium, including computer-readable instructions.
  • the computer reads and executes the computer-readable instructions, the computer executes the above-mentioned mobile terminal Interactive audio and video generation method.
  • FIG. 1 is a schematic diagram of a system architecture provided by an embodiment of the application
  • FIG. 2 is a schematic flowchart of a method for interactive audio and video generation based on a mobile terminal according to an embodiment of the application;
  • FIG. 3 is a schematic structural diagram of an apparatus for interactive audio and video generation based on a mobile terminal according to an embodiment of the application.
  • FIG. 1 is a system architecture to which an embodiment of the application is applicable.
  • the system architecture may be a mobile device 100, including a radio frequency (RF) circuit 110, a memory 120, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, and wireless fidelity (wireless fidelity). , WiFi) module 170 and processor 180.
  • the mobile device 100 can be used to generate interactive audio and video.
  • the mobile device 100 shown in FIG. 1 is only an example and not a limitation.
  • the mobile device 100 may also include more or less components than those shown in the figure, or combine certain components, or Different component arrangements.
  • the RF circuit 110 can be used to receive and send signals during the process of sending and receiving data or during a call.
  • the received audio and video streams are sent to the processor 180 for processing.
  • the memory 120 may be used to store software programs and modules.
  • the processor 180 executes various functional applications and data processing of the mobile device 100 by running the software programs and modules stored in the memory 120.
  • the memory 120 may mainly include a program storage area and a data storage area.
  • the program storage area may store an operating system, an application program required by at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data (such as audio data, phone book, etc.) created by the use of the mobile device 100, etc.
  • the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.
  • the input unit 130 may be used to receive input numeric or character information, and generate key signals related to user settings and function control of the mobile device 100.
  • the input unit 130 may include a touch panel 131, a camera 132, and other input devices 133.
  • the display unit 140 can be used to display information input by the user or information provided to the user and various menus of the mobile device 100.
  • the display unit 140 may include a display panel 141.
  • the display panel 141 may be configured in the form of a liquid crystal display unit (LCD, Liquid Crystal Display), an organic light emitting diode (OLED, Organic Light-Emitting Diode), etc.
  • the touch panel 131 can cover the display panel 141. When the touch panel 131 detects a touch operation on or near it, it transmits it to the processor 180 to determine the type of the touch event. The type of touch event provides corresponding visual output on the display panel 141.
  • the mobile device 100 may further include at least one sensor 150, such as an attitude sensor, a distance sensor, and other sensors.
  • at least one sensor 150 such as an attitude sensor, a distance sensor, and other sensors.
  • the audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the mobile device 100.
  • the audio circuit 160 may transmit the converted electrical signal of the received audio data to the processor 180 for language recognition.
  • WiFi is a short-distance wireless transmission technology.
  • the mobile device 100 can help users send and receive emails, browse webpages, and access streaming media (such as live video), etc. It provides users with wireless broadband Internet access.
  • the processor 180 is the control center of the mobile device 100. It uses various interfaces and lines to connect the various parts of the entire mobile device 100, runs or executes software programs and/or modules stored in the memory 120, and calls and stores them in the memory 120. , Execute various functions of the mobile device 100 and process data, so as to monitor the mobile device 100 as a whole.
  • FIG. 2 exemplarily shows the flow of a method for generating interactive audio and video based on a mobile terminal provided by an embodiment of the present application.
  • the flow can be executed by a device based on interactive audio and video generation on a mobile terminal.
  • the apparatus may be located in the mobile device 100 as shown in FIG. 1, or it may be the mobile device 100.
  • the process specifically includes:
  • Step 201 The mobile device obtains the name of the interactive audio and video to be generated and the corresponding audio and video fragments, and creates an interactive audio and video directory according to the name of the interactive audio and video to be generated.
  • audio and video producers need to generate interactive audio and video, they can import interactive audio and video files on their mobile devices. At this time, they can include the name of the interactive audio and video to be generated and its corresponding audio and video clips. The name of the interactive audio and video to be generated is used to enable the mobile device to create an interactive audio and video directory, for example, a JSON directory.
  • the audio and video clip may be an audio and video clip shot by an audio and video creator through the mobile device, or an audio and video clip imported through the mobile device.
  • the shooting parameters can be configured first, and if the audio and video creator has not specified the parameters, the default parameters of the mobile device can be used.
  • shooting starts call the camera and microphone of the mobile device to collect and encode audio and video according to the parameter configuration, and then move the captured audio and video clips to the interactive video directory for management and update the JSON.
  • Step 202 The mobile device determines the video list and tree fields in the interactive audio and video directory according to the audio and video clips.
  • the mobile device puts the audio and video segment into the video list, generates the tree field, and fills the root node. If the audio and video segment is not the first audio and video segment, the mobile device will put the audio and video segment into the video list and fill in the leaf nodes of the tree field.
  • the obtained audio and video clip is the first audio and video clip
  • update the videos (video list) array list in JSON generate a tree (tree) field and fill in the first root node.
  • Step 203 The mobile device draws a tree relationship in the interactive audio and video directory according to the tree field, and edits the tree relationship according to the video list.
  • the tree relationship may include an interactive tree relationship and a mainline tree relationship.
  • you can draw the tree relationship in the interactive audio and video directory according to the tree field, and edit the tree relationship in the video list.
  • the mobile device can first traverse the root node and the leaf node in the tree field, and draw the mainline tree relationship in the interactive audio and video directory according to the interactive audio and video interaction rule information issued by the user. Then, according to the interaction rule information and the audio and video segments in the video list, the audio and video segments corresponding to each node in the tree relationship and the association relationship between the nodes are edited.
  • the association relationship includes interactive description and multiple options.
  • the above interactive rules are the tree-shaped relationship edited by the user, the association relationship of each node edited by the user, and the interactive description information of each node. It is equivalent to that the user moves or edits a certain node on the graphical interface, and the mobile device edits the corresponding node accordingly.
  • the main line tree relationship can also be determined from the above main line tree relationship. Since the main line tree relationship is a fixed tree relationship, the association relationship between the nodes in the main line tree relationship is fixed. When editing nodes, you only need to edit the corresponding relationship between each node in the mainline tree relationship and the audio and video clips.
  • the interactive tree relationship is used to realize the user-defined different branches of playing audio and video through interaction when the user plays the video.
  • the mainline tree relationship is a fixed mainline plot used to play audio and video, and there is no interaction with users.
  • each node of the above tree relationship can be modified.
  • the mobile device obtains the node modification information issued by the user, and when the node modification information is a new node, it creates a new child node and modifies the new node. The relationship of the child nodes. If the node modification information is a deleted node, the deleted node is deleted according to the identifier of the deleted node. If the node modification information is a modification node, the association relationship of the modification node is modified according to the identifier of the modification node.
  • the arrangement of the above interactive tree relationship is the interactive rule of interactive video. It traverses the root node to the leaf node from top to bottom.
  • the node association relationship includes a question n options, and the node can be associated with a new child node, or the questions and options of the currently associated node can be modified.
  • the next option associated item is dynamically generated.
  • the node is not required to be unique and can be repeated.
  • a globally unique identifier GUID is generated for each newly generated node and the JSON is updated.
  • the mobile device can also obtain the audio and video fragments to be deleted issued by the user. At this time, it is determined whether the audio and video fragments to be deleted are associated with the node of the tree relationship. delete. That is to say, before deleting the audio and video segment, check whether the current tree structure has been associated with the current audio and video segment, if it has been associated, it is not allowed to delete, if it is not associated, it can be deleted. Correspondingly, the name of each audio and video clip can also be modified. At this time, the name in the field containing the current clip in the JSON needs to be updated.
  • Step 204 The mobile device generates the interactive audio and video according to the video list and the tree relationship in the interactive audio and video directory.
  • the interactive audio and video directory needs to be uploaded to obtain the URL of the interactive audio and video directory, which is equivalent to generating the interactive audio and video.
  • the mobile device first uploads the audio and video clips in the video list, determines the URL of each audio and video clip, and then updates the video list in the interactive audio and video catalog according to the URL of each audio and video clip, and finally updates the video list. Upload the interactive audio and video catalog to determine the URL of the interactive audio and video catalog.
  • upload the audio and video clips in turn to get the URL returned by the server to update the URL field of videos in the JSON.
  • upload the updated JSON and then you can share the URL obtained after uploading the JSON.
  • the audio and video segments corresponding to each node in the main-line tree relationship are the audio-video segments of the main-line process, and the main-line process is the video of the specified audio-video segments connected in series to form a traditional single process.
  • the first node can be used as the main line process by default when the upper and lower levels of the node relationship is generated, or the selected branch can be designated as the main line process after the node relationship is generated.
  • the mainline tree relationship can be determined based on the interactive tree relationship, that is, the nodes required for the mainline tree relationship are determined from the interactive tree relationship.
  • the foregoing embodiment shows that the mobile device obtains the name of the interactive audio and video to be generated and its corresponding audio and video clips, and creates an interactive audio and video directory according to the name of the interactive audio and video to be generated, and determines the interactive audio and video according to the audio and video clips.
  • the video list and tree field in the video directory according to the tree field, draw the tree relationship in the interactive audio and video directory, and edit the tree relationship according to the video list, according to the video list and tree in the interactive audio and video directory Relationship, generate interactive audio and video.
  • the mobile device can draw the tree relationship in the interactive audio and video catalog, and edit the tree relationship in order to realize the interactive association relationship, so as to realize the production and generation of interactive audio and video on the mobile device, which solves the existing mobile
  • the device cannot realize the problem of interactive video content.
  • FIG. 3 exemplarily shows the structure of a mobile terminal interactive audio and video generation device provided by an embodiment of the present application.
  • the device can execute a mobile terminal interactive audio and video generation process.
  • the apparatus may be located in the mobile device 100 shown in FIG. 1, or it may be the mobile device 100.
  • the device specifically includes:
  • the obtaining unit 301 is configured to obtain the name of the interactive audio and video to be generated and the corresponding audio and video fragments, and create an interactive audio and video directory according to the name of the interactive audio and video to be generated;
  • the processing unit 302 is configured to determine the video list and tree field in the interactive audio and video directory according to the audio and video clips; draw the tree relationship in the interactive audio and video directory according to the tree field, and The tree relationship is edited according to the video list; the interactive audio and video are generated according to the video list and the tree relationship in the interactive audio and video directory.
  • processing unit 302 is specifically configured to:
  • the tree relationship includes an interactive tree relationship and a mainline tree relationship
  • the processing unit 302 is specifically configured to:
  • association relationship includes interactive description and multiple options.
  • processing unit 302 is further configured to:
  • node modification information is a new node, create a new child node and modify the association relationship of the new child node;
  • the node modification information is a deleted node, delete the deleted node according to the identifier of the deleted node;
  • the association relationship of the modification node is modified according to the identifier of the modification node.
  • processing unit 302 is further configured to:
  • processing unit 302 is specifically configured to:
  • an embodiment of the present application also provides a computing device, including:
  • Memory used to store program instructions
  • the processor is configured to call the program instructions stored in the memory, and execute the above-mentioned method based on mobile terminal interactive audio and video generation according to the obtained program.
  • the embodiments of the present application also provide a computer-readable non-volatile storage medium, including computer-readable instructions.
  • the computer reads and executes the computer-readable instructions, the computer executes the above-mentioned The method of interactive audio and video generation on the mobile terminal.
  • These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment.
  • the instructions provide steps for implementing functions specified in a flow or multiple flows in the flowchart and/or a block or multiple blocks in the block diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请公开了一种基于移动端交互式音视频生成的方法及装置，该方法包括移动设备获取待生成交互式音视频的名称及其对应的音视频片段，并根据待生成交互式音视频的名称创建交互式音视频目录（201）；移动设备根据音视频片段，确定交互式音视频目录中的视频列表和树字段（202）；移动设备根据树字段，绘制交互式音视频目录中的树形关系，并根据视频列表对树形关系进行编辑（203）；移动设备根据交互式音视频目录中的视频列表和树形关系，生成交互式音视频（204）。

Description

一种基于移动端交互式音视频生成的方法及装置
交叉引用
本申请引用于2019年07月25日递交的名称为“一种基于移动端交互式音视频生成的方法及装置”的第201910676131.4号中国专利申请，其通过引用被全部并入本申请。
技术领域
本申请实施例涉及视频播放技术领域，尤其涉及一种基于移动端交互式音视频生成的方法及装置。
背景技术
随着移动互联网的高速发展及终端设备性能的不断提升，使用移动设备随时随地在线观看直播和点播视频的行为越来越普及，而直播由于具备实时性可以实现良好的主播与观众互动，点播由于没有实时性就无法实现互动。
传统的流媒体点播的播放方式中的观众还是单一的接收方，而互动视频的引入可以让传统的点播观众在观看视频内容时还能参与与视频内容相关的互动，提升互动趣味，实现更有价值的视频点播。
移动互联网时代，视频内容制作趋于普遍，使用移动端设备即可制作内容丰富的视频，但是当前移动端视频制作编辑最终生成的仅是单一的视频，不具备互动特征。
发明内容
本申请实施例提供一种基于移动端交互式音视频生成的方法及装置，用 以实现在移动设备上生成制作交互式互动视频。
第一方面，本申请实施例提供一种基于移动端交互式音视频生成的方法，包括：
移动设备获取待生成交互式音视频的名称及其对应的音视频片段，并根据所述待生成交互式音视频的名称创建交互式音视频目录；
所述移动设备根据所述音视频片段，确定所述交互式音视频目录中的视频列表和树字段；
所述移动设备根据所述树字段，绘制所述交互式音视频目录中的树形关系，并根据所述视频列表对所述树形关系进行编辑；
所述移动设备根据所述交互式音视频目录中的视频列表和树形关系，生成所述交互式音视频。
上述技术方案中，移动设备可以绘制交互式音视频目录中的树形关系，并对该树形关系进行编辑，以便实现交互式的关联关系，从而实现在移动设备上制作生成交互式音视频，解决了现有移动设备无法实现交互性质的视频内容的问题。
在一个实施例中，所述移动设备根据所述音视频片段，确定所述交互式音视频目录中的视频列表和树字段，包括：
若所述音视频片段为第一个音视频片段，则所述移动设备将所述音视频片段放入所述视频列表，生成所述树字段并填充根节点；
若所述音视频片段不是第一个音视频片段，则所述移动设备将所述音视频片段放入所述视频列表，并填写所述树字段的叶子节点。
上述技术方案中，通过对树字段中节点的填充，可以实现音视频片段与各节点的对应关系。
在一个实施例中，所述树形关系包括交互式树形关系和主线式树形关系；
所述移动设备根据所述树字段，绘制所述交互式音视频目录中的树形关系，并根据所述视频列表对所述树形关系进行编辑，包括：
所述移动设备遍历所述树字段中的根节点和叶子节点，根据用户下发的交互式音视频的交互规则信息，绘制所述交互式音视频目录中的交互式树形关系，并从所述交互式树形关系中确定出所述主线式树形关系；
所述移动设备根据所述交互规则信息以及所述视频列表中的音视频片段，编辑所述交互式树形关系中各节点对应的音视频片段以及各节点之间的关联关系；以及编辑所述主线式树形关系中各节点与音视频片段的对应关系；
其中，所述关联关系包括交互式描述和多个选项。
上述技术方案中，通过交互规则信息以及遍历树字段，绘制交互式树形关系和主线式树形关系，并对树形关系进行编辑，从而实现在移动设备上编辑交互式音视频的目的。
在一个实施例中，所述移动设备在根据所述视频列表对所述树形关系进行编辑之后，还包括：
所述移动设备获取用户下发的节点修改信息；
若所述节点修改信息为新增节点，则所述移动设备创建新的子节点，并修改所述新的子节点的关联关系；
若所述节点修改信息为删除节点，则所述移动设备根据所述删除节点的标识，对所述删除节点进行删除；
若所述节点修改信息为修改节点，则所述移动设备根据所述修改节点的标识，修改所述修改节点的关联关系。
上述技术方案中，通过获取用户下发的节点修改信息可以实现对树形关系中各节点的管理。
在一个实施例中，所述移动设备在根据所述视频列表对所述树形关系进行编辑之后，还包括：
所述移动设备获取用户下发的待删除的音视频片段；
所述移动设备确定所述待删除的音视频片段是否与所述树形关系的节点关联，若否，将所述待删除的音视频片段删除，否则不删除。
上述技术方案中，通过对待删除的音视频片段的判断，可以实现对音视频片段的管理。
在一个实施例中，所述移动设备根据所述交互式音视频目录中的视频列表和树形关系，生成所述交互式音视频，包括：
所述移动设备将所述视频列表中的音视频片段进行上传，确定出各所述音视频片段的URL；
所述移动设备根据各所述音视频片段的URL，更新所述交互式音视频目录中的视频列表；
所述移动设备将更新后的所述交互式音视频目录进行上传，确定出所述交互式音视频目录的URL。
上述技术方案中，通过视频列表中的音视频片段进行上传来获取各音视频片段对应的URL，从而可以实现将音视频片段进行发布。
第二方面，本申请实施例提供一种基于移动端交互式音视频生成的装置，包括：
获取单元，用于获取待生成交互式音视频的名称及其对应的音视频片段，并根据所述待生成交互式音视频的名称创建交互式音视频目录；
处理单元，用于根据所述音视频片段，确定所述交互式音视频目录中的视频列表和树字段；根据所述树字段，绘制所述交互式音视频目录中的树形关系，并根据所述视频列表对所述树形关系进行编辑；根据所述交互式音视频目录中的视频列表和树形关系，生成所述交互式音视频。
在一个实施例中，所述处理单元具体用于：
若所述音视频片段为第一个音视频片段，则将所述音视频片段放入所述视频列表，生成所述树字段并填充根节点；
若所述音视频片段不是第一个音视频片段，则将所述音视频片段放入所述视频列表，并填写所述树字段的叶子节点。
在一个实施例中，所述树形关系包括交互式树形关系和主线式树形关系；
所述处理单元具体用于：
遍历所述树字段中的根节点和叶子节点，根据用户下发的交互式音视频的交互规则信息，绘制所述交互式音视频目录中的交互式树形关系，并从所述交互式树形关系中确定出所述主线式树形关系；
根据所述交互规则信息以及所述视频列表中的音视频片段，编辑所述交互式树形关系中各节点对应的音视频片段以及各节点之间的关联关系；以及编辑所述主线式树形关系中各节点与音视频片段的对应关系；
其中，所述关联关系包括交互式描述和多个选项。
在一个实施例中，所述处理单元还用于：
在根据所述视频列表对所述树形关系进行编辑之后，获取用户下发的节点修改信息；
若所述节点修改信息为新增节点，则创建新的子节点，并修改所述新的子节点的关联关系；
若所述节点修改信息为删除节点，则根据所述删除节点的标识，对所述删除节点进行删除；
若所述节点修改信息为修改节点，则根据所述修改节点的标识，修改所述修改节点的关联关系。
在一个实施例中，所述处理单元还用于：
在根据所述视频列表对所述树形关系进行编辑之后，获取用户下发的待删除的音视频片段；
确定所述待删除的音视频片段是否与所述树形关系的节点关联，若否，将所述待删除的音视频片段删除，否则不删除。
在一个实施例中，所述处理单元具体用于：
将所述视频列表中的音视频片段进行上传，确定出各所述音视频片段的URL；
根据各所述音视频片段的URL，更新所述交互式音视频目录中的视频列表；
将更新后的所述交互式音视频目录进行上传，确定出所述交互式音视频目录的URL。
第三方面，本申请实施例还提供了一种计算设备，包括：
存储器，用于存储程序指令；
处理器，用于调用所述存储器中存储的程序指令，按照获得的程序执行上述基于移动端交互式音视频生成的方法。
第四方面，本申请实施例还提供了一种计算机可读非易失性存储介质，包括计算机可读指令，当计算机读取并执行所述计算机可读指令时，使得计算机执行上述基于移动端交互式音视频生成的方法。
附图说明
为了更清楚地说明本申请实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简要介绍，显而易见地，下面描述中的附图仅是本申请的一些实施例，对于本领域的普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本申请实施例提供的一种系统架构的示意图；
图2为本申请实施例提供的一种基于移动端交互式音视频生成的方法的流程示意图；
图3为本申请实施例提供的一种基于移动端交互式音视频生成的装置的结构示意图。
具体实施方式
为了使本申请的目的、技术方案和优点更加清楚，下面将结合附图对本申请作详细描述，显然，所描述的实施例仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例，都属于本申请保护的范围。
图1为本申请实施例所适用的系统架构。参考图1所示，该系统架构可以为移动设备100，包括射频(Radio Frequency，RF)电路110、存储器120、输入单元130、显示单元140、传感器150、音频电路160、无线保真(wireless fidelity，WiFi)模块170以及处理器180等部件。该移动设备100可以用于生成交互式音视频。
其中，本领域技术人员可以理解，图1中示出的移动设备100结构仅为示例而非限定，移动设备100还可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
RF电路110可用于在收发数据或通话过程中，信号的接收和发送，特别地，将接收到的音视频流，给处理器180处理。
其中，存储器120可用于存储软件程序以及模块，处理器180通过运行存储在存储器120的软件程序以及模块，从而执行移动设备100的各种功能应用以及数据处理。存储器120可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(如声音播放功能、图像播放功能等)等；存储数据区可存储根据移动设备100的使用所创建的数据(如音频数据、电话本等)等。此外，存储器120可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
输入单元130可用于接收输入的数字或字符信息，以及产生与移动设备100的用户设置以及功能控制有关的键信号。具体地，输入单元130可包括触控面板131、摄像设备132以及其他输入设备133。
其中，显示单元140可用于显示由用户输入的信息或提供给用户的信息以及移动设备100的各种菜单。显示单元140可包括显示面板141，可选的，可以采用液晶显示单元(LCD，Liquid Crystal Display)、有机发光二极管(OLED，Organic Light-Emitting Diode)等形式来配置显示面板141。在本实施例中，触控面板131可覆盖显示面板141，当触控面板131检测到在其上或附近的触摸 操作后，传送给处理器180以确定触摸事件的类型，随后处理器180根据触摸事件的类型在显示面板141上提供相应的视觉输出。
另外，移动设备100还可包括至少一种传感器150，比如姿态传感器、距离传感器、以及其他传感器。
音频电路160、扬声器161，传声器162可提供用户与移动设备100之间的音频接口。音频电路160可将接收到的音频数据转换后的电信号，传输到处理器180进行语种识别。
WiFi属于短距离无线传输技术，移动设备100通过WiFi模块170可以帮助用户收发电子邮件、浏览网页和访问流式媒体(如视频直播)等，它为用户提供了无线的宽带互联网访问。
处理器180是移动设备100的控制中心，利用各种接口和线路连接整个移动设备100的各个部分，通过运行或执行存储在存储器120内的软件程序和/或模块，以及调用存储在存储器120内的数据，执行移动设备100的各种功能和处理数据，从而对移动设备100进行整体监控。
基于上述描述，图2示例性的示出了本申请实施例提供的一种基于移动端交互式音视频生成的方法的流程，该流程可以由基于移动端交互式音视频生成的装置执行，该装置可以位于如图1所示移动设备100内，也可以是该移动设备100。
如图2所示，该流程具体包括：
步骤201，移动设备获取待生成交互式音视频的名称及其对应的音视频片段，并根据所述待生成交互式音视频的名称创建交互式音视频目录。
音视频制作者在需要生成交互式音视频时，可以在移动设备上导入交互式音视频文件，此时可以包括待生成交互式音视频的名称以及其对应的音视频片段。该待生成交互式音视频的名称用于使得移动设备创建交互式音视频目录，例如可以为JSON目录。
该音视频片段可以是音视频创作者通过该移动设备拍摄的音视频片段， 也可以通过该移动设备导入的音视频片段。例如，在拍摄时，可以先配置拍摄参数，如果音视频创作者未指定参数，则可以使用移动设备的默认参数。开始拍摄时，根据参数配置调用移动设备的摄像头及麦克风进行音视频采集编码，然后将拍摄的音视频片段移动到交互视频目录下进行管理，更新JSON。
步骤202，所述移动设备根据所述音视频片段，确定所述交互式音视频目录中的视频列表和树字段。
具体的，若该音视频片段为第一个音视频片段，则移动设备将音视频片段放入视频列表，生成树字段并填充根节点。若音视频片段不是第一个音视频片段，则移动设备将音视频片段放入视频列表，并填写树字段的叶子节点。
举例来说，如果获取的音视频片段为第一音视频片段，则更新JSON中videos(视频列表)数组列表；生成tree(树)字段并填充首个根节点。
步骤203，所述移动设备根据所述树字段，绘制所述交互式音视频目录中的树形关系，并根据所述视频列表对所述树形关系进行编辑。
在本申请实施例中，该树形关系可以包括交互式树形关系和主线式树形关系。当得到交互式音视频目录中的视频列表和树字段和主线数组之后，就可以根据树字段来绘制交互式音视频目录中的树形关系，以及对视频列表中的树形关系进行编辑，具体的，可以移动设备首先遍历树字段中的根节点和叶子节点，根据用户下发的交互式音视频的交互规则信息，绘制交互式音视频目录中的主线式树形关系。然后根据交互规则信息以及视频列表中的音视频片段，编辑树形关系中各节点对应的音视频片段以及各节点之间的关联关系。其中，所述关联关系包括交互式描述和多个选项。上述交互式规则为用户编辑的树形关系，以及用户编辑的各节点的关联关系和各节点的交互式描述信息。相当于，用户在图形界面上，移动或编辑了某个节点，移动设备对应编辑该对应的节点。此外，还可以从上述主线式树形关系中确定出主线式树形关系，由于该主线式树形关系是固定的树形关系，其主线式树形关系中各节点之间的关联关系式固定，在进行节点编辑时，只需要编辑主线式树形关系中各节点与音视频片段的 对应关系即可。
交互式树形关系是用于用户播放视频时通过交互的方式来实现用户自定义播放音视频的不同支线。而主线式树形关系是用于播放音视频的固定主线剧情，与用户不存在交互。
此外，还可以对上述树形关系的各节点进行修改，具体的，移动设备获取用户下发的节点修改信息，当节点修改信息为新增节点时，创建新的子节点，并修改所述新的子节点的关联关系。若节点修改信息为删除节点，则根据删除节点的标识，对删除节点进行删除。若节点修改信息为修改节点，则根据修改节点的标识，修改该修改节点的关联关系。
也就是说，上述交互式树形关系的编排是交互视频的交互规则，自上而下遍历根节点到叶子节点，在进行编辑时，可以选中任意子节点作为当前节点，他的子节点就作为交互视频的选项进行选择，以此类推直至树遍历结束。
例如，首先读取JSON中tree字段，递归遍历所有节点。递归遍历时标记子节点个数，并计算出宽度，向下遍历时画出树。然后获取音视频制作者在交互式树形关系图中选中的节点，进入该节点的关联列表，显示他的子节点。当继续被选中时当前节点进入关联关系编辑模式。其中，在进行关联关系编辑时，节点关联关系包含一个问题n个选项，节点可关联新的子节点，也可以修改当前已关联的节点的问题及选项。在指定当前选项，并将音视频片段关联成功时，动态生成下一个选项关联项。节点不要求唯一，可以重复。当指定并保存成功时，对每个新产生的节点生成全局唯一标识符GUID并更新JSON。当节点需要删除时，通过GUID遍历到当前节点的父节点，将该父节点相应位置的子节点删除。
同时，移动设备也可以获取用户下发的待删除的音视频片段，此时确定待删除的音视频片段是否与树形关系的节点关联，若否，将待删除的音视频片段删除，否则不删除。也就是说删除音视频片段前校验当前树形结构是否已经关联当前音视频片段，如果已被关联则不允许删除，如果未被关联则可删除。 相应的，还可以对各音视频片段的名称进行修改，此时需要更新JSON中包含当前片段的字段中的名称。
步骤204，所述移动设备根据所述交互式音视频目录中的视频列表和树形关系，生成所述交互式音视频。
当得到视频列表和树形关系之后，就需要将交互式音视频目录进行上传，得到交互式音视频目录的URL，即相当于生成该交互式音视频。具体的，移动设备首先将视频列表中的音视频片段进行上传，确定出各音视频片段的URL，然后根据各音视频片段的URL，更新交互式音视频目录中的视频列表，最后将更新后的交互式音视频目录进行上传，确定出交互式音视频目录的URL。在具体实现时，可以将JSON表单及音视频片段导出到同一个目录下。然后将音视频片段依次上传获取服务端返回的URL更新JSON中videos的URL字段。最后将更新后的JSON上传，此时在上传JSON后获得的URL即可进行分享。
需要说明的是，上述主线式树形关系中各节点对应的音视频片段即为主线流程的音视频片段，主线流程是所指定的音视频片段串联起来形成传统单一流程的视频。可以在节点上下层级关系生成时默认以首个节点作为主线流程，也可以在节点关系生成后指定所选分支为主线流程。主线式树形关系是可以依据交互式树形关系来确定的，即从交互式树形关系中确定出主线式树形关系所需节点。
上述实施例表明，移动设备获取待生成交互式音视频的名称及其对应的音视频片段，并根据待生成交互式音视频的名称创建交互式音视频目录，根据音视频片段，确定交互式音视频目录中的视频列表和树字段，根据树字段，绘制交互式音视频目录中的树形关系，并根据视频列表对树形关系进行编辑，根据交互式音视频目录中的视频列表和树形关系，生成交互式音视频。移动设备可以绘制交互式音视频目录中的树形关系，并对该树形关系进行编辑，以便实现交互式的关联关系，从而实现在移动设备上制作生成交互式音视频，解决了现有移动设备无法实现交互性质的视频内容的问题。
基于相同的技术构思，图3示例性的示出了本申请实施例提供的一种基于移动端交互式音视频生成的装置的结构，该装置可以执行基于移动端交互式音视频生成的流程，该装置可以位于图1所示的移动设备100内，也可以是该移动设备100。
如图3所示，该装置具体包括：
获取单元301，用于获取待生成交互式音视频的名称及其对应的音视频片段，并根据所述待生成交互式音视频的名称创建交互式音视频目录；
处理单元302，用于根据所述音视频片段，确定所述交互式音视频目录中的视频列表和树字段；根据所述树字段，绘制所述交互式音视频目录中的树形关系，并根据所述视频列表对所述树形关系进行编辑；根据所述交互式音视频目录中的视频列表和树形关系，生成所述交互式音视频。
在一个实施例中，所述处理单元302具体用于：
若所述音视频片段为第一个音视频片段，则将所述音视频片段放入所述视频列表，生成所述树字段并填充根节点；
若所述音视频片段不是第一个音视频片段，则将所述音视频片段放入所述视频列表，并填写所述树字段的叶子节点。
在一个实施例中，所述树形关系包括交互式树形关系和主线式树形关系；
所述处理单元302具体用于：
遍历所述树字段中的根节点和叶子节点，根据用户下发的交互式音视频的交互规则信息，绘制所述交互式音视频目录中的交互式树形关系，并从所述交互式树形关系中确定出所述主线式树形关系；
根据所述交互规则信息以及所述视频列表中的音视频片段，编辑所述交互式树形关系中各节点对应的音视频片段以及各节点之间的关联关系；以及编辑所述主线式树形关系中各节点与音视频片段的对应关系；
其中，所述关联关系包括交互式描述和多个选项。
在一个实施例中，所述处理单元302还用于：
在根据所述视频列表对所述树形关系进行编辑之后，获取用户下发的节点修改信息；
若所述节点修改信息为新增节点，则创建新的子节点，并修改所述新的子节点的关联关系；
若所述节点修改信息为删除节点，则根据所述删除节点的标识，对所述删除节点进行删除；
若所述节点修改信息为修改节点，则根据所述修改节点的标识，修改所述修改节点的关联关系。
在一个实施例中，所述处理单元302还用于：
在根据所述视频列表对所述树形关系进行编辑之后，获取用户下发的待删除的音视频片段；
确定所述待删除的音视频片段是否与所述树形关系的节点关联，若否，将所述待删除的音视频片段删除，否则不删除。
在一个实施例中，所述处理单元302具体用于：
将所述视频列表中的音视频片段进行上传，确定出各所述音视频片段的URL；
根据各所述音视频片段的URL，更新所述交互式音视频目录中的视频列表；
将更新后的所述交互式音视频目录进行上传，确定出所述交互式音视频目录的URL。
基于相同的技术构思，本申请实施例还提供了一种计算设备，包括：
存储器，用于存储程序指令；
处理器，用于调用所述存储器中存储的程序指令，按照获得的程序执行上述基于移动端交互式音视频生成的方法。
基于相同的技术构思，本申请实施例还提供了一种计算机可读非易失性存储介质，包括计算机可读指令，当计算机读取并执行所述计算机可读指令时，使得计算机执行上述基于移动端交互式音视频生成的方法。
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管已描述了本申请的部分实施例，但本领域内的技术人员一旦得知了基本创造性概念，则可对这些实施例作出另外的变更和修改。所以，所附权利要求意欲解释为包括上述部分实施例以及落入本申请范围的所有变更和修改。
显然，本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样，倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内，则本申请也意图包含这些改动和变型在内。

Claims (14)

  1. 一种基于移动端交互式音视频生成的方法，包括：
    移动设备获取待生成交互式音视频的名称及其对应的音视频片段，并根据所述待生成交互式音视频的名称创建交互式音视频目录；
    所述移动设备根据所述音视频片段，确定所述交互式音视频目录中的视频列表和树字段；
    所述移动设备根据所述树字段，绘制所述交互式音视频目录中的树形关系，并根据所述视频列表对所述树形关系进行编辑；
    所述移动设备根据所述交互式音视频目录中的视频列表和树形关系，生成所述交互式音视频。
  2. 如权利要求1所述的方法，其中，所述移动设备根据所述音视频片段，确定所述交互式音视频目录中的视频列表和树字段，包括：
    若所述音视频片段为第一个音视频片段，则所述移动设备将所述音视频片段放入所述视频列表，生成所述树字段并填充根节点；
    若所述音视频片段不是第一个音视频片段，则所述移动设备将所述音视频片段放入所述视频列表，并填写所述树字段的叶子节点。
  3. 如权利要求1所述的方法，其中，所述树形关系包括交互式树形关系和主线式树形关系；
    所述移动设备根据所述树字段，绘制所述交互式音视频目录中的树形关系，并根据所述视频列表对所述树形关系进行编辑，包括：
    所述移动设备遍历所述树字段中的根节点和叶子节点，根据用户下发的交互式音视频的交互规则信息，绘制所述交互式音视频目录中的交互式树形关系，并从所述交互式树形关系中确定出所述主线式树形关系；
    所述移动设备根据所述交互规则信息以及所述视频列表中的音视频片段，编辑所述交互式树形关系中各节点对应的音视频片段以及各节点之间的关联关系；以及编辑所述主线式树形关系中各节点与音视频片段的对应关系；
    其中，所述关联关系包括交互式描述和多个选项。
  4. 如权利要求3所述的方法，其中，所述移动设备在根据所述视频列表对所述树形关系进行编辑之后，还包括：
    所述移动设备获取用户下发的节点修改信息；
    若所述节点修改信息为新增节点，则所述移动设备创建新的子节点，并修改所述新的子节点的关联关系；
    若所述节点修改信息为删除节点，则所述移动设备根据所述删除节点的标识，对所述删除节点进行删除；
    若所述节点修改信息为修改节点，则所述移动设备根据所述修改节点的标识，修改所述修改节点的关联关系。
  5. 如权利要求3所述的方法，其中，所述移动设备在根据所述视频列表对所述树形关系进行编辑之后，还包括：
    所述移动设备获取用户下发的待删除的音视频片段；
    所述移动设备确定所述待删除的音视频片段是否与所述树形关系的节点关联，若否，将所述待删除的音视频片段删除，否则不删除。
  6. 如权利要求1至5任一项所述的方法，其中，所述移动设备根据所述交互式音视频目录中的视频列表和树形关系，生成所述交互式音视频，包括：
    所述移动设备将所述视频列表中的音视频片段进行上传，确定出各所述音视频片段的URL；
    所述移动设备根据各所述音视频片段的URL，更新所述交互式音视频目录中的视频列表；
    所述移动设备将更新后的所述交互式音视频目录进行上传，确定出所述交互式音视频目录的URL。
  7. 一种基于移动端交互式音视频生成的装置，包括：
    获取单元，用于获取待生成交互式音视频的名称及其对应的音视频片段，并根据所述待生成交互式音视频的名称创建交互式音视频目录；
    处理单元，用于根据所述音视频片段，确定所述交互式音视频目录中的视频列表和树字段；根据所述树字段，绘制所述交互式音视频目录中的树形关系，并根据所述视频列表对所述树形关系进行编辑；根据所述交互式音视频目录中的视频列表和树形关系，生成所述交互式音视频。
  8. 如权利要求7所述的装置，其中，所述处理单元具体用于：
    若所述音视频片段为第一个音视频片段，则将所述音视频片段放入所述视频列表，生成所述树字段并填充根节点；
    若所述音视频片段不是第一个音视频片段，则将所述音视频片段放入所述视频列表，并填写所述树字段的叶子节点。
  9. 如权利要求7所述的装置，其中，所述树形关系包括交互式树形关系和主线式树形关系；
    所述处理单元具体用于：
    遍历所述树字段中的根节点和叶子节点，根据用户下发的交互式音视频的交互规则信息，绘制所述交互式音视频目录中的交互式树形关系，并从所述交互式树形关系中确定出所述主线式树形关系；
    根据所述交互规则信息以及所述视频列表中的音视频片段，编辑所述交互式树形关系中各节点对应的音视频片段以及各节点之间的关联关系；以及编辑所述主线式树形关系中各节点与音视频片段的对应关系；
    其中，所述关联关系包括交互式描述和多个选项。
  10. 如权利要求9所述的装置，其中，所述处理单元还用于：
    在根据所述视频列表对所述树形关系进行编辑之后，获取用户下发的节点修改信息；
    若所述节点修改信息为新增节点，则创建新的子节点，并修改所述新的子节点的关联关系；
    若所述节点修改信息为删除节点，则根据所述删除节点的标识，对所述删除节点进行删除；
    若所述节点修改信息为修改节点，则根据所述修改节点的标识，修改所述修改节点的关联关系。
  11. 如权利要求9所述的装置，其中，所述处理单元还用于：
    在根据所述视频列表对所述树形关系进行编辑之后，获取用户下发的待删除的音视频片段；
    确定所述待删除的音视频片段是否与所述树形关系的节点关联，若否，将所述待删除的音视频片段删除，否则不删除。
  12. 如权利要求7至11任一项所述的装置，其中，所述处理单元具体用于：
    将所述视频列表中的音视频片段进行上传，确定出各所述音视频片段的URL；
    根据各所述音视频片段的URL，更新所述交互式音视频目录中的视频列表；
    将更新后的所述交互式音视频目录进行上传，确定出所述交互式音视频目录的URL。
  13. 一种计算设备，包括：
    存储器，用于存储程序指令；
    处理器，用于调用所述存储器中存储的程序指令，按照获得的程序执行权利要求1至6任一项所述的方法。
  14. 一种计算机可读非易失性存储介质，包括计算机可读指令，当计算机读取并执行所述计算机可读指令时，使得计算机执行如权利要求1至6任一项所述的方法。
PCT/CN2020/074963 2019-07-25 2020-02-12 一种基于移动端交互式音视频生成的方法及装置 WO2021012664A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP20725764.3A EP3790008A4 (en) 2019-07-25 2020-02-12 METHOD AND DEVICE FOR GENERATING INTERACTIVE AUDIO VIDEOS ON THE BASIS OF A MOBILE TERMINAL
US16/882,355 US20210029420A1 (en) 2019-07-25 2020-05-22 Method and apparatus for generating interactive audio-video based on mobile terminal

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910676131.4 2019-07-25
CN201910676131.4A CN110381383B (zh) 2019-07-25 2019-07-25 一种基于移动端交互式音视频生成的方法、装置、计算设备及存储介质

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/882,355 Continuation US20210029420A1 (en) 2019-07-25 2020-05-22 Method and apparatus for generating interactive audio-video based on mobile terminal

Publications (1)

Publication Number Publication Date
WO2021012664A1 true WO2021012664A1 (zh) 2021-01-28

Family

ID=68255920

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/074963 WO2021012664A1 (zh) 2019-07-25 2020-02-12 一种基于移动端交互式音视频生成的方法及装置

Country Status (3)

Country Link
EP (1) EP3790008A4 (zh)
CN (1) CN110381383B (zh)
WO (1) WO2021012664A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110381383B (zh) * 2019-07-25 2020-09-25 网宿科技股份有限公司 一种基于移动端交互式音视频生成的方法、装置、计算设备及存储介质
CN111818371B (zh) * 2020-07-17 2021-12-24 腾讯科技（深圳）有限公司 一种互动视频的管理方法以及相关装置
CN113012723B (zh) * 2021-03-05 2022-08-30 北京三快在线科技有限公司 多媒体文件播放方法、装置、电子设备
CN113343027A (zh) * 2021-06-03 2021-09-03 北京有竹居网络技术有限公司 交互视频编辑、交互视频展示方法及装置
CN116527982B (zh) * 2023-06-01 2023-09-15 杭州威灿科技有限公司 一种问讯同步音视频刻录方法及系统

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110258668A1 (en) * 2008-05-28 2011-10-20 Musa Sagal B H Method and apparatus for interacting with media programming in real-time using a mobile telephone device
CN104883627A (zh) * 2015-06-22 2015-09-02 田志明 一种情节影视及其播映装置与方法
CN106851162A (zh) * 2017-02-17 2017-06-13 成都依能科技股份有限公司 视频录制方法及装置
CN108093315A (zh) * 2017-12-28 2018-05-29 优酷网络技术（北京）有限公司 视频生成方法及装置
CN108124187A (zh) * 2017-11-24 2018-06-05 互影科技（北京）有限公司 交互视频的生成方法及装置
CN108829654A (zh) * 2018-05-30 2018-11-16 互影科技（北京）有限公司 一种互动剧本编辑方法和装置
CN109600674A (zh) * 2017-10-03 2019-04-09 皇家Kpn公司 非线性媒体的基于客户端的自适应流式传输
CN110381383A (zh) * 2019-07-25 2019-10-25 网宿科技股份有限公司 一种基于移动端交互式音视频生成的方法及装置

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003050811A (ja) * 2001-08-07 2003-02-21 Sony Corp 記録装置、記録方法、プログラム、記録媒体および撮像装置
US8201073B2 (en) * 2005-08-15 2012-06-12 Disney Enterprises, Inc. System and method for automating the creation of customized multimedia content
CN101754056B (zh) * 2008-12-17 2013-01-02 中国科学院自动化研究所 支持海量数据自动处理的数字内容编目管理系统及方法
CN102957941A (zh) * 2012-07-18 2013-03-06 深圳市同洲电子股份有限公司 节目单内容的播发方法和数字电视前端
CN103888790B (zh) * 2012-12-21 2017-02-15 中国科学院声学研究所 一种epg适配系统及方法
US9792026B2 (en) * 2014-04-10 2017-10-17 JBF Interlude 2009 LTD Dynamic timeline for branched video
CN104063196B (zh) * 2014-06-26 2017-01-18 西安诺瓦电子科技有限公司 节目清单自适应编辑方法及装置

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110258668A1 (en) * 2008-05-28 2011-10-20 Musa Sagal B H Method and apparatus for interacting with media programming in real-time using a mobile telephone device
CN104883627A (zh) * 2015-06-22 2015-09-02 田志明 一种情节影视及其播映装置与方法
CN106851162A (zh) * 2017-02-17 2017-06-13 成都依能科技股份有限公司 视频录制方法及装置
CN109600674A (zh) * 2017-10-03 2019-04-09 皇家Kpn公司 非线性媒体的基于客户端的自适应流式传输
CN108124187A (zh) * 2017-11-24 2018-06-05 互影科技（北京）有限公司 交互视频的生成方法及装置
CN108093315A (zh) * 2017-12-28 2018-05-29 优酷网络技术（北京）有限公司 视频生成方法及装置
CN108829654A (zh) * 2018-05-30 2018-11-16 互影科技（北京）有限公司 一种互动剧本编辑方法和装置
CN110381383A (zh) * 2019-07-25 2019-10-25 网宿科技股份有限公司 一种基于移动端交互式音视频生成的方法及装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3790008A4 *

Also Published As

Publication number Publication date
EP3790008A1 (en) 2021-03-10
CN110381383A (zh) 2019-10-25
CN110381383B (zh) 2020-09-25
EP3790008A4 (en) 2021-03-10

Similar Documents

Publication Publication Date Title
WO2021012664A1 (zh) 一种基于移动端交互式音视频生成的方法及装置
WO2021012665A1 (zh) 一种交互式音视频播放的方法及装置
US11539989B2 (en) Media content redirection
US10643660B2 (en) Video preview creation with audio
US8819559B2 (en) Systems and methods for sharing multimedia editing projects
CN111901674A (zh) 一种视频播放控制及装置
US11475920B2 (en) Embedding interactive content into a shareable online video
US10841647B2 (en) Network aggregation of streaming data interactions from distinct user interfaces
TW201416888A (zh) 場景片段播放系統、方法及其記錄媒體
JP2014176082A (ja) 仮想チャンネル管理の方法、仮想チャンネルを有するネットワークベースのマルチメディア再生システム、及びコンピューター可読記憶媒体
CN108156490B (zh) 一种利用移动终端回放电视直播的方法、系统及存储介质
US20210029420A1 (en) Method and apparatus for generating interactive audio-video based on mobile terminal
KR102545040B1 (ko) 비디오 재생 방법, 장치, 전자 기기, 저장 매체 및 컴퓨터 프로그램 제품
US11205459B2 (en) User generated content with ESRB ratings for auto editing playback based on a player's age, country, legal requirements
CN113064590B (zh) 互动视频中互动组件的处理方法及装置
US9049416B2 (en) System and method for constructing scene clip, and record medium thereof
CN104427364A (zh) 媒体播放处理方法、装置、系统及媒体服务器
US20230024969A1 (en) Methods and systems for generating a summary of content based on a co-relation graph
US20220417594A1 (en) Methods and systems for generating a playlist of content items and content item segments
CN115734033A (zh) 视频播放方法、装置和计算机可读存储介质
KR101467079B1 (ko) 신 클립을 구성하기 위한 시스템 및 방법, 및 그 기록매체
JP2014053063A (ja) データ処理装置及びデータ処理方法
KR20150004208A (ko) 방송 재생용 단말 장치, 방송 시스템, 및 배경음 서비스 서버

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2020725764

Country of ref document: EP

Effective date: 20200525

NENP Non-entry into the national phase

Ref country code: DE