CN113014985A

CN113014985A - Interactive multimedia content processing method and device, electronic equipment and storage medium

Info

Publication number: CN113014985A
Application number: CN201911318226.5A
Authority: CN
Inventors: 阳轲; 洪薇; 欧文文; 于德艺
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2019-12-19
Filing date: 2019-12-19
Publication date: 2021-06-22

Abstract

The application relates to the technical field of computers, and discloses an interactive multimedia content processing method, an interactive multimedia content processing device, electronic equipment and a storage medium, which can display a plurality of plot branches contained in the whole interactive multimedia content, so that a user can grasp the interactive progress from the whole situation, the interactive efficiency is improved, and better interactive experience is provided for the user. The method comprises the following steps: displaying a playing interface of the interactive multimedia content; responding to a first trigger operation input through a playing interface, and displaying a global mind map of interactive multimedia contents to which currently played multimedia content segments belong, wherein the interactive multimedia contents comprise at least two scenario branches, and the global mind map comprises logical relations among the multimedia content segments in the at least two scenario branches.

Description

Interactive multimedia content processing method and device, electronic equipment and storage medium

Technical Field

The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for processing interactive multimedia content, an electronic device, and a storage medium.

Background

With the continuous development of the multimedia content industry, the multimedia content is also more and more abundant in form, including various electronic books, broadcast plays, movies, television plays, integrated art, and the like. The user's desire to participate in multimedia content is becoming stronger, and interactive multimedia content is on this background. The interactive multimedia content is a novel multimedia content presentation form, and audiences can determine the trend and the development of the multimedia content through interactive operations such as options, multiple visual angles and the like. Therefore, a plurality of plot branches exist in the interactive multimedia content, and a user can determine plot development according to the selected plot straight line.

If an efficient and convenient interactive control mode can be provided, the method is a key factor for determining the development prospect of interactive multimedia contents.

Disclosure of Invention

The embodiment of the application provides an interactive multimedia content processing method, an interactive multimedia content processing device, electronic equipment and a storage medium, which can display a plurality of scenario branches contained in the whole interactive multimedia content, so that a user can grasp the interactive progress from the whole situation, and the interactive efficiency is improved.

In one aspect, an embodiment of the present application provides an interactive multimedia content processing method, including:

displaying a playing interface of the interactive multimedia content;

and responding to a first trigger operation input through the playing interface, and displaying a global mind map of interactive multimedia contents to which the currently played multimedia content segments belong on the playing interface, wherein the interactive multimedia contents comprise at least two scenario branches, and the global mind map comprises a logical relationship between the multimedia content segments in the at least two scenario branches.

In one aspect, an embodiment of the present application provides an interactive multimedia content processing apparatus, including:

the interface display module is used for displaying a playing interface of the interactive multimedia content;

the thinking guide picture display module is used for responding to a first trigger operation input through a playing interface and displaying a global thinking guide picture of interactive multimedia contents to which currently played multimedia content segments belong, wherein the interactive multimedia contents comprise at least two scenario branches, and the global thinking guide picture comprises a logical relation between the multimedia content segments in the at least two scenario branches.

Optionally, the mind map display module is specifically configured to display, in the global mind map, multimedia content segments that are not selected by the user in the global mind map in a first state and display, in a second state, multimedia content segments that have been selected by the user in the global mind map according to interaction progress information of the user in a playing process.

Optionally, the mind map display module is further configured to: when a global thinking map of the interactive multimedia content to which the currently played multimedia content segment belongs is obtained, displaying the locking state of the subsequently playable multimedia content segment as an unlocked state according to the logic relationship and the interactive progress information;

the interactive multimedia content processing device further comprises a playing module, which is used for responding to the selection operation of the multimedia content segment with the locked state being the unlocked state in the global thinking guide graph and playing the multimedia content segment corresponding to the selection operation on the playing interface.

Optionally, the interactive multimedia content processing apparatus further includes an archive module and a login module;

the archiving module is used for responding to the closing operation aiming at the interactive multimedia content and storing the account of the current login user and the current interactive progress information of the interactive multimedia content in a correlation manner;

and the login module is used for responding to the login request of the account and taking the interaction progress information stored in a correlated manner as the initial interaction progress information of the user.

Optionally, the interactive multimedia content processing apparatus further includes a positioning module, configured to adjust a display position of the global mind map within the playing interface in response to a positioning operation on the global mind map, so that the currently played multimedia content segment in the global mind map is located in a specified area on the playing interface.

Optionally, the multimedia content segment corresponding to the ending in the global mind map is displayed in a third state.

Optionally, the interactive multimedia content processing apparatus further includes a branch line selection module, configured to update a locked state of each multimedia content segment in any scenario branch line to an unlocked state in response to a selection operation for any scenario branch line in the global mind map; and responding to the playing operation aiming at the selected scenario branch line, and sequentially playing the multimedia content segments in the selected scenario branch line.

Optionally, the mind map display module is further configured to respond to a second trigger operation input through a play interface, where the interactive multimedia content includes at least two chapters, each chapter includes at least two scenario branches, and the chapter mind map includes a logical relationship between the at least two chapters.

Optionally, the thinking guide display module is further configured to display a plot thinking guide of any chapter on the playing interface in response to a triggering operation for any chapter in the chapter thinking guide, where the plot thinking guide includes: a chapter includes a logical relationship between multimedia content segments in at least two storylines.

Optionally, the chapter mind map displays the chapter corresponding to the office in a third state.

acquiring a global mind map of interactive multimedia content based on a global mind map display request of the interactive multimedia content sent by a terminal device, wherein the interactive multimedia content comprises at least two scenario branches, and the global mind map comprises a logical relationship between multimedia content segments in the at least two scenario branches;

and sending the global mind map to the terminal equipment so that the terminal equipment displays the global mind map on the playing interface.

the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a global mind map of interactive multimedia contents based on a global mind map display request of the interactive multimedia contents sent by terminal equipment, the interactive multimedia contents comprise at least two plot branches, and the global mind map comprises a logic relationship between multimedia content segments in the at least two plot branches;

and the sending module is used for sending the global mind map to the terminal equipment so that the terminal equipment displays the global mind map on the playing interface.

In one aspect, an embodiment of the present application provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any one of the methods when executing the computer program.

In one aspect, an embodiment of the present application provides a computer-readable storage medium having stored thereon computer program instructions, which, when executed by a processor, implement the steps of any of the above-described methods.

In one aspect, an embodiment of the present application provides a computer program product comprising a computer program stored on a computer-readable storage medium, the computer program comprising program instructions that, when executed by a processor, implement the steps of any of the methods described above.

According to the interactive multimedia content processing method and device, the electronic equipment and the storage medium, the overall situation branches contained in the whole interactive multimedia content are displayed on the playing interface in an overall mode through the overall thinking guide graph, so that a user can clearly know the trend of the whole situation, the current position of the user in the situation is sensed, the interaction progress is further grasped in the overall mode, the interaction efficiency is improved, and better interaction experience is provided for the user.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic view of an application scenario of an interactive multimedia content processing method according to an embodiment of the present application;

fig. 2 is a flowchart illustrating an interactive multimedia content processing method according to an embodiment of the present application;

fig. 3A is a schematic diagram of a playing interface provided in an embodiment of the present application;

fig. 3B is a schematic interface diagram illustrating options presented in a playing interface after a video clip is played according to an embodiment of the present application;

FIG. 4A is an example of a global mind map of an interactive video provided by an embodiment of the present application;

FIG. 4B is an example of a global mind map of an interactive video provided by an embodiment of the present application;

FIG. 5 is an example of a global mind map of an interactive video provided by an embodiment of the present application;

FIG. 6 is an example of a global mind map of an interactive video provided by an embodiment of the present application;

FIG. 7 is a diagram illustrating operations of moving, zooming and positioning a global mind map according to an embodiment of the present application;

fig. 8 is a schematic diagram illustrating an operation of selecting a scenario branch line for playing in the global mind map according to an embodiment of the present application;

fig. 9 is a flowchart illustrating an interactive multimedia content processing method according to an embodiment of the present application;

FIG. 10 is an example of a section thought map of an interactive video provided by an embodiment of the present application;

fig. 11 is an example of a plot mind map corresponding to chapters provided in an embodiment of the present application;

FIG. 12 is another example of a section thought map of an interactive video provided by an embodiment of the present application;

FIG. 13 is a diagram illustrating a connection line under various conditions according to an embodiment of the present disclosure;

FIG. 14 is a diagram illustrating a mind map generated by a rendering engine according to an embodiment of the present application;

FIG. 15 is a schematic diagram of a process for obtaining interaction data using an axios library according to an embodiment of the present application;

FIG. 16 is a diagram illustrating a unified rendering of interactive data into specific components according to an embodiment of the present application;

fig. 17 is a flowchart illustrating an interactive multimedia content processing method according to an embodiment of the present application;

FIG. 18 is a block diagram of an interactive multimedia content processing apparatus according to an embodiment of the present application;

FIG. 19 is a block diagram of an interactive multimedia content processing apparatus according to an embodiment of the present application;

fig. 20 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

For convenience of understanding, terms referred to in the embodiments of the present application are explained below:

multimedia content: it refers to the integration of multiple media, generally including multiple media forms such as text, sound and image. The multimedia content in the embodiments of the present application includes, but is not limited to; video, audio (e.g., a radio play), an e-book, etc.

Multimedia content segment: refers to a partial segment in a multimedia content. For example, one video may be divided into a plurality of video segments according to the scenario and the video size.

Multimedia content chapters: the method refers to a dividing mode of multimedia content, a plurality of multimedia content segments related on a scenario are combined together to form a chapter, and one interactive multimedia content can comprise a plurality of chapters. Chapters can help creators organize content better and can also help ordinary users understand the content of a plot better and experience interaction better. For example, an e-book may be divided into chapters, and a television series may be divided into episodes (corresponding chapters).

Interactive multimedia content: the method is a novel content presentation form, and the trend and the development of the plot can be determined according to the selection of the user in the process of watching the interactive multimedia content. The interactive multimedia content mainly comprises interactive video, interactive electronic book, interactive broadcast play and the like. Taking an interactive video as an example, audiences can determine the trend and development of video content through interactive operations such as countdown selection, quick click and the like, and can feel the venation and trend of the whole plot through a story line.

Scenario branch line: refers to an independent and complete story context formed by a plurality of multimedia content segments which are sequentially connected in series. An interactive multimedia content includes a plurality of scenario legs, and different scenario legs can be played according to a user's selection.

Chapter line: for presenting logical relationships between chapters within an interactive multimedia content.

Global story line: including the logical relationships between the multimedia content segments in all storylines of the interactive multimedia content.

The chapter line, the plot branch line and the global story line are concreteness of abstract plot relations, are concrete presentation modes of internal logic and vein trends of interactive multimedia contents, and can help common users to feel the development of plots more intuitively.

Global mind map: is a mental diagram for showing the logical relationship between multimedia content segments in the entire interactive multimedia content.

Chapter thinking guidance picture: is a mental diagram for showing the logical relationship between chapters in the entire interactive multimedia content.

Plot thinking guide chart: is a mental diagram for showing logical relationships between pieces of multimedia content in one chapter.

Jumping across chapters: refers to the action of switching multimedia content from one chapter to another, and represents the dynamic effect of switching at the content level and switching at the product level. The cross-chapter jump may be a sequential switch (e.g., from chapter one to chapter two) or an out-of-order switch (e.g., from chapter one to chapter five).

The terminal equipment: the electronic device can be installed with various clients and can display the objects provided in the installed clients, and the electronic device can be mobile or fixed. For example, a desktop computer, a mobile phone, a mobile computer, a tablet computer, a media player, a smart wearable device, a smart television, a vehicle-mounted device, a Personal Digital Assistant (PDA), or other electronic devices capable of implementing the above-described functions, and the like.

A client: it refers to a class of applications capable of playing multimedia content, such as an application for watching an electronic book, a music playing application for playing audio, or a video playing application for playing video.

Any number of elements in the drawings are by way of example and not by way of limitation, and any nomenclature is used solely for differentiation and not by way of limitation.

In a specific practical process, the existing client supporting the interactive multimedia content can only show one currently selected scenario branch line to a user, so that the user cannot acquire information of other scenario branch lines and cannot acquire the relationship between different selections and different scenario branch lines, therefore, the user cannot form overall perception on the whole scenario trend of the interactive multimedia content, the interactive efficiency is reduced, and the immersion experience of the interactive multimedia content is damaged. In addition, the existing client does not have a filing function, when the user returns to the previous plot branch point to make a selection again, the client can cover the previous plot branch line, and subsequently only the plot branch line newly selected by the user can be displayed, namely the plot branch lines explored by the user before completely disappear, which may bring difficulty to the user in understanding the plot, thereby reducing the interaction efficiency, and especially under the condition that the plot branch line is complex, the user experience is poor.

Therefore, the present application provides an interactive multimedia content processing method, which specifically includes: displaying a playing interface of the interactive multimedia content; and responding to a first trigger operation input through the play interface, and displaying a global mind map of interactive multimedia contents to which the currently played multimedia content segments belong on the play interface, wherein the interactive multimedia contents comprise at least two scenario branches, and the global mind map comprises a logical relationship between the multimedia content segments in the at least two scenario branches. According to the interactive multimedia content processing method, the global thinking guide picture is used for carrying out global display on a plurality of plot branches contained in the whole interactive multimedia content on the playing interface, so that a user can clearly know the trend of the whole plot, the current position of the plot is sensed, the interaction progress is further grasped globally, the interaction efficiency is improved, and better interaction experience is provided for the user.

After introducing the design concept of the embodiment of the present application, some simple descriptions are provided below for application scenarios to which the technical solution of the embodiment of the present application can be applied, and it should be noted that the application scenarios described below are only used for describing the embodiment of the present application and are not limited. In specific implementation, the technical scheme provided by the embodiment of the application can be flexibly applied according to actual needs.

Fig. 1 is a schematic view of an application scenario of the interactive multimedia content processing method according to an embodiment of the present application. The application scenario includes a terminal device 101 and a background server 102. The terminal device 101 and the background server 102 are connected through a communication network, a client is installed in the terminal device 101, and the background server 102 provides multimedia contents to the client in the terminal device 101, wherein the multimedia contents include common multimedia contents and interactive multimedia contents. The terminal device 101 may be a desktop computer, a mobile phone, a mobile computer, a tablet computer, a media player, a smart wearable device, a smart television, a vehicle-mounted device, a personal digital assistant, or other electronic devices capable of implementing the above-described functions. The background server 102 may be a server, a server cluster composed of several servers, or a cloud computing center.

Of course, the method provided in the embodiment of the present application is not limited to be used in the application scenario shown in fig. 1, and may also be used in other possible application scenarios, and the embodiment of the present application is not limited. The functions that can be implemented by each device in the application scenario shown in fig. 1 will be described in the following method embodiments, and will not be described in detail herein.

To further illustrate the technical solutions provided by the embodiments of the present application, the following detailed description is made with reference to the accompanying drawings and the detailed description. Although the embodiments of the present application provide the method operation steps as shown in the following embodiments or figures, more or less operation steps may be included in the method based on the conventional or non-inventive labor. In steps where no necessary causal relationship exists logically, the order of execution of the steps is not limited to that provided by the embodiments of the present application.

In the following embodiments of the present application, the interactive video is specifically described as an example, and a client playing the interactive video can generally play a common audio and a video, and can also play an interactive audio and an interactive video. The interactive video is a novel video content presentation form, audiences can determine the trend and the development of the video content through interactive operations such as countdown selection, quick click and the like, and can feel the venation and the trend of the whole plot through a story line. An interactive video includes a plurality of video segments. Specifically, the multimedia clip is a video clip, and the scenario branch of the interactive video is an independent and complete story vein formed by sequentially connecting a plurality of video clips in series. The chapters of the interactive video are formed by combining a plurality of video segments related to the plot together according to the dividing mode of the video content. The chapter lines of the interactive video are used for presenting the logic relationship among chapters in the interactive video. The global story line of the interactive video includes logical relationships between video clips in all scenario legs of the interactive video. And the chapter mind map of the interactive video is a mind map for showing logical relationships among chapters in the entire interactive video. A plot mind map of an interactive video is a mind map for showing logical relationships between video segments in one chapter.

It should be noted that, any interactive multimedia content processing method in this embodiment of the present application may be executed by a terminal device, may also be executed by a background server, and may also be executed by a terminal device and a background server in a matching manner, and an execution main body is not limited in this embodiment of the present application.

The following describes the technical solution provided in the embodiment of the present application with reference to the application scenario shown in fig. 1.

Referring to fig. 2, an embodiment of the present application provides an interactive multimedia content processing method, which is described as an example executed by a terminal device, and includes the following steps:

s201, displaying a playing interface of the interactive multimedia content.

S202, responding to a first trigger operation input through a playing interface, and displaying and acquiring a global thinking guide graph of interactive multimedia content to which a currently played multimedia content segment belongs on the playing interface, wherein the interactive multimedia content comprises at least two scenario branches, and the global thinking guide graph comprises a logical relation between the multimedia content segments in the at least two scenario branches.

In particular, the global mind map may show logical relationships among all multimedia content segments in an interactive multimedia content.

In specific implementation, the number of the multimedia content segments displayed in the global mind map, that is, the logical relationship between the multimedia content segments with the preset ratio displayed in the global mind map, may also be determined according to the total number of the multimedia content segments in the interactive multimedia content and the preset ratio. For example, if the preset ratio is 80%, 80% of multimedia content segments in the interactive multimedia content are acquired to generate the global mind map. The preset ratio may be selected by a user, or adaptively adjusted by the terminal device or the background server according to the size of the playing interface, for example, the larger the playing interface is, the higher the preset ratio is, for example, may reach 100%, that is, the logical relationship among all the multimedia content segments is displayed.

Further, if the global mind map showing the preset proportion is selected, a number of multimedia content segments corresponding to the preset proportion can be obtained from the multimedia content segments having a logical relationship with the currently played multimedia content segments, for example, a corresponding number of multimedia content segments can be preferentially obtained from the multimedia content segments included in the scenario branch to which the currently played multimedia content segments belong, if the obtained number is not enough, a plurality of multimedia content segments are continuously selected from the multimedia content segments having a logical relationship with the obtained multimedia content segments and not being selected until a number of multimedia content segments corresponding to the preset proportion are obtained, and the global mind map is generated based on the obtained multimedia content segments.

The first trigger operation in the embodiment of the present application is an operation for triggering presentation of a global mind map.

Taking an interactive video as an example, in specific implementation, referring to fig. 3A, a first control 302 for triggering and displaying a global mind map may be set in advance in a playing interface 301 of a client, and a user may click the first control 302 in a process of watching a video clip, so as to input a first trigger operation. The client responds to the first trigger operation, obtains a global mind map of the interactive video to which the currently played video clip belongs, and displays the global mind map on a playing interface, wherein the displaying interface of the global mind map can refer to fig. 4A. After one video clip is played, the questions and the corresponding options are displayed to the user in the playing interface, and the client plays the corresponding video clip according to the options selected by the user. Referring to fig. 3B, after the video clip is played, the question and the corresponding option a and option B are displayed in the play interface, if the user clicks the option a, the client continues to play the video clip corresponding to the option a, and if the user clicks the option B, the client continues to play the video clip corresponding to the option a.

In specific implementation, the first trigger operation may also be a specific operation for the play interface, such as pressing the play interface for a long time, sliding left, and the like.

As a possible implementation manner, a global mind map corresponding to each interactive multimedia content may be generated in advance and stored in the background server. And the client in the terminal equipment responds to the first trigger operation, determines the interactive multimedia content to which the currently played multimedia content segment belongs, acquires the global thinking diagram of the interactive multimedia content from the background server and displays the global thinking diagram on the playing interface. Or when the client sends a request for acquiring the interactive multimedia content to the background server, the background server sends the interactive multimedia content and the corresponding global mind map I to the client, the client stores the acquired global mind map locally in the terminal equipment, and the client responds to the first trigger operation to locally acquire the global mind map of the interactive multimedia content from the terminal equipment and display the global mind map on the playing interface.

As another possible implementation, the story line information may include logical relationships between multimedia content segments in all story lines of the interactive multimedia content according to a global story line configured for the interactive multimedia content in advance. And the client responds to the first trigger operation to acquire a global story line configured for the interactive multimedia content and generate a global thinking guide graph of the interactive multimedia content in real time according to story line information. The global story line corresponding to the interactive multimedia content can be stored in a background server, or can be sent to the client together with the interactive multimedia content by the background server and stored locally in the terminal equipment. Of course, the background server can also generate a global mind map of the interactive multimedia content in real time according to the story line information.

The embodiment of the present application does not limit the specific manner of displaying the global mind map on the playing interface. For example, the client generates a floating layer or a popup window on the playing interface in response to the first trigger operation, and displays the global mind map in the generated floating layer or popup window.

Taking FIG. 4A as an example, it shows a global mind map of an interactive video XX. The interactive video XX includes 12 video segments in total, a connection line between the video segments in fig. 4A represents a logical relationship between the video segments, the logical relationship refers to a playing sequence between a plurality of video segments determined according to a scenario, for example, the right side of the video segment 1 is connected with the video segment 2, the video segment 3, and the video segment 4, which represents that three options are displayed to a user after the video segment 1 is played: if the user selects the option A, the video clip 2 is continuously played, if the user selects the option B, the video clip 3 is continuously played, and if the user selects the option C, the video clip 4 is continuously played; the right side of the video clip 5 is not connected with any video clip, which indicates that the video clip 5 is the last video clip in the scenario branch line, namely, the video clip corresponds to the ending of the scenario branch line; only video segment 12 is connected to the right side of video segment 10, which means that video segment 12 is played directly after video segment 10 without user selection. Each scenario branch in the interactive video XX is formed by sequentially connecting a plurality of video segments with a logical relationship in series, and the series rule corresponding to fig. 4A is as follows: starting from the first video clip on the left, the video clips are sequentially connected in series from left to right along the connecting line until the last video clip, and a plot branch is obtained. For example, video segments 1, 2, 5 are connected in series to form scenario branch 1, video segments 1, 2, 6, 10, 12 are connected in series to form scenario branch 2, and each scenario branch corresponds to a complete scenario. In fig. 4A, the rule for serially connecting video segments is to serially connect from left to right to obtain a scenario branch.

It should be noted that the global mind map shown in fig. 4A is only an example, and the form and content of the global mind map in practical application are not limited to the manner shown in fig. 4A. For example, referring to fig. 4B, the lines between video segments may be directional lines to more clearly reveal the trend of a determined scenario; for another example, the corresponding position of each video clip in the global thinking guide graph may display the specific content, the plot title or the content introduction of the corresponding option of the video clip, and may also display the cover frame corresponding to the video clip.

According to the interactive multimedia content processing method, the overall situation branches contained in the whole interactive multimedia content are displayed on the playing interface in an overall mode through the overall thinking guide graph, so that a user can clearly know the trend of the whole situation, the current position of the user in the situation is sensed, the interaction progress is further grasped from the overall situation, the interaction efficiency is improved, and better interaction experience is provided for the user.

In specific implementation, the client may store interaction progress information between the user and the interactive multimedia content according to an operation of the user in the process of viewing the interactive multimedia content, wherein the interaction progress information includes at least one of the following: the locking state of each video clip in the interactive video, the video clip selected by the user and the currently played video clip, etc.

On the basis of any one of the above embodiments, in order to enable a user to intuitively and quickly know a scenario branch selected by the user, according to the interaction progress information of the user in the playing process, in the global thinking map, multimedia content segments which are not selected by the user in the global thinking map are displayed in a first state, and multimedia content segments which are selected by the user in the global thinking map are displayed in a second state.

The multimedia content segment selected by the user is the multimedia content segment corresponding to the option selected by the user, that is, the multimedia content segment viewed by the user.

In specific implementation, the first state is a normal display state, the second state may be any highlighted manner different from the first state, and the second state includes but is not limited to highlight, bold, and zoom.

Taking fig. 4A as an example, after playing the video segment 1, the user selects the option corresponding to the video segment 2, and after playing the video segment 2, selects the option corresponding to the video segment 6, the video segment 6 is currently played, at this time, the video segments that the user has selected include the video segment 1, the video segment 2, and the video segment 6, so that the video segment 1, the video segment 2, the video segment 6, and the connection lines between the video segment 1, the video segment 2, and the video segment 6 in the global thinking guide diagram of fig. 4A are all displayed in a bold display manner so as to be distinguished from the video segments that the user has not selected. It should be noted that the first video segment in the interactive video (e.g., video segment 1 in fig. 4A) does not need to be selected by the user, i.e., the first video segment is the video segment selected by the user by default.

In specific implementation, a global mind map of the interactive multimedia content can be generated in advance, and then when the global mind map is displayed, the display mode of the multimedia content segments which are not selected by the user in the global mind map is set to be in a first state and the display mode of the multimedia content segments which are selected by the user is set to be in a second state according to the current interactive progress information.

In specific implementation, a global mind map of the interactive multimedia content may also be generated in real time according to the current interactive progress information and the logical relationship of the interactive multimedia content, and when the global mind map is generated, a multimedia content segment not selected by the user in the global mind map is rendered into a first state, and a multimedia content segment selected by the user is rendered into a second state.

The step of generating the global mind map may be executed by the terminal device, or may be executed by the background server, which is not limited in the embodiment of the present application.

The method comprises the steps of determining the multimedia content segments selected by a user by recording each selection made by the user in the process of watching interactive multimedia content, and displaying the multimedia content segments selected by the user in a highlighted manner in the global thinking guide graph when the global thinking guide graph is displayed, so that the user can clearly and intuitively know how to select the currently played multimedia content segments, thereby knowing the causal relationship between each selected option and the current plot, and better highlighting the interaction and the effect of the options on the plot progress.

In specific implementation, a user can click any multimedia content segment in the global mind map, and then the multimedia content segment is played. For this purpose, the user can return to any one of the previously played multimedia content segments at any time through the global mind map, or select to play the previously unselected multimedia content segment, thereby starting to explore another scenario branch.

Taking fig. 4A as an example, the currently played video segment 6 in the scenario branch 2 (the played video segments are video segments 1, 2, and 6 at this time), when the user wants to return to watch the video segment 2, the user clicks the video segment 2 in the global thinking guide graph, and the client automatically hides the global thinking guide graph and plays the video segment 2; when the user wants to explore other scenario branches, the user can click on other unselected video segments, for example, click on the video segment 3 in the global thinking guide graph, the client automatically hides the global thinking guide graph, plays the video segment 3, and then starts to explore the scenario branch where the video segment 3 is located.

To this end, the user may quickly return to the previous multimedia content segment by clicking on the multimedia content segment in the global mind map, thereby re-making a selection or reviewing the previous scenario.

On the basis of any one of the above embodiments, the method in the embodiments of the present application further includes the steps of: and when the global thinking guide picture of the interactive multimedia content to which the currently played multimedia content segment belongs is obtained, displaying the locking state of the subsequently played multimedia content segment as the unlocked state according to the logic relationship and the interactive progress information.

The locked state is displayed as the unlocked state to indicate that the corresponding multimedia content segment can be played, and the locked state is displayed as the unlocked state to indicate that the corresponding multimedia content segment cannot be played, so as to prompt a user which multimedia content segments can be played.

The display mode of the locking state is not limited in the embodiment of the application. Taking fig. 5 as an example, in the global thinking diagram, a video clip with a locked state being an unlocked state is marked with a lock mark 501, and a video clip with a locked state being an unlocked state has no lock mark 501. The global mind map shown in fig. 5 also includes an identifier 503 for indicating the currently playing video clip.

In specific implementation, the following multimedia content segments that can be played can be determined as follows: determining the multimedia content segment selected by the user according to the interaction progress information; and according to the logic relation among the multimedia content segments, determining the multimedia content segment selected by the user and at least one multimedia segment behind the multimedia content segment selected by the user as the multimedia content segment which can be played subsequently. Then, in the global mind map, the locked state of the subsequent playable multimedia content segment is displayed as the unlocked state.

Taking fig. 5 as an example, at this time, the interactive progress video segment 4 is not yet played, the video segments selected by the user in the interactive progress information include video segments 1, 2, and 6, the video segments 2, 3, and 4 are located after the video segment 1 and directly connected to the video segment 1, the video segments 5 and 6 are located after the video segment 2 and directly connected to the video segment 2, and the video segment 10 is located after the video segment 6 and directly connected to the video segment 6, so that the following multimedia content segments that can be played are the video segments 1, 2, 3, 4, 5, 6, and 10. If the user selects the displayed global mind map at this time, in the global mind map, the locked states of the video segments 1, 2, 3, 4, 5, 6, and 10 are displayed as the unlocked state, the locked states of the other video segments are displayed as the unlocked state, and the display effect refers to fig. 5.

In the specific implementation, the locking state of each multimedia content segment can be updated at any time in the interaction process. Specifically, when a certain multimedia content segment is played, prompting the user to select an option, or when the user selects to play a certain multimedia content segment, the locking states of a plurality of multimedia content segments directly connected with the multimedia content segment after the multimedia content segment are updated to the unlocked states according to the logical relationship. Then, when the global mind map of the interactive multimedia content to which the currently played multimedia content segment belongs is obtained, the global mind map is directly displayed according to the locking state of each multimedia content segment.

Taking fig. 5 as an example, at this time, the video segment 4 is not played yet, and therefore, the video segment 7 and the video segment 8 directly connected after the video segment 4 are in an unlocked state; and after the user clicks to play the video segment 4 or the video segment 4 is played, updating the locking state of the video segment 7 and the video segment 8 to be the unlocked state.

Therefore, the interactive multimedia content processing method of the embodiment of the application further comprises the following steps: responding to the selection operation of the multimedia content segment with the locked state being the unlocked state in the global thinking guide graph, and playing the multimedia content segment corresponding to the selection operation on the playing interface.

In specific implementation, the operation of selecting the multimedia content segment in the global mind map includes, but is not limited to: clicking the global mind map, long-pressing the global mind map, and the like.

Taking fig. 5 as an example, the user clicks the video segment 4 in the global mind map, the client responds to the selection operation for the video segment 4, automatically hides the global mind map, plays the video segment 4, and then starts to explore the scenario branch where the video segment 4 is located.

In particular, when the user clicks on a multimedia content segment (e.g., video segment 7, video segment 8 in fig. 5) in an unlocked state, the client may display a prompt message of "unlocked".

For this reason, the user can quickly know which multimedia content segments are not unlocked and which multimedia content segments are unlocked through the global mind map.

In one possible implementation, the global mind map of the interactive video to which the currently played video clip belongs may be obtained as follows: and generating a global thinking guide graph according to the logic relation between the video clips in the at least two plot branches and the video clip selected by the user, and hiding the video clip which is not unlocked in the locking state in the global thinking guide graph. The video clips which are not selected by the user in the global mind map are displayed in a first state, and the video clips which are selected by the user in the global mind map are displayed in a second state. Therefore, the video clips which are not unlocked in the global mind map can be hidden, and the breakthrough is prevented.

Fig. 6 is a global mind map obtained by hiding the video clip that is not unlocked in fig. 5, fig. 6 hides the video clip that is not unlocked in fig. 5, and finally the global mind map shown in fig. 6 is displayed on a playing interface.

On the basis of any one of the above embodiments, the interactive multimedia content processing method according to the embodiment of the present application further includes the following steps: responding to closing operation aiming at the interactive multimedia content, and storing the account of the current login user and the current interactive progress information of the interactive multimedia content in a correlation manner; and responding to the login request of the account, and taking the interaction progress information stored in a correlated manner as the initial interaction progress information of the user.

In specific implementation, before watching the interactive multimedia content, the user can log in the account of the user through the client, so that the client can store the current interactive progress information of the user in association with the account of the user, and the current interactive progress information can be stored locally in the terminal equipment or can be synchronized to the background server. The interactive multimedia content can be watched again after the user logs in next time, at this time, the client can acquire the interactive progress information corresponding to the interactive multimedia content from the local or background server of the terminal device according to the account number logged in by the user as the initial interactive progress information of the user, and directly play the currently played multimedia content segment in the initial interactive progress information or prompt the user to watch the last multimedia content segment (namely the currently played multimedia content segment in the initial interactive progress information) based on the currently played multimedia content segment in the initial interactive progress information, and if the user selects to continue playing, the last watched multimedia content segment is played. When a user wants to view a global thinking guide graph before viewing interactive multimedia content, a client can generate and display the global thinking guide graph based on a global story line configured for the interactive multimedia content in advance, the locking state of each multimedia content segment stored in initial interaction progress information and the multimedia content segment selected by the user, and the user can quickly and intuitively know the progress of the last interaction through the global thinking guide graph, so that the user is assisted to quickly finish the antecedent review and the subsequent interaction efficiency is improved. Then, based on the operation of the user in the process of watching the interactive multimedia content, the interactive progress information is continuously updated on the basis of the initial interactive progress information.

Therefore, the interactive multimedia content processing method of the embodiment of the application realizes the archiving of the interactive progress information of the interactive multimedia content watched by the user, and is convenient for the user to quickly locate the last watched multimedia content segment based on the acquired previously stored interactive progress information when the user watches the interactive multimedia content again, so as to know the played multimedia content segment and the unlocking condition of the multimedia content segment, thereby determining which plot branches have been explored and which plot branches are yet to be explored, and improving the interactive efficiency.

On the basis of any one of the above embodiments, the method in the embodiments of the present application further includes the steps of: and responding to the positioning operation aiming at the global mind map, and adjusting the display position of the global mind map in the playing interface so as to enable the currently played multimedia content segment in the global mind map to be positioned in the designated area on the playing interface.

During specific implementation, the central point of the designated area can be overlapped with the central point of the playing interface, and the central point of the designated area can also be near the central point of the playing interface, so that the currently played video clip position in the global thinking map can be displayed near the central position of the playing interface through positioning operation, and a user can conveniently and quickly find the currently played video clip.

During specific implementation, the display position of the global mind map in the playing interface can be adjusted according to the central point of the currently played video clip in the global mind map, so that the central point of the currently played video clip coincides with the central point of the playing interface.

In specific implementation, the user can move the global mind map up, down, left and right, can also enlarge the global mind map so as to look over local details, and can also reduce the global mind map so as to look over the whole global mind map, thereby facilitating the user to understand the drama venation.

After moving, enlarging, or reducing the global mind map, the user may not be able to find the position of the currently played multimedia content segment conveniently, so as to facilitate the user to quickly locate the currently played multimedia content segment, a positioning control may be set on a floating layer or a pop-up window displaying the global mind map, and the setting manner of the positioning control may refer to fig. 7. Referring to fig. 7, a user inputs a positioning operation by clicking a positioning control 701, and in response to the positioning operation, the client adjusts a display position of the global mind map in the playing interface, so that a currently played video clip in the global mind map is located in a specified area on the playing interface, and displays a positioning identifier 702 on the currently played video clip 6, which is convenient for the user to find the video clip 6.

In specific implementation, the positioning operation may also be a specific operation for the global mind map, such as long-pressing the global mind map, continuously clicking the global mind map, and the like.

In the specific implementation process, in the positioning process, the client can adaptively adjust the size of the global mind map displayed after the positioning according to the size of the global mind map and the size of the global mind map displayed in the client, so as to achieve the size suitable for the user to check.

On the basis of any one of the above embodiments, the multimedia content segment corresponding to the terminal in the global mind map is displayed in a third state.

In a specific implementation, the third state may be any highlighting manner different from the first state and the second state. Taking fig. 5 as an example, in the global mind map, the ending mark 502 is marked on the video segment corresponding to the ending. By marking the ending videos in the global thinking guide graph, a user can conveniently know the video segments corresponding to the ending of each scenario branch line.

On the basis of any one of the above embodiments, the method in the embodiments of the present application further includes the steps of: updating the locking state of each multimedia content segment in any scenario branch line to be an unlocked state in response to the selection operation aiming at any scenario branch line in the global thinking guide graph; and responding to the playing operation aiming at the selected scenario branch line, and sequentially playing the multimedia content segments in the selected scenario branch line.

Referring to fig. 8, in a specific implementation, a user presses a branch line selection control 801, then a check control 803 is displayed at a corresponding position of each video segment in the global mind map, and a play control 802 is displayed, the user can check the video segments in the branch line of the global mind map one by one along a scenario branch line in the global mind map, a symbol "√" symbol is displayed in the check control 803 corresponding to the checked video segment, the user checks the scenario branch line of the video segments 1, 3, 10, 12 in fig. 8, and updates the locked state of the checked video segment to be unlocked, eliminates the lock-shaped identifier 804 of the checked video segment in the global mind map, and finally, the selected video segments 1, 3, 10, 12 can be played sequentially by pressing the play control 802, and the user-selected portion can be skipped during the sequential playing of the checked video segments, and directly playing the continuous video clip. Therefore, the user can select to play the video clips in any plot branch line through the global thinking guide graph, and the user can conveniently explore different plot branch lines.

On the basis of any one of the above embodiments, in order to facilitate a user to understand the scenarios of the interactive multimedia content more clearly, a transition hierarchy of chapters is set, the interactive multimedia content is divided into a plurality of chapters according to the relevance between the scenarios, each chapter comprises a plurality of scenario branches, and each scenario branch comprises a plurality of multimedia content segments. The story line can be displayed by chapters, and especially when the interactive multimedia content has complex plot and more branches, the chapters can be divided to reduce the complexity of the thinking guide picture.

Therefore, referring to fig. 9, an embodiment of the present application further provides an interactive multimedia content processing method, which is described as being executed by a terminal device, and specifically includes the following steps:

and S901, displaying a playing interface of the interactive multimedia content.

S902, responding to a second trigger operation input through a playing interface, and displaying a chapter thinking guide graph of interactive multimedia content to which a currently played multimedia content segment belongs on the playing interface, wherein the interactive multimedia content comprises at least two chapters, each chapter comprises at least two scenario branches, and the chapter thinking guide graph comprises a logical relationship between the at least two chapters.

The second trigger operation in the embodiment of the present application is an operation for triggering presentation of a chapter mind map.

In specific implementation, referring to fig. 3A, a second control 303 for triggering and displaying a chapter thinking diagram may be set in the playing interface 301 of the client in advance, and the user may click the second control 303 in the process of watching the video clip, so as to input a second triggering operation. And the client responds to the second trigger operation to acquire the chapter thinking guide picture of the interactive video to which the currently played video clip belongs and display the chapter thinking guide picture on the playing interface.

In specific implementation, the second trigger operation may also be a specific operation for the play interface, for example, long-time pressing of the play interface, leftward sliding, and the like, but it is required to ensure that the second trigger operation is different from the first trigger operation.

As a possible implementation manner, a chapter mind map corresponding to each interactive multimedia content may be generated in advance and stored in the background server. And the client in the terminal equipment responds to the second trigger operation, determines the interactive multimedia content to which the currently played multimedia content segment belongs, acquires the chapter thinking diagram of the interactive multimedia content from the background server, and displays the chapter thinking diagram on the playing interface. Or when the client sends a request for acquiring the interactive multimedia content to the background server, the background server sends the interactive multimedia content and the corresponding chapter thought guide graph I to the client, the client stores the acquired chapter thought guide graph in the local terminal equipment, and the client responds to the second trigger operation to acquire the chapter thought guide graph of the interactive multimedia content from the local terminal equipment and display the chapter thought guide graph on the playing interface.

As another possible implementation, the chapter lines may be configured for the interactive multimedia content in advance, and include a logical relationship between all chapters of the interactive multimedia content. And the client responds to the second trigger operation to acquire chapter lines configured for the interactive multimedia content and generate a chapter thinking guide picture of the interactive multimedia content in real time according to the chapter lines. The chapter lines corresponding to the interactive multimedia contents can be stored in a background server, and also can be sent to the client together with the interactive multimedia contents by the background server and stored locally in the terminal equipment. Of course, the chapter thinking map of the interactive multimedia content can also be generated by the background server in real time according to the chapter points.

The embodiment of the present application does not limit the specific manner of displaying the chapter mind map on the playing interface. For example, the client generates a floating layer or a popup window on the playing interface in response to the second trigger operation, and displays the chapter thinking guide picture in the generated floating layer or popup window.

In particular, the chapter corresponding to the ending in the chapter thinking diagram is displayed in the third state.

Taking fig. 10 as an example, it shows a chapter mind map of the interactive video XX. The interactive video XX includes five chapters in total, and the lines between the chapters in fig. 10 indicate the logical relationship between the chapters, for example, the first chapter may jump to the second chapter, and the first chapter may jump to the third chapter directly according to the selection of the user. In fig. 10, a chapter corresponding to the ending (i.e., the fifth chapter) is marked by an ending mark 1001, while a chapter not to be unlocked (including the third chapter, the fourth chapter, and the fifth chapter) is marked by a lock-shaped mark 1002, and a chapter positioning mark 1003 is used for indicating the chapter currently located. The chapter mind map may also show the viewing progress of each chapter, such as 90% for the first chapter, 25% for the second chapter, and the third, fourth, and fifth chapters in an unlocked state.

In particular implementations, the lock status of a chapter can be determined based on the lock status of the segment of multimedia content contained in the chapter. For example, when all multimedia content segments in a certain chapter are in the unlocked state, the locked state of the chapter is unlocked; when any multimedia content segment in a certain chapter is unlocked, the locking state of the chapter is updated to be unlocked.

In specific implementation, the viewing progress of each chapter can be determined according to the ratio of the viewed multimedia content segments in each chapter to the total number of the multimedia content segments in each chapter.

In practical applications, the content shown in the chapter thinking diagram is not limited to the content shown in fig. 10, and may also show information such as the title of the chapter. For example, when the chapter thinking guide map contains more chapters, the user can move the chapter thinking guide map up and down, left and right or zoom the chapter thinking guide map, a chapter positioning control can be arranged in the chapter thinking guide map, the action of the chapter positioning control is similar to that of the positioning control 701 in fig. 7, the user clicks the chapter positioning control, the client responds to the clicking operation of the chapter positioning control and adjusts the display position of the chapter thinking guide map in the playing interface, so that the currently watched chapter in the chapter thinking guide map is located at the center of the playing interface, and the user can conveniently and quickly locate the currently watched chapter.

Further, on the basis of the interactive multimedia content processing method shown in fig. 9, the interactive multimedia content processing method according to the embodiment of the present application further includes the following steps: responding to a triggering operation aiming at any chapter in the chapter thinking guide diagram, and displaying the plot thinking guide diagram of the chapter on a playing interface, wherein the plot thinking guide diagram comprises: the section includes a logical relationship between the multimedia content segments in at least two storylines.

In the embodiment of the present application, the trigger operation for the chapter in the chapter mind map may be an operation of long pressing the chapter in the chapter mind map, clicking the long pressing the chapter in the chapter mind map, and the like.

In specific implementation, the scenario thinking guide graph of a chapter is generated in a similar manner to the global thinking guide graph, and the difference is that the global thinking guide graph is generated based on a global story line configured for interactive multimedia content, and the scenario thinking guide graph is generated based on a local story line configured for a certain chapter in advance.

In specific implementation, the interactive multimedia content processing method according to the embodiment of the present application further includes the following steps: responding to the triggering operation of any chapter with an unlocked locking state in the chapter mind map, and displaying the plot mind map of the chapter on a playing interface; and responding to the triggering operation of any chapter of which the locking state is not unlocked in the chapter thinking diagram, and playing the trailer corresponding to the chapter.

Therefore, the user can look up the information of chapter titles, video covers and the like of the unopened chapters through the chapter thinking picture, and simultaneously, the user can watch the forenotice of the unopened chapters, so that the user can have certain perception on the subsequent plot.

The interactive multimedia content processing method enables a user to roughly know the trend of a plot through the chapter thinking guide picture, then the plot enters the plot thinking guide picture corresponding to each chapter, and the complexity of the plot thinking guide picture can be reduced by setting a transition level of the chapter.

In particular, the association between the chapters is related by the multimedia content segments. Any piece of multimedia content within one chapter may lead to any piece of multimedia content in other chapters. Fig. 11 is a plot of the story thinking map corresponding to the second chapter in fig. 10, in which the video segments in the second chapter are connected by solid lines, and the video segments in the second chapter and other chapters are connected by dotted lines, so as to distinguish the jump relationship between different chapters and the jump relationship in the chapter, and help to weaken the sense of disorder caused by the complexity of story lines. In fig. 11, a video segment 5 in the first chapter leads to a video segment 1 in the second chapter, a video segment 8 in the first chapter leads to a video segment 3 in the second chapter, a video segment 8 in the second chapter leads to a video segment 1 in the third chapter, a video segment 5 and a video segment 7 in the second chapter lead to a video segment 3 in the fifth chapter, and a video segment 6 in the second chapter is an ending, so that when a user clicks the video segment 3 in the fifth chapter, the client can directly play the video segment 3 in the fifth chapter.

It can be found with reference to fig. 11 that an ending may also be included within the middle chapter, and thus, in order to provide more plot information in the chapter mind map, each chapter in the chapter mind map may be split into multiple branches according to its internal plot branches, with particular reference to fig. 12. In fig. 12, the second chapter splits into 3 branches, the first second chapter branch corresponds to the scenario branches where the video segments 1, 3, and 7 in fig. 11 are located, the second chapter branch corresponds to the scenario branches where the video segments 1, 3, and 6 in fig. 11 are located, the third second chapter branch corresponds to the scenario branches where the video segments 1, 2, 4, 5, and 8 in fig. 11 are located, the first second chapter branch is directly connected with the first fifth chapter branch, the second chapter branch corresponds to an ending, the third second chapter branch is connected with the third chapter, and the second chapter branch is marked as an ending.

In practical application, a plurality of rendering rules are formulated for thinking diagrams (including a global thinking diagram, a chapter thinking diagram and a plot thinking diagram), and the rendering rules relate to the problems of how to place multimedia content fragments and chapters in the thinking diagrams, how to display connecting lines, how to process connecting line intersection, how to display cross-chapter skip and the like, so that the generated thinking diagrams can more clearly and intuitively display the logical relationship of plots, and the user experience is improved.

Specifically, aiming at the problem of how to place the multimedia content segments in the global thinking map, the coordinates of each multimedia content segment in the global thinking map can be calculated according to the overall trend of the global story line, so that the reasonable gaps among the multimedia content segments are ensured as much as possible under the condition of avoiding the overlapping of the multimedia content segments, and the excessive dispersion among the multimedia content segments is avoided. The locations of the chapters in the chapter mind map can be determined in the same manner for the chapter mind map. The same manner may be used for the storyline mind map to determine the location of the multimedia content segments in the chapters in the storyline mind map.

In specific implementation, the minimum distances among the connecting lines, the multimedia content segments and the chapters can be respectively set, and in the generated thinking map, the distances among the connecting lines, the multimedia content segments and the chapters are not less than the respective minimum distances.

Specifically, the display mode of the connecting line may be: extending along the horizontal direction and the vertical direction and adopting round corners for processing. Different connecting lines can be defined into different display styles according to the states of the multimedia content segments connected by the connecting lines, such as highlight, thickening, realizing, dotted lines and other styles, so that the user can understand the trend of the plot. When storylines allow one-to-many, many-to-one, there is necessarily a crossing of connecting lines. Aiming at the problem of connecting line crossing, when calculating the coordinates of the multimedia content segments and chapters in the thinking guide graph, the connecting line crossing is avoided as much as possible; when the connecting lines cannot be avoided to be crossed through layout, the cross points between the connecting lines are always perpendicular to the two single straight lines, overlapping of the connecting lines is avoided, the cross points can be obviously distinguished, and a user is helped to better distinguish the trend of the story line. In addition, the plot branch where the user is currently located can be highlighted or bolded, and jumping across chapters can be achieved in a dotted line type, so that the disorder caused by crossing of connecting lines can be weakened. Referring to fig. 13, the connection lines are shown in various cases. In the case of one-to-one, one-to-many, many-to-one, the center points of the video segments are connected. In many-to-many cases, the intervals between the plurality of parallel connection lines are equal.

In particular, with respect to the problem of jumping across chapters, with reference to fig. 11, the connecting lines of the video segments between chapters are dashed to aid the user in distinguishing and understanding.

The cross-chapter processing rules, one-to-many and many-to-one massive playing methods ensure that the story line is overall concise and easy to understand, and simultaneously furthest show the trend and the interactive veins of the dramas in front of the user, so that richer interactive playing methods and experiences are brought to the user.

In particular, the mind map (including the global mind map, the chapter mind map, and the plot mind map) may be generated by a rendering engine.

Referring to FIG. 14, a diagram of a mind map generated by a rendering engine is shown. The steps corresponding to fig. 14 may be executed by the terminal device, or may be executed by the backend server.

First, interactive data is obtained.

In particular, interactive data can be obtained by a unified data request tool. For example, referring to fig. 15, a caller may initiate an interactive data acquisition request to a data storage server using a request interface (ivapi) of an axios library, the interactive data acquisition request including: and after the data storage server inquires the interactive data meeting the serial numbers of the account and the interactive video of the user in the interactive data acquisition request, the inquired interactive data is sent to the data processing and exchanging layer. The calling party can be a terminal device or a background server.

The interactive data in the embodiment of the present application includes but is not limited to: interactive video ID, chapter ID, video clip ID, global story line, local story line, chapter line, motion progress information, etc.

And secondly, data processing and conversion.

The data processing conversion layer mainly converts the interactive data and the data fields in the rendering rules into the data rendering fields which are universal at the front end. The specific implementation principle is that the default field is mapped into the field which can be understood by the rendering layer through the mapping table, and the field which is defined by the user can also be converted through the same set of conversion rules.

The rendering rules can be stored in a background server and can be directly called when needed.

And thirdly, rendering according to the output data of the data processing conversion layer to obtain the mind map.

Referring to fig. 14, the rendering layer includes a rendering main frame and an underlying rendering engine. The rendering main frame comprises a tool set, a core function and a plug-in system. The underlying rendering engine provides the most basic canvas rendering capability.

Referring to fig. 16, the rendering layer obtains the interactive data and the rendering rule converted by the data processing conversion layer, calls a tool in the rendering main frame, uniformly renders the interactive data into a specific component according to the rendering rule, and then delivers the rendered component to the bottom rendering engine for rendering.

The underlying rendering engine may employ a Canvas to enable the rendering of components. The Canvas Component is an abstract space for UI (User Interface) layout and rendering, all of which must be under this element, and simply a Component that renders the UI.

The following description will take an example of a method for executing interactive multimedia content by the cooperation of a terminal device and a background server.

Referring to fig. 17, the method for processing interactive multimedia content according to the embodiment of the present application includes the following steps:

s1701, the terminal equipment displays a playing interface of the interactive multimedia content.

S1702, the terminal device responds to the first trigger operation input through the playing interface, and sends a global mind map display request for the interactive multimedia content to the background server.

S1703, the background server obtains the global mind map of the interactive multimedia content based on the global mind map display request of the interactive multimedia content sent by the terminal equipment.

And S1704, the background server sends the global thinking guide graph to the terminal equipment.

S1705, the terminal device displays the global thinking guide graph on the playing interface.

In a possible implementation manner, step S1703 specifically includes: and the background server displays the multimedia content segments which are not selected by the user in the global thinking map in a first state and displays the multimedia content segments which are selected by the user in the global thinking map in a second state according to the interaction progress information of the user in the playing process.

In a possible implementation manner, step S1703 specifically includes: and the background server displays the locking state of the multimedia content segment which can be played subsequently as the unlocked state according to the logic relation and the interaction progress information.

Correspondingly, the interactive multimedia content processing method provided by the embodiment of the application further comprises the following steps: and the terminal equipment responds to the selection operation of the multimedia content segment with the unlocked locking state in the global thinking guide graph, and plays the multimedia content segment corresponding to the selection operation on the playing interface.

In a possible implementation manner, the interactive multimedia content processing method provided in the embodiment of the present application further includes the following steps: the terminal equipment responds to the closing operation aiming at the interactive multimedia content and sends a closing request aiming at the interactive multimedia content to the background server; and the background server stores the account of the current login user and the current interactive progress information of the interactive multimedia content in a correlation manner based on the closing request.

Correspondingly, the interactive multimedia content processing method provided by the embodiment of the application further comprises the following steps: the terminal equipment responds to the login request of the account and sends the login request of the account to the background server; the background server sends a login request for an account number based on the terminal equipment, and takes interaction progress information stored in association with the account number as initial interaction progress information of a user corresponding to the account number.

In a possible implementation manner, the interactive multimedia content processing method provided in the embodiment of the present application further includes the following steps: and responding to the positioning operation aiming at the global mind map, and adjusting the display position of the global mind map in the playing interface so as to enable the currently played multimedia content segment in the global mind map to be positioned in the designated area on the playing interface.

In a possible implementation manner, the interactive multimedia content processing method provided in the embodiment of the present application further includes the following steps: the terminal equipment responds to the selection operation aiming at any scenario branch line in the global thinking guide graph and updates the locking state of each multimedia content segment in any scenario branch line into the unlocked state; and responding to the playing operation aiming at the selected scenario branch line, and sequentially playing the multimedia content segments in the selected scenario branch line.

In a possible implementation manner, the interactive multimedia content processing method provided in the embodiment of the present application further includes the following steps: the terminal equipment responds to a second trigger operation input through the playing interface and sends a chapter thinking guide picture display request for the interactive multimedia content to the server; the background server acquires a chapter thinking guide picture of the interactive multimedia content and sends the chapter thinking guide picture to the terminal equipment; and the terminal equipment displays the chapter thinking guide picture on the playing interface.

In a possible implementation manner, the interactive multimedia content processing method provided in the embodiment of the present application further includes the following steps: the terminal equipment responds to the triggering operation aiming at any chapter in the chapter thinking guide graph and sends a plot thinking guide graph display request for the chapter to the server; the background server acquires the plot thinking guide picture of the chapter and sends the plot thinking guide picture to the terminal equipment; and the terminal equipment displays the plot thinking guide picture of the section on a playing interface.

The interactive video is taken as an example to describe the interactive multimedia content processing technology provided by the embodiment of the present invention in detail, and for other interactive multimedia contents, a person skilled in the art can completely implement specific control according to the above disclosure. Based on the same inventive concept as the interactive multimedia content processing method, the embodiment of the application also provides an interactive multimedia content processing device.

As shown in fig. 18, the interactive multimedia content processing apparatus 180 provided in the embodiment of the present application includes an interface display module 1801 and a mind map display module 1802.

An interface display module 1801, configured to display a playing interface of the interactive multimedia content;

the mind map display module 1802 is configured to display, in response to a first trigger operation input through the play interface, a global mind map of an interactive multimedia content to which a currently played multimedia content segment belongs, where the interactive multimedia content includes at least two scenario branches, and the global mind map includes a logical relationship between multimedia content segments in the at least two scenario branches.

Optionally, the mind map display module 1802 is specifically configured to display, in the global mind map, multimedia content segments that are not selected by the user in the global mind map in a first state and display, in a second state, multimedia content segments that have been selected by the user in the global mind map according to the interaction progress information of the user in the playing process.

Optionally, the mind map display module 1802 is further configured to display, when displaying a global mind map of an interactive multimedia content to which a currently played multimedia content segment belongs, a locked state of a subsequently playable multimedia content segment as an unlocked state according to the logical relationship and the interaction progress information;

the interactive multimedia content processing device also comprises a playing module which is used for responding the selection operation of the multimedia content segment of which the locking state is the unlocked state in the global thinking guide graph and playing the multimedia content segment corresponding to the selection operation on the playing interface.

Optionally, the mind map display module 1802 is further configured to: when a global thinking map of interactive multimedia content to which a currently played multimedia content segment belongs is obtained, displaying a locking state of a subsequently playable multimedia content segment as an unlocked state according to the logic relationship and the interactive progress information;

Optionally, the interactive multimedia content processing apparatus further comprises an archive module and a login module;

the archiving module is used for responding to closing operation aiming at the interactive multimedia content and storing the account of the current login user and the current interactive progress information of the interactive multimedia content in a correlation manner;

and the login module is used for responding to a login request of the account and taking the interaction progress information stored in a correlated manner as the initial interaction progress information of the user.

Optionally, the interactive multimedia content processing apparatus further includes a positioning module, configured to adjust a display position of the global mind map within the playing interface in response to a positioning operation for the global mind map, so that a currently played multimedia content segment in the global mind map is located in a specified area on the playing interface.

Optionally, the segment of multimedia content corresponding to the ending in the global mind map is displayed in a third state.

Optionally, the mind map display module 1802 is further configured to respond to a second trigger operation input through the play interface, where the chapter mind map of the interactive multimedia content to which the currently played multimedia content segment belongs on the play interface includes at least two chapters, each chapter includes at least two scenario branches, and the chapter mind map includes a logical relationship between at least two chapters.

Optionally, the thinking map display module 1802 is further configured to display a plot thinking map of any chapter on the playing interface in response to a triggering operation for any chapter in the chapter thinking map, where the plot thinking map includes: a chapter includes a logical relationship between multimedia content segments in at least two storylines.

Optionally, the chapter thinking map displays the corresponding chapter in the office in a third state.

As shown in fig. 19, the interactive multimedia content processing apparatus 190 provided in the embodiment of the present application includes an obtaining module 1901 and a sending module 1902.

The obtaining module 1901 is configured to obtain a global mind map of an interactive multimedia content based on a global mind map display request of the interactive multimedia content sent by a terminal device, where the interactive multimedia content includes at least two scenario branches, and the global mind map includes a logical relationship between multimedia content segments in the at least two scenario branches.

The sending module 1902 is configured to send the global mind map to the terminal device, so that the terminal device displays the global mind map on the playing interface.

Optionally, the obtaining module 1901 is specifically configured to display, in the global mind map, multimedia content segments that are not selected by the user in the global mind map in a first state and display, in a second state, multimedia content segments that have been selected by the user in the global mind map according to the interaction progress information of the user in the playing process.

Optionally, the obtaining module 1901 is specifically configured to display a locked state of a multimedia content segment that can be played subsequently in the global mind map as an unlocked state according to the logical relationship and the interaction progress information.

Optionally, the interactive multimedia content processing apparatus 190 provided in this embodiment of the application further includes an association module, configured to associate and store the account of the current login user and the current interaction progress information of the interactive multimedia content based on a closing request for the interactive multimedia content sent by the terminal device.

Correspondingly, the interactive multimedia content processing apparatus 190 provided in this embodiment of the present application further includes a login module, configured to send a login request for an account based on the terminal device, and use interaction progress information stored in association with the account as initial interaction progress information of the user corresponding to the account.

Optionally, the obtaining module 1901 is further configured to send a chapter mind map display request for the interactive multimedia content based on the terminal device, and obtain a chapter mind map of the interactive multimedia content; the sending module 1902 is further configured to send the obtained chapter mind map to the terminal device, so that the terminal device displays the chapter mind map on the playing interface.

Optionally, the obtaining module 1901 is further configured to obtain the plot thinking guide of the chapter and send the plot thinking guide to the terminal device based on the plot thinking guide display request sent by the terminal device for the chapter, so that the terminal device displays the plot thinking guide of the chapter on the playing interface.

The interactive multimedia content processing device and the interactive multimedia content processing method provided by the embodiment of the application adopt the same inventive concept, can obtain the same beneficial effects, and are not repeated herein.

Based on the same inventive concept as the interactive multimedia content processing method, an embodiment of the present application further provides an electronic device, which may specifically be the terminal device 101 or the background server 102 shown in fig. 1. As shown in fig. 20, the electronic device 200 may include a processor 2001 and a memory 2002.

The Processor 2001 may be a general-purpose Processor, such as a Central Processing Unit (CPU), a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component, which may implement or perform the methods, steps, and logic blocks disclosed in the embodiments of the present Application. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of a method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware processor, or may be implemented by a combination of hardware and software modules in a processor.

The memory 2002, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. The Memory may include at least one type of storage medium, and may include, for example, a flash Memory, a hard disk, a multimedia card, a card-type Memory, a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Programmable Read Only Memory (PROM), a Read Only Memory (ROM), a charged Erasable Programmable Read Only Memory (EEPROM), a magnetic Memory, a magnetic disk, an optical disk, and so on. The memory is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited to such. The memory 2002 in the embodiments of the present application may also be circuitry or any other device capable of performing a storage function for storing program instructions and/or data.

An embodiment of the present application provides a computer-readable storage medium for storing computer program instructions for the electronic device, which includes a program for executing the interactive multimedia content processing method in any of the above embodiments.

The computer storage media may be any available media or data storage device that can be accessed by a computer, including but not limited to magnetic memory (e.g., floppy disks, hard disks, magnetic tape, magneto-optical disks (MOs), etc.), optical memory (e.g., CDs, DVDs, BDs, HVDs, etc.), and semiconductor memory (e.g., ROMs, EPROMs, EEPROMs, non-volatile memory (NAND FLASH), Solid State Disks (SSDs)), etc.

The above embodiments are only used to describe the technical solutions of the present application in detail, but the above embodiments are only used to help understanding the method of the embodiments of the present application, and should not be construed as limiting the embodiments of the present application. Modifications and substitutions that may be readily apparent to those skilled in the art are intended to be included within the scope of the embodiments of the present application.

Claims

1. An interactive multimedia content processing method, comprising:

displaying a playing interface of the interactive multimedia content;

2. The method as claimed in claim 1, wherein the step of displaying the global mind map of the interactive multimedia content to which the currently played multimedia content segment belongs comprises:

according to the interactive progress information of the user in the playing process, displaying the multimedia content segments which are not selected by the user in the global mind map in a first state and displaying the multimedia content segments which are selected by the user in the global mind map in a second state in the global mind map.

3. The method of claim 2, further comprising:

when the global thinking map of the interactive multimedia content to which the currently played multimedia content segment belongs is displayed, the locking state of the multimedia content segment which can be played subsequently is displayed as the unlocked state according to the logic relationship and the interactive progress information; and

responding to the selection operation of the multimedia content segment with the locked state being the unlocked state in the global thinking guide graph, and playing the multimedia content segment corresponding to the selection operation on the playing interface.

4. The method of claim 2, further comprising:

responding to the closing operation aiming at the interactive multimedia content, and storing the account of the current login user and the current interactive progress information of the interactive multimedia content in a correlation manner; and

and responding to the login request of the account, and taking the interaction progress information stored in a correlated manner as the initial interaction progress information of the user.

5. The method of any of claims 1 to 4, further comprising:

and responding to a positioning operation aiming at the global mind map, and adjusting the display position of the global mind map in the playing interface so as to enable the currently played multimedia content segment in the global mind map to be positioned in a designated area on the playing interface.

6. The method as claimed in any one of claims 1 to 4, wherein the segment of the multimedia content corresponding to the ending in the global mind map is displayed in a third state.

7. The method of any of claims 1 to 4, further comprising:

responding to the selected operation aiming at any scenario branch line in the global thinking guide graph, and updating the locking state of each multimedia content segment in any scenario branch line into an unlocked state;

and responding to the playing operation aiming at the selected scenario branch line, and sequentially playing the multimedia content segments in the selected scenario branch line.

8. The method of any of claims 1 to 4, further comprising:

and responding to a second trigger operation input through a playing interface, and displaying a chapter thinking guide graph of interactive multimedia content to which a currently played multimedia content segment belongs on the playing interface, wherein the interactive multimedia content comprises at least two chapters, each chapter comprises at least two scenario branches, and the chapter thinking guide graph comprises a logical relationship between the at least two chapters.

9. The method of claim 8, further comprising:

responding to a triggering operation aiming at any section in the section thinking guide graph, and displaying the plot thinking guide graph of any section on the playing interface, wherein the plot thinking guide graph comprises: a chapter includes a logical relationship between multimedia content segments in at least two storylines.

10. The method as claimed in any one of claims 1 to 4, wherein the number of multimedia content segments included in the global mind map is determined according to the total number of multimedia content segments in the interactive multimedia content and a preset ratio.

11. An interactive multimedia content processing method, comprising:

12. An interactive multimedia content processing apparatus, comprising:

13. An interactive multimedia content processing apparatus, comprising:

14. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 11 are implemented when the computer program is executed by the processor.

15. A computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, implement the steps of the method of any one of claims 1 to 11.