CN111346376A

CN111346376A - Interaction method and device based on multimedia resources, electronic equipment and storage medium

Info

Publication number: CN111346376A
Application number: CN202010118805.1A
Authority: CN
Inventors: 孙莹; 杨明; 薛倩莲; 冯金; 刘艺
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2020-02-25
Filing date: 2020-02-25
Publication date: 2020-06-30
Anticipated expiration: 2040-02-25
Also published as: CN111346376B

Abstract

The application provides an interaction method and device based on multimedia resources, electronic equipment and a storage medium, and belongs to the technical field of multimedia. The method comprises the following steps: in response to receiving a plot backtracking instruction, determining at least one target plot resource segment that has been played in a multimedia resource; displaying a plot structure diagram of multimedia resources in a plot backtracking interface, wherein the plot structure diagram is used for representing a plot trend relation between at least one target plot resource segment and at least two associated branch plot resource segments; responding to the selection operation of any target plot resource segment in the plot structure chart, and playing the target plot resource segment; and playing the branch scenario resource segments indicated by the interactive operation according to the interactive operation detected in the process of playing the target scenario resource segments. According to the scheme, the structure of the whole scenario can be simply displayed, so that a user can select the scenario bifurcation node to carry out interactive operation again, and experience other branching scenarios.

Description

Interaction method and device based on multimedia resources, electronic equipment and storage medium

Technical Field

The present application relates to the field of multimedia technologies, and in particular, to an interaction method and apparatus based on multimedia resources, an electronic device, and a storage medium.

Background

With the continuous development of multimedia technology and internet technology, interactive plot games are receiving more and more attention as an emerging game form. The interactive plot game often has a plurality of mutually exclusive branch plots, different branch plots may run to different endings, and a user can decide which branch plot the plot enters through interactive operation, so that the trend of the plot is promoted to play the game. Therefore, because the mutual exclusion relationship exists between different scenarios entered by the user through different selections, the user can only select a unique scenario path in the game process, namely once the user enters a certain branch scenario, the user has no way to enter other branch scenarios mutually exclusive with the branch scenario, and therefore, the problem that the user enters other branch scenarios in the interactive scenario game becomes necessary to be solved.

In the related art, a game archiving method is generally provided to facilitate the user to save the game progress. The user can utilize a game archiving mechanism to store the game progress before entering a certain branch scenario, and if the user wants to experience another branch scenario mutually exclusive with the current branch scenario in the game process, the user can read the game progress and restart the game from the game progress to achieve the purpose of experiencing other branch scenarios.

The technical scheme has the problems that the experience of different branch scenarios through game archiving is realized by a mechanism of game archiving by a user rather than the function of a game, and the archiving can only store one game progress, so that once the user forgets to store the game progress or has a plurality of continuous branch scenarios, the user cannot access other branch scenarios through the technical scheme.

Disclosure of Invention

The embodiment of the application provides an interaction method, an interaction device, electronic equipment and a storage medium based on multimedia resources, which can simplify the structure for displaying the whole scenario, so that a user can select a scenario bifurcation node to carry out interaction operation again, and experience other branching scenarios. . The technical scheme is as follows:

in one aspect, an interaction method based on multimedia resources is provided, and the method includes:

in response to receiving a plot backtracking instruction, determining at least one target plot resource segment which is played in the multimedia resource, wherein one target plot resource segment is associated with at least two branch plot resource segments;

displaying a plot structure diagram of the multimedia resource in a plot backtracking interface, wherein the plot structure diagram is used for representing a plot trend relation between the at least one target plot resource segment and the associated at least two branch plot resource segments;

responding to the selection operation of any target plot resource segment in the plot structure chart, and playing the target plot resource segment;

and playing the branch scenario resource segments indicated by the interactive operation according to the interactive operation detected in the process of playing the target scenario resource segments.

In one aspect, an interactive device based on multimedia resources is provided, the device including:

the system comprises a determining module, a judging module and a judging module, wherein the determining module is used for responding to a received plot backtracking instruction, determining at least one target plot resource segment which is played in a multimedia resource, and at least two branch plot resource segments are associated with one target plot resource segment;

the system comprises a display module, a source module and a source module, wherein the display module is used for displaying a plot structure diagram of the multimedia resource in a plot backtracking interface, and the plot structure diagram is used for representing the plot trend relation between at least one target plot resource segment and at least two associated branch plot resource segments;

the playing module is used for responding to the selection operation of any target plot resource segment in the plot structure chart and playing the target plot resource segment;

the playing module is further configured to play the branch scenario resource segment indicated by the interactive operation according to the interactive operation detected in the process of playing the target scenario resource segment.

In an optional implementation manner, the determining module is further configured to obtain at least one attribute information corresponding to a resource segment that has been played in a multimedia resource; and determining at least one target plot resource segment according to the at least one attribute information.

In an optional implementation manner, the determining module is further configured to determine a scenario chapter to which the resource segment currently being played belongs; and determining at least one target plot resource segment according to at least one attribute information corresponding to the played resource segment in the plurality of resource segments included in the plot section.

In an optional implementation manner, the display module is further configured to use the at least one target scenario resource segment and at least two branching scenarios associated with the target resource segment as nodes of the scenario structure diagram; for any target plot resource segment, constructing an edge between a node corresponding to the target plot resource segment and nodes corresponding to at least two branch plot resource segments associated with the target plot resource segment; responding to the adjacent and relatively advanced playing sequence of any branch scenario resource segment and any target scenario resource segment, and constructing an edge between the branch scenario resource segment and the target scenario resource segment; and displaying the obtained plot structure diagram.

In an optional implementation manner, the determining module is further configured to determine, in response to receiving a switching instruction for switching a currently displayed scenario chapter, a target scenario chapter indicated by the switching instruction;

the determining module is further configured to determine at least one played target scenario resource segment according to at least one attribute information of a plurality of resource segments included in the target scenario section;

the display module is further used for displaying the target plot structure diagram corresponding to the target plot sections in the plot backtracking interface.

In an optional implementation, the apparatus further includes:

the acquisition module is used for acquiring chapter names of the plot chapters and the plot titles of the at least one target plot resource segment;

the display module is further used for displaying the chapter names and the plot titles.

In an optional implementation manner, the playing module is further configured to obtain the target scenario resource segment; and in response to receiving a display instruction of any scenario problem, displaying the scenario problem and at least two problem options corresponding to the scenario problem in a suspension manner on the target scenario resource segment which is being played.

In an optional implementation manner, the playing module is further configured to determine, in response to detecting an interactive operation in the process of playing the target scenario resource segment, a question option triggered by the interactive operation; determining a branching scenario resource segment indicated by the question option; and responding to the completion of the playing of the target scenario resource segment, and playing the branch scenario resource segment.

In an optional implementation manner, the playing module is further configured to determine, in response to detecting an interactive operation in the process of playing the target scenario resource segment, a question option triggered by the interactive operation; accumulating the target scores corresponding to the question options into a target score total value corresponding to a user account; determining the branching scenario resource segments according to the target score total value; and responding to the completion of the playing of the first resource segment, and playing the branching scenario resource segment.

In an optional implementation, the apparatus further includes:

the display module is further used for responding to the received scenario archiving instruction and displaying a scenario archiving interface, and the scenario archiving interface comprises at least one manual archiving sub-interface;

the display module is further used for responding to the detection of the trigger operation of any manual archiving sub-interface and displaying the manual archiving sub-interface;

and the storage module is used for responding to the trigger operation of detecting the storage button included in the manual archiving sub-interface and storing at least one resource identifier corresponding to the played resource segment.

In an optional implementation manner, the scenario archiving interface further includes an automatic archiving sub-interface, and the automatic archiving sub-interface is configured to display the scenario structure diagram stored when the target condition is met; the target condition is one of detection of selection operation, playing of a new resource segment, ending of a plot chapter and interval target duration.

In one aspect, an electronic device is provided, and the electronic device includes a processor and a memory, where the memory is configured to store at least one program code, and the at least one program code is loaded and executed by the processor to implement the operations performed in the multimedia resource based interaction method in the embodiments of the present application.

In one aspect, a storage medium is provided, where at least one program code is stored in the storage medium, and the at least one program code is configured to execute the multimedia resource-based interaction method in the embodiment of the present application.

The technical scheme provided by the embodiment of the application has the following beneficial effects:

in the embodiment of the application, the plot trend relationship between the target plot resource segment and the branch plot resource segment is displayed in the plot structure diagram form on the plot backtracking interface, so that the structure of the whole plot can be simplified, and a user can select the target plot resource segment to perform interaction operation again, thereby experiencing other branch plot resource segments corresponding to the target plot resource segment.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a block diagram illustrating a multimedia resource-based interactive system according to an embodiment of the present application;

fig. 2 is a flowchart of an interaction method based on multimedia resources according to an embodiment of the present application;

fig. 3 is a schematic diagram of a scenario backtracking interface provided according to an embodiment of the present application;

fig. 4 is a schematic diagram of another scenario backtracking interface provided in accordance with an embodiment of the present application;

FIG. 5 is a schematic diagram of a toggle button provided in accordance with an embodiment of the present application;

FIG. 6 is a schematic diagram of a loading question and option provided according to an embodiment of the present application;

fig. 7 is a schematic diagram of a scenario archiving interface provided according to an embodiment of the present application;

FIG. 8 is a schematic diagram of a manual archive interface provided in accordance with an embodiment of the present application;

FIG. 9 is a logical schematic diagram of a manual archive and an automatic archive provided in accordance with an embodiment of the present application;

fig. 10 is a schematic diagram of another scenario backtracking interface provided in accordance with an embodiment of the present application;

FIG. 11 is a block diagram of an interactive apparatus based on multimedia resources according to an embodiment of the present application;

fig. 12 is a block diagram of a terminal provided according to an embodiment of the present application;

fig. 13 is a schematic structural diagram of a server provided according to an embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

The interaction method based on the multimedia resources, provided by the embodiment of the application, can be applied to an interactive game scene. The interactive game can be an interactive game based on video resources, such as an interactive movie game based on real-time shooting of a real person as video resource materials, an interactive game based on animation video resources; the game system can also be an interactive game based on picture resources, an interactive game based on audio resources and the like. The interactive game has the core that a plurality of branch scenarios are designed, different options are provided for users in the game process, and the users can determine the trend of the scenarios by selecting the options and simple interactive operation to experience different scenarios. For example, a real-person interactive movie game is an interactive movie game produced by using real-person movies as image materials, and the multimedia resources are presented in a manner of the conventional real-person movie effect of movie play. Multimedia resources generally have a complete scenario structure, and a scenario can be divided into a branching scenario, a branching scenario and an ending scenario according to the scenario structure. A bifurcated scenario refers to a scenario structurally associated with at least two branching scenarios, by which the scenario may be pushed into a different branching scenario. The branch scenario refers to a scenario which is mutually exclusive in scenario structure, namely, a branch scenario is entered, and the scenario which is mutually exclusive with the branch scenario is not entered. Ending scenarios refer to scenarios that are located at the end of the scenario structure. One scenario corresponds to one resource segment, the scenario resource segment corresponding to the divergent scenario is associated with at least two branch scenario resource segments corresponding to the branch scenarios, the divergent scenario can enter the corresponding branch scenario through the selection operation of a user, and the divergent scenario can enter the corresponding branch scenario after settlement according to the related numerical value accumulated in the background.

The following briefly introduces the main steps of the interaction method based on multimedia resources provided by the embodiment of the present application: first, in response to receiving a scenario backtracking instruction, at least one target scenario resource segment that has been played in a multimedia resource is determined, and one target scenario resource segment is associated with at least two branching scenario resource segments. And then, displaying a plot structure diagram of the multimedia resource in the plot backtracking interface, wherein the plot structure diagram is used for representing the plot trend relationship between the at least one target plot resource segment and the associated at least two branch plot resource segments. Then, in response to a selection operation of any one of the target scenario resource segments in the scenario structure diagram, the target scenario resource segment is played. And finally, according to the interactive operation detected in the process of playing the target scenario resource segment, playing the branch scenario resource segment indicated by the interactive operation. According to the technical scheme, the plot trend relation between the target plot resource segment and the branch plot resource segment is displayed in the plot structure chart form on the plot backtracking interface, so that the structure of the whole plot can be simplified, a user can select the target plot resource segment to carry out interaction operation again, and other branch plot resource segments corresponding to the target plot resource segment are experienced.

Fig. 1 is a block diagram illustrating a multimedia resource-based interactive system 100 according to an embodiment of the present disclosure. The multimedia resource-based interactive system 100 includes: a terminal 110 and an interactive platform based on multimedia resources 120.

The terminal 110 is connected to the multimedia resource-based interactive platform 110 through a wireless network or a wired network. The terminal 110 may be at least one of a smartphone, a game console, a desktop computer, a tablet computer, an e-book reader, an MP3 player, an MP4 player, and a laptop portable computer. The terminal 110 is installed and operated with an application program supporting multimedia resource-based interaction. The application may be a game type, video type, audio type, etc. application. Illustratively, the terminal 110 is a terminal used by a user, and an application running in the terminal 110 has a user account logged therein.

The multimedia resource-based interactive platform 120 includes at least one of a server, a plurality of servers, a cloud computing platform, and a virtualization center. The multimedia asset based interactive platform 120 is used to provide background services for applications that support multimedia asset based interaction. Optionally, the interactive platform 120 based on multimedia resources undertakes primary interactive work, and the terminal 110 undertakes secondary interactive work; or, the multimedia resource-based interactive platform 120 undertakes the secondary interactive work, and the terminal 110 undertakes the primary interactive work; alternatively, the interactive platform 120 or the terminal 110 based on multimedia resources can respectively undertake the interactive work independently.

Optionally, the multimedia resource-based interaction platform 120 includes: an access server, an interactive server based on multimedia resources and a database. The access server is used for providing the terminal 110 with access service. The multimedia resource-based interaction server is used for providing background services related to the multimedia resource-based interaction. The number of the interactive servers based on the multimedia resources can be one or more. When there are multiple multimedia resource-based interactive servers, there are at least two multimedia resource-based interactive servers for providing different services, and/or there are at least two multimedia resource-based interactive servers for providing the same service, for example, providing the same service in a load balancing manner, which is not limited in the embodiments of the present application.

The terminal 110 may be generally referred to as one of a plurality of terminals, and the embodiment is only illustrated by the terminal 110.

Those skilled in the art will appreciate that the number of terminals described above may be greater or fewer. For example, the number of the terminal may be only one, or several tens or hundreds, or more, and in this case, the multimedia resource based interactive system further includes other terminals. The number of terminals and the type of the device are not limited in the embodiments of the present application.

Fig. 2 is a flowchart of an interaction method based on multimedia resources according to an embodiment of the present application, as shown in fig. 2. The electronic device may be provided as a terminal, and may also be provided as a server, which is described in this embodiment by taking the application to the terminal as an example. The interaction method based on the multimedia resources comprises the following steps:

201. the terminal responds to the received plot backtracking instruction and determines at least one target plot resource segment which is played in the multimedia resource, and at least two branch plot resource segments are associated with one target plot resource segment.

In the embodiment of the application, a user can trigger a plot backtracking instruction when the terminal plays any resource segment. The multimedia resources can be video resources, audio resources, picture resources and the like. The multimedia resource can be divided into a plurality of resource segments according to a plot structure, and one resource segment corresponds to one plot. The resource segments may include target scenario resource segments corresponding to the branching scenarios and branching scenario resource segments corresponding to the branching scenarios, and at least two branching scenario resource segments are associated with one target scenario resource segment. The terminal may determine at least one target scenario resource segment from the played at least one resource segment.

For example, scenario F is a divergent scenario, scenario a and scenario B are mutually exclusive branching scenarios, and scenario F is structurally associated with scenario a, scenario B. That is, the scenario may be developed in the direction of first scenario F and then scenario a, or in the direction of first scenario F and then scenario B, and once the scenario F is developed to scenario a, the scenario B will not be developed, otherwise, once the scenario F is developed to scenario B, the scenario a will not be developed. That is to say, the terminal may play the target scenario resource segment F corresponding to the scenario F first, and then play the branching scenario resource segment a corresponding to the scenario a, or play the target scenario resource segment F corresponding to the scenario F first, and then play the branching scenario resource segment B corresponding to the scenario B. In any case, the terminal may determine the played target scenario resource segment f.

In an alternative implementation manner, the terminal may determine the target scenario resource segment through the attribute information of the resource segment. Correspondingly, the step of the terminal determining at least one target scenario resource segment played in the multimedia resource may be: the terminal may obtain at least one attribute information corresponding to a resource segment that has been played in the multimedia resource. The terminal may determine at least one target scenario resource segment according to the obtained at least one attribute information. By the aid of the attribute information of the resource segments, the target plot resource segments corresponding to the divergent plots can be rapidly determined, time for determining the target plot resource segments is saved, and efficiency of subsequently displaying plot structure diagrams is improved.

For example, there are two fields of video and openvideo in the attribute information of a resource fragment. If the value of the openvideo field is at least two, the resource segment is a target scenario resource segment, the value of the video field indicates the resource identifier of the target scenario resource segment, and the value of the openvideo field is the resource identifiers of at least two branching scenario resource segments associated with the target resource segment; if the value of the openvideo field is one, the resource segment is a branching scenario resource segment, the value of the video field is a resource identifier of the branching scenario resource segment, the value of the openvideo field is a resource identifier corresponding to a next played resource segment after the resource segment is played, and the next played resource segment may be a target scenario resource segment or a branching scenario resource segment.

In an alternative implementation manner, the terminal may determine the target scenario resource segment according to the scenario chapters. Correspondingly, the steps can be as follows: the terminal may determine a scenario section to which the resource segment currently being played belongs, and one scenario section may include a plurality of resource segments in the multimedia resource. The terminal acquires at least one attribute information corresponding to the played resource segment in the plurality of resource segments included in the plot section, and determines at least one target plot resource segment. By determining at least one target scenario resource segment from the scenario chapters which are currently experienced, the range of the resource segments is reduced, the time for determining the at least one target scenario resource segment is saved, and the actual requirements of users are better met.

For example, a storyline structure of a multimedia asset may be divided into a plurality of storyline sections, each storyline section including a plurality of asset segments. After entering a scenario chapter, a user usually does not return to the previous scenario chapter to play again, but experiences a plurality of branch scenarios in the current scenario chapter. Therefore, the requirement of the user on plot backtracking can be met only by acquiring at least one target plot resource segment in the plot section to which the currently played resource segment belongs.

In an alternative implementation manner, the terminal may determine the target scenario resource segment according to the resource type in the attribute information. Correspondingly, the step of determining at least one target scenario resource segment played in the multimedia resource may be: the terminal may determine at least one target scenario resource segment from the played at least one resource segment according to the resource type in the at least one attribute information.

For example, the attribute information of the resource segment includes a type field, and by taking a value of the type field, it can be determined whether the resource segment is a target scenario resource segment or a branching scenario resource segment.

It should be noted that, if a segment scenario is not mutually exclusive with other scenarios and is not structurally associated with a plurality of branch scenarios, the scenario may be referred to as a general scenario, and the general scenario may be associated with a divergent scenario or a branch scenario. Correspondingly, the resource segments corresponding to the general scenario are general scenario resource segments. For example, if the scenario G is a general scenario, the scenario F is a divergent scenario, the scenario a and the scenario B are mutually exclusive branch scenarios, the scenario trends are first scenario G, then scenario F, then scenario a or scenario B, and the playing sequence of the resource segments is to play the general scenario resource segment G corresponding to the scenario G first, then play the target scenario resource segment F corresponding to the scenario F, and then play one of the branch scenario resource a and the branch scenario resource B associated with the target scenario resource segment F.

202. And the terminal displays a plot structure chart of the multimedia resources in the plot backtracking interface, wherein the plot structure chart is used for representing the plot trend relation between the at least one target plot resource segment and the associated at least two branch plot resource segments.

In the embodiment of the application, besides the mutual exclusion relationship, the resource segments may also have a sequence relationship and an association relationship, where the sequence relationship is used to represent the playing sequence of the resource segments, and the association relationship is used to represent the association between the target scenario resource segment and the branching scenario resource segment. Of course, the sequential relationship between resource segments can also be indirectly represented by an association relationship. And constructing a plot structure chart for representing the trend relation of the plots according to the incidence relation between the target plot resource segments and the branch plot resource segments, and displaying the plot structure chart on a plot backtracking interface. The display modes of the target scenario resource segments and the branch scenario resource segments may be in the forms of characters, pictures, dynamic diagrams, and the like, for example, the scenario thumbnails are displayed in the forms of rectangles, diamonds, circles, pentagons, or hexagons, and the embodiment of the present application does not limit this.

For example, if a scenario may be shown from scenario F to scenario a or B, and a scenario may be shown from scenario E to scenario C or D, then target scenario resource segment F is shown in the scenario structure diagram to be associated with branching scenario resource segment a and branching scenario resource segment B, respectively, and target scenario resource segment E is shown to be associated with branching scenario resource segment C and branching scenario resource segment D, respectively.

In an alternative implementation manner, the terminal may use the target scenario resource segment and the branch scenario resource segment as nodes of the scenario structure diagram to construct the scenario structure diagram. Correspondingly, the step of displaying the plot structure diagram of the multimedia resource may be: the terminal may regard the at least one target scenario resource segment and the at least two branching scenarios associated with the target resource segment as nodes of the scenario structure diagram. And for any target plot resource segment, constructing an edge between a node corresponding to the target plot resource segment and nodes corresponding to at least two branch plot resource segments associated with the target plot resource segment. And the terminal responds to that the playing sequence of any one of the branch scenario resource segments is adjacent to and relatively ahead of the playing sequence of any one of the target scenario resource segments, and a side is constructed between the branch scenario resource segment and the target scenario resource segment. And displaying the constructed plot structure diagram by the terminal. The target plot resource segments and the branch plot resource segments are displayed in a node mode, so that the plot structure display mode is simple and clear, and a user can clearly know the plot trend relation among the resource segments.

For example, referring to fig. 3, fig. 3 is a schematic diagram of a scenario backtracking interface provided according to an embodiment of the present application. The description is continued by taking an example that the target scenario resource segment f is associated with the branching scenario resource segment a and the branching scenario resource segment b respectively, and the target scenario resource segment e is associated with the branching scenario resource segment c and the branching scenario resource segment d respectively. In the plot structure diagram shown in fig. 3, a node 301 represents a target plot resource segment f, a node 302 represents a branching plot resource segment a, a node 303 represents a branching plot resource segment b, a node 304 represents a target plot resource segment e, a node 305 represents a branching plot resource segment c, and a node 306 represents a branching plot resource segment d, the node 301 is connected to the node 302 and the node 303 by edges, respectively, and the node 304 is connected to the node 305 and the node 306 by edges, respectively. In response to that the branching storyline resource segment a is adjacent to the target storyline resource segment e in the playing sequence, and the playing sequence of the branching storyline resource segment a is the target storyline resource segment e, that is, the target storyline resource segment e is played after the branching storyline resource segment a is played, in the storyline structure diagram, the node 302 is connected with the node 304 through an edge.

In an alternative implementation manner, the terminal may display the nodes in the plot structure diagram in different display states. Correspondingly, the step of displaying the plot structure diagram of the multimedia resource may be: for any node, in response to that the resource segment indicated by the node is a played resource segment, the terminal may display the node in a first state, where the first state is used to indicate that the node may be selected; in response to the resource segment indicated by the node not being played, the node is displayed in a second state, the second state indicating that the node may not be selected. Since the resource segment plays the scenario showing that the scenario corresponding to the resource segment is the experienced scenario, the nodes are displayed through different states, so that the user can clearly know which scenarios are the experienced scenarios and which scenarios are the unexperienced scenarios, and the user can conveniently return to the target scenario resource segment before the unexperienced scenarios to experience the unexperienced scenarios.

For example, since the target scenario resource segment is determined according to the played resource segment, the node representing the target scenario resource segment is displayed in a highlighted state, and the user can know that the scenario corresponding to the highlighted node is an experienced scenario. At least two branching scenario resource segments associated with the target scenario resource segment may not be played, or the at least two branching scenario resource segments are played, and other branching scenario resource segments are not played. Therefore, the nodes representing the played branch scenario resource segments may be displayed in a highlighted state, and the nodes representing the unplayed branch resource segments may be displayed in an unlocked state. Referring to fig. 4, fig. 4 is a schematic diagram of another scenario backtracking interface provided according to an embodiment of the present application. In fig. 4, the target scenario resource segment represented by the node 401 has been played, and the node 401 is displayed in a highlighted state. The branching scenario resource segments represented by the node 402, the node 403, the node 404 and the node 405 are associated with the target scenario resource segment represented by the node 401, wherein the branching scenario resource segment represented by the node 402 is played, and no other branching scenario resource segment is played, the node 402 is displayed in a highlighted state, and the node 403, the node 404 and the node 405 are displayed in an unlocked state. In response to the target scenario resource segment represented by the node 406 being played, the target scenario resource segment represented by the node 406 is played in an order adjacent to and behind the branch scenario resource segments represented by the above-mentioned node 402, node 403, node 404 and node 405, and then the node 406 is displayed in a highlighted state.

In an optional implementation manner, if the terminal acquires the target scenario resource segment according to the scenario section, the terminal may display the scenario structure diagram of the target scenario section. Correspondingly, after the terminal displays the plot structure diagram of the multimedia resource, the step of displaying the plot structure diagram of the target plot section may be: the terminal responds to the received switching instruction for switching the currently displayed plot chapters and determines the target plot chapters indicated by the switching instruction. And the terminal determines at least one played target plot resource segment according to at least one attribute information of the plurality of resource segments included in the target plot section. And displaying a target plot structure chart corresponding to the target plot section in the plot backtracking interface. The plot structure chart is displayed according to the plot chapters, so that the user can be concentrated in the plot structure in one plot chapter, and the situation that the user is distracted due to the fact that the plot structures of a plurality of plot chapters are displayed at the same time is avoided.

For example, the terminal may display a switching button for switching the scenario chapters on the scenario backtracking interface, and when the switching button is triggered, the target scenario chapters indicated by the switching instruction are determined. Referring to fig. 5, fig. 5 is a schematic view of a switch button provided according to an embodiment of the present application. In fig. 5, two kinds of switching buttons are exemplarily shown, a switching button 501 may switch between adjacent story chapters, and a switching button 502 may switch between arbitrary story chapters. Of course, other switching manners may also exist, and this is not limited in this embodiment of the application.

In an optional implementation manner, when the plot structure diagram is displayed according to the plot sections, the terminal may further obtain the section names of the plot sections and the plot titles of the at least one target plot resource segment, and display the section names and the plot titles on the plot backtracking interface. Of course, the terminal may also obtain a subtitle of the branching scenario resource segment, and display the subtitle on the scenario backtracking interface. The plot content of the plot node can be prompted to the user by displaying information such as chapter names, plot titles, subtitles and the like, so that the user can better clear the structure of the plot.

For example, the chapter name of the scenario chapter is "meet", the scenario title of the target scenario resource segment is "meet for the first time", and the subtitles of the plurality of branch scenario resource segments are "bar", "restaurant", "bus stop", and "cafe", respectively. When the terminal displays the plot structure diagram according to plot chapters, the node representing the target plot resource segment is displayed and the 'meeting for the first time' is displayed, when the node representing the branch plot resource segment is displayed, the 'bar', 'restaurant', 'bus platform' and 'coffee hall' are displayed at the corresponding position, and when the node representing the branch plot resource segment corresponding to the 'bar' is displayed in a highlight state, the user can know that the experienced plot is the meeting for the first time in the bar.

203. And the terminal responds to the selection operation of any target plot resource segment in the plot structure chart and plays the target plot resource segment.

In the embodiment of the application, a user can select any target plot resource segment in the plot structure diagram displayed on the plot backtracking interface. The terminal can close the plot backtracking interface and replay the target plot source segment according to the selection operation instruction of the target plot resource segment.

In an alternative implementation manner, the terminal may load the content supporting the interactive operation when playing the resource segment. Correspondingly, the step of playing the target scenario resource segment by the terminal may be: the terminal can obtain the target plot resource segment, respond to the display instruction of any plot problem and display the plot problem and at least two problem options corresponding to the plot problem in a floating mode on the target plot resource segment which is playing. By displaying the plot question and the question options, the user can perform interactive operation, so that the trend of the plot is determined.

For example, the terminal may process the target scenario resource segment, perform question pop-up countdown through a timer when starting to play the target scenario resource segment, pop-up a scenario question and a scenario option when the question pop-up countdown is finished, then start to perform question answering countdown, close the question when the question answering countdown is finished, and continue to play the target scenario resource segment. When the plot question and the plot option are popped up, the terminal can stop playing the target plot resource segment; the playing of the target scenario resource segment is not stopped, but the appropriate question popping time is selected by adjusting the time length of the question popping countdown, the appropriate question display time is selected by adjusting the time length of the question answering countdown, and the scenario question and question options are popped at the time that the user knows the scenario. Accordingly, as can be seen in fig. 6, fig. 6 is a schematic diagram of a loading problem and option provided according to an embodiment of the present application. In fig. 6, the target scenario resource segment is a video, which is divided into three parts, and for the second part of the video when displaying the questions and options, the second part of the video is a special video, such as reducing background music, or inserting voice-over. The elapsed time, which is exemplarily represented by the length of the rectangle in fig. 6, starts the problem pop-up countdown at the same time as the first portion of the video starts to be played. And when the popup countdown is finished, popping up the questions and options, starting to count down the answering questions, and displaying the questions and options while playing the second part of video. And when the countdown of the answer is finished, closing the question and the option and playing the third part of video.

In an optional implementation manner, after receiving the selection operation of any one of the target scenario resource segments, the terminal may further adjust a playing state of the played resource segment. Correspondingly, the steps can be as follows: the terminal can obtain the attribute information of the target scenario resource segment, determine at least one resource segment with the playing sequence behind the target scenario resource segment in the played resource segments according to the attribute information, and set the playing state in the attribute information of the at least one resource segment as not played. By setting the played resource segment behind the currently played target resource segment as not played, on one hand, the situation that mutually exclusive scenarios are all in a played state and the scenario logic is not met can be avoided, and on the other hand, the user can not be influenced by other branch scenarios when experiencing the scenario again.

For example, the attribute information of the resource segment includes a sequence field for indicating the playing sequence of the resource segment, and for any target scenario resource segment, at least one resource segment with the playing sequence after the resource segment in the played resource segment can be determined according to the sequence field. The attribute information of the resource segment may also include at least one resource identifier corresponding to a next resource segment of the resource segment, the at least one resource identifier is acquired, if the resource segment corresponding to any resource identifier is in a played state, the playing state of the resource segment is set to be not played, then the at least one resource identifier is acquired according to the attribute information of the resource segment, and the playing state of the played resource segment is sequentially set to be not played until the playing states of the resource segments corresponding to the acquired at least one resource identifier are all not played.

204. And the terminal plays the branch scenario resource segments indicated by the interactive operation according to the interactive operation detected in the process of playing the target scenario resource segments.

In the embodiment of the application, the interactive operation detected by the terminal can directly influence the trend of the plot and can also indirectly influence the trend of the plot, so that the played branch plot resource segments are influenced.

In an optional implementation manner, when the interactive operation directly affects the trend of the scenario, the step of the terminal playing the branch scenario resource segment indicated by the interactive operation may be: and the terminal responds to the detection of the interactive operation in the process of playing the target plot resource segment and determines the problem option triggered by the interactive operation. And the terminal determines the branching scenario resource segment indicated by the question option, and plays the branching scenario resource segment in response to the completion of the playing of the target scenario resource segment. The problem options triggered by the interactive operation of the user can directly influence the trend of the scenario, so that the user can clearly determine the branch scenario which can enter next according to the problem options.

For example: the scenario problem is 'please select an appointment place', the problem options are 'bar' and 'coffee hall', the user selects the 'bar' to enter the branch scenario corresponding to the 'bar', the user selects the 'coffee hall' to enter the branch scenario corresponding to the 'coffee hall', and the branch scenario resource segment corresponding to the branch scenario is played.

In an optional implementation manner, when the interactive operation does not directly affect the trend of the scenario, the step of the terminal playing the branch scenario resource segment indicated by the interactive operation may be: and the terminal responds to the detection of the interactive operation in the process of playing the target plot resource segment and determines the problem option triggered by the interactive operation. And the terminal accumulates the target score corresponding to the question option into a target score total value corresponding to the user account, and determines the branching scenario resource segment according to the target score total value. And the terminal responds to the completion of the playing of the first resource segment and plays the branching scenario resource segment. Because the interactive operation of the user does not directly influence the trend of the plot, but a plurality of interactive operations influence the trend of the plot together, the degree of influence of each interactive operation on the trend of the plot is reflected in the form of scores, the association between the plots and the complexity of the game are improved, and the game experience of the user is enhanced.

For example, the storyline question is "is a person who has suffered a fall, is he to be helped? "question options are" help "and" not help ", different options may increase or decrease the goodness value of the virtual character in the game, which affects the plot trend. However, for a virtual character with low goodness, even if the preference improves the goodness of the virtual character, the branch scenario related to the virtual character cannot be entered; for the virtual character with high goodness, even if the option does not improve the goodness of the virtual character, the branch scenario related to the virtual character is entered.

In an optional implementation manner, the terminal further provides a scenario archiving interface for archiving. And the terminal responds to the received scenario archiving instruction and displays a scenario archiving interface, and the scenario archiving interface comprises at least one manual archiving sub-interface. And the terminal responds to the detection of the triggering operation of any manual archiving sub-interface and displays the manual archiving sub-interface. And the terminal responds to the trigger operation of the storage button included in the manual file saving sub-interface and stores at least one resource identifier corresponding to the played resource segment. Through providing at least one manual filing sub-interface, a user can store the game progress when needed, and a plurality of manual filing sub-interfaces can store a plurality of game files, and the game files are not interfered with each other, so that the user can experience a plurality of branch scenarios simultaneously.

Optionally, the scenario archiving interface further includes an automatic archiving sub-interface, and the automatic archiving sub-interface is configured to display at least one scenario structure diagram stored when the target condition is met. The target condition may be one of detection of a selection operation, playing of a new resource segment, ending of a scenario chapter, and an interval target duration. By setting the automatic archiving sub-interface, the situation that the user loses the game progress due to forgetting archiving is avoided, and the game experience of the user is improved.

For example, referring to fig. 7, fig. 7 is a schematic diagram of a scenario archiving interface provided according to an embodiment of the present application. In fig. 7, the scenario archiving interface includes an automatic archiving sub-interface and four manual archiving sub-interfaces, namely, an automatic archiving sub-interface, a manual one, a manual two, a manual three, and a manual four, which are displayed by default. The user may switch the currently displayed sub-interface by clicking on a different tab. Fig. 8 is a schematic diagram of a manual archiving sub-interface provided according to an embodiment of the present application, and referring to fig. 8, the manual archiving sub-interface includes a storage button 801, and when the content displayed on the manual archiving sub-interface is empty, it indicates that the game progress has not been stored yet. When the game progress is stored, the plot structure diagram is displayed in the display area 802 according to the display mode of the plot backtracking interface. After detecting the triggering operation of the user on the storage button 801, the terminal may convert at least one resource identifier corresponding to the played resource segment into a JSON (JSON object notation) character string, where a key of the JSON character string is a manual archive identifier corresponding to the manual archive sub-interface, and a value of the JSON character string is the at least one resource identifier. The terminal can store the JSON character string in a local storage, and can also upload the JSON character string to a server for storage. When the terminal or the server stores the JSON character string, if the JSON character string comprising the same key is detected to exist, the covering storage is carried out. Correspondingly, as shown in fig. 9, when the terminal detects that the storage button of the manual archive sub-interface is triggered, the terminal determines a manual archive identifier, the terminal sends a JSON character string to the server, the server receives the JSON character string, and the server stores the JSON character string through the manual archive identifier. And if the terminal detects that the manual archiving operation is read, the terminal judges whether the target condition of automatic archiving is met, and the terminal covers the automatic archiving when the target condition is met.

It should be noted that, because the automatic archiving sub-interface and the at least one manual archiving sub-interface are described above, the scenario structure diagram may also be displayed in a manner of a scenario backtracking interface, where the scenario structure diagram includes a node representing a target scenario resource segment that has been played in the game progress and represents at least two branching scenario resource segments associated with the target scenario resource segment, and specific implementation steps may refer to the foregoing step 201 to step 204, which are not described herein again. Since the user can click the nodes in the automatic archiving sub-interface and the at least one manual archiving sub-interface to backtrack the scenario and experience different branch scenarios, the automatic archiving sub-interface and the at least one manual archiving sub-interface can also be used as scenario backtracking interfaces. For example, the user may enter the scenario archive interface, i.e., the scenario trace interface, through "my recall" in the game main interface or "save" in the play interface.

It should be noted that, in the scenario section corresponding to the ending scenario, since there is no branch in the ending scenario, there is only a sequential relationship between resource segments corresponding to the ending scenario. Accordingly, each resource segment may be represented by sequentially connected nodes in the plot structure diagram. Moreover, the interactive game can set a plurality of endings, and the endings are mutually exclusive absolutely, that is, when the node of the resource segment corresponding to the ending scenario of one ending is displayed, the node of the resource segment corresponding to the ending scenario of other ending is not displayed.

For example, referring to fig. 10, fig. 10 is a schematic diagram of another scenario backtracking interface provided according to an embodiment of the present application. In fig. 10, a node 1001, a node 1002, a node 1003, and a node 1004 are shown for identifying four resource segments corresponding to an ending scenario of a certain ending, where the node 1001 is connected to the node 1002, the node 1002 is connected to the node 1003, and the node 1003 is connected to the node 1004 according to a context between scenarios, that is, a play order of the resource segments.

It should be noted that, the foregoing steps 201 to 204 are optional implementations of the multimedia resource-based interaction method provided in the embodiment of the present application. Accordingly, there are other implementations: since the scenario structure does not change with the development of the scenario, the terminal may store a structure diagram formed by nodes representing all resource segments according to the scenario structure, where the structure diagram may be in the form of a tree diagram, and when the terminal receives the scenario backtracking instruction, the terminal may display the nodes representing the played resource segments in a highlighted state in the structure diagram.

Fig. 11 is a block diagram of an interactive device based on multimedia resources according to an embodiment of the present application. The apparatus is used for executing the steps executed by the above-mentioned interactive method based on multimedia resources, referring to fig. 11, and the apparatus includes: a determination module 1101, a display module 1102, and a playback module 1103.

A determining module 1101, configured to determine, in response to receiving a scenario backtracking instruction, at least one target scenario resource segment that has been played in a multimedia resource, where one target scenario resource segment is associated with at least two branching scenario resource segments;

the system comprises a display module 1102 and a control module, wherein the display module is used for displaying a plot structure diagram of multimedia resources in a plot backtracking interface, and the plot structure diagram is used for representing a plot trend relation between at least one target plot resource segment and at least two associated branch plot resource segments;

a playing module 1103, configured to play the target scenario resource segment in response to a selection operation on any target scenario resource segment in the scenario structure diagram;

the playing module 1103 is further configured to play the branch scenario resource segment indicated by the interactive operation according to the interactive operation detected in the process of playing the target scenario resource segment.

In an optional implementation manner, the determining module 1101 is further configured to obtain at least one attribute information corresponding to a resource segment that has been played in a multimedia resource; and determining at least one target plot resource segment according to the at least one attribute information.

In an optional implementation manner, the determining module 1101 is further configured to determine a scenario section to which the resource segment currently being played belongs; and determining at least one target plot resource segment according to at least one attribute information corresponding to the played resource segment in the plurality of resource segments included in the plot section.

In an alternative implementation manner, the display module 1102 is further configured to use at least one target scenario resource segment and at least two branching scenarios associated with the target resource segment as nodes of the scenario structure diagram; for any target plot resource segment, constructing an edge between a node corresponding to the target plot resource segment and nodes corresponding to at least two branch plot resource segments associated with the target plot resource segment; responding to the adjacent and relatively forward playing sequence of any one of the branch scenario resource segments and any one of the target scenario resource segments, and constructing an edge between the branch scenario resource segment and the target scenario resource segment; and displaying the obtained plot structure diagram.

In an optional implementation manner, the determining module 1101 is further configured to determine, in response to receiving a switching instruction for switching a currently displayed scenario chapter, a target scenario chapter indicated by the switching instruction;

the determining module 1101 is further configured to determine at least one played target scenario resource segment according to at least one attribute information of a plurality of resource segments included in the target scenario section;

the display module 1102 is further configured to display a target scenario structure diagram corresponding to the target scenario chapter in the scenario backtracking interface.

In an optional implementation, the apparatus further comprises:

the acquisition module is used for acquiring chapter names of the plot chapters and plot titles of at least one target plot resource segment;

the display module 1102 is further configured to display the chapter name and the scenario title.

In an optional implementation manner, the playing module 1103 is further configured to obtain a target scenario resource segment; and in response to receiving a display instruction of any scenario problem, displaying the scenario problem and at least two problem options corresponding to the scenario problem in a suspension manner on the target scenario resource segment which is playing.

In an optional implementation manner, the playing module 1103 is further configured to determine, in response to detecting an interactive operation in the process of playing the target scenario resource segment, a question option triggered by the interactive operation; determining a branch scenario resource segment indicated by the question option; and responding to the completion of the playing of the target scenario resource segment, and playing the branch scenario resource segment.

In an optional implementation manner, the playing module 1103 is further configured to determine, in response to detecting an interactive operation in the process of playing the target scenario resource segment, a question option triggered by the interactive operation; accumulating the target scores corresponding to the question options into a target score total value corresponding to the user account; determining the branching scenario resource segments according to the total value of the target scores; and responding to the completion of the playing of the first resource segment, and playing the branching scenario resource segment.

In an optional implementation, the apparatus further comprises:

the display module 1102 is further configured to display a scenario archiving interface in response to receiving the scenario archiving instruction, where the scenario archiving interface includes at least one manual archiving sub-interface;

the display module 1102 is further configured to display the manual archiving sub-interface in response to detecting a trigger operation of any manual archiving sub-interface;

and the storage module is used for responding to the trigger operation of detecting a storage button included in the manual archive storage sub-interface and storing at least one node identifier corresponding to the played resource segment.

In an optional implementation manner, the scenario archiving interface further includes an automatic archiving sub-interface, and the automatic archiving sub-interface is used for displaying the scenario structure diagram stored when the target condition is met; the target condition is one of detection of a selection operation, playing of a new resource segment, ending of a plot chapter, and an interval target duration.

It should be noted that: in the above embodiment, when the interactive device based on multimedia resources runs an application program, only the division of the functional modules is used for illustration, and in practical applications, the function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the interaction device based on multimedia resources provided by the above embodiments and the interaction method based on multimedia resources provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in detail in the method embodiments and are not described herein again.

In the embodiment of the present application, the electronic device may be provided as a terminal or a server, and when the electronic device is provided as a terminal, the terminal may implement the operation performed by the multimedia resource-based interaction method; when the system is provided as a server, the server can realize the operation executed by the interaction method based on the multimedia resources, the server can receive a plot backtracking instruction sent by the terminal, the server generates a plot backtracking interface based on the interaction platform based on the multimedia resources, and the plot backtracking interface is returned to the terminal; the operations performed by the above-mentioned multimedia resource-based interactive method can also be realized by the interaction between the server and the terminal.

The electronic device may be provided as a terminal, and fig. 12 is a block diagram of a terminal 1200 provided according to an embodiment of the present application. Fig. 12 is a block diagram illustrating a terminal 1200 according to an exemplary embodiment of the present invention. The terminal 1200 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group audio Layer III, motion Picture Experts compression standard audio Layer 3), an MP4 player (Moving Picture Experts Group audio Layer IV, motion Picture Experts compression standard audio Layer 4), a notebook computer, or a desktop computer. Terminal 1200 may also be referred to by other names such as user equipment, portable terminal, laptop terminal, desktop terminal, and so forth.

In general, terminal 1200 includes: a processor 1201 and a memory 1202.

The processor 1201 may include one or more processing cores, such as a 4-core processor, an 8-core processor, or the like. The processor 1201 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 1201 may also include a main processor and a coprocessor, where the main processor is a processor for processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 1201 may be integrated with a GPU (Graphics Processing Unit) that is responsible for rendering and drawing content that the display screen needs to display. In some embodiments, the processor 1201 may further include an AI (Artificial Intelligence) processor for processing a computing operation related to machine learning.

Memory 1202 may include one or more computer-readable storage media, which may be non-transitory. Memory 1202 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in the memory 1202 is used to store at least one instruction for execution by the processor 1201 to implement the multimedia asset based interaction method provided by the method embodiments herein.

In some embodiments, the terminal 1200 may further optionally include: a peripheral interface 1203 and at least one peripheral. The processor 1201, memory 1202, and peripheral interface 1203 may be connected by a bus or signal line. Various peripheral devices may be connected to peripheral interface 1203 via a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 1204, display 1205, camera assembly 1206, audio circuitry 1207, positioning assembly 1208, and power supply 1209.

The peripheral interface 1203 may be used to connect at least one peripheral associated with I/O (Input/Output) to the processor 1201 and the memory 1202. In some embodiments, the processor 1201, memory 1202, and peripheral interface 1203 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1201, the memory 1202 and the peripheral device interface 1203 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

The Radio Frequency circuit 1204 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuit 1204 communicates with a communication network and other communication devices by electromagnetic signals. The radio frequency circuit 1204 converts an electric signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electric signal. Optionally, the radio frequency circuit 1204 comprises: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuit 1204 may communicate with other terminals through at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the rf circuit 1204 may further include NFC (Near Field Communication) related circuits, which are not limited in this application.

The display screen 1205 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 1205 is a touch display screen, the display screen 1205 also has the ability to acquire touch signals on or over the surface of the display screen 1205. The touch signal may be input to the processor 1201 as a control signal for processing. At this point, the display 1205 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display 1205 may be one, providing the front panel of the terminal 1200; in other embodiments, the display 1205 can be at least two, respectively disposed on different surfaces of the terminal 1200 or in a folded design; in still other embodiments, the display 1205 may be a flexible display disposed on a curved surface or on a folded surface of the terminal 1200. Even further, the display screen 1205 may be arranged in a non-rectangular irregular figure, i.e., a shaped screen. The Display panel 1205 can be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), or other materials.

Camera assembly 1206 is used to capture images or video. Optionally, camera assembly 1206 includes a front camera and a rear camera. Generally, a front camera is disposed at a front panel of the terminal, and a rear camera is disposed at a rear surface of the terminal. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 1206 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.

The audio circuitry 1207 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals into the processor 1201 for processing or inputting the electric signals into the radio frequency circuit 1204 to achieve voice communication. For stereo capture or noise reduction purposes, multiple microphones may be provided at different locations of terminal 1200. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 1201 or the radio frequency circuit 1204 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, the audio circuitry 1207 may also include a headphone jack.

The positioning component 1208 is used to locate a current geographic location of the terminal 1200 to implement navigation or LBS (location based Service). The positioning component 1208 may be a positioning component based on the GPS (global positioning System) in the united states, the beidou System in china, the graves System in russia, or the galileo System in the european union.

The power supply 1209 is used to provide power to various components within the terminal 1200. The power source 1209 may be alternating current, direct current, disposable or rechargeable. When the power source 1209 includes a rechargeable battery, the rechargeable battery may support wired or wireless charging. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, terminal 1200 also includes one or more sensors 1210. The one or more sensors 1210 include, but are not limited to: acceleration sensor 1211, gyro sensor 1212, pressure sensor 1213, fingerprint sensor 1214, optical sensor 1215, and proximity sensor 1216.

The acceleration sensor 1211 can detect magnitudes of accelerations on three coordinate axes of the coordinate system established with the terminal 1200. For example, the acceleration sensor 1211 may be used to detect components of the gravitational acceleration in three coordinate axes. The processor 1201 may control the display screen 1205 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 1211. The acceleration sensor 1211 may also be used for acquisition of motion data of a game or a user.

The gyro sensor 1212 may detect a body direction and a rotation angle of the terminal 1200, and the gyro sensor 1212 may collect a 3D motion of the user on the terminal 1200 in cooperation with the acceleration sensor 1211. The processor 1201 can implement the following functions according to the data collected by the gyro sensor 1212: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.

Pressure sensors 1213 may be disposed on the side frames of terminal 1200 and/or underlying display 1205. When the pressure sensor 1213 is disposed on the side frame of the terminal 1200, the user's holding signal of the terminal 1200 can be detected, and the processor 1201 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 1213. When the pressure sensor 1213 is disposed at a lower layer of the display screen 1205, the processor 1201 controls the operability control on the UI interface according to the pressure operation of the user on the display screen 1205. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.

The fingerprint sensor 1214 is used for collecting a fingerprint of the user, and the processor 1201 identifies the user according to the fingerprint collected by the fingerprint sensor 1214, or the fingerprint sensor 1214 identifies the user according to the collected fingerprint. When the user identity is identified as a trusted identity, the processor 1201 authorizes the user to perform relevant sensitive operations, including unlocking a screen, viewing encrypted information, downloading software, paying, changing settings, and the like. The fingerprint sensor 1214 may be provided on the front, back, or side of the terminal 1200. When a physical button or vendor Logo is provided on the terminal 1200, the fingerprint sensor 1214 may be integrated with the physical button or vendor Logo.

The optical sensor 1215 is used to collect the ambient light intensity. In one embodiment, the processor 1201 may control the display brightness of the display 1205 according to the ambient light intensity collected by the optical sensor 1215. Specifically, when the ambient light intensity is high, the display luminance of the display panel 1205 is increased; when the ambient light intensity is low, the display brightness of the display panel 1205 is turned down. In another embodiment, processor 1201 may also dynamically adjust the camera head 1206 shooting parameters based on the ambient light intensity collected by optical sensor 1215.

A proximity sensor 1216, also known as a distance sensor, is typically disposed on the front panel of the terminal 1200. The proximity sensor 1216 is used to collect a distance between the user and the front surface of the terminal 1200. In one embodiment, when the proximity sensor 1216 detects that the distance between the user and the front surface of the terminal 1200 gradually decreases, the processor 1201 controls the display 1205 to switch from the bright screen state to the dark screen state; when the proximity sensor 1216 detects that the distance between the user and the front surface of the terminal 1200 gradually becomes larger, the processor 1201 controls the display 1205 to switch from the breath-screen state to the bright-screen state.

Those skilled in the art will appreciate that the configuration shown in fig. 12 is not intended to be limiting of terminal 1200 and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components may be used.

The electronic device may be provided as a server, and fig. 13 is a schematic structural diagram of a server according to an embodiment of the present application, where the server 1300 may generate a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 1301 and one or more memories 1302, where the memory 1302 stores at least one instruction, and the at least one instruction is loaded and executed by the processor 1301 to implement the semantic matching method provided by each method embodiment. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input/output interface, so as to perform input/output, and the server may also include other components for implementing the functions of the device, which are not described herein again.

The embodiment of the present application also provides a computer-readable storage medium, which is applied to an electronic device, and the computer-readable storage medium stores at least one program code, where the at least one program code is used for being executed by a processor and implementing the operations performed by the electronic device in the multimedia resource based interaction method in the embodiment of the present application.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only exemplary of the present application and should not be taken as limiting, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. An interactive method based on multimedia resources, the method comprising:

2. The method of claim 1, wherein the determining at least one target storyline resource segment that has been played in the multimedia resource comprises:

acquiring at least one attribute information corresponding to a resource segment played in a multimedia resource;

and determining at least one target plot resource segment according to the at least one attribute information.

3. The method of claim 2, wherein the determining at least one target storyline resource segment that has been played in the multimedia resource comprises:

determining a plot section to which a resource segment currently being played belongs;

and determining at least one target plot resource segment according to at least one attribute information corresponding to the played resource segment in the plurality of resource segments included in the plot section.

4. The method of claim 1, wherein said displaying a plot structure of said multimedia asset comprises:

taking the at least one target plot resource segment and at least two branch plots associated with the target resource segment as nodes of the plot structure diagram;

for any target plot resource segment, constructing an edge between a node corresponding to the target plot resource segment and nodes corresponding to at least two branch plot resource segments associated with the target plot resource segment;

responding to the adjacent and relatively advanced playing sequence of any branch scenario resource segment and any target scenario resource segment, and constructing an edge between the branch scenario resource segment and the target scenario resource segment;

and displaying the obtained plot structure diagram.

5. The method of claim 3, wherein after displaying the plot structure of the multimedia asset, the method further comprises:

in response to receiving a switching instruction for switching a currently displayed scenario chapter, determining a target scenario chapter indicated by the switching instruction;

determining at least one played target plot resource segment according to at least one attribute information of a plurality of resource segments included in the target plot section;

and displaying a target plot structure chart corresponding to the target plot sections in the plot backtracking interface.

6. The method of claim 3, wherein after displaying the plot structure of the multimedia asset, the method further comprises:

acquiring chapter names of the plot chapters and a plot title of the at least one target plot resource segment;

and displaying the chapter name and the plot title.

7. The method of claim 1, wherein the playing the target storyline resource segment comprises:

acquiring the target plot resource segments;

and in response to receiving a display instruction of any scenario problem, displaying the scenario problem and at least two problem options corresponding to the scenario problem in a suspension manner on the target scenario resource segment which is being played.

8. The method according to claim 7, wherein playing the branching scenario resource segment indicated by the interactive operation according to the interactive operation detected during playing the target scenario resource segment comprises:

responding to the detection of interactive operation in the process of playing the target plot resource segment, and determining a problem option triggered by the interactive operation;

determining a branching scenario resource segment indicated by the question option;

and responding to the completion of the playing of the target scenario resource segment, and playing the branch scenario resource segment.

9. The method according to claim 7, wherein playing the branching scenario resource segment indicated by the interactive operation according to the interactive operation detected during playing the target scenario resource segment comprises:

accumulating the target scores corresponding to the question options into a target score total value corresponding to a user account;

determining the branching scenario resource segments according to the target score total value;

and responding to the completion of the playing of the first resource segment, and playing the branching scenario resource segment.

10. The method of claim 1, wherein prior to receiving a plot backtracking instruction, the method further comprises:

in response to receiving a scenario archiving instruction, displaying a scenario archiving interface, wherein the scenario archiving interface comprises at least one manual archiving sub-interface;

in response to detecting the triggering operation of any manual archiving sub-interface, displaying the manual archiving sub-interface;

and responding to the trigger operation of detecting a storage button included in the manual archiving sub-interface, and storing at least one resource identifier corresponding to the played resource segment.

11. The method of claim 10, wherein the storyline archive interface further comprises an auto-archive sub-interface for displaying the storyline structure graph stored when a target condition is satisfied; the target condition is one of detection of selection operation, playing of a new resource segment, ending of a plot chapter and interval target duration.

12. A plot backtracking apparatus, the apparatus comprising:

13. The method according to claim 12, wherein the determining module is further configured to obtain at least one attribute information corresponding to a resource segment that has been played in the multimedia resource; and determining at least one target plot resource segment according to the at least one attribute information.

14. An electronic device, comprising a processor and a memory, wherein the memory is configured to store at least one program code, and the at least one program code is loaded by the processor and executed to perform the method of multimedia asset based interaction according to any of claims 1-11.

15. A storage medium for storing at least one program code for executing the method of multimedia asset based interaction according to any of claims 1 to 11.