CN113157236A

CN113157236A - Data processing method and device, electronic equipment and computer storage medium

Info

Publication number: CN113157236A
Application number: CN202010075733.7A
Authority: CN
Inventors: 房秀强; 章兢; 徐昊; 陈翌; 朱艺; 曾欢; 陈龚
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2020-01-22
Filing date: 2020-01-22
Publication date: 2021-07-23

Abstract

The embodiment of the invention provides a data processing method, a data processing device, electronic equipment and a computer storage medium, wherein the data processing method is applied to the process of playing interactive media contents, and comprises the following steps: receiving voice interaction information input by a user according to the interaction prompt; determining an interaction heat index of the user for a target object in the interaction media according to the voice interaction information; and playing the interactive media content matched with the interactive heat index according to the interactive heat index. By the embodiment of the invention, the user can better participate in the interaction with the interactive media.

Description

Data processing method and device, electronic equipment and computer storage medium

Technical Field

The embodiment of the invention relates to the technical field of computers, in particular to a data processing method and device, electronic equipment and a computer storage medium.

Background

With the development of computer technology, platforms and applications that can interact with users are being widely used, such as instant messaging interaction, live broadcast interaction, and the like. More and more new media types that can interact with users, such as interactive video, are increasingly used in the day.

Taking an interactive video as an example, the interactive video is a brand new video type aiming at bringing richer impression experience to watching users by enhancing somatosensory feedback, plot reference, content exploration and other modes. The current interactive video adopts a mode that a plurality of preset options are displayed in the video playing process, a user manually clicks and selects one option, and then the video corresponding to the clicked option is played. However, this method requires manual operation of the user, and has complex interaction operation, high interaction cost, and large operation burden for the user. Similar problems exist with other types of interactive media.

Disclosure of Invention

Embodiments of the present invention provide a data processing scheme to at least partially solve the above problems.

According to a first aspect of the embodiments of the present invention, there is provided a data processing method applied in a process of playing interactive media content, the method including: receiving voice interaction information input by a user according to the interaction prompt; determining an interaction heat index of the user for a target object in the interaction media according to the voice interaction information; and playing the interactive media content matched with the interactive heat index according to the interactive heat index.

According to a second aspect of the embodiments of the present invention, there is provided a data processing apparatus, for use in playing interactive media content, the apparatus comprising: the trigger module is used for receiving voice interaction information input by a user according to the interaction prompt; the determining module is used for determining the interaction heat index of the user for the target object in the interaction media according to the voice interaction information; and the playing module is used for playing the interactive media content matched with the interactive heat index according to the interactive heat index.

According to a third aspect of embodiments of the present invention, there is provided an electronic apparatus, including: the display equipment is used for displaying the content of the played interactive media and prompting the user to carry out interactive prompt of voice interactive operation in the playing process of the interactive media; the voice input equipment is used for receiving voice interaction information input by the user according to the interaction prompt; the processor is used for determining the interaction heat index of the user for the target object in the interaction media according to the voice interaction information; determining interactive media content matched with the interactive heat index; and playing the determined interactive media content through the display device. .

According to a fourth aspect of embodiments of the present invention, there is provided a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the data processing method according to the first aspect.

According to the data processing scheme provided by the embodiment of the invention, in the playing process of the interactive media, a user can perform voice interaction operation with the interactive media according to the interaction prompt, and input voice interaction information to interact with a target object in the interactive media, so that the interaction heat (represented by the interaction heat index) between the user and the target object is determined, and further, the interactive media branch which is more in line with the preference or requirement of the user can be determined according to the interaction heat, and the interactive media content of the interactive media branch is played. Therefore, when a user watches the interactive media, on one hand, the user interacts with the interactive media through voice interactive operation to participate in determining the plot trend of the interactive media; on the other hand, the more voice interaction information input by the user based on voice interaction operation, the higher the interaction heat with the target object in the interactive media is, so that the determined interactive media content is more in line with the preference and the requirement of the user; on the other hand, the user does not need manual operation, hands of the user are released, the interactive operation process is simplified, the interactive cost is reduced, and the operation burden of the user is relieved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the embodiments of the present invention, and it is also possible for a person skilled in the art to obtain other drawings based on the drawings.

FIG. 1A is a flowchart illustrating steps of a data processing method according to an embodiment of the present invention;

FIG. 1B is a diagram illustrating a usage scenario in the embodiment of FIG. 1A;

FIG. 2A is a flowchart illustrating steps of a data processing method according to a second embodiment of the present invention;

FIG. 2B is a diagram illustrating a voice recognition event setup in an interactive medium in the data processing method shown in FIG. 2A;

FIG. 2C is a schematic diagram of an interactive interface of an interactive medium according to the embodiment shown in FIG. 2A;

FIG. 3A is a flowchart illustrating steps of a data processing method according to a third embodiment of the present invention;

FIG. 3B is a diagram illustrating a usage scenario in the embodiment shown in FIG. 3A;

fig. 4 is a block diagram of a data processing apparatus according to a fourth embodiment of the present invention;

fig. 5 is a block diagram of a data processing apparatus according to a fifth embodiment of the present invention;

fig. 6 is a schematic structural diagram of an electronic device according to a sixth embodiment of the present invention.

Detailed Description

In order to make those skilled in the art better understand the technical solutions in the embodiments of the present invention, the technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments. All other embodiments obtained by a person skilled in the art based on the embodiments of the present invention shall fall within the scope of the protection of the embodiments of the present invention.

The following further describes specific implementation of the embodiments of the present invention with reference to the drawings.

Example one

Referring to fig. 1A and 1B, fig. 1A is a flowchart illustrating steps of a data processing method according to a first embodiment of the present invention, and fig. 1B is a scene diagram illustrating steps of a data processing method according to a first embodiment of the present invention.

The data processing method of the embodiment is applied to the process of playing interactive media content, and comprises the following steps:

step S102: and receiving voice interaction information input by a user according to the interaction prompt.

In this embodiment, during the playing process of the interactive media, there may be at least one voice interactive operation, and each interactive operation corresponds to a corresponding interactive prompt to prompt the user to interact with the interactive media.

In one possible approach, the voice interaction operation may be triggered by an event. The event may be an operation that can be recognized by the control, and in the embodiment of the present invention, at least one voice recognition event may be preset in the interactive medium. The voice recognition event in the interactive media is used for indicating the voice recognition operation which can be recognized by the media playing control at a certain time point in a section of the interactive media. The voice recognition event may comprise one or more pieces, which are preset in the interactive medium by a person skilled in the art and are triggered when the time point is reached. Of course, the triggering of the speech recognition event may also be triggered by other suitable means, such as a certain video frame, or a certain phrase, or by detecting a set content in the video content or the audio content corresponding to the video of the interactive media, and so on.

The interaction prompt corresponding to the triggered voice interaction operation may be in a suitable manner, including but not limited to a user interface UI manner. But not limited thereto, other methods, such as text prompt message, voice prompt message, or image prompt message, are also applicable. Of course, the traditional option button prompting mode is also applicable, but the manual operation of the user is not needed any more, and the voice can be input according to the prompt.

In the embodiments of the present invention, the numbers "plural", and the like in relation to "plural" mean two or more unless otherwise specified.

Step S104: and determining the interactive heat index of the user to the target object in the interactive media according to the voice interactive information.

The interactive heat index may indicate a user's preference or interest level in the target object in the interactive media, which is a global index. In one possible approach, a global value may be set, such as a privacy value or a goodness value, etc. In a specific configuration, the interactive heat index may be a fixed value, for example, each time the interactive heat index is interacted with, the interactive heat index is increased by 5 heat points. The interactive heat index may also be a plurality of gradient values, for example, the interactive heat index is increased by 1 heat point for the first time, 2 points for the second time, 3 points for the third time, and so on. The interactive heat index may also be a numerical range, such as within a range of 1-10, and increases according to the number of interactions with a certain step length, for example, with the step length being 2, the first interaction is performed, and the interactive heat index is 1; for the second time of interaction, the interaction heat index is 3 because the step length is 2; and the third time of interaction, wherein the interaction heat index is 5 according to the step length, and so on. It will be appreciated by those skilled in the art that the various approaches described above are exemplary and that in practice, other approaches are equally applicable.

When the interactive heat index is determined according to the voice interactive information, the interactive heat index of the user on the target object in the interactive media can be determined by performing audio content detection or text content detection on the voice interactive information input by the user (audio data of the voice interactive information needs to be converted into text data) to determine whether the voice interactive information contains preset interactive key information.

In one case, the user performs voice input for voice interaction operation, generates voice interaction information, and if the content of the voice interaction information includes interaction key information, the content of the voice interaction information may correspond to a preset interaction heat index.

In another case, the user performs voice input for the voice interaction operation, and generates voice interaction information, but the content of the voice interaction information does not include the interaction key information, and the corresponding interaction heat index may be 0.

In another case, the user does not perform voice input for the voice interaction operation, and does not generate the voice interaction information, that is, if the voice interaction information is null, the corresponding interaction heat index is also 0.

Of course, if the voice interaction information content includes the interaction key information, a higher interaction heat index is corresponding to the voice interaction information content, and if the voice interaction information content does not include the interaction key information, a lower interaction heat index is corresponding to the voice interaction information content, and if the voice interaction information content is null, the interaction heat index is 0.

Step S106: and playing the interactive media content matched with the interactive heat index according to the interactive heat index.

After the interactive heat index of the user to the target object in the interactive media is determined, the matched interactive media content can be determined according to the index, and then the interactive media content is played. In practical application, a plurality of threshold ranges can be set for the interactive heat index, each threshold range corresponds to the interactive media content in one interactive media branch, and the corresponding interactive media content is determined according to the threshold range in which the interactive heat index falls. But not limited to, a discrete index threshold may be set, and if the interactive heat index is consistent with a certain index threshold, the interactive media content corresponding to the index threshold is determined, and then played. But is not limited to this, other ways of determining matching interactive media content based on the interactive popularity indicators are equally applicable.

If only one voice interaction operation is involved in one section of interactive media, the final interactive heat index can be determined according to the voice interaction information of the user aiming at the voice interaction operation. If a section of interactive media comprises a plurality of voice interactive operations, the final interactive heat index needs to be determined according to the sum of the interactive heat indexes of the voice interactive information of the user each time.

In the following, the above process is illustrated by taking three voice interactive operations included in the interactive media as an example, as shown in fig. 1B.

In fig. 1B, a piece of interactive media X relates to three voice interaction operations A, B and C, assuming that A, B, C is triggered at 3 rd, 5 th and 7 th minutes of X, respectively, and the targeted object is a suspense event Y in the interactive media, i.e., the interactive media content for the suspense event Y. After the playing end of the interactive media starts playing the interactive media, the content of the played interactive media is displayed through the display interface. When the interactive media X is played to the 3 rd minute, the first voice interactive operation A is triggered, and interactive prompts, such as a microphone icon and a text prompt 1, such as Zhang III, and a text prompt 2, such as Liquan, are displayed through a playing interface. If the user inputs the voice interaction information "zhang san" according to the text prompt 1, while the scenario continues, the background determines the corresponding interaction heat index according to the voice interaction information, which is set to 3 in this example. If the user inputs the voice interaction information "li si" according to the text prompt 2, the background determines the corresponding interaction heat index according to the voice interaction information while the scenario continues, which is set to 4 in this example. And the X is continuously played for 5 minutes, a second voice interaction operation B is triggered, and interaction prompts such as a microphone icon and a text prompt 3 such as 'buying a train ticket' and a text prompt 4 such as 'buying a ship ticket' are displayed through a playing interface. If the user does not perform any voice input at this time, that is, the voice interaction information is empty, the interaction heat index is 0 at this time, and the total interaction heat index at the current time is still 3. And the X is continuously played for 7 minutes, a third voice interaction operation C is triggered, and the interaction prompt, such as a microphone icon and a text prompt 5, such as 'walk', and a text prompt 6, such as 'no walk', are displayed through the playing interface. Suppose that the user inputs the voice interaction information "no go" according to the text prompt 6, if the corresponding interactive heat index of this time is 5, and if the user inputs "no go" according to the voice, the corresponding interactive heat index of this time is 3. After three times of interaction, if the voice input of the user is "zhangsan" + empty + "go" for three times, the interactive heat index of the user for the suspense event Y is 3+0+ 5-8. Further, the interactive media branch matching with the interactive heat index 8 is determined, and the interactive media content in the interactive media branch is played. And if the three voice inputs of the user are respectively 'Liquan' + empty + 'no-go', the interactive heat index of the user to the suspicion event Y is 4+0+ 3-7. Further, the interactive media branch matching with the interactive heat index 7 is determined, and the interactive media content in the interactive media branch is played.

It should be noted that, in the embodiment of the present invention, the interactive media Content may be video Content, such as short video series, movie, UGC (User Generated Content), and the like. And the voice interaction information input by the user may include, but is not limited to: sentences, phrases, singing segments, screaming voice, etc. input by voice.

Therefore, through the embodiment, in the playing process of the interactive media, the user can perform voice interaction operation with the interactive media according to the interaction prompt, input voice interaction information, and interact with the target object in the interactive media, so as to determine the interaction heat (represented by the interaction heat index) between the user and the target object, further determine the interactive media branch which is more in line with the preference or requirement of the user according to the interaction heat, and play the interactive media content of the interactive media branch. Therefore, when a user watches the interactive media, on one hand, the user interacts with the interactive media through voice interactive operation to participate in determining the plot trend of the interactive media; on the other hand, the more voice interaction information input by the user based on voice interaction operation, the higher the interaction heat with the target object in the interactive media is, so that the determined interactive media content is more in line with the preference and the requirement of the user; on the other hand, the user does not need manual operation, hands of the user are released, the interactive operation process is simplified, the interactive cost is reduced, and the operation burden of the user is relieved.

The data processing method of the present embodiment may be performed by any suitable electronic device having data processing capabilities, including but not limited to: mobile terminals (such as mobile phones, PADs, etc.), PCs, servers, etc.

Example two

Referring to fig. 2A, a flowchart illustrating steps of a data processing method according to a second embodiment of the present invention is shown.

step S202: and playing the interactive media.

Step S204: and receiving voice interaction information input by a user according to the interaction prompt in the interactive media playing process.

In a feasible mode, the step can be realized by triggering and displaying the interactive prompts corresponding to a plurality of voice recognition events in the interactive media playing process according to the triggering sequence of the plurality of preset voice recognition events; and receiving voice interaction information input by a user according to the interaction prompt.

As mentioned above, the predetermined voice recognition event in the interactive medium includes at least one piece. When the voice recognition event is triggered in the interactive media playing process, corresponding voice interactive operation is carried out, and the voice interactive operation can be interacted with a user through interactive prompt in any appropriate mode. If the voice recognition event comprises a plurality of voice recognition events, a prompt can be provided for the voice interaction operation triggered by each voice recognition event. Moreover, the prompting mode can be the same or different. Of course, some of the prompts may be present and some of the prompts may be absent. For convenience of description, the implementation of only one hint is taken as an example in the present embodiment, but it should be apparent to those skilled in the art that other hint manners can be implemented by referring to the example.

In a possible way, the prompting can be carried out by adopting an image and file way. In this case, the step can be implemented as: aiming at each voice recognition event, if the interactive media is determined to be played to the voice recognition event, displaying a voice interaction guide prompt, and receiving voice interaction information input by a user according to the voice interaction guide prompt; wherein, the voice interaction guidance prompt comprises at least one of the following: voice interactive guidance image and voice interactive guidance file. The voice interaction guide image can be realized as a static image or a dynamic image, and a better display effect can be achieved if the voice interaction guide image is realized as the dynamic image. The voice interaction guiding file can be preset according to interaction requirements, can also be generated according to plot information or speech information and the like, can achieve the prompting effect, and can be combined with the plot more tightly.

Further optionally, the voice interactive guidance prompt may also have a corresponding display duration, and the setting of the specific display duration may be set by a person skilled in the art as appropriate according to actual needs, for example, may be any value from 0 second to 1 second. It should be noted that the display duration may be set to 0 second, so as to indicate that the voice interactive guidance prompt is not required to be displayed. Therefore, different functions are realized by using one numerical value, whether the voice interaction guidance prompt needs to be displayed or not can be determined according to the display time, and the display time can be determined when the voice interaction guidance prompt needs to be displayed. The display duration is indicated through the display time information of the voice interaction guide prompt. Based on this, if it is determined that the interactive media is played to the voice recognition event, displaying the voice interactive guidance prompt may be implemented such that the voice interactive guidance prompt is displayed if it is determined that the interactive media is played to the voice recognition event and it is determined that the display time information of the voice interactive guidance prompt satisfies a first preset display time setting. As previously mentioned, the first preset presentation time setting may be set to a value greater than 0 seconds.

It should be noted that if the display duration is 0, although the voice interaction guidance prompt is not displayed, voice interaction can still be performed, for example, if the interactive media playing picture is paused in a certain picture, the user can perform voice input according to the speech corresponding to the picture. For example, when the interactive media is paused until a certain video frame, the current speech in the video frame is "do you feel he? ", the user may voice input" yes "to interact with the interactive media, although there is no prompt. Of course, the user may not do the processing, and when the pause time, such as 3S, is reached, the interactive media playback is continued.

Step S206: and determining the interactive heat index of the user to the target object in the interactive media according to the voice interactive information.

As previously mentioned, the target object may be any suitable object in the interactive media, including but not limited to: character objects, content episode objects, content event objects, etc. in interactive media.

In this embodiment, a manner of determining the interactive heat index is described by taking an example that the preset speech recognition event includes a plurality of pieces.

Fig. 2B shows an arrangement of voice recognition events in an interactive medium, in which N voice recognition events, namely voice recognition events 1-N, are arranged. And, the interactive medium is preset with an initial value of the interactive heat index, optionally, 0 or M (both integers) may be set. But not limited thereto, in practical application, those skilled in the art can set the value to any suitable value according to practical requirements.

And when a voice recognition event is triggered, a corresponding interaction prompt is displayed to the user to prompt the user to carry out voice interaction operation, and according to voice interaction information input by the user aiming at the voice interaction operation, a corresponding heat value is increased or reduced on the basis of an initial value of an interaction heat index. For example, after the voice recognition event 1 is triggered, the interaction heat index of the voice recognition event 1 is determined to be N1 according to the voice interaction information input by the user, and N + N1 or N-N1 is calculated on the basis of the initial value N of the interaction heat index to serve as a new interaction heat index. After the voice recognition event 2 is triggered, the interaction heat index of the voice recognition event 2 can be determined to be N2 according to the voice interaction information input by the user corresponding to the event 2, and calculation can be performed on the basis of the interaction heat index obtained by the voice recognition event 1, such as calculation of N + N1+ N2 or N-N1-N2, so as to serve as a new interaction heat index after the voice recognition event 2 is triggered. And so on until speech recognition event N.

As can be seen, in the case that the preset speech recognition event includes a plurality of events, this step can be implemented as: determining an interactive heat index corresponding to each voice interactive information; and determining the interactive heat index of the user for the target object in the interactive media according to the interactive heat index corresponding to each voice interactive message. Therefore, the continuous interaction condition of the user and the interactive media can be reflected, and the interaction heat of the user to the target object in the interactive media can be more accurately determined.

Further, when the interactive heat index of the user for the target object in the interactive media is determined according to the interactive heat index corresponding to each piece of voice interactive information, the interactive heat indexes corresponding to each piece of voice interactive information may be summed, and the interactive heat index of the user for the target object in the interactive media is determined according to the summed result. The addition method is simple and easy to implement, but is not limited thereto, and other suitable methods, such as setting a weight for each voice interaction information, and obtaining a final interaction heat index according to the weight and the interaction heat index of each voice interaction information, are also applicable.

Based on the characteristics of the interaction and the consideration of the user interaction experience, an interaction feedback time period can be set for the voice interaction operation, and the setting of the specific time period can be set by the technical personnel in the field according to the actual requirements. In this case, for the voice interaction operation triggered by each voice recognition event, whether the voice interaction information of the user for the voice interaction operation is received or not can be judged within the interaction feedback time period corresponding to the voice interaction operation; and determining the interactive heat index corresponding to each voice interactive information according to the judgment result. That is, when determining the interactive heat index of the user for the target object in the interactive media according to the voice interaction information, it may be determined whether each received voice interaction information is empty for each voice recognition event; determining an interaction heat index corresponding to each voice interaction information according to the judgment result; and determining the interactive heat index of the user for the target object in the interactive media according to the interactive heat index corresponding to each voice interactive message.

If the voice interaction information is determined not to be empty according to the judgment result, judging whether the voice interaction information contains interaction key information; and if so, determining an interactive heat index corresponding to the voice interactive information. And if not, determining the interactive heat index corresponding to the voice interactive information without the interactive key information or setting the interactive heat index to 0.

The interactive key information indicates the tendency emotion or opinion of the user aiming at the target object in the interactive media, and is the basis for subsequently determining the tendency of the interactive media. In a feasible implementation manner for judging whether the voice interaction information contains the interaction key information, the voice can be converted into text content, and then the text content is subjected to key information analysis or key information extraction, so that the interaction key information is obtained. The interactive key information may be an interactive keyword or an interactive semantic result, and so on.

In order to enable the user to have more visual experience on the voice interaction, interactive prompt can be performed through a playing interface of the interactive media. In this case, the determining whether the voice interaction information includes the interaction key information may include: displaying a first voice interaction feedback prompt through a playing interface of an interactive medium; and judging whether the voice interaction information contains interaction key information or not in the process of displaying the first voice interaction feedback prompt. Wherein the first voice interaction feedback prompt comprises at least one of: the first voice interaction feedback image and the first voice interaction feedback file.

The voice interaction feedback prompt is feedback for voice interaction information of the user, which may be in the form of a feedback image and/or a feedback document. For example, if the voice interaction guidance image is displayed as a microphone, the first voice interaction feedback image may be displayed as a dynamic image emitting spectrum to the periphery or both sides of the microphone. After the user inputs the voice interaction information, the first voice interaction feedback document may be displayed as "recognition in progress", "matching in progress", and so on. Through the first voice interaction feedback prompt, on one hand, a user can definitely know that the voice interaction information is received and the processing progress of the voice interaction information is obtained; on the other hand, interactive key information is analyzed in the background, so that monotonous interface display is avoided, and use experience of a user is improved.

Optionally, a display duration may be set for the first voice interaction feedback prompt, and the display duration may be flexibly set according to the speed and time for acquiring the interaction key information, and generally may be set to be more than 4 seconds. In addition, under the condition that the display duration of the voice interaction guidance prompt is 0, that is, under the condition that the voice interaction guidance prompt is not displayed, the user can also be reminded through the voice interaction feedback prompt, for example, the voice interaction feedback case can be displayed as "you have not input voice" and the like.

And if the voice interaction information of the user aiming at the voice interaction operation is not received in the interaction feedback time period corresponding to the voice interaction operation, determining the interaction heat index corresponding to each voice interaction information according to whether each voice interaction information is a null judgment result or not, wherein the interaction heat index corresponding to each voice interaction information comprises: if the voice interaction information is determined to be empty according to the judgment result, judging whether the current voice interaction operation is the first voice interaction operation; if so, displaying a second voice interaction feedback prompt; or if not, displaying a third voice interaction feedback prompt; and acquiring the interaction heat index when the voice interaction information is empty in the process of displaying the second voice interaction feedback prompt or the third voice interaction feedback prompt. The interactive heat index may be 0 or a preset default value.

Wherein the second voice interaction feedback prompt comprises at least one of: a second voice interaction feedback image and a second voice interaction feedback file; or, the third voice interactive feedback prompt includes at least one of: a third voice interaction feedback image and a third voice interaction feedback file.

For example, the second voice interaction feedback image may be a dynamic image of a spectrum emitted to the periphery or both sides of the microphone, and the second voice interaction feedback document may be "input voice soon, and do i'm friend bar", etc. For another example, the third voice interactive feedback image may also be a dynamic image that emits a spectrum to the periphery or both sides of the microphone, and the third voice interactive feedback document may be "please input voice in time", etc.

After the interactive heat index corresponding to each voice interactive information is determined, result feedback can be performed on the voice interactive information of the user. In a feasible manner, the voice interaction result prompt and/or the interaction heat index prompt can be displayed through a playing interface of the interactive media. Wherein the voice interaction result prompt comprises at least one of the following: voice interaction result images and voice interaction result documents; the interactive heat indicator prompt includes at least one of: interactive heat index result image and interactive heat index result file. Therefore, the user can feel more intuitive to the interactive result.

The voice interaction result prompt is a display of a result obtained after processing the voice interaction information of the user, for example, the voice interaction result file can be displayed as "correct input", "wrong input", and the like, and can be set by a person skilled in the art according to actual requirements. Accordingly, the voice interaction result image may be any suitable image, such as a microphone icon returning to a still state, and the like. Through voice interaction result prompt, a user can clearly know the interaction result of the voice interaction information input by the user and the interaction media, and user experience is improved.

In addition, a corresponding display duration may also be set for the voice interaction result prompt, and the specific display duration may be set by a person skilled in the art as appropriate according to actual needs, for example, may be any value from 0 second to 1 second. It should be noted that the display duration may be set to 0 second, so as to indicate that the voice interaction result prompt is not required to be displayed. Similar to the voice interaction guidance prompt, different functions are realized by using one numerical value, so that whether the voice interaction result prompt needs to be displayed or not can be determined according to the display time, and the display time can be determined when the voice interaction result prompt needs to be displayed. The display duration is indicated through display time information prompted by a voice interaction result.

Based on this, when the voice interaction result prompt is displayed through the playing interface of the interactive media, if it is determined that the display time information of the voice interaction result prompt meets the second preset display time setting, the voice interaction result prompt is displayed through the playing interface of the interactive media. Wherein the second preset presentation time setting may be set to a value greater than 0 seconds.

Similarly, a corresponding display duration may also be set for the interactive heat index prompt, and may be any value from 0 second to 1 second, for example. When the interactive heat index prompt is displayed through the playing interface of the interactive media, if the display time information of the interactive heat index prompt meets the third preset display time setting, the interactive heat index prompt is displayed through the playing interface of the interactive media.

In addition, the interactive heat index result image can adopt a uniform image (such as a heart-shaped image) or can adopt different matched images according to the interactive heat index; the interactive heat index result file may be an interactive heat index value, or an interactive degree prompt determined according to the interactive heat index, such as "how close you are, how much harder you are to interact", and the like.

If the voice interaction result prompt and the interaction heat index prompt are displayed, it can be determined that the display time information of the voice interaction result prompt meets a second preset display time setting, and the display time information of the interaction heat index prompt meets a third preset display time setting; and displaying the voice interaction result prompt through a playing interface of the interactive media, and displaying the interactive heat index prompt through the playing interface of the interactive media after the interval preset interval time. The preset interval time can be set by a person skilled in the art according to actual requirements, such as a value between 500ms and 1 s. The voice interaction result prompt and the interaction heat index prompt are displayed at intervals, so that the attention of a user can be attracted more easily, and the prompt effect is enhanced. But not limited thereto, the preset interval time may also be set to 0, in which case, the voice interaction result prompt and the interaction heat index prompt start to be displayed at the same time.

By the method, more intuitive voice interaction information feedback is realized, and the interaction experience of the user is improved.

Step S208: and playing the interactive media content matched with the interactive heat index according to the interactive heat index.

In this step, a final interactive heat index may be determined according to the voice interactive information input by the user for a plurality of times, and then interactive media content corresponding to the interactive heat index is determined, and the interactive media content is played.

In a feasible manner, after all voice interaction operations are determined to be completed, the interactive media content matched with the interaction heat index can be determined according to the final interaction heat index; and skipping to the interactive media content and playing according to the skipping setting information of the interactive media. Wherein, the skip setting information is used for indicating whether the current interactive media starts the skip mode.

Based on the above, if the jump playing mode of the interactive media is determined to be started according to the jump setting information of the interactive media, the current interactive media content is stopped to be played, and the interactive media content matched with the interactive heat index is jumped to be played; and if the jumping play mode of the interactive media is determined not to be started according to the jumping setting information of the interactive media, continuing to play the current interactive media content, and jumping to the determined interactive media content matched with the interactive heat index for playing after the current interactive media content is played. Therefore, the plot jump can be smoothly realized according to the indication of the user no matter whether the current interactive media starts the jump playing mode or not. Skipping interactive media content in time under the condition of starting a skipping playing mode, so that the user requirements can be met in real time; and under the condition that the skip playing mode is not started, skipping is carried out after the current interactive media content is played, although skipping delay is short, the requirement of a user for participating in plot decision can be met, and the condition that the user requirement cannot be responded is effectively avoided.

In the following, the above process is briefly described by taking two speech recognition events as an example, and an interactive interface of an interactive medium corresponding to the process is shown in fig. 2C.

In this example, the content of the interactive media is the content of the interactive media related to a suspense case, and the target object of the content of the suspense case is the content of the suspense case. When the interactive media is played for 3 minutes, the first voice recognition event is triggered to perform voice interaction operation with the user, the voice interaction operation prompts the user through voice interaction guidance prompt, as shown in the first interface in fig. 2C, on the basis of the displayed interactive media content interface, a microphone image is displayed in the center of the lower end of the interface, and guidance documents "go to the royal palace" and "go to the temple" are displayed below the microphone image to prompt the user to answer. Assuming the user answers "Queen", as shown in the second interface, a voice interaction feedback prompt will be presented, with a microphone image presented in the middle of the lower end of the interface emitting a spectral pattern to both sides, and a guide paper "match middle … …" displayed below the microphone image. Meanwhile, the background determines that the interactive heat index corresponding to the 'Quhuanggong removal' is 5, and interactive media skipping does not occur at the moment. After the prompt duration of the voice interaction feedback prompt is reached, a first voice interaction result image is also displayed, as shown in a third interface in fig. 2C, a number matching pattern and an "OK" word are displayed.

The interactive media continues to play, when the interactive media plays to 7 minutes, a second voice recognition event is triggered to perform again the voice interaction operation with the user, which also prompts the user through a voice interaction guidance prompt, as shown in the fifth interface in fig. 2C, which shows a microphone image in the middle of the lower end of the interface on the basis of the presented interactive media content interface, and shows a guidance document "the thief 'was you' yesterday and night? ". Where the "yes" word is specially marked with a quotation mark to prompt the user to answer "yes" or "no". Assuming the user answers "yes", as shown in the sixth interface, a voice interaction feedback prompt will be presented, a microphone image presented in the middle of the lower end of the interface emits a spectral pattern to both sides, and a guide text "matching … …" is displayed below the microphone image. Meanwhile, the background determines that the interactive heat index corresponding to the 'yes' is still 5, and after the interactive heat index is added with the previous interactive heat index, the current interactive heat index is 10. After the prompt duration of the voice interaction feedback prompt is reached, a first voice interaction result image of the voice interaction information is displayed, as shown in a seventh interface in fig. 2C, a number matching pattern and an "OK" character are displayed. In addition, in this example, an interactive heat indicator prompt, such as a heart-shaped pattern and "10" (interactive heat indicator) and a prompt, shown in the upper left corner of the seventh interface, are also displayed. In this example, taking the skip playing mode as an example, after determining that the current interaction heat index is 10, the user will skip to the interaction media content corresponding to the interaction heat index to play.

Therefore, in the process of playing the interactive media, the interactive popularity of the user to the target object in the interactive media is determined through multiple interactions between the user and the interactive media, and further the future trend of the plot is determined, so that the user has higher participation, and can effectively participate in the interactive interaction with the interactive media.

Through the embodiment, the interactive media is provided with the voice recognition event, and the event is used for triggering the voice interactive operation with the user. The user can input voice interaction information according to the interaction prompt corresponding to the voice interaction operation so as to interact with a target object in the interaction media, and therefore the interaction heat (represented by the interaction heat index) between the user and the target object is determined, and further the interaction media branch which is more in line with the preference or the requirement of the user can be determined according to the interaction heat, and the interaction media content of the interaction media branch is played. Therefore, in the process of watching the interactive media, on one hand, the user can input voice interactive information according to voice interactive operation so as to interact with the interactive media and participate in determining the plot trend of the interactive media; on the other hand, the more voice interaction information input by the user based on voice interaction operation, the higher the interaction heat with the target object in the interactive media is, so that the determined interactive media content is more in line with the preference and the requirement of the user; on the other hand, the user does not need manual operation, hands of the user are released, the interactive operation process is simplified, the interactive cost is reduced, and the operation burden of the user is relieved.

Examples

Referring to fig. 3, a flowchart of steps of a data processing method according to a third embodiment of the present invention is shown.

It should be noted that, in this embodiment, a voice interaction triggered by one voice recognition event in a specific example is taken as an example to describe the data processing method provided in the embodiment of the present invention. It will be apparent to those skilled in the art that the implementation can be performed with reference to the present embodiment for the case of multiple speech recognition events.

step S302: during the interactive media playing process, it is determined that a speech recognition event is triggered.

For example, the interactive media is played to the triggering time point of the voice recognition event, etc. In this embodiment, the interactive media is specifically interactive video.

In a segment of interactive media, a plurality of voice recognition events can be preset, and an initial value of an interactive heat index is set, wherein the interactive heat index is, for example, an index such as a privacy value and a goodness value.

In this embodiment, the target object in the interactive media takes a character object as an example, and an initial value of an interaction heat index (for example, intimacy degree, goodness degree, and the like) of a certain character is set in advance for the user. Under the condition, the interactive heat index can effectively represent the love degree of the user to the role. For example, if the interactive media relates to the content of a joke spoken by a certain character, and an interactive heat index is set for the character, the higher the interactive heat of the user with the character is, the more the user recognizes the joke spoken by the character, and the user likes the character. Subsequently, the plot trend and the playing content of the interactive media can be determined according to the final interactive heat index.

Step S304: and performing microphone right determination.

For example, it is determined whether the microphone function of the terminal, such as a mobile phone, is authorized, and if so, the step S306 is directly performed; if not, the video can be paused, and the user is prompted for authorization through a pop-up window, and step S306 is performed after the user is authorized. If the user does not authorize, i.e. the authorization does not pass, step S312 is executed to end the interaction and continue playing the interactive media.

Step S306: and entering voice interaction operation and displaying a voice interaction guiding prompt.

For example, if the display time of a guidance UI (User Interface) for setting a voice interaction guidance prompt is longer than 0 second, a guidance image (which may be a moving picture) and a guidance document of the guidance UI may appear at a certain position (which may be preset or determined according to a recognition result of content in the play Interface) of the video play Interface, so as to guide the User to enter voice interaction, which requires User operation. In fig. 3, the guidance UI of the voice interaction guidance prompt is illustrated as "display guidance UI", and a corresponding specific implementation example is illustrated as the first interface in fig. 2C in the second embodiment.

In a specific implementation, the display duration of the voice interaction guidance prompt may use GMT to indicate the maximum display duration of the guidance prompt. After the voice interaction operation is started, judging whether the GMT is larger than 0 or not, if so, displaying a voice interaction guide prompt (namely displaying a guide UI), then displaying a real-time feedback UI and starting FMT (showing duration of the voice interaction feedback prompt) countdown; otherwise, a real-time feedback UI is displayed, e.g., a microphone icon and a document "quick to come and i interact with a bar" is displayed. Then, step S308 is performed. The real-time feedback UI can prompt a user to interact with the video in time.

Step S308: and feeding back the voice interaction information of the user in real time.

For example, a UI that presents voice interaction feedback prompts may be presented at a location of a video playback interface, including voice interaction feedback images (e.g., a moving image of an image transform of a microphone) and voice interaction feedback patterns (e.g., in matching, in recognition, etc.).

In application, the display duration of the voice interaction feedback prompt can be represented by using the FMT, which indicates that the longest display duration of the feedback prompt enters countdown after step S306, and the time is circulated in real time to check whether the FMT countdown time is up. If the count-down has been reached, the flow proceeds to step S310. If the count down is not reached, further processing may be performed.

In one example, the above process may include:

substep S308A: judging whether the FMT is reached, if so, executing a substep S310; if not, then sub-step S308B is performed.

Substep S308B: judging whether a voice is input, if so, executing a substep S308C; if not, then sub-step S308D is performed.

Substep S308C: a first voice interaction feedback prompt is shown and then the rotator step S308G is performed.

The first voice interactive feedback prompt may also be presented through a UI, which is illustrated in fig. 3 as "matching UI + document", and a corresponding specific implementation of the first voice interactive feedback prompt may be as shown in the second interface of fig. 2C in the second embodiment.

Substep S308D: judging whether the voice is input for the first time, if so, executing a substep S308E; if not, then sub-step S308F is performed.

Substep S308E: a second voice interaction feedback prompt is shown and then sub-step S308G is performed.

Wherein, the second voice interaction feedback prompt is also presented through the UI, which is illustrated as "real-time feedback UI" in fig. 3, and the real-time feedback UI may adopt the same real-time feedback UI as in step S306, because both can be regarded as the first voice input in nature, and the adoption of the same UI can save the implementation cost. But is not limited thereto, the real-time feedback UI in the present step may also take a different form from the real-time feedback UI in step S306.

Substep S308F: a third voice interaction feedback prompt is presented and then sub-step S308G is performed.

The third voice interactive feedback prompt is also shown by the UI, and is illustrated as "fault-tolerant UI + fault-tolerant document" in fig. 3, for example, a document showing a spectrum pattern emitted from the microphone to both sides, and "please input voice", etc.

Substep S308G: judging whether the voice interaction information input by voice is recognized, if so, executing a substep S308H; if not, return to substep S308A.

Substep S308H: and determining an interactive heat index corresponding to the voice interactive information, and updating the obtained interactive heat index according to the interactive heat index.

If so, the current interactive heat index is added and summed with the existing interactive heat index to serve as the latest interactive heat index. The notation in fig. 3 means "change the value".

It should be noted that, no matter which voice interaction feedback prompt is, it has a certain display duration, and in practical application, this step may be performed in the background while displaying the voice interaction feedback prompt.

Therefore, after a real-time feedback UI (which can be a motion picture) and a real-time feedback file appear in a playing interface of the interactive media, a real-time voice input detection cycle is entered, and whether the countdown time of the real-time feedback is up or not is checked. If the countdown is not reached, the user may be guided to speak words containing interactive key information, such as interactive keywords, based on the storyline and the case prompt. A terminal such as a microphone of a mobile phone collects voice content spoken by a user, converts the voice content into text characters through a voice algorithm, and then judges whether the characters contain interactive keywords. If the interactive keyword is judged to be recognized, the operation changes the interactive heat index (such as the affinity value, the goodness value, etc.), and the operation proceeds to the subsequent step S310. If no interactive keyword is recognized, the loop judgment can be continued, and the fault-tolerant UI and the fault-tolerant document are displayed when the voice input is judged not to be the first input. If the real-time feedback countdown time has come, the process proceeds directly to the next step S310.

Step S310: and (5) feedback of an interaction result.

The method comprises the following substeps:

sub-step S310A: judging whether the display duration of the voice interaction result prompt or the interaction heat index prompt is greater than 0; if yes, performing substeps S310B1 and S310B2, respectively; if not, go to step S312.

In fig. 3, the voice interaction result prompt is illustrated as "RT _ UI" and the interaction heat index prompt is illustrated as "tipsT".

Sub-step S310B 1: judging whether the display duration of the voice interaction result prompt is greater than 0; if so, displaying a voice interaction result prompt, and then executing step S312; if not, no processing is performed.

In fig. 3, the prompt illustration showing the voice interaction result means "display: success/failure UI + documentation ".

Sub-step S310B 2: judging whether the display duration prompted by the interactive heat index is greater than 0; if yes, displaying an interactive heat index prompt after a preset interval time, and then executing step S312; if not, no processing is performed.

In fig. 3, the preset interval time is denoted as "interval t interval time", and the presentation interactive heat index prompt is denoted as "display: tips success/tips failure UI + tips documents + values ", where" values "means values of the interactive heat index.

As can be seen from the above process, in this step, it is first determined whether the display time of the result UI corresponding to the voice interaction result or the display time of the interaction heat index tips is greater than 0, and if both are not greater than 0, that is, both are 0, the interaction result feedback stage is directly skipped. If one is not 0, whether the display time of the result UI is greater than 0 is judged, if so, the result UI and the corresponding result file (success or failure) are displayed, and optionally, the interactive heat indexes (such as affinity value, goodness and the like) can also be displayed at the same time. Meanwhile, whether the tips display time is larger than 0 is judged, if yes, after waiting for the specified interval time, the UI and tips file of the tips are displayed, and optionally, the interactive heat index (such as the intimacy value, the goodness value and the like) can also be displayed at the same time.

Step S312: and ending the voice interaction and playing the interactive media.

The illustration in fig. 3 means "interactive bit ends, video normally plays".

If the current voice interaction is not the last interaction of the interactive media, the current interaction is ended, the interactive media is played normally, and the operation of the step S302 is repeated when the next voice recognition event is played.

If the voice interaction is the last interaction of the interactive media, all voice recognition events in the interactive media can be determined to be completed, and a skip playing stage can be entered. Under the condition, if the skip switch is turned on, the playing of the current interactive media is stopped, and different interactive media branches are switched according to the size of the interactive heat index (such as the intimacy value, the goodness value and the like) to play; if the skip switch is not turned on, the current interactive media continues to be played until the playing is finished, and then different interactive media branches are switched according to the size of the interactive heat index (such as the intimacy value, the goodness value and the like) to be played.

A simple scenario of the above process is shown in fig. 3B, where the interactive media is played to the first voice recognition event, and the voice interaction guidance prompt is presented through the playing interface, including the microphone image and the text, "what was 'you' the thief of last night? ". The user enters speech interaction information based on the prompt, e.g., the user says "yes" (the user may also say "no"). Next, a voice interactive feedback prompt is shown, such as a microphone image with a spectral pattern emitted to both sides in the figure, and a text pattern "match in … …" displayed below the microphone image. In the process, the background can also analyze key information of the voice interaction information input by the user and obtain interaction key information. In this example, the user says "yes," and the corresponding interaction heat index is 5; if the user says "no", the corresponding interactive heat index is 3. Furthermore, voice interaction result prompts and interaction heat index prompts, such as number matching images and 'saying is correct' documentaries, are displayed, and heart-shaped images and interaction heat indexes 5 are displayed at the upper left corner of the interface.

In another possible branch, if the user says "not" his process is similar to the process of "yes" above, but in the interactive heat indicator prompt, he will show a heart-shaped image and an interactive heat indicator 3.

If the user inputs the voice interaction information incorrectly, for example, the user says "yes" or "not" but "pot" under the prompt of the voice interaction guidance prompt, in this case, the voice interaction result prompt prompts the user in combination with the cross image and the file "say wrong", and in the example, the user displays the heart-shaped image and the interaction heat index 0 in the interaction heat index prompt.

After the first voice interaction is finished, the interactive media continues to be played, the interactive media is played to a second voice recognition event, and voice interaction guiding prompts including microphone images and patterns 'go imperial palace' and 'go temple and temple' are displayed through a playing interface. The user inputs voice interaction information based on the prompt, for example, the user says "go royal" (the user may also say "go temple"). Next, a voice interactive feedback prompt is shown, such as a microphone image with a spectral pattern emitted to both sides in the figure, and a text pattern "match in … …" displayed below the microphone image. In the process, the background can also analyze key information of the voice interaction information input by the user and obtain interaction key information. In this example, the user says "go imperial palace", and the corresponding interactive heat index is 5; if the user says "go temple", its corresponding interactive heat index is also 5. Furthermore, voice interaction result prompts and interaction heat index prompts, such as number matching images and 'saying is correct' documentaries, are displayed, and heart-shaped images and interaction heat indexes 10 are displayed at the upper left corner of the interface.

After the voice interaction result prompt and the interaction heat index prompt are displayed, if the skip playing mode is started, the current interaction media skip to the interaction media content corresponding to the interaction heat index 10 for playing. And if the skip playing mode is not started, the current interactive media can continue to be played, and after the playing is finished, the current interactive media skip is carried out to the interactive media content corresponding to the interactive heat index 10 for playing.

If the user says 'not' (the interactive heat index is 3) during the first voice interaction and says 'go imperial palace' or 'go temple' (the interactive heat indexes corresponding to the two are 5) during the second voice interaction, the user can jump to the interactive media content corresponding to the interactive heat index 8 to play.

And for the situation that the user says 'pan' during the first voice interaction, if the user says 'go imperial palace' or 'go temple' (the interactive heat indexes corresponding to the two are both 5) during the second voice interaction, the user can jump to the interactive media content corresponding to the interactive heat index 5 to play.

Through this embodiment, in one section interactive media, with voice interaction application to interactive media content broadcast, through the interactive judgement of continuous pronunciation, determine the change of interactive heat index to according to the size of interactive heat index, determine the trend of interactive content drama, effectively promoted user's interactive experience, and interactive operation is simple, and the operation burden is little.

Example four

Referring to fig. 4, a block diagram of a data processing apparatus according to a fourth embodiment of the present invention is shown.

The data processing apparatus of this embodiment is applied to the process of playing interactive media content, and the apparatus includes: a triggering module 402, configured to receive voice interaction information input by a user according to an interaction prompt; a determining module 404, configured to determine, according to the voice interaction information, an interaction heat index of the user for a target object in the interaction media; and the playing module 406 is configured to play the interactive media content matched with the interactive heat index according to the interactive heat index.

The data processing apparatus of this embodiment is used to implement the corresponding data processing methods in the foregoing first and second method embodiments, and has the beneficial effects of the corresponding method embodiments, which are not described herein again. In addition, the functional implementation of each module in the data processing apparatus of this embodiment can refer to the description of the corresponding part in the foregoing first and second method embodiments, and is not repeated here.

EXAMPLE five

Referring to fig. 5, a block diagram of a data processing apparatus according to a fifth embodiment of the present invention is shown.

The data processing apparatus of this embodiment is applied to the process of playing interactive media content, and the apparatus includes: a triggering module 502, configured to receive voice interaction information input by a user according to an interaction prompt; a determining module 504, configured to determine, according to the voice interaction information, an interaction heat index of the user for a target object in the interaction media; and the playing module 506 is configured to play the interactive media content matched with the interactive heat index according to the interactive heat index.

Optionally, the triggering module 502 is configured to trigger and display an interactive prompt corresponding to a plurality of voice recognition events in an interactive media playing process according to a triggering sequence of the plurality of preset voice recognition events; and receiving voice interaction information input by a user according to the interaction prompt.

Optionally, the determining module 504 includes: the first determining submodule 5042 is configured to determine an interaction heat index corresponding to each piece of voice interaction information; the second determining sub-module 5044 is configured to determine, according to the interaction heat index corresponding to each piece of voice interaction information, an interaction heat index of the user with respect to a target object in the interaction media.

Optionally, the second determining sub-module 5044 is configured to sum the interaction heat indicators corresponding to the respective voice interaction information, and determine, according to a sum result, an interaction heat indicator of the user with respect to a target object in the interaction media.

Optionally, the triggering module 502 is configured to, for each voice recognition event, if it is determined that the interactive media is played to the voice recognition event, display a voice interaction guidance prompt, and receive voice interaction information input by a user according to the voice interaction guidance prompt; wherein the voice interaction guidance prompt comprises at least one of: voice interactive guidance image and voice interactive guidance file.

Optionally, when the trigger module 502 determines that the interactive media is played to the voice recognition event and then displays the voice interaction guidance prompt, if it is determined that the interactive media is played to the voice recognition event and it is determined that the display time information of the voice interaction guidance prompt meets a first preset display time setting, then displays the voice interaction guidance prompt.

Optionally, the determining module 504 is configured to determine, for each of the voice recognition events, whether each of the received voice interaction information is null; determining an interaction heat index corresponding to each voice interaction information according to the judgment result; and determining the interactive heat index of the user for the target object in the interactive media according to the interactive heat index corresponding to each piece of voice interactive information.

Optionally, when determining the interaction heat index corresponding to each piece of voice interaction information according to the determination result, the determining module 504: if the voice interaction information is determined not to be empty according to the judgment result, judging whether the voice interaction information contains interaction key information; and if so, determining an interactive heat index corresponding to the voice interactive information.

Optionally, when determining whether the voice interaction information includes interaction key information, the determining module 504: displaying a first voice interaction feedback prompt through a playing interface of the interactive media; and judging whether the voice interaction information contains interaction key information or not in the process of displaying the first voice interaction feedback prompt.

Optionally, the first voice interaction feedback prompt includes at least one of: the first voice interaction feedback image and the first voice interaction feedback file.

Optionally, the determining module 504 is further configured to determine whether the current voice interaction operation is the first voice interaction operation if it is determined that the voice interaction information is empty according to the determination result; if so, displaying a second voice interaction feedback prompt; or if not, displaying a third voice interaction feedback prompt; and acquiring an interaction heat index when the voice interaction information is empty in the process of displaying the second voice interaction feedback prompt or the third voice interaction feedback prompt.

Optionally, the second voice interaction feedback prompt includes at least one of: a second voice interaction feedback image and a second voice interaction feedback file; or, the third voice interaction feedback prompt includes at least one of: a third voice interaction feedback image and a third voice interaction feedback file.

Optionally, the determining module 504 is further configured to, after determining the interaction heat index corresponding to each piece of voice interaction information, display a voice interaction result prompt and/or the interaction heat index prompt through a playing interface of the interactive media; wherein the voice interaction result prompt comprises at least one of: voice interaction result images and voice interaction result documents; the interactive heat index prompt includes at least one of: interactive heat index result image and interactive heat index result file.

Optionally, the determining module 504 is further configured to display the voice interaction result prompt through a playing interface of the interactive media if it is determined that the display time information of the voice interaction result prompt meets a second preset display time setting.

Optionally, the determining module 504 is further configured to display the interactive heat index prompt through a play interface of the interactive media if it is determined that the display time information of the interactive heat index prompt meets a third preset display time setting.

Optionally, the determining module 504 is further configured to determine that the display time information prompted by the voice interaction result meets a second preset display time setting, and that the display time information prompted by the interaction heat index meets a third preset display time setting; and displaying the voice interaction result prompt through the playing interface of the interactive media, and displaying the interactive heat index prompt through the playing interface of the interactive media after a preset interval time.

Optionally, the playing module 506 is configured to determine, according to the interaction heat index, an interaction media content matched with the interaction heat index after it is determined that all voice interaction operations are completed; and skipping to the interactive media content and playing according to the skipping setting information of the interactive media.

Optionally, when jumping to the interactive media content and playing the interactive media content according to the jumping setting information of the interactive media, the playing module 506: if the jumping play mode of the interactive media is determined to be started according to the jumping setting information of the interactive media, stopping playing the current interactive media content and jumping to the interactive media content matched with the interactive heat index for playing; and if the jumping play mode of the interactive media is not started according to the jumping setting information of the interactive media, continuing to play the current interactive media content, and jumping to the interactive media content matched with the interactive heat index for playing after the current interactive media content is played.

Optionally, the target object is a character object in the interactive media.

EXAMPLE six

Referring to fig. 6, a schematic structural diagram of an electronic device according to a sixth embodiment of the present invention is shown, and the specific embodiment of the present invention does not limit the specific implementation of the electronic device.

As shown in fig. 6, the electronic device may include: a processor (processor)602, a display device 604, a voice input device 606, a memory 608, and a communication bus 610.

Wherein:

the processor 602, display device 604, voice input device 606, and memory 608 communicate with one another via a communications component 610. Further, the communication section 610 can also communicate with other electronic devices or servers.

The display device 604 is configured to display data or information, and particularly, in this embodiment, may be configured to display content of a played interactive medium, and prompt a user to perform an interactive prompt of a voice interactive operation during a playing process of the interactive medium; and playing the interactive media content corresponding to the interactive heat index according to the instruction of the processor 602.

The voice input device 606 is configured to receive a voice input, and in this embodiment, may be configured to receive voice interaction information input by the user according to the interaction prompt. Alternatively, the voice input device 606 may be a microphone.

The processor 602 is configured to execute the program 612, and may specifically perform relevant steps in the foregoing data processing method embodiments. For example, the method is used for determining an interaction heat index of the user for a target object in the interactive media according to the voice interaction information; determining interactive media content matched with the interactive heat index; and playing the determined interactive media content through the display device.

In particular, the program 612 may include program code that includes computer operating instructions.

The processor 602 may be a central processing unit CPU or an application Specific Integrated circuit asic or one or more Integrated circuits configured to implement embodiments of the present invention. The intelligent device comprises one or more processors which can be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.

The memory 608 is used for storing a program 612 and storing at least interactive media content corresponding to a plurality of interactive media branches, wherein each interactive media branch corresponds to at least one interactive heat index or at least one interactive heat index range. Memory 608 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

In an optional implementation manner, the program 612 is further configured to, when receiving voice interaction information input by a user according to an interaction prompt, trigger and display, by the processor 602, the interaction prompt corresponding to a plurality of preset voice recognition events through the display device 604 in an interactive media playing process according to a trigger sequence of the plurality of preset voice recognition events; and receiving voice interaction information input by the user according to the interaction prompt through the voice input device 606.

In an optional implementation manner, the program 612 is further configured to enable the processor 602 to determine an interaction heat index corresponding to each piece of voice interaction information when determining an interaction heat index of the user for a target object in the interaction media according to the voice interaction information; and determining the interactive heat index of the user for the target object in the interactive media according to the interactive heat index corresponding to each piece of voice interactive information.

In an optional implementation manner, the program 612 is further configured to enable the processor 602, when determining an interaction heat index of the user for a target object in the interactive media according to the interaction heat index corresponding to each piece of voice interaction information, sum the interaction heat indexes corresponding to each piece of voice interaction information, and determine an interaction heat index of the user for the target object in the interactive media according to a sum result.

In an optional implementation manner, the program 612 is further configured to enable the processor 602, when receiving voice interaction information input by a user according to an interaction prompt, to display, by the display device 604, a voice interaction guidance prompt if it is determined that the interaction medium is played to the voice recognition event for each voice recognition event, and receive voice interaction information input by the user through the voice input device 606 according to the voice interaction guidance prompt; wherein the voice interaction guidance prompt comprises at least one of: voice interactive guidance image and voice interactive guidance file.

In an optional implementation manner, the program 612 is further configured to enable the processor 602 to display the voice interaction guidance prompt through the display device 604 if it is determined that the interactive medium is played to the voice recognition event and the voice interaction guidance prompt is displayed through the display device 604 if it is determined that the interactive medium is played to the voice recognition event and it is determined that the display time information of the voice interaction guidance prompt meets the first preset display time setting.

In an optional implementation manner, the program 612 is further configured to enable the processor 602, when determining an interaction heat index of the user for a target object in the interactive media according to the voice interaction information, to determine, for each of the voice recognition events, whether each of the received voice interaction information is empty; determining an interaction heat index corresponding to each voice interaction information according to the judgment result; and determining the interactive heat index of the user for the target object in the interactive media according to the interactive heat index corresponding to each piece of voice interactive information.

In an optional implementation manner, the program 612 is further configured to enable the processor 602, when determining the interaction heat index corresponding to each piece of voice interaction information according to the determination result, if it is determined that the voice interaction information is not empty according to the determination result, determine whether the voice interaction information includes interaction key information; and if so, determining an interactive heat index corresponding to the voice interactive information.

In an optional implementation manner, the program 612 is further configured to enable the processor 602 to display a first voice interaction feedback prompt through a playing interface of the interactive media displayed by the display device 604 when determining whether the voice interaction information includes interaction key information; in the process of displaying the first voice interaction feedback prompt through the display device 604, it is determined whether the voice interaction information includes interaction key information.

In an alternative embodiment, the first voice-interactive feedback prompt includes at least one of: the first voice interaction feedback image and the first voice interaction feedback file.

In an optional implementation manner, the program 612 is further configured to enable the processor 602, when determining the interaction heat index corresponding to each piece of voice interaction information according to the determination result, if it is determined that the voice interaction information is empty according to the determination result, determine whether the current voice interaction operation is the first voice interaction operation; if so, displaying a second voice interaction feedback prompt through the display device 604; or, if not, displaying a third voice interaction feedback prompt through the display device 604; and acquiring an interaction heat index when the voice interaction information is empty in the process of displaying the second voice interaction feedback prompt or the third voice interaction feedback prompt through a display device 604.

In an optional embodiment, the second voice interactive feedback prompt comprises at least one of: a second voice interaction feedback image and a second voice interaction feedback file; or, the third voice interaction feedback prompt includes at least one of: a third voice interaction feedback image and a third voice interaction feedback file.

In an optional implementation manner, the program 612 is further configured to enable the processor 602, after determining an interaction heat indicator corresponding to each piece of voice interaction information, to display a voice interaction result prompt and/or the interaction heat indicator prompt through a play interface of the interactive media displayed in the display device 604; wherein the voice interaction result prompt comprises at least one of: voice interaction result images and voice interaction result documents; the interactive heat index prompt includes at least one of: interactive heat index result image and interactive heat index result file.

In an optional implementation manner, the program 612 is further configured to enable the processor 602, when displaying the voice interaction result prompt through the playing interface of the interactive media displayed in the display device 604, if it is determined that the display time information of the voice interaction result prompt meets a second preset display time setting, display the voice interaction result prompt through the playing interface of the interactive media displayed in the display device 604.

In an optional implementation manner, the program 612 is further configured to enable the processor 602, when the interactive heat indicator prompt is displayed through the playing interface of the interactive media displayed in the display device 604, if it is determined that the display time information of the interactive heat indicator prompt meets a third preset display time setting, display the interactive heat indicator prompt through the playing interface of the interactive media displayed in the display device 604.

In an optional implementation manner, the program 612 is further configured to enable the processor 602 to determine that display time information of the voice interaction result prompt meets a second preset display time setting and display time information of the interactive heat index prompt meets a third preset display time setting when the voice interaction result prompt and the interactive heat index prompt are displayed through a play interface of the interactive media displayed in the display device 604; and displaying the voice interaction result prompt through the playing interface of the interactive media displayed in the display device 604, and displaying the interactive heat index prompt through the playing interface of the interactive media after a preset interval time.

In an optional implementation manner, the program 612 is further configured to enable the processor 602, when playing the interactive media content matching the interactive heat index according to the interactive heat index, after determining that all voice interaction operations are completed, determine the interactive media content matching the interactive heat index according to the interactive heat index; and skipping to the interactive media content according to the skipping setting information of the interactive media and playing the interactive media content through the display equipment 604.

In an optional implementation manner, the program 612 is further configured to enable the processor 602, when jumping to the interactive media content and playing according to the jump setting information of the interactive media, if it is determined that the jump playing mode of the interactive media has been started according to the jump setting information of the interactive media, terminate playing the current interactive media content and jump to the interactive media content matched with the interactive heat index and play the interactive media content through the display device 604; if the skip playing mode of the interactive media is determined not to be started according to the skip setting information of the interactive media, continuing to play the current interactive media content through the display equipment 604, and skipping to the interactive media content matched with the interactive heat index after the current interactive media content is played through the display equipment 604.

In an optional embodiment, the target object is a character object in the interactive media.

For specific implementation of each step in the program 612, reference may be made to corresponding steps and corresponding descriptions in units in the foregoing data processing method embodiments, which are not described herein again. It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described devices and modules may refer to the corresponding process descriptions in the foregoing method embodiments, and are not described herein again.

Through the electronic equipment of the embodiment, a voice recognition event is set in the interactive medium, and the event is used for triggering voice interactive operation with a user. The user can carry out voice interaction information according to the voice interaction operation so as to interact with a target object in the interactive media, and therefore the interaction heat (represented by the interaction heat index) between the user and the target object is determined, and further the interactive media branch which is more in line with the preference or the requirement of the user can be determined according to the interaction heat, and the interactive media content of the interactive media branch is played. Therefore, when a user watches the interactive media, on one hand, the user can carry out voice interactive information according to voice interactive operation so as to interact with the interactive media and participate in determining the plot trend of the interactive media; on the other hand, the more voice interaction information of the user based on voice interaction operation, the higher the interaction heat with the target object in the interactive media, so that the determined interactive media content is more in line with the preference and the requirement of the user; on the other hand, the user does not need manual operation, hands of the user are released, the interactive operation process is simplified, the interactive cost is reduced, and the operation burden of the user is relieved.

It should be noted that, according to the implementation requirement, each component/step described in the embodiment of the present invention may be divided into more components/steps, and two or more components/steps or partial operations of the components/steps may also be combined into a new component/step to achieve the purpose of the embodiment of the present invention.

The above-described method according to an embodiment of the present invention may be implemented in hardware, firmware, or as software or computer code storable in a recording medium such as a CD ROM, a RAM, a floppy disk, a hard disk, or a magneto-optical disk, or as computer code originally stored in a remote recording medium or a non-transitory machine-readable medium downloaded through a network and to be stored in a local recording medium, so that the method described herein may be stored in such software processing on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware such as an ASIC or FPGA. It will be appreciated that the computer, processor, microprocessor controller or programmable hardware includes memory components (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code that, when accessed and executed by the computer, processor or hardware, implements the data processing methods described herein. Further, when a general-purpose computer accesses code for implementing the data processing method shown herein, execution of the code converts the general-purpose computer into a special-purpose computer for executing the data processing method shown herein.

Those of ordinary skill in the art will appreciate that the various illustrative elements and method steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present embodiments.

The above embodiments are only for illustrating the embodiments of the present invention and not for limiting the embodiments of the present invention, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the embodiments of the present invention, so that all equivalent technical solutions also belong to the scope of the embodiments of the present invention, and the scope of patent protection of the embodiments of the present invention should be defined by the claims.

Claims

1. A data processing method is applied to the process of playing interactive media content, and the method comprises the following steps:

receiving voice interaction information input by a user according to the interaction prompt;

determining an interaction heat index of the user for a target object in the interaction media according to the voice interaction information;

and playing the interactive media content matched with the interactive heat index according to the interactive heat index.

2. The method of claim 1, wherein the receiving of the voice interaction information input by the user according to the interaction prompt comprises:

according to the triggering sequence of a plurality of preset voice recognition events, in the interactive media playing process, triggering and displaying interactive prompts corresponding to the voice recognition events;

and receiving voice interaction information input by a user according to the interaction prompt.

3. The method of claim 2, wherein the determining, from the voice interaction information, an interaction heat indicator of the user for a target object in the interactive media comprises:

determining an interaction heat index corresponding to each voice interaction information;

and determining the interactive heat index of the user for the target object in the interactive media according to the interactive heat index corresponding to each piece of voice interactive information.

4. The method of claim 3, wherein the determining the interactive heat index of the user for the target object in the interactive media according to the interactive heat index corresponding to each piece of voice interaction information comprises:

and summing the interactive heat indexes corresponding to the voice interactive information, and determining the interactive heat index of the user to the target object in the interactive media according to the sum result.

5. The method according to any one of claims 2-4, wherein the receiving of the voice interaction information input by the user according to the interaction prompt comprises:

aiming at each voice recognition event, if the interactive media is determined to be played to the voice recognition event, displaying a voice interaction guide prompt, and receiving voice interaction information input by a user according to the voice interaction guide prompt;

wherein the voice interaction guidance prompt comprises at least one of: voice interactive guidance image and voice interactive guidance file.

6. The method of claim 5, wherein the presenting a voice-interactive guidance prompt if it is determined that the interactive media is played to the voice recognition event comprises:

and if the interactive media is determined to be played to the voice recognition event and the display time information of the voice interactive guidance prompt is determined to meet the first preset display time setting, displaying the voice interactive guidance prompt.

7. The method of claim 2, wherein the determining, from the voice interaction information, an interaction heat indicator of the user for a target object in the interactive media comprises:

judging whether each received voice interaction information is empty or not aiming at each voice recognition event;

determining an interaction heat index corresponding to each voice interaction information according to the judgment result;

8. The method of claim 7, wherein the determining the interactive heat index corresponding to each piece of voice interaction information according to the determination result comprises:

if the voice interaction information is determined not to be empty according to the judgment result, judging whether the voice interaction information contains interaction key information;

and if so, determining an interactive heat index corresponding to the voice interactive information.

9. The method of claim 8, wherein the determining whether the voice interaction information includes interaction key information comprises:

displaying a first voice interaction feedback prompt through a playing interface of the interactive media;

and judging whether the voice interaction information contains interaction key information or not in the process of displaying the first voice interaction feedback prompt.

10. The method of claim 9, wherein the first voice-interactive feedback prompt comprises at least one of: the first voice interaction feedback image and the first voice interaction feedback file.

11. The method of claim 7, wherein the determining the interactive heat index corresponding to each piece of voice interaction information according to the determination result comprises:

if the voice interaction information is determined to be empty according to the judgment result, judging whether the current voice interaction operation is the first voice interaction operation;

if so, displaying a second voice interaction feedback prompt; or if not, displaying a third voice interaction feedback prompt;

and acquiring an interaction heat index when the voice interaction information is empty in the process of displaying the second voice interaction feedback prompt or the third voice interaction feedback prompt.

12. The method of claim 11, wherein the second voice-interactive feedback prompt comprises at least one of: a second voice interaction feedback image and a second voice interaction feedback file; or, the third voice interaction feedback prompt includes at least one of: a third voice interaction feedback image and a third voice interaction feedback file.

13. The method of claim 3, wherein after the determining the interaction heat indicator corresponding to each of the voice interaction information, the method further comprises:

displaying a voice interaction result prompt and/or the interaction heat index prompt through a playing interface of the interaction media;

wherein the voice interaction result prompt comprises at least one of: voice interaction result images and voice interaction result documents; the interactive heat index prompt includes at least one of: interactive heat index result image and interactive heat index result file.

14. The method of claim 13, wherein the presenting a voice interaction result prompt through the playing interface of the interactive media comprises:

and if the display time information of the voice interaction result prompt meets a second preset display time setting, displaying the voice interaction result prompt through a playing interface of the interactive media.

15. The method of claim 13, wherein the displaying the interactive heat indicator prompt through the playing interface of the interactive media comprises:

and if the display time information of the interactive heat index prompt meets a third preset display time setting, displaying the interactive heat index prompt through a playing interface of the interactive media.

16. The method of claim 13, wherein displaying the voice interaction result prompt and the interaction popularity indicator prompt through the playing interface of the interactive media comprises:

determining that the display time information prompted by the voice interaction result meets a second preset display time setting, and the display time information prompted by the interaction heat index meets a third preset display time setting;

and displaying the voice interaction result prompt through the playing interface of the interactive media, and displaying the interactive heat index prompt through the playing interface of the interactive media after a preset interval time.

17. The method of claim 1, wherein playing the interactive media content matching the interactive heat indicator according to the interactive heat indicator comprises:

after all voice interaction operations are determined to be completed, determining interactive media content matched with the interactive heat index according to the interactive heat index;

and skipping to the interactive media content and playing according to the skipping setting information of the interactive media.

18. The method of claim 17, wherein jumping to the interactive media content and playing according to jumping setting information of the interactive media comprises:

if the jumping play mode of the interactive media is determined to be started according to the jumping setting information of the interactive media, stopping playing the current interactive media content and jumping to the interactive media content matched with the interactive heat index for playing;

and if the jumping play mode of the interactive media is not started according to the jumping setting information of the interactive media, continuing to play the current interactive media content, and jumping to the interactive media content matched with the interactive heat index for playing after the current interactive media content is played.

19. The method of claim 1, wherein the target object is a character object in the interactive media.

20. A data processing apparatus for application to interactive media content, the apparatus comprising:

the triggering module is used for receiving voice interaction information input by a user according to the interaction prompt in the interactive media playing process;

the determining module is used for determining the interaction heat index of the user for the target object in the interaction media according to the voice interaction information;

and the playing module is used for determining and playing the interactive media content matched with the interactive heat index according to the interactive heat index.

21. An electronic device, comprising:

the display equipment is used for displaying the content of the played interactive media and prompting the user to carry out interactive prompt of voice interactive operation in the playing process of the interactive media;

the voice input equipment is used for receiving voice interaction information input by the user according to the interaction prompt;

the processor is used for determining the interaction heat index of the user for the target object in the interaction media according to the voice interaction information; determining interactive media content matched with the interactive heat index; and playing the determined interactive media content through the display device.

22. The electronic device of claim 21, further comprising a memory;

the memory is configured to at least store interactive media content corresponding to a plurality of interactive media branches, where each interactive media branch corresponds to at least one interactive heat index, or corresponds to at least one interactive heat index range.

23. A computer storage medium, on which a computer program is stored which, when being executed by a processor, carries out the data processing method of any one of claims 1 to 19.