WO2024169975A1

WO2024169975A1 - Session processing method and apparatus, and device and storage medium

Info

Publication number: WO2024169975A1
Application number: PCT/CN2024/077248
Authority: WO
Inventors: 蔡成荣; 杨麒; 张培辉; 牛力
Original assignee: 北京字跳网络技术有限公司
Priority date: 2023-02-17
Filing date: 2024-02-15
Publication date: 2024-08-22
Also published as: CN118524080A

Abstract

Provided in the present disclosure are a session processing method and apparatus, and a device and a storage medium. The method comprises: determining a first target object corresponding to a first user, wherein the first target object is an object in multimedia content; and when a sending operation for first session content is received, displaying, on a session page, second session content corresponding to the first session content, wherein the second session content is determined on the basis of the first session content and the first target object. Therefore, interaction modes of instant messaging are enriched, thereby meeting ever-increasing requirements of a user for diversified session interaction.

Description

A session processing method, device, equipment and storage medium

This application claims priority to the Chinese invention patent application entitled “A session processing method, apparatus, device and storage medium” and application number 202310154269.4, filed on February 17, 2023. The entire contents of this application are incorporated by reference into this application.

Technical Field

The present disclosure relates to the field of data processing, and in particular to a session processing method, apparatus, device and storage medium.

Background Art

With the continuous development of Internet technology, the interaction between users relying on the network is becoming increasingly close. Instant Messaging (IM) has become a more popular communication method on the Internet. Various instant messaging software have emerged in an endless stream, bringing greater convenience to people's interaction in work, study, life, entertainment and other aspects.

However, the conversation modes supported by current instant messaging software are relatively simple and cannot meet users' growing needs for diversified conversation interaction.

Summary of the invention

In order to solve the above technical problems, an embodiment of the present disclosure provides a session processing method.

In a first aspect, the present disclosure provides a session processing method, the method comprising:

Determine a first target object corresponding to the first user; wherein the first target object is an object in the multimedia content;

In response to a sending operation on the first conversation content, a second conversation content corresponding to the first conversation content is displayed on the conversation page; wherein the second conversation content is determined based on the first conversation content and the first target object.

Optionally, before determining the first target object corresponding to the first user, the method further includes:

On the object selection page, multiple object identifiers to be selected are displayed according to a preset classification method;

Accordingly, determining the first target object corresponding to the first user includes:

In response to a selection operation on a target object identifier among the multiple object identifiers to be selected, an object corresponding to the target object identifier is determined as a first target object corresponding to the first user.

Optionally, after displaying multiple to-be-selected object identifiers in a preset classification manner on the object selection page, the method further includes:

In response to a preset trigger operation for a first object identifier among the object identifiers to be selected, displaying an object details page corresponding to the first object identifier;

The object information corresponding to the first object identifier is displayed on the object details page.

Optionally, the object information includes audio information, and after displaying the object information corresponding to the first object identifier on the object details page, the further comprising:

In response to an input operation for first audio data, second audio data corresponding to the first audio data is played; wherein the second audio data is determined based on audio information corresponding to the first object identifier and the first audio data.

Optionally, the first conversation content is user input content, and the second conversation content is audio conversation content determined based on the user input content and audio information of the first target object.

Optionally, in response to the sending operation on the first conversation content, before displaying the second conversation content corresponding to the first conversation content on the conversation page, further includes:

Receiving text content input into an input box on the session page;

Displaying at least one optional conversation content corresponding to the text content on the conversation page; wherein the optional conversation content is determined from a set of sentences associated with the first target object based on the text content;

In response to a selection operation on a target conversation content in the at least one selectable conversation content, the target conversation content is determined as the first conversation content; wherein the target conversation content is an audio conversation content or a text conversation content.

Optionally, a session content generation control is provided on the session page, and in response to the sending operation for the first session content, the first session content is displayed on the session page. Before the second session content corresponding to the content, it also includes:

In response to a trigger operation on the session content generation control, a first session content is generated, and a sending operation on the first session content is performed; wherein the first session content is determined from a set of statements associated with the first target object based on the historical content of this session.

Optionally, after determining the first target object corresponding to the first user, the method further includes:

In response to a selection operation on a first target object corresponding to the first user, the first image identifier of the first user on the conversation page is updated and displayed as a second image identifier related to the first target object.

Optionally, the method further includes: displaying a set of expression images corresponding to the first target object on the conversation page;

In response to a sending operation on a target emoticon image in the emoticon image set corresponding to the first target object, the target emoticon image is displayed on the conversation page.

Optionally, the method also includes: in response to a conversation trigger operation for a three-dimensional virtual image on the conversation page, displaying a scene conversation page; wherein an image display window and a conversation window are provided on the scene conversation page, the image display window is used to display the three-dimensional virtual images corresponding to the first user and the second user respectively in a preset image display scene, and the conversation window is used to display the conversation content between the first user and the second user.

Optionally, the method further includes: displaying, in the image display window, the latest conversation contents corresponding to the first user and the second user respectively.

Optionally, the method further includes: in response to a sending operation for the third session content, sending the third session content to a target server; wherein the target server is used to determine an interactive action corresponding to the third session content;

receiving an interactive action corresponding to the third session content returned by the target server, and controlling the three-dimensional virtual image corresponding to the first user in the image display window to execute the interactive action;

and/or, receiving an interactive action corresponding to the second user from the target server, and controlling the three-dimensional virtual image corresponding to the second user in the image display window, performing Perform an interactive action corresponding to the second user.

Optionally, the method further comprises: displaying an interactive action panel on the scene conversation page; wherein at least one interactive action icon is provided on the interactive action panel;

In response to a trigger operation on a target interactive action icon among the at least one interactive action icon, the three-dimensional virtual image corresponding to the first user in the image display window is controlled to perform an interactive action corresponding to the target interactive action icon.

Optionally, the method further includes: sending a communication request to establish a voice connection or a video connection with the second user based on the scenario conversation page;

When a voice connection or a video connection is successfully established between the first user and the second user, the conversation content input based on the voice connection or the video connection is displayed in the image display window.

Optionally, the method further includes: in response to a video generation operation for a target scenario session triggered on a scenario session page, generating a scenario session video based on the content displayed in the image display window in the target scenario session.

In a second aspect, an embodiment of the present disclosure provides a session processing device, the device comprising:

A first determination module, configured to determine a first target object corresponding to a first user; wherein the first target object is an object in multimedia content;

The first display module is used to display the second session content corresponding to the first session content on the session page in response to the sending operation on the first session content; wherein the second session content is determined based on the first session content and the first target object.

In a third aspect, the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium stores instructions, and when the instructions are executed on a terminal device, the terminal device implements the above method.

In a fourth aspect, the present disclosure provides a session processing device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above method when executing the computer program.

In a fifth aspect, the present disclosure provides a computer program product, the computer program product comprising a computer program/instruction, the computer program/instruction being executed by a processor to implement Now the above method.

Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has at least the following advantages:

The disclosed embodiment provides a conversation processing method, specifically, first determining a first target object corresponding to a first user, wherein the first target object is an object in multimedia content; then, upon receiving a sending operation for the first conversation content, displaying a second conversation content corresponding to the first conversation content on a conversation page; wherein the second conversation content is determined based on the first conversation content and the first target object. It can be seen that the disclosed embodiment implements a conversation interaction function on a conversation page based on the characteristics of objects in multimedia content, enriches the conversation mode of instant messaging, and thus meets the users' growing demand for diversified conversation interactions.

It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

FIG1 is a flow chart of a session processing method provided by an embodiment of the present disclosure;

FIG2 is a schematic diagram of an object selection page provided by an embodiment of the present disclosure;

FIG3 is a schematic diagram of an object information card provided by an embodiment of the present disclosure;

FIG4 is a schematic diagram of an object screening page provided by an embodiment of the present disclosure;

FIG5 is a schematic diagram of an object details page provided by an embodiment of the present disclosure;

FIG6 is a schematic diagram of a session page provided by an embodiment of the present disclosure;

FIG7 is a schematic diagram of another session page provided by an embodiment of the present disclosure;

FIG8 is a schematic diagram of another session page provided by an embodiment of the present disclosure;

FIG9 is a schematic diagram of a scene loading page provided by an embodiment of the present disclosure;

FIG10 is a schematic diagram of a scenario conversation page provided by an embodiment of the present disclosure;

FIG11 is a schematic diagram of another scenario conversation page provided by an embodiment of the present disclosure;

FIG12 is a schematic diagram of a video sharing page provided by an embodiment of the present disclosure;

FIG13 is a schematic diagram of an object matching page provided in an embodiment of the present disclosure;

FIG14 is a schematic diagram of a matching result page provided by an embodiment of the present disclosure;

FIG15 is a schematic diagram of the structure of a session processing device provided in an embodiment of the present disclosure;

FIG. 16 is a schematic diagram of the structure of a session processing device provided in an embodiment of the present disclosure.

DETAILED DESCRIPTION

In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

In the related art, the conversation mode supported by instant messaging is relatively single, which cannot meet the users' growing needs for diversified conversation interaction. To this end, the embodiments of the present disclosure provide a conversation processing method. First, determine the first target object corresponding to the first user, wherein the first target object belongs to an object in the multimedia content; then, upon receiving a sending operation for the first conversation content, display the second conversation content corresponding to the first conversation content on the conversation page; wherein the second conversation content is determined based on the first conversation content and the first target object. It can be seen that the embodiments of the present disclosure implement the conversation interaction function on the conversation page based on the characteristics of the objects in the multimedia content, enrich the conversation mode of instant messaging, and thus meet the users' growing needs for diversified conversation interaction.

Based on this, the embodiment of the present disclosure further provides a session processing method. Referring to FIG1 , which is a flow chart of a session processing method provided by the embodiment of the present disclosure, the method includes:

S101: Determine a first target object corresponding to a first user.

The first target object is an object in multimedia content.

In the embodiments of the present disclosure, multimedia content may include movies, TV series, documentaries, cartoons, short videos, online games, etc., and objects in multimedia content may include Roles, such as film and television roles, animal characters in animal-related documentaries, animation characters, game characters, etc.

The present disclosure provides the following three methods for determining the first target object corresponding to the first user, which are as follows:

First, the first user can actively select the first target object through the identifier of the selected object displayed on the object selection page.

Specifically, first, on the object selection page, multiple object identifiers are displayed according to a preset classification method; wherein the preset classification method may include a classification method according to at least one of the object recommendation degree, the genre of the multimedia content to which the object belongs, and the object usage time information. Specifically, the object recommendation degree refers to the degree of recommendation of each object; the genre of the multimedia content to which the object belongs may include the genre of film and television drama, the genre of game, the genre of animal world documentary, the genre of animation, etc.; the object usage time information refers to the usage time dimension of each object by the first user.

As shown in FIG. 2, a schematic diagram of an object selection page provided by an embodiment of the present disclosure is provided, wherein the identifiers of the objects to be selected displayed on the object selection page include the identifiers of the objects most recently used by the first user, and taking object identifier 201 as an example, also include identifiers of objects with high recommendation degrees, and identifiers of objects classified according to the genre of the multimedia content to which the objects belong, etc. Among them, the identifiers of the objects to be selected may include object icons, etc., and may also include object names, etc. The embodiment of the present disclosure does not limit the display method of the identifiers of the objects to be selected.

In the disclosed embodiment, based on the identifier of the selected object displayed on the object selection page, the first user can select the first target object based on the needs. Specifically, when receiving the selection operation for the target object identifier, the object corresponding to the target object identifier is determined as the first target object corresponding to the first user, so that the function of the first user actively selecting the desired object is realized, and the user's object selection needs are met.

Second, through the random selection control set on the object selection page, the first user can trigger the random selection of the first target object.

Specifically, as shown in FIG. 2 , a random selection control 202 is provided on the object selection page. When a trigger operation for the random selection control 202 is received, a first target object corresponding to the first user can be randomly determined from objects corresponding to a plurality of object identifiers to be selected.

In an optional implementation, when a trigger operation for the random selection control 202 is received, the first target object corresponding to the first user is randomly determined from the objects corresponding to the multiple candidate object identifiers, and the object information card corresponding to the first target object is displayed. As shown in FIG3, a schematic diagram of an object information card provided by an embodiment of the present disclosure is shown, wherein a "change one" control 301 may be provided on the object information card, which is used to trigger the random switching of objects when the first user is not satisfied with the object currently displayed on the object information card. In addition, a "role details" control 302 may also be provided on the object information card to trigger the display of the object details page.

Third: the first user can filter out the first target object that meets his needs by inputting object screening information.

Specifically, based on the object filtering information input by the first user, the first target object corresponding to the first user is determined; wherein the object filtering information is used to describe the characteristics of the object required by the first user. As shown in FIG4, a schematic diagram of an object filtering page provided in an embodiment of the present disclosure is provided, wherein the user can input object filtering information based on a slider, (A-H shown in FIG4 are used to represent different filtering information, corresponding to different filtering conditions, respectively). Based on the object filtering information input by the user, at least one optional object identifier, such as optional object identifier 401, can be displayed on the object filtering page, and the first user can select the first target object from the at least one optional object identifier. In addition, a "change a group" control 402 can also be provided on the object filtering page, which is used to trigger the re-determination of the next group of optional object identifiers based on the object filtering information input by the first user when the first user is not satisfied with the currently displayed optional object identifiers.

It should be noted that the above three methods are only used as examples to introduce the methods for determining the first target object, and cannot be used as limitations on the methods for determining the first target object.

In an optional implementation, the display operation of the corresponding object details page can also be triggered for the selected object identifier displayed on the object selection page. As shown in FIG2, when a preset trigger operation for the first object identifier 201 is received, the object details page corresponding to the first object identifier 201 is displayed. The first object identifier can be any object identifier on the object selection page. As shown in FIG5, a schematic diagram of an object details page provided in an embodiment of the present disclosure is shown, and the object corresponding to the first object identifier 201 is displayed on the object details page. information.

In another optional implementation, upon receiving a trigger operation for any optional object identifier (such as optional object identifier 401) displayed on the object filtering page as shown in FIG. 4 , the object details page corresponding to the optional object identifier can also be displayed, and the object information corresponding to the optional object identifier can be displayed on the object details page.

The object information displayed on the object details page in the disclosed embodiment may include object introduction information, wonderful video clips associated with the object, a set of sentences associated with the object, object audio information, etc. The first user can gain a deeper understanding of the object through the object information and decide whether to select it as the first target object.

In an optional implementation, the first user can learn about the audio information of the object by inputting audio data. Specifically, after receiving the first audio data input by the first user, based on the object audio information of the currently displayed object on the object details page, the first audio data is converted into second audio data corresponding to the object, and the second audio data is played; wherein, the conversion of the first audio data into the second audio data corresponding to the object can be executed on the client or on the server. The second audio data is audio data played with the audio information of the object. By playing the second audio data, the first user can understand the audio characteristics of the currently displayed object, thereby deciding whether to use it as the first target object.

In addition, as shown in FIG. 5 , a “play this role” control 501 may be provided on the object details page to trigger determination of the current display object on the object details page as the first target object corresponding to the first user.

S102: In response to a sending operation on the first conversation content, display a second conversation content corresponding to the first conversation content on the conversation page.

The second conversation content is determined based on the first conversation content and the first target object.

In the embodiment of the present disclosure, after determining the first target object corresponding to the first user, a conversation page may be displayed, and on the conversation page, based on the characteristics of the first target object, the conversation content may be sent to the second user. The first user and the second user may interact with each other in a conversation based on the conversation page. It is worth noting that the conversation page may also be a group conversation page, that is, a conversation page that supports a conversation interaction function for multiple people (e.g., not less than 3 people).

The feature of the first target object may include at least one of audio features, language expression features, action features, etc. The disclosed embodiment does not limit the type of feature, and any feature that can express any dimensional characteristics of the first target object can be used as the feature of the first target object.

In an optional embodiment, when a sending operation for the first session content is received, the first session content can be sent to the server. The server can convert the first session content into second session content based on the characteristics of the first target object corresponding to the first user, and return the second session content so that the second session content can be displayed on the session page of the first user's client.

On the conversation page, the first user sends conversation content to the second user based on the characteristics of the first target object, that is, the characteristics of the first target object are integrated into the conversation content sent by the first user to the second user, which not only expresses the first user's conversation content to the second user, but also enhances the second user's conversation experience when browsing the conversation content from an entertainment perspective.

In an optional implementation, after determining the first target object corresponding to the first user, a resource card corresponding to the first target object is first displayed on the conversation page to display the object resources of the first target object, so that the second user can learn about the first target object corresponding to the first user through the resource card. As shown in FIG6 , a schematic diagram of a conversation page provided in an embodiment of the present disclosure is shown, on which a resource card 600 is displayed, on which the object resources of the first target object corresponding to the first user are displayed, and the object resources may include information that can describe the object, such as an object image, an object image animation, and an object name.

In addition, the resource card can also be used to initiate an object session invitation to the second user. The second user can enter the object selection page by clicking the resource card on the session page, thereby determining the second target object for the second user. When the first user's client receives the object selection message triggered by the second user for the object session invitation, an object selection mark is displayed on the resource card, such as the object selection mark 610 shown in FIG6, which is used to indicate that the second user has selected the object. In the case where the object selection message triggered by the second user for the object session invitation is not received, a prompt message "waiting for the other party to select a role" is displayed on the object card to indicate that the second user has not yet selected an object.

In an optional implementation manner, as shown in FIG6 , an embodiment of the present disclosure provides Schematic diagram of a conversation page, wherein on the conversation page, the first user can input voice content through the voice input control 601, or can input text content in the text input box 602. After receiving the user input content, the user input content is converted into the audio conversation content of the first target object, that is, the second conversation content, according to the audio information of the first target object corresponding to the first user. Then, the audio conversation content is sent to the second user on the conversation page, such as the audio conversation content 603 shown in FIG6. The audio conversation content carries the user input content of the first user, and the input content of the first user is expressed by the audio features of the first target object. The user input content can be text input content or voice input content.

In response to the sending operation for the user input content, the user input content is sent to the server, and the server converts the user input content into the audio conversation content corresponding to the first target object, that is, the second conversation content, according to the audio information of the first target object corresponding to the first user. The specific method can adopt a high-fidelity global automatic voice conversion method, and the specific implementation method is not limited in the embodiments of the present disclosure.

In another optional implementation, a conversation content generation control may be provided on the conversation page, such as the conversation content generation control 604 shown in FIG6 . When a trigger operation is received for the conversation content generation control 604, the second conversation content may be determined from the sentence set associated with the first target object based on the historical content of this conversation, and the second conversation content may be sent to the second user on the conversation page. Each object is associated with a sentence set, and the sentence set may include the words frequently expressed by the object in the multimedia content (such as a film or TV series) to which it belongs. The historical content of this conversation includes the historical conversation content between the first user and the second user, which is directly displayed or hidden on the current conversation page (i.e., it can be redisplayed by dragging the page).

In an optional embodiment, after receiving a message from a user triggering a session content generation control, the server determines the intent of the first user's session content by analyzing the historical content of the session, and then determines the second session content from the sentence set associated with the first target object based on the analyzed intent of the session content, that is, the sentence that best expresses the intent of the session content, and then sends the second session content to the second user based on the session page, wherein the second session content may be text session content or audio session content. The second conversation content not only expresses the first user's reply intention, but also combines the characteristics of the first target object, thereby improving the conversation experience of the second user when browsing the second conversation content.

In another optional implementation, as shown in FIG7 , it is a schematic diagram of another conversation page provided by an embodiment of the present disclosure, wherein the first user can input text content in an input box 701 on the conversation page. After receiving the first text content input by the first user, firstly based on the first text content, at least one optional conversation content is determined from the sentence set associated with the first target object, wherein the optional conversation content is a sentence associated with the first target object determined based on a keyword in the text content input by the first user.

After determining at least one optional conversation content from the set of sentences associated with the first target object, display each optional conversation content on the conversation page for the second user to select. When receiving a selection operation for a target conversation content in the optional conversation content, the selected target conversation content, i.e., the first conversation content, is sent to the second user on the conversation page. The first conversation content may be a text conversation content or an audio conversation content.

In order to enhance the conversation interaction immersion of both parties, the disclosed embodiment may also update the first image identifier of the first user on the conversation page to a second image identifier related to the first target object, wherein the second image identifier may be an avatar of the first target object, etc. The icon 605 shown in FIG6 displays the avatar of the first target object corresponding to the first user.

In addition, in order to further enrich the functional diversity of conversation interaction, the disclosed embodiment can use the expression image set of the first target object to conduct a conversation on the conversation page. Specifically, the expression image set of the first target object is displayed on the conversation page. The expression image set of the first target object is displayed on the expression package panel 606 as shown in Figure 6, which may specifically include multiple expression images, expression animations, etc. On the conversation page, the first user can use the expression image set of the first target object to send the conversation content to the second user. Specifically, the first user can select an expression image or an expression animation from the expression package panel 606 and send it to the second user on the conversation page to realize the function of conversation interaction.

In the session processing method provided by the embodiment of the present disclosure, firstly, a first target object corresponding to a first user is determined, wherein the first target object belongs to an object in multimedia content; then, When a sending operation for the first conversation content is received, the second conversation content corresponding to the first conversation content is displayed on the conversation page; wherein the second conversation content is determined based on the first conversation content and the first target object. It can be seen that the embodiment of the present disclosure implements the conversation interaction function on the conversation page based on the characteristics of the objects in the multimedia content, enriches the conversation mode of instant messaging, and thus meets the growing diversified conversation interaction needs of users.

On the basis of the above-mentioned embodiment, the embodiment of the present disclosure can also perform conversation interaction based on the three-dimensional virtual image. Specifically, when a conversation trigger operation for the three-dimensional virtual image on the conversation page is received, the scene conversation page is displayed. The scene conversation page is provided with an image display window and a conversation window. The image display window is used to display the three-dimensional virtual images corresponding to the first user and the second user respectively in a preset image display scene, and the conversation window is used to display the conversation content between the first user and the second user.

In an optional implementation, the conversation triggering operation for the three-dimensional virtual image may include: when the first user and the second user both select the object for setting the three-dimensional virtual image, triggering the entry into the scene conversation page. As shown in FIG5 , a three-dimensional virtual image control 500 of the object is displayed on the object details page. When it is determined that the first user and the second user both select the object of the three-dimensional virtual image based on the object selection page, the three-dimensional virtual resource cards corresponding to the two are displayed on the conversation page, and the entry into the scene conversation page is triggered. As shown in FIG8 , it is a schematic diagram of another conversation page provided in an embodiment of the present disclosure, wherein the conversation page displays a three-dimensional virtual resource card 801 corresponding to the first user and a three-dimensional virtual resource card 802 corresponding to the second user.

Before entering the scene session page, the scene loading page can be displayed first. As shown in Figure 9, it is a schematic diagram of a scene loading page provided in an embodiment of the present disclosure. The scene loading page displays three-dimensional virtual images of objects corresponding to the first user and the second user, respectively, for display during the process of loading the scene session page.

In actual applications, after entering the scene conversation page, a preset image display scene can be displayed in the image display window on the scene conversation page, and the three-dimensional virtual images corresponding to the first user and the second user can be displayed in the preset image display scene. As shown in FIG10, a schematic diagram of a scene conversation page provided by an embodiment of the present disclosure is shown, in which the scene conversation window is displayed in the scene conversation window. The image display window 1001 on the page displays a preset image display scene, and displays the three-dimensional virtual images corresponding to the first user and the second user respectively in the preset image display scene, and displays the latest input conversation content corresponding to the first user and the second user respectively in a dialogue manner. In addition, the conversation window 1002 on the scene conversation page is used to display the conversation content.

In order to further enrich the diversity of the interactive functions of the conversation, the embodiment of the present disclosure can also control the three-dimensional virtual image corresponding to the first user in the image display window to perform the interactive action corresponding to the current input content based on the current input content of the first user. Specifically, for the three-dimensional virtual image corresponding to the first user, a correspondence between input keywords and interactive actions is pre-set, and for the input keyword carried in the current input content of the first user, the corresponding interactive action is determined, and the three-dimensional virtual image corresponding to the first user is controlled to perform the interactive action, thereby enriching the diversity of the interactive functions of the conversation.

In addition, for the current input content of the second user, on the scene conversation page of the first user, the three-dimensional virtual image corresponding to the second user in the image display window is controlled to perform the interactive action corresponding to the current input content. The specific implementation method can be understood by referring to the above content.

In an optional implementation, an interactive action panel may also be displayed on the scene conversation page, such as the interactive action panel 1003 shown in FIG10 , and at least one interactive action icon is provided on the interactive action panel 1003 , and upon receiving a trigger operation for a target interactive action icon, the three-dimensional virtual image corresponding to the first user in the image display window may be controlled to perform the interactive action corresponding to the target interactive action icon. For example, when the first user clicks the "sit down" interactive action icon on the interactive action panel 1003 , the three-dimensional virtual image corresponding to the first user in the image display window is controlled to perform the "sit down" interactive action.

In order to further enrich the diversity of conversation interaction functions, the embodiment of the present disclosure can also establish a voice connection or a video connection between the first user and the second user on the scene conversation page, and then perform conversation interaction based on the voice connection or the video connection. The specific method of establishing the voice connection or the video connection is not limited in the embodiment of the present disclosure.

In an optional implementation, firstly, a voice connection or a video connection is established between the first user and the second user based on the scene conversation page. Then, the conversation content input based on the voice connection or the video connection is displayed in the image display window. A schematic diagram of another scenario conversation page provided in an embodiment is provided, wherein the conversation content respectively input by the first user and the second user is displayed in the form of a dialogue in the image display window on the scenario conversation page. The conversation content is respectively input by both users based on a voice connection or a video connection.

In actual applications, after receiving the conversation content input by the user based on the voice connection or video connection, voice recognition is performed to obtain the text conversation content, and the text conversation content is displayed in the form of a dialogue in the image display window on the scene conversation page.

The conversation processing method provided by the embodiment of the present disclosure can further enrich the conversation interaction functions implemented on the conversation page by conducting conversation interaction through a three-dimensional virtual image, thereby enriching the conversation mode of instant messaging and further meeting the users' growing and diversified conversation interaction needs.

On the basis of the above-mentioned embodiment, the materials in the user conversation process, such as the conversation content, the content displayed in the image display window, etc., can be obtained and used as the materials for generating the video.

In an optional implementation, when a video generation operation for a target scenario session is received that is triggered on a session scenario page, a scenario session video can be generated based on the content displayed in the image display window in the target scenario session, thereby enriching the generated video types.

In another optional implementation, the first user can also share or publish the generated scene conversation video. As shown in FIG12, it is a schematic diagram of a video sharing page provided in an embodiment of the present disclosure, wherein in the preview window 1201 on the video sharing page, the generated scene conversation video can be previewed and played, and the scene conversation video is a video generated based on the voice input content and the content displayed in the image display window. In the conversation record window 1202 on the video sharing page, the conversation content is displayed in real time based on the time information of the preview playback.

In addition, the video sharing page is provided with a "Send to Friends" control 1203 and a "Publish" control 1204. The "Send to Friends" control 1203 is used to share the scene conversation video with designated friends, and the "Publish" control 1204 is used to upload the scene conversation video to the server, which is then published by the server, thereby enriching the video-related functions.

In addition, in each of the above embodiments, before entering the session page, the first user first First, a user who has a conversation with the first user, ie, the second user, is determined.

In an optional implementation, the second user may be determined for the first user based on a random matching method. Specifically, when a session user matching operation is received, the second user is determined based on a preset object matching condition.

The preset object matching condition may include selecting a user with an object or selecting a user with an object belonging to the same multimedia content as the first target object.

As shown in Figure 13, it is a schematic diagram of an object matching page provided in an embodiment of the present disclosure, wherein on the object matching page, the first user can trigger the random determination of the first target user from all users who have selected the object by selecting the "All Roles" control 1301, and the first user can also trigger the random determination of the second user from users who have set objects belonging to the same multimedia content as the first target object by selecting the "Same TV Series Roles" control 1302, for example, selecting a user who has selected an object in the same TV series as the first target object of the first user as the second user.

After the second user is randomly determined, the first target object corresponding to the first user and the second target object corresponding to the second user are displayed on the matching result page, as shown in FIG14, which is a schematic diagram of a matching result page provided by an embodiment of the present disclosure, on which the first target object 1401 corresponding to the first user and the second target object 1402 corresponding to the second user are displayed, as well as a start session control 1403. After receiving a trigger operation for the start session control 1403, the session page between the first user and the second user is entered, such as the session page shown in FIG6 and FIG7 above.

The conversation content between the first user and the second user is displayed on the conversation page, and a "drama value" can be generated based on the conversation content and the duration of the conversation between the two to represent the excitement of the conversation content.

In addition, in each of the above embodiments, there may be multiple paths for triggering the execution of the session processing method of the embodiments of the present disclosure.

In an optional implementation, the object conversation mode can be entered through the message center page. In the object conversation mode, after selecting the second user, the conversation page can be entered, and object conversation interaction can be implemented based on the conversation page. The specific implementation method can be referred to the description of the above embodiments and will not be repeated here.

In another optional implementation, an entrance to the object conversation mode may be provided on the conversation page. On the conversation page between the first user and the second user, the object conversation mode may be entered through the entrance, and object conversation interaction may be implemented based on the conversation page. The specific implementation method may refer to the description of the above-mentioned embodiments and will not be repeated here.

It is worth noting that the embodiment of the present disclosure does not limit the path for triggering the execution of the session processing method of the embodiment of the present disclosure, and the above two paths are only used as examples.

Based on the above method embodiment, the present disclosure further provides a session processing device. Referring to FIG15 , a structural diagram of a session processing device provided by an embodiment of the present disclosure is shown. The device includes:

A first determination module 1501 is used to determine a first target object corresponding to a first user; wherein the first target object is an object in multimedia content;

The first display module 1502 is used to display the second session content corresponding to the first session content on the session page in response to the sending operation on the first session content; wherein the second session content is determined based on the first session content and the first target object.

In an optional implementation, the device further includes:

The second display module is used to display multiple identifications of objects to be selected according to a preset classification method on the object selection page;

Accordingly, the first determining module is specifically configured to:

In an optional implementation, the device further includes:

A third display module, configured to display an object details page corresponding to a first object identifier among the object identifiers to be selected in response to a preset trigger operation for the first object identifier;

A fourth display module is used to display the object information corresponding to the first object identifier on the object details page.

In an optional implementation manner, the object information includes audio information, and the device Also includes:

A playing module is used to play second audio data corresponding to the first audio data in response to an input operation on the first audio data; wherein the second audio data is determined based on the audio information corresponding to the first object identifier and the first audio data.

In an optional implementation manner, the first conversation content is user input content, and the second conversation content is audio conversation content determined based on the user input content and audio information of the first target object.

In an optional implementation, the device further includes:

A first receiving module, used to receive text content input into an input box on the conversation page;

a fifth display module, configured to display at least one optional conversation content corresponding to the text content on the conversation page; wherein the optional conversation content is determined from a set of sentences associated with the first target object based on the text content;

The second determination module is configured to determine the target conversation content as the first conversation content in response to a selection operation on a target conversation content in the at least one optional conversation content; wherein the target conversation content is an audio conversation content or a text conversation content.

In an optional implementation manner, a session content generation control is provided on the session page, and the device further includes:

A content generation module is used to generate a first conversation content in response to a trigger operation on the conversation content generation control, and to perform a sending operation on the first conversation content; wherein the first conversation content is determined from a set of sentences associated with the first target object based on the historical content of this conversation.

In an optional implementation, the device further includes:

The update display module is used to update and display the first image identifier of the first user on the conversation page to a second image identifier related to the first target object in response to a selection operation on the first target object corresponding to the first user.

In an optional implementation, the device further includes:

A sixth display module, configured to display a set of expression images corresponding to the first target object on the conversation page;

The seventh display module is used to display the target expression image on the conversation page in response to a sending operation of a target expression image in the expression image set corresponding to the first target object.

In an optional implementation, the device further includes:

A scene display module is used to display a scene conversation page in response to a conversation trigger operation for a three-dimensional virtual image on the conversation page; wherein, an image display window and a conversation window are provided on the scene conversation page, the image display window is used to display the three-dimensional virtual images corresponding to the first user and the second user respectively in a preset image display scene, and the conversation window is used to display the conversation content between the first user and the second user.

In an optional implementation, the device further includes:

An eighth display module is used to display the latest conversation contents corresponding to the first user and the second user respectively in the image display window.

In an optional implementation, the device further includes:

A content sending module, configured to send the third session content to a target server in response to a sending operation on the third session content; wherein the target server is configured to determine an interactive action corresponding to the third session content;

A second receiving module is used to receive the interactive action corresponding to the third session content returned by the target server, and control the three-dimensional virtual image corresponding to the first user in the image display window to perform the interactive action;

And/or, a third receiving module is used to receive the interactive action corresponding to the second user from the target server, and control the three-dimensional virtual image corresponding to the second user in the image display window to execute the interactive action corresponding to the second user.

In an optional implementation, the device further includes:

A ninth display module, configured to display an interactive action panel on the scene conversation page; wherein at least one interactive action icon is provided on the interactive action panel;

An action control module is used to control the three-dimensional virtual image corresponding to the first user in the image display window in response to a trigger operation on a target interactive action icon in the at least one interactive action icon, and execute the interactive action corresponding to the target interactive action icon.

In an optional implementation, the device further includes:

A request sending module, used for sending a communication request to establish a voice connection or a video connection with the second user based on the scenario conversation page;

The tenth display module is used to display the conversation content input based on the voice connection or the video connection in the image display window when a voice connection or a video connection is successfully established between the first user and the second user.

In an optional implementation, the device further includes:

The video generation module is used to generate a scene session video based on the content displayed in the image display window in the target scene session in response to a video generation operation for the target scene session triggered on the scene session page.

In the conversation processing device provided by the embodiment of the present disclosure, the first target object corresponding to the first user is first determined, wherein the first target object belongs to an object in the multimedia content; then, when a sending operation for the first conversation content is received, the second conversation content corresponding to the first conversation content is displayed on the conversation page; wherein the second conversation content is determined based on the first conversation content and the first target object. It can be seen that the embodiment of the present disclosure implements the conversation interaction function on the conversation page based on the characteristics of the objects in the multimedia content, enriches the conversation mode of instant messaging, and thus meets the users' growing diversified conversation interaction needs.

In addition to the above-mentioned method and apparatus, the embodiment of the present disclosure further provides a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a terminal device, the terminal device implements the session processing method described in the embodiment of the present disclosure.

The embodiment of the present disclosure further provides a computer program product, which includes a computer program/instructions. When the computer program/instructions are executed by a processor, the session processing method described in the embodiment of the present disclosure is implemented.

In addition, the embodiment of the present disclosure further provides a session processing device, as shown in FIG16 , which may include:

Processor 1601, memory 1602, input device 1603 and output device 1604. The number of processors 1601 in the session processing device can be one or more, and one processor is used as an example in FIG16. In some embodiments of the present disclosure, processor 1601, memory 1602, input device 1603 and output device 1604 are provided. The input device 1603 and the output device 1604 may be connected via a bus or other means, wherein FIG16 takes the connection via a bus as an example.

The memory 1602 can be used to store software programs and modules. The processor 1601 executes various functional applications and data processing of the session processing device by running the software programs and modules stored in the memory 1602. The memory 1602 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function, etc. In addition, the memory 1602 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. The input device 1603 can be used to receive input digital or character information, and generate signal input related to user settings and function control of the session processing device.

Specifically in this embodiment, the processor 1601 will load the executable files corresponding to the processes of one or more applications into the memory 1602 according to the following instructions, and the processor 1601 will run the applications stored in the memory 1602, thereby realizing various functions of the above-mentioned session processing device.

It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

The above description is only a specific embodiment of the present disclosure, which enables those skilled in the art to understand or implement the present disclosure. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to The present invention is intended to be limited to the embodiments described herein, but is to be consistent with the widest scope consistent with the principles and novel features disclosed herein.

Claims

A session processing method, the method comprising:

Determine a first target object corresponding to the first user; wherein the first target object is an object in the multimedia content;

In response to a sending operation on a first conversation content, a second conversation content corresponding to the first conversation content is displayed on a conversation page; wherein the second conversation content is determined based on the first conversation content and the first target object.
The method according to claim 1, before determining the first target object corresponding to the first user, further comprising:

On the object selection page, multiple object identifiers to be selected are displayed according to a preset classification method;

Accordingly, determining the first target object corresponding to the first user includes:

In response to a selection operation on a target object identifier among the multiple object identifiers to be selected, an object corresponding to the target object identifier is determined as a first target object corresponding to the first user.
The method according to claim 2, after displaying multiple to-be-selected object identifiers in a preset classification manner on the object selection page, further comprising:

In response to a preset trigger operation for a first object identifier among the object identifiers to be selected, displaying an object details page corresponding to the first object identifier;

The object information corresponding to the first object identifier is displayed on the object details page.
The method according to claim 3, wherein the object information includes audio information, and after displaying the object information corresponding to the first object identifier on the object details page, further comprising:

In response to an input operation for first audio data, second audio data corresponding to the first audio data is played; wherein the second audio data is determined based on audio information corresponding to the first object identifier and the first audio data.
According to the method according to claim 1, the first conversation content is user input content, and the second conversation content is audio conversation content determined based on the user input content and audio information of the first target object.
According to the method of claim 1, in response to the sending operation for the first session content, before displaying the second session content corresponding to the first session content on the session page, the method further comprises:

Receiving text content input into an input box on the session page;

Displaying at least one optional conversation content corresponding to the text content on the conversation page; wherein the optional conversation content is determined from a set of sentences associated with the first target object based on the text content;

In response to a selection operation on a target conversation content in the at least one selectable conversation content, the target conversation content is determined as the first conversation content; wherein the target conversation content is an audio conversation content or a text conversation content.
According to the method of claim 1, a session content generation control is provided on the session page, and the method in response to the sending operation for the first session content, before displaying the second session content corresponding to the first session content on the session page, further comprises:

In response to a trigger operation on the session content generation control, a first session content is generated, and a sending operation on the first session content is performed; wherein the first session content is determined from a set of statements associated with the first target object based on the historical content of this session.
The method according to claim 1, after determining the first target object corresponding to the first user, further comprising:

In response to a selection operation on a first target object corresponding to the first user, the first image identifier of the first user on the conversation page is updated and displayed as a second image identifier related to the first target object.
The method according to claim 1, further comprising:

Displaying a set of emoticon images corresponding to the first target object on the conversation page;

In response to a sending operation on a target emoticon image in the emoticon image set corresponding to the first target object, the target emoticon image is displayed on the conversation page.
The method according to claim 1, further comprising:

In response to a conversation trigger operation for the virtual image on the conversation page, a scene conversation page is displayed; wherein the scene conversation page is provided with an image display window and a conversation window. The image display window is used to display the virtual images corresponding to the first user and the second user respectively in a preset image display scene, and the conversation window is used to display the conversation content between the first user and the second user.
The method according to claim 10, further comprising:

In the image display window, the latest conversation contents corresponding to the first user and the second user are displayed respectively.
The method according to claim 10, further comprising:

In response to the sending operation for the third session content, the third session content is sent to a target server; wherein the target server is used to determine an interactive action corresponding to the third session content;

receiving an interactive action corresponding to the third session content returned by the target server, and controlling the three-dimensional virtual image corresponding to the first user in the image display window to execute the interactive action;

And/or, receiving an interactive action corresponding to the second user from the target server, and controlling the three-dimensional virtual image corresponding to the second user in the image display window to execute the interactive action corresponding to the second user.
The method according to claim 10, further comprising:

Displaying an interactive action panel on the scene session page; wherein at least one interactive action icon is provided on the interactive action panel;

In response to a trigger operation on a target interactive action icon among the at least one interactive action icon, the three-dimensional virtual image corresponding to the first user in the image display window is controlled to perform an interactive action corresponding to the target interactive action icon.
The method according to claim 10, further comprising:

Based on the scenario conversation page, sending a communication request to establish a voice connection or a video connection with the second user;

When a voice connection or a video connection is successfully established between the first user and the second user, the conversation content input based on the voice connection or the video connection is displayed in the image display window.
The method according to any one of claims 10 to 14, further comprising include:

In response to a video generation operation for a target scenario session triggered on a scenario session page, a scenario session video is generated based on the content displayed in the image display window in the target scenario session.
A session processing device, the device comprising:

A first determination module, configured to determine a first target object corresponding to a first user; wherein the first target object is an object in multimedia content;

The first display module is used to display the second session content corresponding to the first session content on the session page in response to the sending operation on the first session content; wherein the second session content is determined based on the first session content and the first target object.
A computer-readable storage medium having instructions stored therein, which, when executed on a terminal device, enables the terminal device to implement the method according to any one of claims 1 to 15.
A session processing device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method according to any one of claims 1 to 15 is implemented.