WO2022041201A1

WO2022041201A1 - Interaction method employing virtual intelligent character, client, and system

Info

Publication number: WO2022041201A1
Application number: PCT/CN2020/112493
Authority: WO
Inventors: 马宇尘
Original assignee: 深圳市永兴元科技股份有限公司
Priority date: 2020-08-29
Filing date: 2020-08-31
Publication date: 2022-03-03
Also published as: CN112215062A

Abstract

Disclosed are an interaction method employing a virtual intelligent character, a client, and a system, relating to the technical field of communication interaction. An interaction method employing a virtual intelligent character comprises the following steps: configuring a virtual intelligent character of a user on a communication interaction platform, wherein the virtual intelligent character is different from a real social identity of the user on the communication interaction platform; acquiring virtual intelligent character information configured by a contact object of the user; and establishing communication between the virtual intelligent character of the user and a virtual intelligent character of the contact object so as to exchange information. In the present invention, the virtual intelligent character corresponding to the user is configured, and communication is established between respective virtual intelligent characters of the user and the contact so as to exchange information, thereby providing an an ice-breaker in the initial stage of communication between the user and the contact, and eliminating an obstacle in the initial stage of communication between strangers.

Description

Interactive method, client and system based on virtual intelligent character

technical field

The present invention relates to the technical field of communication interaction.

Background technique

Social networks have a large number of users scattered all over the world, but these large numbers of users will naturally aggregate to form various groups based on some common hobbies, purposes or certain associations. Members of a group generally have multiple network identities, and they can use multiple identities to use a variety of social networking applications to connect with other members of the group to form a specific social network.

In the current traditional social communication system, it is usually necessary to manually trigger a search or add a contact, and interact with social information through text information, voice, pictures, or video image information. There are the following limitations: the manual trigger search or the way of adding contacts is more suitable for user objects with clear goals, and the communication object is single; especially for the unfamiliar contacts found by manual trigger search, there is often a lack of communication bridges, and no one knows How to take the first step in communication cannot solve the obstacles of initial communication between strangers.

technical problem

The purpose of the present invention is to overcome the deficiencies of the prior art and provide an interaction method, client and system based on virtual intelligent characters. By setting up virtual intelligent characters corresponding to users, and establishing communication between users and contacts to communicate with each other, the present invention acts as an ice-breaking journey in the initial stage of communication between users and contacts, and solves the obstacles in the initial stage of communication between strangers question.

technical solutions

To achieve the above-mentioned goals, the present invention provides the following technical solutions:

An interaction method based on a virtual intelligent role, comprising the steps of: setting a user's own virtual intelligent role on a communication interaction platform, the virtual intelligent role being different from the user's real social identity on the communication interaction platform; acquiring the user's contacts The virtual intelligent role information set by the object; the user's own virtual intelligent role establishes communication with the virtual intelligent role of the contact object for information exchange.

Further, the interaction information between the aforementioned virtual intelligent characters is collected, and after analysis, the part of the interaction information that meets the preset conditions is obtained to generate streaming media data output.

Further, it also includes steps:

generating and outputting to the user a chat record based on the interaction information between the user's own virtual intelligent character and the virtual intelligent character of the contact object, the chat record including the interaction role, time, place and/or content;

Determine whether the user is interested in the aforementioned chat records;

When it is determined that the user is interested, the user's real social identity is triggered to establish communication with the real social identity of the aforementioned contact object.

Further, the way to determine whether the user is interested in the aforementioned chat records is:

Collect the image information of the user reading the aforementioned chat records, and obtain the user's body movements, facial and/or voice information in the image;

It is determined that the user is interested when the aforementioned body motion, face and/or sound information meets the preset conditions.

Further, it also includes steps:

Collect the interaction frequency and/or interaction duration information between the user's own virtual intelligent character and the contact object's virtual intelligent character,

When the aforementioned interaction frequency and/or interaction duration information meets the preset conditions, the user's real social identity is triggered to establish communication with the aforementioned real social identity of the contact object.

Preferably, the virtual interaction strength between the user and the contact object is analyzed according to the aforementioned interaction frequency and/or interaction duration, and the display information of the own virtual intelligent character is adjusted according to the virtual interaction strength.

Preferably, the virtual interaction intensity is divided into multiple levels, and different virtual intelligent character images are correspondingly displayed at different virtual interaction intensity levels; more beautiful virtual intelligent character images are displayed for contact objects with high virtual interaction intensity levels.

Further, the communication interaction platform is an IM communication platform, a short message SMS communication platform, a web interface communication platform, an email communication platform and/or a game interaction communication platform.

Further, a deep learning method is used to inductively learn the user's chat mode information, and the user's own virtual intelligent character imitates the user's chat mode to interact with the contact object's virtual intelligent character. Preferably, the chat mode information includes the user's mantra, habitual action, tone of voice, speech rate, sound quality, tone, preference, clothing and/or emotional expression information.

Further, the method of setting the user's own virtual intelligent role on the communication interaction platform is:

The user's human body image is collected, the user's human body feature information is obtained, and a three-dimensional human body image is created based on the human body feature information as an image image of the virtual intelligent character.

Use the virtual intelligent character creation unit set in the communication interaction platform to set up its own virtual intelligent character, and the virtual intelligent character creation unit can create the character's image, gender, personality label, body movement and/or voice information.

Further, the interaction information between the aforementioned virtual intelligent characters is collected, and the interaction information is loaded into the interaction record of the user's real social identity and the aforementioned contact object's real social identity.

The present invention also provides a virtual intelligent character-based interactive client, including:

a user information setting module for setting the user's own virtual intelligent role on the communication interaction platform, and the virtual intelligent role is different from the user's real social identity on the communication interaction platform;

A contact module for acquiring virtual intelligent role information set by the user's contact object;

The virtual interaction module is used to establish communication between the user's own virtual intelligent character and the virtual intelligent character of the contact object for information exchange. Further, it can also include:

An interaction strength determination module, configured to analyze the virtual interaction strength level between the user and the contact object according to the aforementioned interaction frequency and/or interaction duration;

The real interaction triggering module is used for triggering the establishment of communication between the user's real social identity and the real social identity of the aforementioned contact object when the aforementioned virtual interaction strength meets the preset condition.

The present invention also provides an interactive system based on virtual intelligent characters, including:

A virtual intelligent role attribute library, used to set the user's own virtual intelligent role on the communication interaction platform, and the virtual intelligent role is different from the user's real social identity on the communication interaction platform;

The server side is used to obtain the virtual intelligent role information set by the user's contact object, and trigger the user's own virtual intelligent role to establish communication with the virtual intelligent role of the contact object for information exchange.

beneficial effect

Compared with the prior art, the present invention has the following advantages and positive effects due to the adoption of the above technical solutions, as an example: by setting up virtual intelligent roles corresponding to users, establishing and communicating information through the virtual intelligent roles of users and contacts Interaction, as an ice-breaking journey in the early stage of communication between users and contacts, solves the problem of obstacles in the early stages of communication between strangers.

Description of drawings

1 to 3 are flowcharts of an interaction method based on a virtual intelligent character provided by an embodiment of the present invention.

FIG. 4 to FIG. 5 are example diagrams of user interfaces of a virtual intelligent character based on an IM communication platform provided by an embodiment of the present invention.

6 to 8 are exemplary diagrams of a communication interaction interface provided by an embodiment of the present invention.

FIG. 9 is a module structure diagram of an interactive client provided by an embodiment of the present invention.

Description of reference numbers:

User terminal 200, real social identity 210, virtual intelligent character 210a, contact list 220, 220a, real contact 221, virtual intelligent character contact 222; communication interactive interface 300; interactive client 400, user information setting module 410, contact Human module 420 , virtual interaction module 430 , interaction strength determination module 440 , real interaction trigger module 450 .

Embodiments of the present invention

The interaction method, client and system based on virtual intelligent characters disclosed in the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be noted that the technical features or combinations of technical features described in the following embodiments should not be considered isolated, and they can be combined with each other to achieve better technical effects. In the drawings of the following embodiments, the same reference numerals appearing in the various drawings represent the same features or components, which may be used in different embodiments. Therefore, once an item is defined in one figure, it need not be discussed further in subsequent figures.

It should be noted that the structures, proportions, sizes, etc. shown in the accompanying drawings in this specification are only used to cooperate with the contents disclosed in the specification, so as to be understood and read by those who are familiar with the technology, and are not used to limit the invention. The limited conditions for implementation, any structural modification, change in proportional relationship or adjustment of size, shall fall within the scope of the technical content disclosed in the invention without affecting the efficacy and purpose of the invention. within the range. The scope of the preferred embodiments of the present invention includes additional implementations in which the functions may be performed out of the order described or discussed, including performing the functions in a substantially simultaneous manner or in the reverse order depending upon the functions involved, which should be Embodiments of the invention will be understood by those skilled in the art to which the embodiments of the invention pertain.

Techniques, methods, and devices known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, such techniques, methods, and devices should be considered part of the authorized description. In all examples shown and discussed herein, any specific value should be construed as illustrative only and not as limiting. Accordingly, other examples of exemplary embodiments may have different values.

Example

Referring to FIG. 1, an interaction method based on virtual intelligent characters is disclosed, and the method includes the following steps:

S100: Set the user's own virtual intelligent role on the communication interaction platform, where the virtual intelligent role is different from the user's real social identity on the communication interaction platform.

The communication interaction platform includes but is not limited to network communication platforms such as IM communication platform, short message SMS communication platform, web interface communication platform, email communication platform and game interaction communication platform.

Taking the IM communication platform (instant messaging platform) as an example, as an example and not a limitation, as shown in FIG. 4 , for example, the real social identity 210 of user Zhang San on the IM tool is Austus (that is, the nickname given to himself in his IM tool) , corresponding to the aforementioned real social identity 210, a virtual intelligent character 210a is set as "Little A robot", and the little A robot is the virtual intelligent character of user Zhang San on the IM communication platform. The virtual intelligent character is an artificial intelligence object (virtual person), which has the same functions as its corresponding real social identity in the IM communication platform, as an example and not a limitation, for example, it has language understanding and processing functions, and can communicate with contacts Objects engage in chat interactions, which have their own contact list, profile space, and tag attributes (such as gender, hobbies, interests), etc.

Preferably, in this embodiment, the user's real social identity 210 and virtual intelligent character 210a in the IM communication tool are displayed in columns on the user's main interface. Referring to Figures 4 and 5, the user can trigger the real social Identity 210 and ITEM triggers of virtual intelligent character 210a to select the information displayed in the window. For example, the real social identity 210 in FIG. 4 is the currently selected object, and the contact list of the real social identity 210 “Austus” is displayed in the window. In FIG. 5, the virtual intelligent character 210a is the currently selected object, and the virtual intelligent character is displayed in the window. 210a Contact list for "Little A Robot".

S200: Acquire virtual intelligent role information set by the user's contact object.

Taking the contact object Li Si as an example, the corresponding virtual intelligent character is Xiao Li Robot.

S300, the user's own virtual intelligent character establishes communication with the virtual intelligent character of the contact object, and performs information exchange.

Referring to FIG. 6 , the virtual intelligent character 210a "Xiao A robot" and the virtual intelligent character "Xiao Li robot" have performed information interaction.

In this embodiment, the interaction between the virtual intelligent characters may be that one virtual intelligent character randomly selects another virtual intelligent character to interact, or the virtual intelligent character selects from preset contact objects according to user settings interact with the virtual intelligent character set by the contact object; or, interact with the virtual intelligent character that selects the target based on the interaction frequency of the user's recent chat objects.

Further, in order to facilitate the user to obtain valuable chat content between the virtual intelligent characters, the following steps are further included: collecting the interaction information between the aforementioned virtual intelligent characters, analyzing and obtaining the part of the interaction information that meets the preset conditions to generate streaming media data output.

The preset condition may be the interactive content about a certain topic set by the user. For example, if the user likes traveling, the chat content about traveling in the interactive information between the virtual intelligent characters can be obtained through preset keywords, and Generate streaming media output to the user.

The streaming media, by way of example and not limitation, may be multimedia files such as audio, video, animation, and ppt. Referring to FIG. 7 , it is exemplified that a video generated by interactive information between virtual intelligent characters is sent to the user.

When outputting, preferably, the interaction information between the aforementioned virtual intelligent characters is collected, and the interaction information is loaded into the interaction record of the user's real social identity and the aforementioned contact object's real social identity.

In this embodiment, a deep learning method can also be used to inductively learn the user's chat mode information, and then the user's own virtual intelligent character can imitate the user's chat mode to interact with the contact object's virtual intelligent character.

Preferably, the chat mode information includes the user's mantra, habitual action, tone of voice, speech rate, sound quality, tone, preference, clothing and/or emotional expression information.

Specifically, by way of example and not limitation, for example, a smart terminal that collects user feature information is provided, and the smart terminal may be one or more of a mobile phone, a tablet computer, a desktop computer, and a wearable smart device. The intelligent terminal is provided with a camera, and the user's human body image information and audio information obtained by the user using the aforementioned camera are learned for a long time through deep learning software, and the image information and audio information are analyzed after inductive learning to obtain the user's mantra, habitual action, tone. , speech rate, sound quality, pitch, preferences, clothing and/or emotional expression.

Of course, the above method is an example and not a limitation, and the deep learning method can also be as follows:

Deep learning is performed by collecting data information of the user and/or the surrounding environment of the user through the wearable terminal. Alternatively, the data information browsed by the user on the smart terminal and/or the input data information is collected for learning. Alternatively, the data information of the user itself and/or the communication platform where the contact object is located is collected for learning. Alternatively, the chat content in the user's historical communication records is collected for learning.

In this embodiment, the user or the server can set its own virtual intelligent character. Specifically, the method of setting the user's own virtual intelligent character on the communication interaction platform may be: collecting the user's human body image, obtaining the user's human body feature information, and creating a three-dimensional human body image based on the human body feature information as the image of the user's own virtual intelligent character image.

The avatar image of the virtual intelligent character is displayed in the ITEM item of the IM tool, for example, as a virtual avatar.

Alternatively, a virtual intelligent character creation interface is provided for user personalization. Specifically, the method of setting the user's own virtual intelligent character on the communication interaction platform is: using the virtual intelligent character creation unit set in the communication interaction platform to set the own virtual intelligent character, and the virtual intelligent character creation unit can create the image of the character, Gender, personality tags, body movements and/or vocal information.

Referring to FIG. 2, another implementation of this embodiment is shown.

A virtual intelligent character-based interaction method includes the following steps:

S400: Generate a chat record from the interaction information between the user's own virtual intelligent character and the contact object's virtual intelligent character and output it to the user. The chat record includes the role, time, place and/or content of the interaction.

S500, determine whether the user is interested in the foregoing chat record.

S600, when it is determined that the user is interested, trigger the establishment of communication between the user's real social identity and the real social identity of the aforementioned contact object.

In this embodiment, the method of determining whether the user is interested in the aforementioned chat records may specifically be: collecting image information of the user reading the aforementioned chat records, and obtaining the user's body movements, facial and/or voice information in the images; It is determined that the user is interested when the motion, face and/or voice information conforms to the preset body motion, face and/or voice conditions.

When it is determined that the user is interested, the real social identity can be triggered to chat with the real social identity of the aforementioned contact object. Referring to FIG. 8 , for example, user Zhang San checks the interaction information between the virtual intelligent character 210a "Xiao A robot" and the virtual intelligent character "Xiao Li robot", and smiles many times during the viewing process, then the user Zhang San can be launched. San is interested in Li Si (has a common language), at this time, the interaction between Zhang San's real social identity 210 "Austus" and Li Si's real social identity 210 "Li Si" can be intelligently triggered, as shown in FIG. 8 . Since the communication between virtual intelligent characters establishes a communication bridge, the first step of communication is taken, and the initial communication obstacle between unfamiliar users is solved.

For other technical features, refer to the descriptions in the foregoing embodiments, which will not be repeated here.

Referring to FIG. 3 , another implementation of this embodiment is shown.

S410, collect the interaction frequency and/or interaction duration information between the user's own virtual intelligent character and the contact object's virtual intelligent character,

S510 , when the aforementioned interaction frequency and/or interaction duration information meets a preset condition, trigger the user's real social identity to establish communication with the aforementioned real social identity of the contact object.

Further, in this embodiment, the virtual interaction strength between the user and the contact object can also be analyzed according to the aforementioned interaction frequency and/or interaction duration, and the display information of the own virtual intelligent character can be adjusted according to the virtual interaction strength.

As an example and not a limitation, for example, the virtual interaction strength is divided into 5 levels, and the higher the level, the higher the interaction frequency and/or the longer the interaction duration. That is, the user can determine the degree of communication between himself and the other party through the virtual interaction strength, so as to facilitate the user to decide whether to communicate with the real contact object.

Preferably, the virtual interaction intensity is divided into multiple levels, and different virtual intelligent character images are correspondingly displayed at different virtual interaction intensity levels; more beautiful virtual intelligent character images are displayed for contact objects with high virtual interaction intensity levels. Understandably, this approach helps to make a stronger impression on the contact object.

Referring to Fig. 9, another embodiment of the present invention further provides an interactive client based on a virtual intelligent character.

The interactive client 400 includes the following structure:

The user information setting module 410 is used to set the user's own virtual intelligent role on the communication interaction platform, and the virtual intelligent role is different from the user's real social identity on the communication interaction platform.

Preferably, the user information setting module can provide a virtual intelligent character creation interface so that the user can perform personalized settings. Specifically, the virtual intelligent character creation unit can create the image, gender, personality label, body movement and/or voice information, etc. of the virtual intelligent character.

The contact module 420 is configured to acquire the virtual intelligent role information set by the user's contact object.

The virtual interaction module 430 is used to establish communication between the user's own virtual intelligent character and the virtual intelligent character of the contact object for information interaction.

and an interaction strength determination module 440, configured to analyze the virtual interaction strength level between the user and the contact object according to the aforementioned interaction frequency and/or interaction duration.

The real interaction triggering module 450 is configured to trigger the user's real social identity to establish communication with the real social identity of the contact object when the aforementioned virtual interaction strength meets the preset condition.

The communication connection between the above modules is used for information transmission.

The interactive client includes, but is not limited to, an IM communication client, a short message SMS communication client, a web interface communication client, an email communication client, a game client, and the like.

Taking the IM communication client as an example, for example, user Zhang San can set his own virtual intelligent role through the user information setting module (user setting interface) on the IM tool. The virtual intelligent character is different from the real social identity of the user on the communication interaction platform.

As an example and not a limitation, for example, Zhang San's real social identity is Austus (that is, his nickname given to himself in his IM tool), and a virtual intelligent character "Little A Robot" is set corresponding to the aforementioned real social identity. The little A robot is the virtual intelligent character of user Zhang San on the IM tool. The virtual intelligent character is an artificial intelligence object (virtual person), which has the same functions as its corresponding real social identity in the IM tool, as an example and not a limitation, for example, it has language understanding and processing functions, and can communicate with contacts. Objects engage in chat interactions, which have their own contact list, profile space, and tag attributes (such as gender, hobbies, interests), etc.

The contact module is used to obtain the virtual intelligent role information set by the user's contact object. For example, the virtual intelligent character of user Zhang San's contact Li Si (real social identity 210 "Li Si") is "Little Li Robot".

Then, the virtual intelligent character of the self and the virtual intelligent character of the contact object establish communication through the virtual interaction module to exchange information.

The interaction between the virtual intelligent characters may be that one virtual intelligent character randomly selects another virtual intelligent character to interact, or the virtual intelligent character selects a contact object from the preset contact objects according to the settings of the user. The virtual intelligent character interacts; or, the virtual intelligent character that selects the target based on the interaction frequency of the user's recent chat objects interacts.

The preset condition may be the interactive content about a certain topic set by the user. For example, if the user likes traveling, the chat content about traveling in the interactive information between the virtual intelligent characters can be obtained through preset keywords, and Generate streaming media output to the user. The streaming media, by way of example and not limitation, may be multimedia files such as audio, video, animation, and ppt.

In this embodiment, a deep learning method can also be used to inductively learn the user's chat mode information, and then the user's own virtual intelligent character can imitate the user's chat mode to interact with the contact object's virtual intelligent character. Preferably, the chat mode information includes the user's mantra, habitual action, tone of voice, speech rate, sound quality, tone, preference, clothing and/or emotional expression information.

For other technical features, reference may be made to the previous embodiments, which will not be repeated here.

Another embodiment of the present invention also provides an interaction system based on virtual intelligent characters. The system includes:

The system can also set other modules according to requirements to realize corresponding functions. For other technical features, refer to the descriptions of the previous embodiments, which will not be repeated here.

In the above description, the disclosure of the present invention is not intended to limit itself in these respects. Rather, the various components may be selectively and operatively combined in any number within the intended scope of this disclosure. Additionally, terms like "includes," "includes," and "has" should by default be construed as inclusive or open, rather than exclusive or closed, unless explicitly defined to the contrary. All technical, scientific or other terms have the meaning as understood by those skilled in the art unless they are defined to the contrary. Common terms found in dictionaries should not be interpreted too ideally or too practically in the context of related technical documents, unless this disclosure explicitly defines them as such. Any changes and modifications made by those of ordinary skill in the field of the present invention according to the above disclosure fall within the protection scope of the claims.

Claims

A kind of interaction method based on virtual intelligent character is characterized in that comprising the following steps:

Setting the user's own virtual intelligent role on the communication interaction platform, the virtual intelligent role is different from the user's real social identity on the communication interaction platform;

Obtain the virtual intelligent role information set by the user's contact object;

The user's own virtual intelligent character establishes communication with the virtual intelligent character of the contact object, and conducts information exchange.
The method according to claim 1, wherein the interaction information between the virtual intelligent characters is collected, and after analysis, the part of the interaction information that meets the preset conditions is obtained to generate the streaming media data output.
The method of claim 1, further comprising the step of:

generating and outputting to the user a chat record based on the interaction information between the user's own virtual intelligent character and the virtual intelligent character of the contact object, the chat record including the interaction role, time, place and/or content;

Determine whether the user is interested in the aforementioned chat records;

When it is determined that the user is interested, the user's real social identity is triggered to establish communication with the real social identity of the aforementioned contact object.
The method of claim 1, further comprising the step of:

Collect the interaction frequency and/or interaction duration information between the user's own virtual intelligent character and the contact object's virtual intelligent character,

When the aforementioned interaction frequency and/or interaction duration information meets the preset conditions, the user's real social identity is triggered to establish communication with the aforementioned real social identity of the contact object.
The method according to claim 4, wherein the virtual interaction strength between the user and the contact object is analyzed according to the interaction frequency and/or interaction duration, and the display information of the virtual intelligent character is adjusted according to the virtual interaction strength.
The method according to claim 5, wherein: the virtual interaction strength is divided into multiple levels, and different virtual interaction strength levels correspondingly display different virtual intelligent character images;

A more beautiful virtual intelligent character image is displayed for contact objects with a high virtual interaction intensity level.
The method according to claim 1, wherein the user's chat mode information is inductively learned by using a deep learning method, and the user's own virtual intelligent character imitates the user's chat mode to interact with the contact object's virtual intelligent character.
The method according to claim 1, wherein the method of setting the user's own virtual intelligent character on the communication interaction platform is:

Use the virtual intelligent character creation unit set in the communication interaction platform to set up its own virtual intelligent character, and the virtual intelligent character creation unit can create the image, gender, personality label, body movement and/or voice information of the character.
The method according to claim 1, wherein the interaction information between the virtual intelligent characters is collected, and the interaction information is loaded into the interaction record of the user's real social identity and the real social identity of the contact object.
A kind of interactive client based on virtual intelligent character is characterized in that comprising:

The user information setting module is used to set the user's own virtual intelligent role on the communication interaction platform, and the virtual intelligent role is different from the user's real social identity on the communication interaction platform;

A contact module for acquiring virtual intelligent role information set by the user's contact object;

The virtual interaction module is used to establish communication between the user's own virtual intelligent character and the virtual intelligent character of the contact object for information exchange.
An interactive system based on virtual intelligent characters, characterized in that it includes:

A virtual intelligent role attribute library, used to set the user's own virtual intelligent role on the communication interaction platform, and the virtual intelligent role is different from the user's real social identity on the communication interaction platform;

The server side is used to obtain the virtual intelligent role information set by the user's contact object, and trigger the user's own virtual intelligent role to establish communication with the virtual intelligent role of the contact object for information exchange.