KR20230103666A - Method and apparatus for providing a metaverse virtual reality companion animal capable of conducting a voice conversation with a user through learning about beavior and personality in a communication system - Google Patents

Abstract

The present invention relates to a method and apparatus for providing a metaverse virtual reality companion animal capable of conducting a conversation with a user by voice through learning of behavior and personality in a communication system. Specifically, the present invention creates a companion animal avatar similar in appearance and personality to a real companion animal in the virtual reality of the metaverse in a communication system, and learns the behavior and personality of the companion animal avatar according to the user's feedback. A method and apparatus for forming a companion animal in virtual reality with similar behavior patterns and personalities to the user's companion animal, and allowing the companion animal in virtual reality and the user to have a voice conversation according to the behavior pattern and personality formed as described above will be.

Description

Method and apparatus for providing a metaverse virtual reality companion animal capable of conducting a conversation with a user by voice through learning of behavior and personality in a communication system {METHOD AND APPARATUS FOR PROVIDING A METAVERSE VIRTUAL REALITY COMPANION ANIMAL CAPABLE OF CONDUCTING A VOICE CONVERSATION WITH A USER THROUGH LEARNING ABOUT BEAVIOR AND PERSONALITY IN A COMMUNICATION SYSTEM}

The present invention relates to a method and apparatus for providing a metaverse virtual reality companion animal capable of conducting a conversation with a user by voice through learning of behavior and personality in a communication system. Specifically, the present invention creates a companion animal avatar similar in appearance and personality to a real companion animal in the virtual reality of the metaverse in a communication system, and learns the behavior and personality of the companion animal avatar according to the user's feedback. A method and apparatus for forming a companion animal in virtual reality with similar behavior patterns and personalities to the user's companion animal, and allowing the companion animal in virtual reality and the user to have a voice conversation according to the behavior pattern and personality formed as described above will be.

With the recent increase in single-person households, the demand for companion animals that can live with humans as a family is increasing. The common interest of people who have companion animals is to know what their companion animal is thinking and to talk with their companion animal. A technology that analyzes the barking of an actual companion animal to determine the intention of the companion animal has also appeared, but it is still technically difficult to find out the thoughts of the actual companion animal or to have a conversation with the actual companion animal.

Recently, the virtual reality-related technology of the metaverse is attracting attention. Metaverse is a compound word of meta, which means processing and abstraction, and universe, which means the real world, and is a term that means the virtual world. Due to the metaverse, the boundary between the real world and the virtual world is gradually blurring. This is because various actions performed in the real world can be performed identically or similarly in the virtual world.

After creating a companion animal avatar in virtual reality that is similar in appearance, behavior pattern, and personality to a real companion animal in the virtual reality of the metaverse, the user creates a companion animal avatar and thinks of my companion animal through continuous data accumulation and reinforcement learning. If you predict and configure a system that communicates with companion animals based on this, you will be able to give users a new sense of satisfaction. In particular, it will be valuable as a service that continues to service the companion animal even after the death of the companion animal and continue the play or conversation with the companion animal during life.

Therefore, in the communication system, companion animal avatars that are similar in appearance and personality to real companion animals in the virtual reality of the metaverse are created, and the companion animal avatar's behavior and personality are learned according to the user's feedback, so that the actual user's companion animal There is a need for a method and device for forming a companion animal in virtual reality with similar behavioral patterns and personalities, and allowing the companion animal in virtual reality and the user to have a voice conversation according to the behavioral patterns and personalities formed as described above.

Republic of Korea Patent No. 10-2199843 (2020.12.31.) (Virtual companion animal provision system in augmented reality)

The present invention aims to solve the following problems in order to solve the above problems.

An object of the present invention is to provide a method and apparatus for generating a companion animal avatar similar in appearance and personality to a real companion animal in the virtual reality of the metaverse in a communication system.

The present invention provides a method and apparatus for forming a companion animal in virtual reality with behavioral patterns and personalities similar to those of an actual user's companion animal by learning the behavior and personality of a companion animal avatar according to a user's feedback in a communication system. aims to do

An object of the present invention is to provide a method and apparatus for enabling a companion animal and a user in a virtual reality to have a conversation by voice according to the behavior patterns and personalities formed as described above in a communication system.

The problems of the present invention are not limited to those mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

Various embodiments of the present disclosure provide a method of operating a user's terminal in a communication system. The terminal includes a transceiver, a memory, a processor, an input device, an output device, and a camera. The method includes transmitting an image of a companion animal obtained using the camera to a server, and receiving first motion information about a motion of a companion animal avatar generated based on the image in a virtual space from the server. A process of outputting the motion of the companion animal avatar in the virtual space through the output device based on the first motion information, and an operation based on the first motion information of the companion animal avatar through the input device. A process of receiving feedback information of a first input indicating similarity to the actual motion of the companion animal or a second input indicating that it is not similar to the actual motion of the companion animal; The process of transmitting the feedback information of 2 inputs, the process of receiving second motion information of the companion animal avatar generated based on the feedback information, and the process of receiving the second motion information of the companion animal avatar through the output device based on the second motion information and outputting the motion of the companion animal avatar in space.

Various embodiments of the present invention provide a user's terminal in a communication system. The terminal includes a memory, a processor, an input device, an output device, and a camera, and the processor is configured to perform a method of operating a user terminal in a communication system according to various embodiments of the present disclosure.

Various embodiments of the present invention provide a computer program recorded on a computer readable storage medium. The computer program is configured to perform a method of operating a user's terminal in a communication system according to various embodiments of the present disclosure.

The present invention can provide a method and apparatus for generating a companion animal avatar similar in appearance and personality to a real companion animal in the virtual reality of the metaverse in a communication system.

The present invention provides a method and apparatus for forming a companion animal in virtual reality with behavioral patterns and personalities similar to those of an actual user's companion animal by learning the behavior and personality of a companion animal avatar according to a user's feedback in a communication system. can do.

The present invention can provide a method and apparatus for a communication system in which a companion animal and a user in virtual reality can have a conversation by voice according to the behavior pattern and personality formed as described above.

Effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

1 illustrates a communication system according to various embodiments of the present invention.
2 shows a block diagram of a configuration of a user terminal according to various embodiments of the present invention.
Figure 3 shows a block diagram of the configuration of a server according to various embodiments of the present invention.
4 illustrates an example of a process for forming a companion animal in virtual reality having behavior patterns and personalities similar to those of an actual user's companion animal according to various embodiments of the present disclosure.
5 illustrates an example of a process for generating a companion animal avatar in virtual reality similar in appearance and personality to a real companion animal according to various embodiments of the present disclosure.
6 illustrates an example of a process for forming a companion animal in virtual reality having behavior patterns and personalities similar to those of an actual user's companion animal according to various embodiments of the present disclosure.
7 illustrates an example of a process for forming a companion animal in virtual reality having behavior patterns and personalities similar to those of an actual user's companion animal according to various embodiments of the present disclosure.
8 illustrates an example of a process for having a voice conversation according to behavior patterns and personalities formed between a companion animal and a user in virtual reality according to various embodiments of the present disclosure.
9 illustrates an example of a process for automatically generating an interaction event between a user and a companion animal avatar in metaverse virtual reality based on the personality and behavioral characteristics of the companion animal avatar according to various embodiments of the present invention.
10 illustrates an example of a process for automatically matching users in the metaverse and providing customized content based on the personality and behavioral characteristics of companion animal avatars according to various embodiments of the present disclosure.

Hereinafter, with reference to the accompanying drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily carry out the present invention. The present invention may be embodied in many different forms and is not limited to the embodiments described herein.

1 illustrates a communication system according to various embodiments of the present invention.

Referring to FIG. 1 , a communication system according to various embodiments of the present invention includes a user terminal (100: 100-1, 100-2, ..., 100-n), a server 200, a wired/wireless communication network ( 300).

The user terminal 100 (100-1, 100-2, ..., 100-n) is a terminal operated by a companion, that is, a user who actually raises companion animals offline. The user terminal (100: 100-1, 100-2, ..., 100-n) transmits the characteristic information of the companion animal to the server 200 through the wired/wireless communication network 300, and the server 200 ) is an electronic device capable of receiving companion animal avatar information in virtual reality and virtual reality information to which the companion animal avatar belongs. User terminals 100: 100-1, 100-2, ..., 100-n are personal computers, cellular phones, smart phones, tablet computers, head mount display (HMD) devices for VR (virtual reality) capable of transmitting and receiving An input device capable of inputting information, an output device capable of outputting information, a memory capable of storing information, a camera capable of taking an image of an object in the foreground, and a device capable of transmitting and receiving information. It may be an electronic device including a transceiver and at least one processor capable of performing information calculation.

The server 200 is a server operated by an online service provider based on a metaverse virtual reality platform. The server 200 is actually based on the characteristic information of the actual companion animal provided by the user terminals 100 (100-1, 100-2, ..., 100-n) through the wired/wireless communication network 300. A virtual reality animal avatar having the same or similar appearance, behavior pattern, and personality as the companion animal is created, the behavior pattern and personality of the virtual reality animal avatar are trained or modified according to the characteristic information or feedback information input from the user, and the generated appearance is created. It is an electronic device capable of providing the user terminal 100 with information on a service that performs audio-visual communication between a user and a virtual reality avatar based on a user's behavior pattern and personality. The server 200 may be an electronic device including a memory capable of storing information, a transceiver capable of transmitting and receiving information, and at least one processor capable of performing information calculation.

The wired/wireless communication network 300 provides a communication path through which user terminals 100: 100-1, 100-2, ..., 100-n, and the server 200 can transmit and receive signals and data to each other. to provide. The wired/wireless communication network 300 is not limited to a communication method according to a specific communication protocol, and an appropriate communication method may be used according to an implementation example. For example, when configured as an Internet protocol (IP) based system, the wired/wireless communication network 300 may be implemented as a wired/wireless Internet network, and the user terminals 100: 100-1, 100-2, ..., 100-n), and when the server 200 is implemented as a mobile communication terminal, the wired/wireless communication network 300 may be implemented as a wireless network such as a cellular network or a wireless local area network (WLAN) network. there is.

2 shows a block diagram of a configuration of a user terminal according to various embodiments of the present invention.

Referring to FIG. 2 , a user terminal (100: 100-1, 100-2, ..., 100-n) according to various embodiments of the present invention includes a transceiver 110, a memory 120, a processor 130 , an input device 110 , an output device 120 , and a camera 160 .

The transceiver 110 is connected to the processor 130 and transmits and/or receives signals. All or part of the transceiver 110 may be referred to as a transmitter, a receiver, or a transceiver. The transceiver 110 is a wired access system and a wireless access system, such as an institute of electrical and electronics engineers (IEEE) 802.xx system, an IEEE Wi-Fi system, a 3rd generation partnership project (3GPP) system, and a 3GPP long term evolution (LTE) system. , 3GPP 5G new radio (NR) system, 3GPP2 system, at least one of various wireless communication standards such as Bluetooth may be supported.

The memory 120 is connected to the transceiver 110, the memory 120, the processor 130, the input device 140, and the output device 150, information input through the input device 140, the transceiver 110 ) It is possible to store information received from the server 200 through communication. Also, the memory 120 may store information on an image captured by the camera 160 . In addition, the memory 120 is connected to the processor 130 and may store data such as basic programs for operation of the processor 130, application programs, setting information, and information generated by operation of the processor 130. . The memory 120 may include volatile memory, non-volatile memory, or a combination of volatile and non-volatile memories. Also, the memory 120 may provide stored data according to a request of the processor 130 .

The processor 130 may be configured to implement the procedures and/or methods proposed in the present invention. The processor 130 controls overall operations of the user terminal 100 . For example, the processor 130 transmits or receives information or the like through the transceiver 110 . Also, the processor 130 writes data to and reads data from the memory 120 . Also, the processor 130 receives information through the input device 140 . Also, the processor 130 outputs information through the output device 140 . Also, the processor 130 captures an image through the camera 160 . The processor 130 may include at least one processor.

The input device 140 is connected to the processor 130 and may input information and the like. According to an embodiment, the input device 140 may input information received from another device connected to the wired/wireless communication network 300 through the transceiver 130 . The input device 140 may include a touch display, a keypad, and a keyboard.

The output device 150 is connected to the processor 130 and can output information in the form of video/audio. According to an embodiment, the output device 150 may output information received from another device connected to the wired/wireless communication network 300 through the transceiver 110 . The output device 150 may include a display, a speaker, and the like.

The camera 160 is connected to the processor 130 and may capture an image of a front object.

Figure 3 shows a block diagram of the configuration of a server according to various embodiments of the present invention.

Referring to FIG. 3 , a server 200 according to various embodiments of the present disclosure includes a transceiver 210 , a memory 220 and a processor 230 .

The transceiver 210 is connected to the processor 230 and transmits and/or receives signals. All or part of the transceiver 210 may be referred to as a transmitter, a receiver, or a transceiver. The transceiver 210 is a wired access system and a wireless access system, such as an institute of electrical and electronics engineers (IEEE) 802.xx system, an IEEE Wi-Fi system, a 3rd generation partnership project (3GPP) system, and a 3GPP long term evolution (LTE) system. , 3GPP 5G new radio (NR) system, 3GPP2 system, at least one of various wireless communication standards such as Bluetooth may be supported.

The memory 220 is connected to the transceiver 220, and through communication of the transceiver 220, a user terminal 100: 100-1, 100-2, ..., 100-n, or a service terminal 300: Information received from 300-1, 300-2, ..., 300-n) may be stored. In addition, the memory 220 is connected to the processor 230 and may store data such as basic programs for operation of the processor 230, application programs, setting information, and information generated by operation of the processor 230. . The memory 220 may include volatile memory, non-volatile memory, or a combination of volatile and non-volatile memories. Also, the memory 220 may provide stored data according to a request of the processor 230 .

The processor 230 may be configured to implement the procedures and/or methods proposed in the present invention. The processor 230 controls overall operations of the server 200 . For example, the processor 230 transmits or receives information or the like through the transceiver 210 . Also, the processor 230 writes data to and reads data from the memory 220 . The processor 230 may include at least one processor.

4 illustrates an example of a process for forming a companion animal in virtual reality having behavior patterns and personalities similar to those of an actual user's companion animal according to various embodiments of the present disclosure.

Referring to FIG. 4 , in a terminal according to various embodiments of the present disclosure, a user may reinforce a behavior pattern and personality similar to that of a user's actual companion animal through continuous feedback so that a companion animal avatar in virtual reality is formed. Accordingly, the user can directly create the behavior pattern and personality of the companion animal avatar.

The user 100 transmits companion animal avatar-related setting information or feedback information to the server 200 through the user terminals 100: 100-1, 100-2, ..., 100-n, thereby simulating companion animals. can create In addition, the server 200 sends information to the user 100 through the user terminals 100: 100-1, 100-2, ..., 100-n. ., 100-n), it is possible to provide a simulation of a companion animal by providing an image and motion information of the companion animal avatar that can be output.

The companion animal avatar characteristic simulation set formed through mutual information exchange between the user 100 and the server 200 enables avatars to be created through accumulated data within the server 200 and diversity of simulations and options to be secured.

When the server 200 transmits the initial value for the companion animal avatar formed to the user, the user 100 transmits the resulting value through feedback thereto, thereby performing continuous reinforcement learning on the companion animal avatar, and ultimately, the user 100 ) can form a companion animal avatar in virtual reality that has a similar inner side, that is, a personality and behavior pattern, to that of a real companion animal.

The server 200 stores the comprehensive characteristic information of the companion animal received from the user 100 and stores the type information of the companion animal. The server 200 may make predictions about the companion animal's future behavior or intention based on the stored information.

The server 200 performs machine learning on the companion animal-related information received from the user 100, and based on the preformed appearance, personality, behavior pattern, etc. Personality, conversation content, etc. can be automatically predicted and generated. The server 200 provides the user 100 with image information of an operating companion animal through the generated behavior, personality, and conversation content, so that the user 100 can experience a living companion animal that seems to think and react on its own in the virtual world. there is.

5 illustrates an example of a process for generating a companion animal avatar in virtual reality similar in appearance and personality to a real companion animal according to various embodiments of the present disclosure.

Referring to FIG. 5 , the user's terminal may start generating a companion animal avatar by taking a photograph of an actual companion animal using a camera in the terminal.

The terminal can identify the type of companion animal from the photographed image. For example, it can identify whether it is a dog, cat, or goldfish. The identified companion animal type may serve as basic information for forming a basic frame for generating an avatar of the companion animal.

The terminal may identify the detailed species of the companion animal based on the determined type of companion animal. For example, when the type of companion animal is determined to be a puppy, whether the detailed species of the companion animal is a Chihuahua, a Bichon Frize, or a Maltese can be identified. The detailed species of the identified companion animal can be basic information for forming a detailed form in addition to the basic frame of the companion animal.

The terminal may output the basic shape of the companion animal avatar to the user based on the sample based on the determined type and detailed species of the companion animal.

The terminal may perform detailed correction on the companion animal avatar by additionally reflecting detailed external features. For example, information on hair color, eye size and distance, and nose size may be additionally reflected by receiving input from the user.

In each step of the companion animal avatar generation process, the creation of the companion animal avatar may be completed by receiving a confirmation input based on a comparison between the generated companion animal avatar and the actual companion animal's appearance from the user.

The finally created companion animal avatar can operate in a virtual world in a three-dimensional form.

6 illustrates an example of a process for forming a companion animal in virtual reality having behavior patterns and personalities similar to those of an actual user's companion animal according to various embodiments of the present disclosure.

Referring to FIG. 6 , the user's terminal may reinforce the companion animal avatar for behavioral characteristics of the companion animal. Through this, companion animal avatars can be similar to actual companion animals not only in appearance but also inside.

Motion information based on personality information including a currently formed behavior pattern of the companion animal avatar for each situation is transmitted to the user terminal from the server along with a simulation of an arbitrary situation.

The user can see how the companion animal avatar behaves in a corresponding situation through the output device in the terminal and input positive (Buy in) or negative (Buy out) feedback.

For example, given a situation where a rice bowl is full of food, the companion animal avatar can 1) eat all of it even when full, 2) serve food autonomously, 3) eat as much as he can eat, and let others do the rest. You can perform more than one action of keep from eating.

The user can input positive or negative feedback on this. The feedback input by the user may be the basis for determining how the server will behave in a similar situation with respect to the companion animal avatar in the future.

In order to encourage the user to input feedback information, the server may provide coins as a reward whenever the user inputs feedback information. Coins paid to the user can be used as goods for the user to purchase goods or services. For example, a user can use coins to purchase items related to companion animal avatars. Alternatively, the user may use the coin as currency by using an online shopping mall or other financial platform.

Beyond inputting feedback information, the user may more actively create a simulation of a situation in which the companion animal avatar will operate. In a specific situation set by the user, by seeing how the current companion animal behaves based on the preset personality information, the user can provide additional feedback and gradually learn the companion animal avatar to be similar to the actual companion animal.

Even when the user creates a simulation, the user may be provided with coins of compensation from the server.

Feedback input from the user may be reflected to the companion animal avatar by the server after the simulation is finished.

7 illustrates an example of a process for forming a companion animal in virtual reality having behavior patterns and personalities similar to those of an actual user's companion animal according to various embodiments of the present disclosure.

Referring to FIG. 7 , the user's terminal may reinforce the companion animal avatar for the personality characteristics of the companion animal. Through this, companion animal avatars can be similar to actual companion animals not only in appearance but also inside.

Motion information based on the currently formed personality information of the companion animal avatar for each situation is transmitted from the server to the user terminal along with a simulation of an arbitrary situation.

The user can see how the companion animal avatar behaves in a corresponding situation through the output device in the terminal and input positive (Buy in) or negative (Buy out) feedback.

For example, given a situation where you encounter a dog that is bigger than your companion animal avatar on a walk, the actions that your companion animal avatar can 1) ignore and pass by, 2) bark aggressively, 3) be curious and go to say hello You can perform one or more of the following actions: smell and smell.

The user can input positive or negative feedback on this. The feedback input by the user may be the basis for determining how the server will behave in a similar situation with respect to the companion animal avatar in the future.

In order to encourage the user to input feedback information, the server may provide coins as a reward whenever the user inputs feedback information. Coins paid to the user can be used as goods for the user to purchase goods or services. For example, a user can use coins to purchase items related to companion animal avatars. Alternatively, the user may use the coin as currency by using an online shopping mall or other financial platform.

Beyond inputting feedback information, the user may more actively create a simulation of a situation in which the companion animal avatar will operate. In a specific situation set by the user, by seeing how the current companion animal behaves based on the preset personality information, the user can provide additional feedback and gradually learn the companion animal avatar to be similar to the actual companion animal.

Even when the user creates a simulation, the user may be provided with coins of compensation from the server.

Feedback input from the user may be reflected to the companion animal avatar by the server after the simulation is finished.

Appearance, body conditions, behavioral characteristics, and personality characteristics of companion animals that have been learned so far are accumulated in companion animal avatars, and when a specific situation occurs within the metaverse virtual reality, companion animal avatars reflect the characteristics and act.

For example, in personality traits, a dog that barks furiously when meeting a new dog and is aggressive will behave that way if it happens to encounter another dog within the metaverse.

For example, in personality characteristics, when the owner goes out, that is, when the user does not access the companion animal application in the terminal, a dog waiting at the door waits with the corresponding behavior pattern while the owner does not access the app.

For example, in terms of behavioral characteristics, a dog that continues to eat treats even when full will get sick from overeating item snacks.

8 illustrates an example of a process for having a voice conversation according to behavior patterns and personalities formed between a companion animal and a user in virtual reality according to various embodiments of the present disclosure.

Specifically, FIG. 8 is a companion animal in virtual reality, assuming that if a companion animal having a behavior pattern, personality, etc. formed through the above process can communicate with a person based on the corresponding personality, how and with what emotion it can communicate. A process for learning so that the avatar can communicate with the user by voice is shown.

This is to enable the user to feel mutual sympathy with the companion animal avatar in virtual reality by operating as a chatbot (chatter robot) based on the formed behavior pattern and personality.

Rather than exchanging only silent actions and reactions on the screen, if actual conversation can be conducted based on the formed personality, it is possible to provide the user with a strong feeling of being with someone by raising a companion animal.

Through the process of FIG. 8 , if the companion animal avatar can communicate with the user, if the user's actual companion animal avatar has a personality, by providing feedback on how to respond in a specific conversation situation, the companion animal When the avatar has a later conversation, it provides a basis for the server to learn in which direction the conversation will proceed.

In step S801, the server presents a chatbot scenario set based on preset personality information of the companion animal avatar to the terminal.

In step S802, the server may present several example answers to the terminal and suggest to the user to select possible answers among the corresponding answers in order of priority. That is, the user provides feedback on how to respond in the case of the user's real companion animal avatar's personality in a specific conversation situation.

In step S803, the server asks the terminal whether or not the user answer is added. When the user provides additional answers in addition to the default answers, coins may be provided to the user terminal in step S804.

When the user does not provide additional answers other than the default answers, a conversation set specific to the companion animal avatar is completed in step S805.

Based on the completed conversation set, the server may learn in which direction the conversation will proceed when the companion animal avatar has a conversation later.

In addition, when a message spoken by a user to a companion animal avatar by voice through a microphone in the device is converted into text and transmitted to the server using the STT (speech to text) function of the processor in the device, the server converts the previously learned conversation set into text. Based on this, a response message is generated and transmitted to the terminal, and the terminal converts and outputs the corresponding response message through an output device as if the companion animal avatar actually speaks, while outputting a moving screen and sound.

Through this, the user can have the experience of having a conversation with the companion animal avatar in virtual reality displayed on the output device of the terminal.

According to various embodiments of the present invention, a conversation system can be established in a space where companion animals can communicate.

To this end, companion animal conversation simulation and reinforcement learning may be performed. For example, in a metaverse space implemented like a counseling center or cafe, users can try to talk with companion animals. The user may select a line that the user's companion animal would likely respond to the expected question.

Questions and selectable answers may be provided to the terminal from the server. For example, [propose a question] Do you love mom? About, [Present options] 1) I love you so much! I will only follow you forever 2) I love you only when you give me something delicious 3) What do you love? 4) I will love you more if you take a walk a lot is provided, and the user can select the most likely answer [Select Answer] through the terminal and provide it to the server, and duplicate selection of answers may be allowed.

You can complete a set that configures the chatbot scenario to suit your pet. In addition, the voice of the companion animal can be voiced with the voice tone selected by the user.

Based on the chatbot scenario described above, when a user speaks by voice, the companion animal avatar can respond by voice.

That is, the terminal recognizes the user's voice as STT (speech to text) and transmits it to the server, so that the chatbot of the companion animal avatar can recognize the user's voice message.

The companion animal avatar's answer may be selected according to the companion animal's expected answer chatbot selected by the user through positive (buy-in) or negative (buy-out) feedback. The server may learn based on the expected answer selected by the user.

The answer of the companion animal avatar generated by the server may be output as a voice in text to speech (TTS) from the terminal. Through this, users can have the experience of having a conversation with a companion animal avatar in the metaverse virtual reality.

9 illustrates an example of a process for automatically generating an interaction event between a user and a companion animal avatar in metaverse virtual reality based on the personality and behavioral characteristics of the companion animal avatar according to various embodiments of the present invention.

The machine learning client 1 may create an event routine and provide it to the metaverse server 4.

The machine learning client 1 may randomly provide routine events.

The user 2 as a machine learning model reinforcer can provide the metaverse server 4 with a new type of event generation.

The user 2 as a machine learning model reinforcer may generate and provide characteristics of the companion animal avatar of the user 2 with respect to the event 3 of the interaction between companion animals.

10 illustrates an example of a process for automatically matching users in the metaverse and providing customized content based on the personality and behavioral characteristics of companion animal avatars according to various embodiments of the present disclosure.

When a companion animal avatar created in the metaverse virtual reality comes into contact with other companion animal avatars, the preset behavior and personality characteristics of each avatar are internalized and interacted with.

Specifically, according to the personality type of the companion animal, the interaction between avatars of the companion animal may be implemented as an artificial intelligence event.

A companion animal's personality type is one of a set number of multiple personality types, such as the Myers-Briggs-Type Indicator (MBTI), which classifies human personality into 16 limited types. With the personality type of , each of the companion animal avatars in the metaverse virtual reality can be classified according to behavior and personality characteristics. Thereafter, events in which companion animal avatars whose personality types are determined by the server interact in the metaverse virtual space may be generated.

For example, event 1) An event in which a timid dog-type companion animal avatar and a companion animal avatar classified as opposites, such as a free celebrity-type companion animal avatar, fight each other and go to the hospital when they meet at a dog cafe in the metaverse virtual reality. may occur.

For example, Event 2) When an intimate diplomat-type companion animal avatar meets a companion animal avatar of the same type on a promenade, a courtship event may occur.

For example, Event 3) An event may occur in which the destruction king type companion animal avatar fails to adapt to the Metaverse Kindergarten and destroys property, requiring the user to compensate with coins.

According to various embodiments of the present disclosure, an interaction between a companion animal avatar and a user may be matched.

For example, a group function that matches the owner of each companion animal avatar with the creator at the center of the companion animal training center in the metaverse virtual reality may be performed according to the personality type of the companion animal avatar. That is, in the metaverse virtual reality, each user performs a mutual action through the companion animal avatars of each user, and an event that can be matched can be performed.

Also, for example, a function of automatically selecting and providing contents related to companion animal training, education, and care specialized for a corresponding group may be provided.

According to various embodiments of the present disclosure, a method of operating a user's terminal in a communication system is provided. The terminal includes a transceiver, a memory, a processor, an input device, an output device, and a camera. The method includes transmitting an image of a companion animal obtained using the camera to a server, and receiving first motion information about a motion of a companion animal avatar generated based on the image in a virtual space from the server. A process of outputting the motion of the companion animal avatar in the virtual space through the output device based on the first motion information, and an operation based on the first motion information of the companion animal avatar through the input device. A process of receiving feedback information of a first input indicating similarity to the actual motion of the companion animal or a second input indicating that it is not similar to the actual motion of the companion animal; The process of transmitting the feedback information of 2 inputs, the process of receiving second motion information of the companion animal avatar generated based on the feedback information, and the process of receiving the second motion information of the companion animal avatar through the output device based on the second motion information and outputting the motion of the companion animal avatar in space.

According to an embodiment, the companion animal avatar includes a process of determining an animal type for the companion animal based on the image, and a process of determining a detailed species of the companion animal among the animal types based on the image. And, through a process of generating a basic avatar based on the determined animal type and the determined detailed species, and a process of generating a final companion animal avatar by modifying the basic avatar based on detailed characteristics of the companion animal in the image. can be created

According to an embodiment, the method may further include transmitting basic characteristic setting information including physical characteristics, behavioral characteristics, and personality characteristics of the companion animal to the server. Personality information of the companion animal avatar may be generated based on the basic characteristic setting information. Also, the personality information may be determined as one personality type among a plurality of predetermined personality types.

According to an embodiment, the personality information of the companion animal avatar may be modified by repeating the process of transmitting the feedback information and the process of receiving the second motion information of the companion animal avatar generated based on the feedback information. there is. Based on the personality information, new second motion information of the companion animal avatar may be generated and received.

According to an embodiment, the method may further include receiving, from the server, arbitrary simulation information about a first situation of the companion animal avatar together with the first motion information. The feedback information may include a first input or a second input for a motion based on the first motion information of the companion animal avatar in the first situation. When simulation information of a second situation similar to the first situation is received together with the second motion information, the companion animal avatar may operate according to the second motion information generated based on the feedback information.

According to one embodiment, the input device may include a microphone. The method includes the steps of transmitting to the server a voice message about the companion animal avatar of the user obtained through the microphone, and the voice message of the companion animal avatar generated from the server based on the personality information. The method may further include receiving a response message and outputting the response message in video and audio through the output device as the companion animal avatar speaks.

According to an embodiment, the method includes conversation feedback of a third input indicating that the response message of the companion animal avatar is similar to the actual personality of the companion animal or a fourth input indicating that it is not similar through the input device. The method may further include receiving information and transmitting the dialog feedback information of the third input or the fourth input for the response message to the server. Personality information of the companion animal avatar may be modified based on the conversation feedback information. Based on the personality information, a new reply message to a new voice message transmitted to the server thereafter may be generated and received.

According to an embodiment, the method may further include receiving coin payment information as compensation for the feedback information from the server after transmitting the feedback information to the server.

Various embodiments of the present invention provide a user's terminal in a communication system. The terminal includes a memory, a processor, an input device, an output device, and a camera, and the processor is configured to perform a method of operating a user terminal in a communication system according to various embodiments of the present disclosure.

Various embodiments of the present invention provide a computer program recorded on a computer readable storage medium. The computer program is configured to perform a method of operating a user's terminal in a communication system according to various embodiments of the present disclosure.

In the case of implementing the embodiment of the present invention using hardware, ASICs (application specific integrated circuits) or DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices) configured to perform the present invention , FPGAs (field programmable gate arrays), etc. may be provided in the processor of the present invention.

Meanwhile, the above-described method can be written as a program that can be executed on a computer, and can be implemented in a general-purpose digital computer that operates the program using a computer-readable medium. In addition, the structure of data used in the above-described method may be recorded on a computer-readable storage medium through various means. Program storage devices, which may be used to describe a storage device containing executable computer code for performing various methods of the present invention, should not be construed as including transitory objects such as carrier waves or signals. do. The computer-readable storage media includes storage media such as magnetic storage media (eg, ROM, floppy disk, hard disk, etc.) and optical reading media (eg, CD-ROM, DVD, etc.).

The embodiments described above are those in which elements and features of the present invention are combined in a predetermined form. Each component or feature should be considered optional unless explicitly stated otherwise. Each component or feature may be implemented in a form not combined with other components or features. In addition, it is also possible to configure an embodiment of the present invention by combining some elements and/or features. The order of operations described in the embodiments of the invention may be changed. Some components or features of one embodiment may be included in another embodiment, or may be replaced with corresponding components or features of another embodiment. It is obvious that claims that do not have an explicit citation relationship in the claims can be combined to form an embodiment or can be included as new claims by amendment after filing.

It will be clear to those skilled in the art that the present invention can be embodied in other forms without departing from the technical spirit and essential characteristics of the present invention. Accordingly, the above embodiments should be considered in all respects as illustrative rather than restrictive. The scope of the present invention should be determined by reasonable interpretation of the appended claims and all possible changes within the equivalent scope of the present invention.

100: user terminal 110: transceiver
120: memory 130: processor
140: input device 150: output device
160: camera 200: server
210: transceiver 220: memory
230: processor 300: wired / wireless communication network

Claims (10)

A method of operating a terminal of a user in a communication system, wherein the terminal includes a transceiver, a memory, a processor, an input device, an output device, and a camera,
A process of transmitting an image of a companion animal acquired using the camera to a server;
receiving, from the server, first motion information about a motion of a companion animal avatar generated based on the image in a virtual space;
outputting a motion of the companion animal avatar in the virtual space through the output device based on the first motion information;
A process of receiving feedback information of a first input indicating that a motion based on the first motion information of the companion animal avatar is similar to an actual motion of the companion animal or a second input indicating that the motion is not similar to the actual motion of the companion animal through the input device; and ,
transmitting the feedback information of the first input or the second input for the first operation information to the server;
Receiving second motion information of the companion animal avatar generated based on the feedback information;
And outputting the motion of the companion animal avatar in the virtual space through the output device based on the second motion information.
method.
According to claim 1,
The companion animal avatar,
determining an animal type for the companion animal based on the image;
determining a detailed species of the companion animal among the animal types based on the image;
generating a basic avatar based on the determined animal type and the determined detailed species;
Created through a process of generating a final companion animal avatar by modifying the basic avatar based on the detailed characteristics of the companion animal on the image,
method.
According to claim 1,
Further comprising transmitting basic characteristic setting information including physical characteristics, behavioral characteristics, and personality characteristics of the companion animal to the server;
Characteristic information of the companion animal avatar is generated based on the basic characteristic setting information;
The personality information is determined as one personality type among a plurality of predetermined personality types,
method.
According to claim 3,
personality information of the companion animal avatar is modified by repeating the process of transmitting the feedback information and the process of receiving the second motion information of the companion animal avatar generated based on the feedback information;
Based on the personality information, the new second motion information of the companion animal avatar is generated and received.
method.
According to claim 1,
Further comprising receiving, from the server, arbitrary simulation information about a first situation of the companion animal avatar together with the first motion information;
The feedback information includes a first input or a second input for a motion based on the first motion information of the companion animal avatar in the first situation,
When simulation information of a second situation similar to the first situation is received together with the second motion information, the companion animal avatar operates according to the second motion information generated based on the feedback information.
method.
According to claim 4,
The input device includes a microphone,
transmitting a voice message for the companion animal avatar of the user obtained through the microphone to the server;
Receiving a response message of the companion animal avatar generated based on the voice message and the personality information from the server;
Further comprising outputting the answer message through the output device in video and audio as the companion animal avatar speaks,
method.
According to claim 6,
receiving conversation feedback information of a third input indicating that the response message of the companion animal avatar is similar to the actual personality of the companion animal or a fourth input indicating that it is not similar to the actual personality of the companion animal through the input device;
Transmitting the dialogue feedback information of the third input or the fourth input for the reply message to the server;
Personality information of the companion animal avatar is modified based on the conversation feedback information;
Based on the personality information, a new response message to a new voice message transmitted to the server thereafter is generated and received.
method.
According to claim 1,
After transmitting the feedback information to the server, further comprising receiving coin payment information as compensation for the feedback information from the server,
method.
In a user's terminal in a communication system,
Including a transceiver, memory, processor, input device, output device, camera,
wherein the processor is configured to perform the method according to any one of claims 1 to 8;
server.
A computer program recorded on a computer readable storage medium, configured to perform the method according to any one of claims 1 to 8.

Images