KR102584466B1 - Method and system for providing community using metaverse-based doll - Google Patents

Abstract

A system for providing a community using metaverse-based dolls is launched. The system includes a user's user terminal, an operating server configured to provide a metaverse environment to a plurality of accessors, and a doll configured to connect to the metaverse environment and perform interaction based on a connection command from the user terminal, , the doll stores interaction data indicating the result of the doll's interaction, generates user interest data indicating the user's interests from the user's voice or user's schedule information, and uses the interaction data and user interest data, In the metaverse environment, the target object to be interacted with is determined, and interaction is performed with the determined target object.

Description

Method and system for providing community using metaverse-based dolls {METHOD AND SYSTEM FOR PROVIDING COMMUNITY USING METAVERSE-BASED DOLL}

The present invention relates to a method and system for providing a community using metaverse-based dolls.

With the development of robotics technology, robots that can interact with humans or other robots are being developed. For example, robots that can interact with humans or other robots, such as conversing or exchanging data, are being developed. Meanwhile, with the recent increase in single-person households, robots designed to exchange emotions with users (emotional exchange robots) are also appearing. These robots not only provide a lot of help to users, such as talking to them or providing them with specific information, but they also provide some emotional convenience to single-person households, which can be lonely.

However, since these emotional exchange robots only exchange emotions with the user, the information that can be provided to the user is limited, and there is a problem that users can easily become bored because the interaction pattern of the emotional exchange robot does not change. .

The problem to be solved by the present invention is to provide a method and system for providing a community using a metaverse-based doll that can not only interact with users, but also interact with other users connected to the metaverse environment.

The system for providing a community using metaverse-based dolls according to embodiments of the present invention is based on a user's user terminal, an operating server configured to provide a metaverse environment to a plurality of users, and a connection command from the user terminal. Thus, it includes a doll configured to connect to the metaverse environment and perform interaction, where the doll stores interaction data representing the result of the doll's interaction, and determines the user's interests from the user's voice or the user's schedule information. Generates user interest data, uses the interaction data and user interest data to determine a target object to be interacted with in the metaverse environment, and performs interaction with the determined target object.

A method for providing a community using a metaverse-based doll according to embodiments of the present invention includes the steps of an operating server providing a metaverse environment to a plurality of users, and a user terminal accessing the metaverse environment with a doll. transmitting a connection command indicating, the doll generating user interest data indicating the user's interests from the user's voice or the user's schedule information, the doll generating interaction data indicating interactions performed by the doll and determining a target object to be interacted with in the metaverse environment using user interest data, and allowing the doll to connect to the metaverse environment and interact with the target object based on a connection command.

According to embodiments of the present invention, a non-transitory recording medium on which a program for executing the above-described system operating method is recorded and readable by a computer is provided.

According to embodiments of the present invention, a computer program recorded on a non-transitory recording medium is provided to execute the method of operating the above-described system.

According to the system and method for providing a community using metaverse-based dolls according to embodiments of the present invention, even if the user does not directly access the metaverse environment through the user terminal, the doll that operates according to the user's control is connected to the metaverse. It has the effect of connecting to the environment instead, performing interaction, and providing the results of the interaction to the user.

Accordingly, even in situations where the user cannot directly access the metaverse environment, the user can control the doll to access the metaverse environment, thereby providing and using the interaction results.

Figure 1 shows a community provision system according to embodiments of the present invention.
Figure 2 shows a doll according to embodiments of the present invention.
Figure 3 is a diagram for explaining the operation of a doll according to embodiments of the present invention.
Figure 4 is a diagram for explaining the operation of a doll according to embodiments of the present invention.
Figure 5 is a diagram for explaining the operation of a doll according to embodiments of the present invention.
Figure 6 is a diagram for explaining the operation of a doll according to embodiments of the present invention.
Figure 7 is a diagram for explaining the operation of a system according to embodiments of the present invention.

Since the present invention can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all changes, equivalents, and substitutes included in the spirit and technical scope of the present invention. While describing each drawing, similar reference numerals are used for similar components.

Terms such as first, second, A, and B may be used to describe various components, but the components should not be limited by these terms. The above terms are used only for the purpose of distinguishing one component from another. For example, a first component may be named a second component, and similarly, the second component may also be named a first component without departing from the scope of the present invention. The term and/or includes any of a plurality of related stated items or a combination of a plurality of related stated items.

When a component is said to be "connected" or "connected" to another component, it is understood that it may be directly connected to or connected to the other component, but that other components may exist in between. It should be. On the other hand, when it is mentioned that a component is “directly connected” or “directly connected” to another component, it should be understood that there are no other components in between.

The terms used in this application are only used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the technical field to which the present invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless explicitly defined in the present application, should not be interpreted in an ideal or excessively formal sense. No.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the attached drawings.

Figure 1 shows a community provision system according to embodiments of the present invention. Referring to FIG. 1, the community providing system 10 is a system that can provide a community in which a plurality of connected users can communicate with each other, and can provide a community in which a plurality of connected users can interact with each other. .

Depending on embodiments, the community providing system 10 may provide a metaverse-based community. The metaverse is a virtual space where users can interact with each other, and users can interact using an avatar that represents themselves in the metaverse environment.

The community provision system 10 may include a user terminal 100 of the user U, an operation server 200, and a doll 300. The community providing system 10 according to embodiments of the present invention has the effect of allowing the user (U) to use the community by accessing the metaverse through his or her doll 300.

The user terminal 100 is a device possessed or used by the user (U) and can exchange data with an external device such as the operation server 200 or the doll 300. For example, the user terminal 100 may be a personal mobile device with a wireless communication function, such as a personal computer (PC), laptop, smartphone, or wearable device, but according to the present invention, The embodiments are not limited thereto.

The user terminal 100 can exchange data with the operation server 200. Depending on embodiments, the user terminal 100 may transmit user information (i.e., login information) for accessing the metaverse environment provided by the operation server 200 to the operation server 200. Additionally, the user terminal 100 may transmit identification information of the user U's doll 300 to the operation server 200.

The user terminal 100 can exchange data with the doll 300. Depending on embodiments, the user terminal 100 may transmit a control command to control the doll 300 to the doll 300. For example, the user terminal 100 may transmit a command to control the connection of the doll 300 to the metaverse environment (i.e., provided by the operation server 200).

The operation server 200 is a device that can provide a metaverse environment, and can provide a metaverse-based community to users connected to the operation server 200. That is, connected users can access the metaverse environment operated by the operation server 200 and interact with each other through the operation server 200.

The doll 300 is a device that can exchange data with the user terminal 100 and the operation server 200. Depending on embodiments, the doll 300 may be implemented in the shape of a person or an animal.

The doll 300 may store user information associated with the user (U). The user information and doll information may be information input in advance by the user (U). User information may refer to various types of information that can infer the characteristics of the user (U), such as the user's age, interests, personality, residence, and gender.

Additionally, the doll 300 may determine the interests of the user U and the corresponding level of interest. Here, interests are areas in which the user (U) is interested and may include various areas such as, for example, ‘restaurants’, ‘date places’, and ‘weather’. The interest level quantifies the user's level of interest in the relevant interest and can have a value between 0 and 100, but is not limited thereto. This will be described later.

The interests and interest levels of the user (U) determined by the doll 300 may change over time, and unless otherwise stated herein, are understood to represent the interests and interest levels of the user (U) at the current time. It has to be.

The doll 300 can access the metaverse environment provided by the operation server 200 under the control of the user terminal 100. According to embodiments, the doll 300 transmits a request to access the metaverse environment along with the identification information of the doll 300 to the operation server 200, and the operation server 200 sends the identification information of the doll 300 to the operation server 200. You can authenticate and allow access to the metaverse environment based on the authentication result. At this time, authentication of the identification information of the doll 300 may be performed through whether the identification information of the doll 300 matches the identification information previously transmitted from the user terminal 100. However, according to an embodiment of the present invention They are not limited to this.

The doll 300 can access the metaverse environment and interact with other users connected to the metaverse environment. For example, the operation server 200 creates an avatar corresponding to the doll 300 in the metaverse environment and controls the avatar based on data transmitted from the doll 300, so that the doll 300 interacts with the connected users. enable it to perform its function. The doll 300 can store the results of the interaction.

In this specification, users of the metaverse environment should be understood to include not only users (i.e., people) but also dolls that operate under the user's control. For example, a connecter refers to all entities that interact in the metaverse environment.

At this time, the doll 300 connects to and interacts with the metaverse environment according to an operation command from the user terminal 100 (i.e., manually), or automatically (e.g., according to a preset schedule). ) You can connect to and interact with the metaverse environment. This will be described later.

The doll 300 can provide the user with the results of interaction in the metaverse environment. For example, the doll 300 can provide the results of various interactions, such as conversation content, observation content, moved place, conversation partner, and message reception content in the metaverse environment, to the user terminal 100 of the user (U). You can.

According to embodiments of the present invention, even if the user (U) does not directly access the metaverse environment through the user terminal 100, the doll 300, which operates under the control of the user (U), connects to the metaverse environment instead. It has the effect of performing interaction and providing the results of the interaction to the user (U). In addition, the doll 300 triggers the user terminal 100 regardless of (or independently) the control of the user (U), based on the interaction history in the metaverse environment under the control of the user (U). Upon receiving the signal, it automatically connects to the metaverse environment and performs the interaction, and provides the results of the interaction to the user terminal 100 or to the user (U) through the speaker built into the doll 300. It can provide direct interactive results. For example, the trigger signal is generated in the user terminal 100 at every cycle or at a preset time by the user (U), or is detected by the user (U) in conjunction with a wearable device worn by the user (U). It may be transmitted to the doll 300 at the time of entering the sleep state (for example, the time of entering REM sleep or non-REM sleep state). The wearable device is pre-paired with the user terminal 100, detects the sleep state (non-sleep, REM sleep, non-REM sleep, etc.) of the user (U), and transmits the detected sleep state to the user terminal (100). ) can be provided.

Accordingly, even in situations where the user (U) cannot directly access the metaverse environment, the user (U) is provided with the results of the interaction performed independently by the doll 300, thereby interacting with the subjects in the metaverse environment. There is an effect that can be experienced indirectly.

Figure 2 shows a doll according to embodiments of the present invention. Referring to FIG. 2, the doll 300 may include a microphone 310, a communication unit 320, a control unit 330, and a storage unit 340.

The microphone 310 can recognize the voice of the user (U). Depending on the embodiment, the microphone 310 may recognize the voice of the user U and generate voice data (or voice signal) corresponding to the recognized voice.

The communication unit 320 can exchange data with an external device. Depending on embodiments, the communication unit 320 may exchange data with an external device according to a wired communication method or a wireless communication method. For example, the communication unit 320 may exchange data with the user terminal 100 and the operation server 200.

The control unit 330 can control the overall operation of the doll 300. Depending on the embodiments, the control unit 330 may control the speaker 310, communication unit 320, and storage unit 340 of the doll 300. For example, the control unit 330 may include at least one processor, and the at least one processor may include a central processing unit (CPU), a micro controller unit (MCU), a graphical processing unit (GPU), or an application specified processor (ASIC). It may be an integrated circuit (IC) or a field programmable gate array (FPGA), but embodiments of the present invention are not limited thereto.

The control unit 330 may control the operation of the doll 300 according to the control of the user terminal 100. Depending on the embodiment, the control unit 330 may control the connection of the doll 300 to the metaverse environment (ME) and the interaction in the metaverse environment (ME) according to the control of the user terminal 100. For example, the control unit 330 may control data communication with the operation server 200 that provides the metaverse environment according to the control of the user terminal 100.

In addition, even if there is no separate explanation, it should be understood that the operations of the doll 300 described below are performed under the control of the control unit 330.

The storage unit 340 may store data necessary for the operation of the doll 300. For example, the storage unit 340 may include non-volatile memory or volatile memory.

Depending on embodiments, the storage unit 340 may store a plurality of commands for controlling the operation of the doll 300. The control unit 330 may control the doll 300 by loading the commands stored in the storage unit 340.

Additionally, the storage unit 340 may store user preference data indicating the preference of the user U of the doll 300. User tendency data may include at least one of a plurality of predetermined tendencies.

Additionally, the storage unit 340 may store interaction data resulting from the interaction of the doll 300.

In addition, the doll 300 may further include a speaker (not shown), and may play interaction data obtained in the metaverse environment (ME) directly to the user through the speaker. For example, the doll 300 can independently play information obtained through interactions or other users met in the metaverse environment (ME) to the user through a speaker, without the control of the user U.

Figure 3 is a diagram for explaining the operation of a doll according to embodiments of the present invention.

Referring to FIG. 3, the doll 300 can interact in a metaverse environment (ME). Depending on embodiments, the doll 300 may interact using the avatar 301 displayed in the metaverse environment (ME).

The doll 300 can access the metaverse environment (ME) through the operation server 200 and interact with the objects (OBJ1 and OBJ2) of the metaverse environment (ME). For example, the first object (OBJ1) may be an avatar corresponding to another user or doll in the metaverse environment (ME), and the doll 300 can exchange conversations or chat messages with the first object (OBJ). there is. At this time, the doll 300 may store the chatting record with the first object OBJ as interaction data. Additionally, for example, the second object (OBJ2) may be a place, building, or other various objects (e.g., a signboard or exterior material, etc.) within the metaverse environment (ME), and the doll 300 may be a place in the metaverse environment (ME). You can move to a location corresponding to the second object (OBJ) within (ME). At this time, the doll 300 acquires information about the second object (OBJ) (for example, the appearance and color of the second object (OBJ), or whether the appearance or color has changed compared to the previous access point, etc.) and can be saved as interaction data.

The doll 300 according to embodiments of the present invention can interact in a metaverse environment (ME) under the control of the user terminal 100.

Depending on embodiments, the user terminal 100 may transmit a manual operation command to the doll 300, and the doll 300 may perform interaction in the metaverse environment (ME) in response to the manual operation command. For example, the doll 300 may perform actions or interaction contents (conversation message to be shared with an object, command to move to a specific location or place) indicated by a manual operation command in the metaverse environment (ME). Interaction that occurs according to manual operation commands can be called manual interaction. At this time, the manual operation command is not necessarily transmitted from the user terminal 100, but is directly provided to the doll 300 through the user's voice through the microphone 310 included in the doll 300, or is provided directly to the doll 300 through the user terminal 100. ) The user's voice collected is transmitted to the doll 300, the doll 300 converts the transmitted user's voice into text using STT (Speech to Text) technology, etc., and natural language processing is performed on the converted text. (Natural Language Processing, NLP) technology can be used to interpret and the doll 300 can directly generate manual action commands.

Depending on embodiments, the user terminal 100 may transmit an automatic operation command or trigger signal to the doll 300, and the doll 300 may perform interaction in the metaverse environment (ME) in response to the automatic operation command. You can. For example, the automatic operation command may include information about the time zone and access time to the metaverse environment (ME), and the doll 300 automatically operates at the time indicated by the automatic operation command (i.e., the user terminal You can connect and interact in the metaverse environment (ME) (even without the operation of 100). Interaction that occurs according to automatic action commands can be called automatic interaction.

According to embodiments of the present invention, when the doll 300 operates according to an automatic operation command, it determines the object to be the object of interaction and/or the content of the interaction in the metaverse environment (ME) and performs the interaction. can do. This will be described later.

Figure 4 is a diagram for explaining the operation of a doll according to embodiments of the present invention.

Referring to FIG. 4, the doll 300 generates a keyword (KWD) from the schedule information of the user (U) transmitted from the user terminal 100 of the user (U) or the user's voice data received through the microphone 310. can be extracted. For example, the doll 300 may extract various keywords (KWD) by referring to a preset interest-related keyword dictionary. Here, the interest-related keyword dictionary may be data in which various keywords related to multiple interests are defined in advance by the user or other administrator.

The doll 300 may determine the interests of the user U and the level of interest corresponding to the interests of the user U using the extracted keywords (KWD). According to embodiments, the doll 300 may determine the interests of the user U by determining which interest the extracted keyword (KWD) belongs to among a plurality of predetermined interests. For example, the interest to which the extracted keywords (KWD) most belong may be determined as the interest of the user (U).

According to embodiments, the doll 300 transforms the extracted keyword (KWD) into a vector using a word embedding technique, embedding the keyword (KW) in a predetermined vector space, and embedding the keyword (KWD) into a vector space. , Calculate the distance between the centers of each of the predefined clusters (CLUs) defined in the predetermined vector space and corresponding to each of a plurality of interests, and the interest corresponding to the cluster located at the closest distance among the calculated distances. can be determined as the interest to which the keyword (KWD) belongs.

At this time, each cluster may include keywords defined as expressing interests corresponding to the cluster (for example, keywords defined as expressing specific interests can be identified using an interest-related keyword dictionary). .

A cluster has a centeroid in a vector space, where the center is defined using vectors corresponding to each of a number of keywords included in the cluster (i.e., keywords defined as expressing interests corresponding to the cluster). It can be. For example, the coordinates defined as the average of the coordinate values indicated by the corresponding vectors can be determined as the center. In another embodiment, the size of each of the corresponding vectors may be calculated, and the coordinates indicated by the vector having a size corresponding to the median among the sizes of each of the calculated vectors may be determined as the center.

That is, the doll 300 calculates the distance between the center of each cluster and the vector corresponding to the extracted keyword (KWD), thereby determining which interest among a plurality of predetermined interests the keyword (KWD) belongs to. The interests of the user (U) can be determined. For example, as shown in FIG. 4, the doll 300 may calculate the distance between the extracted keyword (KWD) and the center (O) of the cluster (CLU) representing travel as an interest, and use the calculated distance to The extracted keyword (KWD) belongs to a cluster (CLU) representing travel, and as a result, it can be determined that the user's (U) interest is travel. For example, the doll 300 may determine that the keyword (KWD) belongs to the corresponding interest if the calculated distance is within the radius (R) of the cluster (CLU).

Meanwhile, in one embodiment, when there are a plurality of extracted keywords (KWD), the doll 300 may determine that the interest indicated by the cluster to which the keywords (KWD) most belong is the interest of the user (U).

In another embodiment, when there are multiple extracted keywords (KWD), a virtual center coordinate composed of coordinates corresponding to the median among the coordinate values of the centers corresponding to each of the multiple clusters is set. And the distances between the set virtual center coordinates and the vectors corresponding to each of the keywords can be calculated. Next, among the calculated distances, keywords that fall within a preset threshold distance can be selected as primary keywords. Here, the primary keywords are filtered to reduce the error that occurs when keywords (filtering target keywords) that are overly unrelated or placed far away from the multiple clusters defined by the user belong to the specific cluster that is closest to them. It functions to reduce errors in setting interests.

When primary keywords are selected, the cluster to which each of the selected primary keywords belongs can be determined, and the interest corresponding to the cluster to which the most primary keywords belong can be determined as the interest of the user (U).

Additionally, the user's level of interest (i.e., the size of interest in the interest) corresponding to the determined interest may be defined as shown in Equation 1 below.

In Equation 1, INT is the user's interest, avgK means the average vector among the vectors of each primary keyword, key _i is a vector corresponding to the ith primary keyword, and O is the user's interest determined previously. It is the center of the cluster corresponding to the interest, mediK is a vector indicated by coordinates corresponding to the median value among the coordinates that make up the vectors of each primary keyword, and N is the number of primary keywords.

Figure 5 is a diagram for explaining the operation of a doll according to embodiments of the present invention.

Referring to FIG. 5 , the doll 300 may determine the interests and interest levels of the user U and generate user interest data (UPD) indicating the determined interests of the user and the corresponding interest levels. User interest data (UPD) may be used to determine a target object with which puppet 300 will interact in the metaverse environment (ME).

As described above, the doll 300 may connect to the metaverse environment (ME) and perform interaction in response to the automatic operation command of the user terminal 100. In the case of automatic action commands, since there is no separate instruction on the object with which the doll 300 should interact, the doll 300 determines the object to interact with (i.e., target object) on its own and interacts with the determined object. Interaction can be performed automatically.

Depending on embodiments, the doll 300 may generate interest data for each date and may store user interest data (UPD) for a predetermined period from the current point in time. For example, the doll 300 may store user interest data (UPD) for 3 days (May 26 to May 28) based on May 28 (i.e., the current time).

The doll 300 may use user interest data (UPD) and interaction data to determine the target object to be the subject of interaction and/or the content of the interaction in the metaverse environment (ME). At this time, the doll 300 may use the most recent user interest data (UPD) at the current time, or use user interest data (UPD) for a predetermined period from the current time.

According to embodiments, the doll 300 is based on the relationship between the interests of the user (U) and the interests of the current user (U) when the interaction at a past point in time before the current point in time occurred, Among the targeted objects, the target object with which to perform interaction at the current time can be determined. For example, the doll 300 may determine, among interactions performed in the past, an object that has been the target of an interaction performed when the interest is the same or similar to the current interest as the target object. If the user's (U) current interest is 'music', the doll 300 determines as the target object the object that is the object of the interaction performed when the interest is the same or similar to 'music' among the interactions that have already been performed. You can. At this time, the similarity between interests may be defined as the distance between clusters corresponding to each interest (e.g., distance between centers), and if the defined distance is within a preset first threshold, two It may be determined that the interests are similar to each other, and if the defined distance is 0 or within a second threshold that is less than the first threshold, the two interests may be determined to be the same.

On the other hand, when there are multiple user interests stored for a predetermined period from the current point in time, the doll 300 can determine the target object according to the method described above using the interest with the highest level of interest (i.e., highest interest) among the interests. .

Depending on embodiments, the doll 300 may determine the target object using only manual interaction among previously performed interactions. That is, the doll 300 may determine, among interactions performed in the past, an object that has been the target of a manual interaction performed when the interest is the same or similar to the current interest as the target object.

In a more specific embodiment, when there are a plurality of user interests stored for a predetermined period from the current point in time, and a plurality of interests corresponding to each of the plurality of interests are stored (for example, the interest in travel is measured at the time of measurement) (continuously fluctuates depending on the subject), the doll 300 may determine the target object according to the above-described method using the period change value of the interest of the user (U) during a predetermined period. For example, the doll 300 determines the interest corresponding to the interest with the highest period variation value as the highest interest among the user's multiple interests stored for a predetermined period of time, and determines the interest corresponding to the interest with the highest period variation value as the highest interest and the highest interest of the user U. An object that is the target of interaction corresponding to the same or similar interest may be determined as the target object. For example, the doll 300 may determine as the target object an object that is the target of an interaction performed when the interest is the same or similar to the highest interest of the user U.

Depending on the embodiment, the doll 300 may calculate the period change value of the interest levels corresponding to each of the plurality of interests according to Equation 2 below.

Here, EP(LI) is the period variation value of interest levels corresponding to a specific interest, LI _i is the interest level at a time point i days (i is an integer between 0 and k) from the current point, and k is a predefined period of time. is the number of days, and g _k (i) is a decreasing function for i and an increasing function for k, and is defined as, for example, Equation 3 below.

In the case of FIG. 5, since the number of days in a predetermined period is 3 days, the period change value of the interest level of 'food' interest calculated according to Equations 2 and 3 can be calculated as in Equation 4 below.

The doll 300 according to embodiments of the present invention considers not only the interests and interest levels of the user (U) at the current point in time, but also changes in the interest level of each interest over a predetermined period from the current point in time. It has the effect of determining the target object on which it will act.

Figure 6 is a diagram for explaining the operation of a doll according to embodiments of the present invention.

Referring to FIG. 6, the doll 300 may use user interest data and interaction data to determine a target object to interact with in the metaverse environment (ME).

Interaction data (ID) includes information about the date on which the interaction was performed, the interests of the user (U) when the interaction was performed, interest level, object of interaction, and operation mode (manual/automatic) of the doll 300. It can be included.

The doll 300 uses objects that were the object of interaction in the past based on the relationship between the interests of the user (U) and the interests of the current user (U) when the interaction took place in the past before the current time. Thus, the target object of the interaction to be performed at the current time can be determined. For example, the doll 300 may determine, among interactions performed in the past, an object that has been the target of an interaction performed when the interest is the same or similar to the current interest as the target object.

As shown in FIG. 6, when the user U's current interest is 'travel', the doll 300 refers to the interaction data and selects 'travel' among the interactions performed in the past. Interaction can be led, and the object (OBJ427, OBJ428) that is the target of the led interaction can be determined as the target object.

Meanwhile, when there are multiple past interactions that correspond to the current interests of the user (U), interactions with a close level of interest can be read, and the object that is the target of the led interaction can be determined as the target object. Additionally, depending on embodiments, the doll 300 may lead an interaction corresponding to the interest of the current point in time among manual interactions among previously performed interactions, and determine an object that is the target of the led interaction as the target object. .

The doll 300 can access the metaverse environment (ME) and interact with the determined target object. Depending on embodiments, the doll 300 may transmit a request for interaction with the determined target object to the operation server 200.

When interacting with a determined target object, the doll 300 may perform the interaction using the contents of past interactions with the target object. For example, the doll 300 may perform interaction using past conversation records with the target object.

Figure 7 is a diagram for explaining the operation of a system according to embodiments of the present invention.

Referring to FIG. 7 , the doll 300 may receive a recommendation from the operation server 200 for a target object (TOBJ) that will be an object of interaction in the metaverse environment (ME). According to embodiments, the doll 300 may transmit user interest data (UPD) of the determined user (U) to the operation server 200, and the operation server 200 may transmit the target object based on the user interest data (UPD). (TOBJ) may be determined, and information about the determined target object (TOBJ) may be transmitted to the doll 300.

The operation server 200 may store object data (OBJD) representing information about objects that exist (or are accessible) in the metaverse environment (ME). Object data (OBJD) may include, for each object, information about the interest, interest level, and update date of the interest and interest level corresponding to the object. Here, the interest corresponding to the object represents the interest of the user associated with the object (for example, if the object is an avatar of a doll, the interest of the owner (user) of the doll).

The operation server 200 uses object data (OBJD) to determine, as a target object (TOBJ), an object with interests and degrees most similar to the user interest data (UPD) transmitted from the doll 300, and Information about (TOBJ) can be transmitted to the doll 300.

For example, the operation server 200 may determine as the target object an object that has the same interest as the interest indicated by the user interest data (UPD) and has the smallest difference from the interest.

Methods according to the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. Computer-readable media may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on a computer-readable medium may be specially designed and constructed for the present invention or may be known and usable by those skilled in the computer software art.

Examples of computer-readable media may include hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions may include machine language code such as that created by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The above-described hardware device may be configured to operate with at least one software module to perform the operations of the present invention, and vice versa.

Additionally, the above-described method or device may be implemented by combining all or part of its components or functions, or may be implemented separately.

Although the present invention has been described above with reference to preferred embodiments, those skilled in the art may make various modifications and changes to the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. You will understand that you can do it.

Claims (5)

In a system for providing a community on the metaverse, a virtual space where users interact with objects using avatars, through dolls,
the user's user terminal;
An operating server configured to provide a metaverse environment to a plurality of connected users; and
Based on a connection command from the user terminal, it includes a doll configured to connect to the metaverse environment and perform interaction,
The objects include the avatar and objects in the metaverse,
The doll is,
Store interaction data representing the result of the doll's interaction,
Generating user interest data indicating the user's interests from the user's voice or the user's schedule information,
Using the interaction data and the user interest data, determine a target object to be interacted with in the metaverse environment,
Interact with the determined target object,
The connection command includes a manual operation command or an automatic operation command,
The doll is,
When the manual operation command is received, interaction in the metaverse environment is performed based on the operation command from the user terminal,
When the automatic operation command is received, interaction in the metaverse environment is performed without an operation command from the user terminal,
The doll is,
In response to the automatic operation command, determine the target object with which to interact during the automatic operation in the metaverse environment using the interaction data and the user interest data,
The doll is,
Extract keywords from the user's voice or the user's schedule information,
Embed the extracted keywords in a random vector space,
Calculating the distance between one of the embedded keywords and one of the clusters defined in the vector space and corresponding 1:1 to a plurality of predetermined interests in relation to the clusters for each of the keywords,
Among the calculated distances, keywords that fall within a preset threshold distance are selected as primary keywords,
Determine the cluster to which each of the selected primary keywords belongs,
Determining the interest corresponding to the cluster to which the largest number of primary keywords belong among the primary keywords as the user's interest,
The user's interest level, which represents the size of interest corresponding to the determined interest, is determined according to the equation below,

In the above equation, INT is the user's interest, avgK means the average vector calculated from the vectors in which each of the primary keywords is embedded, key _i is the vector corresponding to the ith primary keyword, and O is the user's It is the center of the cluster corresponding to the interest, and mediK obtains the first median value from the values of the first coordinate among the first to nth coordinates corresponding to each component of the vectors in which each of the primary keywords is embedded, and the second It is a vector composed of the first to nth median values obtained by sequentially calculating the second median value from the coordinate values to obtain the nth median value from the nth coordinates, where N is the number of primary keywords, dis is an operation that represents the distance between the two corresponding vectors,
system. delete delete delete The method of claim 1, wherein the doll is:
Among interactions made by the doll in the past, determine a past interaction corresponding to the determined interest of the user,
Determining an object that has been the target of a determined past interaction as the target object,
system.