KR102215736B1 - Display method of character avatar created for service provision in virtual reality space - Google Patents

Abstract

Disclosed is a method of generating an avatar for an exhibition hall platform using a virtual reality space operated by a system including a user terminal, a seller terminal, and a service server. A method for generating an avatar according to an embodiment of the present disclosure may include, at the service server, generating a virtual space based on data received from the seller terminal and providing the virtual space to the user terminal; The service server receiving a request for generating a character avatar from at least one of the user terminal and the seller terminal and generating a character avatar corresponding to the request; Placing the generated character avatar in the virtual space; And when a user command for learning the character avatar is input, learning the character avatar based on the user command. Includes.

Description

In a virtual 　 real 　 space 　 service 　 provision 　 created 　 character 　 avatar's 　 display 　

The present invention relates to a character generation and learning system for providing a service in a virtual reality space.

Virtual Reality is a technology that enables humans to experience real life in a virtual world created with computers.

On the other hand, a technology that combines virtual reality (VR) and augmented reality (AR), a technology that adds virtual information to the real world, is called mixed reality (MR). VR, AR, and MR all have something in common in that they are technologies that enable people to recognize reality by realizing a reality that does not exist. However, there is a difference in that AR is a method of adding virtual information to real reality, and in VR, all fictional situations are presented. MR mixes AR and VR to provide a mixture of real and virtual information in a real background, and a technology that can process large amounts of data is required.

HMD (Head Mount Display) is generally used for virtual reality experience, which is a display device that the user mounts on the head for VR experience. It blocks the user's gaze from the outside and then shows the virtual world to the user's perspective. Do it. A microphone, stereo speaker and other sensors can be mounted on the face so that the display is in front of the eyes.

The problem to be solved by the present invention is to provide a character creation and learning system for providing services in a virtual reality space.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

A method for generating an avatar of an exhibition hall platform using a virtual reality space operated by a system including a user terminal, a seller terminal, and a service server according to an embodiment of the present disclosure for solving the above-described problem, the service server Creating a virtual space based on the data received from the seller terminal and providing it to the user terminal; The service server receiving a request for generating a character avatar from at least one of the user terminal and the seller terminal and generating a character avatar corresponding to the request; Placing the generated character avatar in the virtual space; And when a user command for learning the character avatar is input, learning the character avatar based on the user command. Includes.

In this case, in the learning step, category information for learning the character avatar is transmitted to the user terminal or the seller terminal, and category information for at least one of the transmitted category information is transmitted from the user terminal or the seller terminal. Upon receipt, the character avatar may be trained based on the received category information.

In this case, when the character avatar is a character avatar generated by the seller terminal, the character avatar learns data on the generated virtual space and services provided in the virtual space, and the avatar generation method includes the service Obtaining, by a server, request information for the virtual space and services provided in the virtual space from a plurality of character avatars corresponding to a plurality of user terminals; Obtaining, by the service server, response information corresponding to the obtained request information; And providing, by the service server, a recommendation service to a user avatar corresponding to any one user terminal based on the fairy request and answer information.

In this case, the avatar generation method includes: the service server, the user's personal information received from the user terminal, the user's field of interest information, the user's search history information, the state information of the user terminal, the usage history information of the user terminal Receiving at least one of the information; The service server may further include learning the character avatar based on the received at least one piece of information.

In this case, the avatar generation method includes: receiving, at the service server, a request to purchase a character avatar from the user terminal learned from at least one of a plurality of user terminals or a plurality of seller terminals; The service server, upon receiving a command for selling the character avatar from the user terminal, selling the character avatar to a terminal corresponding to the purchase request; Including, the character avatar purchase request and sale may be provided within the virtual space.

In this case, the selling of the character avatar may further include, upon receiving a command for selling the character avatar from the user terminal, deleting personal information of the user of the user terminal stored in the character avatar; I can.

In this case, the method of generating an avatar includes: when a request for access to the virtual space is requested from the user terminal, providing the virtual space and a character avatar of the seller terminal disposed in the virtual space to the user terminal; And if there is a character avatar corresponding to the user terminal, disposing the character avatar in the virtual space and providing the character avatar to the user terminal; and generated from the service server from a user terminal other than the user terminal. Upon receiving a request to access the virtual space, a user avatar corresponding to the other user terminal may be displayed and provided in the virtual space.

In this case, the providing step includes providing the created virtual space when the user's view transmitted from the user terminal is outside a preset range, and when the user’s view transmitted from the user terminal is within a preset range, the It is possible to receive and provide an image around the user terminal.

Meanwhile, a service server according to an embodiment of the present disclosure for solving the above-described problem includes: a memory for storing one or more instructions; And a processor that executes the one or more instructions stored in the memory, wherein the processor executes the one or more instructions to perform the method of claim 1.

. On the other hand, the computer program according to an embodiment of the present disclosure for solving the above-described problem. It is combined with a computer, which is hardware, and stored in a computer-readable recording medium to perform the method of claim 1.

According to the disclosed embodiment, it is possible to construct a platform capable of effectively providing various services by using various characters in a virtual reality building.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a diagram illustrating a character creation and learning system for providing a service in a virtual reality space according to an embodiment of the present disclosure.
2 is a diagram illustrating an operation of a character generation and learning system according to an embodiment of the present disclosure.
3 is a diagram for explaining a method of constructing a virtual space and providing a service according to an embodiment of the present disclosure.
4 and 5 are exemplary diagrams for explaining a method for generating a virtual space according to an embodiment of the present disclosure.
6 is an exemplary diagram illustrating a service recommendation method according to an embodiment of the present disclosure.
7 is an exemplary diagram for explaining that a plurality of users use the same virtual space according to an embodiment of the present disclosure.
8 is an exemplary diagram for explaining selling a character avatar according to an embodiment of the present disclosure.
9 is an exemplary diagram for describing a method of displaying a virtual space according to an exemplary embodiment of the present disclosure.
10 is a block diagram of an apparatus according to an exemplary embodiment.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms, only the present embodiments are intended to complete the disclosure of the present invention, It is provided to fully inform the technician of the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used in the specification, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements. Throughout the specification, the same reference numerals refer to the same elements, and “and/or” includes each and all combinations of one or more of the mentioned elements. Although "first", "second", and the like are used to describe various elements, it goes without saying that these elements are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical idea of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

The term "unit" or "module" used in the specification refers to a hardware component such as software, FPGA or ASIC, and the "unit" or "module" performs certain roles. However, "unit" or "module" is not meant to be limited to software or hardware. The “unit” or “module” may be configured to be in an addressable storage medium, or may be configured to reproduce one or more processors. Thus, as an example, "sub" or "module" refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, It includes procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays and variables. Components and functions provided within "sub" or "module" may be combined into a smaller number of components and "sub" or "modules" or into additional components and "sub" or "modules". Can be further separated.

Spatially relative terms "below", "beneath", "lower", "above", "upper", etc., as shown in the figure It can be used to easily describe the correlation between a component and other components. Spatially relative terms should be understood as terms including different directions of components during use or operation in addition to the directions shown in the drawings. For example, if a component shown in a drawing is turned over, a component described as "below" or "beneath" of another component will be placed "above" the other component. I can. Accordingly, the exemplary term “below” may include both directions below and above. Components may be oriented in other directions, and thus spatially relative terms may be interpreted according to orientation.

In the present specification, a computer refers to all kinds of hardware devices including at least one processor, and may be understood as encompassing a software configuration operating in a corresponding hardware device according to embodiments. For example, the computer may be understood as including all of a smartphone, a tablet PC, a desktop, a laptop, and a user client and an application running on each device, but is not limited thereto.

In the present specification, the artificial intelligence model includes all types of models designed to implement an artificial intelligence system, including a model learned using machine learning.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Each of the steps described herein is described as being performed by a computer, but the subject of each step is not limited thereto, and at least some of the steps may be performed by different devices according to embodiments.

1 is a diagram illustrating a character creation and learning system for providing a service in a virtual reality space according to an embodiment of the present disclosure.

The components shown in FIG. 1 are shown as examples, and components of the system according to the disclosed embodiment are not limited thereto. Also, components not shown in FIG. 1 may be added to the system shown in FIG. 1, and some components shown in FIG. 1 may be omitted from the system shown in FIG. 1.

In one embodiment, the character creation and learning system may include a user terminal 110, a service server 120, and a seller terminal 130. In the present disclosure, the operation of one user terminal 110, service server 120, and seller terminal 130 is disclosed, but with respect to a plurality of user terminals 110, service server 120, and seller terminal 130 It is obvious that the same technical idea can be applied.

The user terminal 110 may include an additional device for providing a virtual space. In one embodiment, the user terminal 110 may include a Head Mount Display (HMD). However, the output device included in the user terminal 110 is not limited to the HMD, and various types of output devices may be used to provide virtual reality.

In one embodiment, the user terminal 110 may have a built-in processing device for processing and reproducing a virtual space, or may be connected to an external processing device to output information received from the processing device using a display. . The external processing device may be the user terminal 110 or a computing device connected to the service server 120. According to an embodiment, the user terminal 110 may output a virtual reality image based on information received from the service server 120.

In an embodiment, the service server 120 may be a computing device including at least one processor. Depending on the embodiment, the service server 120 may mean a cloud server. In one embodiment, the service server 120 may be used interchangeably with a platform.

* In one embodiment, the service server 120 is connected to a plurality of user terminals 110 and can transmit content to each of a plurality of virtual reality equipment, and each user terminal 110 is a service server 120 A virtual space is output based on the content received from.

2 is a diagram illustrating an operation of a character generation and learning system according to an embodiment of the present disclosure.

First, the service server 120 may create a virtual space based on data received from the seller terminal 130 and provide it to the user terminal 110 (S210). A method of creating a virtual space will be described in detail with reference to FIGS. 3 and 4.

The service server 120 may generate a character avatar by receiving a request for generating a character avatar from at least one of a user terminal and a seller terminal (S220). The character avatar generated at this time is a character avatar including only basic functions, and new functions may be learned according to a user command.

The service server 120 may place the generated character avatar in the virtual space (S230). In one embodiment, when the character avatar is generated from the request of the seller terminal 130, the service server 120 receives the location information and the moving radius information of the character avatar placed from the seller terminal 130 and places the character avatar. can do. That is, since the character avatar corresponding to the seller terminal 130 is often used to provide information or services to the user of the user terminal 110, it may be set to have a specific location and a specific moving radius.

In another embodiment, when the character avatar is generated from the request of the user terminal 110, the service server 120 may place the character avatar within a preset range in the user's field of view in the virtual space. That is, since the character avatar corresponding to the user terminal 110 is often a character avatar for the user's convenience, it may be placed near the user.

When a user command for learning a character avatar is input, the service server 120 may learn a character avatar based on the user command (S240).

In one embodiment, the service server 120 transmits category information for learning a character avatar to the user terminal 110 or the seller terminal 120, and transmits category information for at least one of the transmitted category information to the user terminal ( 110) or the seller terminal 130, it is possible to learn a character avatar based on the received category information.

In this case, the category information may be information on various categories for learning a character avatar. In an embodiment, the category information may be information on various categories, such as a language category, a sports category, a shopping category, and an education category. The category information may further include detailed category information obtained by subdividing the category information. For example, the subcategory of the language category is a first subcategory that constitutes the type of language such as Korean, Japanese, Chinese, and English, and a second subcategory that expresses behaviors related to language such as translation, writing, reading, speaking, and listening. It may be composed of a third subcategory that determines the degree of learning of the category of.

In particular, the third subcategory is, for example, a category related to the degree of learning about the English translation category, and may be a subcategory for determining the level of translation such as beginner level translation, intermediate level translation, and advanced level translation. In general, a character avatar with a high degree of learning requires more resources (data amount, cost, etc.) than a character avatar with a low degree of learning. Accordingly, it is possible to classify categories according to the amount of available resources and learn character avatars according to user selection.

The user may select at least one of category information provided from the service server 120 to learn a character avatar. In this case, the process of learning the character avatar may be configured by transmitting a previously stored learning module. However, the process of learning a character avatar may be implemented through an artificial intelligence model.

Meanwhile, the service server 120 may continuously learn the learned character avatar. Specifically, the service server 120 may update the character avatar when data related to the learned category information is input to the character avatar. At this time, data for the update may be provided from the user terminal 110 or the seller terminal 13. However, the present invention is not limited thereto, and the service server 120 may select data to be updated to learn a character avatar. For example, when data corresponding to the learned category information is received through various methods, the service server 120 may update the character avatar based on the received data.

As an example, it is assumed that the character avatar has learned translation of beginner level English (the same applies to various languages such as Chinese and Japanese). The user terminal 110 or the seller terminal 130 provides various English (and its translation data) for learning English translation to the service server 120, and the service server 120 learns a character avatar using the provided data. I can make it. Character avatars, which were initially capable of English translation at the beginner level, can raise the level of English translation through continuous learning.

Furthermore, since learning is performed using data provided by the terminal, a personalized character avatar can be obtained for the user of the terminal. That is, the data provided from the terminal may be data related to words or sentences that the user of the terminal is interested in or frequently used. Accordingly, the learned character data can better translate the user's field of interest, and there is an effect that a personalized character avatar can be created. For example, when a user of a terminal continuously provides data on a sports field, which is a field of interest, to learn a character avatar, the character avatar has a higher quality of translation in the sports field than in the other field. Will be high.

Furthermore, when compared with a character avatar that has learned English translation at the level of a native speaker from the beginning, there is an effect of reducing the amount of data for learning and reducing the capacity of the character avatar by improving only the translation ability for the field required by the user. .

Meanwhile, in the above-described embodiment, it has been described that the user terminal 110 or the seller terminal 130 transmits category information so that the service server 120 learns the character avatar, but the present invention is not limited thereto. In an embodiment according to the present disclosure, the service server 120 may receive user information of the terminal from the user terminal 110 or the seller terminal 130, and learn a character avatar based on the received user information. Of course. At this time, the user information refers to the user's biometric information collected through the terminal, the usage history record of the terminal collected through the terminal (the usage history record includes schedule information, type of application used, usage time, website address accessed, and access time). , Alarm setting time, terminal usage time and distribution, etc. may be at least one of all user commands through the terminal.)

That is, the character avatar may be learned according to the personal usage of each terminal and used as a personalized character avatar.

Meanwhile, the above-described various learning can be implemented through an artificial intelligence system. The artificial intelligence (AI) system is a computer system that implements human-level intelligence, and unlike the existing rule-based smart system, the machine learns, judges, and becomes smarter. As artificial intelligence systems are used, their recognition rate improves and users' tastes can be understood more accurately, and existing rule-based smart systems are gradually being replaced by deep learning-based artificial intelligence systems.

Artificial intelligence technology consists of machine learning (deep learning) and component technologies using machine learning.

Machine learning is an algorithm technology that classifies/learns the features of input data by itself, and element technology is a technology that simulates functions such as cognition and judgment of the human brain using machine learning algorithms such as deep learning. It consists of technical fields such as understanding, reasoning/prediction, knowledge expression, and motion control.

Specifically, deep learning is a machine learning algorithm that attempts a high level of abstraction (summarizing key contents or functions in a large amount of data or complex data) through a combination of several nonlinear transformation methods. Is defined as a set of Deep learning can be seen as a branch of machine learning that teaches computers how people think in a large framework.

When there is any data, it is represented in a form that can be understood by a computer (for example, in the case of an image, pixel information is expressed as a column vector, etc.) and a lot of research (how to do better) to apply it to learning. How to create representation techniques and how to create models to learn them) is in progress. As a result of these efforts, various deep learning techniques have been developed. Examples of deep learning techniques include Deep Neural Networks (DNN), Convolutional Deep Neural Networks (CNN), Reccurent Neural Networks (RNN), and Deep Belief Networks (DBN). have.

Deep Neural Networks (DNNs) are artificial neural networks (ANNs) composed of a plurality of hidden layers between an input layer and an output layer.

In this case, the structure of the deep neural network may be composed of a perceptron. Perceptron consists of several inputs, one processor, and one output. The processor multiplies several input values by a weight, and then sums all the input values multiplied by the weight. Then, the processor substitutes the summed value into the activation function and outputs one output value. If a specific value is desired as an output value of the activation function, the weight multiplied by each input value can be modified, and the output value can be recalculated using the modified weight. At this time, each perceptron may use a different activation function. Also, each perceptron accepts the outputs from the previous layer as inputs, and then uses the activation function to get the outputs. The obtained output is passed to the input of the next layer. Through the above-described process, several output values can be finally obtained.

According to the disclosed embodiment, the service server 120 may collect various user information of a user using a virtual space from the user terminal 110 or the seller terminal 130 and use it to set weights used for deep learning. have. At this time, the user information refers to the user's biometric information collected through the terminal, the usage history record of the terminal collected through the terminal (the usage history record is the type of application used, the usage time, the website address accessed, the access time, and the alarm It may be at least one of all user commands through the terminal, such as setting time, terminal usage time, and distribution.) For example, an artificial intelligence model for learning a character avatar complements the character avatar based on the above-described various user information. Information may be collected, and each weight may be reset based on this.

Returning to the description of deep learning techniques, convolutional deep neural networks (CNNs) are a type of multilayer perceptrons designed to use minimal preprocessing. A convolutional neural network consists of one or several convolutional layers and a general artificial neural network layer on top of it, and additionally utilizes weights and pooling layers. Thanks to this structure, the convolutional neural network can fully utilize the input data of the two-dimensional structure. Also, convolutional neural networks can be trained through standard inverse forwarding. Convolutional neural networks are more easily trained than other feed-forward artificial neural networks, and have the advantage of using fewer parameters. The convolutional neural network extracts features from the input image by alternately performing convolution and subsampling on the input image.

The convolutional neural network includes several convolution layers, several subsampling layers (subsampling layers, lacal pooling layers, and Max-Pooling layers), and fully connected layers. The convolution layer is a layer that performs convolution on an input image. In addition, the subsampling layer is a layer that locally extracts a maximum value for an input image and maps it to a 2D image. The local area is enlarged and subsampling is performed.

In the convolutional layer, information such as a kernel size, the number of kernels to be used (that is, the number of maps to be generated), and a weight table to be applied during a convolution operation is required. For example, take a case where the size of the input image is 32×32, the size of the kernel is 5×5, and the number of kernels to be used is 20. In this case, if a 5×5 kernel is applied to an input image having a size of 32×32, it is impossible to apply a kernel to each of two pixels at the top, bottom, left, and right of the input image. This is because when convolution is performed after placing the kernel on the input image, the resulting value of'-8' is determined as the value of the pixel corresponding to the center element of the kernel among the pixels of the input image included in the kernel. to be. Accordingly, when convolution is performed by applying a kernel of a size of 5×5 to an input image of size of 32×32, a map of size of 28×28 is generated. Previously, since it was assumed that the number of kernels to be used is a total of 20, a total of 20 maps with a size of 28×28 are generated in the first convolutional layer.

The subsampling layer needs information on the size of the kernel to be subsampled and information on whether to select the maximum or minimum value among values in the kernel region.

Returning to the description of the deep learning technique, a Reccurent Neural Network (RNN) refers to a neural network in which the connection between units constituting an artificial neural network constitutes a directed cycle. Unlike the forward neural network, the recurrent neural network can utilize the memory inside the neural network to process arbitrary inputs.

Deep Belief Networks (DBN) is a generative graphical model used in machine learning, and in deep learning, it means a deep neural network composed of multiple layers of latent variables. The feature is that there is a connection between layers, but there is no connection between units within a layer.

The deep trust neural network can be used for prior learning due to its generative model, and after learning initial weights through prior learning, it can fine-tune the weights through backpropagation or other discrimination algorithms. This characteristic is very useful when there is little training data, because the smaller the training data, the stronger the initial value of the weight has on the resulting model. The pre-learned weight initial value is closer to the optimal weight compared to the arbitrarily set weight initial value, which makes it possible to improve the performance and speed of the fine-tuning step.

The above-described artificial intelligence and its learning method are described for illustration purposes, and the artificial intelligence and its learning method used in the embodiments described below are not limited. For example, all kinds of artificial intelligence technologies and learning methods thereof that a person skilled in the art can apply to solve the same problem may be used to implement the system according to the disclosed embodiment.

3 is a diagram for explaining a method of constructing a virtual space and providing a service according to an embodiment of the present disclosure.

As shown in FIG. 3, a detailed operation of the service server 120 will be described. The service server 120 may receive data for building a virtual space and information on a service to be applied to the virtual space to be created from the seller terminal 130 (S310).

Specifically, the seller terminal 130 may transmit data on the virtual space to be provided to the user terminal 110 to the service server 120 to request the service server 120 to create a virtual space. In this case, the virtual space to be created may be various types of virtual spaces.

In an embodiment, the virtual space to be created may be a virtual space corresponding to the model house.

In another embodiment, the virtual space to be created may be a virtual space corresponding to a shopping mall.

In another embodiment, the virtual space to be created may be a virtual space corresponding to various exhibitions.

In another embodiment, the virtual space to be created may be a cooperative space of a plurality of user avatars corresponding to a plurality of users.

In another embodiment, the virtual space to be created may be a virtual space for providing content.

The service server 120 may generate a virtual space by converting the data received from the seller terminal 130 (S320).

Thereafter, the service server 120 may map a service corresponding to information on the service to a region of the created virtual space (S330).

Specifically, the seller terminal 130 may aim to provide various services within a virtual space rather than simply for the purpose of creating a virtual space. Accordingly, the seller terminal 130 transmits service information for mapping various services to the created virtual space to the service server 120, and the service server 120 may map the service to the created virtual space.

In one embodiment, when the created virtual space is a virtual space corresponding to a model house, the mapped service is a content service for guiding information on the model house (price information, construction company and sales company information) or built-in furniture. It may be a service for Korea, an interior recommendation service suitable for the environment, and the like.

In another embodiment, when the generated virtual space is a virtual space corresponding to a shopping mall, the mapped service may be a service for product information, price information, inventory information, fitting information, etc. of products sold in the shopping mall. Further, the mapped service may be a service that provides an expected appearance when the user wears a shopping mall product when the user avatar registered by the user terminal 110 includes user body shape information.

In another embodiment, when the generated virtual space is a virtual space corresponding to various exhibitions, the mapped service may be a content service for works to be displayed in the exhibition. In this case, the service server 120 may help the user to view the exhibition without directly attending the exhibition by implementing the work to be displayed in a virtual space. Furthermore, the mapped service may be a service that provides information on an artwork to be displayed. Video, audio, text enhancement There is an effect that users can provide better services than visiting an exhibition directly by delivering information about the work in various ways.

In another embodiment, the generated virtual space may be a cooperative space of a plurality of user avatars corresponding to a plurality of users. In this case, the mapped service may be a data transmission service for a plurality of users to cooperate, a viewer service that provides various viewers for data, a chat service for sharing information, a document work service for editing and modifying information, and the like. .

In another embodiment, the generated virtual space may be a virtual space for providing content. In this case, the mapped service may be a service for providing content.

Meanwhile, when an access to the virtual space is requested from the user terminal 110, the service server 120 may provide the created virtual space to the user terminal 110 (S340).

In this case, as will be described later, the user terminal 110 may display its own character avatar together in the created virtual space. Or, of course, a user avatar corresponding to another user terminal can be displayed in the created virtual space.

When the service server 120 transmits a user command requesting a mapped service from the user terminal 110, the service server 120 may provide the requested service to the user terminal 110 (3250 ). In this case, the various services described above may be provided through various methods.

4 is an exemplary diagram illustrating a method for creating a virtual space according to an embodiment of the present disclosure.

The service server 120 may receive 2D 6-view data from the seller terminal 130 (S410). The service server 120 may convert the received 2D six-dimensional view into a 3D virtual space (S420). In an embodiment, data for building a virtual space received by the service server 120 may be a 2D six-dimensional view. The service server 120 may generate a 3D virtual space by converting the received 2D six-dimensional view. In this case, each side of the 2D six-view view may include elements such as wallpaper pattern, content information, and frame as needed. Meanwhile, although the present disclosure refers to a six-sided view, when the virtual space is not a rectangular parallelepiped shape, it goes without saying that various 2D drawings corresponding thereto can be used as data for constructing the virtual space. For example, when the 3D space is a conical shape, the service server 120 may receive data on the expanded view of the cone.

As another embodiment, it goes without saying that the implemented virtual space may be a 4D virtual space (eg, a 4D supercube). It goes without saying that the service server 120 can receive a 3D development view to build a 4D virtual space. For example, as shown on the left side of FIG. 5, the service server 120 may create a 4D space by attaching each corresponding surface of the 3D virtual diagram. That is, the service server 120 may create the right virtual space of FIG. 5 by attaching faces having the same number in the left development view of FIG. 5.

When an access to the virtual space is requested from the user terminal 110, the service server 120 may provide the created virtual space to the user terminal 110 (S430).

Meanwhile, in the generated virtual space, various objects may be arranged inside the space. Accordingly, data for building a virtual space received by the service server 120 may include data on an object object. Specifically, the service server 120 may receive object object information and location information of the object object from the seller terminal 130.

The service server 120 may place an object object corresponding to the object object information at a location corresponding to the location information of the object object. For example, when the object object is a closet and the location of the object object is the home, the service server 120 may arrange the closet in a place located in the home of the virtual space. As another example, when the object object is a front door and the location of the object object is between the shoe cabinet and the outside, the service server 120 may arrange the front door between the shoe cabinet and the outside.

The service server 120 may receive a user interaction for an object object from the user terminal 110. User interaction may be various, such as a user gesture or input through the user terminal 110.

In this case, if another virtual space mapped to the object object exists, the service server 120 may provide a virtual space corresponding to another mapped virtual space to the user terminal. For example, when the object object is a closet, another mapped virtual space may be a virtual space representing the interior of the closet. Alternatively, when the object object is a front door, another mapped virtual space may be a virtual space representing the outside.

Meanwhile, it goes without saying that the object objects arranged in the virtual space can also be mapped with various services. For example, when the object object is a closet, the service mapped to the closet may be a service that provides a list of clothes inside the closet. Alternatively, when the object object is a front door, the service mapped to the front door may be a logout service for terminating the virtual space.

6 is an exemplary diagram illustrating a service recommendation method according to an embodiment of the present disclosure.

The service server 120 may obtain request information for a virtual space and a service provided in the virtual space from a plurality of character avatars corresponding to a plurality of user terminals (S610). In this case, the request information may mean all information for which the user terminal 110 requests a service from the seller terminal 130.

The service server 120 may acquire response information for the acquired request information (S620). That is, the service server 120 may obtain the request information and response information to the request information, and obtain information related to the distribution of services, questions, complaints, etc. used by the user, and response information thereto. Furthermore, the service server 120 may additionally acquire feedback information on the provided answer. In one embodiment, the service server 120 may directly request feedback on the provided answer to the user terminal 110 or may obtain the response by analyzing the frequency of service use of the user terminal 110 after the response.

The service server 120 may provide a recommendation service for a user avatar corresponding to any one user terminal based on the acquired request information and response information (S630). Specifically, the service server 120 acquires user information of the user terminal 110 from the user terminal 110 that provided the recommended service, and obtains usage information of the user terminal 110 and obtained request information and response information. Recommendation service can be provided based on. That is, the service server 120 may provide a service that is of interest to the user based on user information of the user terminal 110.

7 is an exemplary diagram for explaining that a plurality of users use the same virtual space according to an embodiment of the present disclosure.

First, when access to a virtual space is requested from the user terminal 110, the service server 120 may provide the created virtual space to the user terminal 110 (S710).

The service server 120 may determine whether the user terminal 110 is in an online mode (S720). That is, when the user wants to receive only the virtual space, only the virtual space is provided, and when the user wants to interact with another user, the user avatar of the other user can be displayed, and the service server 120 provides the user terminal 110 online. This can be determined according to whether the mode is the mode or the offline mode.

When the user terminal 110 is in the online mode (S720-Y), the service server 120 displays and provides a user avatar corresponding to the other user terminal in the virtual space if there is another user terminal accessing the virtual space. Can be (S730)

Furthermore, when there is a character avatar provided by the seller terminal 130, the service server 120 may display and provide the provided character avatar in a virtual space (S750).

* In this case, the character avatar may be a character avatar provided from the seller terminal 130 or a character avatar provided from the user terminal 110. The character avatar can output various interactions according to a specific purpose.

8 is an exemplary diagram for explaining selling a character avatar according to an embodiment of the present disclosure.

The service server 120 may receive a purchase request for a learned character avatar from at least one user terminal among a plurality of user terminals or a plurality of seller terminals (S810).

The service server 120 may sell the character avatar to the terminal corresponding to the purchase request when receiving a command to sell the character avatar from the terminal corresponding to the purchase request (S820).

The character avatar learned through the various methods described above may be implemented in various forms according to the learning method and learning content. Therefore, a character avatar learned by a specific user may be scarce as only a specific user. Accordingly, the service server 120 may provide a virtual space for purchasing or selling a plurality of character avatars corresponding to a plurality of terminals.

In this case, the character avatar to be sold is personalized to a specific user, and thus, there may be a case that includes the user's personal information. Accordingly, the service server 120 may delete the user's personal information stored in the character avatar to be sold and proceed with the sales procedure.

In one embodiment, the service server 120 not only deletes the seller's personal information, but also deletes learning contents related to the seller's personal information.

9 is an exemplary diagram for describing a method of displaying a virtual space according to an exemplary embodiment of the present disclosure.

The service server 120 may receive the user's field of view information from the user terminal 110 (S910). In this case, the field of view information may be information on a focal length of the user. The method for the user terminal 110 to recognize the user's focal length is not limited, for example, the user terminal 110 is at least one sensor device facing the user's 10 eye to recognize the user's focal length. It may include.

The service server 120 may determine whether the received field of view information is within a preset range (S920).

If it is within a preset range (S920-Y), the service server 120 may transmit the surrounding image of the user terminal to the user terminal 110 (S930). That is, when the focal length received from the user terminal 110 is short, the service server 120 determines that it is to search the real world rather than a virtual space, and transmits the surrounding image of the user terminal to the user terminal 110. have. However, without providing the surrounding image of the user terminal 110 to the user terminal, the user may be able to search the real world by removing the virtual space being provided. Alternatively, the service server 120 may display an image around the user terminal 110 only for an area corresponding to the focal length of the user based on the focal length, and may display a virtual space for the remaining area.

Meanwhile, the service server 120 may display a separate guide object for providing the surrounding image of the user terminal 110 to the user terminal in a virtual space. That is, the service server 120 displays a guide object according to the focal length in a virtual space, and when the user gazes at the guide object and the focal length is changed within a preset range, the service server 120 may provide an image around the user terminal 100 I can. That is, since it requires considerable effort for the user to change the focal length without any object, the service server 120 may arrange a guide object for adjusting the focal length on the virtual space.

In another embodiment, it goes without saying that the service server 120 may arrange a plurality of guide objects in a virtual space and map each service for each guide object. That is, the service server 120 may provide various services according to the focal length of the user.

If it is not within the preset range (S920-N), the service server 120 may provide the created virtual space to the user terminal 110 (S940).

Meanwhile, a method of displaying a virtual space and a method of using the displayed virtual space according to the present disclosure may be various.

In one embodiment, the user terminal 110 may display the virtual space and the surrounding image by mixing or overlapping, or displaying a section by dividing it, or crossing it according to a situation, and the method is not limited. Does not.

In an embodiment, an actual surrounding image may be photographed and displayed in a space between screens and an area where the screen is not displayed.

In an embodiment, when the user's gaze moves more than a preset angle, an actual surrounding image may be displayed within the user's gaze, and a virtual space may be displayed outside the user's gaze. Likewise, when the user's gaze again moves more than a preset angle, a virtual space may be displayed within the user's gaze, and an actual surrounding image may be displayed outside the user's gaze.

In this embodiment, an image may be actually displayed outside the user's gaze, but it is unnecessary or impossible to display the image outside the user's gaze, so displaying an image outside the user's gaze means that the user It may include the concept of rendering or loading the image so that the image can be displayed when the visual line of sight is turned in a corresponding direction.

In an embodiment, an upper limit may be set to a speed at which the user's gaze recognized by the user terminal 110 moves as the user's gaze moves. That is, when the user's gaze moves at a speed greater than or equal to a preset speed, the speed at which the user's gaze recognized by the user terminal 110 moves does not follow it. You can watch the video. That is, the user can view the actual surrounding image displayed outside the line of sight until the movement of the line of sight follows the movement of the actual line of sight. Therefore, the user can check the actual surrounding image by moving the gaze rapidly above the preset upper limit speed.

In another embodiment, the user terminal 110 may control the display of a virtual space or an actual surrounding image by recognizing a surrounding situation.

For example, when the user terminal 110 detects the sound of a friend sitting around the user calling the user, the user terminal 110 may display an actual surrounding image in a corresponding direction.

Similarly, the user terminal 110 is the user terminal 110 when another person or object approaches the user, when the user has a risk of collision with an external object, when it is detected that the user reaches out in a specific direction. May display an actual surrounding image in the direction in which the corresponding object or motion is recognized.

In an embodiment, the user terminal 110 may display an advertisement object at a point in the virtual space where the screen is not displayed. In another embodiment, the advertisement object may be displayed by overlapping the screen, or may be displayed in a space in front of the screen in the virtual space.

In addition, the user terminal 110 may display an advertisement image on at least one of the screens 310 to 330 displayed in the virtual space.

In an embodiment, the user terminal 110 may display an advertisement image or advertisement object in the user's gaze direction. In this case, the advertisement object may disappear from the user's gaze direction as the user observes the advertisement object for more than a preset time or performs a predetermined interaction with the advertisement object, such as selecting the advertisement object, but is not limited thereto.

10 is a block diagram of an apparatus according to an exemplary embodiment.

The processor 102 may include one or more cores (not shown) and a graphic processing unit (not shown) and/or a connection path (eg, a bus) for transmitting and receiving signals with other components. .

The processor 102 according to an embodiment performs the method described with reference to FIGS. 1 to 9 by executing one or more instructions stored in the memory 104.

Meanwhile, the processor 102 temporarily and/or permanently stores a signal (or data) processed inside the processor 102, a RAM (Random Access Memory, not shown) and a ROM (Read-Only Memory). , Not shown) may further include. In addition, the processor 102 may be implemented in the form of a system on chip (SoC) including at least one of a graphic processing unit, RAM, and ROM.

The memory 104 may store programs (one or more instructions) for processing and controlling the processor 102. Programs stored in the memory 104 may be divided into a plurality of modules according to functions.

The steps of a method or algorithm described in connection with an embodiment of the present invention may be implemented directly in hardware, implemented as a software module executed by hardware, or a combination thereof. Software modules include Random Access Memory (RAM), Read Only Memory (ROM), Erasable Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), Flash Memory, hard disk, removable disk, CD-ROM, or It may reside on any type of computer-readable recording medium well known in the art to which the present invention pertains.

Components of the present invention may be implemented as a program (or application) and stored in a medium in order to be executed in combination with a computer that is hardware. Components of the present invention may be implemented as software programming or software elements, and similarly, embodiments include various algorithms implemented with a combination of data structures, processes, routines or other programming elements, including C, C++ , Java, assembler, or the like may be implemented in a programming or scripting language. Functional aspects can be implemented with an algorithm running on one or more processors.

In the above, embodiments of the present invention have been described with reference to the accompanying drawings, but those of ordinary skill in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features. You can understand. Therefore, the embodiments described above are illustrative in all respects, and should be understood as non-limiting.

110: user terminal
120: service server
130: seller terminal

Claims (1)

In the method of generating an avatar for an exhibition hall platform using a virtual reality space operated by a system including a user terminal, a seller terminal, and a service server,
The service server generating a virtual space based on data received from the seller terminal and providing the virtual space to the user terminal;
The service server, receiving a request for generating a character avatar from at least one of the user terminal and the seller terminal, and generating a character avatar corresponding to the request;
Placing the generated character avatar in the virtual space; And
When a user command for learning the character avatar is input, learning the character avatar based on the user command; Including,
The step of learning,
When category information for learning the character avatar is transmitted to the user terminal or the seller terminal, and category information for at least one of the transmitted category information is received from the user terminal or the seller terminal, the received category information Including; learning the character avatar based on,
When the character avatar is a character avatar generated by the user terminal
The avatar generation method,
Receiving, by the service server, user's personal information, user's interest field information, user's search history information, status information of the user terminal, and usage history information of the user terminal received from the user terminal; And
Further comprising, by the service server, learning the character avatar based on the received at least one piece of information,
The avatar generation method,
The service server includes: receiving a request to purchase a character avatar of the user terminal learned from at least one of a plurality of user terminals or a plurality of seller terminals;
The service server, upon receiving a command for selling the character avatar from the user terminal, selling the character avatar to a terminal corresponding to the purchase request; Including,
Selling the character avatar,
Upon receiving an instruction for selling the character avatar from the user terminal, deleting personal information about the user of the user terminal stored in the character avatar and learning contents related to the personal information; Including more,
The providing step,
When the user's view transmitted from the user terminal is outside a preset range, the created virtual space is provided, and when the user’s view transmitted from the user terminal is within a preset range, the surrounding image of the user terminal is received. Providing; Including more,
The step of receiving and providing the surrounding image of the user terminal,
Displaying a guide object for providing a surrounding image to a user terminal on the virtual space;
Determining the user's field of view based on the user's focal length when the user gazes at the guide object and the user's focal length is changed; And
When the user's field of view corresponding to the user's focal length is within a preset range, the image around the user terminal is displayed only for the area corresponding to the user's focal length, and the virtual space is displayed for the remaining areas. Including;
The providing step,
Determining a moving speed of the user's gaze; And
When the moving speed is greater than or equal to a preset speed, displaying a surrounding image; Including more,
The user terminal is characterized in that it is implemented as a head mounted display (HMD) to provide the virtual space,
The avatar generation method,
When access to the virtual space is requested from the user terminal, providing the virtual space and a character avatar of the seller terminal disposed in the virtual space to the user terminal; And
If a character avatar corresponding to the user terminal exists, placing the character avatar in the virtual space and providing the character avatar to the user terminal; Including,
When a request for accessing a virtual space created from the service server is received from a user terminal other than the user terminal, a user avatar corresponding to the other user terminal is displayed and provided in the virtual space. Way.

Images