KR102080878B1 - Character creation and learning system for service provision in virtual reality space - Google Patents

Abstract

Disclosed is a method for creating an avatar for an exhibition platform using a virtual reality space operated by a system including a user terminal, a seller terminal and a service server. According to an embodiment of the present invention, the avatar creation method includes: a step in which the service server creates a virtual space based on data received from the seller terminal to provide the space to the user terminal; a step in which the service server receives a request for the creation of a character avatar from at least one of the user terminal and the seller terminal to create a character avatar responding to the request; a step in which the created character avatar is placed in the virtual space; and a step in which when a user command for instructing the character avatar is inputted, the character avatar is instructed based on the user command.

Description

Character creation and learning system for providing services in virtual reality space {CHARACTER CREATION AND LEARNING SYSTEM FOR SERVICE PROVISION IN VIRTUAL REALITY SPACE}

The present invention relates to a character generation and learning system for providing a service in a virtual reality space.

Virtual Reality is a technology that allows people to have a realistic experience in a virtual world made of computers.

Meanwhile, a technology that combines virtual reality (VR) and augmented reality (AR), a technology that adds virtual information to the real world, is called mixed reality (MR). VR, AR, and MR are all common in that they are technologies that realize reality that does not exist so that people can recognize it. AR differs from the fact that virtual information is added to real reality and VR is presented in a fictional situation. MR provides a mixture of AR and VR to provide a mixture of real and virtual information on a realistic background, requiring a technology that can process large amounts of data.

HMD (Head Mount Display) is generally used for the experience of virtual reality, which is a display device mounted on the user's head for the VR experience, and serves to show the virtual world to the user's vision after blocking the user's eyes from the outside. Do it. It can be equipped with a microphone, stereo speakers and other sensors in the form of a face that faces the display in front of you.

An object of the present invention is to provide a character generation and learning system for providing a service in a virtual reality space.

Problems to be solved by the present invention are not limited to the above-mentioned problems, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

The avatar generating method of the exhibition hall platform using a virtual reality space operated by a system including a user terminal, a seller terminal and a service server according to an embodiment of the present disclosure for solving the above problems, the service server, the Generating a virtual space based on data received from a seller terminal and providing the virtual space to the user terminal; The service server generating a character avatar corresponding to the request by generating a character avatar request from at least one of the user terminal and the seller terminal; Disposing the generated character avatar in the virtual space; And when a user command for learning the character avatar is input, training the character avatar based on the user command; It includes.

In this case, the training may include transmitting category information for learning the character avatar to the user terminal or the seller terminal, and category information for at least one of the transmitted category information from the user terminal or the seller terminal. Upon reception, the character avatar can be trained based on the received category information.

In this case, when the character avatar is a character avatar generated by the seller terminal, the character avatar learns data about the generated virtual space and a service provided in the virtual space, and the avatar generating method includes the service. Obtaining, by the server, request information for the virtual space and the services provided in the virtual space from a plurality of character avatars corresponding to a plurality of user terminals; Acquiring, by the service server, answer information corresponding to the obtained request information; And providing, by the service server, a recommendation service to a user avatar corresponding to any one user terminal based on the fairy hearing and answer information.

In this case, the avatar generation method, the service server, the user's personal information received from the user terminal, the user's interest field information, the user's search history information, the state information of the user terminal, the usage history information of the user terminal Receiving at least one of the information; And learning, by the service server, the character avatar based on the at least one received information.

In this case, the avatar generation method, the service server, receiving a character avatar purchase request of the user terminal learned from at least one of a plurality of user terminals or a plurality of seller terminals; The service server, when receiving a command for selling the character avatar from the user terminal, selling the character avatar to a terminal corresponding to the purchase request; The character avatar purchase request and sale may be provided in the virtual space.

In this case, the selling of the character avatar may further include deleting personal information of the user of the user terminal stored in the character avatar when receiving a command for selling the character avatar from the user terminal. Can be.

In this case, the avatar generating method may further include providing a character avatar of the virtual space and the seller terminal disposed in the virtual space to the user terminal when an access to the virtual space is requested from the user terminal; And if the character avatar corresponding to the user terminal exists, placing the character avatar in the virtual space and providing the character avatar to the user terminal, wherein the character avatar is generated from the service server from a user terminal other than the user terminal. When receiving a request for access to the virtual space, a user avatar corresponding to the other user terminal may be displayed and provided in the virtual space.

In this case, the providing may include providing the generated virtual space when the visual field of the user transmitted from the user terminal is outside a preset range, and when the visual field of the user transmitted from the user terminal is within a preset range. The surrounding image of the user terminal may be received and provided.

On the other hand, the service server according to an embodiment of the present disclosure for solving the above problems, the memory for storing one or more instructions; And a processor that executes the one or more instructions stored in the memory, wherein the processor executes the one or more instructions to perform the method of claim 1.

. On the other hand, a computer program according to an embodiment of the present disclosure for solving the above problems. Combined with a computer, which is hardware, it is stored on a computer-readable recording medium for carrying out the method of claim 1.

According to the disclosed embodiment, it is possible to build a platform that can effectively provide various services using various characters in virtual reality.

Effects of the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a diagram illustrating a character generation and learning system for providing a service in a virtual reality space according to one embodiment of the present disclosure.
2 is a view for explaining the operation of the character generation and learning system according to an embodiment of the present disclosure.
FIG. 3 is a diagram for describing a method of building a virtual space and providing a service according to an embodiment of the present disclosure.
4 and 5 are exemplary diagrams for describing a method for creating a virtual space according to an embodiment of the present disclosure.
6 is an exemplary view for explaining a service recommendation method according to an embodiment of the present disclosure.
7 is an exemplary diagram for describing a plurality of users using the same virtual space according to an embodiment of the present disclosure.
8 is an exemplary view for explaining a character avatar sale according to an embodiment of the present disclosure.
9 is an exemplary view for explaining a virtual space display method according to an embodiment of the present disclosure.
10 is a block diagram of an apparatus according to an embodiment.

Advantages and features of the present invention, and methods for achieving them will be apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below but may be embodied in various different forms, only the present embodiments are intended to complete the disclosure of the present invention, and those of ordinary skill in the art to which the present invention pertains. It is provided to fully inform the skilled person of the scope of the invention, which is defined only by the scope of the claims.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and / or “comprising” does not exclude the presence or addition of one or more other components in addition to the mentioned components. Like reference numerals refer to like elements throughout, and "and / or" includes each and all combinations of one or more of the mentioned components. Although "first", "second", etc. are used to describe various components, these components are of course not limited by these terms. These terms are only used to distinguish one component from another. Therefore, of course, the first component mentioned below may be the second component within the technical spirit of the present invention.

Unless otherwise defined, all terms used in the present specification (including technical and scientific terms) may be used in a sense that can be commonly understood by those skilled in the art. In addition, terms that are defined in a commonly used dictionary are not ideally or excessively interpreted unless they are specifically defined clearly.

The term "part" or "module" as used herein refers to a hardware component such as software, FPGA or ASIC, and the "part" or "module" plays certain roles. However, "part" or "module" is not meant to be limited to software or hardware. The “unit” or “module” may be configured to be in an addressable storage medium or may be configured to play one or more processors. Thus, as an example, a "part" or "module" may include components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, Procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. Functions provided within components and "parts" or "modules" may be combined into smaller numbers of components and "parts" or "modules" or into additional components and "parts" or "modules". Can be further separated.

The spatially relative terms " below ", " beneath ", " lower ", " above ", " upper " It can be used to easily describe a component and its correlation with other components. Spatially relative terms are to be understood as including terms in different directions of components in use or operation in addition to the directions shown in the figures. For example, when flipping a component shown in the drawing, a component described as "below" or "beneath" of another component may be placed "above" the other component. Can be. Thus, the exemplary term "below" can encompass both an orientation of above and below. Components may be oriented in other directions as well, so spatially relative terms may be interpreted according to orientation.

In the present specification, a computer refers to any kind of hardware device including at least one processor, and according to an embodiment, it may be understood as a meaning encompassing a software configuration that operates on the hardware device. For example, a computer may be understood as including, but not limited to, a smartphone, a tablet PC, a desktop, a notebook, and a user client and an application running on each device.

In this specification, the AI model includes all kinds of models designed to implement an AI system, including a model trained using machine learning.

Hereinafter, with reference to the accompanying drawings will be described an embodiment of the present invention;

Each step described herein is described as being performed by a computer, but the subject of each step is not limited thereto, and at least some of the steps may be performed in different devices according to embodiments.

1 is a diagram illustrating a character generation and learning system for providing a service in a virtual reality space according to one embodiment of the present disclosure.

The components shown in FIG. 1 are shown by way of example, and the components of the system according to the disclosed embodiments are not limited thereto. In addition, components not shown in FIG. 1 may be further added to the system shown in FIG. 1, and some components shown in FIG. 1 may be omitted from the system shown in FIG. 1.

In an embodiment, the character generation and learning system may include a user terminal 110, a service server 120, and a seller terminal 130. In the present disclosure, an operation of one user terminal 110, a service server 120, and a seller terminal 130 is disclosed. However, the plurality of user terminals 110, the service server 120, and a seller terminal 130 are described. Obviously, the same technical idea may be applied.

The user terminal 110 may include an additional device for providing a virtual space. In one embodiment, the user terminal 110 may include a head mount display (HMD). However, the output device included in the user terminal 110 is not limited to the HMD, and various types of output devices may be used to provide virtual reality.

In an embodiment, the user terminal 110 may have a built-in processing device for processing and reproducing a virtual space, or may be connected to an external processing device to output information received from the processing device using a display. . The external processing device may be the user terminal 110 or a computing device connected to the service server 120. According to an embodiment, the user terminal 110 may output the virtual reality image based on the information received from the service server 120.

In one embodiment, the service server 120 may be a computing device including at least one processor. According to an embodiment, the service server 120 may mean a cloud server. In one embodiment, the service server 120 may be used interchangeably with the platform.

In an embodiment, the service server 120 is connected to the plurality of user terminals 110 and transmits content to each of the plurality of virtual reality devices, each user terminal 110 from the service server 120 The virtual space is output based on the received content.

2 is a view for explaining the operation of the character generation and learning system according to an embodiment of the present disclosure.

First, the service server 120 may generate a virtual space based on the data received from the seller terminal 130 and provide the virtual space to the user terminal 110 (S210). A method of generating a virtual space will be described in detail with reference to FIGS. 3 and 4.

The service server 120 may generate a character avatar by receiving a request for generating a character avatar from at least one of a user terminal and a seller terminal (S220). In this case, the generated character avatar is a character avatar including only basic functions, and may learn new functions according to a user command.

The service server 120 may arrange the generated character avatar in the virtual space (S230). In one embodiment, when the character avatar is generated from the request of the seller terminal 130, the service server 120 receives the position information and moving radius information of the character avatar disposed from the seller terminal 130 to arrange the character avatar. can do. That is, the character avatar corresponding to the seller terminal 130 is often provided to provide information or service to the user of the user terminal 110, and thus may be set to have a specific location and a specific moving radius.

In another embodiment, when the character avatar is generated from the request of the user terminal 110, the service server 120 may arrange the character avatar within a preset range in the field of view of the user in the virtual space. That is, since the character avatar corresponding to the user terminal 110 is often a character avatar for the convenience of the user, the character avatar may be disposed near the user.

If a user command for learning the character avatar is input, the service server 120 may learn the character avatar based on the user command (S240).

In one embodiment, the service server 120 transmits the category information for learning the character avatar to the user terminal 110 or the seller terminal 120, the category information for at least one of the transmitted category information to the user terminal ( If received from 110 or the seller terminal 130, it is possible to learn the character avatar based on the received category information.

In this case, the category information may be information on various categories for learning the character avatar. In one embodiment, the category information may be information on various categories such as language category, sports category, shopping category, and education category. The category information may further include detailed category information obtained by subdividing the category information. For example, the sub-categories of the language category are the first sub-category constituting the kind of language such as Korean, Japanese, Chinese, and English, and the second sub-category representing the acts on the language such as translation, writing, reading, speaking, and listening, respectively. The third subcategory may be configured to determine the degree of learning of the category.

In particular, the third subcategory is, for example, a category related to the degree of learning about the English translation category, and may be a subcategory for determining a translation level such as beginner level translation, intermediate level translation, and advanced level translation. In general, a character avatar with a high degree of learning requires more resources (amount of data, cost, etc.) than a character avatar with a low degree of learning. Therefore, the category is classified according to the amount of available resources and the character avatar can be trained according to the user's selection.

The user may select at least one of the category information provided from the service server 120 to learn the character avatar. In this case, the process of learning the character avatar may be configured by transmitting a pre-stored learning module. However, the process of learning the character avatar may be implemented through an artificial intelligence model.

Meanwhile, the service server 120 may continuously learn the learned character avatar. In detail, the service server 120 may update the character avatar when data related to the learned category information is input to the character avatar. In this case, the data for updating may be provided from the user terminal 110 or the seller terminal 13. However, the present invention is not limited thereto, and the service server 120 may select the data to be updated to train the character avatar. For example, when data corresponding to the learned category information is received through various methods, the service server 120 may update the character avatar based on the received data.

As an example, it is assumed that the character avatar is in a state of learning a beginner level translation of English (also in the case of various languages such as Chinese and Japanese). The user terminal 110 or the seller terminal 130 provides a variety of English (and its translation data) to the service server 120 for learning English translation, the service server 120 learns the character avatar using the provided data You can. Character avatars, which were initially available for beginner level English translation, can be improved through continuous learning.

Furthermore, since the learning is performed using data provided by the terminal, a character avatar personalized to the user of the terminal may be obtained. That is, the data provided from the terminal may be data related to a word or a sentence that the user of the terminal is interested in or frequently used. Thus, the learned character data can translate the user's field of interest better and there is an effect that a personalized character avatar can be generated. For example, if the user of the terminal has continuously provided data on the sports field of his / her interests to learn the character avatar, the character avatar has a higher quality of translation in the sports field than the quality of the translation to other fields. Will be high.

Furthermore, when comparing native English-language translation with a character avatar who has learned from the beginning, there is an effect of reducing the amount of data for learning and the capacity of the character avatar by improving only the translation ability for the required field. .

Meanwhile, in the above-described embodiment, the user terminal 110 or the seller terminal 130 transmits the category information so that the service server 120 learns the character avatar, but is not limited thereto. According to an embodiment of the present disclosure, the service server 120 may receive user information of the terminal from the user terminal 110 or the seller terminal 130, and learn the character avatar based on the received user information. Of course. In this case, the user information includes biometric information of the user collected through the terminal and usage history records of the terminal collected through the terminal (the usage history record includes schedule information, types of applications used, usage time, website address, and access time). At least one of all user commands through the terminal, such as an alarm setting time, a terminal use time, and a distribution.

That is, the character avatar may be learned and used as a personalized character avatar according to the personal use aspect of each terminal.

Meanwhile, the above-described various learning may be implemented through an artificial intelligence system. Artificial Intelligence (AI) system is a computer system that implements human-level intelligence, and unlike conventional rule-based smart systems, machines learn, judge, and become smart. As the AI system is used, the recognition rate is improved and the user's taste can be understood more accurately, and the existing Rule-based smart system is gradually replaced by the deep learning-based AI system.

AI technology is composed of elementary technology that utilizes machine learning (deep learning) and machine learning.

Machine learning is an algorithm technology that classifies / learns characteristics of input data by itself, and element technology is a technology that simulates the functions of human brain cognition and judgment by using machine learning algorithms such as deep learning. It consists of technical fields such as understanding, reasoning / prediction, knowledge representation and motion control.

Specifically, deep learning is a machine learning algorithm that attempts a high level of abstraction (summarizing key content or functions in large amounts of data or complex data) through a combination of several nonlinear transformations. It is defined as a set of. Deep learning can be seen as a field of machine learning that teaches computers how people think in a large framework.

When there is any data, it is represented in a form that can be understood by a computer (for example, in the case of an image, the pixel information is represented by a column vector), and a lot of research is performed to apply it to learning. How to create expression techniques and how to build models to learn them). As a result of these efforts, various deep learning techniques have been developed. Deep learning techniques include Deep Neural Networks (DNN), Convolutional Deep Neural Networks (CNN), Reccurent Neural Networks (RNN), and Deep Belief Networks (DBN). have.

Deep Neural Networks (DNNs) are artificial neural networks (ANNs) made up of a plurality of hidden layers between an input layer and an output layer.

At this time, the structure of the deep neural network may be composed of a perceptron (perceptron). A perceptron consists of several inputs, one processor, and one output. The processor multiplies a plurality of input values by each weight, and then adds the weighted input values together. The processor then substitutes the sum of the values into the activation function and outputs one output value. If a specific value is desired as an output value of the activation function, the weight multiplied by each input value may be modified, and the output value may be recalculated using the modified weight. At this time, each perceptron may use a different activation function. Each perceptron also accepts the output from the previous layer as input, then uses the activation function to get the output. The obtained output is passed to the input of the next layer. Through the above process, several output values can be finally obtained.

According to an embodiment of the present disclosure, the service server 120 may collect various user information of a user who uses a virtual space from the user terminal 110 or the seller terminal 130 and use it to set weights used for deep learning. have. In this case, the user information is a user's biometric information collected through the terminal, the usage history record of the terminal collected through the terminal (use history record is the type of the application used, the usage time, the website address, the access time, the alarm It may be at least one of all user commands through the terminal, such as a set time, a terminal use time, and a distribution.) For example, an artificial intelligence model for learning a character avatar may be used to supplement the character avatar based on the above-described various user information. The information may be collected, and the respective weights may be reset based on the information.

Returning to the deep learning technique, Convolutional deep Neural Networks (CNN) is a type of multilayer perceptrons designed to use minimal preprocessing. A convolutional neural network consists of one or several convolutional layers and a general artificial neural network layer on top of them, and further utilizes weights and pooling layers. This structure allows the multiplicative neural network to fully utilize the input data of the two-dimensional structure. In addition, convolutional neural networks can be trained through standard backtransmission. The multiplicative neural network is more easily trained than other feedforward neural network techniques and has the advantage of using fewer parameters. The convolutional neural network extracts features from the input image by performing alternating convolutional and subsampling on the input image.

The convolutional neural network includes a plurality of convolution layers, a plurality of subsampling layers, a lacal pooling layer, a max-pooling layer, and a fully connected layer. The convolution product layer is a layer that performs a convolution product on an input image. The subsampling layer is a layer that locally extracts the maximum value of the input image and maps it to the 2D image. The subsampling layer enlarges the local region and performs subsampling.

In the product multiplication layer, information such as kernel size, the number of kernels to be used (that is, the number of maps to be generated), and a weight table to be applied when performing a product multiplication are needed. For example, assume that the size of the input image is 32 × 32, the size of the kernel is 5 × 5, and the number of kernels to be used is 20. In this case, if a 5 × 5 kernel is applied to an input image having a size of 32 × 32, it is impossible to apply the kernel to two pixels at the top, bottom, left, and right sides of the input image. When the kernel is placed on the input image and then the result is composite, the resulting value of '-8' is determined as the pixel value corresponding to the center element of the kernel among the pixels of the input image included in the kernel. to be. Therefore, when a composite product is performed by applying a 5 × 5 kernel to a 32 × 32 input image, a 28 × 28 map is generated. Since it is assumed that the total number of kernels to be used is 20 in total, 20 maps of 28 × 28 sizes are generated in the first convolutional layer.

In the subsampling layer, information on the size of the kernel to be subsampled and information on whether to select the maximum value or the minimum value among the values in the kernel region are needed.

Returning to the deep learning technique, a cyclic neural network (RNN) refers to a neural network in which connections between units forming an artificial neural network form a directed cycle. The cyclic neural network, unlike the front neural network, can utilize the memory inside the neural network to process arbitrary input.

Deep Belief Networks (DBN) is a generic graphical model used in machine learning. In deep learning, deep Belief Networks (DBN) is a deep neural network composed of multiple layers of latent variables. There is a connection between layers, but there is no connection between units within a layer.

Deep trust neural networks can be used for preliminary learning due to the nature of the generation model, and after the initial weights are learned through prior learning, the weights can be fine-tuned through back propagation or other discrimination algorithms. This characteristic is very useful when the training data is small, because the smaller the training data, the greater the influence of the initial value of the weight on the resulting model. The pre-learned weight initial value is closer to the optimal weight than the arbitrarily set weight initial value, which enables the performance and speed improvement of the fine tuning step.

Details of the above-described artificial intelligence and its learning method are described for the purpose of illustration, and the artificial intelligence used in the embodiments described below and its learning method are not limited. For example, all kinds of artificial intelligence techniques and learning methods that can be applied by those skilled in the art to solve the same problem may be utilized to implement a system according to the disclosed embodiments.

FIG. 3 is a diagram for describing a method of building a virtual space and providing a service according to an embodiment of the present disclosure.

As shown in FIG. 3, a detailed operation of the service server 120 will be described. The service server 120 may receive data for building a virtual space and information on a service to be applied to the virtual space to be generated from the seller terminal 130 (S310).

In detail, the seller terminal 130 may request the service server 120 to generate a virtual space by transmitting data about the virtual space to be provided to the user terminal 110 to the service server 120. In this case, the virtual space to be created may be various kinds of virtual spaces.

In one embodiment, the virtual space to be created may be a virtual space corresponding to the model house.

In another embodiment, the virtual space to be created may be a virtual space corresponding to a shopping mall.

In another embodiment, the virtual space to be created may be a virtual space corresponding to various exhibitions.

In another embodiment, the virtual space to be created may be a collaboration space of a plurality of user avatars corresponding to the plurality of users.

In another embodiment, the virtual space to be created may be a virtual space for providing content.

The service server 120 may generate a virtual space by converting the data received from the seller terminal 130 (S320).

Thereafter, the service server 120 may map a service corresponding to the information about the service to one region of the created virtual space (S330).

Specifically, the seller terminal 130 may be aimed at providing various services in the virtual space, rather than simply creating a virtual space. Accordingly, the seller terminal 130 may transmit service information for mapping various services to the created virtual space to the service server 120, and the service server 120 may map the service to the created virtual space.

In one embodiment, if the created virtual space is a virtual space corresponding to the model house, the mapped service is provided to a content service or built-in furniture for guiding information (price information, contractor and sales company information) about the model house. Service, interior recommendation service suitable for the environment.

In another embodiment, when the generated virtual space is a virtual space corresponding to a shopping mall, the mapped service may be a service for product information, price information, inventory information, fitting information, and the like, of a product sold in the shopping mall. Further, the mapped service may be a service that provides an expected appearance when the user wears a product of a shopping mall when the user avatar registered by the user terminal 110 includes user body type information.

In another embodiment, when the generated virtual space is a virtual space corresponding to various exhibitions, the mapped service may be a content service for a work to be displayed at the exhibition. In this case, the service server 120 may implement a work to be displayed in the virtual space to help the user to view the exhibition without attending the exhibition directly. In addition, the mapped service may be a service that provides information on a work to be displayed. Video, audio, text increase By transmitting information about the work in various ways, there is an effect that the user can provide a better service than visiting the exhibition in person.

In another embodiment, the generated virtual space may be a collaboration space of a plurality of user avatars corresponding to the plurality of users. In this case, the mapped service may be a data transmission service for cooperating a plurality of users, a viewer service providing various viewers for the material, a chat service for sharing information, a document work service for editing and modifying information, and the like. .

In another embodiment, the generated virtual space may be a virtual space for providing content. In this case, the mapped service may be a service for providing content.

On the other hand, if the service server 120 is requested to access the virtual space from the user terminal 110, it may provide the created virtual space to the user terminal 110 (S340).

In this case, as described below, the user terminal 110 may display its character avatar together in the generated virtual space. Alternatively, a user avatar corresponding to another user terminal may be displayed in the generated virtual space.

If the service server 120 transmits a user command for requesting a mapped service from the user terminal 110, the service server 120 may provide the requested service to the user terminal 110 (3250). In this case, the above-described various services may be provided through various methods.

4 is an exemplary diagram for describing a method for creating a virtual space according to an embodiment of the present disclosure.

The service server 120 may receive 2D hexadecimal data from the seller terminal 130 (S410). The service server 120 may convert the received 2D hexahedron into a 3D virtual space (S420). In one embodiment, the data for building the virtual space received by the service server 120 may be a 2D hexadecimal view. The service server 120 may generate the 3D virtual space by converting the received 2D hexahedron. At this time, each surface of the 2D hexahedron may include elements such as a wallpaper pattern, content information, and a picture frame as necessary. On the other hand, although the disclosure refers to the hexahedron, if the virtual space is not the shape of a rectangular parallelepiped, various 2D drawings that can be used as data for the construction of the virtual space, of course. For example, if the 3D space is conical, the service server 120 may receive data about the development of the cone.

In another embodiment, the virtual space to be implemented may be a 4D virtual space (for example, a four-dimensional hypercube or the like). Of course, the service server 120 may receive a 3D development view for building a 4D virtual space. For example, as shown on the left side of FIG. 5, the service server 120 may create a 4D space by pasting each corresponding surface of the 3D virtual diagram. That is, the service server 120 may generate the right virtual space of FIG. 5 by pasting the surfaces having the same number in the left exploded view of FIG. 5.

If the service server 120 is requested to access the virtual space from the user terminal 110, the service server 120 may provide the generated virtual space to the user terminal 110 (S430).

Meanwhile, in the generated virtual space, various objects may be disposed in the space. Therefore, the data for building the virtual space received by the service server 120 may include data about the object object. In detail, the service server 120 may receive object object information and location information of the object object from the seller terminal 130.

The service server 120 may arrange the object object corresponding to the object object information at a position corresponding to the position information of the object object. For example, if the object object is a wardrobe and the location of the object object is a room, the service server 120 may arrange the wardrobe in a place located in the inside of the virtual space. As another example, when the object object is the front door and the location of the object object is between the shoe box and the outside, the service server 120 may arrange the front door between the shoe box and the outside.

The service server 120 may receive a user interaction with respect to the object object from the user terminal 110. The user interaction may be various, such as a user gesture and an input through the user terminal 110.

In this case, if another virtual space mapped to the object object exists, the service server 120 may provide a virtual space corresponding to the mapped another virtual space to the user terminal. For example, if the object object is a closet, another mapped virtual space may be a virtual space representing the inside of the closet. Alternatively, when the object is the front door, another mapped virtual space may be a virtual space representing the outside.

On the other hand, the object object disposed in the virtual space can be mapped to various services, of course. For example, if the object object is a closet, the service mapped to the closet may be a service that provides a list of clothes in the closet. Alternatively, when the object object is the front door, the service mapped to the front door may be a logout service for ending the virtual space.

6 is an exemplary view for explaining a service recommendation method according to an embodiment of the present disclosure.

The service server 120 may obtain request information for a service provided in the virtual space and the virtual space from the plurality of character avatars corresponding to the plurality of user terminals (S610). In this case, the request information may refer to all information that the user terminal 110 requests a service from the seller terminal 130.

The service server 120 may obtain response information to the obtained request information (S620). That is, the service server 120 may obtain the request information and the response information about the request information, and may obtain information related to the distribution of the service, question, complaint, etc. used by the user, and the response information. Furthermore, the service server 120 may further obtain feedback information on the provided answer. In one embodiment, the service server 120 may directly request feedback on the provided answer to the user terminal 110, or may obtain and analyze the frequency of service use of the user terminal 110 after the answer.

The service server 120 may provide a recommendation service for a user avatar corresponding to any one user terminal based on the obtained request information and response information (S630). In detail, the service server 120 obtains user information of the user terminal 110 from the user terminal 110 that provides the recommended service, and obtains usage information and obtained request information and response information of the user terminal 110. Based on the recommendation service can be provided. That is, the service server 120 may provide a service that may be of interest to the user based on the user information of the user terminal 110.

7 is an exemplary diagram for describing a plurality of users using the same virtual space according to an embodiment of the present disclosure.

First, when access to the virtual space is requested from the user terminal 110, the service server 120 may provide the created virtual space to the user terminal 110 (S710).

The service server 120 may determine whether the user terminal 110 is in an online mode (S720). That is, when the user wants to be provided with only the virtual space, only the virtual space may be provided, and when the user wants to interact with another user, the user avatar of the other user may be displayed, and the service server 120 may display the user terminal 110 online. This can be determined depending on whether the mode is in the offline mode.

When the user terminal 110 is in the online mode (S720-Y), if there is another user terminal accessing the virtual space, the service server 120 may display and provide a user avatar corresponding to the other user terminal in the virtual space. It can be (S730)

Furthermore, if there is a character avatar provided by the seller terminal 130, the service server 120 may display the provided character avatar in a virtual space and provide the generated character avatar (S750).

In this case, the character avatar may be a character avatar provided by the seller terminal 130 or a character avatar provided by the user terminal 110. The character avatar may output various interactions according to a specific purpose.

8 is an exemplary view for explaining a character avatar sale according to an embodiment of the present disclosure.

The service server 120 may receive a purchase request of a learned character avatar from at least one user terminal among a plurality of user terminals or a plurality of seller terminals (S810).

When the service server 120 receives the character avatar sale command from the terminal corresponding to the purchase request, the service server 120 may sell the character avatar to the terminal corresponding to the purchase request (S820).

Character avatars learned through the various methods described above may be implemented in various forms according to the learning method and the learning content. Therefore, the character avatar learned by a specific user may exist only as the specific user. Accordingly, the service server 120 may provide a virtual space for purchasing or selling a plurality of character avatars corresponding to the plurality of terminals.

At this time, the character avatar to be sold is personalized to a specific user, and thus may include personal information of the user. Therefore, the service server 120 may delete the user's personal information stored in the character avatar to be sold and proceed with the selling procedure.

In an embodiment, the service server 120 may delete not only the personal information of the seller, but also the learning content related to the personal information of the seller.

9 is an exemplary view for explaining a virtual space display method according to an embodiment of the present disclosure.

The service server 120 may receive the visual field information of the user from the user terminal 110 (S910). In this case, the visual field information may be information about a focal length of the user. The manner in which the user terminal 110 recognizes the focal length of the user is not limited. For example, the user terminal 110 may include at least one sensor device facing the eye of the user 10 to recognize the focal length of the user. It may include.

The service server 120 may determine whether the received view information is within a preset range (S920).

If it is within the preset range (S920-Y), the service server 120 may transmit the surrounding image of the user terminal to the user terminal 110 (S930). That is, the service server 120 may determine that the short distance is received from the user terminal 110 to search the real world, not the virtual space, and transmit the surrounding image of the user terminal to the user terminal 110. have. However, instead of providing the surrounding image of the user terminal 110 to the user terminal, the user may allow the user to search the real world by removing the provided virtual space. Alternatively, the service server 120 may display an image around the user terminal 110 only in an area corresponding to the focal length of the user based on the focal length, and display the virtual space in the remaining areas.

Meanwhile, the service server 120 may display a separate guide object for providing the surrounding image of the user terminal 110 to the user terminal in the virtual space. That is, the service server 120 displays the guide object according to the focal length on the virtual space, and when the user gazes at the guide object and the focal length is changed within a preset range, the service server 120 may provide the surrounding image of the user terminal 100. Can be. That is, since the user needs considerable effort to change the focal length without any object, the service server 120 may place a guide object for adjusting the focal length in the virtual space.

In another embodiment, the service server 120 may arrange a plurality of guide objects in a virtual space, and may map each service for each guide object. That is, the service server 120 may provide various services according to the focal length of the user.

If not within the preset range (S920-N), the service server 120 may provide the created virtual space to the user terminal 110 (S940).

Meanwhile, the method of displaying the virtual space and the method of using the displayed virtual space according to the present disclosure may vary.

In an embodiment, the user terminal 110 may display the virtual space and the surrounding image by mixing or overlapping them, displaying the sections separately, displaying the sections alternately depending on the situation, and the method is not limited thereto. Do not.

According to an embodiment of the present disclosure, the actual surrounding image may be photographed and displayed in the margin between the screen and the region where the screen is not displayed.

According to an embodiment of the present disclosure, when the user's gaze moves more than a preset angle, the actual surrounding image may be displayed within the user's gaze, and the virtual space may be displayed outside the user's gaze. Similarly, when the gaze of the user moves over a preset angle, the virtual space may be displayed within the gaze of the user, and the actual surrounding image may be displayed outside the gaze of the user.

In the present embodiment, the image may actually be displayed outside the user's line of sight, but displaying the image outside the line of sight of the user may be unnecessary or impossible due to limitations of the display. When the gaze is turned in the corresponding direction, the concept may be rendered or loaded to display the corresponding image.

According to an embodiment of the present disclosure, an upper limit may be set on the speed at which the gaze of the user recognized by the user terminal 110 moves as the gaze of the user moves. That is, when the user's eyes move at a speed higher than or equal to a preset speed, the speed at which the eyes of the user recognized by the user terminal 110 move does not follow this, so that the user is outside the gaze recognized by the user terminal 110. You can watch the video. That is, the user may watch the actual surrounding image displayed outside of the gaze until the movement of the gaze follows the movement of the gaze. Therefore, the user can check the actual surrounding image by moving the gaze faster than the preset upper limit speed.

In another embodiment, the user terminal 110 may recognize the surrounding situation and control the display of the virtual space or the actual surrounding image.

For example, the user terminal 110 may display the actual surrounding image in a corresponding direction when a sound of a friend sitting near the user calling the user is detected.

Similarly, when the user terminal 110 approaches the user, when the user is in danger of colliding with an external object, when the user is detected that the user reaches out in a specific direction, the user terminal 110, etc. May display the actual surrounding image in the direction in which the object or motion is recognized.

In an embodiment, the user terminal 110 may display an advertisement object at a point where a screen is not displayed in the virtual space. In another embodiment, the advertisement object may be displayed overlapping with the screen or may be displayed in a space ahead of the screen in the virtual space.

In addition, the user terminal 110 may display an advertisement image on at least one of the screens 310 to 330 displayed in the virtual space.

In an embodiment, the user terminal 110 may display an advertisement image or an advertisement object in the user's gaze direction. In this case, as the user observes the advertisement object for a predetermined time or selects the advertisement object, the advertisement object may disappear from the user's line of sight as the user interacts with the advertisement object.

10 is a block diagram of an apparatus according to an embodiment.

The processor 102 may include a connection passage (eg, a bus, etc.) that transmits and receives signals with one or more cores (not shown) and graphics processing unit (not shown) and / or other components. .

The processor 102 according to one embodiment executes one or more instructions stored in the memory 104 to perform the method described in connection with FIGS. 1-9.

Meanwhile, the processor 102 may include random access memory (RAM) and read-only memory (ROM) for temporarily and / or permanently storing a signal (or data) processed in the processor 102. , Not shown) may be further included. In addition, the processor 102 may be implemented in the form of a system on chip (SoC) including at least one of a graphic processor, a RAM, and a ROM.

The memory 104 may store programs (one or more instructions) for processing and controlling the processor 102. Programs stored in the memory 104 may be divided into a plurality of modules according to functions.

The steps of a method or algorithm described in connection with an embodiment of the present invention may be implemented directly in hardware, in a software module executed by hardware, or by a combination thereof. The software module may be a random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any form of computer readable recording medium well known in the art.

The components of the present invention may be embodied as a program (or an application) and stored in a medium for execution in combination with a computer which is hardware. The components of the present invention may be implemented in software programming or software elements, and similarly, embodiments include C, C ++, including various algorithms implemented in combinations of data structures, processes, routines, or other programming constructs. It may be implemented in a programming or scripting language such as Java, assembler, or the like. Functional aspects may be implemented in algorithms running on one or more processors.

In the above, embodiments of the present invention have been described with reference to the accompanying drawings, but those skilled in the art to which the present invention pertains may realize the present invention in other specific forms without changing the technical spirit or essential features thereof. I can understand that. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive.

110: user terminal
120: service server
130: seller terminal

Claims (10)

In the avatar generating method of the exhibition hall platform using a virtual reality space operated by a system comprising a user terminal, a seller terminal and a service server,
The service server, generating a virtual space based on the data received from the seller terminal to provide to the user terminal;
The service server generating a character avatar corresponding to the request by generating a character avatar request from at least one of the user terminal and the seller terminal;
Disposing the generated character avatar in the virtual space; And
If a user command for learning the character avatar is input, training the character avatar based on the user command; Including,
The learning step,
When the category information for learning the character avatar is transmitted to the user terminal or the seller terminal, and category information about at least one of the transmitted category information is received from the user terminal or the seller terminal, the received category information Learning the character avatar based on the;
When the character avatar is a character avatar generated by the user terminal
The avatar generation method,
Receiving, by the service server, user's personal information, user's interest field information, user's search history information, status information of the user terminal and usage history information of the user terminal received from the user terminal; And
And learning, by the service server, the character avatar based on the received at least one information.
The avatar generation method,
The service server may include receiving a character avatar purchase request of the user terminal learned from at least one of a plurality of user terminals or a plurality of seller terminals;
The service server, when receiving a command for selling the character avatar from the user terminal, selling the character avatar to a terminal corresponding to the purchase request; Including,
Selling the character avatar,
When receiving a command for selling the character avatar from the user terminal, deleting personal information about the user of the user terminal stored in the character avatar and learning contents related to the personal information; More,
The providing step,
When the field of view of the user transmitted from the user terminal is out of a preset range, the generated virtual space is provided, and when the field of view of the user transmitted from the user terminal is within a preset range, the surrounding image of the user terminal is received. Providing; More,
Receiving and providing the surrounding image of the user terminal,
Displaying a guide object for providing a peripheral image to the user terminal in the virtual space;
If the user gazes at the guide object and the focal length of the user changes, determining the user's field of view based on the focal length of the user; And
When the user's field of view corresponding to the focal length of the user is within a preset range, an image around the user terminal is displayed only in an area corresponding to the focal length of the user, and the virtual space is displayed for the remaining areas. Comprising;
The providing step,
Determining a moving speed of the user's gaze; And
Displaying a surrounding image when the moving speed is greater than or equal to a preset speed; More,
The user terminal is an avatar generation method, characterized in that implemented in the head mounted display (HMD) to provide the virtual space. delete The method of claim 1,
When the character avatar is a character avatar generated by the seller terminal, the character avatar learns data about the generated virtual space and services provided in the virtual space,
The avatar generation method,
Obtaining, by the service server, request information for the virtual space and a service provided in the virtual space from a plurality of character avatars corresponding to a plurality of user terminals;
Acquiring, by the service server, answer information corresponding to the obtained request information; And
Providing, by the service server, a recommendation service to a user avatar corresponding to any one user terminal based on the request information and response information; Avatar generation method comprising a. delete The method of claim 1,
The character avatar purchase request and sale are provided in the virtual space. delete The method of claim 1,
The avatar generation method,
If the user terminal requests access to the virtual space, providing the virtual terminal and a character avatar of the seller terminal disposed in the virtual space to the user terminal; And
If the character avatar corresponding to the user terminal exists, placing the character avatar in the virtual space and providing the character avatar to the user terminal;
When receiving a request for access to the virtual space generated from the service server from a user terminal other than the user terminal, generating an avatar by displaying a user avatar corresponding to the other user terminal in the virtual space Way. delete In the service server,
Memory for storing one or more instructions; And
A processor for executing the one or more instructions stored in the memory;
The processor executes the one or more instructions,
An apparatus for carrying out the method of claim 1. A computer program, coupled with a computer, which is hardware, stored on a recording medium readable by a computer to perform the method of claim 1.

Images