KR20240069884A - Virtual space environment creation system based on extended reality - Google Patents

Abstract

The present invention relates to a system for creating a virtual space environment based on extended reality. An extended reality-based virtual space environment creation system according to an embodiment of the present invention includes an object creation unit that creates an extended reality (XR)-based avatar, and a motion or gesture input to the avatar created by the object creation unit. An object creation unit that creates an object including clothing and accessories to be linked to the avatar created in the object creation unit and links the object to the avatar, and an object creation unit that provides activity to the avatar. An XR environment creation unit that creates an extended reality (XR)-based virtual space that can accommodate the avatar generated in and the objects created in the object creation unit, and a live commerce or O2O service using the avatar, object, and virtual space. A content production unit that produces content in the form of content and transmits the produced content, wherein the XR environment creation unit includes a floor, a wall, and a ceiling, wherein the floor, walls, and ceiling are configured as a display. It creates an extended reality-based virtual space, and further includes a filming scene creation unit that provides a space for filming extended reality-based content through a camera within the virtual space.

Description

Virtual space environment creation system based on extended reality}

The present invention relates to a system for creating a virtual space environment based on extended reality. More specifically, it relates to an extended reality-based virtual space environment creation system for creating extended reality-based content by constructing an extended reality-based virtual space and placing avatars and objects inside the virtual space.

Due to the increase in transactions and the explosive increase in users, wired and wireless Internet content providers are trying to attract users by providing various communities. In general, chatting, messenger, and short message services are provided, and recently, various functions have been added using avatars.

If we reflect on the meaning of this avatar, avatar means 'a visual image of one's alter ego in a virtual society', meaning an alter ego or incarnation, the user's role in cyberspace. It is an animation character that replaces . If we look at its etymology in detail, the original word avatar comes from the Sanskrit word 'avataara'. Avatara is the noun form of the verb ‘Abatre’, which means ‘to come down’, and means ‘the descent of God to earth or the incarnation of God who has descended on earth.’ The Sanskrit word 'Avatar' is pronounced as 'Avatar' in Hindi, and 'Avatar' is a form of the Hindi word 'Avatar' with the final 'le' pronunciation omitted. It was a term referring to an incarnation of a god who came down to earth in ancient India, but with the advent of the Internet era, it refers to a graphic icon that represents oneself in 3D or virtual reality games or chatting on the web. An avatar can be said to be a virtual body that represents oneself in a graphic-oriented virtual society. Currently, the fields in which avatars are used have expanded beyond chatting and online games to include cyber welfare malls, virtual education, and virtual offices. Recently, the field that has been receiving the most attention is online chatting services, which include chatting using avatars such as icon chatting and 3D graphic chatting. The service has been introduced. Most existing avatars were two-dimensional pictures. The avatars that appeared in mud games and online chats were at the most rudimentary level, and 3D avatars appeared to compensate for the problem of lack of realism. The advantage of 3D avatars is that they have both a three-dimensional feel and a sense of reality. Avatars connect the real world and virtual space, and exist somewhere between anonymity and realness. In the past, netizens were fascinated by the anonymity of cyberspace, but now they feel the desire to express themselves, and an avatar has been created that satisfies both. Most games or chat services mainly combine a few characters or provide ready-made avatars, but as graphic technology has improved, users can create their own unique avatars, such as character IDs, rather than using ready-made products already made by service providers. You can also create your own avatar.

Various methods have been proposed to create such an avatar and use it on the wired or wireless Internet, and one of them is the user's own independent 3D character interface (Patent Document 1). (Patent Document 1) has a problem in that it simply proposes various interfaces that can be implemented using avatars and does not provide detailed technical means.

Meanwhile, (Patent Document 2) is disclosed as a technology for electronic shopping using an avatar. (Patent Document 2) discloses a method where multiple avatar characters access a website at the same time and share opinions and information about specific products while shopping at multiple virtual stores formed on the website. However, the same avatar is provided to customers. Problems are being raised that it is outdated in terms of what it provides, and sales are declining as a result.

Republic of Korea Patent Publication No. 10-2003-0021525 Republic of Korea Patent Publication No. 10-2001-0091446

The purpose of the present invention is to provide an extended reality-based virtual space environment creation system for constructing an extended reality-based virtual space and creating extended reality-based content by placing avatars and objects inside the virtual space.

In order to solve the above problems,

An extended reality-based virtual space environment creation system according to an embodiment of the present invention includes an object generator that creates an extended reality (XR)-based avatar;

an object motion granting unit for providing activity to the avatar by inputting a motion or gesture to the avatar created in the object creation unit;

an object creation unit that creates objects including clothing and accessories to be linked to the avatar created by the object creation unit, and links the objects to the avatar;

an XR environment creation unit that creates an extended reality (XR)-based virtual space that can accommodate the avatar created in the object creation unit and the object created in the object creation unit;

a content production unit that creates content in the form of live commerce or O2O services using the avatar, object, and virtual space, and transmits the produced content; Including,

The XR environment creation unit includes a floor, a wall, and a ceiling, and the floor, walls, and ceiling are made of a display to create an extended reality-based virtual space, and the virtual space is expanded through a camera. Filming Site Creation Department, which provides a space to film reality-based content; It may further include.

In addition, in the extended reality-based virtual space environment creation system according to an embodiment of the present invention, the XR environment creation unit is a camera tracking system in which the camera tracks and photographs an object or objects located inside the shooting scene creation unit. wealth; It further includes,

The camera tracking unit includes an object detection unit that detects the object or objects in real time and takes pictures focusing on the detected object or objects; It may further include.

In addition, in the extended reality-based virtual space environment creation system according to an embodiment of the present invention, the XR environment creation unit replaces the object photographed by the shooting scene creation unit with the object creation unit and the object creation unit. A real-time synthesis unit that synthesizes avatars and objects and transmits them as real-time content; It may further include.

In addition, in the extended reality-based virtual space environment creation system according to an embodiment of the present invention, the XR environment creation unit selects at least one object from among one or more objects photographed by the shooting scene creation unit and creates the object creation unit and the object. A synthesis selection unit that synthesizes the avatar and object created in the creation unit; It may further include.

Additionally, in the extended reality-based virtual space environment creation system according to an embodiment of the present invention, the XR environment creation unit constructs an extended reality-based virtual space, and the object creation unit and the objects created in the object creation unit and a virtual space construction unit that constructs an object within the virtual space. It may further include.

In addition, in the extended reality-based virtual space environment creation system according to an embodiment of the present invention, the virtual space construction unit sets up a background image or background video in the existing virtual space and outputs it to the virtual space. wealth; It may further include.

These solutions will become more apparent from the following detailed description of the invention based on the accompanying drawings.

Prior to this, the terms or words used in this specification and claims should not be interpreted in their usual, dictionary meaning, and the inventor may appropriately define the concept of the term in order to explain his or her invention in the best way. It must be interpreted with meaning and concept consistent with the technical idea of the present invention based on the principle that it can be done.

According to an embodiment of the present invention, photorealistic texture-based computer graphics are used to create photorealistic avatars so that they can be used in extended reality-based content, and a virtual space is created according to the type and situation of the content. You can.

In addition, according to one embodiment of the present invention, it is possible to give activity to the created avatar by collecting motions or gestures captured externally and assigning them to the self-made avatar.

In addition, according to an embodiment of the present invention, photorealistic texture-based computer graphics are used to produce photorealistic objects so that they can be used in extended reality-based content, and virtual space is created according to the type and situation of the content. can be produced.

In addition, according to an embodiment of the present invention, a virtual studio can be created for real-time live extended reality-based content, and an object or objects photographed in the studio can be changed into a self-produced object or objects and transmitted.

In addition, according to an embodiment of the present invention, by constructing an extended reality-based virtual space and placing avatars and objects inside the constructed virtual space, it is possible to construct content related to a digital showroom or O2O system. One content can be provided to the user.

In addition, according to one embodiment of the present invention, the object to be sold to the user can be separately guided in extended reality-based content, and the user can select the object he or she wants to purchase through a smart device and proceed with payment to purchase the object. You can.

1 is a schematic diagram showing the process of transmitting extended reality-based content in an extended reality-based virtual space environment creation system according to an embodiment of the present invention.
Figure 2 is a block diagram showing the components of a server of an extended reality-based virtual space environment creation system according to an embodiment of the present invention.
Figure 3 is a block diagram showing the components of the object creation unit of the extended reality-based virtual space environment creation system according to an embodiment of the present invention.
Figure 4 is a block diagram showing the components of the object motion granting unit of the extended reality-based virtual space environment creation system according to an embodiment of the present invention.
Figure 5 is a block diagram showing the components of the object creation unit of the extended reality-based virtual space environment creation system according to an embodiment of the present invention.
Figure 6 is a block diagram showing the components of the XR environment creation unit of the extended reality-based virtual space environment creation system according to an embodiment of the present invention.
Figure 7 is a block diagram showing the components of the content production unit of the extended reality-based virtual space environment creation system according to an embodiment of the present invention.

Unique aspects and specific technical features of the present invention will become more apparent from the following detailed description and embodiments in conjunction with the accompanying drawings. In this specification, when adding reference numerals to components in each drawing, it should be noted that the same components are given the same reference numerals as much as possible even if they are shown in different drawings. Additionally, when describing an embodiment of the present invention, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present invention, the detailed description will be omitted.

Additionally, in describing the components of the present invention, terms such as first, second, A, B, (a), and (b) may be used. These terms are only used to distinguish the component from other components, and the nature, order, or order of the component is not limited by the term. When a component is described as being “connected,” “coupled,” or “connected” to another component, that component may be directly connected or connected to that other component, but there is another component between each component. It will be understood that elements may be “connected,” “combined,” or “connected.”

Hereinafter, an embodiment of the present invention will be described in detail based on the attached drawings.

As shown in FIG. 1, the extended reality-based virtual space environment creation system according to an embodiment of the present invention is an extended reality-based digital fashion and goods according to an embodiment of the present invention. The live commerce platform linked can be comprised of a server (2) that builds the platform and a smart device (1) that allows users to access the metaverse platform.

The server 2 builds a platform, and multiple smart devices 1 can access the platform.

A smart device (1) is a device that a user can possess and can access the Metaverse platform, and may include a smartphone, laptop, tablet, personal PC, or iPad. In the present invention, the smartphone is used as the reference. Please explain.

As shown in FIG. 2, the server 2 includes an object creation unit 10, an object motion granting unit 20, an object creation unit 30, an XR environment creation unit 40, and a content creation unit 50. It can be configured.

As shown in FIGS. 2 and 3, the object generator 10 includes a first generator 11 that generates a photo-realistic avatar using photorealistic texture-based computer graphics, and a hard mesh data-based avatar. It may be configured to include a second generator 12 that generates an animation avatar.

The first generation unit 11 can create an avatar based on real-life photography, and the generated avatar can be used in various fields such as virtual influencers, virtual singers, and virtual movie stars, and can utilize a game engine. This can be implemented.

Here, the game engine can be configured by selecting any one of the Cry Engine, Source Engine, Havok Engine, Unreal Engine, and Unity Engine, and in the present invention, the avatar can be created by utilizing the photorealistic texture function of the Unity Engine. .

The second generator 12 can create an animated avatar by utilizing the hard mesh data function of the game engine function, and can create an avatar that is separate from the photo-based avatar generated by the first generator 11. there is.

The object creation unit 10 can create an avatar by selecting one of the first creation unit 11 and the second creation unit 12, and the created avatar is stored in the database 3 of the server 2. It can be saved.

This object creation unit 10 creates an avatar and a virtual space so that the avatars generated by the first creation unit 11 and the second creation unit 12 can be accommodated in the virtual space or virtual studio formed by the XR environment creation unit 40. It may be configured to further include an object linking unit 13 that links.

The object linkage unit 13 can be set to be compatible with the virtual space and the avatar so that it can be placed in the virtual space formed by the XR environment creation unit 40, or the XR environment creation unit 40 can transmit the avatar in real time from the virtual studio. At this time, a separate object placed in the virtual studio may be converted to an avatar created by the object creation unit 10 through a separate compatible algorithm.

As shown in FIGS. 2 and 4, the object motion granting unit 20 has a function of inputting motion or gestures to the avatar created by the object creation unit 10 to give the avatar the power to move in virtual space. Perform.

In addition, the object motion granting unit 20 separately captures a motion or gesture from an object of the same shape as the avatar created in the object creation unit 10, processes the captured motion or gesture, and creates the object in the object creation unit 10. It may further include a motion production unit 21 that produces motions or gestures that can be given to the avatar.

The motion production unit 21 selects either externally collected data or data previously stored in the database 3 and merges the data into the avatar. In the present invention, externally collected data is used to merge the data into the avatar. Let me explain based on how it is done.

First, the motion production unit 21 may be configured to include a motion tracking unit 22, a motion extraction unit 23, and a motion input unit 24.

The motion tracking unit 22 captures the motion or gesture to be given to the avatar through a camera in the external environment, and performs a function of tracking in real time when the camera captures the motion or gesture to collect data centered on the motion or gesture. , the collected motion or gesture data may be previously stored in the database 3.

The motion extraction unit 23 extracts data in the form of a 3D bone based on the motion or gesture data collected by the motion tracking unit 22 and creates it to be compatible with the avatar created by the object creation unit 10. can do.

The motion input unit 24 inputs the 3D bone form motion or gesture data extracted from the motion extraction unit 23 into the avatar created by the object creation unit 10 to perform the function of the avatar executing the corresponding motion or gesture. You can.

The object motion granting unit 20 can input motion or gestures to the avatar created by the object creation unit 10 through the motion input unit 24 to give activity to the avatar, and the avatar to which activity has been granted can be transferred to the content creation unit ( It can be applied to content related to live commerce or O2O (online to offline) services produced by 50).

As shown in FIGS. 2 and 5, the object creation unit 30 creates and manages objects including clothing and accessories to be linked to the avatar created by the object creation unit 10, and links the objects to the avatar. It can perform its function.

This object creation unit 30 may include an object creation unit 31, an object compatibility unit 32, a motion optimization unit 33, and an object linking unit 34.

The object production department 31 is a game engine that can produce objects including photorealistic clothing and accessories using photorealistic texture-based computer graphics, and more specifically, can utilize photorealistic texture-based computer graphics. Objects can be implemented using , and the game engine can be configured by selecting any one of the Cry Engine, Source Engine, Havok Engine, Unreal Engine, and Unity Engine. In the present invention, it will be described as being implemented using the Unity Engine. do.

The object compatibility unit 32 sets and manages compatibility data to enable easy compatibility between avatars and objects in order to apply the photo-realistic object produced in the object creation unit 31 to the avatar created in the object creation unit 10. performs the function of

When the avatar reflects a motion or gesture in real time through the object motion granting unit 20 (more specifically, the content production unit transmits content in the form of live commerce or O2O service in real time) When) When the avatar performs a motion or gesture, the object performs the function of optimizing the motion appropriate for the avatar and object without making the avatar's motion or gesture awkward.

The object linkage unit 34 is an avatar and a virtual space or object so that the object produced in the object production unit 31 can simultaneously accommodate an avatar and an object in a virtual space formed in the XR environment creation unit 40 or real-time content conducted in a virtual studio. It performs the function of linking with a virtual studio, and compatibility settings can be made so that objects can be easily compatible with a virtual space or virtual studio.

As shown in Figures 2 and 6, the XR environment creation unit 40 is an extended reality (XR)-based system that can accommodate the avatar created in the object creation unit 10 and the object created in the object creation unit 30. It performs the function of creating a virtual space, and may be configured to include a filming scene creation unit 41 and a virtual space construction unit 46.

The filming site creation unit 41 can create a dedicated studio capable of producing expanded reality (XR)-based content, and may be comprised of a floor 41a, a wall 41b, and a ceiling 41c. . One virtual studio can be created by combining the floor (41a), wall (41b), and ceiling (41c), and LED displays are installed on the floor (41a), wall (41b), and ceiling (41c), respectively. By installing each and outputting a background image or background video on the display, the filming site creation department 41 can create an extended reality (XR)-based studio.

This filming scene composition unit 41 may include a camera tracking unit 42, an object detection unit 43, a real-time synthesis unit 44, and a synthesis selection unit 45.

The camera tracking unit 42 performs the function of tracking in real time the object or objects located inside the filming scene creation unit 41 by the camera filming the virtual studio, and the tracked and captured data is stored in the database 3. It can be.

In addition, the camera tracking unit 42 is configured to detect the object or object in real time through the object detection unit 43 when taking pictures centered on the object or object, so that the camera can easily photograph the object or object. We can provide guidance to help you.

The real-time synthesis unit 44 performs the function of combining the objects photographed by the filming scene composition unit 41 with avatars and objects created by the object creation unit 10 and the object creation unit 30 and transmitting them to real-time content. can do. Specifically, the real-time synthesis unit 44 selects an object or objects to be synthesized among the objects or objects detected by the object detection unit 43 through the synthesis selection unit 45, and creates an object creation unit instead of the selected object or objects. By combining the avatar and object created in (10) and the object creation unit 30, object A (object captured through a camera) was actually filmed, but the content transmitted in real time was object B (created in the object creation unit). It can be configured to transmit one avatar).

Meanwhile, the virtual space construction unit 46 builds a virtual space based on extended reality and places an avatar or object inside the constructed virtual space to build content utilizing the virtual space, such as a digital showroom or O2O outlet. can do.

Here, the virtual space construction unit 46 can decorate the background to suit the purpose of the content, by selecting at least one of one or more background images or background videos pre-stored in the database 3 through the background setup unit 47. You can decorate a virtual space.

In other words, the XR environment creation unit 40 can film content in real time through the filming site creation unit 41 and produce extended reality-based content by synthesizing only necessary elements, or by constructing a separate virtual space and creating virtual space. It can be produced in a way that the content is processed internally.

As shown in FIGS. 2 and 7, the content production unit 50 creates content in the form of live commerce or O2O services using avatars, objects, and virtual spaces, and delivers the produced content to a smart device owned by the customer. It performs the function of transmitting and may be configured to include a live commerce production unit 51 that produces content in the form of live commerce in real time.

In addition, the content production unit 50 selects one of goods of the same type as at least one object (or article) or goods identical to a collaboration sponsored from outside among the contents produced by the live commerce production unit 51 and provides the content to the live commerce production unit 51. It may further include a goods management unit 52 that produces and manages goods data that can be linked to (51).

The goods management department 52 is configured to separately build the goods data in the XR environment creation department 40 by landing the goods data to be provided to the content production department 50 using photorealistic texture-based computer graphics. It can be.

The live commerce production department (51) can transmit at least one content in the form of live commerce or O2O service in real time, and a separate platform is installed on the server (1) so that the customer can access it through the smart device (1) owned by the customer. 2) can be built.

In addition, when the content production unit 50 accesses the content through the smart device 1, the content production unit 50 can select the product it wants to purchase from among the products sold by the live commerce production unit 51 and purchase the selected product.

Therefore, the content production unit 50 can provide expanded reality-based content, sell products in the content to consumers, and provide consumers with real-life products through the smart device 1, thereby increasing reliability of the products. can be improved.

The present invention has been described in detail through an example, but this is for detailed explanation of the present invention, and the extended reality-based virtual space environment creation system according to the present invention is not limited to this. And terms such as “include,” “comprise,” or “have,” as described above mean that the corresponding component can be included unless specifically stated to the contrary, so excluding other components is not necessary. It should be construed as being capable of further including other components, and all terms, including technical or scientific terms, are generally understood by those skilled in the art to which the present invention pertains, unless otherwise defined. It has the same meaning as becoming.

In addition, the above description is merely an illustrative explanation of the technical idea of the present invention, and various modifications and variations can be made by those skilled in the art without departing from the essential characteristics of the present invention. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but are for illustrative purposes, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted in accordance with the claims below, and all technical ideas within the equivalent scope should be construed as being included in the scope of rights of the present invention.

1 - Smart Device 2 - Server
3 - Database 10 - Object creation unit
11 - first generation unit 12 - second generation unit
13 - Object connection unit 20 - Object motion grant unit
21 - Motion production department 22 - Motion tracking department
23 - motion extraction unit 24 - motion input unit
30 - Object creation unit 31 - Object creation unit
32 - Object compatibility unit 33 - Motion optimization unit
34 - Object Link Department 40 - XR Environment Creation Department
41 - Filming site preparation department 42 - Camera tracking department
43 - object detection unit 44 - real-time synthesis unit
45 - Composition selection unit 46 - Virtual space construction unit
47 - Background setup department 50 - Content production department
51 - Live Commerce Production Department 52 - Goods Management Department

Claims (6)

An object creation unit that creates an extended reality (XR)-based avatar;
an object motion granting unit for providing activity to the avatar by inputting a motion or gesture to the avatar created in the object creation unit;
an object creation unit that creates objects including clothing and accessories to be linked to the avatar created by the object creation unit, and links the objects to the avatar;
an XR environment creation unit that creates an extended reality (XR)-based virtual space that can accommodate the avatar created in the object creation unit and the object created in the object creation unit;
a content production unit that creates content in the form of live commerce or O2O services using the avatar, object, and virtual space, and transmits the produced content; Including,
The XR environment creation unit includes a floor, a wall, and a ceiling, and the floor, walls, and ceiling are made of a display to create an extended reality-based virtual space, and the virtual space is expanded through a camera. Filming Site Creation Department, which provides space to film reality-based content; An extended reality-based virtual space environment creation system further comprising:
In claim 1,
The XR environment creation unit includes a camera tracking unit in which the camera tracks and photographs an object or objects located inside the shooting scene creation unit; It further includes,
The camera tracking unit includes an object detection unit that detects the object or objects in real time and takes pictures focusing on the detected object or objects; An extended reality-based virtual space environment creation system further comprising:
In claim 2,
The XR environment creation unit includes a real-time synthesis unit that synthesizes the objects photographed by the shooting scene creation unit with avatars and objects generated by the object creation unit and the object creation unit and transmits them as real-time content; An extended reality-based virtual space environment creation system further comprising:
In claim 3,
The XR environment creation unit includes a synthesis selection unit that selects at least one object from among one or more objects photographed in the shooting scene creation unit and combines them into an avatar and an object created in the object creation unit and the object creation unit; An extended reality-based virtual space environment creation system further comprising:
In claim 1,
The XR environment creation unit includes a virtual space construction unit that constructs an extended reality-based virtual space and constructs the object creation unit and objects created in the object creation unit within the virtual space; An extended reality-based virtual space environment creation system further comprising:
In claim 5,
The virtual space construction unit,
A background setup unit that sets up a background image or background video in a previously constructed virtual space and outputs it to the virtual space; An extended reality-based virtual space environment creation system further comprising: