KR20240044206A - Virtual reality-based adaptation performance content experience system - Google Patents

Abstract

A virtual reality-based adapted performance content experience system according to an embodiment of the present invention includes an adapted performance experience unit that provides a virtual experience of an adapted performance during an artist's performance based on virtual reality; And an operation server that stores and executes the dramatization performance content or video content provided to the dramatization performance experience unit, and controls the operation of the dramatization performance experience unit, wherein the operation server selects a part of the artist's performance and An adapted performance reflecting the user's preferences can be created and the adapted performance can be delivered to the adapted performance experience unit to be experienced in virtual reality.

Description

Virtual Reality-BASED ADAPTATION PERFORMANCE CONTENT EXPERIENCE SYSTEM}

The present invention relates to a virtual reality-based adapted performance content experience system. More specifically, a virtual reality-based adapted performance content experience that allows users to adapt a virtual performance they want to see using actual performance video and experience it in virtual reality. It's about the system.

For performances held at performance halls, such as existing musicals and music concerts, the audience visits the performance site in person and watches it from the audience, but visiting the site in person has the limitation that it is difficult to participate because conditions such as location and time are not satisfactory. .

Accordingly, there are a significant number of viewers who watch through live TV broadcasts or Internet broadcasts, but this method of watching TV is insufficient to give the feeling of actually participating in the event.

Recently, with the development of electronic display technology, head-mounted displays or head-mounted devices (head-mounted displays), a type of wearable device that viewers wear directly on the head, are being introduced in addition to providing two-dimensional information through TVs, monitors, etc. Head Mounted Device (HMD) was proposed.

As head mounted displays (hereinafter referred to as “HMD”) devices, which are video display devices that can be worn on the head like glasses and enjoy large images, become widespread, virtual reality (hereinafter referred to as “VR”) images are available. Interest in it is also increasing. HMD devices can provide users with VR images that make them feel as if they are interacting with the real surrounding environment.

Virtual reality refers to an artificial world or such technology that artificially implements objects or backgrounds of the virtual world or the real world using a computer. This virtual reality technology provides a virtual world to the user and creates a virtual world created by a computer. Users become immersed in the space or environment.

Using these virtual reality images, the viewpoint changes depending on the user's movement, allowing images from various viewpoints to be provided. Attempts to utilize these characteristics and apply them to various fields such as games, education, medical care, video, broadcasting, advertising, and manufacturing are actively underway.

However, recently, due to the COVID-19 incident, not only are people unable to easily go to concert halls, but artists are also unable to perform. Accordingly, people are attempting to watch artists' performances through virtual reality content.

However, most virtual reality technologies currently being introduced provide a virtual experience of the performance by filming the actual performance and then applying virtual reality technology to the filmed video. As such, since most virtual reality performances use actual performance videos, there are limitations in satisfying users' diverse performance experience needs.

The present applicant proposed the present invention to solve the above problems.

Korean Patent No. 10-1839270 (registration date 2018.03.09.) Korean Patent No. 10-1491760 (registration date 2015.02.03.) Korean Patent No. 10-2407493 (registration date 2022.06.07.) Korean Patent Publication No. 10-2022-0065391 (publication date 2022.05.20.) Korean Patent Publication No. 10-2018-0131687 (publication date 2018.12.11.)

The present invention was proposed to solve the above problems, and is a virtual performance that allows users to experience a virtual performance by introducing virtual reality technology to the specific content that the user is interested in or likes among the entire content of the actual performance, rather than the entire content of the actual performance. Provides a reality-based adapted performance content experience system.

The present invention provides a virtual reality-based adapted performance content experience system that does not use the performance video as is, but adds the user's preferences to the performance video and selectively shows the user's favorite scenes, songs, dances, etc. in virtual reality.

The present invention does not reproduce the actual performance in virtual reality, but compares and analyzes the content of the actual performance with the performance content that the user wants to see, creates a new content of the actual performance content, and allows the user to experience the created virtual performance. Provides a virtual reality-based adapted performance content experience system.

A virtual reality-based adapted performance content experience system according to an embodiment of the present invention for achieving the above-described problem includes: an adapted performance experience unit that provides a virtual experience of an adapted performance during an artist's performance based on virtual reality; And an operation server that stores and executes the dramatization performance content or video content provided to the dramatization performance experience unit and controls the operation of the dramatization performance experience unit, wherein the operation server selects a part of the artist's performance and An adapted performance reflecting the user's preferences can be created and the adapted performance can be delivered to the adapted performance experience unit to be experienced in virtual reality.

The operation server includes a performance selection unit that selects a performance by an artist for whom a user wishes to experience a virtual performance; a feature selection unit that selects feature content preferred by the user from among the performances of the artist selected in the performance selection unit; and an adapted performance output unit that adapts the performance by reflecting the performance content desired by the user in the feature content of the performance selected in the feature selection unit.

The feature selection unit may select the user's favorite feature content among performance content including songs, dances, performances, dialogue, or stage scenes among the artist's performances.

The adapted performance output unit outputs an adapted performance that replaces the artist's actual performance by reflecting the performance content that the user wants to see or wants to experience virtually in the feature content selected in the feature selection unit, and transmits it to the adapted performance experience unit. Users can experience the dramatized performance in virtual reality.

The operation server includes a history management unit that stores and analyzes user-specific data or history of using the dramatized performance experience unit; a big data unit that stores and analyzes history data of other users using the adapted performance experience unit and calculates data matching the user's history data; a product management unit that provides a virtual experience of performance products or performance content provided by a performance product seller in the adapted performance experience unit; And a feedback unit that collects feedback data on the performance product or performance content of a user who has virtually experienced the performance product or performance content provided by the product management unit through the adapted performance experience unit and delivers it to the performance product seller. You can.

The product management unit uses data from the history management unit, the big data unit, or the feedback unit to select adapted performances that have a high user preference or have many positive elements in the feedback data, and allows the performance product seller to provide the selected adapted performances and It can encourage the sale of identical or similar performance products or performance content.

The operation server may include an additional service unit that provides additional services related to the adapted performance or the artist of the adapted performance that is virtually experienced through the adapted performance experience unit.

The operation server may create an adapted performance using performance video captured of the artist's actual performance.

It includes a media server that acquires performance videos of artists and extracts and provides performance videos required by the operation server, wherein the additional service unit of the operation server provides additional services in the metaverse space to users. In this case, it may include a metaverse creation unit that creates the necessary metaverse space.

Through the virtual reality-based adapted performance content experience system according to the present invention, users can experience virtual performances of their favorite scenes, songs, and dances without having to go to the performance hall in person. In other words, instead of having a virtual experience of the entire performance using the actual performance video, the user experiences a virtual performance only of the stage the user wants to see, the dance moves he or she is interested in, or the song section he or she likes, among the content of the entire performance, thereby increasing the user's immersion. You can increase your satisfaction level and enjoy virtual experiences for more performances.

The virtual reality-based adapted performance content experience system according to the present invention can satisfy the user's satisfaction with the virtual performance experience because it adapts a virtual performance that has never been performed in reality and provides a virtual experience based on the actual performance.

The virtual reality-based adapted performance content experience system according to the present invention does not reproduce the actual performance in virtual reality, but analyzes the actual performance and the performance content that the user wants to see, creates a new content of the actual performance, and creates a new content of the actual performance. Because users can experience virtual performances, a customized virtual performance experience can be provided.

The virtual reality-based adapted performance content experience system according to the present invention is a technology that allows users to feel like they are participating in a virtual reality performance hall, and allows users to feel as if they are running and enjoying themselves in a real standing performance hall. In addition, the user's satisfaction with the artist can be increased by providing virtual experiences of various additional services, such as experiencing the daily manager of the user's favorite artist in the metaverse space or purchasing goods related to the artist.

The virtual reality-based adapted performance content experience system according to the present invention can contribute to revitalizing the entertainment industry by encouraging users to plan and sell performance products by artists related to adapted performances with high preference.

Figure 1 is a diagram showing the configuration of a virtual reality-based dramatized performance content experience system according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a portion of the configuration of an adapted performance experience unit in the virtual reality-based adapted performance content experience system according to FIG. 1.
FIG. 3 is a diagram illustrating the configuration of an operating server in the virtual reality-based dramatized performance content experience system according to FIG. 1.
FIG. 4 is a diagram illustrating important parts of the dramatization experience unit, operation server, and media server in the virtual reality-based dramatization content experience system according to FIG. 1.
FIG. 5 is a diagram for explaining the function of the metaverse generator in the configuration of the media server according to FIG. 4.

The advantages and/or features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and will be implemented in various different forms, but the present embodiments only serve to ensure that the disclosure of the present invention is complete and are within the scope of common knowledge in the technical field to which the present invention pertains. It is provided to fully inform those who have the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

In addition, the preferred embodiments of the present invention to be implemented below are provided in each system function configuration in order to efficiently explain the technical components constituting the present invention, or system functions commonly provided in the technical field to which the present invention pertains. The configuration will be omitted whenever possible, and the description will focus on the functional configuration that must be additionally provided for the present invention. If a person has ordinary knowledge in the technical field to which the present invention pertains, he or she will be able to easily understand the functions of conventionally used components among the functional configurations not shown and omitted below, as well as the omitted configurations as described above. The relationships between elements and components added for the present invention will also be clearly understood.

In addition, in the following description, "transmission", "communication", "transmission", "reception" and other similar terms of signals or information refer to the direct transmission of signals or information from one component to another component. In addition, it also includes those transmitted through other components. In particular, “transmitting” or “transmitting” a signal or information as a component indicates the final destination of the signal or information and does not mean the direct destination. This is the same for “receiving” signals or information.

FIG. 1 is a diagram showing the configuration of a virtual reality-based adapted performance content experience system according to an embodiment of the present invention, and FIG. 2 illustrates a portion of the configuration of an adapted performance experience unit among the virtual reality-based adapted performance content experience system according to FIG. 1. 3 is a diagram showing the configuration of an operating server in the virtual reality-based adapted performance content experience system according to FIG. 1, FIG. 4 is a diagram showing an adapted performance experience unit in the virtual reality-based adapted performance content experience system according to FIG. 1, FIG. 5 is a diagram illustrating important components of the operation server and media server configuration. FIG. 5 is a diagram for explaining the function of the metaverse generator in the configuration of the media server according to FIG. 4.

The virtual reality-based adapted performance content experience system 10 according to an embodiment of the present invention described below is a system using virtual reality (VR) video or technology, and the provision or implementation of virtual reality video is known. You can use virtual reality technology.

Referring to Figure 1, a virtual reality-based adapted performance content experience system (10, hereinafter referred to as 'adapted performance content experience system') according to an embodiment of the present invention is a virtual reality-based adapted performance of an artist's performance. Adapted performance experience unit 100 providing a virtual experience; and an operation server 200 that stores and executes the adapted performance content or video content provided to the adapted performance experience unit 100 and controls the operation of the adapted performance experience unit 100.

Here, the operation server 200 may select a portion of the artist's performance, create an adapted performance reflecting the user's preference, and deliver the adapted performance to the adapted performance experience unit 100 to experience it in virtual reality.

The adapted performance content experience system 10 according to an embodiment of the present invention provides an experience as if the user is watching a real performance by selecting his or her favorite artist or performance in virtual reality, but the entire actual performance of the artist is virtual. Rather than experiencing it in reality, it allows users to experience only specific parts (specific content) that they like, want to see, or are interested in during the actual performance in virtual reality.

In addition, the adapted performance content experience system 10 according to an embodiment of the present invention provides a newly created adapted performance in virtual reality by adding the user's personal taste or preference to a specific part of the artist's actual performance that the user is interested in. so that you can experience it.

Meanwhile, the adapted performance content experience system 10 according to an embodiment of the present invention is a media server 300 (see FIG. 4) provided to a performance product seller who collects and manages performance videos or performance content and plans and sells performance products. ) may include.

The operation server 200 and media server 300 are provided in the form of a computer or terminal and may include a monitor.

The adapted performance experience unit 100, the operation server 200, and the media server 300 of the adapted performance content experience system 10 according to an embodiment of the present invention are each arranged to be connected through a wireless network (wireless information and communication network). It can be.

Here, a plurality of dramatized performance experience units 100 may be provided. That is, multiple dramatization performance experience units 100 may be connected to the operation server 200 and the media server 300 through a network. Through the plurality of adapted performance experience units 100, multiple users can not only access the operation server 200 and the media server 300 at the same time, but also virtually experience the same performance or performance content at the same time.

The adapted performance content experience system 10 according to an embodiment of the present invention is based on virtual reality and provides users with an experience of at least a portion of an actual performance or an experience of a virtual performance created based on an actual performance. do.

Referring to FIG. 2, the adapted performance experience unit 100 includes an acting module 110 that allows the user to stand and enjoy the virtual performance with his body, an HMD device 180 that the user wears on his head, and an HMD device 180 that the user holds in his hand. It may include a hand motion controller 190 and a user terminal 170 that operate it.

Users can stand in the acting module 110 and enjoy actions similar to those at the actual performance hall while watching the virtual performance, such as running or shaking their body. To this end, the acting module 110 includes a standing pad unit 120 on which the user stands; A monitor 140 that presents a virtual reality image matching the movement the user makes while standing on the standing pad 120; A main module unit 150 that controls the movement of the standing pad unit 120; and an additional function unit 160 that detects the user's posture or body movement or provides an additional motion environment to the user.

The standing pad portion 120 is a part on which the user stands, and may be made of an elastic material or may include a cushioning material to alleviate the recoil applied to the user when the user makes a jumping motion. Users can enjoy the feeling of being in a standing performance hall in the standing pad unit 120.

The standing pad unit 120 can also exert a vibration function to generate vibration so that users can feel the atmosphere of the performance hall as much as possible. The standing pad unit 120 vibrates in accordance with the sound of music or singing resounding in the performance hall, allowing the user to feel the atmosphere of the performance hall. The vibration function of the standing pad unit 120 may be controlled by the main module unit 150.

Since the user stands on the standing pad 120 and runs or does something exciting while wearing the HMD device 180 on his head, he may fall due to lack of visibility. A handle to prevent the user from falling is provided. 130) may be provided connected to the standing pad portion 120.

The handle 130 may be provided with a biosignal sensor (not shown) to measure or detect the user's physical condition. The bio-signal sensor senses the heart rate or the amount of sweat secretion through the palm of the user holding the handle 130, and allows the user to use the acting module 110, the dramatized performance experience unit 100, the HMD device 180, etc. You can sense whether you feel comfortable or anxious about using it. The sensing value of the biological signal sensor is transmitted to the history management unit 240 or the big data unit 250 of the operation server 200 through the main module unit 150 or the communication unit 101 provided in the main module unit 150. It can be saved. Additionally, when the bio-signal sensor determines that the user's heart rate increases rapidly or sweating excessively, the main module unit 150 may protect the user by stopping the operation of the standing pad unit 120.

Additionally, it is possible to determine whether the user enjoys the virtual performance experience or not by using the measured value of the bio-signal sensor provided on the handle 130. This judgment may be used as data to determine the possibility of product success of the performance content that the user is virtually experiencing in connection with the product management unit 260 or the feedback unit 280 of the operation server 200.

The acting module 110 may include a main module unit 150 that controls the operation of the standing pad unit 120 or transmits various commands. The main module unit 150 is provided in front of the standing pad unit 120, and a monitor 140 may be provided in the main module unit 150.

As mentioned above, the main module unit 150 may be provided with a communication unit 101 and the like, and a data storage unit (not shown) may also be provided. The main module unit 150 can communicate or exchange data with the operation server 200 or the media server 300 through the communication unit 101. Additionally, it is possible to communicate with the user terminal 170 or exchange data. The user terminal 170 may include not only a desktop-type terminal but also a laptop-type or smartphone-type terminal.

A virtual reality image displayed through the HMD device 180 worn by the user on the monitor 140 provided in the main module unit 150 and a user standing or moving on the standing pad unit 120 may be displayed. The monitor 140 may be provided in the form of a touch screen, and the user can select various virtual experience menus by touching the monitor 140.

Meanwhile, an additional function unit 160 may be provided at the top of the main module unit 150. When the user stands on the standing pad unit 120, the additional function unit 160 is positioned above the user's head. The additional function unit 160 above the user's head can sense the position of the user's head. That is, the distance between the additional function unit 160 and the user's head, the distance at which the user's head is located from the center of the additional function unit 160, etc. can be measured. The additional function unit 160 can measure the position and distance of the user's head and sense whether the user is standing normally on the standing pad unit 120 or has fallen down.

Additionally, the additional function unit 160 may express various stage effects of a virtual performance experienced by the user. For example, the additional function unit 160 can spray wind or water droplets toward the user's head to make the user feel like attending a water bomb concert.

Additionally, the additional function unit 160 can create sound effects that occur in the virtual performance that the user is experiencing. For example, the user may be able to feel sound effects such as the artist's performance, singing, or the audience's shouts.

The additional function unit 160 may provide various additional functions according to the virtual performance selected by the user in connection with the history management unit 240 or the big data unit 250 of the operation server 200.

In addition, the dramatized performance content experience system 10 according to an embodiment of the present invention provides experiences of various performances using virtual reality. To this end, the dramatized performance experience unit 100 includes the HMD device 180 and hand motion. It may include a controller 190.

The HMD device 180 is a device worn on the user's head like glasses, and a virtual reality image can be displayed on a display unit provided inside the device. The HMD device 180 may be implemented not only as a device of the type shown in FIG. 2 but also as a smartphone mounted on a device (not shown) similar to a hair band that can be worn on the user's head.

The user may hold the hand motion controller 190 shown in FIG. 2 with his hand while wearing the HMD device 180 on his head. The HMD device 180 and the hand motion controller 190 may be provided as one set. The hand motion controllers 190 are preferably provided in pairs so that the user can hold one in each hand.

Since the virtual reality image displayed through the HMD device 180 shows the user holding the hand motion controller 190 in his hand, the user uses the hand motion controller 190 to control the HMD device 180 or the monitor ( 140), you can select the performance content displayed or select various menus.

Referring to FIG. 2, the hand motion controller 190 includes a grip part (not shown) that the user can grasp with his hand, a joystick-type movement function lever (not shown) operated by the finger, and a viewpoint adjustment function operated by pressing with the finger. It may include a button (not shown) and a trigger (not shown) that is operated by pulling with a finger.

The hand motion controller 190 can be used to select various menus or content that appear in a 3D virtual reality image displayed on the HMD device 180 worn on the user's head.

In addition, the adapted performance experience unit 100 includes a monitor 140 on which a virtual reality image related to the performance content is displayed, and a headset that allows the user to listen to the sound included in the performance content or the user's own voice and add the user's voice to the virtual reality image. It may include (102).

The user can become more immersed in virtual reality by listening to the sounds coming from the virtual performance through the headset 102, and the words or sounds made by the user while immersed in the performance or in a happy state can be expressed in the virtual reality image through the headset 102. there is. For example, the user's words or shouts while watching the performance content are transmitted to the operation server 200 through the headset 102, and the operation server 200 communicates with the headset 102 by the sound guide unit 297, which will be described later. The user's sound input can be converted into text and displayed on the virtual reality image displayed on the HMD device 180. Therefore, the user can experience a different pleasure from the actual performance by seeing his or her words or shouts displayed as text in the virtual reality video.

In this way, because the adapted performance experience unit 100 includes the acting module 110 that allows the user to experience the feeling of enjoying a performance in the standing area of the performance hall, the user does not simply stand and experience the virtual performance, but also experiences the virtual performance in the standing area of the performance hall. You can also run or enjoy the performance in the standing area.

As mentioned above, the dramatization performance experience unit 100 may include an additional function unit 160. The additional function unit 160 can add weather effects or stage special effects to a performance or performance content played in a virtual reality video. For example, when the performance product or performance content selected by the user is unfolded along with water play on a midsummer night, the additional function unit 160 darkens the virtual reality image displayed on the HMD device 180 to create a night-like situation. Alternatively, you can spray water droplets to make users feel as if they are at a real performance as much as possible.

The additional function unit 160 may provide various additional functions according to the performance product or performance content selected by the user in connection with the history management unit 240 or the big data unit 250 of the operation server 200.

The operating state of the additional function unit 160 may be controlled by the control unit 210 of the operation server 200. The user can directly select the operation of the additional function unit 160 to create a performance situation desired by the user, and even if the user does not select the operation of the additional function unit 160, the operation server 200 provides user-customized additional functions. Unit 160 may also be operated.

The dramatization performance experience unit 100 may communicate with or exchange data with the operation server 200 or the media server 300 through the communication unit 101. In addition, the operation server 200 or the media server 300 can communicate with the user terminal 170 or exchange data through the communication unit 101.

The user terminal 170 of the dramatization performance experience unit 100 wirelessly transmits the operation history data of the dramatization performance experience unit 100 to the operation server 200 using the communication unit 101 (see FIG. 4) or directly. Virtual reality video or performance content can be received from 200 and transmitted to the HMD device 180 or monitor 140.

In the adapted performance content experience system 10 according to an embodiment of the present invention, the adapted performance experience unit 100 is a hardware component for experiencing a performance or virtual performance in virtual reality, and the adapted performance experience unit 100 The virtual reality image displayed on the HMD device 180 or the monitor 140 and data related to the operation of the dramatization performance experience unit 100 may be provided from the operation server 200 and the media server 300.

Referring to FIG. 3, the operation server 200 of the dramatization performance content experience system 10 according to an embodiment of the present invention includes a control unit 210, a performance selection unit 221, a feature selection unit 223, and an adaptation unit 223. Performance output unit (230), history management unit (240), big data unit (250), product management unit (260), additional service unit (270), feedback unit (280), communication unit (291), graphic rendering engine (293) , may include a hand motion engine 295, a billing unit 296, a sound guide unit 297, and a display unit 299.

Here, the control unit 210 can control the operation of various components of the operation server 200 and enable collaboration. That is, the control unit 210 is a component that controls and coordinates the functions of each component of the operation server 200. Additionally, the control unit 210 may also control the operation of the dramatization performance experience unit 100.

The operating server 200 of the dramatized performance content experience system 10 according to an embodiment of the present invention is provided with a communication unit 291, so that it can exchange data with the user terminal 170 of the dramatized performance experience unit 100. The operation of the HMD device 180 and the hand motion controller 190 can be controlled.

The communication unit 291 of the operation server 200 can exchange data related to realistic experience through wireless communication with the user terminal 170, HMD device 180, and hand motion controller 190 of the dramatized performance experience unit 100. . The operation server 200 can transmit graphic images necessary for implementing a virtual reality image to the HMD device 180 or the monitor 140 through the communication unit 291, and the movement of the hand motion controller 190 is transmitted to the communication unit 291. It can be delivered to the operation server 200 through . In some cases, the HMD device 180 and the hand motion controller 190 may exchange data directly through wireless communication.

Additionally, the communication unit 291 of the operation server 200 can also exchange data with the communication unit 370 (see FIG. 4) of the media server 300.

The communication units 291 and 370 can send and receive data using various known wired or wireless communication methods.

The graphic rendering engine 293 of the operation server 200 is an engine that generates a virtual reality image displayed on the HMD device 180 or the monitor 140. When there is a request for modification or update of performance content by the history management unit 240, the control unit 210 commands the graphic rendering engine 293 to modify or modify the virtual reality image displayed on the HMD device 180 or monitor 140. It can be updated.

In addition, according to the selection result of the performance selection unit 221, the feature selection unit 223, or the additional service unit 270, the control unit 210 generates a virtual reality image related to the selected value or creates a virtual reality image matching the selection result. A command may be transmitted to the graphics rendering engine 293 to generate the image.

The hand motion engine 295 uses the movement information of the hand motion controller 190 to display the state of the user holding the hand motion controller 190 with his hand or making a hand signal by moving the hand motion controller 190 on the HMD device ( 180) or can be expressed in a virtual reality image displayed on the monitor 140.

The operation server 200 displays arrows indicating items or equipment that the user must check or select with the hand motion controller 190 within the virtual reality image displayed on the HMD device 180 or monitor 140. It may include a display unit 299. That is, the display unit 299 can display guidance indicators to prevent users from making mistakes while experiencing a virtual performance, etc., on the virtual reality image displayed on the HMD device 180 or the monitor 140.

The control unit 210 can selectively turn on/off the function of the display unit 299 using feedback data from the feedback unit 280. That is, the control unit 210 can automatically turn on/off the function of the display unit 299 regardless of the user's selection.

The operation server 200 may include a sound guide unit 297 that outputs a guidance voice explaining the use procedure, method of use, or performance content contents of the dramatized performance experience unit 100 to the user. The sound information unit 297 not only transmits messages related to the virtual performance experience, but also transmits ambient noise (sound) that actually occurs during the experience process. To this end, the sound guide unit 297 may operate in conjunction with the additional function unit 160 of the adapted performance experience unit 100.

Meanwhile, the operation server 200 of the adapted performance content experience system 10 according to an embodiment of the present invention includes a performance selection unit 221 for selecting a performance of an artist for which a user wishes to experience a virtual performance; a feature selection unit 223 that selects feature content preferred by the user among the performances of the artist selected in the performance selection unit 221; and an adapted performance output unit 230 that adapts the performance by reflecting the performance content desired by the user in the feature content of the performance selected in the feature selection unit 223.

The performance selection unit 221 may provide a performance selected by the user from among the actual performances that are the basis of the adapted performance experienced in the adapted performance experience unit 100 from the media server 300.

The operation server 200 of the adapted performance content experience system 10 according to an embodiment of the present invention may create an adapted performance using a performance video captured of an artist's actual performance. In other words, the adapted performance content that the user virtually experiences in the adapted performance experience unit 100 can be obtained from the video of the actual performance.

The performance selection unit 221 may store actual videos of performances received from the media server 300, such as actual performance videos of many artists, concert videos, musical videos, and play videos.

The user can select a performance or video of an artist for which he or she wishes to experience virtually through the performance selection unit 221. The performance selection unit 221 may express a selection menu as a 3D string image or a graphic image on a virtual reality image displayed on the HMD device 180. The user can select a desired performance video from the performance selection unit 221 by touching the hand motion controller 190 or the monitor 140.

The adapted performance content experience system 10 according to an embodiment of the present invention implements the video of the performance or artist selected by the user through the performance selection unit 221 in virtual reality and allows the user to experience the performance in virtual reality. It is not possible to experience the actual performance video in virtual reality. The adapted performance content experience system 10 according to an embodiment of the present invention allows the user to experience in virtual reality only the specific part of the performance video of the artist selected by the user through the performance selection unit 221. For example, by adding the user's preferences to the selected actual performance video, the user's favorite performance scenes, songs, dances, and specific dance movements are selectively displayed in virtual reality. For this purpose, the operation server 200 is provided with a feature selection unit 223.

The feature selection unit 223 of the operation server 200 may select the user's favorite feature contents among performance contents including songs, dances, performances, dialogues, or stage scenes among the artist's performances. In more detail, the feature selection unit 223 of the operation server 200 may extract the user's favorite song, dance, performance, dialogue, or stage scene from the artist's performance video and select it as feature content. Through the feature selection unit 223, the user virtually experiences only the feature content he or she has selected.

The feature selection unit 223 may express a selection menu for feature content as a 3D character string image on the virtual reality image displayed on the HMD device 180 or may express the selection menu as a graphic image. The user can select the feature he or she wants from among the feature contents displayed in the feature selection unit 223 using the hand motion controller 190 or the touch of the monitor 140.

Additionally, the user may select a performance or artist or select feature content verbally through the headset 102. When the user speaks through the headset 102 about the performance or artist he or she wants, the data is compared with the data stored in the performance selection unit 221 or the feature selection unit 223, and if there is matching data, the selection is made. If there is no data, the operation server 200 may use data from the history management unit 240 or the big data unit 250 to recommend a performance, artist, or feature similar to the performance, artist, or feature selected by the user.

The adapted performance output unit 230 outputs only the specific portion or content desired by the user among the performance videos selected by the user through the performance selection unit 221 and transmits them to the adapted performance experience unit 100, or the user selects the performance selection unit 221. It is also possible to adapt a new performance video by adding the features selected through the feature selection unit 223 to a specific part or content desired by the user among the performance videos selected through ) and transmit it to the adapted performance experience unit 100.

That is, the adapted performance output unit 230 outputs an adapted performance that replaces the artist's actual performance by reflecting the performance content that the user wants to see or wants to experience virtually in the feature content selected in the feature selection unit 223. It can be transmitted to the performance experience unit 100 so that the user can experience the adapted performance in virtual reality.

The adapted performance output unit 230 may search actual performance data and output a performance video or performance content desired by the user, or may create or create and output a performance video or performance content desired by the user based on actual performance data. there is. For example, when a performance by an inactive, disbanded artist, or deceased artist is selected in the performance selection unit 221, the adapted performance output unit 230 searches for performance data when the selected artist was active or performance data while he was alive. And based on this, you can create performance videos or performance content that fits the current trend.

The adapted performance output unit 230 can generate a performance video or performance content that a user wishes to experience virtually in virtual reality using video content, 3D content, and sound content. Here, video content refers to content directly related to the content of the performance or the artist, 3D content refers to content related to the performance stage or stage effects, and sound content refers to content related to performances or songs related to the performance or artist. . The adapted performance output unit 230 analyzes various data selected by the user to generate a performance video or performance content desired by the user, and provides an adaptation (creation or generation) of a performance video or performance content in which the stage, performers, and sound are harmoniously combined. By doing so, users can feel as if they are watching an actual performance right in front of their eyes.

The adapted performance output unit 230 transmits the adapted performance video data to the adapted performance experience unit 100. The adapted performance video data is implemented as a virtual reality image by the graphic rendering engine 293 and is transmitted to the adapted performance experience unit ( 100).

The adapted performance content experience system 10 according to an embodiment of the present invention includes a performance selection unit 221, a feature selection unit 223, and an adapted performance output unit 230 of the operation server 200, so that the actual performance Rather than reproducing the live performance in virtual reality, it extracts the performance content that the user wants to see from the actual performance, adds the user's preference, creates a new content of the actual performance, and allows the user to experience the created performance in virtual reality. You can.

In addition, the operation server 200 includes a history management unit 240 that stores and analyzes user-specific history data or user-specific data using the dramatization performance experience unit 100; A big data unit 250 that stores and analyzes history data of other users using the adapted performance experience unit 100 and calculates data matching the user's history data; a product management unit 260 that provides a virtual experience of performance products or performance content provided by a performance product seller in the adapted performance experience unit 100; and a feedback unit that collects feedback data on the performance product or performance content of users who have virtually experienced the performance product or performance content provided by the product management unit 260 through the adapted performance experience unit 100 and delivers it to the performance product seller. (280); may include.

The product management unit 260 may use or combine data from the performance selection unit 221, the feature selection unit 223, and the adapted performance output unit 230 to create a performance product or performance content desired by the user. That is, the product management unit 260 can present a performance product or performance content for which the user wants to experience a virtual experience.

The history management unit 240 may store and analyze history data and user personal data of the user's use of the dramatization performance experience unit 100. In order for a user to use the adapted performance content experience system 10 according to an embodiment of the present invention, the user must go through a registration process, and at this time, information about the user's personal information, favorite performance genre, artist, etc. may be input. In this way, the user's personal data entered during the subscription process of the adapted performance content experience system 10 may be stored in the history management unit 240.

In the big data unit 250, usage data and personal unique data of many users who use the dramatization performance experience unit 100 can be stored, converted into big data, and managed. Usage data may include information such as what genre, artist, and feature each user has selected, and personal unique data may include information such as the user's gender, age, residence, and hobbies.

In addition, the big data unit 250 may store and analyze data on the history of the user and other users using the adapted performance experience unit 100, reviews, comments or evaluations of performances or performance content, etc. The big data unit 250 can use the user's individual unique data for big data analysis in connection with the history management unit 240.

Meanwhile, the data stored in the history management unit 240 may be transferred to the big data unit 250 and managed as big data after a certain period of time has elapsed.

The feedback unit 280 of the operation server 200 may transmit the user's feedback data about the performance or performance content that is virtually experienced using the adapted performance experience unit 100 to the performance product seller. The feedback unit 280 may transmit feedback data to the operator of the adapted performance content experience system 10.

Through the feedback unit 280, the user can deliver feedback data including inconveniences felt while using the adapted performance experience unit 100, points for improvement, etc. to the performance product seller or the operator of the adapted performance content experience system. Performance product sellers may use feedback data to develop performance products or performance content highly preferred by users, or may improve the marketability of performance products already being sold to include performance content preferred by users.

The feedback unit 280 of the operation server 200 may transmit the user's feedback data about the performance or performance content virtually experienced by the adapted performance experience unit 100 to the performance product seller. The dramatized performance experience unit 100 of the dramatized performance content experience system 10 according to an embodiment of the present invention can provide a virtual experience for a performance product that is already on sale or is scheduled to be sold. After a user has a virtual experience of a performance product, etc., the user can input feedback data including the advantages or disadvantages felt about the product he or she has selected into the feedback unit 280. The user inputs verbal feedback data into the feedback unit 280 through the microphone or headset 102 provided in the HMD device 180, or inputs feedback data into the feedback unit 280 through a personal terminal 170 such as the user's smartphone. ) can be entered.

Feedback data for each user input to the feedback unit 280 may be transmitted to the media server 300 by the communication unit 291.

As described above, the operation server 200 of the adapted performance content experience system 10 according to an embodiment of the present invention may include a product management unit 260, where the product management unit 260 includes a history management unit 240. ), using data from the big data unit 250 or the feedback unit 280, to select adapted performances that have a high user preference or have many positive elements in the feedback data, and allow performance product sellers to select the adapted performances that are the same as the selected adapted performances or It can encourage the sale of similar performance products or performance content.

The product management unit 260 analyzes the reactions or feedback of users who use the adapted performance experience unit 100, derives products or content that are expected to be purchased by many people when planned and sold as performance products or performance content, and commercializes them. It can be induced. For example, the user's evaluation of the performance experienced virtually through the adapted performance experience unit 100, the number of audiences for the virtual performance, etc. are investigated, and based on this, the entertainment company or performance management company to which the artist belongs commercializes the performance. It can be induced to do so.

The product management unit 260 selects performance products or performance content that have a good response from users among performance products or performance content that can be virtually experienced through the adapted performance experience unit 100, and performs performances similar to the selected performance product or performance content. The artist's agency, which is judged to be possible, can be encouraged to plan performance products, or the performance agency can be encouraged to plan performance products.

Entertainment companies and performance product sellers can increase the success rate of product planning and sales because they can expect that performance products or performance content presented through the product management department 260 will have high user preference.

In addition, the product management unit 260 includes the user's individual taste (preference) data reflected in the performance or performance content created (adapted) based on the selection made by the user in the performance selection unit 221 or the feature selection unit 223. By analyzing the usage data and personal unique data of other users with the same or similar tendencies, performances or performance content matching the user can be recommended.

The product management unit 260 may recommend a performance or performance content to the user using the history data of the user's past use of the adapted performance experience unit 100, that is, the past use history data stored in the history management unit 240. there is. Since the user's past usage history data includes information such as the user's preferred performance genre, artist, song, dance movement, and performance format, analyzing this usage history data can identify performances or performance content that the user is likely to like. You can find it.

The product management unit 260 may recommend a performance or performance content to the user using the user's personal data as well as the usage history data. In other words, a performance or performance content can be recommended by analyzing the user's personal data stored in the history management unit 240.

In addition, the product management department 260 not only uses data or information directly related to the user, but also uses data that other users (other users) other than the user have used the dramatized performance experience unit 100 and other users' personal unique data. You can use it to recommend performances or performance content to the user.

The product management unit 260 analyzes other personal data stored in the big data unit 250, extracts other users who have personal data similar to the user's personal data, and performs an adapted performance of the extracted other users. By analyzing usage data for the experience unit 100, a performance, performance product, or performance content to be recommended to the user may be presented.

In addition, the operation server 200 may include an additional service unit 270 that provides additional services related to the adapted performance or the artist of the adapted performance that is virtually experienced through the adapted performance experience unit 100.

The additional service unit 270 can provide content that users can experience in virtual reality other than virtual experiences such as dramatized performances. For example, the additional service unit 270 may provide a service that allows a user to purchase an artist's goods in the metaverse space or allows a user to virtually experience the artist's daily manager. In this way, the additional service unit 270 can increase user satisfaction by providing additional services related to the user's favorite artist and encourage the user to continuously purchase performance products of the artist.

The operation server 200 may include a billing unit 296, which sets and charges fees incurred when a user virtually experiences a performance or performance content. Additionally, the billing unit 296 may charge the user the cost necessary to purchase the artist's goods in the metaverse space through the additional service unit 270. In this way, the operating server 200 of the adapted performance content experience system 10 according to an embodiment of the present invention may be provided with a billing unit 296 to resolve costs related to the copyright of the performance or artist.

Meanwhile, referring to Figures 1 and 4, the adapted performance content experience system 10 according to an embodiment of the present invention develops performance products or performance content in addition to the adapted performance experience unit 100 and the operation server 200, and It may include a media server 300 provided to the seller of the product being sold.

The media server 300 is a server provided on the side that collects, manages, plans, develops, and sells performances, performance products, or performance content that are virtually experienced by the adapted performance experience unit 100.

As shown in FIG. 4, the media server 300 includes a performance storage unit 310, a performance classification unit 320, a performance video extraction unit 330, a feedback application unit 340, and a metaverse generation unit 350. ), a billing department 360, a communication department 370, and a copyright management department 380.

In more detail, the media server 300 includes a performance storage unit 310 that stores performances or performance videos required by the adapted performance experience unit 100 and the operation server 200; A performance classification unit 320 that classifies the performances stored in the performance storage unit 310 according to genre, artist, or performance format; A performance video extraction unit 330 that extracts the performance video requested by the performance selection unit 221 of the operation server 200; A feedback application unit 340 that reflects the review or feedback data received from the feedback unit 280 of the operation server 200 on the performance video or performance content selected by the performance video extraction unit 330; and a metaverse creation unit 350 that generates a metaverse space and an avatar upon a request from the additional service unit 270 of the operation server 200.

The media server 300 is a server that stores, classifies, and extracts performance videos required by the adapted performance experience unit 100 or the operation server 200.

Referring to FIG. 1, performance video of the recording equipment 400 that captures the performances and artists of the performance hall 500 may be stored in the performance storage unit 310 of the media server 300.

The performance classification unit 320 may classify the performance video stored in the performance storage unit 310 according to the performing artist, genre (category), performance format, performance hall type, etc. When the performance selection unit 210 of the operation server 200 requests a performance video, the performance classification unit 320 can quickly find a performance video matching the request by searching the classified performance videos.

The media server 300 may transmit the performance video found in the performance classification unit 320 to the operation server 200 as is, and extract the performance video matching the feature selected in the feature selection unit 223 of the operation server 200. It can also be transmitted to the operation server 200. The performance video extraction unit 330 may apply the features selected in the feature selection unit 223 to the performance video and then transmit the generated performance video to the operation server 200.

The feedback application unit 340 can improve marketability by applying feedback data received from the feedback unit 280 of the operation server 200 to its performance products. The media server 300, which has received the user's feedback data, analyzes the feedback data, corrects any problems with its performance product, and adds user requests to its performance product to improve the marketability of its performance product. You can. In this way, the feedback data can be applied by the feedback application unit 340 to improve the marketability of the company's performance products, thereby encouraging users to select more of the company's performance products through the adapted performance experience unit 100.

Additionally, when the product management unit 260 of the operation server 200 requests planning of a performance product, this request may also be transmitted to the feedback application unit 340.

Meanwhile, the additional service unit 270 of the operation server 200 provides a service for users to purchase artist's goods in the metaverse space, or provides a service for users to virtually experience the artist's daily manager. In this case, the metaverse creation unit 350 of the media server 300 may create a metaverse space as shown in FIG. 5.

Users can try various experiences in virtual reality, such as having their avatar experience as the daily manager of an artist's avatar in the metaverse space created through the metaverse creation unit 350.

Referring to FIG. 4, when the performance video or performance content provided by the performance video extraction unit 330 is virtually experienced through the adapted performance experience unit 100, the media server 300 calculates the cost for the virtually experienced performance product, etc. It may include a billing unit 360 that receives. The billing unit 360 of the media server 300 may charge fees from the billing unit 296 of the operation server 200. That is, while the billing unit 296 of the operation server 200 charges fees from users, the billing unit 360 of the media server 300 charges costs in the nature of performance product fees from the operation server 200. You can.

In addition, the media server 300 includes a copyright management unit 380 that manages copyrights for artists or works related to the performance video or performance content provided to the adapted performance experience unit 100 by the performance video extraction unit 330. It can be included.

Since the performance work is virtually experienced using the adapted performance content experience system 10 according to an embodiment of the present invention, copyright issues regarding the work may arise. In other words, unauthorized commercial use of a copyrighted work may constitute copyright infringement. The adapted performance content experience system 10 according to an embodiment of the present invention has the media server 300 provided with a copyright management unit 380. You can prepare for copyright infringement issues.

Costs charged by the billing department 296 of the operation server 200 and the billing department 360 of the media server 300 may include copyright fees. The copyright management department 380 may calculate a portion of the costs charged by the charging department 296, 360 as copyright fees and pay it to the copyright holder.

Additionally, in the case of unauthorized virtual experience of a copyrighted work, the copyright management unit 380 may warn the user or the operator of the dramatized performance experience unit 100 of the possibility of copyright infringement.

The system or device described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, devices and components described in embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), It may be implemented using one or more general-purpose or special-purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. A processing device may execute an operating system (OS) and one or more software applications that run on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include multiple processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used on any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

As described above, the embodiments of the present invention have been described with specific details such as specific components and limited examples and drawings, but this is only provided to facilitate a more general understanding of the present invention, and the present invention is limited to the above embodiments. This does not mean that various modifications and variations can be made from this description by those skilled in the art. Accordingly, the spirit of the present invention should not be limited to the described embodiments, and the claims described below as well as all modifications that are equivalent or equivalent to the claims will fall within the scope of the present invention.

10: Virtual reality-based adapted performance content experience system
100: Adapted performance experience unit 110: Acting module
120: Standing pad part 130: Handle
140: Monitor 150: Main module part
160: Additional function unit 170: Terminal
180: HMD device 190: Hand motion controller
200: operation server 210: control unit
221: Performance selection unit 223: Feature selection unit
230: Adapted performance output unit 240: History management unit
250: Big Data Department 260: Product Management Department
270: Additional service department 280: Feedback department
300: Media server 310: Performance storage unit
320: Performance classification unit 330: Performance video extraction unit
340: Feedback application unit 350: Metaverse generation unit
380: Copyright Management Department

Claims (9)

An adapted performance experience unit that provides a virtual experience of an adapted performance during an artist's performance based on virtual reality; and
An operating server that stores and executes the adapted performance content or video content provided to the adapted performance experience unit and controls the operation of the adapted performance experience unit;
The operating server selects a portion of the artist's performance, creates an adapted performance reflecting the user's preference, and delivers the adapted performance to the adapted performance experience unit to experience the adapted performance in virtual reality. system.
According to paragraph 1,
The operating server is,
A performance selection unit where the user selects a performance by an artist for whom the user wishes to experience a virtual performance;
a feature selection unit that selects feature content preferred by the user from among the performances of the artist selected in the performance selection unit; and
A virtual reality-based adapted performance content experience system comprising: an adapted performance output unit that adapts the performance by reflecting the performance content desired by the user in the feature content of the performance selected in the feature selection unit.
According to paragraph 2,
The feature selection unit,
A virtual reality-based adapted performance content experience system that allows users to select their favorite feature content among performance content including songs, dances, performances, dialogue, or stage scenes from an artist's performance.
According to paragraph 3,
The adapted performance output unit,
The feature content selected in the feature selection unit reflects the performance content that the user wants to see or experience virtually, outputs an adapted performance that replaces the artist's actual performance, and delivers it to the adapted performance experience unit so that the user can view the adapted performance as a virtual version. A virtual reality-based adapted performance content experience system characterized by allowing people to experience it in reality.
According to paragraph 4,
The operating server is,
a history management unit that stores and analyzes history data or unique data for each user using the adapted performance experience unit;
a big data unit that stores and analyzes history data of other users using the adapted performance experience unit and calculates data matching the user's history data;
a product management unit that provides a virtual experience of performance products or performance content provided by a performance product seller in the adapted performance experience unit; and
A feedback unit that collects feedback data on the performance product or performance content of a user who has virtually experienced the performance product or performance content provided by the product management unit through the adapted performance experience unit and delivers it to the performance product seller; comprising a. Characterized by a virtual reality-based adapted performance content experience system.
According to clause 5,
The product management department,
Using the data from the history management unit, the big data unit, or the feedback unit, adapted performances that have a high user preference or have many positive elements in the feedback data are selected, and performance product sellers are provided with performance products that are identical or similar to the selected adapted performances. Or, a virtual reality-based adapted performance content experience system characterized by encouraging sales of performance content.
According to clause 6,
The operating server is,
A virtual reality-based adapted performance content experience system comprising an additional service unit that provides additional services related to the adapted performance or the artist of the adapted performance that is virtually experienced through the adapted performance experience unit.
According to any one of claims 1 to 7,
A virtual reality-based adapted performance content experience system, wherein the operating server generates an adapted performance using performance video captured of the artist's actual performance.
According to clause 8,
It includes a media server that acquires the artist's performance video and extracts and provides the performance video required by the operation server,
The media server is,
A virtual reality-based adapted performance content experience system, characterized in that the additional service unit of the operation server includes a metaverse creation unit that creates the metaverse space required when providing additional services in the metaverse space to the user.