KR20240044205A - Virtual reality-based performance experience providing system - Google Patents

Abstract

A virtual reality-based performance immersive providing system according to an embodiment of the present invention includes a performance immersive unit that provides a realistic experience of an artist's performance based on virtual reality; and an operation server that stores and executes performance content provided to the performance immersive unit and controls the operation of the immersive performance unit, wherein the operation server provides a performance product selected by the user through the immersive performance unit. User-customized performance products are recommended, and the user-selected performance products and user-customized recommended performance products may include the artist's actual performance content or creative performance content based on the artist's actual performance content.

Description

Virtual Reality-BASED PERFORMANCE EXPERIENCE PROVIDING SYSTEM}

The present invention relates to a virtual reality-based performance immersion system, and more specifically, a virtual reality-based performance immersion system that allows users to experience various performances of their favorite artists in virtual reality at home, etc., even without going to the performance site. It's about the delivery system.

For performances held at performance halls, such as existing musicals and music concerts, the audience visits the performance site in person and watches it from the audience, but visiting the site in person has the limitation that it is difficult to participate because conditions such as location and time are not satisfactory. .

Accordingly, there are a significant number of viewers who watch through live TV broadcasts or Internet broadcasts, but this method of watching TV is insufficient to give the feeling of actually participating in the event.

Recently, with the development of electronic display technology, head-mounted displays or head-mounted devices (head-mounted displays), a type of wearable device that viewers wear directly on the head, are being introduced in addition to providing two-dimensional information through TVs, monitors, etc. Head Mounted Device (HMD) was proposed.

As head mounted displays (hereinafter referred to as “HMD”) devices, which are video display devices that can be worn on the head like glasses and enjoy large images, become widespread, virtual reality (hereinafter referred to as “VR”) images are available. Interest in it is also increasing. HMD devices can provide users with VR images that make them feel as if they are interacting with the real surrounding environment.

Virtual reality refers to an artificial world or such technology that artificially implements objects or backgrounds of the virtual world or the real world using a computer. This virtual reality technology provides a virtual world to the user and creates a virtual world created by a computer. Users become immersed in the space or environment.

Using these virtual reality images, the viewpoint changes depending on the user's movement, allowing images from various viewpoints to be provided. Attempts to utilize these characteristics and apply them to various fields such as games, education, medical care, video, broadcasting, advertising, and manufacturing are actively underway.

However, recently, due to the COVID-19 incident, not only are people unable to easily go to concert halls, but artists are also unable to perform. Accordingly, people are attempting to watch artists' performances through virtual reality content.

However, most virtual reality technologies currently being introduced have the limitation of simply showing actual performances as virtual reality images.

The present applicant proposed the present invention to solve the above problems.

Korean Patent No. 10-2042159 (registration date 2019.11.01.) Korea Patent Publication No. 10-2009-0000550 (publication date 2009.01.08.) Korean Patent Publication No. 10-2016-0136160 (publication date 2016.11.29.) Korea Patent Publication No. 10-2019-0031220 (publication date 2019.03.25.) Korean Patent No. 10-0921452 (registration date 2009.10.06.)

The present invention was proposed to solve the above problems, and by introducing virtual reality technology, it is a virtual reality-based performance that allows you to experience not only actual performances but also performances by inactive or deceased artists. Provides a realistic experience system.

The present invention is a virtual reality-based system that can recommend not only the artist or performance directly selected by the user, but also the performance that the user is likely to prefer by analyzing which performances have been virtually experienced by many other users with similar usage history or preferences as the user. Provides a system that provides realistic performance experience.

A virtual reality-based performance immersion providing system according to an embodiment of the present invention for achieving the above-described problem includes a performance immersion unit that provides a realistic experience of an artist's performance based on virtual reality; and an operation server that stores and executes performance content provided to the performance immersive unit and controls the operation of the immersive performance unit, wherein the operation server provides a performance product selected by the user through the immersive performance unit. User-customized performance products are recommended, and the user-selected performance products and user-customized recommended performance products may include the artist's actual performance content or creative performance content based on the artist's actual performance content.

The operation server includes a genre selection unit that selects a genre or category of a performance for which the user wishes to experience a realistic experience; An artist selection unit where the user selects an artist for whom he or she wishes to experience an immersive experience; A performance format selection unit that selects the type of performance for which the user wishes to experience a realistic experience; And a product creation unit that generates performance content to be provided to the user using the selection results of the genre selection unit, the artist selection unit, and the performance format selection unit, wherein the product creation unit includes the genre selection unit and the artist selection. By extracting video content, 3D content, and sound content from the performance format selection unit and the performance format selection unit, a performance product or performance content that the user wishes to experience can be created.

The artist selection unit may select at least one of an active artist, an inactive or disbanded artist, or a deceased artist.

The operation server includes a history management unit that stores and analyzes user personal data and history data of the user's use of the performance immersive unit; a big data unit that stores and manages usage data and personal unique data for the performance immersive unit of users other than the user; And a product recommendation unit that recommends a user-customized performance product or performance content using data from the history management unit and the big data unit, wherein the product recommendation unit includes a performance product or performance product generated in the product creation unit according to the user's selection. By analyzing the usage data and personal unique data of other users with the same or similar tendencies as the user's preference data reflected in the performance content, we recommend customized performance products or performance content that match the user, but the performance product or performance product created in the product creation unit Compared to performance content, performance products or performance content that are identical or similar may not be recommended.

The operation server includes a feedback unit that stores and manages user reviews or feedback data on performance products or performance content generated by the product creation unit and performance products or performance content recommended by the product recommendation unit; and a product planning unit that uses data stored in the feedback unit, the history management unit, or the big data unit to plan performance products or performance content expected to be highly preferred by users and induce sales.

It includes a sales server provided to a product seller who develops and sells performance products or performance content, and the sales server develops performance products or performance content matching the performance products or performance content presented by the product planning department and operates the performance product or performance content. Product sales department provided to the server; a feedback application unit that reflects reviews or feedback data received from the feedback unit to performance products or performance content of the product sales department; And providing purchase points to users who provide reviews or feedback data reflected in performance products or performance content by the feedback application department, or providing compensation services including rewards to users when the user purchases performance products or performance content. It may include a promotion department.

The sales server may include a copyright management unit that manages copyrights for artists or works related to performance products or performance content provided to the performance immersive unit by the product sales unit.

Through the virtual reality-based performance providing system according to the present invention, users can experience the performance of their favorite artist in virtual reality without having to go to the performance hall in person, allowing them to feel as if they are actually at the performance hall.

The virtual reality-based performance providing system according to the present invention allows users to experience performances not only by currently active artists but also by disbanded, inactive, or deceased artists in virtual reality.

The virtual reality-based performance providing system according to the present invention can contribute to revitalizing the entertainment industry because it is possible to plan and sell products for artists or performances highly preferred by users.

Figure 1 is a diagram illustrating the configuration of a system for providing a realistic performance experience based on virtual reality according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a portion of the configuration of a performance immersion unit in the virtual reality-based performance immersion providing system according to FIG. 1.
FIG. 3 is a diagram illustrating the configuration of an operating server in the virtual reality-based performance providing system according to FIG. 1.
FIG. 4 is a diagram illustrating important components of a performance immersion unit, an operation server, and a sales server in the virtual reality-based performance immersion providing system according to FIG. 1.

The advantages and/or features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and will be implemented in various different forms, but the present embodiments only serve to ensure that the disclosure of the present invention is complete and are within the scope of common knowledge in the technical field to which the present invention pertains. It is provided to fully inform those who have the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

In addition, the preferred embodiments of the present invention to be implemented below are provided in each system function configuration in order to efficiently explain the technical components constituting the present invention, or system functions commonly provided in the technical field to which the present invention pertains. The configuration will be omitted whenever possible, and the description will focus on the functional configuration that must be additionally provided for the present invention. If a person has ordinary knowledge in the technical field to which the present invention pertains, he or she will be able to easily understand the functions of conventionally used components among the functional configurations not shown and omitted below, as well as the omitted configurations as described above. The relationships between elements and components added for the present invention will also be clearly understood.

In addition, in the following description, "transmission", "communication", "transmission", "reception" and other similar terms of signals or information refer to the direct transmission of signals or information from one component to another component. In addition, it also includes those transmitted through other components. In particular, “transmitting” or “transmitting” a signal or information as a component indicates the final destination of the signal or information and does not mean the direct destination. This is the same for “receiving” signals or information.

FIG. 1 is a diagram illustrating the configuration of a virtual reality-based performance immersion providing system according to an embodiment of the present invention, and FIG. 2 is a diagram illustrating a portion of the configuration of a performance immersion unit in the virtual reality-based performance immersion providing system according to FIG. 1. , FIG. 3 is a diagram showing the configuration of an operating server in the virtual reality-based performance immersive providing system according to FIG. 1, and FIG. 4 is a diagram showing the configuration of the performance immersive unit, operating server, and sales server among the virtual reality-based performance immersive providing system according to FIG. 1. This is a drawing showing the main parts of the structure.

The virtual reality-based performance providing system 10 according to an embodiment of the present invention described below is a system using virtual reality (VR) images or technology, and the provision or implementation of virtual reality images is known in the art. Virtual reality technology can be used.

Referring to FIG. 1, the virtual reality-based performance immersion providing system 10 (hereinafter referred to as 'realism providing system') according to an embodiment of the present invention is a performance immersion unit that provides a realistic experience of an artist's performance based on virtual reality. (100); and an operation server 200 that stores and executes performance content provided to the realistic performance unit 100 and controls the operation of the realistic performance unit 100.

Here, the operation server 200 provides performance products selected by the user or recommends user-customized performance products through the performance immersion unit 100, and the user-selected performance products and user-customized recommended performance products are the actual performance content of the artist or the artist. It may include creative performance content based on actual performance content.

The reality providing system 10 according to an embodiment of the present invention can provide an experience as if a user is watching a real performance by selecting his or her favorite artist or performance in virtual reality. In addition, the realistic experience system 10 according to an embodiment of the present invention is based on actual performances, but investigates the user's prior user preferences for the user's favorite artist, genre, or performance type, and determines the preferences of other users with similar tendencies. By analyzing data, virtual reality performance experience content can be provided to users.

Meanwhile, the realistic experience providing system 10 according to an embodiment of the present invention may include a sales server 300 (see FIG. 4) provided to a product seller who plans, develops, and sells performance products or performance content.

The operation server 200 and sales server 300 are provided in the form of a computer or terminal and may include a monitor.

The performance immersive unit 100, the operation server 200, and the sales server 300 of the immersive experience system 10 according to an embodiment of the present invention may each be connected through a wireless network (wireless information and communication network). .

Here, a plurality of performance immersive units 100 may be provided. That is, multiple performance immersive units 100 may be connected to the operation server 200 and the sales server 300 through a network. Through the plurality of performance immersive units 100, multiple users can not only access the operation server 200 and the sales server 300 at the same time, but can also realistically experience the same performance product or the same performance content at the same time.

The realistic sensation providing system 10 according to an embodiment of the present invention is based on virtual reality and can provide users with an experience of at least a portion of an actual performance or an experience of a virtual performance created based on an actual performance. there is.

Meanwhile, referring to FIG. 2, the performance immersion unit 100 includes an HMD device 110 that the user wears on his or her head, a hand motion controller 120 that the user holds in his hand and operates, and a user terminal 130. can do.

The HMD device 110 is a device worn on the user's head like glasses, and a virtual reality image can be displayed on a display unit provided inside the device. The HMD device 120 may be implemented not only as a device of the type shown in FIG. 2 but also as a smartphone mounted on a device (not shown) similar to a hair band that can be worn on the user's head.

The user may hold the hand motion controller 120 shown in FIG. 2 with his hand while wearing the HMD device 110 on his head. The HMD device 110 and the hand motion controller 120 may be provided as one set. The hand motion controllers 120 are preferably provided in pairs so that the user can hold one in each hand.

Since the virtual reality image displayed through the HMD device 110 shows the user holding the hand motion controller 120 in his hand, the user uses the hand motion controller 120 to control the HMD device 110 or the monitor ( 140), you can select the performance content displayed or select various menus.

Referring to FIG. 2, the hand motion controller 120 includes a gripper (not shown) that the user can grasp with his or her hand, a joystick-type movement function lever (not shown) operated by the finger, and a point of view adjustment operated by pressing with the finger. It may include a button (not shown) and a trigger (not shown) that is operated by pulling with a finger.

The hand motion controller 120 can be used to select various menus or content that appear in a 3D virtual reality image displayed on the HMD device 110 worn on the user's head.

In addition, the performance immersive unit 100 includes a monitor 140 on which a virtual reality image related to the performance content is displayed, a headset ( 150) may be included.

The user can become more immersed in virtual reality by listening to the sound transmitted by the artist or during the performance through the headset 150, and the words or sounds made by the user while immersed in the performance or in a happy state are also expressed in the virtual reality image through the headset 150. It can be. For example, the user's words or shouts while watching the performance content are transmitted to the operation server 200 through the headset 150, and the operation server 200 operates the headset 150 by the sound guide 297, which will be described later. The user's sound input can be converted into text and displayed on the virtual reality image displayed on the HMD device 110. Therefore, the user can experience a different pleasure from the actual performance by seeing his or her words or shouts displayed as text in the virtual reality video.

Additionally, as shown in FIG. 4, the performance immersive unit 100 may include an acting module 160 in which the user sits or stands. The user can not only simply stand in the acting module 160, but also run or enjoy the performance as if he were in a standing seat at a performance hall.

The performance immersive unit 100 may include an acting detection unit 170 that detects the user's movement, that is, acting, in the acting module 160. The acting detection unit 170 detects whether the user sitting or standing in the acting module 160 moves his or her body in response to the performance and to what extent the user moves violently, and the detection result is sent to the operation server through the communication unit 101. It may be transmitted to the history management unit 240 of (200).

The operation server 200 may use the detection result of the action detection unit 170 to determine the user's preference or satisfaction with performance content played as a virtual reality video. If it is determined that the user is moving his or her body happily, it may be determined that the user likes or is satisfied with the performance content being played. The history management unit 240 can store the analysis results or transmit them to the big data unit 250 and use them to determine the user's individual tastes or to recommend customized performance products or performance content to the user.

Additionally, the performance immersive unit 100 may include an additional function unit 180. The additional function unit 180 can add weather effects, stage special effects, etc. to performance products or performance content played in a virtual reality video. For example, when the performance product or performance content selected by the user is unfolded along with water play on a midsummer night, the additional function unit 180 darkens the virtual reality image displayed on the HMD device 110 to create a night-like situation. Alternatively, you can spray water droplets to make users feel as if they are at a real performance as much as possible.

The additional function unit 180 is connected to the history management unit 240 or the big data unit 250 of the operation server 200, and performs a performance product or performance content selected by the user or a performance product or performance content recommended by the operation server 200. Various additional functions can be provided accordingly.

The operating state of the additional function unit 180 may be controlled by the control unit 210 of the operation server 200. The user can directly select the operation of the additional function unit 180 to create a performance situation desired by the user, and even if the user does not select the operation of the additional function unit 180, the operation server 200 provides additional functions customized to the user. Unit 180 may also be operated.

The action detection unit 170 and the additional function unit 180 are preferably positioned above the user's head.

The performance immersive unit 100 may communicate or exchange data with the operation server 200 or the sales server 300 through the communication unit 101. In addition, through the communication unit 101, the operation server 200 or the sales server 300 can communicate with the user terminal 130 or exchange data. The user terminal 130 may include a smartphone-type terminal as well as a desktop-type terminal and a laptop-type terminal.

The monitor 140 of the performance immersive unit 100 can display a virtual reality image reflecting the user moving in the acting module 160, similar to the HMD device 110 worn by the user. The monitor 140 may be provided in the form of a touch screen, and the user can select various realistic experience menus by touching the monitor 140.

The user terminal 130 of the performance immersive unit 100 wirelessly transmits the operation history data of the performance immersive unit 100 to the operation server 200 using the communication unit 101 (see FIG. 4) or directly. ) can receive virtual reality video or performance content and transmit it to the HMD device 110 or monitor 140.

As described above, the monitor 140 of the performance immersive unit 100 displays a virtual reality image of the immersive performance experience displayed through the HMD device 110 worn by the user and the user moving in the acting module 160. It can be.

In the reality providing system 10 according to an embodiment of the present invention, the performance experience unit 100 is a hardware component for virtual reality experience, and the HMD device 110 or monitor 140 of the performance experience unit 100 ) and data related to the operation of the virtual reality image displayed in the performance immersive unit 100 may be provided from the operation server 200 and the sales server 300.

Referring to FIG. 3, the operation server 200 of the realistic experience providing system 10 according to an embodiment of the present invention includes a control unit 210, a genre selection unit 221, an artist selection unit 223, and a performance format selection. Department (235), product creation department (230), history management department (240), big data department (250), product recommendation department (260), feedback department (270), product planning department (280), communication department (291), graphics It may include a rendering engine 293, a hand motion engine 295, a sound guide unit 297, an additional service unit 298, and a display unit 299.

Here, the control unit 210 can control the operation of various components of the operation server 200 and enable collaboration. That is, the control unit 210 is a component that controls and coordinates the functions of each component of the operation server 200. Additionally, the control unit 210 may also control the operation of the performance immersive unit 100.

The operating server 200 of the realistic performance system 10 according to an embodiment of the present invention is provided with a communication unit 291, so that it can exchange data with the user terminal 130 of the performance realistic unit 100 and HMD device ( 110) and the operation of the hand motion controller 120 can be controlled.

The communication unit 291 of the operation server 200 can exchange data related to realistic experience with the user terminal 130, HMD device 110, and hand motion controller 120 of the performance immersive unit 100 through wireless communication. The operation server 200 can transmit graphic images necessary for implementing a virtual reality image to the HMD device 110 or the monitor 140 through the communication unit 291, and the movement of the hand motion controller 120 is transmitted to the communication unit 291. It can be delivered to the operation server 200 through . In some cases, the HMD device 110 and the hand motion controller 120 may exchange data directly through wireless communication.

Additionally, the communication unit 291 of the operation server 200 can also exchange data with the communication unit 360 of the sales server 300.

The communication units 291 and 360 can send and receive data using various known wired or wireless communication methods.

The graphic rendering engine 293 of the operation server 200 is an engine that generates a virtual reality image displayed on the HMD device 110 or the monitor 140. If there is a request for modification or update of performance content by the history management unit 240, the control unit 210 commands the graphic rendering engine 293 to modify the virtual reality image displayed on the HMD device 110 or monitor 140 or It can be updated.

In addition, according to the selection result of the genre selection unit 221, artist selection unit 223, performance format selection unit 235, or additional service unit 298, the control unit 210 generates a virtual reality image related to the selected value or A command may be transmitted to the graphic rendering engine 293 to generate a virtual reality image that matches the selection result.

The hand motion engine 295 uses the movement information of the hand motion controller 120 to display the state of the user holding the hand motion controller 120 with his hand or making a hand signal by moving the hand motion controller 120 on the HMD device ( 110) or can be expressed in a virtual reality image displayed on the monitor 140.

The operation server 200 displays arrows indicating items or equipment that the user must check or select with the hand motion controller 120 within the virtual reality image displayed on the HMD device 110 or monitor 140. It may include a display unit 299. That is, the display unit 299 can display guidance signs to prevent the user from making mistakes during the realistic experience, etc., on the virtual reality image displayed on the HMD device 110 or the monitor 140.

The control unit 210 can selectively turn on/off the function of the display unit 299 using feedback data from the feedback unit 270. That is, the control unit 210 can automatically turn on/off the function of the display unit 299 regardless of the user's selection.

The operation server 200 may include a sound guide unit 297 that outputs a guidance voice explaining the use procedure, method of use, or performance content contents to the user. The sound information unit 297 not only transmits messages related to the realistic performance experience, but can also transmit ambient noise (sound) that is actually generated during the realistic performance experience. To this end, the sound guide unit 297 may operate in conjunction with the additional function unit 180 of the performance immersive unit 100.

Meanwhile, the operating server 200 of the realistic experience providing system 10 according to an embodiment of the present invention includes a genre selection unit 221 that selects a genre or category of a performance for which the user wishes to experience a realistic experience; An artist selection unit 223 where the user selects an artist for whom he or she wishes to experience an immersive experience; A performance format selection unit 225 that selects the type of performance for which the user wishes to experience a realistic experience; and a product creation unit 230 that generates performance content to be provided to the user using the selection results of the genre selection unit 221, the artist selection unit 223, and the performance format selection unit 225.

Here, the product creation unit 230 extracts video content, 3D content, and sound content from the genre selection unit 221, artist selection unit 223, and performance format selection unit 225 to select a performance for which the user wishes to experience a realistic experience. You can create product or performance content.

Through the genre selection unit 221, the user can select the genre or category of the performance for which he or she wishes to experience virtually. For example, you can select a genre or category of performance, such as a concert, play, musical, public broadcast, or dinner show.

The genre selection unit 221 can express a selection menu as a 3D character string image or a graphic image in a virtual reality image displayed on the HMD device 110. The user can select a desired genre or category of the performance displayed in the genre selection unit 221 by touching the hand motion controller 120 or the monitor 140 and proceed to the next step.

Additionally, the user can select which artist's performance he or she wishes to experience in the selected performance genre through the artist selection unit 223. For example, when a user selects a concert through the genre selection unit 221, he or she can select whose concert he or she wants to virtually experience.

At this time, through the artist selection unit 223, the user can select at least one of not only the currently active artist, but also an artist who is currently inactive, disbanded, or a deceased artist.

The realistic experience system 10 according to an embodiment of the present invention provides not only a virtual experience of currently active artists and popular performances, but also a virtual experience of performances by artists whose live performances cannot be seen in reality. do.

The artist selection unit 223 may express a selection menu for the contents of the experience as a 3D string image on the virtual reality image displayed on the HMD device 110 or may express the selection menu as a graphic image. The user can select a desired artist from among the artists displayed in the artist selection unit 223 using the hand motion controller 120 or the touch of the monitor 140.

Additionally, the user may select a performance genre or artist verbally through the headset 150. When the user speaks a genre or artist through the headset 150, the data is compared with the data stored in the genre selection unit 221 or the artist selection unit 223 and selected if matching data is found. If there is none, the operation server 200 may use data from the history management unit 240 or the big data unit 250 to recommend a genre or artist similar to the genre or artist verbally selected by the user.

The user can select the format of the performance he or she wants to virtually experience through the performance format selection unit 225. For example, when a concert is selected in the genre selection unit 221 and the artist who is the main character of the selected concert is selected in the artist selection unit 223, a large theater concert, a small theater concert, a fan meeting, You can choose a performance format such as a broadcast performance. Depending on the user, they may prefer a large theater concert with fancy stage effects, lighting, or decorations, or they may prefer a small theater concert where the physical distance from the artist is close and a sense of intimacy can be felt.

Through the performance format selection unit 225, the user can select the form or format of the performance he or she prefers.

The performance format selection unit 225 may express a selection menu for the contents of the experience as a 3D string image on the virtual reality image displayed on the HMD device 110 or may express the selection menu as a graphic image. The user can select a desired format among the performance formats displayed in the performance format selection unit 225 using the hand motion controller 120 or the touch of the monitor 140.

The product creation unit 230 may generate a performance product or performance content desired by the user by using or combining the selection results of the genre selection unit 221, the artist selection unit 223, and the performance format selection unit 225. That is, the product creation unit 230 can present a performance product or performance content for which the user wants to experience a virtual experience.

Here, the product creation unit 230 may search actual performance data and present performance products or performance content desired by the user, or may create or create and present performance products or performance content desired by the user based on actual performance data. It may be possible. For example, when an inactive, disbanded artist, or deceased artist is selected in the artist selection unit 223, the product creation unit 230 searches performance data when the selected artist was active or performance data while he was alive, and searches for performance data when the selected artist was active or when he was alive. Based on this, you can create performance products or performance content that matches current trends.

The product creation unit 230 can use video content, 3D content, and sound content to create a performance product or performance content that the user wishes to experience realistically in virtual reality. Here, video content refers to content directly related to the content of the performance or the artist, 3D content refers to content related to the performance stage or stage effects, and sound content refers to content related to performances or songs related to the performance or artist. . The product creation unit 230 analyzes various data selected by the user and generates the performance product or performance content desired by the user. By creating and providing a performance product or performance content that harmoniously combines the stage, performers, and sound, the user can perform the actual performance. You can feel as if you are seeing it right in front of your eyes.

Meanwhile, the operation server 200 includes a history management unit 240 that stores and analyzes user personal data and history data of the user's use of the performance immersive unit 100; A big data unit 250 that stores and manages usage data and personal unique data for the performance immersive unit 100 of other users excluding the user; and a product recommendation unit 260 that recommends user-customized performance products or performance content using data from the history management unit 240 and the big data unit 250.

Here, the product recommendation unit 260 provides usage data and personal unique data of other users with the same or similar tendencies as the user's preference data reflected in the performance product or performance content generated by the product creation unit 230 according to the user's selection. Analyzes and recommends customized performance products or performance content that matches the user, but does not recommend or excludes from recommendation the same or similar performance products or performance content compared to the performance product or performance content generated in the product creation unit 230. there is.

The product creation unit 230 of the operation server 200 reflects the user's intention and presents performance products or performance content that the user wants to experience realistically, while the product recommendation unit 260 operates regardless of the user's intention. The difference is that performance products or performance content that the user is likely to like are selected and presented to the user.

The product recommendation unit 260 recommends a performance product or performance content to the user using the user's past use history of the performance experience unit 100, that is, the past use history data stored in the history management unit 240. You can. Since the user's past usage history data includes information such as the user's preferred genre, artist, and performance format, analyzing this usage history data can help find customized performance products or performance content that the user may like.

The product recommendation unit 260 may recommend a customized performance product or performance content to the user using not only the usage history data but also the user's personal data. In order for the user to use the realistic experience providing system 10 according to an embodiment of the present invention, the user must go through a registration process, and at this time, the user can input information about the user's personal information, favorite performance genre, artist, etc. In this way, the user's personal data entered during the subscription process of the realistic providing system 10 is stored in the history management unit 240, and the product recommendation unit 260 analyzes the user's personal data stored in the history management unit 240 to provide customized performance. You can recommend products or performance content.

In addition, the product recommendation unit 260 not only uses data or information directly related to the user, but also uses data using the performance immersive unit 100 by users other than the user (other users) and personal unique data of other users. You can use it to recommend customized performance products or performance content to the user.

In the big data unit 250, usage data and personal unique data of many users who use the performance immersive unit 100 can be stored, converted into big data, and managed. Usage data may include information such as what genre, artist, and performance format each user has selected, and personal unique data may include information such as the user's gender, age, residence, and hobbies.

The product recommendation unit 260 analyzes other personal data stored in the big data unit 250 to extract other users with personal data similar to the user's personal data, and the extracted other users perform the performance. By analyzing usage data about the realistic unit 100, customized performance products or performance content to be recommended to the user can be presented.

In addition, the big data unit 250 may store and analyze data on the history of the user and other users using the performance immersive unit 100, reviews, comments, or evaluations of performance products or performance content, etc. The big data unit 250 can use the user's individual unique data for big data analysis in connection with the history management unit 240.

However, if the customized performance product or performance content presented in the product recommendation unit 260 is the same or similar to the performance product or performance content generated in the product creation unit 230, it is not recommended to the user. This is because the performance product or performance content to be recommended by the product recommendation unit 260 is the same as or similar to the performance product or performance content directly selected by the user through the product creation unit 230.

Meanwhile, the data stored in the history management unit 240 may be transferred to the big data unit 250 and managed as big data after a certain period of time has elapsed.

In addition, the operation server 200 stores and manages user reviews or feedback data on performance products or performance content generated by the product creation unit 230 and performance products or performance content recommended by the product recommendation unit 260. a feedback unit 270; and a product planning department (280) that uses data stored in the feedback department (270), history management department (240), or big data department (250) to plan and promote sales of performance products or performance content that are expected to be highly preferred by users. May include ;.

The feedback unit 270 may transmit the user's feedback data about the performance product or performance content that is virtually experienced using the performance immersion unit 100 to the performance product seller. The feedback unit 270 may transmit feedback data to the operator of the realistic experience providing system 10.

Through the feedback unit 270, the user can deliver feedback data including inconveniences felt while using the realistic performance unit 100, points for improvement, etc. to the performance product seller or the operator of the realistic performance providing system. Performance product sellers may use feedback data to develop performance products or performance content highly preferred by users, or may improve the marketability of performance products already being sold to include performance content preferred by users.

The feedback unit 270 of the operation server 200 may transmit the user's feedback data about the performance product or performance content that is virtually experienced by the performance immersion unit 100 to the performance product seller. The performance immersive unit 100 of the immersive experience providing system 10 according to an embodiment of the present invention can provide a virtual experience for a performance product that is already on sale or is scheduled to be sold. After a user has a virtual experience of a performance product, etc., the user can input feedback data including the advantages or disadvantages felt about the product he or she has selected into the feedback unit 270. The user inputs verbal feedback data into the feedback unit 270 through the microphone or headset 150 provided in the HMD device 110, or inputs feedback data into the feedback unit 270 through a personal terminal 130 such as the user's smartphone. ) can be entered.

Feedback data for each user input to the feedback unit 270 may be transmitted to the sales server 300 by the communication unit 291.

The operation server 200 of the realistic experience providing system 10 according to an embodiment of the present invention may include a product planning department 280, which may include a feedback department 270, a history management department 240, or Using the data stored in the big data unit 250, product sellers can be encouraged to plan and sell performance products or performance content that are expected to be highly preferred by users.

In other words, the product planning department 280 analyzes the reactions or feedback of users who use the performance immersive unit 100, derives products or content that are expected to be purchased by many people when planned and sold as performance products or performance content, and commercializes them. It can be induced to do so. For example, the user's evaluation of the performance experienced virtually through the performance immersion unit 100, the number of audiences for the virtual performance, etc. are investigated, and based on this, the artist's agency or performance agency is asked to commercialize the performance. It can be induced.

The product planning department 280 selects performance products or performance content that have a good response from users among performance products or performance content that can be virtually experienced through the performance immersion unit 100, and determines whether a performance similar to the selected performance product or performance content is possible. The agency of the artist judged to be an artist may be encouraged to plan performance products, or the performance agency may be encouraged to plan performance products.

Entertainment companies and performance product sellers can increase the success rate of product planning and sales because they can expect that performance products or performance content presented through the product planning department 280 will have high user preference.

The operation server 200 may include an additional service unit 298. The additional service unit 298 can provide users with virtual reality experiences other than virtual experiences such as performances. For example, the additional service unit 298 may provide a service that allows users to purchase artist's goods based on the metaverse or allows users to virtually experience the artist's daily manager. In this way, the additional service unit 298 can increase user satisfaction by providing services related to the user's favorite artist and encourage the user to continuously purchase performance products of the artist.

The operation server 200 may include a billing unit 296, which sets and charges fees incurred when a user virtually experiences a performance product or performance content. Additionally, the billing department 296 may charge a fee when a user purchases an artist's goods on the metaverse through the additional service department 298. In this way, the operating server 200 of the realistic experience providing system 10 according to an embodiment of the present invention can solve the costs related to performances or artists' copyrights to some extent by providing a billing unit 296.

Meanwhile, referring to FIGS. 1 and 4, the realistic experience providing system 10 according to an embodiment of the present invention includes a performance product or a product that develops and sells performance content in addition to the performance experience unit 100 and the operation server 200. It may include a sales server 300 provided to the seller.

The sales server 300 is a server provided on the side that plans, develops, and sells performance products that are virtually experienced by the performance immersion unit 100.

The sales server 300 includes a product sales unit 310, a feedback application unit 320, a promotion unit 330, an update unit 340, a data storage unit 350, a communication unit 360, a billing unit 370, It may include a copyright management department 380.

In more detail, the sales server 300 includes a product sales department 310 that develops performance products or performance content matching the performance products or performance content presented in the product planning department 280 and provides them to the operation server 200; a feedback application unit 320 that reflects the review or feedback data received from the feedback unit 270 to the performance product or performance content of the product sales unit 310; and the feedback application unit 320 provides purchase points to the user who provides reviews or feedback data reflected in the performance product or performance content, or provides compensation services including rewards to the user when the user purchases the performance product or performance content. It may include a promotion unit 330 that provides.

The performance immersive unit 100 of the immersive experience providing system 10 according to an embodiment of the present invention not only provides a virtual experience of the performance product or performance content desired or selected by the user, but also provides the performance product developer regardless of the user's selection. Virtual experiences of performance products or performance content provided by may also be provided. A performance product developer may promote or publicize a performance product he or she has developed through the performance immersive unit 100 of the immersive experience providing system 10 according to an embodiment of the present invention.

The product sales unit 310 of the sales server 300 may transmit information such as characteristics, advantages, schedules, and costs of its performance products, including the virtual performance experience of the performance immersive unit 100, to the operation server 200. . The operation server 200 may control the operation of the performance immersive unit 100 using performance product information received from the product sales department 310.

The feedback application unit 320 may reflect the feedback data received from the feedback unit 270 of the operation server 200 in improving its performance products. The sales server 300, which has received the user's feedback data, analyzes the feedback data, corrects any problems with its performance product, and adds user requests to its performance product to improve the marketability of its performance product. You can. In this way, the feedback data can be applied by the feedback application unit 320 to improve the marketability of the company's performance products, thereby encouraging users to select more of the company's performance products through the performance immersive unit 100.

The promotion unit 330 of the sales server 300 transmits the competitive advantage points of the performance product or performance content to the operation server 200, and induces users to select many of its performance products by the performance immersion unit 100. You can. The promotion unit 330 is a component that promotes the company's performance products so that they can be selected by users in the performance experience unit 100. The promotion unit 330 may induce the company's performance products to be frequently selected by the performance experience unit 100 in connection with the product sales unit 310 or the feedback application unit 320.

In addition, the promotion unit 330 provides feedback data on its performance product or performance content that is virtually experienced by the performance immersion unit 100, and when the feedback data is applied to product improvement, a compensation service can be provided to the user. . For example, a user who has virtually experienced the company's performance product in the performance immersive unit 100 provides feedback data that can be reflected in improving the marketability of the company's performance product, and this feedback data is used to improve the product by the feedback application unit 320. In this case, the promotion department 330 may provide purchase points to the user or provide compensation services including rewards when purchasing the company's performance products.

Referring to FIG. 4, the sales server 300 transmits it to the product sales department 310, the feedback application department 320, or the promotion department 330 when information about its performance products or compensation service information is updated. update unit 340; a data storage unit 350 that stores various information or data transmitted to the sales server 300; It may include a communication unit 360 that exchanges data with the operation server 200 or the performance immersive unit 100.

If the feedback data is applied to the company's performance product by the feedback application unit 320 and the information of the performance product is changed, the update unit 340 may store the information and transmit it to the product sales unit 310.

Meanwhile, when the performance product or performance content provided by the product sales department 310 is virtually experienced through the performance immersive unit 100, the sales server 300 is a billing department 370 that receives the fee for the virtually experienced performance product, etc. may include. The billing unit 370 of the sales server 300 may charge costs from the billing unit 296 of the operation server 200. That is, while the billing unit 296 of the operation server 200 charges fees from users, the billing unit 370 of the sales server 300 charges costs in the nature of performance product fees from the operation server 200. You can.

Additionally, the sales server 300 may include a copyright management unit 370 that manages copyrights for artists or works related to performance products or performance content provided to the performance immersive unit 100 by the product sales unit 310. there is.

Since the realistic experience system 10 according to an embodiment of the present invention provides a virtual experience of a copyrighted work, copyright issues regarding the copyrighted work may arise. In other words, unauthorized commercial use of a copyrighted work may constitute copyright infringement, and the realistic experience providing system 10 according to an embodiment of the present invention infringes copyright by providing the sales server 300 with a copyright management unit 380. You can prepare for problems.

Costs charged by the billing department 296 of the operation server 200 and the billing department 370 of the sales server 300 may include copyright fees. The copyright management department 380 may calculate a portion of the costs charged by the charging department 296,370 as copyright fees and pay it to the copyright holder.

Additionally, in the case of unauthorized virtual experience of a copyrighted work, the copyright management unit 380 may warn the user or the operator of the performance immersive unit 100 of the possibility of copyright infringement.

The system or device described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, devices and components described in embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), It may be implemented using one or more general-purpose or special-purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. A processing device may execute an operating system (OS) and one or more software applications that run on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include multiple processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used on any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed over networked computer systems and thus stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

As described above, the embodiments of the present invention have been described with specific details such as specific components and limited examples and drawings, but this is only provided to facilitate a more general understanding of the present invention, and the present invention is limited to the above embodiments. This does not mean that various modifications and variations can be made from this description by those skilled in the art. Accordingly, the spirit of the present invention should not be limited to the described embodiments, and the claims described below as well as all modifications that are equivalent or equivalent to the claims shall fall within the scope of the spirit of the present invention.

10: Virtual reality-based performance immersive system
100: Performance immersion unit 110: HMD device
120: hand motion controller 130: user terminal
140: Monitor 150: Headset
160: Acting module 170: Acting detection unit
180: Additional function unit 200: Operation server
210: Control unit 221: Genre selection unit
223: Artist selection section 225: Performance format selection section
230: Product creation department 240: History management department
250: Big data department 260: Product recommendation department
270: Feedback Department 280: Product Planning Department
300: Sales server 310: Product sales department
320: Feedback application department 330: Promotion department
370: Billing Department 380: Copyright Management Department

Claims (7)

A performance immersion unit that provides a realistic experience of an artist's performance based on virtual reality; and
An operating server that stores and executes performance content provided to the performance immersive unit and controls the operation of the performance immersive unit,
The operation server provides performance products selected by the user or recommends user-customized performance products through the performance immersion unit,
A virtual reality-based performance experience providing system, wherein the user-selected performance product and the user-customized recommended performance product include the artist's actual performance content or creative performance content based on the artist's actual performance content.
According to paragraph 1,
The operating server is,
A genre selection unit for selecting a genre or category of a performance for which the user wishes to experience a realistic experience;
An artist selection unit where the user selects an artist for whom he or she wishes to experience an immersive experience;
A performance format selection unit that selects the type of performance for which the user wishes to experience a realistic experience; and
It includes a product creation unit that generates performance content to be provided to the user using the selection results of the genre selection unit, the artist selection unit, and the performance format selection unit,
The product creation unit extracts video content, 3D content, and sound content from the genre selection unit, the artist selection unit, and the performance format selection unit to generate a performance product or performance content that the user wishes to experience realistically. A virtual reality-based performance immersive system.
According to paragraph 2,
The artist selection section,
A virtual reality-based performance immersive providing system characterized by selecting at least one of an active artist, an inactive or disbanded artist, or a deceased artist.
According to paragraph 3,
The operating server is,
a history management unit that stores and analyzes user personal data and history data of the user's use of the performance immersive unit;
a big data unit that stores and manages usage data and personal unique data for the performance immersive unit of users other than the user; and
It includes a product recommendation unit that recommends user-customized performance products or performance content using data from the history management unit and the big data unit,
The product recommendation unit analyzes the usage data and personal unique data of other users with the same or similar tendencies as the user's preference data reflected in the performance product or performance content generated in the product creation unit by the user's selection and matches the user. A virtual reality-based performance experience providing system that recommends customized performance products or performance content, but does not recommend performance products or performance content that are the same or similar to the performance product or performance content generated by the product creation unit.
According to paragraph 4,
The operating server is,
a feedback unit that stores and manages user reviews or feedback data on performance products or performance content generated in the product creation unit and performance products or performance content recommended in the product recommendation unit; and
A product planning unit that uses data stored in the feedback unit, the history management unit, or the big data unit to plan performance products or performance content that are expected to be highly preferred by users and induce sales; a virtual reality comprising a. A system that provides realistic performance experience.
According to any one of claims 1 to 5,
Includes a sales server provided to product sellers who develop and sell performance products or performance content,
The sales server is,
a product sales department that develops performance products or performance content matching the performance products or performance content presented by the product planning department and provides them to the operation server;
a feedback application unit that reflects reviews or feedback data received from the feedback unit to performance products or performance content of the product sales department; and
A promotion that provides purchase points to users who provide reviews or feedback data reflected in performance products or performance content by the feedback application department, or provides compensation services, including rewards, to users when the user purchases performance products or performance content. A virtual reality-based performance providing system comprising:
According to clause 6,
The sales server is,
A virtual reality-based performance experience providing system comprising a copyright management unit that manages copyrights for artists or works related to performance products or performance content provided to the performance experience unit by the product sales department.