KR20230078204A - Method for providing a service of metaverse based on based on hallyu contents - Google Patents

Abstract

The present invention includes the steps of collecting Korean Wave contents in a metaverse service providing device and storing them in a collection database, recruiting participants for an online fan meeting service for the Korean Wave contents in the metaverse service providing device, and Creating a first layer in which virtual or augmented reality is implemented based on the Korean Wave content in a bus service providing device and storing it in the database for collection, and in the metabus service providing device, a participant side device and the entertainer side device Generating a second layer based on the avatars of participants and virtual characters of entertainers as connected, generating content for the metaverse by merging the second layer with the first layer, and content for the metaverse It is possible to provide a method of providing a metaverse service based on Korean Wave content, including servicing the participant-side device and the entertainer-side device.

Description

Method for providing a service of metaverse based on hallyu contents}

The present invention relates to a method for providing a metaverse service based on Hallyu contents.

Hallyu refers to the phenomenon in which Korean pop culture gained popular popularity, especially in Asia, as Korean television dramas were exported to China in 1996 and popular songs became known two years later. After 2000, not only popular culture such as dramas, songs, and movies, but also preference for Korea-related products such as kimchi, gochujang, ramen, and home appliances appeared. In a comprehensive sense, all these phenomena are referred to as the Korean Wave.

Thanks to the popularity of the Korean Wave, until recently, popular celebrities have been promoting themselves by holding fan meetings through overseas performances.

However, in the recent pandemic situation, it is almost impossible to publicize themselves or Korean Wave content because overseas performances themselves are difficult.

On the other hand, according to the recent rapid development of IT technology, various types of services are possible using wired and wireless networks.

In particular, services such as virtual and augmented reality are being activated to create a non-face-to-face environment in a pandemic situation.

Augmented Reality is a technology that creates a new environment by combining a real world that a user sees with eyes and a virtual world having additional information. Since the late 1990s, research and development of virtual reality systems that combine real and virtual environments have been conducted mainly in the United States and Japan. Virtual reality, a concept that supplements the real world with the virtual world, uses a virtual environment created by computer graphics, but the main character is the real environment. Computer graphics play a role in providing additional information necessary for the real environment. Virtual reality technology makes users immersed in a virtual environment so that they cannot see the real environment. However, virtual reality technology in which a real environment and virtual objects are mixed provides a better sense of reality by enabling users to see the real environment.

On the other hand, according to the recent policy stance of the government, the government attaches great importance to the openness and sharing of information, and provides various types of public data free of charge. In addition, due to the proliferation of smartphones and social network services (SNS), general users play the role of prosumers who participate in the creation as well as the use of information, and a tremendous amount of various data is being produced at a rapid pace.

According to the diversification of such data, research and development are being conducted in various ways to improve the quality of virtual reality content services.

Korean Registered Patent No. 10-1879586 (registered on July 12, 2018)

The present invention provides a method for providing a metaverse service based on Korean wave content that can activate an online fan meeting service by implementing a metaverse environment based on Korean wave content and providing an online fan meeting service through this.

In addition, the present invention minimizes network delay when servicing content for metaverse by creating a first layer necessary for implementing virtual and augmented reality for scenes of Korean wave content and then implementing a metaverse environment for online fan meetings based on this. Provides a method for providing metaverse services that can be

As a technical means for achieving the above technical problem, a method for providing a metaverse service based on Korean content according to an embodiment of the present invention includes the steps of collecting Korean content in a metaverse service providing device and storing it in a collection database; Recruiting participants for an online fan meeting service for the Korean wave content in a metaverse service providing device, and generating a first layer in which virtual or augmented reality is implemented based on the Korean wave content in the metaverse service providing device storing in the database for collection; generating a second layer based on the participant's avatar and the celebrity's virtual character as the participant's device and the entertainer's device are connected to the metaverse service providing device; It may include generating contents for the metaverse by merging the second layer with the first layer, and servicing the contents for the metaverse to the participant-side device and the entertainer-side device.

According to an embodiment of the present invention, in the step of recruiting participants, a first interface for selecting an avatar and a second interface for selecting a scene in the drama when the Korean Wave content is a drama may be provided to the participant's device. there is.

According to an embodiment of the present invention, the step of generating the second layer is based on the virtual character generated based on the image of the avatar selected through the first interface and the character in the drama in which the entertainer appeared. layers can be created.

According to an embodiment of the present invention, the metaverse service providing method may further include receiving entertainer-side control information from the entertainer-side device, and reflecting the entertainer-side control information on the contents for the metaverse. there is.

According to an embodiment of the present invention, the step of recruiting the participants obtains nationality information of the participants, and the step of providing the service generates dubbing data for the voice part of the entertainer based on the nationality information of the participants. The contents for the metaverse to which the dubbing data is reflected can be provided to the device of the participant.

According to an embodiment of the present invention, the dubbing data may be generated based on previously stored voice data of the entertainer.

According to the above-described embodiment of the present invention, the online fan meeting service can be activated by implementing the metaverse environment based on Korean Wave content and providing the online fan meeting service through this.

In addition, according to the above-described embodiment of the present invention, after creating the first layer necessary for implementing virtual and augmented reality for the scene of Korean wave content, based on this, a metaverse environment for online fan meeting is implemented, so that the metaverse It is possible to minimize network delay during content service.

1 is a diagram showing the configuration of a metaverse service providing system based on Hallyu contents according to an embodiment of the present invention.
2 is a block diagram showing the detailed configuration of a metaverse service providing platform in a metaverse service providing system based on Korean Wave contents according to an embodiment of the present invention.
3 is a flowchart illustrating a process in which a metaverse service providing platform based on Korean Wave contents according to an embodiment of the present invention generates and provides contents for the metaverse.

Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. The detailed descriptions that follow are provided to provide a comprehensive understanding of the methods, devices and/or systems described herein. However, this is only an example and the present invention is not limited thereto.

In describing the embodiments of the present invention, if it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted. In addition, terms to be described later are terms defined in consideration of functions in the present invention, which may vary according to the intention or custom of a user or operator. Therefore, the definition should be made based on the contents throughout this specification. Terminology used in the detailed description is only for describing the embodiments of the present invention and should in no way be limiting. Unless expressly used otherwise, singular forms of expression include plural forms. In this description, expressions such as "comprising" or "comprising" are intended to indicate any characteristic, number, step, operation, element, portion or combination thereof, one or more other than those described. It should not be construed to exclude the existence or possibility of any other feature, number, step, operation, element, part or combination thereof.

Hereinafter, a metaverse service providing system and method based on Hallyu contents according to an embodiment of the present invention will be described with reference to the accompanying drawings.

1 is a diagram showing the configuration of a metaverse service providing system based on Korean Wave contents according to an embodiment of the present invention, and FIG. 2 is a metaverse service in a metaverse service providing system based on Korean Wave contents according to an embodiment of the present invention. It is a block diagram showing the detailed configuration of the provision platform.

As shown in FIG. 1, the metaverse service providing platform 100 may be a computing device capable of providing various services based on Hallyu contents by being connected to a plurality of participant-side devices 10 through a wired or wireless network. there is.

To this end, the metaverse service providing platform 100 according to an embodiment of the present invention collects Korean Wave contents, stores them in a collection database 112, and manages them. A recruitment server 120 that interworks with the participant's device 10 to recruit participants who want to participate, a layer creation server 140 that creates a first layer based on Korean Wave content and stores it in the collection database 112, and In the first layer, content for the metaverse is created by reflecting the avatar image of the participant of the participant's device 10, the character corresponding to the virtual character or real image of the celebrity in the Korean Wave content, and then the participant's device 10 It may include a service providing server 150 providing services to.

If the Korean Wave content is a drama, the collection server 110 collects making video data including drama filming videos including NG cuts, celebrity (actor) current status videos, etc., mini-concert of singers who sang the drama OSTs, and videos sung by the lead actors of the dramas as OSTs. OST video data (hereinafter, referred to as 'Musiccon data') including the like may be collected.

The recruitment server 120 may provide the participant's device 10 with an interface capable of setting various settings when participating in a service through interworking with the participant's device 10, for example, an interface capable of setting a nationality. Accordingly, the recruitment server 120 may store and manage information set through the interface (hereinafter referred to as 'participant setting information') in the participant database 122 .

In addition, when the Korean Wave content is a drama, the recruitment server 120 provides an interface through which participants in the Korean Wave content can select a desired scene, and sets the selected scene as participant setting information and stores it in the participant database 122. .

The layer creation server 140 may create a first layer based on a specific scene or a scene selected by a participant, store it in the database 112 for collection, and manage the first layer.

The service providing server 150 is to provide various online fan meeting services based on Hallyu contents, and the participant side device 10 and celebrity side device 20 are connected through a network to participate in the online fan meeting service. After creating the second layer using the avatar image for the participant and the character corresponding to the virtual character or real image of the celebrity, the content for the metaverse is created by merging the second layer and the first layer, and the device on the participant's side (10 ) can be served. Accordingly, the user can connect the augmented reality device or the virtual reality device to the smartphone, which is the participant's device 10, to receive the content for the metaverse. Here, the augmented reality device or virtual reality device may include a Head Mounted Display (HMD), a Head-Up Display (HUD), and the like.

Meanwhile, the service providing server 150 may generate dubbing data for the audio part in the real video using the nationality of the participant setting information, and then generate a real video dubbed with the dubbing data.

In an embodiment of the present invention, dubbing data may be generated through a TTS (Text To Speech) program, that is, it may be generated by converting a voice part into text and then converting the text using the voice of a corresponding celebrity.

Meanwhile, the service providing server 150 may provide a talk service while servicing actual video or contents for the metaverse. Specifically, the service providing server 150 provides a chatting interface capable of chatting to the participant's device 10, collects questions of participants input through the chatting interface, and then sends a voice for the best question among the questions. It can be reproduced on the entertainer side device 20 or displayed on the entertainer display 40.

In addition, the service providing server 150 may arbitrarily select and control an audio function of a participant selected from among participants, so that a participant selected during the talk service may ask a question. Specifically, the service providing server 150 selects at least one participant through monitoring of the participants, and controls to activate the audio function of the device 10 of the selected participant, so that the at least one selected participant You can enable them to participate in the talk service.

In addition, the service providing server 150 provides the participant device 10 with a control interface capable of controlling the avatar set as participant setting information, and controls the operation of the avatar in the contents for the metaverse based on the operation information through the control interface. You can control it.

In addition, the service providing server 150 controls a virtual character corresponding to an entertainer or a character corresponding to a real image according to the entertainer-side control information received from the entertainer-side device 20, or transfers the entertainer-side control information to contents for the metaverse. can reflect

The process of operating the metaverse service providing system based on Hallyu contents having the above configuration will be described with reference to FIGS. 3 and 4 .

3 is a flowchart illustrating a process in which a metaverse service providing platform based on Korean Wave content according to an embodiment of the present invention creates and provides content for the metaverse.

As shown in FIG. 3, the metaverse service providing platform 100 collects Hallyu contents and stores them in the collection database 112 (S300).

Then, the metaverse service providing platform 100 recruits participants for an online fan meeting service for Korean Wave content (S302). Specifically, the metaverse service providing platform 100 may recruit participants by sending an invitation message, for example, a push notification message to a plurality of participant-side devices 10 or by posting an online fan meeting event on a predetermined bulletin board. At this time, the metaverse service providing platform 100 provides an interface for setting participant setting information, and may store the participant setting information set through the interface in the participant database 122.

In particular, in the embodiment of the present invention, if the Korean wave content is a drama, the metaverse service providing platform 100 may provide an interface for selecting a specific scene in the drama to the participant's device 10 or post it on the bulletin board.

Thereafter, the metaverse service providing platform 100 creates a first layer for generating content for the metaverse based on a specific scene in the Korean Wave content stored in the database 112 for collection and stores it in the database 112 for collection ( S304). Here, the first layer may be for providing an augmented reality or virtual reality service using a specific scene as a real image.

In addition, when there are at least two specific scenes, the metaverse service providing platform 100 may create each layer for augmented reality or virtual reality for each specific scene.

Then, when the online meeting service point is reached, that is, as the participant-side device 10 and the entertainer-side device 20 access the metaverse service providing platform 100 through the network (S306), the metaverse service providing platform 100 ) Is provided based on the image of the participant's avatar according to the participation of the plurality of participant-side devices 10 and the celebrity-side device 20 and the actual image (or virtual character) of the entertainers who want to participate in the online meeting event. After creating the two layers in real time (S308), the second layer is combined with the first layer to create contents for the metaverse, and the created contents for the metaverse can be served to the device 10 of the participant (S310). . Specifically, the metaverse service providing platform 100 merges the second layer generated based on the participant's avatar and the celebrity's virtual character (which may be a character corresponding to the actual image) into the first layer to provide content for the metaverse. can create

Then, as the entertainer side control information is received from the entertainer side device 20 (S312), the metaverse service providing platform 100 reflects the entertainer side control information to the content for the metaverse (S314). For example, the entertainer-side control information may be voice data for a specific line, video data introducing the celebrity's recent situation, data related to the OST performance of the celebrity in a drama, and the like.

Here, when voice data for a specific line is received as entertainer-side control information, the metaverse service providing platform 100 performs an operation for a specific line by a real image or virtual character corresponding to the celebrity in the content for the metaverse. In addition, by outputting voice data, the entertainer side control information can be reflected in the content for the metaverse.

In addition, when the video data is received as entertainer side control information, the metaverse service providing platform 100 creates a third layer using the video data in the contents for the metaverse and merges it with the first layer to create the contents for the metaverse. It is possible to generate and provide service to the device 10 of the participant.

In addition, when data related to OST performance is received as entertainer-side control information, the metaverse service providing platform 100 creates a fourth layer for the OST performance part in the metaverse content and merges it with the first layer to Content for the metaverse can be created and serviced to the device 10 of the participant.

On the other hand, it is possible to provide a talk service that conducts an online fan meeting service, that is, the metaverse service providing platform 100 activates the audio part of a plurality of participant-side devices 10 and entertainer-side devices 20 to communicate with participants. A conversation service between entertainers may be provided (S314).

According to the embodiment of the present invention as described above, although it has been described as an example of selecting a specific scene in the metaverse service providing platform 100, a specific scene can be selected in the drama in the metaverse service providing platform 100 A first layer may be created based on a specific scene selected through the interface after providing the present interface to the device 10 of the participant.

Meanwhile, a first layer for each of a plurality of scenes in Korean Wave content may be created. In this case, the participant's device 10 is provided with an interface for selecting a scene that the participant wants to participate in, and content for the metaverse is generated by merging the first layer and the second layer corresponding to the scene selected through the interface. After that, it may be serviced to the device 10 on the participant's side.

4 is a flowchart illustrating a process in which a metaverse service providing platform based on Hallyu contents according to another embodiment of the present invention generates and provides contents for the metaverse.

As shown in FIG. 4, the metaverse service providing platform 100 based on Hallyu contents according to another embodiment of the present invention is for generating contents for the metaverse, making through a plurality of cameras (not shown). Stage images that provide online fan meeting services consisting of Making Con, Music Con, and Talk Con are collected and stored in the database 112 for collection (S400). Here, the metaverse service providing platform plays online making video data, including drama shooting videos including NG cuts, celebrity (actor) current status videos, etc. through a plurality of displays (not shown) arranged on the stage. It provides a fan meeting service, collects making-con data by filming it with multiple cameras, collects music-con data by filming the mini-concert of a singer who sang a drama OST implemented on stage, Talk-Con data can be collected by filming the progress of an online talk service with fans on the platform.

In the process of providing such an online fan meeting service, the metaverse service providing platform 100 checks the reaction of the participants who participated in the online fan meeting for each field, that is, Making Con, Music Con, and Talk Con (S402). Specifically, the metaverse service providing device 100 receives an evaluation score for the online fan meeting service from the device 10 of the participant whenever the online fan meeting service for each field ends, and checks the reaction of the participants or It is possible to check the degree of reaction of the participants by checking the access status of the participants.

Thereafter, the metaverse service providing platform 100 creates a first layer for generating content for the metaverse based on the data collected in the process for each field and stores it in the database 112 for collection (S404). Specifically, the metaverse service providing platform 100 may create a first layer for Making Con, Music Con, and Talk Con based on the collected data and store it in the database 112 for collection.

Then, the metaverse service providing platform 100 creates and provides metaverse content in which the metaverse space corresponding to the virtual space of each field is implemented based on the first layer for each field (S406). At this time, the metaverse service providing platform 100 selects one of the fields based on the responsiveness of the participants to create a first layer, or selects any one of the first layers to create and provide metaverse content. .

The above description of the present application is for illustrative purposes, and those skilled in the art will understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present application. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts thereof should be construed as being included in the scope of the present application. .

10: Participant side device
20: Celebrity side device
100: Metabus service providing platform
110: collection server
120: recruitment server
140: layer creation server
150: service providing server

Claims (6)

Collecting Hallyu contents from a metaverse service providing device and storing them in a database for collection;
Recruiting participants for an online fan meeting service for the Korean wave content in the metaverse service providing device;
Generating a first layer in which virtual or augmented reality is implemented based on the Korean Wave content in the metaverse service providing device and storing it in the database for collection;
Generating a second layer based on the participant's avatar and the celebrity's virtual character as the participant's device and the entertainer's device are connected to the metaverse service providing device;
Generating contents for a metaverse by merging the second layer with the first layer;
A method of providing a metaverse service based on Korean Wave content, comprising servicing the contents for the metaverse to the participant-side device and the celebrity-side device.
According to claim 1,
The step of recruiting the participants is,
A method for providing a Korean Wave content-based metaverse service providing a first interface for selecting an avatar and a second interface for selecting a scene in a drama when the Korean Wave content is a drama.
According to claim 2,
Creating the second layer,
A method for providing a metaverse service based on Hallyu contents, wherein the second layer is created based on an image of an avatar selected through the first interface and a virtual character generated based on a character in a drama in which the celebrity appears.
According to claim 1,
The metabus service providing method,
Receiving entertainer side control information from the entertainer side device;
A method of providing a metaverse service based on Korean wave content, further comprising the step of reflecting the entertainer side control information to the metaverse content.
According to claim 1,
The step of recruiting the participants is,
Obtain nationality information of the participant;
The service step is
A method of providing a metaverse service based on Korean Wave content, in which dubbing data for the voice part of the entertainer is generated based on the nationality information of the participant, and then the contents for the metaverse in which the dubbing data is reflected are serviced to the participant's device.
According to claim 5,
The dubbing data is a method for providing a metaverse service based on Hallyu content that is generated based on the voice data of the celebrity set in advance.

Images