KR102227998B1 - System for virtual reality karaoke and providing virtual reality karaoke using the same - Google Patents

Abstract

The present invention relates to a virtual reality karaoke system and a method for providing VR karaoke using the same.
According to the present invention, in a method for providing VR karaoke using a virtual reality karaoke system, the step of connecting a user wearing a head mounted display to a VR karaoke server through the head mounted display or a user terminal interlocked with the head mounted display, Receiving a mode selection from the user, the VR karaoke server receiving a request to create a virtual room from the user or receiving a request for admission to a previously created virtual room list, the virtual room is filled with a garden, or the chairman of the virtual room When instructing to proceed with a song, the VR karaoke server outputs lyrics, background images, and MR (Music Recorded) for a selected song through the head mounted display to a plurality of users entering the virtual room, the VR karaoke server And designating a song order of a plurality of users who have entered the virtual room according to the mode selected by the user, and displaying a song score when a song is ended from a plurality of users who have entered the virtual room. .

Description

Virtual reality karaoke system and VR karaoke provision method using it {SYSTEM FOR VIRTUAL REALITY KARAOKE AND PROVIDING VIRTUAL REALITY KARAOKE USING THE SAME}

The present invention relates to a virtual reality karaoke system and a method of providing VR karaoke using the same, and more particularly, a virtual reality karaoke system that enables a user wearing a head mounted display to sing together in a virtual space with another user, and the same. It relates to a method of providing VR karaoke using.

With the convergence of IT in various fields of society, a virtual experience service that allows users to experience various virtual information in the real world has begun to be provided.Many industries are seeking to discover next-generation IT business based on the current IT market led by smart terminals. This is the biggest challenge.

Among them, the technology that has attracted the most attention recently is Virtual Reality (VR) technology. With the recent rapid development of technologies such as high-resolution display, powerful computing power, and 3D sensing, virtual reality technology has created an environment that can provide a meaningful level of immersion and interaction for general users as related hardware costs have fallen significantly. done.

In addition, the industry related to games using VR has developed, which is expanding the market of more and more virtual reality contents.

In the case of a conventional virtual reality karaoke room, since users can use it only when VR equipment, sound facilities, and servers are equipped, there is an inconvenience in that a large number of users have to find and enter the virtual reality karaoke room together.

In addition, in order to use such a virtual reality karaoke room, it was necessary to pay a higher price than a general karaoke room.

Therefore, there is a need for a technology capable of using virtual reality karaoke freely regardless of location.

The technology behind the present invention is disclosed in Korean Patent Publication No. 10-2009-0090647 (published on Aug. 26, 2009).

The technical problem to be achieved by the present invention relates to a virtual reality karaoke system that enables a user wearing a head mounted display to sing together with other users in a virtual space, and a VR karaoke provision method using the same.

According to an embodiment of the present invention for achieving such a technical problem, in a VR karaoke provision method using a virtual reality karaoke system, a user wearing a head mounted display provides the head mounted display or a user terminal interlocked with the head mounted display. Accessing a VR karaoke server through a VR karaoke server, receiving a mode selection from the user, the VR karaoke server receiving a request to create a virtual room from the user, or receiving an entry request to a previously created virtual room list, to the virtual room When the garden is filled or the chairman of the virtual room instructs a song to proceed, the VR karaoke server provides lyrics, background images, and MR (Music Recorded) for the song selected through the head mounted display to a plurality of users entering the virtual room. Outputting, the VR karaoke server designating a song order of a plurality of users entering the virtual room according to a mode selected by the user, and when a song is ended from a plurality of users entering the virtual room And displaying the song score.

A song title, a virtual room name, and a number of people are displayed in the virtual room list, and a password may be set in the virtual room.

In the step of selecting the mode, any one of a general mode, a game mode, and a blind date mode may be selected.

The VR karaoke server analyzes pre-stored data of users entering the virtual room in the game mode or calculates the user's sound range using artificial intelligence, and uses the calculated sound range and the user's gender information to determine the selected song. You can allocate an appropriate section or part among them.

The VR karaoke server provides priority to sing a song to one of the users who enter the virtual room in the game mode, and if the pitch or beat of the corresponding user is wrong, the VR karaoke server can sing to the next user. You can make sure that the right you have is passed on.

In the blind date mode, the user inputs the song to be singed and the user's gender, and enters the user into a virtual room corresponding to the input condition among the previously created virtual rooms through an automatic matching function using the input information. , When there are a plurality of virtual rooms corresponding to the input condition, the user may be admitted to the first opened virtual room.

In the blind date mode, the VR karaoke server allocates an appropriate section or part from among the selected songs using pre-stored data of users entering the virtual room in the blind date mode, and when the song ends, the likelihood of the other party from the entered users You can receive input and request whether to register as a friend.

According to another embodiment of the present invention, in a virtual reality karaoke system for providing VR karaoke, a plurality of head mounted displays worn by a user for using a virtual reality karaoke system, and the head mounted display or the head mounted display And a VR karaoke server connected to a user terminal linked to a network, wherein the VR karaoke server includes a mode selection unit that receives a mode selection from the user, a virtual room request from the user, or a previously generated virtual room list When the virtual room management unit receives an entry request to the virtual room, when the virtual room is filled with a garden, or when the director of the virtual room instructs to proceed with a song, the VR karaoke server is selected through the head mounted display to a plurality of users entering the virtual room. An output unit that outputs lyrics, background images, and MR (Music Recorded) for a song, a control unit that designates the order of songs of a plurality of users who enter the virtual room according to the mode selected by the user, and enters the virtual room. And a score calculation unit that calculates a song score when a song is ended from a plurality of users and outputs it to the head mounted display.

As described above, according to the present invention, by using a head mounted display or a user terminal, a user can sing a song in real time with a friend or a lover in a remote place without regard to time and place, and various modes can be used to induce interest. have.

1 is a diagram showing a virtual reality karaoke system according to an embodiment of the present invention.
2 is a diagram showing the configuration of a virtual reality karaoke system according to an embodiment of the present invention.
3 is a view showing a state of a user wearing a head mounted display according to an embodiment of the present invention.
4 is a flow chart showing a VR karaoke provision method using a virtual reality karaoke system according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a certain part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

Then, with reference to the accompanying drawings, embodiments of the present invention will be described in detail so that those of ordinary skill in the art can easily implement the present invention.

1 is a view showing a virtual reality karaoke system according to an embodiment of the present invention, Figure 2 is a view showing the configuration of a virtual reality karaoke system according to an embodiment of the present invention, Figure 3 is a diagram according to an embodiment of the present invention This is a diagram showing a user wearing a head mounted display.

As shown in FIG. 1, the virtual reality karaoke system includes a VR karaoke server 100, a plurality of user terminals 200, and a plurality of head mounted displays 300.

In addition, the VR karaoke server 100, the plurality of user terminals 200, and the plurality of head mounted displays 300 are connected using wired or wireless networks, respectively.

Here, the VR karaoke server 100 includes a mode selection unit 110, a virtual room management unit 120, an output unit 130, a control unit 140, and a score calculation unit 150, as shown in FIG. 2.

First, the mode selection unit 110 receives a selection of any one of a general mode, a game mode, and a blind date mode from a user.

Next, the virtual room management unit 120 receives a request to create a virtual room from a user or displays a list of previously generated virtual rooms.

Here, a song title, a virtual room name, and the number of people are displayed in the virtual room list, and the user can set a password, song title, virtual room name, and number of people when creating a virtual room.

The output unit 130 fills the virtual room, or when the director of the virtual room instructs the progress of the song, the lyrics of the song selected through the head mounted display worn by a plurality of users entering the virtual room, background image and MR (Music) Recorded) is displayed.

Next, the controller 140 designates a section or part of a song selected by a plurality of users entering the virtual room according to the mode selected by the user.

Here, when the mode selected by the user is a game mode, the controller 140 analyzes pre-stored voice data of users entering the virtual room or calculates the user's sound range using artificial intelligence, and calculates the calculated sound range and the user's gender. The information is used to allocate an appropriate section or part among the selected songs.

In addition, the control unit 140 provides priority to sing a song to one of the users who have entered the virtual room first, and when the pitch or beat of the corresponding user is wrong, the control unit 140 sings the next part or section of the song to the next user. Change the authority to be able to.

Next, when the mode selected by the user is the blind date mode, the controller 140 receives the title of the song to be sung and the user's gender from users who want to enter the virtual room using the automatic matching function, and uses the input data. Automatically enter the virtual room. At this time, if a plurality of virtual rooms are configured under the same conditions, they enter the virtual room opened the earliest.

In addition, the control unit 140 allocates an appropriate section or part among the selected songs using pre-stored voice data of users entering the corresponding virtual room, and when the song ends, the control unit 140 You can input your preference and check whether you have registered as a friend.

Next, the score calculation unit 150 calculates a song score when the songs of a plurality of users entering the virtual room are finished and outputs the song score through the head mounted display 300.

Here, the score calculation unit 150 calculates a song score and a total song score of each individual entering the virtual room using artificial intelligence and AI.

Next, the user terminal 200 may be connected to the head mounted display 300 as shown in FIG. 1, and may access the VR karaoke server 100 through a network.

Next, the head mounted display 300 includes a headset 310 and a microphone 320 as shown in FIG. 3.

That is, the user can listen to music provided by the VR karaoke server 100 and songs sung by other users by using the headset 310 attached to the head mounted display 300.

In addition, the user can sing a song using the microphone 320 attached to the head mounted display 300 and can conduct a voice conversation with users who have entered the virtual room.

The user can access the VR karaoke server 100 using the user terminal 200 connected to the head mounted display 300, and when the head mounted display 300 includes an interface function, the user terminal 200 It is also possible to directly access the VR karaoke server 100 using the head mounted display 300 without going through.

Hereinafter, a method of providing a VR karaoke room using a virtual reality karaoke system according to an embodiment of the present invention will be described with reference to FIG. 4.

4 is a flow chart showing a VR karaoke provision method using a virtual reality karaoke system according to an embodiment of the present invention.

First, as shown in FIG. 4, the user accesses the VR karaoke server 100 using the user terminal 200 connected to the head mounted display 300 (S410).

In this case, as described above, when the head mounted display 300 is equipped with a user's motion recognition function and an interface function, the user may directly access the VR karaoke server 100 through the head mounted display 300.

That is, as shown in FIG. 3, the user connects to the VR karaoke server 100 through voice or gesture while wearing the head mounted display 300, or accesses the VR karaoke server 100 using the user terminal 200. You can connect.

Next, the user accessing the VR karaoke server 100 selects a mode (S420).

Here, the user can select any one of a general mode, a game mode, and a blind date mode.

First, when the user selects the game mode, the VR karaoke server 100 provides priority to sing to one of the users who enter the virtual room first, and when the user's pitch or beat is wrong, the following Authorizes the user to sing the next part or section of the song.

In addition, when the user selects the blind date mode, the user can enter the virtual room using a 1:1 matching function with the opposite sex.

In addition, when the user selects the normal mode, unlike the game mode and the blind date mode, a plurality of users entering the virtual room can freely sing songs.

Next, the user creates a virtual room corresponding to the selected mode or enters a previously created virtual room (S430).

In this case, the user may enter a virtual room created using the user terminal 200 or the head mounted display 300 or create a new virtual room.

In particular, when the user selects the blind date mode, the user can enter the virtual room that has already been created using the automatic matching function.

Here, to explain the automatic matching function of the blind date mode, when a user receives a song and a gender to be sung, the controller 140 corresponds to a virtual room that meets the input condition from among the virtual rooms that have been previously created using the input information. Enter the user.

Here, if a plurality of virtual rooms are created under the same conditions, the user enters the first virtual room opened.

Next, when the garden of the virtual room is filled or the host selects the start of the song, the output unit 130 outputs the lyrics, background image, and MR of the song through the head mounted display 300 worn by each user (S440). .

At this time, the output background image can be changed according to the currently playing song and the selected mode.

Here, the background image is a music video of a currently playing song, and when a music video does not exist, the output unit 130 may output various images according to the mood or genre of the song.

In particular, the output unit 130 may output a song sung by the original songwriter together with the MR by the user's selection.

In addition, the score calculation unit 150 calculates a score in real time while users are singing, and the output unit 130 outputs the score calculated in real time through the head mounted display 300.

Next, the VR karaoke server 100 designates a section or part of a song selected by a plurality of users entering the virtual room for each user (S450).

At this time, when the mode selected in step S420 is the game mode, the VR karaoke server 100 analyzes pre-stored voice data of users entering the virtual room or calculates the user's sound range using artificial intelligence, and calculates the calculated sound range and An appropriate section or part is allocated among the selected songs using the user's gender information.

For example, if there are 3 users entering the virtual room, and each user's pitch range is calculated as high, mid, and low, the high-pitched part of the selected song is a user in the high-pitched range, the middle is as a user in the mid-range, and the low-pitched tone. Is assigned to users in the low-pitched range.

In addition, in the game mode, priority to sing a song is provided to one of the users who enter the virtual room first, and if the pitch or beat of the corresponding user is wrong, the right to sing is transferred to the next user.

That is, in the game mode, if the user who previously sang a song is wrong in pitch or beat, the authority is changed so that the next user can sing the song, and the voice output of the user singing the song in the previous part is blocked.

In addition, even when the blind date mode is selected by the user, as in the game mode, sections or parts of the users' songs are allocated based on the user's voice range and gender.

Next, when the song is finished, the VR karaoke server 100 calculates and outputs a song score (S460).

At this time, the score calculation unit 150 calculates the individual scores, total scores, and personal rankings of each user entering the virtual room, and the score calculation unit 150 calculates the scores calculated through the head mounted display 300, respectively. Provides to the user.

In addition, when the songs of users entering the blind date mode are ended, the control unit 140 receives the likeness of the other party from the entered users and requests whether or not to register a friend.

Here, when the user inputs the likelihood of the other party using the user terminal 200 or the head mounted display 300, the inputted likelihood is transmitted to the other party.

As described above, according to an embodiment of the present invention, by using a head mounted display or a user terminal, a user can sing a song with a friend or a lover in a remote place in real time without regard to time and place, and various modes are used to generate interest. Can be triggered.

Although the present invention has been described with reference to the embodiments shown in the drawings, this is only exemplary, and those of ordinary skill in the art will understand that various modifications and equivalent other embodiments are possible therefrom. Therefore, the true technical protection scope of the present invention should be determined by the technical spirit of the appended claims.

100: VR karaoke server, 110: mode selection unit,
120: virtual room management unit, 130: output unit,
140: control unit, 150: score calculation unit,
200: user terminal, 300: head mounted display,
310: headset, 320: microphone

Claims (14)

In the VR karaoke provision method using a virtual reality karaoke system,
Accessing a VR karaoke server through the head mounted display or a user terminal linked to the head mounted display by a user wearing a head mounted display,
Receiving a mode selection from the user,
The VR karaoke server receiving a request to create a virtual room from the user or receiving a request for admission to a previously created virtual room list,
When a garden is filled in the virtual room, or when the director of the virtual room instructs a song to proceed, the VR karaoke server provides lyrics, background images, and MR for the song selected through the head mounted display to a plurality of users entering the virtual room. Steps to output (Music Recorded),
The VR karaoke server designating a song order of a plurality of users entering the virtual room according to the mode selected by the user, and
Including the step of displaying a song score when a song is ended from a plurality of users entering the virtual room,
The VR karaoke server,
In the game mode, pre-stored voice data of users entering the virtual room is analyzed or the user's sound range is calculated using artificial intelligence, and an appropriate section or part of the selected song is selected using the calculated sound range and the user's gender information. How to provide a VR karaoke room allocated. The method of claim 1,
The song title, virtual room name, and number of people are displayed in the virtual room list,
A method of providing a VR karaoke room in which a password is set in the virtual room. The method of claim 1,
The step of receiving the selection of the mode,
A method of providing VR karaoke in which you can choose any one of normal mode, game mode, and blind date mode. delete The method of claim 3,
The VR karaoke server,
In the game mode, providing priority to sing a song to one of the users who entered the virtual room first,
A VR karaoke provision method that allows the next user to be given the right to sing if the user's pitch or beat is wrong. The method of claim 3,
The VR karaoke server,
In the blind date mode, the user inputs the song to be singed and the user's gender, and enters the user into a virtual room corresponding to the input condition among the previously created virtual rooms through an automatic matching function using the input information. ,
When there are a plurality of virtual rooms corresponding to the input condition, the VR karaoke providing method in which the user enters the first opened virtual room. The method of claim 6,
The VR karaoke server,
In the blind date mode, an appropriate section or part is allocated from the selected songs using pre-stored data of users entering the virtual room,
When the song is ended, a method for providing a VR karaoke room for receiving a friend's preference from the entered users and requesting whether to register a friend. In a virtual reality karaoke system for providing VR karaoke,
A plurality of head mounted displays worn by users to use a virtual reality karaoke system, and
A VR karaoke server connected to the head mounted display or a user terminal linked to the head mounted display through a network,
The VR karaoke server,
A mode selection unit that receives a mode selection from the user,
A virtual room management unit that receives a request to create a virtual room from the user or receives a request for admission to a previously created virtual room list,
When a garden is filled in the virtual room, or when the director of the virtual room instructs a song to proceed, the VR karaoke server provides lyrics, background images, and MR for the song selected through the head mounted display to a plurality of users entering the virtual room. Output to output (Music Recorded),
A control unit that designates a song order of a plurality of users who have entered the virtual room according to the mode selected by the user, and
When a song is ended from a plurality of users entering the virtual room, a score calculation unit for calculating a song score and outputting it to the head mounted display,
The control unit,
In the game mode, pre-stored voice data of users entering the virtual room is analyzed or the user's sound range is calculated using artificial intelligence, and an appropriate section or part of the selected song is selected using the calculated sound range and the user's gender information. Virtual reality karaoke system to be assigned. The method of claim 8,
The song title, virtual room name, and number of people are displayed in the virtual room list,
A virtual reality karaoke system in which a password can be set in the virtual room. The method of claim 8,
The mode selection unit,
A virtual reality karaoke system that provides any one of a normal mode, a game mode, and a blind date mode. delete The method of claim 10,
The control unit,
In the game mode, providing priority to sing a song to one of the users who entered the virtual room first,
If the user's pitch or beat is wrong, a virtual reality karaoke system that allows the next user to sing the right to sing. The method of claim 10,
The control unit,
In the blind date mode, the user inputs the song to be singed and the user's gender, and enters the user into a virtual room corresponding to the input condition among the previously created virtual rooms through an automatic matching function using the input information. ,
When there are a plurality of virtual rooms corresponding to the input condition, a virtual reality karaoke system for entering the user into the first opened virtual room. The method of claim 13,
The control unit,
In the blind date mode, an appropriate section or part is allocated from the selected songs using pre-stored data of users entering the virtual room,
When the song is ended, a virtual reality karaoke system that receives a friend's preference from the entered users and requests whether to register a friend.

Images