KR102296434B1 - Method for providing customized music station by using virtual reality technology, and server using the same - Google Patents

Abstract

The present invention relates to a method for providing a customized music station using virtual reality technology and a server using the same. According to the present invention, with reference to a database recording at least one of reference pitch information and reference time information for music content, at least one of actual pitch information and actual time information included in an audio component generated by a user is Comparing the degree of similarity with at least one of the reference pitch information and the reference time signature information of the music content in real time, (i) when it is sensed that the time period for which the degree of similarity is equal to or greater than a first predetermined threshold continues for a first predetermined time , support to provide at least one of video and audio for the first action mode through an avatar corresponding to at least some of the virtual judges and spectators, and (ii) the time when the degree of similarity is less than or equal to a preset second threshold is 2 A method, apparatus, and computer reading comprising providing at least one of an image and an audio for a second action mode through an avatar corresponding to at least some of the virtual judges and the audience when it is sensed that the second action mode lasts for a predetermined time It relates to possible recording media.

Description

A method for providing a customized music station using virtual reality technology and a server using the same

The present invention relates to a method for providing a customized music station using virtual reality technology and a server using the same, and more particularly, to a database recording at least one of reference pitch information and reference time signature information for music content. For reference, at least one of the actual pitch information and the actual time information included in the audio component generated by the user is compared in real time to a similar degree to at least one of the reference pitch information and the reference time information of the music content, (i) When it is sensed that the time period for which the degree of similarity is equal to or greater than the first threshold value continues for a first predetermined time, video and audio for the first action mode through an avatar corresponding to at least a portion of the virtual judges and the audience and (ii) when it is sensed that the second predetermined period of time for which the degree of similarity is less than or equal to a second preset threshold is detected, an avatar corresponding to at least some of the virtual judges and the audience is selected. It relates to a method comprising providing at least one of an image and an audio for a second action mode through a method, and a server using the same.

Virtual reality refers to a specific environment or situation or the technology itself that is similar to reality created by artificial technology using a computer, etc., but is not real. At this time, the created virtual environment or situation stimulates the user's five senses and experiences a spatial and temporal experience similar to the real one, allowing the user to freely enter and exit the boundary between reality and imagination.

The virtual reality market started to grow rapidly after 2015, and currently, various services are provided using virtual reality technology in many fields. For reference, the global virtual reality market, which was worth 4 billion dollars in 2016, is expected to grow to 150 billion dollars by 2020. In addition, Korea is currently a 1 trillion won market, but it is expected to grow to 6 trillion won in 2020.

Meanwhile, the current karaoke market is gradually declining. Specifically, in the early stage of karaoke in the 1990s, several people visited and enjoyed karaoke together, but in the mid-stage of karaoke in the 2000s, they sang alone in a coin karaoke room, and recently it has changed to enjoying singing at home through mobile devices. became In other words, the karaoke market is also changing in line with the trend of personalized culture.

In accordance with these changes in the karaoke market, karaoke contents are also developing in a direction in which the song they are singing and the video they are watching are integrated to give a higher sense of immersion when the user sings, and furthermore, based on virtual reality technology, There is a need for optimized content that can maximize auditory satisfaction.

In addition, according to Korea Patent Application Laid-Open No. 2008-0106676, although contents related to a VR karaoke service system and method were searched, it was simply related to a karaoke service using virtual reality technology, and in reality it was difficult to satisfy various needs of users.

Accordingly, the present inventor refers to a database in which reference pitch information and reference time information for music contents are recorded, and at least one of actual pitch information and actual time information included in an audio component generated by a user is the music contents. The degree of similarity with at least one of the reference pitch information and the reference time information of We would like to propose a method for providing at least one.

An object of the present invention is to solve the above problems.

Specifically, the present invention compares in real time the similarity between the user's actual pitch information and real time information and the reference pitch information and reference time information of the music content using virtual reality technology, and at least some of the virtual judges and the audience Another object of the present invention is to provide at least one of an image and an audio for the first action mode or the second action mode through an avatar corresponding to .

In addition, the present invention compares in real time the harmonious degree of the user's actual pitch information and real time information with the collaboration pitch information and the collaboration time information of the virtual collaboration avatar using virtual reality technology, and among virtual judges and spectators, Another object of the present invention is to provide at least one of an image and an audio for the first action mode or the second action mode through an avatar corresponding to at least a portion.

In order to achieve the object of the present invention as described above and to realize the characteristic effects of the present invention to be described later, the characteristic configuration of the present invention is as follows.

According to an aspect of the present invention, there is provided a method for providing a customized music station using virtual reality technology. providing or assisting to provide music content, and obtaining an audio component generated by the user in accordance with the music content; (b) the server, with reference to a database recording at least one of reference pitch information and reference time signature information for the music content, actual pitch information and actual time signature included in the audio component generated by the user comparing in real time a degree to which at least one piece of information is similar to at least one of the reference pitch information and the reference time signature information of the music content; and (c) the server, including at least one of the actual pitch information and the actual time information included in the audio component generated by the user, with at least one of the reference pitch information and the reference time information of the music content In comparison, (i) when it is sensed that the period for which the degree of similarity is equal to or greater than the first threshold value continues for a first predetermined time, an image for the first action mode through an avatar corresponding to at least some of the virtual judges and the audience and voice; (ii) when it is sensed that the time for which the degree of similarity is equal to or less than a second preset threshold continues for a second predetermined time, corresponding to at least some of the virtual judges and the audience. A method comprising: providing at least one of an image and an audio for the second action mode through the avatar is provided.

According to another aspect of the present invention, there is provided a server for providing a customized music station using virtual reality technology, comprising: a communication unit communicating with a display unit for providing virtual reality to a user; and (1) when information for using the music station is input from the user, providing or supporting the provision of music content corresponding to the input information, and providing an audio component generated by the user in accordance with the music content the process of obtaining; (2) at least one of actual pitch information and actual time information included in the audio component generated by the user with reference to a database recording at least one of reference pitch information and reference time information for the music content a process of comparing the degree of similarity with at least one of the reference pitch information and the reference time signature information of the music content in real time; and (3) comparing at least one of the actual pitch information and the actual time information included in the audio component generated by the user with at least one of the reference pitch information and the reference time information of the music content (i) ) When it is sensed that the time for which the degree of similarity is equal to or greater than the first predetermined threshold continues for the first predetermined time, at least one of video and audio for the first action mode through an avatar corresponding to at least some of the virtual judges and the audience and (ii) if it is sensed that the second predetermined period of time for which the degree of similarity is less than or equal to a second preset threshold is detected, the selection is made through an avatar corresponding to at least some of the virtual judges and the audience. A server comprising: a processor for performing a process of providing at least one of an image and an audio for two action modes is provided.

According to the present invention, by using virtual reality technology, the user's actual pitch information and real time information and the degree of similarity between the reference pitch information and the reference time information of the music content are compared in real time to at least some of the virtual judges and the audience. By providing at least one of video and audio for the first action mode or the second action mode through the corresponding avatar, the user can feel as if he or she can sing in front of judges and audiences and exchange realistic interactions between the two parties. can give

In addition, the present invention compares in real time the harmonious degree of the user's actual pitch information and real time information with the collaboration pitch information and the collaboration time information of the virtual collaboration avatar using virtual reality technology, and among virtual judges and spectators, By providing at least one of an image and an audio for the first action mode or the second action mode through an avatar corresponding to at least a portion, the user may feel as if they are singing with a singer whom they have admired.

The accompanying drawings for use in the description of the embodiments of the present invention are only a part of the embodiments of the present invention, and to those of ordinary skill in the art to which the present invention pertains (hereinafter referred to as "a person skilled in the art") Other drawings may be obtained based on these drawings without any inventive work in the present invention.
1 is a diagram illustrating a server capable of providing a customized music station using virtual reality technology according to the present invention.
2 is a diagram illustrating a configuration for providing a customized music station using virtual reality technology according to an embodiment of the present invention.
3 is a diagram illustrating examples of a first action mode and a second action mode according to an embodiment of the present invention.
4 is a diagram illustrating an example of a screen for singing a duet together with a virtual collaboration avatar according to another embodiment of the present invention.
5 is a diagram illustrating an example of a screen for selecting a musical instrument to learn, practicing a playing method according to a guide of a player, and enjoying an ensemble together according to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following detailed description of the present invention refers to the accompanying drawings, which show by way of illustration a specific embodiment in which the present invention may be practiced, in order to clarify the objects, technical solutions and advantages of the present invention. These embodiments are described in sufficient detail to enable those skilled in the art to practice the present invention.

Also, throughout this description and claims, the word 'comprise' and variations thereof are not intended to exclude other technical features, additions, components or steps. Other objects, advantages and characteristics of the present invention will appear to a person skilled in the art, in part from this description, and in part from practice of the present invention. The following illustrations and drawings are provided by way of illustration and are not intended to limit the invention.

Moreover, the invention encompasses all possible combinations of the embodiments indicated herein. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein with respect to one embodiment may be embodied in other embodiments without departing from the spirit and scope of the invention. In addition, it should be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the following detailed description is not intended to be taken in a limiting sense, and the scope of the present invention, if properly described, is limited only by the appended claims, along with all scope equivalents to those claimed. Like reference numerals in the drawings refer to the same or similar functions throughout the various aspects.

Unless otherwise indicated herein or otherwise clearly contradicted by context, items referred to in the singular encompass the plural unless the context requires otherwise. Hereinafter, in order to enable those skilled in the art to easily practice the present invention, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a server capable of providing a customized music station using virtual reality technology according to the present invention.

Referring to FIG. 1 , a virtual reality providing device 100 according to an embodiment of the present invention is a head mounted display (HMD), which means a device capable of viewing content while worn on the head like glasses, but is limited thereto. It is not, and various types of devices can be formed. Such a virtual reality providing apparatus 100 may include a display unit, a processor, and in some cases may further include a camera.

In addition, the server 200 according to an embodiment of the present invention compares in real time the similarity between the user's actual pitch information and actual time information and the reference pitch information and reference time information of the music content using virtual reality technology. , by performing a process of providing at least one of video and audio for the first action mode or the second action mode through an avatar corresponding to at least some of the virtual judges and the audience, the user can feel as if he or she is in front of the judges and the audience. It can give a feeling of being able to send and receive a realistic interaction between the two parties while singing, and it uses virtual reality technology to create a harmonious combination of the user's real pitch information and real time information and the virtual collaboration avatar's collaboration pitch information and collaboration time information. By comparing the degree in real time and providing at least one of an image and an audio for the first action mode or the second action mode through an avatar corresponding to at least some of the virtual judges and the audience, the user can feel as if It may give you the feeling that you are singing with a singer you have admired. This will be described later in more detail.

2 is a diagram illustrating a configuration for providing a customized music station using virtual reality technology according to an embodiment of the present invention.

As shown in FIG. 2 , the server 200 according to an embodiment of the present invention may include a communication unit 210 , a processor 220 and a storage unit 230 , and the communication unit 210 is a network may communicate with the virtual reality providing device 100 and the music content DB 300 through the . In this case, the virtual reality providing apparatus 100 may include a communication unit 110 , an input unit 120 , an output unit 130 , and a storage 140 .

First, the communication unit 210 of the server 200 may be implemented using various communication technologies. That is, Wi-Fi (WIFI), WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), HSPA (High Speed Packet Access), Mobile WiMAX (Mobile WiMAX), WiBro (WiBro) , LTE (Long Term Evolution), Bluetooth (bluetooth), infrared data association (IrDA), NFC (Near Field Communication), Zigbee, wireless LAN technology, etc. may be applied. In addition, when a service is provided by being connected to the Internet, TCP/IP, which is a standard protocol for information transmission on the Internet, may be followed.

Specifically, the communication unit 210 of the server 200 receives and transmits data with the virtual reality providing apparatus 100 and/or the music content DB 300 through a network.

The processor 220 of the server 200 performs data analysis with reference to information input through the input unit 120 of the virtual reality providing device 100, and provides an avatar corresponding to at least some of the judges and the audience to the user. It performs a function of providing at least one of an image and an audio for the first action mode or the second action mode through the

In addition, according to an embodiment of the present invention, the server 200 may obtain the user's actual pitch information and actual time information, and may also obtain reference pitch information and reference time information of the music content. In addition, a degree of similarity between the user's actual pitch information and the actual time information to the reference pitch information and the reference time information of the music content may be compared in real time.

In addition, according to another embodiment of the present invention, the server 200 may obtain information on a musical pitch and a time signature of a virtual collaboration avatar, and may obtain information about a user's actual pitch and real time and the virtual collaboration avatar. It is possible to compare in real time the degree of harmonization with the information on the pitch of the collaboration and the information on the time of the collaboration.

Hereinafter, the server 200 will be described in detail.

Specifically, when information for using a music station is input from a user, the server 200 provides or supports to provide music content corresponding to the input information, and the server 200 provides or supports the music content generated by the user according to the music content. Acquire an audio component, and refer to a database that records at least one of reference pitch information and reference time signature information for the music content, and information about actual pitch and actual time included in the audio component generated by the user compare in real time a degree of at least one of the music content being similar to at least one of the reference pitch information and the reference time signature information, and the actual pitch information and the actual time information included in the audio component generated by the user comparing at least one of the music contents with at least one of the reference pitch information and the reference time signature information of the music content (i) when it is sensed that the time period for which the degree of similarity is equal to or greater than a predetermined first threshold value lasts for a first predetermined time, virtual support to provide at least one of an image and an audio for the first action mode through an avatar corresponding to at least some of the judges and spectators of When it is sensed that the time is lasting, at least one of an image and an audio for the second action mode is provided through an avatar corresponding to at least some of the virtual judges and the audience.

For example, when a user wears the virtual reality providing device 100 and sings a song according to a specific music content selected by the user, the server 200 may store the user's actual time beat information and actual pitch information as reference beat information of the specific music content. and a degree of similarity with reference pitch information may be compared in real time. Specifically, when the reference pitch information of a specific music content is "Domisol", but the actual pitch information of the user is "Domi wave", the error rate may be assumed to be 1/3. Also, when the actual pitch information of the user is "Domi wave #", the error rate may be assumed to be 0.5/3. That is, the degree of similarity may be calculated by comparing the user's actual time information and the actual pitch information according to the reference time information and the reference pitch information of the specific music content.

In addition, the server 200 compares the reference time information and reference pitch information of the specific music content with the user's actual time information and actual pitch information. At least one of an image and an audio for the first action mode may be provided through an avatar corresponding to the judge of . Here, the first action mode represents a positive expression, and may include a state of nodding the head, a state of raising a thumb, a state of cheering, and the like.

That is, when the similarity between the reference time and pitch information of a specific music content and the user's actual time information and actual pitch information is high and the high degree of similarity continues for a certain period of time, the judge's avatar is set to the first action mode. It is possible to provide a way to react. Here, the degree of similarity and the duration of the degree of similarity may be preset by the user or may be a preset value. In addition, when determining whether the degree of similarity continues, it may be assumed to determine the case of continuing, but is not limited thereto. It may be assumed that the judgment is cumulative.

Meanwhile, it may be assumed that the user's actual time information and actual pitch information have a low similarity to the reference time information and the reference pitch information of a specific music content.

Specifically, by comparing the reference time information and reference pitch information of a specific music content with the user's actual time information and actual pitch information, if the degree of similarity is 30% or less and lasts for 2 minutes, respond to a virtual judge and/or audience At least one of an image and an audio for the second action mode may be provided through the avatar that is used. Here, the second action mode represents a negative expression, and may include a state of making an impression, a state of shaking the head, and the like.

That is, if the similarity between the reference time and pitch information of a specific music content and the user's actual time information and actual pitch information is low, and the low similarity continues for a certain period of time, judges and/or audiences in the second action mode An avatar of can be provided. Again, the similarity and the duration of the similarity may be preset by the user or may be a preset value. Similarly, when determining whether a similar degree continues, it may be assumed to determine a continuous case, but the present invention is not limited thereto. It may be assumed that the judgment is cumulative.

Meanwhile, according to another embodiment of the present invention, it may be assumed that a virtual collaboration avatar is included as a target to sing or play music content jointly with the user.

Referring to FIG. 4 , it is a diagram illustrating an example of a screen for singing a duet together with a virtual collaboration avatar according to another embodiment of the present invention. Server 200, from the view point of view of the user, the user can provide a visual effect and audible effects, such as singing and the avatar of the "IU" as the selected avatar to take the user collaboration.

To this end, the server 200 may provide a UI for selecting a specific virtual collaboration avatar as a target to sing a specific music content jointly with the user.

Here, the virtual specific collaboration avatar may be an avatar of a famous singer who sings together, but is not limited thereto, and may be a specific instrument selected by the user as shown in FIG. 5 .

5 is a diagram illustrating an example of a screen for selecting an instrument to learn, practicing a playing method according to a player's guidance, and enjoying an ensemble, according to another embodiment of the present invention.

Specifically, the user may select a virtual person who plays the “drum” as the virtual collaboration avatar, receives a guide on how to play the “drum”, and enjoys Samulnori with the virtual avatar. Here, the musical instrument may include any musical instrument.

Again, referring to another embodiment of the present invention, specifically, when a user selects a virtual collaboration avatar that the user wants to sing or play together, and sings a song together according to a specific music content, the server 200, the user It is possible to compare in real time the degree of harmonization between the actual time and pitch information of the avatar and the collaboration time information and pitch information of the virtual collaboration avatar.

Specifically, the degree to which at least a part of the chord, tempo, strength, and singing method of the user's actual time information and actual pitch information is similar to at least some of the chords, tempo, strength, and singing method of the virtual collaboration avatar's collaboration time information and musical pitch information is to judge

In addition, by comparing the user's actual tempo information and real pitch information with the virtual collaborating avatar's collaboration time information and musical pitch information, for example, if the degree of harmonization is more than 90% and lasts for 2 minutes, At least one of an image and an audio for the first action mode may be provided through the avatar.

On the other hand, if the degree of harmony between the user's actual time and pitch information and the virtual collaboration avatar's collaboration time information and musical pitch information is 30% or less and lasts for 2 minutes, respond to the virtual judge and/or audience At least one of an image and an audio for the second action mode may be provided through the avatar that is used.

In the case of such a collaboration, the server 200 determines that at least one of the actual pitch information and the actual time information included in the audio component generated by the user is similar to at least one of the reference pitch information and the reference time information of the music content. At least one of actual pitch information and real time information included in the audio component generated by the user corresponds to the virtual collaboration avatar, reflecting the first weight, which is a weighting factor for the avatar. A second weight, which is a weighting factor for the degree of harmonization with the time signature information, may be reflected.

That is, at least one of the first action mode and the second action mode may be provided using the first weight and the second weight.

Specifically, in a state in which the ratio of the first weight is set to 30% and the ratio of the second weight is set to 70%, the user's actual pitch information and the actual time information are the reference pitch information and the reference time signature of the music content. Even if the degree of similarity to information is high, the ratio to the first weight is only 30%, so in the end, the user is more concerned about harmony with the collaborating avatar rather than trying to sing similarly to the sheet music data, the judges and / Or it may be a way to elicit a higher response from the audience's avatar.

The ratio to the first weight and the ratio to the second weight may be flexibly changed, and the first action mode or the second action mode may be provided with respect to the result in which the first weight and the second weight are reflected.

On the other hand, when it is sensed that the user's actual pitch information and the actual time information included in the audio component generated from the user is similar to at least one of the reference pitch information and the reference time information of the music content and continues for a predetermined period of time with the predetermined similarity or more , the server 200 may support uploading of the user's audio component overlapping music content to a predetermined website.

For example, if the user's actual pitch information and the actual time information are 99% or more similar to the reference pitch information and the reference time information of the specific music content for 3 minutes or longer, the audio component track (a plurality of musical instruments) of the specific music content , the user's song development data track is combined with a plurality of tracks) and uploaded to a predetermined website. In this case, the category uploaded to a predetermined website may be uploaded to a category that sings well, such as "singing jjang".

On the other hand, when it is sensed that the user's actual pitch information and the actual time information included in the audio component generated from the user is similar to at least one of the reference pitch information and the reference time information of the music content is less than a predetermined similarity and continues for a predetermined time. , the server 200 may support uploading of the user's audio component overlapping music content to a predetermined website.

Specifically, if the user's actual pitch information and actual time information lasted for 3 minutes or longer with a similarity of less than 5% to the reference pitch information and reference time information of the specific music content, the audio component track of the specific music content (a plurality of When a musical instrument is assumed, the user's song development data track is combined with a plurality of tracks) and uploaded to a predetermined website. In this case, the category uploaded to a predetermined website may be uploaded to a category that cannot sing, such as "comic room" or "sound room".

Meanwhile, FIG. 3 is a diagram illustrating examples of a first action mode and a second action mode according to an embodiment of the present invention.

Specifically, the time period for which the degree of similarity is equal to or greater than a preset first threshold by comparing at least one of the actual pitch information and the actual time information included in the audio component generated by the user with at least one of the reference pitch information and the reference time information of the music content. When it is sensed that the first predetermined time duration, the server 200 determines the user's ability as a specific ability level among a plurality of ability levels with reference to the duration of the first predetermined time period, and performs a first action Among the modes, a specific lower first action mode corresponding to a specific skill level of the user may be provided.

Here, the first action mode includes a plurality of lower first action modes, and at least some of the lower first action modes correspond to each skill level.

For example, when it is determined that the user's ability level is "level 1" by comparing the user's actual pitch information and actual time information with reference pitch information and reference time information of specific music content, a specific lower first corresponding to "level 1" Action mode - 1 is what is provided. Here, it can be assumed that the responsiveness of the first action mode is high as the level is high. For example, a user who sings very well may correspond to "Level 10", and in the first action mode - 10 corresponding to "Level 10", all of the virtual judges may stand up and clap vigorously. The audience is also characterized by cheers.

On the other hand, even in the first action mode, if it falls under "Level 1", only some of the virtual judges are satisfied with their expressions, and only some of the virtual audiences can nod their heads.

On the other hand, when it is sensed that the time period for which the similarity is equal to or less than the second predetermined threshold value continues for the second predetermined time period, the user's ability is set to a specific ability level among a plurality of ability levels with reference to the duration of the second predetermined time period. and may provide a specific lower second action mode corresponding to a specific skill level of the user among the second action modes. Similarly, the second action mode includes a plurality of lower second action modes, and at least some of the lower second action modes correspond to each skill level.

Similar to the first action mode described above, a specific lower second action mode corresponding to the user's skill level is provided by comparing the user's actual pitch information and actual time information with the reference pitch information and reference time information of a specific music content. will be. Again, it can be assumed that the responsiveness of the second action mode is high as the level is high. For example, a user who can't sing very well may correspond to "Level 10", and the second action mode corresponding to "Level 10" - 10 is that the virtual judges all frown, or some of the virtual audience. leaves the seat, and the facial expressions of the other virtual audiences are also characterized by a bad look.

Meanwhile, the server 200 may change and provide at least one of a virtual reality background, virtual reality lighting, virtual reality special effects, virtual judges, and virtual audience according to the category of music content.

Specifically, if the category of the music content selected by the user is "dance", a stage with sparkling lights on a colorful background may be displayed. On the other hand, if the category of the music content selected by the user is "classic", virtual audiences in suits in a quiet background may be displayed.

Based on the description of the above embodiments, those skilled in the art can clearly understand that the present invention can be achieved through a combination of software and hardware or can be achieved only with hardware. The object of the technical solution of the present invention or parts contributing to the prior art may be implemented in the form of program instructions that can be executed through various computer components and made into a computer program product or a computer readable recording medium recording the same. The computer program product or a computer readable recording medium recording the same may include program instructions, data files, data structures, etc. alone or in combination. The computer program product or the program instructions included in the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software. Examples of readable recording media used in computer program products include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical disks such as floppy disks. hardware devices specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform processing according to the present invention, and vice versa. The hardware device may include a processor, such as a CPU or GPU, coupled with a memory such as ROM/RAM for storing program instructions and configured to execute instructions stored in the memory, and may send and receive signals to and from an external device. It may include a communication unit. In addition, the hardware device may include a keyboard, a mouse, and other external input devices for receiving commands written by developers.

In the above, the present invention has been described with specific matters such as specific components and limited embodiments and drawings, but these are provided to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , those of ordinary skill in the art to which the present invention pertains can make various modifications and variations from these descriptions.

Therefore, the spirit of the present invention should not be limited to the above-described embodiments, and not only the claims described below, but also all modifications equivalently or equivalently to the claims described below belong to the scope of the spirit of the present invention. will do it

Claims (14)

A method for providing a customized music station using virtual reality technology, comprising:
(a) when information for using the music station is input from a user, the server provides or supports to provide music content corresponding to the input information, and an audio component generated by the user in accordance with the music content obtaining a;
(b) the server, with reference to a database that records at least one of reference pitch information and reference time information for the music content, actual pitch information and actual time signature included in the audio component generated by the user comparing in real time a degree to which at least one piece of information is similar to at least one of the reference pitch information and the reference time signature information of the music content; and
(c) the server compares at least one of the actual pitch information and the actual time information included in the audio component generated by the user with at least one of the reference pitch information and the reference time information of the music content Thus, (i) when it is sensed that the time period for which the degree of similarity is equal to or greater than the first threshold value lasts for a first predetermined time, an image for the first action mode through an avatar corresponding to at least some of the virtual judges and the audience; an avatar corresponding to at least one of the virtual judges and the audience; providing at least one of an image and an audio for the second action mode through ;
including,
In step (a),
The server provides a collaborative avatar as an object to sing or play the music content jointly with the user to be displayed in a virtual reality corresponding to the music content, and audio recorded in response to the virtual collaborative avatar Further comprising the step of outputting the component,
In step (b),
The server may be configured to include at least one of the real pitch information and the real time information included in the audio component generated from the user in an audio component recorded in correspondence to the virtual collaboration avatar, the cooperative pitch information and the cooperative time signature information. degree of harmonization with - The degree of harmonization includes at least a part of chords, tempo, strength, and singing method of the actual pitch information and the actual time information among chords, tempo, strength, and singing method of the cooperative pitch information and the cooperative time information. It further comprises the step of determining in real time - to a degree similar to at least some,
In step (c),
The server is
Comparing at least one of the actual pitch information and the actual time information included in the audio component generated by the user with at least one of the concerted pitch information and the collaborative time information (i) the degree of harmonization is determined in advance to provide at least one of an image and an audio for the first action mode through the avatar corresponding to at least some of the virtual judges and the audience when it is sensed that the time exceeding the third threshold continues for a third predetermined time and (ii) when it is sensed that the time for which the degree of harmonization is equal to or less than the fourth threshold is lasting for a fourth predetermined time, the second through the avatar corresponding to at least some of the virtual judges and the audience. Further comprising the step of providing at least one of video and audio for the action mode,
The server is
(i) a weighting degree to which at least one of the actual pitch information and the actual time information included in the audio component generated by the user is similar to at least one of the reference pitch information and the reference time information of the music content a first weight that is a factor and (ii) at least one of the real pitch information and the real time information included in the audio component generated from the user is included in the audio component recorded in correspondence to the virtual collaboration avatar The method of claim 1, wherein at least one of the first action mode and the second action mode is provided by using a second weight, which is a weighting factor for a degree of harmony with the musical pitch information and the musical time information. delete delete According to claim 1,
(d) the server, the degree to which the actual pitch information and the actual time information of the user included in the audio component generated from the user are similar to at least one of the reference pitch information and the reference time information of the music content (i) if it is sensed that the time equal to or greater than the fifth predetermined threshold lasts for a fifth predetermined time, supporting the user to upload the music content overlapping the audio component to a website; and (ii) performing at least one of a process of supporting uploading of the music content overlapping the audio component of the user to a website when it is detected that the time less than the preset sixth threshold continues for a sixth predetermined time; The method further comprising. According to claim 1,
In step (c),
At least one of the actual pitch information and the actual time information included in the audio component generated by the user is compared with at least one of the reference pitch information and the reference time information of the music content, and the degree of similarity is preset. When it is sensed that the time equal to or greater than the first threshold continues for the first predetermined time, the server sets the user's ability to a specific ability level from among a plurality of ability levels, with reference to the duration of the first predetermined time. and the first action mode - the first action mode includes a plurality of lower first action modes, and at least some of the lower first action modes correspond to each skill level - the specific skill level Method characterized in that it provides a specific lower first action mode corresponding to . According to claim 1,
In step (c),
At least one of the actual pitch information and the actual time information included in the audio component generated by the user is compared with at least one of the reference pitch information and the reference time information of the music content, and the degree of similarity is preset. When it is sensed that the time equal to or less than the second threshold continues for the second predetermined time, the server sets the user's ability to a specific ability level from among a plurality of ability levels, with reference to the duration of the second predetermined time. is determined, and the second action mode - the second action mode includes a plurality of lower second action modes, and at least some of the lower second action modes correspond to each skill level - the specific skill level Method characterized in that it provides a specific lower second action mode corresponding to . According to claim 1,
The server is
According to the category of the music content, at least one of the virtual reality background, the virtual reality lighting, the virtual reality special effect, the virtual judge, and the virtual audience is changed and provided. . As a server for providing a customized music station using virtual reality technology,
a communication unit communicating with the display unit for providing virtual reality to the user; and
(1) When information for using the music station is input from the user, providing or supporting music content corresponding to the input information, and obtaining an audio component generated by the user according to the music content process; (2) at least one of actual pitch information and actual time information included in the audio component generated by the user with reference to a database recording at least one of reference pitch information and reference time information for the music content a process of comparing the degree of similarity with at least one of the reference pitch information and the reference time signature information of the music content in real time; and (3) comparing at least one of the actual pitch information and the actual time information included in the audio component generated by the user with at least one of the reference pitch information and the reference time information of the music content (i) ) When it is sensed that the time for which the degree of similarity is equal to or greater than the first predetermined threshold continues for the first predetermined time, at least one of video and audio for the first action mode through an avatar corresponding to at least some of the virtual judges and the audience and (ii) if it is sensed that the second predetermined period of time for which the degree of similarity is less than or equal to a second preset threshold is detected, the selection is made through an avatar corresponding to at least some of the virtual judges and the audience. 2 a processor for performing a process of providing at least one of an image and an audio for an action mode;
including,
The processor is
A collaborative avatar as an object to sing or play the music content jointly with the user is included and displayed in a virtual reality corresponding to the music content, and an audio component recorded in response to the virtual collaborative avatar is output. characterized in that the process is carried out,
The degree to which at least one of the real pitch information and the real time information included in the audio component generated from the user is harmonized with the concert pitch information and the concert time information included in the audio component recorded in correspondence to the virtual collaboration avatar - The degree of harmonization is that at least a part of chords, tempo, strength, and singing method of the actual pitch information and the actual time information is similar to at least some of the chords, tempo, strength, and singing method of the cooperative pitch information and the cooperative time information. It is characterized by performing the process of judging the degree in real time,
Comparing at least one of the actual pitch information and the actual time information included in the audio component generated by the user with at least one of the concerted pitch information and the collaborative time information (i) the degree of harmonization is determined in advance to provide at least one of an image and an audio for the first action mode through the avatar corresponding to at least some of the virtual judges and the audience when it is sensed that the time exceeding the third threshold continues for a third predetermined time and (ii) when it is sensed that the time for which the degree of harmonization is equal to or less than the fourth threshold is lasting for a fourth predetermined time, the second through the avatar corresponding to at least some of the virtual judges and the audience. performing a process of providing at least one of video and audio for an action mode;
The processor is
(i) a weighting degree to which at least one of the actual pitch information and the actual time information included in the audio component generated by the user is similar to at least one of the reference pitch information and the reference time information of the music content a first weight that is a factor and (ii) at least one of the real pitch information and the real time information included in the audio component generated from the user is included in the audio component recorded in correspondence to the virtual collaboration avatar and performing a process of providing at least one of the first action mode and the second action mode by using a second weight, which is a weighting factor for a degree of harmony with the cooperative pitch information and the cooperative tempo information. delete delete 9. The method of claim 8,
The processor is
(i) the degree to which the actual pitch information and the actual time information of the user included in the audio component generated from the user are similar to at least one of the reference pitch information and the reference time information of the music content; If it is sensed that the time equal to or greater than the 5th threshold lasts for a fifth predetermined time, a process of supporting the user to upload the music content overlapping the audio component to a predetermined website; and (ii) a time less than the sixth predetermined threshold. If it is detected that the sixth predetermined time duration is detected, the server further performs at least one of a process of supporting uploading of the music content in which the audio component of the user overlaps to a predetermined website. 9. The method of claim 8,
The processor is
At least one of the actual pitch information and the actual time information included in the audio component generated by the user is compared with at least one of the reference pitch information and the reference time information of the music content, and the degree of similarity is preset. when it is sensed that the time equal to or greater than the first threshold continues for the first predetermined time, the user's ability is determined as a specific ability level among a plurality of ability levels with reference to the duration of the first predetermined time; Specific corresponding to the specific skill level among the first action mode, wherein the first action mode includes a plurality of lower first action modes, and at least some of the lower first action modes correspond to each skill level A server, characterized in that performing a process for providing a lower first mode of action. 9. The method of claim 8,
The processor is
At least one of the actual pitch information and the actual time information included in the audio component generated by the user is compared with at least one of the reference pitch information and the reference time information of the music content, and the degree of similarity is preset. when it is sensed that the time equal to or less than the second threshold continues for the second predetermined time, the user's ability is determined as a specific ability level among a plurality of ability levels, with reference to the duration of the second predetermined time; Specific corresponding to the specific skill level of the second action mode, wherein the second action mode includes a plurality of lower second action modes, and at least some of the lower second action modes correspond to each skill level A server, characterized in that performing a process for providing a lower second mode of action. 9. The method of claim 8,
The processor is
performing a process of changing and providing at least one of the background of the virtual reality, the lighting of the virtual reality, the special effects of the virtual reality, the virtual judge, and the virtual audience according to the category of the music content Characterized Server.

Images