KR20220139675A - Apparatus and method for providing user interface for generating and contesting user's music sources - Google Patents

Abstract

In accordance with one embodiment of the present invention, a method for providing a user interface for generating and contesting a user sound source, which is performed by a central server, includes the following steps of: (a) creating a user profile with user terminal received from a user terminal; (b) when receiving a user sound source generated by a sound source production interface from the user terminal, matching and storing the user sound source with the user profile; and (c) conducting a contest through a plurality of user sound sources received from different user terminal, wherein the sound source production interface can provide a mixing and mastering function necessary for reproducing an MR sound source selected by a user terminal, receiving voice information of a user and then generating a sound source in which the MR sound source is combined with the user voice, and the contest means the procedure of determining rankings by receiving preferences from listeners listening to a plurality of user sound sources for a predetermined period. Therefore, the present invention is capable of opening sound sources to the public and creating profits.

Description

Apparatus and method for providing a user interface for creation and competition of user sound sources

The present invention relates to an apparatus and method for providing an interface through which a user can easily mix and edit his/her own voice and MR sound source, and a method therefor.

Conventionally, platforms for sharing various videos generated by individuals or companies, including YouTube (You Tube), are widely used. As such, as platforms develop, content creators upload their videos through the platform and share them with others.

In addition, there is an increasing number of content creators who not only video, but also create and upload sound sources that were previously exclusive to singers through video platforms or the like as cover songs.

In this case, the cover song refers to a song performed or sung by another person in a music field released by a specific person.

In a typical content sharing platform, an advertisement mapped with the content is compulsorily exposed for a certain period of time before or during the playback of the uploaded content. Through this process, according to the number of views of the uploaded content, a certain amount of revenue is paid to the content creator according to the number of times and the exposure time of the advertisement exposed along with the playback time of the content.

In the case of the cover songs described above, copyright issues may arise between the original authors. For example, under the Copyright Act, singing a song using the original music MR may constitute an infringement of the right to copy, and arranging is an infringement of the right to create a secondary work. Furthermore, uploading these videos to a content sharing platform may constitute a violation of the right to transmit.

At this time, in the case of YouTube, since 2008, the content verification technology (Content ID, hereinafter CID) has been introduced to protect the copyright of the author. This is a system that automatically verifies whether the content uploaded by the content creator matches the original content reference file of the copyright holder based on the database consisting of the original content reference file provided by the copyright holder.

When YouTube searches for uploaded content that matches the copyright holder's work through this content verification technology, the copyright holder will receive a report. At this time, the copyright holder can choose whether to block, track, or model the content for the corresponding content. That is, if the uploaded content is found to be in violation of copyright, a warning action is taken according to the setting of the copyright holder, users' access is automatically blocked, the corresponding content is removed, or the copyright holder can take the revenue generated from content reproduction. .

Meanwhile, YouTube is also using bots to manage copyrights. When copyright holders apply for copyright to a video sharing platform by copyright holders, and other content creators other than the copyright holder upload content that matches or is similar to the work requested by the copyright holder, the management bot filters and gives permission to the copyright holder for the work All advertising revenues from this will be allocated to the copyright holder.

According to 2019 statistics, it is estimated that YouTube paid a whopping 3.5 trillion won in music usage fees to authors or the music industry. Among them, advertising revenues attached to videos uploaded by famous YouTubers who sing cover dances or cover songs account for a significant portion.

In the end, it can be said that there is a great need to protect the copyright of the original copyright holder in the case of simply using music or sound sources, but a new business model is needed to distribute the profits generated from content created by oneself, such as cover songs, with existing authors. to be.

However, there is a limit to the ability of a content creator who wants to upload content such as a cover song to a video sharing platform to personally contact the copyright holder directly. Even if there is contact between the content creator and the copyright holder, it is difficult to obtain permission to use the work, and it is not easy to prepare everything from payment of royalties to use approval documents.

In order to solve the above problems, an object of the present invention is to implement a platform in which a user can record his/her own voice, and mix and edit the recorded voice with MR accompaniment.

Specifically, the platform provides an interface that allows users to record their own voice and edit the sync or mastering values to match the MR accompaniment.

In addition, even if the user does not know how to use it through the manual, the purpose is to support the user to easily create and manage his/her own sound source only in the form of the UI provided by the interface.

In addition, it aims to implement a platform where users can open their own music sources to the public and generate revenue.

In the method of providing a user interface for generation and competition of a user sound source, performed by a central server, according to an embodiment of the present invention for achieving the above technical problem, (a) user information received from a user terminal creating a user profile with (b) receiving the user sound source generated by the sound source production interface from the user terminal, matching the user profile and storing; and (c) performing a contest through a plurality of user terminals received from different user terminals, wherein the sound source production interface plays the MR sound source selected by the user terminal, and after receiving the user's voice information, MR It provides mixing and mastering functions necessary to create a user sound source that combines sound sources and user voices, and a contest may refer to a process of determining a ranking by receiving preferences from listeners who have listened to a plurality of user sound sources for a predetermined period. .

In addition, the user profile may be displayed on the user terminal by the profile interface, and at least one of a user's photo, an uploaded user sound source, and a number of followers/following may be displayed.

In addition, the profile interface may list and display user sound sources, and display the number of views for each user sound source and revenue by user sound sources.

In addition, before step (a), a questionnaire interface for receiving user information is provided to the user terminal, and the questionnaire interface provides options for preset questions, and can classify the user's propensity for songs according to the selected options. have.

In addition, the sound source production interface may be composed of a voice receiving interface, a mixing setting interface, and a mastering setting interface.

In addition, the voice receiving interface receives at least one of a user's voice or a video, and a first area of the voice receiving interface provides video information being recorded in real time, and a second area provides lyrics of a song corresponding to the voice information. and at least one button for operating the voice reception interface may be provided in the third area of the interface.

In addition, the mixing setting interface modifies a mixing adjustment value for mixing the MR sound source and voice information, and the mixing adjustment value may include at least one of a vocal sync value, a master volume option value, and an edit value.

In addition, in the mixing setting interface, an option for selecting and editing any one of a vocal sync value, a master volume value, and an edit value is provided in the first area, and the waveforms of the MR sound source and voice information are mapped and arranged in the second area, , a time value for determining the synchronization of the MR sound source and voice information is provided as visual information, and at least one button for adjusting any one of a vocal sync value, a master volume value, and an edit value is provided in the third area can

In addition, the mastering setting interface modifies the mastering adjustment value for mastering one of the MR sound sources and voice information, but the mastering adjustment value is at least one of doubling, compressor, equalizer, reverb, delay and limiter values. may be included.

In addition, in the mastering setting interface, an option for selecting and editing any one of doubling, compressor, equalizer, reverb, delay and limiter values is provided in the first area, and the waveform of the user's sound source is arranged in the second area, and editing At least one or more buttons may be provided to visually provide the position of the section to be set or to allow a specific section to be selected, and to adjust any one of doubling, compressor, equalizer, reverb, delay and limiter values in the third area. have.

In addition, before the step (c), the user terminal provides a user sound source and provides a contest interface for performing a contest, but the listener terminal may be a terminal for listening and evaluating the user sound source.

In addition, the contest interface displays a list of at least one or more user sound sources in which a contest is in progress, and when the listener terminal selects a specific user sound source included in the list of user sound sources, song information and streaming of the specific user sound source are provided, The information may include at least one of a user profile, a name of an original song, a singer's name of the original song, a description of the original song, a thumbnail, image information, and a value of preference given to a specific user's sound source.

In addition, when the winning sound source is selected based on the preference obtained from the listener terminal for each user sound source for a predetermined period, the winning sound source is displayed on the contest interface for a predetermined period, and the user's profile information and comments are received from the user terminal Thus, it can be displayed together with other user sound sources and the number of wins generated by the user.

In addition, in the apparatus for providing a user interface for generation and competition of a user sound source, a memory in which a user interface providing program for generation and competition of a user sound source is stored and a program stored in the memory are executed to create and compete a user sound source user interface Including a providing processor, the processor creates a user profile with the user information received from the user terminal, and when receiving the user sound source generated by the sound source production interface from the user terminal is matched with the user profile and stored, from different user terminals The contest is performed through a plurality of received user terminals, and the sound source production interface plays the MR sound source selected by the user terminal, and after receiving the user's voice information, mixing necessary to create a user sound source in which the MR sound source and the user voice are combined and a mastering function, and the contest may be a device which means a process of determining a ranking by receiving preferences from listeners who have listened to a plurality of user sound sources for a predetermined period.

In addition, it may be a computer-readable storage medium in which a program for performing the method of providing a user interface for creation and competition of a user sound source according to claim 1 is recorded.

According to an embodiment of the present invention, a platform is implemented in which a user can record his/her own voice, and mix and edit the recorded voice with MR accompaniment.

Specifically, the platform provides an interface that allows users to record their own voice and edit the sync or mastering values to match the MR accompaniment.

In addition, even if the user is not familiar with the usage through the manual, it is possible to easily create and manage his/her own sound source only in the form of the UI provided by the interface.

In addition, the user can open the sound source created by the user to the public and generate revenue.

1 is a diagram showing the configuration of a system for implementing a platform for generating a sound source and generating revenue, according to an embodiment of the present invention.
2 is a diagram showing the configuration of a central server 100 that provides a platform according to an embodiment of the present invention.
3 is an operation flowchart illustrating a process of generating a sound source and performing a contest according to an embodiment of the present invention.
4 is an operation flowchart illustrating a process of producing a user sound source according to an embodiment of the present invention.
5 is an operation flowchart illustrating a process of mixing a sound source based on AI, according to an embodiment of the present invention.
6 is an operation flowchart illustrating a process of mixing and contesting a sound source through an interface provided by a platform according to an embodiment of the present invention.
7 is an operation flowchart illustrating a process of generating revenue and distributing revenue through a sound source, according to an embodiment of the present invention.
8 to 13 are diagrams illustrating examples of a platform interface according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. However, the present invention may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is "connected" with another part, this includes not only the case of being "directly connected" but also the case of being "electrically connected" with another element interposed therebetween. . Also, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated, and one or more other features However, it is to be understood that the existence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded in advance.

The following examples are detailed descriptions to help the understanding of the present invention, and do not limit the scope of the present invention. Accordingly, an invention of the same scope performing the same function as the present invention will also fall within the scope of the present invention.

The platform to be implemented in the present invention creates a unique user sound source by combining it through an AI algorithm when a user selects an MR sound source and sings a song about it, or by applying a custom sound source adjustment value.

In addition, the platform to be implemented in the present invention not only generates a user sound source, but also opens it to the outside to compete with other user sound sources or to generate and distribute revenue.

Hereinafter, in the present specification, a sound source refers to an electronic file including at least one of a sound or an image.

Also, in the present specification, an MR sound source (music recorded, or instrumental track) refers to a sound file except for voices in the sound sources of specific singers. In general, only sound is provided, but according to embodiments, visual information may be further included. In this case, the MR sound source may be a creative song or a ready-made song, and in the case of a ready-made song, it corresponds to a sound source that can be created secondary with the permission of the original author.

Also, in the present specification, voice information is voice information generated by a user using a service through a platform through his/her terminal. That is, it corresponds to the information recorded through the terminal of the song (the song lyrics) corresponding to the MR sound source. In this case, the voice information may be generated in the form of a moving picture, rather than being limited only to sound, according to an embodiment.

In addition, the technology disclosed in this specification combines the MR sound source and voice information. At this time, a user sound source is created by mixing the MR sound source and voice information, and the user sound source is adjusted by resetting the mixing conditions for the user sound source, and then the mastering operation is performed. That is, in this specification, "combination of MR sound source and voice information" includes mixing the MR sound source and voice information and performing a mastering operation.

1 is a diagram showing the configuration of a system for implementing a platform for generating a sound source and generating revenue, according to an embodiment of the present invention.

Referring to FIG. 1 , the system may include a central server 100 , a plurality of user terminals 200 , and a distributor server 300 . At this time, although not shown in the drawing, each device may be interconnected by wire or wirelessly through a communication network.

According to an embodiment of the present invention, the central server 100 stores the user information received from the user terminal 200, and then, when the user terminal 200 receives the user sound source generated through the sound source production interface, first The stored user information is matched and stored.

Thereafter, the central server 100 performs a contest through the user sound source received from the plurality of user terminals 200 , and provides the winning user sound source to the distributor server 300 to generate revenue.

At this time, the user terminal 200 generates a user sound source by combining the MR sound source received from the central server 100 and the voice information recorded by the user through the sound source production interface.

At this time, the sound source production interface reproduces the MR sound source selected by the user terminal 200 from the central server 100, receives the user's voice information, and mixes and An interface that provides a mastering function.

On the other hand, the platform may provide an AI mixing algorithm. Specifically, the AI mixing algorithm combines the MR sound source and the voice according to the pre-stored sound source adjustment value (which may include a mixing adjustment value and a mastering adjustment value). Accordingly, the user omits the mixing and mastering work through the sound source production interface described above.

In addition, the contest refers to a process of determining a ranking by receiving preferences from listeners who have listened to the plurality of user sound sources for a predetermined period. At this time, if the user sound source of a specific user wins the contest, the distributor server 300 provides the winning user sound source through the central server 100 . In addition, a platform server such as YouTube can provide user music. Thereafter, the service principal of the central server 100 and the producer of the user terminal 200 have a certain percentage of the revenue that the distributor server 300 obtains through the user sound source.

In this case, the platform application for the user terminal 200 to use the service may be an application built into the user terminal 200 or an application downloaded from an application distribution server and installed in the user terminal 200 .

Meanwhile, the user terminal 200 refers to a communication terminal capable of using a terminal application in a wired/wireless communication environment. Here, the user terminal 200 may be a user's portable terminal. In FIG. 1, the user terminal 200 is illustrated as a smart phone, which is a type of a portable terminal, but the spirit of the present invention is not limited thereto. can be borrowed

More specifically, user terminal 200 may include a handheld computing device (eg, PDA, email client, etc.), any form of a mobile phone, or any other type of computing or communication platform. However, the present invention is not limited thereto.

On the other hand, the communication network is a communication network that provides a connection path so that the user terminal 200 can transmit and receive data after accessing the central server 100 or the distributor server 300 (this can be borrowed in the opposite case). it means. The communication network is, for example, wired networks such as LANs (Local Area Networks), WANs (Wide Area Networks), MANs (Metropolitan Area Networks), ISDNs (Integrated Service Digital Networks), etc., or wireless networks such as wireless LANs, CDMA, Bluetooth, and satellite communication. However, the scope of the present invention is not limited thereto.

2 is a diagram showing the configuration of a central server 100 that provides a platform according to an embodiment of the present invention.

Referring to FIG. 2 , the central server 100 according to an embodiment of the present invention includes a communication module 101 , a memory 102 , a processor 103 , and a database 104 .

In detail, the communication module 101 provides a communication interface necessary to provide a transmission/reception signal between the central server 100 , the user terminal 200 and the distribution company server 300 in the form of packet data by interworking with the communication network. Furthermore, the communication module 101 may perform a role of receiving a data request from the user terminal 200 and transmitting data in response thereto.

Here, the communication module 101 may be a device including hardware and software necessary for transmitting and receiving signals such as control signals or data signals through wired/wireless connection with other network devices.

In the memory 102, a program for operating the platform is recorded. In addition, the processor 103 performs a function of temporarily or permanently storing the processed data. Here, the memory 102 may include magnetic storage media or flash storage media, but the scope of the present invention is not limited thereto.

The processor 103 is a kind of central processing unit and controls the entire process of operating the platform. Each step performed by the processor 103 will be described later with reference to FIGS. 3 to 7 .

Here, the processor 103 may include all kinds of devices capable of processing data, such as a processor. Here, the 'processor' may refer to a data processing device embedded in hardware, for example, having a physically structured circuit to perform a function expressed as a code or an instruction included in a program. As an example of the data processing device embedded in the hardware as described above, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, an application-specific integrated (ASIC) circuit) and a processing device such as a field programmable gate array (FPGA), but the scope of the present invention is not limited thereto.

The database 104 stores the MR sound source to be provided to the user terminal 200 (which may also include a general sound source in some cases), voice information received from the user terminal 200, and data about the user sound source. In addition, a sound source adjustment value and an AI algorithm corresponding to each MR sound source may be stored.

In this case, the sound source adjustment value may correspond to a mixing adjustment value required in the process of combining the MR sound source and the user's voice, for example, a sync value and an EQ value.

Although not shown in FIG. 2 , some of the data for the MR sound source, voice information, user sound source, and sound source adjustment value may be stored in a database (not shown) physically or conceptually separated from the database 104 . That is, in an optional embodiment, the database 104 may be omitted, and necessary data may be received and used from the database provided in the user terminal 200 .

3 is an operation flowchart illustrating a process of generating a sound source and performing a contest according to an embodiment of the present invention.

Referring to FIG. 3 , the central server 100 stores user information and a user sound source received from the user terminal 200 ( S110 ).

Specifically, the central server 100 stores user information in advance, and when a user sound source generated by the sound source production interface is received from the user terminal 200 later, it is matched with the user information and stored.

At this time, the central server 100 provides the profile interface to the user terminal 200 . In the profile interface, at least one of user information, a user sound source, and a number of followers/following may be displayed.

In addition, if a plurality of user sound sources corresponding to the specific user terminal 200 exist, they may be listed and displayed. At this time, the number of hits for each user sound source included in the list and the revenue generated by the distributor server 300 are further displayed.

In this case, the process of generating the user sound source by the user terminal 200 initiated in step S110 through the sound source production interface will be described in detail with reference to FIG. 4 to be described later.

Next, the central server 100 performs a contest through user sound sources received from different user terminals 200 (S120).

Before the step (S120), the central server 100 provides the user's sound source to the listener terminal and provides a contest interface for performing the contest.

In this case, the listener terminal means a terminal that listens to or evaluates a user sound source. That is, since it can correspond to a user who will use the service of the platform, the user terminal 200 may also be included in the listener terminal in a broad sense.

In addition, the central server 100 selects the winning sound source based on the preference acquired by a plurality of user sound sources for a predetermined period when the listener terminal receiving the user sound source through the contest interface gives preference to a specific user sound source. .

Finally, the central server 100 provides the winning user sound source to the distributor server 300 , and the distributor server 300 performs revenue generation and distribution ( S130 ).

At this time, the distribution company server 300 generates revenue based on the winning sound source, and provides a preset ratio of revenue to the service subject of the central server 100 and the creator of the user terminal 200 .

4 is an operation flowchart illustrating a process of producing a user sound source according to an embodiment of the present invention.

Referring to FIG. 4 , the central server 100 provides the MR sound source according to the request of the user terminal 200 ( S210 ).

Before step S210 , the central server 100 provides a list of the MR sound sources it possesses to the user terminal 200 , and when the user terminal 200 selects a specific MR sound source, it provides a specific MR sound source.

Next, the user terminal 200 generates a user sound source by combining the sound source including the MR sound source and the user's voice information through the sound source production interface (S220).

Before step S220 , the central server 100 provides a voice reception interface to the user terminal 200 to receive voice information from the user terminal 200 . In this case, the voice receiving interface may simply receive voice information or, if necessary, may receive voice information in the form of a video through a camera.

In addition, in step S220, the central server 100 provides an interface for mixing and mastering voice information to be included in the user sound source through the sound source production interface.

In addition, when receiving the custom sound source adjustment value from the user, the user terminal 200 performs mixing and mastering of the voice information of the user sound source based on the custom sound source adjustment value.

In this case, the custom sound source adjustment value may include a mixing adjustment value and a mastering adjustment value. Specifically, the mixing adjustment value may include at least one of a vocal sync value, a master volume value, and an edit value. Also, the mastering adjustment value may include at least one of doubling, compressor, equalizer, reverb, delay, and limiter values.

For example, the vocal sync value may correspond to a value for correcting the sync by changing the reproduction time of the voice information. In addition, the master volume value may adjust the volume for each predetermined section of the voice information, and the edit option value may correspond to a value for repeatedly recording or deleting a predetermined section of the voice information.

In an optional embodiment, the central server 100 may receive and store the voice information generated from the user's other terminals (eg, desktop, notebook, etc.). Thereafter, voice information may be provided according to a request of the user terminal 200 - a terminal completely different from the other terminals disclosed above. That is, the user records his or her song on the desktop, creates voice information and uploads it to the central server 100, and the user later downloads the voice information uploaded to the central server 100 to the smartphone to perform editing. there will be

Finally, the central server 100 receives the user sound source from the user terminal 200 (S230).

In an optional embodiment, the MR sound source received by the user terminal 200 in step S210 may be stored by matching a preset sound source adjustment value.

In this case, the process performed in step S220 may automatically combine the MR sound source and voice information according to the AI mixing algorithm and the sound source adjustment value.

A detailed description of the above embodiment will be performed with reference to FIG. 5 to be described later.

5 is an operation flowchart illustrating a process of mixing a sound source based on AI, according to an embodiment of the present invention.

Referring to FIG. 5 , the user terminal 200 receives voice information from the user ( S310 ).

In this case, as described above, the voice information refers to information in which a voice or song generated by the user's own voice is recorded.

In step S310 , the user terminal 200 may collect the user's voice information and then extract the low tone, the middle tone, and the high tone from the corresponding voice information. Alternatively, as an additional embodiment, the user terminal 200 may provide the user with a preset MR sound source and induce the user to sing along to the song through the MR sound source to receive voice information for each bass, middle, and treble. .

Thereafter, the user terminal 200 may classify the gender of the voice information.

Next, the user terminal 200 selects a comparison singer similar to voice information within the corresponding gender (S320).

Specifically, the user terminal 200 compares the voice information with the previously stored singer voice information of at least one or more of the comparison singers. In this case, the similarity with the singer's voice information is calculated based on at least one of a genre, a tone, and a pitch of the voice information. In this case, the singer voice information refers to information on the upbringing of a song sung by an actual singer according to their MR sound source.

First, the method of selecting a comparative singer based on the genre is as follows.

In addition, when preset genre information is given to each genre of singer voice information, genre information associated with the user is digitized based on either preferred genre information received from the user or genre information corresponding to the voice information. . Alternatively, the user terminal 200 may digitize the genre information by referring to the preferred genre information previously received from the user (ie, a value input as a preferred genre in the profile information input step).

Thereafter, the user terminal 200 digitizes each genre information given to the singer's voice information, and compares it with the user's genre information to select a comparison singer. For example, if genres of songs owned by a corresponding singer are identified for each singer, the scores for the corresponding genre are digitized, and then averaged, the representative genre value of the corresponding singer can be quantified. Here, the user terminal 200 may select the comparison singer with the smallest comparison value by comparing the genre information of the user with the genre information of the comparison singer.

Second, the method of selecting a comparative singer based on the tone is as follows.

The user terminal 200 digitizes the timbre of the voice information, and selects the comparative singer having the lowest difference compared with the timbre value included in the singer's voice information of the comparative singer. For example, after defining each tone, such as a husky tone, a soft tone, and a rough tone, numerical value may be performed for each tone. This can be quantified through a conventional timbre digitization program.

Third, the method of selecting a comparative singer based on the height is as follows.

The user terminal 200 digitizes the height of the voice information, and selects the comparison singer having the lowest difference compared with the height value included in the singer voice information of the comparison singer. In this case, the pitch value may be an average value of the pitches of a plurality of sounds expressed in one singer voice information.

The comparison singer may be selected based on at least one of the above-described tone, genre, and pitch. If an example is given based on tone, at least three comparative singers with the smallest difference value from the user's tone value may be selected and sorted by difference value. In this way, the same method can be performed for each genre and pitch, and a comparison singer with the smallest difference from the user's number can be selected when all of the tone, genre, and pitch are considered. Alternatively, a comparison singer may be selected after applying a weight to any one of the three fields. For example, if singer A is derived for genre and pitch, but the singer with the smallest difference value in the tone part is B, and if weight is given for tone, the comparative singer may be selected as B.

Also, the user terminal 200 classifies the categories of voice information based on the selection result of the comparative singer. Thereafter, the user terminal 200 sets the sound source adjustment value corresponding to the classified category as the user's sound source adjustment value, and applies it in step S330 to be described later.

Here, the category may be defined for each comparative singer or may be defined as a separate criterion. For example, the separate criteria may be defined in various ways, such as defined by genre, such as a ballad category or hip-hop category, or defined by age, such as teenagers, 20s, and 30s. For each category, a numerical range for at least one of genre, tone, and pitch that can be included in the corresponding category may be defined, and if these regulations are met, the user sound source may be defined as corresponding to the corresponding category .

In addition, sound source adjustment values (mixing condition values, mastering adjustment values) may be preset for each category. For example, if the category is defined for each comparative singer, so if it is a user sound source that falls under the A singer category of the ballad type, the master volume ratio (that is, singer voice information (or MR sound source)) and the user voice composing the mixing condition value. volume ratio), vocal sync ratio (that is, the ratio to the alignment time difference between the playback position of the singer's voice information (or MR sound source) on the time axis and the playback position of the voice information on the time axis) The user is recording simultaneously, but the voice is actually recorded at a slower beat than the MR sound source. ratio adjustment is required) may be preset. In addition, the mastering adjustment value is also composed of elements such as doubling, compressor, equalizer (EQ), reverb, delay, limiter, and a numerical value that needs to be adjusted for each element may be preset.

These sound source adjustment values may be defined differently for each category. Alternatively, the sound source adjustment value may be defined differently for each genre of the song. For example, a different sound source adjustment value may be applied depending on whether the user sang a ballad or hip-hop. Also, even for one song, the sound source adjustment value may be set differently in the middle according to the flow (beat or melody) of the song. For example, when the song A, which is 2 minutes long, has different beats based on the play time of 1 minute, the sound source adjustment value may be set differently for each section.

In a further embodiment, the user terminal 200 compares the user's voice information with a plurality of tone templates pre-stored in the database 104 of the central server 100, and selects the tone template with the highest similarity. At this time, the tone template is divided into soprano, mezzo-soprano, alto, counter tenor, tenor, baritone, or bass, or a number of levels, for example, 0 level (low tone tone) to 10 level (treble tone), each It has the sound source adjustment value corresponding to the option of . Accordingly, the sound source adjustment value corresponding to the voice information in the tone template is applied.

Finally, the user terminal 200 generates a user sound source by mixing and mastering voice information based on a previously stored sound source adjustment value mapped with a comparative singer (S330).

After step S330, the user terminal 200 may receive a new user sound source from the user. In this case, the user terminal 200 may repeat the process up to step S330. The sound source adjustment value according to the result of re-performing up to step S330 may be the same as the previous sound source adjustment value, but may be different. For example, the genre of the MR sound source selected by the user may be different, or the user's voice information may be received and analyzed slightly differently from that of the previous sound source. Alternatively, when the user manually changes the sound source adjustment value, it may be different from that in the previous sound source.

In this way, a lot of voice information (tone, genre, pitch) may be received for one user, and a sound source adjustment value corresponding to each of the voice information may be generated. Expanding on multiple users, there may be training data of a myriad of sound source adjustment values for a myriad of voice information. When training is performed by setting the input value of these training data as voice information (tone, genre, pitch) and setting the output value as the sound source adjustment value to apply the training to the machine learning model, the sound source is optimized for the user's sound source through the AI algorithm. Algorithm learning that recommends values can be completed. In this case, the machine learning model may be any one of ANN, DNN, KNN, and CNN, or an ensemble model combining at least two of them. Alternatively, it may be a variety of other artificial intelligence learning models.

Therefore, the more a user creates a sound source, the more the sound source adjustment value is slightly modified, so that a sound source adjustment value suitable for the user can be derived more accurately. In addition, it is possible to recommend accurate sound source adjustment values for the first service to users who access after training has already been completed.

If the above value is received, the user terminal 200 modifies the user voice by generating a custom sound source adjustment value based on the received genre, tone, and pitch.

In this case, the user terminal 200 may correct the pre-stored sound source adjustment value by interworking with the singer voice information of the comparative singer based on the custom sound source adjustment value. Through this, it is possible to generate a user sound source to suit the user's taste.

At this time, the mixing condition value and the mastering condition value for generating the user sound source are set as output values, and the accuracy of the mixing condition value and the mastering condition value is increased in the process of generating the user sound source through the voice information of the new user. .

At this time, the machine learning model may be built in the user terminal 200, but may also be implemented in the central server 100 if necessary.

On the other hand, in another optional embodiment, after the step (S330), the user terminal 200 uploads the user sound source to the central server, and provides the user sound source by streaming to another user terminal.

6 is an operation flowchart illustrating a process of mixing and contesting a sound source through an interface provided by a platform according to an embodiment of the present invention.

Referring to FIG. 6 , the central server 100 creates a user profile through user information (S410).

At this time, the user profile is displayed on the user terminal by the profile interface.

In the profile interface, as shown in FIG. 8 , at least one of the user's photo and the number of followers/following is displayed in the profile interface first area 110 .

In addition, the list of the user sound source uploaded by the user terminal is displayed in the second area 120 of the profile interface. By displaying the number of views for each user sound source and the revenue generated by the user sound source, the user can check which sound source among his user sound sources is the most popular or has a high yield.

Also, in the third area 140 of the profile interface, an option for selecting an interface is given.

Meanwhile, in an optional embodiment, before step S410 , the central server 100 provides a questionnaire interface for receiving user information to the user terminal 200 .

In this case, the questionnaire interface provides options for a preset question, and classifies the user's tendency toward songs according to the selected options. Based on the classified tendencies, the quality of services to be provided in the future will be improved.

Next, when the central server 100 receives the user sound source generated by the sound source production interface from the user terminal 200, it matches the user profile and stores it (S420).

In this case, the sound source production interface may be composed of a voice receiving interface, a mixing setting interface, and a mastering setting interface.

First, the voice receiving interface corresponds to an interface for receiving at least one of a user's voice or video.

At this time, if necessary, the MR list 210 is provided as shown in FIG. 9, and the user selects and inputs a specific MR sound source 220 corresponding to the song to be sung.

Referring to FIG. 10 , information about an image being recorded in real time may be provided to the first area 230 of the voice receiving interface.

Lyrics of a song corresponding to the voice information are provided in the second area 231 of the voice reception interface, thereby providing an environment in which a user can sing a song while viewing the lyrics.

At least one button for operating the voice reception interface may be provided in the third area 240 of the voice reception interface. For example, "recording", "camera switching", "screen effect setting", etc. may be included, and may be provided in the form of an icon that a user can easily recognize.

Next, the mixing setting interface may modify a mixing adjustment value for mixing the MR sound source and voice information.

Hereinafter, the mixing setting interface will be described with reference to FIGS. 11A and 11B.

In this case, in the mixing setting interface, the mixing adjustment value may include at least one of a vocal sync value, a master volume option value, and an edit value.

Specifically, an option for selecting and editing any one of a vocal sync value, a master volume option value, and an edit value may be provided in the first area 250 of the mixing setting interface. Accordingly, the user selects by inputting any one of the “vocal sync value”, “master volume value”, and “edit value” according to whether or not the user intends to modify it.

In the second area 260 of the mixing setting interface, waveforms of the MR sound source and voice information are mapped and arranged, and a time value for determining the synchronization of the MR sound source and voice information is provided as visual information.

At least one button for adjusting any one of a vocal sync value, a master volume value, and an edit value is provided in the third area 251 of the mixing setting interface. In this case, the shape or number of buttons provided does not limit the scope of the present invention because it may be provided in a form suitable for adjusting the above numerical values.

For example, in the case of FIG. 11A, it is an interface for correcting the sync of the sound source. Accordingly, the third area 251 of the mixing setting interface is provided with an input button capable of moving or skipping the sync of the sound source in units of time. Meanwhile, in the case of FIG. 11B, it is an example of an interface for adjusting the master volume of voice information and MR sound source. A pair of rotary buttons for adjusting the volume of the MR sound source or the voice sound source in a specific section of the mixed sound source may be provided in the third area 251 of the mixing setting interface. As such, the shape and number of input buttons provided for setting the mixing value and the mastering value of the present invention may be provided in a form that the user can intuitively see and determine.

Next, the mastering setting interface may modify a mastering adjustment value for mastering at least one of the MR sound source and voice information.

In this case, the mastering adjustment value may include, for example, at least one of doubling, compressor, equalizer, reverb, delay, and limiter values.

The form of the mastering setting interface will be described with reference to FIG. 11C as follows.

An option for selecting and editing any one of the doubling, compressor, equalizer, reverb, delay and limiter values is provided in the first area 252 of the mastering setting interface. The user may select the mastering setting to be modified by touch input.

The second area 261 of the mastering setting interface may be provided so that a waveform of a user sound source is arranged and a position of a section to be edited is visually provided or a specific section can be selected.

At least one button for adjusting any one of the doubling, compressor, equalizer, reverb, delay and limiter values may be provided in the third area 253 of the mastering interface.

In this case, since the shape and number of buttons provided through the third area 253 may vary depending on the value to be modified, the scope of the invention is not limited. For example, a rotary button shown in FIG. 11B may be provided in the third area 253 of the mastering interface in order to adjust the doubling and the compressor.

Finally, a contest is performed through a plurality of user terminals received from other user terminals (S430).

In this case, the central server 100 provides the user's sound source to the listener terminal and provides a contest interface for performing the contest.

Specifically, when the contest interface is described with reference to FIG. 12 , the contest interface displays a list 330 of at least one user sound source in which a contest is in progress.

In addition, when the listener terminal selects a specific user sound source included in the list of user sound sources, song information and streaming of the specific user sound source are provided. In this case, the song information includes at least one of a user profile, the name of the original song, the singer's name of the original song, a description of the original song, a thumbnail, image information, and a value of preference given to a specific user's sound source.

In addition, when a winning sound source is selected based on the preference obtained from the listener terminal for each of the user sound sources for a predetermined period, the selected winning sound source is displayed (310, 320) on the contest interface for a predetermined period.

At this time, as shown in FIG. 13 , the user's profile information 340 and comments 350 are received from the user terminal 200 and displayed 360 along with other user sound sources and the number of wins generated by the user. have.

7 is an operation flowchart illustrating a process of generating revenue and distributing revenue through a sound source, according to an embodiment of the present invention.

The following is an example for explaining the generation and flow of revenue. In the case of the conventional sound source, in the case of the generated revenue, the music distributor divides 30% and the copyright association obtains 10%, and the music distributor pays 20% of the original revenue, and the agency pays 80% of the commission. By taking each of these, the revenue that the creator of the soundtrack has will be greatly reduced. On the other hand, even in the case of video content such as YouTube, YouTube, copyright associations, music (video) distributors, and entertainment companies have a portion of the revenue, so the ratio of revenue that the actual content creator has is lowered.

Referring to FIG. 7 , the distribution company server 300 generates a profit of 1 million won by disclosing a user sound source to a listener (S510).

As described above, the user sound source delivered to the distributor server 300 in step S510 corresponds to the sound source that the central server 100 wins by performing a contest with a plurality of other user sound sources for a preset period.

If the user's sound source is media composed of sound, the central server 100 transmits it to the distribution company server 300 corresponding to the sound source sales company. If the user's sound source is media composed of a moving picture, the central server 100 transmits it to the distribution company server 300 corresponding to the moving picture streaming company.

Next, the distributor server 300 acquires 30% (300,000 won) of the generated revenue as a commission (or distribution margin) (S520).

At this time, as an optional embodiment, if the copyright of the MR sound source used to generate the user sound source has already been registered, the Copyright Association, etc. will acquire 10% of the revenue (100,000 won) (S5210). However, if a user sound source that does not use data from other copyright holders for the user sound source generates revenue through YouTube, the process may be omitted.

Next, the service subject of the central server 100, which received the proceeds of 600,000 won excluding the commission from the distributor server 300, provides 20% (120,000 won) to the original song distributor, and 50% (240,000 won) of the remaining profits is obtained (S530).

In an optional embodiment, when at least one user sound source generated by the specific user terminal 200 in step S520 or step S530 is provided to the distributor server 300, the characteristic user terminal 200 in step S540 The distribution ratio of revenue will be adjusted according to the number of user sound sources.

In addition, as another optional embodiment, if a specific user sound source generates revenue greater than or equal to a preset value in step S510 , the distribution ratio of the revenue is adjusted according to the inquiry of the characteristic user sound source in step S540 .

Through the above two functions, the central server 100 can be a means to support excellent creators and at the same time guarantee high profits.

Finally, the creator of the user terminal 200 obtains 50% (240,000 won) of the revenue, thereby completing the distribution of revenue (S540).

Meanwhile, in step S510 , it is possible to request private processing of the specific user sound source delivered to the distributor server 300 by the request of the specific user terminal 200 . Thereafter, when the specific listener terminal occupies more than a preset ratio of revenue generated for a plurality of user sound sources of the specific user terminal 200 in step S520 , the specific user sound source may be provided to the specific listener terminal. In other words, if listener B enthusiastically listens to music with respect to creator A, the private sound source of creator A can only be provided to listener B.

The foregoing description of the present invention is for illustration, and those of ordinary skill in the art to which the present invention pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and likewise components described as distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

100: central server
200: user terminal
300: distributor server

Claims (15)

In the method of providing a user interface for the creation and competition of a user sound source, performed by a central server,
(a) generating a user profile with user information received from a user terminal;
(b) when receiving a user sound source generated by the sound source production interface from the user terminal, matching with the user profile and storing; and
(c) performing a contest through a plurality of user terminals received from different user terminals;
The sound source production interface reproduces the MR sound source selected by the user terminal, receives the user's voice information, and provides a mixing and mastering function necessary to create a user sound source in which the MR sound source and the user voice are combined, and the contest is a method of providing a user interface for generating and contesting a user sound source, which means a process of determining a ranking by receiving preferences from listeners who have listened to a plurality of the user sound sources for a predetermined period. The method of claim 1,
The user profile is displayed on the user terminal by the profile interface, and at least one of a user's photo, the uploaded user sound source, and the number of followers/following is displayed. User interface for creation and competition of user sound sources How to provide. 3. The method of claim 2,
The profile interface lists and displays the user sound source,
A method of providing a user interface for generation and competition of a user sound source, which displays the number of views for each of the user sound sources and revenue by the user sound sources. The method of claim 1,
before step (a)
A questionnaire interface for receiving the user information is provided to the user terminal,
The questionnaire interface provides a choice for a preset question, and classifies the user's propensity for the song according to the selected option. The method of claim 1,
The sound source production interface is composed of a voice receiving interface, a mixing setting interface and a mastering setting interface, a method of providing a user interface for the creation and competition of a user sound source. 6. The method of claim 5,
The voice receiving interface receives at least one of the user's voice or video,
Video information being recorded in real time is provided in a first area of the voice receiving interface, lyrics of a song corresponding to the voice information are provided in a second area, and a third area of the interface for operating the voice receiving interface. At least one or more buttons are provided, a method of providing a user interface for creation and competition of a user sound source. 6. The method of claim 5,
The mixing setting interface corrects a mixing adjustment value for mixing the MR sound source and voice information, wherein the mixing adjustment value includes at least one of a vocal sync value, a master volume option value, and an edit value. How to provide a user interface for creation and competition. 8. The method of claim 7,
The mixing setting interface is
An option for selecting and editing any one of the vocal sync value, the master volume value, and the edit value is provided in the first area;
Waveforms of the MR sound source and voice information are mapped and arranged in a second area, and a time value for determining the synchronization of the MR sound source and voice information is provided as visual information;
At least one button for adjusting any one of the vocal sync value, the master volume value, and the edit value is provided in the third area, a method of providing a user interface for generating and contesting a user sound source. 6. The method of claim 5,
The mastering setting interface modifies a mastering adjustment value for mastering at least one of the MR sound source and voice information, wherein the mastering adjustment value is at least one of doubling, compressor, equalizer, reverb, delay and limiter values. A method of providing a user interface for creation and competition of a user sound source, which is included. 9. The method of claim 8,
The mastering setting interface is
An option for selecting and editing any one of the doubling, compressor, equalizer, reverb, delay and limiter values is provided in the first area,
The waveform of the user sound source is arranged in the second area, and the location of the section to be edited is visually provided or a specific section can be selected,
At least one or more buttons for adjusting any one of the doubling, compressor, equalizer, reverb, delay and limiter values are provided in the third area, a method of providing a user interface for creation and competition of a user sound source. The method of claim 1,
before step (c)
Provide a contest interface for providing the user sound source and performing the contest to a listener terminal,
The listener terminal is a terminal for listening to and evaluating the user sound source, the user interface providing method for the creation and competition of the user sound source. 12. The method of claim 11,
The contest interface displays a list of at least one or more user sound sources in which the contest is in progress, and when the listener terminal selects a specific user sound source included in the list of user sound sources, song information and streaming of the specific user sound source provided,
The song information includes at least one of the user profile, the name of the original song, the singer's name of the original song, the original song description, thumbnail, image information, and the value of preference given to the specific user sound source. How to provide a user interface for 13. The method of claim 12,
When the winning sound source is selected based on the preference obtained from the listener terminal for each of the user sound sources during the predetermined period,
The winning sound source is displayed on the contest interface for a predetermined period, receiving the user's profile information and comments from the user terminal, and displaying it along with other user sound sources and the number of wins generated by the user. A method of providing a user interface for the creation and competition of In the user interface providing device for the creation and competition of the user sound source,
a memory in which a user interface providing program for creation and competition of the user sound source is stored; and
A user interface providing processor for generating and contesting the user sound source by executing the program stored in the memory,
The processor creates a user profile with the user information received from the user terminal, and when receiving the user sound source generated by the sound source production interface from the user terminal, matches and stores the user profile, and a plurality of received from different user terminals The contest is performed through the user terminal of
The sound source production interface reproduces the MR sound source selected by the user terminal, receives the user's voice information, and provides a mixing and mastering function necessary to create a user sound source in which the MR sound source and the user voice are combined, and the contest means a process of determining a ranking by receiving preferences from listeners who have listened to a plurality of the user sound sources for a predetermined period, and a device for mixing and contesting sound sources through an interface provided by a platform. A computer-readable storage medium in which a program is recorded for performing the method of providing a user interface for creation and competition of a user sound source according to claim 1 .

Images