JP2010276794A - Karaoke system and server - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a Karaoke system, and a server or the like, capable of increasing the number of contribution singing sound data presentable to users. <P>SOLUTION: A singer performs first-time singing, and a Karaoke device acquires singing voices as singing sound data for determination, and transmits determination data including the singing sound data for determination to the server. The server records the received singing sound data for determination or the like into a database, determines chorus sound data based on the singing sound data for determination, and transmits the data to the Karaoke device. The Karaoke device outputs a chorus sound based on the received chorus sound data together with a musical sound of a Karaoke composition. Hereby, singers can chorus in second-time singing by using chorus voices determined based on the first-time singing by the singer. Meanwhile, the server records (newly registers) singing sound data for determination in the database as new contribution singing sound data every time the singing sound data for determination is received. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to karaoke, and in particular, to a karaoke system, a server, and the like for outputting singing voices for chorus and chorus.

  2. Description of the Related Art Conventionally, there has been proposed a karaoke apparatus that enables singing and chorusing (hereinafter referred to as “singing”) by outputting singing voices of parts other than a singer's part when performing karaoke music. In such a karaoke apparatus, when the singer sings the main melody part, the singing voice of the harmony part is output, and when the singer sings the harmony part, the singing signal of the main melody part is output. The following Patent Document 1 related to this technology describes a karaoke device that determines a sound range from a singer's singing signal and outputs a singing signal according to the determination result.

JP 9-44171 A

  Along with advances in communication technology and recording technology, a karaoke system has been proposed that can post singing sound data (upload to a server and record it on the server). And it is thought that the interest of a singer who enjoys karaoke can be enhanced by technically combining such a karaoke system and a karaoke apparatus capable of performing singing.

  Here, when constructing a system that provides users with posted singing sound data (posted singing sound data), it is desirable to increase the number of post singing sound data that can be provided as much as possible. It is necessary to provide an environment for posting data.

  An object of this invention is to provide the karaoke system, server, etc. which can solve the said problem.

  In order to achieve the above object, the invention according to claim 1 is a karaoke system comprising a server and a karaoke device capable of communicating with the server, wherein the server sings a posted song sung by the karaoke device. The karaoke apparatus performs a first performance of karaoke music, transmits singing sound data of the performance to the server, and the server transmits the received singing sound data, Recorded in the database as new posted singing sound data, the server determines a part of the singing sound data, and when the server determines a part of the singing sound data, the server uses the singing sound data, and The posted singing sound data is selected from the database, and the server generates the selected posted singing sound data or the generated singing sound data. Sound data is transmitted to the karaoke apparatus as singing singing sound data, and the karaoke apparatus outputs a singing voice using the received singing singing sound data when performing the second performance of the karaoke music. It is characterized by that.

  The invention according to claim 2 is the karaoke system according to claim 1, wherein the karaoke apparatus transmits the singing sound data to the server when the karaoke piece is played to the end. And

  Moreover, the invention which concerns on Claim 3 is a server which can communicate with a karaoke apparatus, Comprising: It has the database which records the contribution song sound data sung by the said karaoke apparatus, The song sound data transmitted from the said karaoke apparatus When the received singing sound data is recorded in the database as new posted singing sound data, the part of the singing sound data is determined, and the part of the singing sound data is determined, the singing sound data is And selecting the posted singing sound data from the database, and transmitting the selected singing sound data or the singing sound data generated from the posted singing sound data to the karaoke apparatus as the singing sound data for singing. And

  According to the first aspect of the present invention, after recording the singing sound data sung in the karaoke apparatus as new posted singing sound data, the singing sound data for singing is transmitted to the karaoke apparatus. Thereby, when a user sings using the singing sound data for heavy singing, the singing sound data (singing sound data of the first performance) used for selection of the singing sound data for heavy singing is new. Since it is recorded in the database as posted singing sound data, the number of posted singing sound data recorded in the database can be reliably increased. Moreover, the posted singing sound data can be used efficiently at the time of heavy singing.

Moreover, according to the invention which concerns on Claim 2, when a karaoke music piece is played to the last, the song sound data of the said performance are transmitted to a server. Thereby, since the singing sound data of the karaoke music piece that has been finished in the middle is not transmitted to the server, network resources and the like can be used effectively.
It should be noted that the case where “the performance of the karaoke music is finished when the follower is played” can also be “the karaoke music has been played to the end”. That is, the singing sound data of the performance is transmitted to the server only when the singing sound data in all the singing sections of the karaoke song can be acquired.

  Moreover, according to the invention which concerns on Claim 3, after recording the song sound data sung in the karaoke apparatus as new contribution song sound data in a database, the song sound data for heavy singing is transmitted to a karaoke apparatus. Thereby, when a user performs singing using the singing sound data for heavy singing, the singing sound data used for selection of the singing sound data for heavy singing (singing sound data of the first performance) is newly posted. Since it is recorded in the database as singing sound data, the number of posted singing sound data recorded in the database can be reliably increased. Moreover, the posted singing sound data can be efficiently used when singing.

It is the figure which showed an example of the structure of a karaoke system. It is the figure which showed an example of the data structure of a contribution song sound database. It is explanatory drawing which showed an example of the flow of information in a karaoke system. It is a flowchart of a karaoke side process. It is a flowchart of a server side process and a chorus sound data transmission process. It is a flowchart of a part determination process. It is a flowchart of a chorus sound data determination process. It is explanatory drawing which showed a mode that the data of a main melody part were converted into the data of a hamori part. It is explanatory drawing which showed a mode that the data of a hamori part were converted into the data of a main melody part. It is a flowchart of provided data selection processing.

  Hereinafter, a karaoke system according to an embodiment of the present invention will be described.

[Outline of Karaoke system]
In the karaoke system according to the present embodiment, it is possible to determine the chorus sound data appropriate for the chorus and output the chorus sound based on the chorus sound data together with the musical sound of the karaoke music.
The singer performs the first singing, the karaoke device acquires the singing voice as the singing sound data for determination, and transmits the determination data including the singing sound data for determination to the server. The server records the determination singing sound data and the like included in the received determination data in a database, determines the heavy singing sound data based on the determination singing sound data, and transmits it to the karaoke apparatus. The karaoke apparatus outputs a chorus sound based on the received chorus sound data together with the musical sound of the karaoke song. Thereby, in the second singing, the singer can perform singing using the singing voice determined based on the first singing of the singer. On the other hand, every time the server receives the determination song sound data, the server records (new registration) the determination song sound data as new posted song sound data, so the posted song sound data recorded in the database, That is, it is possible to reliably increase the number of posted song sound data that can be provided to the user.

[Composition of karaoke stem]
As shown in FIG. 1, the karaoke system includes a karaoke device 100 installed in a guest room of a karaoke store in each place and a server 200 that distributes and manages various information. The karaoke device 100 and the server 200 communicate with each other. Connected via the network. In FIG. 1, there is one karaoke device 100, but actually, a large number of karaoke devices 100 are connected to the server 200.

[Configuration of Server 200]
As shown in FIG. 1, the server 200 includes a control unit 201, a karaoke song database 202, a posted singing sound database 203, and a temporary recording unit 204. The control unit 201 includes a CPU, a RAM, a ROM, and the like. The CPU reads and executes various programs recorded in the ROM, and controls the entire server 200 as a whole. Moreover, since many karaoke apparatuses 100 are connected to the server 200 as above-mentioned, the some karaoke apparatus 100 may be accessed to the server 200 simultaneously. Further, the server 200 can monitor its own load.

  In the karaoke music database 202, music data used for performance of karaoke music is recorded. In addition, main melody reference data and hammer reference data for comparison with later-described determination singing sound data are recorded. Furthermore, singing sound data (prepared in advance) used when playing normal karaoke music is recorded. The singing sound data is a so-called guide melody and is recorded in a MIDI format or a raw sound format. The data structure and the like of the karaoke song database 202 can be a known one and is not directly related to the understanding of the present invention.

In the posted singing sound database 203, “determination data” and “posting data” transmitted from the karaoke apparatus 100 are recorded.
Further, as shown in FIG. 2, the posted singing sound database 203 uses “identification code” as a key, “posted singing sound data”, “music code”, “part”, “poster code”, “posting date”. Is recorded.

The “identification code” is a unique identification code for identifying each posted singing sound data.
The “music code” is an identification code indicating the music name of the posted singing sound data, and the same music code as the karaoke music database 202 is used.
“Part” is an identification code indicating the part of the posted singing sound data, and becomes “main melody” when a melody of the main melody is sung, and becomes “hamomori” when a melody of the hamori is sung.
The “contributor code” is an identification code for identifying a singer who has posted posted singing sound data.
“Posted date” indicates the date and time when the posted singing sound data was posted.

  In the temporary recording unit 204, the singing sound data for determination transmitted from the karaoke apparatus 100 is temporarily recorded, and the recorded singing sound data for determination is used in part determination processing and repetitive sound data determination processing described later. In addition, “reference data” and “candidate data” used in provided data selection processing described later are temporarily recorded.

[Configuration of Karaoke Device 100]
As shown in FIG. 1, the karaoke apparatus 100 includes a remote controller 110 and a commander 120. Note that a plurality of remote controllers 110 may be configured to be able to communicate with the commander 120.
The remote controller 110 includes a control unit 111. The control unit 111 includes a CPU, a RAM, a ROM, and the like. The CPU reads and executes various programs recorded in the ROM, thereby performing overall control of the entire remote control 110.

The commander 120 includes a control unit 121. The control unit 121 includes a CPU, a RAM, a ROM, and the like, and the CPU reads and executes various programs recorded in the ROM, thereby performing overall control of the commander 120. Moreover, the microphone 130 is connected to the commander 120, and the singer's singing voice is acquired as singing sound data and is temporarily recorded in the RAM or the like. In addition, the commander 120 is connected to a speaker 140, and a musical sound of karaoke music and a singing voice for singing are output.
Of the configurations of the remote controller 110 and the commander 120, detailed descriptions of portions that are not directly related to the understanding of the present invention are omitted.

[Information sent and received by the karaoke system]
Next, an example of information transmitted and received by the karaoke system will be described with reference to FIG.

The remote controller 110 accepts a request operation for a song to be sung from a singer (1). Note that this request operation includes an operation for instructing that the user wants to perform a chorus using the chorus sound data.
The remote controller 110 transmits a request signal to the commander 120 (2).
The commander 120 performs the first performance of the karaoke music based on the request signal, acquires the singing voice of the singer as the singing sound data for determination, and temporarily records it in the RAM or the like (3).
When the reproduction of the music ends, the commander 120 creates determination data including the determination singing sound data (4).
The commander 120 transmits the determination data to the server 200 (5).
The server 200 performs part determination processing based on the determination singing sound data included in the received determination data, and determines the part of the singing sound data (6).
The server 200 newly registers the determination singing sound data included in the received determination data as new posted singing sound data in the posted singing sound database 203 (see FIG. 2) together with the determined part information and the like (7). ).
Moreover, this process is performed irrespective of a singer's intention. That is, even if the singer does not want to register his / her determination singing sound data in the posted singing sound database 203, the singing sound data is recorded in the posted singing sound database 203.
Therefore, you may comprise so that the process for confirming whether the said song sound data may be transmitted after said (3). In addition, in this configuration, when it is instructed not to transmit the singing sound data, the processing related to the transmission is not performed, but the following singing sound data cannot be received. You will not be able to perform singing using.

Next, the server 200 performs the repeated sound data determination process based on the singing sound data included in the received determination data, and determines the repeated sound data used when the singer sings (8).
The server 200 transmits the determined chorus sound data to the commander 120 (9). Further, in the transmission of the chorus sound data, identification information indicating to which determination data the chorus sound data corresponds, information indicating a part of the chorus sound data, and the like are attached. This accompanying information is used when post data to be described later is transmitted.
The commander 120 performs the second performance of the karaoke piece based on the request signal, acquires the singing voice of the singer as the singing voice data for posting, and temporarily records it in the RAM or the like (10).
The commander 120 creates posting data including the singing sound data for posting (11).
The commander 120 transmits the post data to the server 200 (12).
The server 200 newly registers the posted singing sound data included in the received posted data in the posted singing sound database 203 (see FIG. 2) as new posted singing sound data (13).
It should be noted that the singer can arbitrarily determine whether or not to perform the processing after the above (11) (that is, the processing for posting the singing sound data of the second singing to the posted singing sound database 203). . In other words, the singing sound data of the first singing must be posted to obtain the singing sound data, but the singing sound data of the second singing is posted (newly registered in the posted singing sound database 203). You can be instructed not to.

  Through the above processing, when a singer performs a karaoke singing using the singing sound data, the singing sound data (singing sound data for determination) of the first singing is always registered in the posted singing sound database 203. Therefore, the karaoke system according to the present embodiment can provide an environment in which more users post singing sound data. In addition, since the part of the singing sound data determined in the part determination process of (6) above is registered in the posted singing sound database 203, the singer indicates which part singed during the first singing. There is no need to input information, and the operability of the user who uses the karaoke system according to the present embodiment can be improved.

[Karaoke equipment processing]
Next, the karaoke side process executed on the karaoke apparatus 100 side will be specifically described with reference to the flowchart of FIG. The karaoke-side processing program is recorded in the ROM in the control unit 111 of the remote controller 110 and the control unit 121 of the commander 120, and is executed by the CPU in the control unit 111 and the CPU in the control unit 121.

In S11, the control unit 111 of the remote controller 110 receives a request operation for a song to be sung from a singer. In addition, when receiving a request operation, the control unit 111 transmits a request signal to the commander 120.
In S12, the control unit 121 of the commander 120 starts playing karaoke music based on the request signal. The singer sings along with the performance of karaoke music.

In S13, the control unit 121 of the commander 120 temporarily records the singing voice of the singer in the RAM or the like as the singing sound data for determination while performing the first performance of the karaoke music.
In S14, the control unit 121 of the commander 120 plays the karaoke piece to the end and ends the reproduction of the karaoke piece. It should be noted that the case where “the performance of karaoke music is finished when the follower is played” is also assumed to be “played karaoke music to the end”. When a performance stop instruction is given during the performance of the karaoke music piece, the control unit 121 ends the karaoke side processing. Thereby, since determination data to be described later is not transmitted to the server 200, the network resources and the like of the karaoke system according to the present embodiment can be effectively utilized.
In S15, the control unit 121 of the commander 120 creates determination data. The determination data includes singing sound data, music code, and contributor code. However, information indicating the sung part is not included in the determination data. Information indicating the part is acquired on the server 200 side by a part determination process to be described later executed on the server 200. By comprising in this way, a singer does not need to input the information which shows which part was sung, and operativity improves. Note that the music code is input at the time of the request operation, and the user ID for logging into the remote controller 110 can be used as the contributor code.
In S <b> 16, the control unit 121 transmits determination data to the server 200.
In S17, the chorus sound data and the accompanying data are received. Here, the accompanying data is generated in S44 of a later-described chorus sound data transmission process executed on the server side.

In S18, the control unit 121 starts the second performance of the karaoke song. In S18, the performance starts from the beginning of the karaoke song. In addition, during the performance of karaoke music, the singing voice of the singer is recorded as the singing sound data for posting.
In S19, the control unit 121 ends the performance of the karaoke song.
In S20, the control unit 121 creates post data. The posting data includes singing sound data for posting, music code, contributor code, and information indicating a part. In addition, the control part 121 can acquire the information which shows a part based on the data accompanying the chorus sound data received by said S17. More specifically, if the accompanying data is information indicating the part of the received singing sound data and the information indicates “main melody”, “hamori” indicates the part of the singing sound data for posting. Information. In addition, if the accompanying data is information indicating the part of the received singing sound data and the information indicates “part”, “main melody” is information indicating the part of the singing sound data for posting. Also, if the accompanying data includes information indicating the part of the singing sound data for determination (result of a part determination process described later executed on the server side), the information directly indicates the part of the singing sound data for posting. It becomes information to show.
In S <b> 21, the control unit 121 transmits post data to the server 200.

[Server-side processing]
Next, server-side processing executed by the server 200 will be specifically described with reference to a flowchart of FIG. The server processing program is recorded in the ROM in the control unit 201 of the server 200 and is repeatedly executed by the CPU in the control unit 201.

In S <b> 31, the control unit 201 determines whether determination data has been received from the commander 120. In this process, if it is determined that determination data has been received (S31: YES), the control unit 201 temporarily records the received determination data in a RAM or the like, and shifts the process to S32.
In S32, the control unit 201 performs a chorus sound data transmission process. In the heavy singing sound data transmission process, registration of the determination singing sound data to the posted singing sound database 203 and transmission of the heavy singing sound data are performed. Details of the chorus sound data transmission processing will be described later.
On the other hand, if it is determined in S31 that the determination data has not been received (S31: NO), the control unit 201 shifts the process to S33.
In step S <b> 33, the control unit 201 determines whether post data has been received from the commander 120. In this process, if it is determined that post data has not been received (S33: NO), the control unit 201 ends the server-side process.
On the other hand, if it is determined in S33 that post data has been received (S33: YES), the control unit shifts the process to S34.
In S <b> 34, the control unit 201 newly registers the posted song sound data and the like in the posted song sound database 203 using the received posted data. More specifically, in order to adapt to the data structure shown in the posted singing sound database 203 of FIG.
(1) A new “identification code” shown in FIG. 2 is generated,
(2) The singing sound data for posting included in the received posting data is “posted singing sound data” shown in FIG.
(3) The music code included in the received post data is “music code” shown in FIG.
(4) Information indicating the part included in the received post data is “part” shown in FIG.
(5) The poster code included in the received post data is “poster code” shown in FIG.
(6) The “post date” shown in FIG. 2 is generated with reference to a timer (not shown) included in the server 200.
Note that the karaoke system according to the present embodiment may be configured to include a timer (not shown) on the karaoke apparatus 100 side so that information indicating the “post date” is included in the post data.

[Song sound data transmission processing]
Next, the chorus sound data transmission process executed in S32 of the server side process will be described with reference to the flowchart of FIG.
In S41, part determination processing is executed. In the part determination process, the part of the singing sound data for determination included in the received determination data is determined. Details of the part determination process will be described later.
In S <b> 42, the control unit 201 newly registers singing sound data for determination and the like in the posted singing sound database 203 using the received determination data. More specifically, as applied to the data structure shown in the posted song sound database 203 of FIG.
(1) A new “identification code” shown in FIG. 2 is generated,
(2) The determination singing sound data included in the received determination data is “posted singing sound data” shown in FIG.
(3) The music code included in the received determination data is “music code” shown in FIG.
(4) The part determined by the part determination process in S41 is “part” shown in FIG.
(5) The poster code included in the received determination data is “poster code” shown in FIG.
(6) The “post date” shown in FIG. 2 is generated with reference to a timer (not shown) included in the server 200.
Note that the karaoke system according to the present embodiment may be configured to include a timer (not shown) on the karaoke apparatus 100 side so that information indicating the “post date” is included in the post data.
In step S43, the control unit 201 performs a chorus sound data determination process. In the repeated sound data determination process, the repeated sound data to be transmitted to the commander 120 is determined based on the determination song sound data included in the received determination data. Details of the chorus sound data determination process will be described later.
In S44, the control unit 201 transmits the repeated sound data determined in S43 to the commander 120. Further, in the transmission of the chorus sound data, identification information indicating to which determination data the chorus sound data corresponds, information indicating a part of the chorus sound data, and the like are attached. This information is based on the result of the part determination process executed in S41. More specifically, the accompanying information is generated by referring to the contents of a “provided flag” (details will be described later in part determination processing) secured in the RAM. Moreover, you may comprise so that the result of a part determination process (namely, the information which shows the part of the singing sound data for contribution) may be attached to the said heavy sound data.

[Part judgment processing]
Next, the part determination process executed in S41 of the chorus sound data transmission process will be described with reference to the flowchart of FIG.

In S <b> 51, the control unit 201 reads the singing sound data for determination from the temporary recording unit 204 for a predetermined section. For example, every time S51 is executed, the reading is sequentially performed from the beginning of the singing section. That is, when S51 is executed for the first time, the first to the predetermined section of the singing section is read, and when it is executed next, the section from the next to the predetermined section is read to the predetermined section.
Moreover, you may make it read preferentially from the section effective for the comparison with main melody reference | standard data and hammer reference data instead of from the beginning of a song section.

In S52, the control unit 201 reads the main melody reference data of the same music as the determination singing sound data from the karaoke music database 202 and compares it with the determination singing sound data using a known technique. In addition, when S51 is performed a plurality of times and the singing sound data for determination of a plurality of predetermined sections are read, a comparison process using the main melody reference data of the plurality of sections is performed.
In S <b> 53, the control unit 201 reads the reference data of the same music as the determination singing sound data from the karaoke music database 202 and compares it with the determination singing sound data using a known technique. In addition, when S51 is performed a plurality of times and the singing sound data for determination of a plurality of predetermined sections are read, a comparison process using the reference data of the plurality of sections is performed.

In S54, the control unit 201 determines whether or not the part determination of the determination singing sound data has been made based on the comparison result of S52 and S53. In this process, when it is determined that the part determination cannot be performed (S54: NO), the control unit 201 shifts the process to S55. In S54, if it is determined that the singing sound data for determination has high similarity with only one of the main melody reference data or the hammer reference data, it is determined that the part determination has been made, and according to the type of similarity. Thus, the part determination result is “main melody” or “hamori”.
In step S55, the control unit 201 determines whether a predetermined time has elapsed since the start of the part determination process. In this process, when it is determined that the predetermined time has not elapsed (S55: NO), the control unit 201 returns the process to S51.
On the other hand, in this process, when it is determined that the predetermined time has elapsed (S55: YES), the control unit 201 shifts the process to S56.

  In step S56, the control unit 201 executes error processing. In the error process, the control unit 201 creates display data indicating that the part determination cannot be performed within a predetermined time, and transmits the display data to the karaoke apparatus 100. Moreover, in the karaoke apparatus 100, the process for making a singer select the sung part can be performed, and the control part 201 can recognize the part of the song sound data for determination by this. Moreover, the control part 201 will complete | finish a chorus sound data transmission process, after complete | finishing an error process.

  In S56, when the display data is transmitted to the karaoke apparatus 100, the karaoke apparatus 100 receives the display data at a timing between S16 and S17 of the karaoke side processing described above. Here, the karaoke apparatus 100 displays a message indicating that “part determination processing could not be performed” or the like on the display of the commander 120 or the remote controller 110 based on the received display data, and the singing sound data for determination Performs processing to input part information. And if the input of part information is received, the karaoke apparatus 100 will transmit the said information to the server 200. FIG. Thereby, the control part 201 of the server 200 can recognize the part of the song sound data for determination.

On the other hand, if it is determined in S54 that the part has been determined, and it is determined that the part is the main melody part, the control unit 201 shifts the process to S57.
In S <b> 57, the control unit 201 sets a “harm” value indicating that the repeated sound data of the hammer part is to be provided to the “provided flag” secured in the RAM in the control unit 201.
In S54, when it is determined that the part has been determined and it is determined that the part is a hammer part, the control unit 201 shifts the process to S58.
In S <b> 58, the control unit 201 sets a “main melody” value indicating that the chord sound data of the main melody part is provided in the “provide flag”.

[Casting sound data decision processing]
Next, the chorus sound data determination process executed in S43 of the chorus sound data transmission process will be described with reference to the flowchart of FIG.

  In S <b> 71, the control unit 201 determines whether or not the provision flag is “harm” (that is, whether or not the hammer part's repeated sound data should be provided). In this determination, when it is determined that the provision flag is “harm” (S71: YES), the control unit 201 shifts the process to S72.

In step S <b> 72, the control unit 201 determines whether or not post singing sound data (hereinafter referred to as “hemo tune data”) of the humming part of the same music as the determination singing sound data is posted to the singing singing sound database 203. . In this process, if it is determined that the same song music data has been posted (S72: YES), the control unit 201 shifts the process to S73.
In step S <b> 73, the control unit 201 extracts the humming song data of the same song from the posted singing sound database 203 and records it as “candidate data” in the temporary recording unit 204. In S73, it is assumed that a plurality of pieces of humming music data are extracted.

  In S74, the control unit 201 converts the singing sound data for determination (main melody part) into a hammer part and records it as “reference data” in the temporary recording unit 204. That is, reference data is created. As shown in FIG. 8, the difference value between the hamori reference data and the main melody reference data recorded in the karaoke song database 202 is added to the main melody part data (determining singing sound data) to obtain the hamori part data. Can be generated. Note that the hamori part data may be generated from the main melody part data by another known method.

In S75, the control unit 201 executes a provided data selection process. By the provided data selection processing, “candidate data” that is most similar to the singing sound data for determination converted into the hammer part is selected from the “candidate data” (hammori song data) in S73. Then, the selected “candidate data” becomes “single sound data” transmitted to the karaoke apparatus 100. Details of the provided data selection process will be described later. Further, in S73, when only one piece of song data is extracted, the processing of S74 and S75 is not executed, and the one piece of song data becomes “song sound data” transmitted to the karaoke apparatus 100. .
In the following, a series of processing of S74 and S75 may be referred to as “first processing”.

Further, the “repeated sound data” can also be determined by the following processing (the following processing may be referred to as “second processing”).
(1) The hamori song data extracted in S73 is converted into post melody data of the main melody part (hereinafter referred to as “main melody data”), and the converted main melody data is set as “candidate data”. The “candidate data” is used for comparison with the determination singing sound data (main melody part). As shown in FIG. 9, the main melody data can be generated by adding the difference value between the hamori reference data and the main melody reference data recorded in the karaoke song database 202 to the hamori song data. It should be noted that the conversion of the main song data from the hammer song data may be performed by other known methods.
(2) The provided data selection process is executed with the singing sound data for determination as “reference data”. Thereby, one data is determined from among a plurality of candidate data, and the humor song data corresponding to the determined candidate data (main melody data) becomes the “song sound data” transmitted to the karaoke apparatus 100.

Here, when the first process is used, the part conversion process (main melody part → hamo part) is performed only on the determination singing sound data, so the processing amount is small and the load on the server 200 can be reduced. it can.
On the other hand, when the second process is used, the amount of processing increases because the part conversion process (harmory part → main melody part) is performed on a plurality of posted singing sound data, but this is a criterion for selecting provided data. Since the singing sound data for determination is used as it is as “reference data” (that is, the processing is not performed on the singing sound data for determination), the provided data selection process with high accuracy can be performed.

  Further, both the first processing and the second processing may be executed, and the processing may be switched according to the load of the server 200. In other words, the first process may be executed when the load on the server 200 is high, and the second process may be executed when the load is not so.

On the other hand, in S72, when it is determined that the same song music data is not posted (S72: NO), the control unit 201 shifts the process to S76.
In S <b> 76, it is determined whether or not the main melody data of the same music as the determination singing sound data is posted in the posted singing sound database 203. In this process, when it is determined that the main melody data of the same music is posted (S76: YES), the control unit 201 shifts the process to S77.

In step S <b> 77, the control unit 201 extracts main melody data of the same music from the posted singing sound database 203. In S77, it is assumed that a plurality of main melody data is extracted. The extracted main melody data is set as “candidate data”.
In S78, the control unit 201 executes a provided data selection process. One data (main melody data) is determined from the plurality of candidate data by the provided data selection process.

In step S79, the control unit 201 converts the main melody data determined in step S78 into hammer song data. As shown in FIG. 9, the hamori music data can be generated by adding the difference value between the main melodic reference data and the hamori reference data recorded in the karaoke music database 202 to the main melodic data. Note that conversion of the main melody data to the hamori music data may be performed by other known methods.
Also, the converted song data data becomes “singing sound data” transmitted to the karaoke apparatus 100.

On the other hand, when it is determined in S76 that the main melody data of the same music as the singing sound data for determination is not posted (S76: NO), the control unit 201 shifts the process to S80.
In step S <b> 80, the control unit 201 extracts singing sound data of the same music from the karaoke music database 202. The extracted singing sound data becomes “single sound data” transmitted to the karaoke apparatus 100.

  On the other hand, in S71, when it is determined that the provision flag is not “harm” (that is, “main melody”) (S71: NO), the control unit 201 shifts the process to S81.

In step S <b> 81, the control unit 201 determines whether or not the main melody data of the same music as the determination singing sound data is posted in the posted singing sound database 203. In this process, when it is determined that main melody data of the same music is posted (S81: YES), the control unit 201 shifts the process to S82.
In S <b> 82, the control unit 201 extracts main melody data of the same music from the posted singing sound database 203 and records it as “candidate data” in the temporary recording unit 204. In S82, a plurality of main melody data are extracted.

  In S83, the control unit 201 converts the singing sound data for determination (hamo part) into the main melody part and records it as “reference data” in the temporary recording unit 204. That is, reference data is created.

In step S84, the control unit 201 executes a provided data selection process. By the provided data selection process, “candidate data” most similar to the singing sound data for determination converted into the main melody part is selected from the “candidate data” (main melody data) in S82. Then, the selected “candidate data” becomes “choral sound data” transmitted to the karaoke apparatus 100. In S81, when only one main melody data is extracted, the processes of S83 and S84 are not executed, and the one main melody data becomes “song sound data” transmitted to the karaoke apparatus 100. .
Hereinafter, the series of processes in S83 and S84 may be referred to as “third process”.

In addition, the “repeated sound data” can be determined by the following processing (the following processing may be referred to as “fourth processing”).
(1) The main melody data extracted in S82 is converted into hammer music data, and the converted hammer music data is set as “candidate data”. The “candidate data” is used for comparison with the determination singing sound data (humor part).
(2) The provided data selection process is executed with the singing sound data for determination as “reference data”. Thereby, one data is determined from among a plurality of candidate data, and the main melody data corresponding to the determined candidate data (humor song data) becomes “repeated sound data” transmitted to the karaoke apparatus 100.

Here, when the third process is used, the part conversion process (harm part → main melody part) is performed only on the determination singing sound data, so the processing amount is small and the load on the server 200 can be reduced. it can.
On the other hand, when the fourth process is used, the amount of processing increases because part conversion processing (main melody part → humor part) is performed on a plurality of posted singing sound data, but this is a criterion for selecting provided data. Since the singing sound data for determination is used as it is as “reference data” (that is, the processing is not performed on the singing sound data for determination), the provided data selection process with high accuracy can be performed.

  Further, both the third process and the fourth process may be executed, and the process may be switched according to the load of the server 200. In other words, the first process may be executed when the load on the server 200 is high, and the second process may be executed when the load is not so.

On the other hand, if it is determined in S81 that the main melody data of the same music has not been posted (S81: NO), the control unit 201 shifts the process to S85.
In S <b> 85, it is determined whether the humming data of the same music as the determination singing sound data is posted in the posted singing sound database 203. In this process, when it is determined that the same song music data has been posted (S85: YES), the control unit 201 shifts the process to S86.

In step S <b> 86, the control unit 201 extracts hamori music data of the same music from the posted singing sound database 203. In S86, a plurality of main melody data are extracted. Further, the extracted song data data is referred to as “candidate data”.
In step S87, the control unit 201 executes provided data selection processing. By the provided data selection processing, one data (harmong song data) is determined from among a plurality of candidate data.

  In S88, the control unit 201 converts the hammer music data determined in S87 into main melody data. Further, the converted main melody data is “single sound data” transmitted to the karaoke apparatus 100.

On the other hand, in S85, when it is determined that the same song music data as the determination singing sound data is not posted (S85: NO), the control unit 201 shifts the process to S89.
In S89, the control unit 201 extracts the singing sound data of the same music from the karaoke music database 202. The extracted singing sound data becomes “single sound data” transmitted to the karaoke apparatus 100.

[Provided data selection process]
Next, the provided data selection process executed in S75, S78, S84, and S87 of the repeated sound data determination process will be described with reference to the flowchart of FIG.
In step S <b> 91, the control unit 201 acquires the singing sound data for determination from the temporary recording unit 204 for a predetermined section.
In S92, the control unit 201 compares the singing sound data for determination with each candidate data.

  In step S93, the control unit 201 determines whether or not the provision data can be determined among the candidate data. This determination is made based on whether one candidate data closest to the determination singing sound data has been identified. For example, when a general karaoke scoring process is performed and one candidate data is stably in the highest rank in a plurality of time intervals, it can be determined that “one closest candidate data has been identified”. it can. In this process, when it is determined that the provision data can be determined (S93: YES), the control unit 201 ends the provision data selection process. On the other hand, when determining that the provided data cannot be determined (S93: NO), the control unit 201 shifts the process to S94.

In S94, the singing sound data for determination is acquired from the temporary recording unit 204 for a predetermined time. The determination singing sound data acquired in this process is different from the determination singing sound data acquired in S91. When this process is executed a plurality of times, each determination singing sound data is obtained. The data are different from each other.
In S95, the control unit 201 compares the singing sound data for determination (obtained in S91 and S94) with each candidate data.

  In S <b> 96, the control unit 201 determines whether or not the provision data can be determined among the candidate data. In this process, when it is determined that the provision data can be determined (S96: YES), the control unit 201 ends the provision data selection process. On the other hand, when determining that the provided data cannot be determined (S96: NO), the control unit 201 returns the process to S94. Thus, until the provision data is determined, the comparison with the candidate data is performed based on the singing sound data for determination newly recorded in the temporary recording unit 204.

As described above, according to the present embodiment, the singer performs the first singing, the karaoke apparatus 100 acquires the singing voice as the singing sound data for determination, and the determination data including the singing sound data for determination. Transmit to server 200. The server 200 records the received determination singing sound data or the like in the posted singing sound database 203, determines the heavy singing sound data based on the determination singing sound data, and transmits it to the karaoke apparatus 100. The karaoke apparatus 100 outputs the chorus sound based on the received chorus sound data together with the musical sound of the karaoke music. Thereby, in the second singing, the singer can perform singing using the singing voice determined based on the first singing of the singer. On the other hand, each time the server 200 receives the determination singing sound data, the server 200 records (newly registers) the determination singing sound data as new posted singing sound data in the database, and thus the posting recorded in the posted singing sound database 203. The number of singing sound data, that is, the number of posted singing sound data that can be provided to the user can be reliably increased. Thereby, an environment where more users post singing sound data can be provided.
And the contribution karaoke sound data which can be provided increase, and a karaoke system attractive to a user can be constructed. Furthermore, if the karaoke system according to the present embodiment is applied to UGC (User-Generated Content), it can contribute to the construction of a UGC system having abundant contents, and the UGC system can be activated.

  In addition, when the singing sound data for determination is determined to be the main melody part (harmonic part), if the posted singing sound data of the harmony part (main melody part) appropriate for repeated singing is recorded, The singing voice based on it is output when playing karaoke music. Furthermore, when there is no post singing sound data of a harmony part (main melody part) suitable for repeated singing, the post singing sound data of the main melody part (harmony part) is selected, and the harmony part (singing part) generated from the singing sound data is selected. Singing sound based on the singing sound data of) is output when the karaoke music is played. Thereby, the posted singing sound data can be effectively used when singing. Further, by comparing the candidate song data with the judgment song sound data as a reference for comparison, the song sound data transmitted according to the way of singing changes, so that the interest of the singer can be enhanced.

  The present invention is not limited to the above-described embodiment, and it goes without saying that various improvements and modifications can be made without departing from the scope of the present invention.

Further, each flowchart described above is merely an example, and the processing may be realized by another flowchart as long as a result equivalent to the processing of each flowchart can be obtained.
Further, the present invention can be realized as each method relating to the above-described remote controller, commander, and server, a program for causing a computer to execute the method, a recording medium recording the program, and the like.

100 ... Karaoke device 110 ... Remote controller, 111 ... Control unit,
120 ... Commander, 121 ... Control unit, 130 ... Microphone, 140 ... Speaker 200 ... Server, 201 ... Control unit,
202 ... Karaoke music database, 203 ... Posted singing sound database

Claims (3)

A karaoke system comprising a server and a karaoke device capable of communicating with the server,
The server has a database for recording posted singing sound data sung by the karaoke device,
The karaoke device performs a first performance of karaoke music, transmits singing sound data of the performance to the server,
The server records the received song sound data as new posted song sound data in the database,
The server determines a part of the singing sound data,
When the server determines the part of the singing sound data, the server uses the singing sound data to select posted singing sound data from the database,
The server transmits the selected singing sound data or the singing sound data generated from the posted singing sound data to the karaoke apparatus as the singing sound data for singing,
When the karaoke device performs the second performance of the karaoke music, the karaoke device outputs a singing voice using the received singing sound data for heavy singing.
Karaoke system characterized by that. The karaoke device transmits the singing sound data to the server when the karaoke music piece is played to the end.
The karaoke system according to claim 1. A server that can communicate with a karaoke device,
Having a database for recording posted singing sound data sung by the karaoke device;
Receiving singing sound data transmitted from the karaoke device,
Record the received singing sound data as new posted singing sound data in the database,
Determining the part of the singing sound data;
When determining the part of the singing sound data, using the singing sound data, select the posted singing sound data from the database,
Transmitting the selected posted singing sound data or the singing sound data generated from the posted singing sound data to the karaoke apparatus as singing sound data for singing,
A server characterized by that.

Images