JP2015045823A - Submission music performance system and submission music performance method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily and smoothly perform singing of a music even if a singing user does not know a melody line of the submission music of a submission user.SOLUTION: A communication karaoke system 1 stores music data 224, music score information 222, and text data 223 prepared by a first submission user as first submission data, stores singing voice data by a second submission user as second submission data, determines whether the singing voice data is included in the first submission data in which acquired music data 224 is included, determines the presence/absence of knowledge for a singing melody of the music data based on singing history information of a specific singing user, and when the singing voice data is not included in the first submission data and there is no knowledge for the singing melody of the music data 224, a guide vocal voice is generated using the singing voice data of the second submission user included in the second submission data, and reproduced together with the music data.

Description

  The present invention relates to a posted music performance system and a posted music performance method for playing original music posted by a user.

  In a system including a server and a karaoke device connected to the server, a service that allows a user to view a song video posted by a singer (singing user) in the server is already known. (For example, refer to Patent Document 1).

JP 2012-73310 A

  By the way, in recent years, a service that allows an original song for singing created by a user (contributing user) to be posted on a server and that allows other users (singing users) to sing the original song is being considered. . Since the music posted in this way is the original work of the posting user, even if the singing user tries to sing along with the playback of the posted music, the melody line is not understood as it is, and it may be difficult to sing. There was sex.

  An object of the present invention is to provide a posted music performance system and a posted music performance method in which a singing user can easily and smoothly sing the music even when the singing user does not know the melody line of the posted music of the posting user. There is to do.

  In order to achieve the above object, the posted music performance system of the first invention transmits posted music data, musical score information of singing melody, and lyrics data related to the first music created by the first posting user. In response to the transmission from the first posting transmission means and the first posting transmission means, at least the posted music data, the score information, and the lyrics data, together with the music identification information of the first music, the first posting data At least in response to the transmission from the second posting transmission means, the second posting transmission means for transmitting the singing voice data by the second posting user related to the desired second music, , Second post storage means for storing the singing voice data as second post data, singing history storage means for storing singing history information of each of a plurality of singing users, and identification Based on the instruction of the singing user, the posted music acquisition means for acquiring the posted music data and the lyrics data included in the first posted data stored in the first posting storage means from the first posting storage means; Singing voice determination for determining whether or not corresponding singing voice data is included in the first posting data including the posted music data acquired by the posted music acquisition means based on an instruction of a specific singing user Singing history acquisition means for acquiring singing history information of the corresponding specific singing user from the singing history storage means, and the singing acquired by the singing history acquisition means based on an instruction of the specific singing user Based on the history information, the specific singing user for the singing melody of the posted music data acquired by the posted music acquisition means. Melody knowledge determination means for determining presence / absence of knowledge, and the singing voice determination means determine that the singing voice data is not included in the first post data, and the melody knowledge determination means determines the posted music data. When it is determined that there is no knowledge of the specific singing user with respect to the singing melody, the second posting data is read from the second posting storage means, and music identification information, score information, By comparing any of the lyric data with any of the music identification information, the score information, and the lyric data of the first post data stored in the first post storage means, the first post data and The second posting data of the same music is specified, and the second posting data of the second posting user included in the second posting data of the same music as the specified first posting data Using the singing voice data, the guide vocal generating means for generating the guide vocal sound of the music, and the posted music data acquired by the posted music acquisition means for the guide vocal sound generated by the guide vocal generating means. And a voice / music piece reproducing means for reproduction together.

  In this invention, the other user (singing user) can browse so that other users (singing user) can sing by posting the original music for singing which the user (1st contribution user) created personally.

  That is, when the first posting user creates a music piece, the posted music data, the musical score information of the singing melody (melody), and the lyric data related to the created music piece are transmitted by the first posting transmission means. In response to the transmission, post data (first post data) including at least the post music data, the score information, and the lyrics data is stored in the first post storage means.

  At this time, since such first posted data is the original work of the first posted user, if the singing user tries to sing along with the reproduction of the posted music data and the display of the lyrics data, The melody line is unknown, and it may be difficult to sing.

  Therefore, in the present invention, guide vocals are generated based on the score information. In that case, the singing voice data by the posting user (second posting user) who posted the singing voice of the same music as the singing user is trying to sing (that is, the singing voice of another person when viewed from the first posting user) The guide vocal is generated using However, if the singing user has sang once or has seen others singing, the above-mentioned guide vocal is not generated. Also, when the first post data happens to contain singing voice data, the guide vocal is not generated in the same manner (because the melody line can be confirmed as it is based on the singing voice data).

  That is, first, according to an instruction from a specific singing user, posted music data and lyrics data included in the first posted data are acquired from the posted storage means by the posted music acquisition means. Thereafter, it is determined by the singing voice determination means whether or not the singing voice data is included in the first posted data related to the acquired posted music data.

  On the other hand, the singing history information of each of the plurality of singing users is stored in advance in the singing history storage means. And according to the instruction | indication from the said specific song user, the song history acquisition means acquires the song history information of the specific song user from the song history storage means. Thereafter, based on the acquired singing history information, the melody knowledge determination means determines whether or not the specific singing user has knowledge of the singing melody of the posted music data (for example, whether there is a specific singing user's own singing history, Whether there is a singing history of another user simultaneously used with the specific singing user, etc.).

  In the determination of the singing voice determination means and the melody knowledge determination means, when the singing voice data is not included in the first posted data and there is no knowledge of a specific singing user for the posted music data Is difficult to sing due to the unknown melody line. Therefore, in this case, the second posting data by the second posting user is read out by the guide vocal generating means, and the music identification information (or score information or lyrics data) of the second posting data, The second contribution of the same music as the first contribution data is compared with the music identification information (or score information or lyrics data) of the first contribution data by the first contribution user stored in the one contribution storage means. Data is identified. Then, using the second posting user's singing voice data included in the second posting data of the same music, a guide vocal voice is generated (in other words, since it is the same music, the second posting user's singing voice is generated). Is used as a guide vocal voice as is). The generated guide vocal voice is reproduced together with the posted music data by the voice / music reproducing means.

  As a result, in the present invention, even if the singing user does not know the melody line of the posted music data of the first posting user, the music can be sung easily and smoothly. Therefore, convenience can be improved.

  2nd invention has the singing genre determination means which determines the singing genre of the said specific singing user based on the said singing history information acquired by the said singing history acquisition means in the said 1st invention, The said guide vocal The generating means generates the guide vocal voice using the singing voice data of the second posting user corresponding to the singing genre determined by the singing genre determining means.

  Thereby, when generating the guide vocal voice using the singing voice data of the second posting user in the guide vocal generating means, the guide vocal voice of a more optimal voice mode that matches the singing preference of the specific singing user is generated. can do. As a result, the convenience can be further improved.

  A third invention has scoring means for scoring the singing voice data transmitted by the second posting transmitting means in the second invention, and the guide vocal generating means is determined by the singing genre determining means. The guide vocal voice is generated using the singing voice data of the second posting user corresponding to the singing genre, and the scoring result by the scoring means is a predetermined value or more. And

  Thus, when generating the guide vocal sound using the second posting user's singing voice data in the guide vocal generating means, the second vocalizing user's singing voice data is used with certainty and the guide vocal voice is surely used. Can be generated. As a result, the guide function using the guide vocal voice can be improved, and the convenience can be further improved.

  In order to achieve the above object, the fourth invention is a first posting transmission means for transmitting posted music data, singing melody score information, and lyrics data related to the first music created by the first posting user. In response to transmission from the first posting transmission means, at least the posted music data, the score information, and the lyrics data are stored as first posted data together with the music identification information of the first music. Storage means, second posting transmission means for transmitting singing voice data by the second posting user relating to the desired second music piece, and singing history storage means for storing singing history information of each of the plurality of singing users. A posted music performance method executed by a posted processing system, which is included in the first posted data stored in the first posted storage unit based on an instruction from a specific singing user The posted song data and the lyrics data acquired from the first posted storage means, and the posted song data acquired in the posted song acquisition procedure based on the instructions of the specific singing user are included. Singing history information of the corresponding specific singing user based on the singing voice determining procedure for determining whether or not the corresponding singing voice data is included in the first posted data and the instruction of the specific singing user To the singing melody of the posted music data acquired in the posted music acquisition procedure based on the singing history acquisition procedure acquired from the singing history storage means and the singing history information acquired in the singing history acquisition procedure, The melody knowledge determination procedure for determining presence / absence of knowledge of the specific singing user and the song data in the first post data by the singing voice determination procedure When it is determined that the voice data is not included and it is determined in the melody knowledge determination procedure that there is no knowledge of the specific singing user with respect to the singing melody of the posted music data, the second posting memory The second posted data is read from the means, and any one of the music identification information, score information, and lyrics data of the second posted data, and the music identification information of the first posted data stored in the first posted storage means, By comparing the musical score information and the lyric data, the second post data of the same music as the first post data is specified, and the second post of the same music as the specified first post data Using the singing voice data of the second posting user included in the data, a guide vocal generating procedure for generating a guide vocal voice of the music, and the guide vocal A voice / music playback procedure for playing back the guide vocal sound generated in the music generation procedure together with the posted music data acquired in the posted music acquisition procedure.

  According to the present invention, even if the singing user does not know the melody line of the posted user's posted music, the music can be easily and smoothly sung.

It is a functional block diagram showing the whole structure of the communication karaoke system concerning one Embodiment of this invention. It is a sequence diagram showing the flow of data and signals and the processing procedure in the external terminal, the remote controller, the apparatus main body of the karaoke apparatus, and the host server. It is explanatory drawing showing an example of the data structure of the posting data memorize | stored in the posting data storage part of the host server. It is a flowchart showing the detailed procedure of step SC0 performed by the control part of the apparatus main body of a karaoke apparatus. It is a flowchart showing the detailed procedure of step SS3 performed by the host server. It is a figure showing an example of each song user's song history memorize | stored in the song history memory | storage part of the host server. It is a flowchart showing the detailed procedure of step SC3 performed by the control part of the apparatus main body of a karaoke apparatus. It is explanatory drawing showing the list of music ID of each user's song audio | speech data memorize | stored in the song posting memory | storage part, and its scoring result.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a functional block diagram showing the overall configuration of the communication karaoke system according to the present embodiment.

  In FIG. 1, a communication karaoke system 1 (corresponding to a posted music performance system and a posting processing system) includes at least one karaoke device (first karaoke device 10A and second karaoke device 10B in this example), a host server 20, And at least one (two in this example) external terminal P.

<Karaoke equipment>
Karaoke devices 10A and 10B (hereinafter, collectively referred to as “karaoke device 10” where appropriate) are installed in a karaoke room KR such as a karaoke store. The karaoke device 10 is a device that provides a karaoke music reproduction service using Musical Instrument Digital Interface (MIDI; registered trademark) data and video data as music data. The karaoke apparatus 10, the host server 20, and the external terminal P are connected to each other so as to be able to transmit / receive information to / from each other via a network NW such as a communication network.

  The karaoke device 10 includes a device main body 100, a remote control 35, and a microphone 30. The apparatus main body 100 and the remote controller 35 are connected to each other so as to be able to transmit / receive information to / from each other via a network such as a wireless or wired LAN. The apparatus main body 100 and the microphone 30 are connected by a wireless line or a wired line.

  The apparatus main body 100 includes a control unit 101, a mass storage device 103, an operation unit 104, a reception unit 105, a sound source 106, a sound control unit 107, a speaker 108, a display unit 109, and a communication control unit 110. And have.

  The control unit 101 includes a CPU (not shown) and a memory such as a RAM and a ROM. The control unit 101 uses various programs stored in advance in the ROM and the large-capacity storage device 103 (control programs for executing processes shown in FIGS. 2 and 7 described later) while using the temporary storage function of the RAM. Include). Thereby, the entire apparatus main body 100 is controlled.

  The mass storage device 103 is composed of, for example, a hard disk drive (HDD). The large-capacity storage device 103 stores various information such as music data (MIDI data), background video data, and lyrics data.

  The operation unit 104 includes, for example, a plurality of keys and switches. The user can perform various operations such as a reservation operation for karaoke music using the operation unit 104 or a remote controller 35 described later.

  The receiving part 105 receives the audio | voice signal by the singer's song output from said microphone 30. FIG.

  The sound source 106 reproduces the music data read from the mass storage device 103 by the control unit 101 and outputs the music data to the audio control unit 107. The voice control unit 107 receives the song data output from the sound source 106, the other user's singing voice read from the mass storage device 103 to generate the guide vocal voice described later, and the reception unit 105. The audio signal input from the microphone 30 is amplified and output to the speaker 108. The speaker 108 outputs the music data and the audio signal (including the guide vocal sound described later) outputted from the audio control unit 107 as audio.

  Hereinafter, the sound source 106, the audio output unit 107, and the speaker 108 are appropriately omitted and referred to as “sound source 106 etc.”.

  The display unit 109 is composed of a liquid crystal display, for example, and displays various videos. In particular, the display unit 109 displays the background video data and the lyrics data read from the large-capacity storage device 103 in synchronization with the reproduction of the music data, as the music data is reproduced by the sound source 106 or the like. Display the corresponding telop.

  The communication control unit 110 controls information communication with the remote controller 35 and the host server 20.

  The remote controller 35 is an operation terminal for a user to perform various operations such as a reservation operation for karaoke music with a plurality of keys and switches.

<Host server>
The host server 20 includes information storage means (not shown) composed of, for example, a large capacity storage device. The host server 20 functionally includes a singing history storage unit 21, a music posting storage unit 22, a singing posting storage unit 23, and a viewing presence / absence determination unit 24. Detailed functions of these functional units will be described later.

<Processing sequence>
In the above, in the communication karaoke system 1 provided with the karaoke apparatuses 10A and 10B according to the present embodiment, the original music for singing personally created by the user (hereinafter referred to as “posting user” as appropriate) is used, for example, for the external terminal P. By using and posting to the host server 20, other users (hereinafter referred to as “singing user” as appropriate) can browse (for example, singing) in the karaoke apparatus 10A. The details will be described below with reference to the sequence diagram of FIG. 2, the apparatus main body 100 of the karaoke apparatus 10A is abbreviated as “apparatus main body 1”, the remote control 35 of the karaoke apparatus 10A is abbreviated as “remote control”, and the apparatus main body 100 of the karaoke apparatus 10B is further referred to as “apparatus”. Abbreviated as “body 2”.

<Music contribution by the first posting user>
That is, when the posting user (corresponding to the first posting user) creates his own original music (corresponding to the first music), the posting data (corresponding to the first posting data) related to the created music is sent from the external terminal P. It is transmitted to the host server 20 (step SP1). The posted data includes music data of the music (= corresponding to posted music data, for example, MIDI data), musical score information of singing melody (melody), and lyrics data. In addition, this contribution data may include the singing voice data of the music data by the posting user's own singing. Note that the external terminal P executing this step SP1 functions as the first posting transmission means described in each claim. The host server 20 that has received the posted data assigns a song ID, which is unique identification information, to the posted data and stores it in the song posting storage unit 22. In addition, this music contribution memory | storage part 22 functions as a 1st contribution memory | storage means as described in each claim.

<Data structure>
FIG. 3 shows an example of the data structure of post data stored in the music post storage unit 22 of the host server 20. In FIG. 3, in this example, the post data 220 includes a song ID (or a song name or the like) 221 given as described above as song identification information, the song data 224 as performance data, and a song. Music score information 222 of melody (melody) and lyrics data 223 are provided.

  The song ID 221 is placed as a header of the post data 220. The music data 224 is composed of, for example, MIDI data as described above, and is downloaded from the host server 20 and stored in the large capacity storage device 103 of, for example, the karaoke apparatuses 10A and 10B as described later, and then read and read. By being reproduced by the sound source 106 or the like, it can be emitted as sound from the speaker 108.

  The lyric data 223 is based on the original lyrics of the posting user as described above, and is downloaded from the host server 20 and stored in the mass storage devices 103 of the karaoke apparatuses 10A and 10B as described above, and then read out. Can be displayed on the display unit 109 as a lyrics telop. In this example, the lyric data contains the lyrics that say "If you don't even say that word, I'm sure a little more ...".

  As described above, the musical score information 222 represents an original singing melody (melody) created by the posting user, and is typically represented by a staff notation as shown.

  In this example, the lyrics data 223 and the score information 222 are incorporated in the same file as the music data 224, but the present invention is not limited to this. That is, the lyrics data 223 and the score information 222 may be configured as a separate file from the music data 224 and may be associated with the same music title.

<Possibility of singing difficulty>
At this time, as described above, since the posting data 220 as described above is the original work of the posting user, even if a specific singing user tries to sing along with the reproduction of the music data 224, If you do not know the melody line, it may be difficult to sing. Therefore, in this embodiment, a guide vocal is artificially generated based on the score information 222.

  Here, a user (corresponding to the second posting user) different from the specific singing user sings various desired karaoke songs (corresponding to the second music), and the singing voice data is sent to the host server 20. You may be uploading. Such a user happens to download the post data 220 and sing the original music of the posting user (hereinafter referred to as “posted music” as appropriate) that the specific singing user is about to sing. Audio data may be uploaded to the host server 20. In this embodiment, when there is already another user's singing voice data, a guide vocal voice for the specific singing user is generated using the singing voice data. Hereinafter, the flow will be described in order.

<Singing Voice Posting by Second Posting User>
That is, when another user (corresponding to the second posting user) appropriately operates, for example, the remote control 35 or the operation unit 104 of the karaoke apparatus 10B, the music data and the lyrics data of the posted music are stored in the host server 20. Is transmitted to the apparatus main body 100 of the karaoke apparatus 10B (step SS0) and stored in the mass storage device 103. Then, using the music data of the posted music stored in the large-capacity storage device 103, the singing voice posting process for the posted music is performed in the apparatus main body 100 of the karaoke apparatus 100B (step SC0). A flowchart showing the singing voice posting process in step SC0 is shown in FIG.

  In FIG. 4, first, in step S300, the control unit 101 of the second karaoke apparatus 10B is based on an appropriate operation of the remote controller 35 or the operation unit 104 of the second karaoke apparatus 10B of another user, for example. The music data and the lyrics data of the posted music stored in the above are read out, and the display unit 109 is started to display the lyrics data while the sound source 106 and the like start reproducing the music data. Thereby, the said another user can sing the said contribution music reproduced | regenerated based on music data. Thereafter, the process proceeds to step S310.

  In step S <b> 310, the second control unit 101 of the second karaoke apparatus 10 </ b> B starts recording the singing voice of the posted music by the other user via the microphone 30. The other user's singing voice data acquired by recording is stored in the mass storage device 103. Thereafter, the process proceeds to step S320.

  In step S320, the control unit 101 of the second karaoke apparatus 10B determines whether or not the reproduction of the music data started to be reproduced in step S300 is finished. If the reproduction of the music data does not end and the determination is not satisfied (S320: NO), the process returns to step S300, and the procedures of steps S300, S310, and S320 are repeated. When the reproduction of the music data is completed, the determination is satisfied (S320: YES), and the process proceeds to step S330.

  In step S330, the control unit 101 of the second karaoke apparatus 10B reads the singing voice data recorded in step S310 described above from the large-capacity storage device 103. Then, this singing voice data is associated with the song ID of the posted music and the user ID of the other user (obtained at the time of login) and transmitted to the host server 20 as posted data (corresponding to the second posted data). (Upload). The control unit 101 of the second karaoke apparatus 10B that executes step S330 functions as a second posting transmission unit. The host server 20 that has received the posted data gives a song ID that is common to the posted music (and may give a posted ID that is unique identification information to the posted data), and the singing post storage unit 23. In addition, this song contribution memory | storage part 23 functions as a 2nd contribution memory | storage means as described in each claim.

  The post data (including the song ID, the user ID, and the singing voice data of the posted music) stored in the singing post storage unit 23 as described above is, for example, the external terminal P or the karaoke device 10 (hereinafter, referred to as “following song data”) Based on a request signal based on an appropriate operation of a user (referred to as “external terminal P or the like”) (may be another user, the posting user, or the specific singing user). 20 outputs a reproduction signal of the singing voice data to the external terminal P or the like. Thereby, the said singing voice data can be heard in the said external terminal P grade | etc.,.

<Downloading songs submitted by singing users>
On the other hand, in the state where the singing voice data of the posted music for the other user is stored in the host server 20 as described above, for example, the specific singing user performs an appropriate operation with the remote control 35 of the karaoke apparatus 10A. As a result, a list of music pieces in which the post data is stored in the music post storage unit 22 of the host server 20 is acquired and displayed by the remote controller 35 (step SR1). When the posted music is reserved by an appropriate operation on the remote control 35 of the karaoke apparatus 10A by the specific singing user (step SR2), the user ID of the specific singing user (logged in at this time), The music ID 221 of the posted music is transmitted to the apparatus main body 100 of the karaoke apparatus 10A. When the song ID 221 of the specific posted song is acquired by the control unit 101 of the apparatus main body 100, a request to download the posted song including this song ID is transmitted from the control unit 101 of the karaoke apparatus 10A to the host server 20. (Step SC1). In response to this, the host server 20 searches the posted music data including the song ID in the music posting storage unit 22, and the posted music post data 220 (music data 224, lyrics data) having the song ID. 223 and the score information 222) are transmitted from the host server 20 to the karaoke apparatus 10A, acquired by the control unit 101, and stored in the mass storage device 103 (step SS2). This step SS2 corresponds to the posted music acquisition procedure described in each claim, and the control unit 101 of the karaoke apparatus 10A that acquires the posted data 220 as described above in this step SS2 acquires the posted music acquisition described in each claim. Functions as a means.

<Reference to singing history>
By the way, even if it is the original music by the posting user as described above, if the specific singing user has already sung once, or has seen others sing, the guide There is no need to generate vocals. Therefore, as mentioned above, a specific singing user himself has sang or has seen other people's singing (this case is hereinafter referred to as “viewed history of posted music”), or a specific singing user In order to determine whether the singing user himself has sang or has never seen another person's singing (this case is referred to as “no viewing history of posted music” as appropriate), the specific singing user's Singing history is referenced. That is, the singing history information of each of a plurality of users is stored in advance in the singing history storage unit 21 of the host server 20. Then, after the posting data 220 is obtained in step SS2, a request for a viewing result is transmitted from the control unit 101 of the karaoke apparatus 10A to the host server 20 in step SC2. Note that the user ID of the specific singing user is attached to this request (see step S120 in FIG. 5 described later).

  Upon receiving the request, the host server 20 performs viewing presence / absence determination processing (step SS3). FIG. 5 is a flowchart showing details of the viewing presence / absence determination processing.

  5, first, in step S100, the host server 20 determines the singing history storage unit 21 (in the singing history storage means) based on the user ID of the specific singing user received from the control unit 101 of the karaoke apparatus 10A in step SC2. The singing history of the specific singing user stored in (equivalent) is acquired.

  An example of the singing history of each singing user stored in the singing history storage unit 21 is shown in FIG. In this example, the song ID of a song that has been sung and the genre of the song are stored in association with the user ID of each singing user. In the example shown in the figure, the user “AAA” has a music piece with ID “555” (genre: pop), a music piece with ID “666” (genre: pop), a music piece with ID “999” (genre: reggae), Singing in the past. The user “BBB” has sung in the past the music with the ID “111” (genre: pop), the music with the ID “222” (genre: enka), and the music with the ID “444” (genre: enka). ing. The user “CCC” has a song with ID “111” (genre: pop), a song with ID “222” (genre: enka), a song with ID “333” (genre: POP), and an ID “777”. The song (genre: POP) has been sung in the past. The user “DDD” has sung the song with the ID “888” (genre: reggae) and the song with the ID “999” (genre: reggae) in the past.

  In addition, said step S100 is corresponded to the song history acquisition procedure as described in each claim, and the host server 20 which performs this step S100 functions as a song history acquisition means as described in each claim.

  Thereafter, the process proceeds to step S110, and the host server 20 determines whether or not the singing history acquired in step S100 includes the song ID received in step SC1 by the viewing presence / absence determination unit 24. If the song ID is included, the determination is satisfied (S110: YES), and the process proceeds to step S140 described later. If the song ID is not included, the determination is not satisfied (S110: NO), and the process proceeds to step S120.

  In step S120, the host server 20 uses the viewing presence / absence determining unit 24 to obtain the user IDs of other singing users who have logged in together with the specific singing user at this time (obtained in step SC2) under a predetermined condition ( The other singing user determines whether or not the posted music of the music ID received in step SC1 has been sung. If the posted music is sung, the determination is satisfied (S120: YES), and the process proceeds to step S140 described later. If the posted music is not sung, the determination is not satisfied (S120: NO), and the process proceeds to step S130.

  In addition, with the said predetermined conditions which extract another singing user, the singing history information of each user is memorize | stored in the singing history memory | storage part 21 of the host server 20, for example. The singing history information includes the time information when the user logged in and the time information when the user logged out (the time period from login to logout or the time length based on one of the login and logout times) and the singing karaoke apparatus 10. Information to be specified (for example, serial number, IP address, etc.) is also included. The host server 20 uses the same karaoke device as the karaoke device that the specific user sang in the time period from login to logout, and logs in another user who has logged in in the same time zone together with the specific singing user. Extract as other singing users.

  In step S130, the host server 20 saw that the other singing user sings the posted music without the specific singing user singing the posted music by the viewing presence / absence judging unit 24. The viewing history of the specific singing user with respect to the posted music is “no viewing history”. Then, this routine ends.

  On the other hand, in step S140, the host server 20 causes the viewing presence / absence determination unit 24 to sing the posted song by the specific singing user or the other singing user sings the posted song. The viewing history of the specific singing user with respect to the posted music is assumed to be “with viewing history”. Then, this routine ends. In addition, the said step S130 and step S140 are equivalent to the melody knowledge determination procedure of each claim, and the host server 20 which performs these steps S130 and S140 functions as the melody knowledge determination means described in each claim. .

  Returning to FIG. 2, when step S130 or step S140 is completed, the host server 20 indicates the determination result obtained in step S130 or step S140, that is, “no viewing history” or “with viewing history” as a karaoke device. It transmits to 10A (step SS4).

  The control unit 101 of the karaoke apparatus 10A that has received the determination result “no viewing history” or “with viewing history” executes a guide vocal provision process based on the reception result (step SC3). FIG. 7 shows a flowchart showing details of the guide vocal imparting process.

  As described above, the posted data 220 created by the posting user includes the song data 224, the score information 222, and the lyrics data 223 of the posted song, and the singing of the song data by the posting user's own singing. Audio data may be included. In such a case, since the melody line can be confirmed as it is based on the singing voice data, it is not necessary to generate a guide vocal voice. Therefore, in FIG. 7, first, in step S200, the control unit 101 of the karaoke apparatus 10A determines whether or not the singing voice data is included in the post data 220 received from the host server 20 in step SS2. . For example, when each posting data 220 is flagged as to whether or not singing voice data is included, this determination method may be checked. Alternatively, it may be determined by performing known audio frequency detection on the post data 220. This step S200 corresponds to the singing voice determination procedure described in each claim, and the control unit 101 of the karaoke apparatus 10A that executes this step S200 functions as a singing voice determination unit described in each claim.

  Thereafter, based on the determination result “no viewing history” or “with viewing history” received from the host server 20 in step SS4 and the determination result of the presence or absence of singing voice in step S200 in step S201, the karaoke apparatus 10A The control unit 101 determines whether the determination result received from the host server 20 is “no viewing history” and the determination result in step S200 is “no singing voice”. If the determination result is “no viewing history” or “no singing voice”, the determination is satisfied (S201: YES), and the process proceeds to step S215. If there is a determination result of either “viewing history is present” or “singing voice is included”, the determination is not satisfied (S201: NO), this routine is ended, and the step of FIG. Move to SC4.

  When the determination result is “no viewing history” or “no singing voice”, singing difficulty due to the unknown melody line occurs. Therefore, in this case, in order to generate the guide vocal voice, in step S215, the control unit 101 of the karaoke apparatus 10A is posted as described above and stored in the host server 20 (the second posting user). It is determined whether or not the singing voice data of the posted music exists. If the existence of the singing voice data of the posted music is confirmed, this determination is satisfied (S215: YES), and the process proceeds to step S220. If the existence of the singing voice data of the posted music cannot be confirmed, this determination is not satisfied (S215: NO), this routine is terminated, and the process proceeds to Step SC4 in FIG. In this case, in step SC4, a guide vocal sound may be created by an artificial sound using an appropriate sound source, for example.

  In step S <b> 220, the control unit 101 of the karaoke apparatus 10 </ b> A transmits a request for the singing genre of the specific singing user to the host server 20. As shown in FIG. 6, the singing history stored in the singing history storage unit 21 of the host server 20 also records the genre of the song sung by each user. The host server 20 that has received the request for the singing genre refers to the genre recorded in the singing history and determines the singing genre of the requested specific singing user (step SS5 in FIG. 2). In this determination, when the songs sung by the user are aggregated for each genre, the genre with the largest number of songs may be set as the singing genre of the user. In the example illustrated in FIG. 6, the user “AAA” sings the genre: POP most frequently, so the singing genre is “POP”. Since the user “BBB” sings the genre: Enka song most, the singing genre is “Enka”. Since the user “CCC” sings the genre: POP most frequently, the singing genre is “POP”. Since the user “DDD” sings the genre: reggae song most, the singing genre is “reggae”. In addition, the host server 20 which performs said step SS5 functions as a singing genre determination means as described in each claim. The determination of the singing genre may be executed by the host server 20 as needed, and the determination result may be stored.

  Thereafter, in step S230, the control unit 101 of the karaoke apparatus 10A acquires the singing genre of the specific singing user transmitted from the host server 20 to the karaoke apparatus 10A after being determined as described above. Thereafter, the process proceeds to step S235.

  In step S235, the control unit 101 of the karaoke apparatus 10A transmits the posted music that the specific singing user is about to sing and has already been posted as described above and stored in the singing post storage unit 23 of the host server 20. Singing voice data is specified and acquired using the above-mentioned song ID. In addition, you may make it specify using the said musical score information 222 or the said lyric data 223 instead of music ID. At that time, based on the singing genre acquired in step S230, singing voice data by a user of the same genre as the specific singing user is acquired. Also, when there are multiple users of the same genre who provided such singing voice data, the singing voice data of the user whose scoring result score at the time of each singing was the highest score is obtained Is done. That is, the control unit 101 of each karaoke apparatus 10 has a known scoring function (corresponding to the scoring means described in each claim), and the singing voice data is posted as described above, and the singing of the host server 20 is performed. When singing voice data is stored in the posting storage unit 23, a scoring result (score) when singing to generate the singing voice data is also stored. In addition, after posting from each karaoke apparatus 10, you may make it perform scoring by the host server 20 side.

  FIG. 8 shows a list of the singing voice data of each user stored in the singing post storage unit 23 of the host server 20 as described above. In the example shown in the figure, the user “PPP” whose genre determined as described above is POP, singing voice data (score at that time is 85 points) singing the posted music of ID “001”, and ID “ Singing voice data (scoring is 90 points) for singing the “002” posted music and singing voice data (score is 90 points) for the ID “005”. Similarly, the user “QQQ” whose genre is enka is singing voice data (score is 70 points) singing the posted music of ID “002” and singing voice data (scores) of the posted music of ID “008”. And 75 points) and singing voice data (score is 60 points) singing the posted music of ID “009”. In addition, the user “RRR” whose genre is POP, singing voice data (score is 80 points) singing the posted music of ID “001”, and singing voice data (score is singing the posted music of ID “005”) 85 points), singing voice data singing the posted music with ID “011” (score is 80 points), and singing voice data singing the posted music with ID “015” (score is 90 points). doing. In addition, the user “SSS” whose genre is reggae is singing voice data (score is 90 points) singing the posted music piece with ID “001” and singing voice data (score is the score is singing the posted music piece with ID “007”). (95 points).

  In the posting state as shown in the figure, the specific singing user is trying to sing (in other words, a guide vocal voice is required) and the tune ID of the posted musical piece is “001” and the specific singing user Suppose that the singing genre is “POP”. In this case, the singing voice data of the song ID “001” has been posted by a total of three people, the user “PPP”, the user “RRR”, and the user “SSS” as described above. However, it is excluded because the singing genre of the user “SSS” is reggae and different from the POP that is the singing genre of the specific singing user, and is the same singing genre (POP) as the specific singing user. Singing voice data of the song ID “001” by the user “PPP” whose score is equal to or higher than a predetermined value (for example, 70 points) among the user “PPP” and the user “RRR” (in this example, the score) 85 points) is selected as singing voice data for generating guide vocals, acquired by the control unit 101 of the karaoke apparatus 10A, and stored in the large-capacity control apparatus 103. Returning to FIG. 7, when step S235 is completed as described above, the process proceeds to step S250.

  In step S250, the control unit 101 of the karaoke apparatus 10A generates a guide voice vocal using the singing voice data acquired in step S235. This generation is generated by diverting the acquired singing voice data as it is (without any special processing), and processing of sound quality, etc. is appropriately performed by a known method if necessary. . The generated guide vocal sound is stored in the mass storage device 103 again, for example. Steps S235 and S250 correspond to the guide vocal generation procedure described in each claim, and the control unit 101 of the karaoke apparatus 10A that executes these steps functions as a guide vocal generation unit described in each claim.

  Returning to FIG. 2, when the guide vocal giving process in step SC <b> 3 is completed as described above, the music data 224 of the posted music is read from the mass storage device 103 based on the control of the control unit 101 of the karaoke apparatus 10 </ b> A. In addition to being reproduced by the sound source 106 and the like, the guide vocal sound generated in step S250 is read out from the mass storage device 103 and reproduced in synchronism with this (step SC4). In other words, the posted music is played with a guide vocal. At this time, lyrics display by the lyrics data 223 is performed by the display unit 109 of the karaoke apparatus 10A. This step SC4 corresponds to the voice / music reproduction procedure described in each claim, and the control unit 101 of the karaoke apparatus 10A executing this step SC4 functions as the voice / music reproduction means described in each claim.

  As described above, in the present embodiment, the singing voice data is not included in the posting data 220 of the original posted music by the posting user, and the specific singing user's singing history and other users are included in the posted music. If there is no history of watching the song, a guide vocal voice is generated and reproduced using song voice data by other users already posted and stored in the host server 20. Thereby, even if the said specific singing user does not know the melody line of the said contribution music of a contribution user, it can sing the said music easily and smoothly. Therefore, convenience can be improved.

  In this embodiment, in particular, the singing genre of the specific singing user is determined based on the singing history, and the guide vocal voice is generated using the singing voice data of the user corresponding to the singing genre. Thereby, at the time of the production | generation of a guide vocal audio | voice, the guide vocal audio | voice of the more optimal audio | voice aspect which matched the said singing user's singing preference can be produced | generated. As a result, the convenience can be further improved.

  In this embodiment, in particular, when singing voice data posted by another user is used to generate the guide vocal voice, the guide vocal voice is generated by using the scoring result that is a predetermined value or more. . Thereby, when the guide vocal sound is generated, the guide vocal sound can be generated by reliably using the singing sound data of the user who is relatively good at singing. As a result, the guide function using the guide vocal voice can be improved, and the convenience can be further improved.

  In the above, the flowcharts shown in FIG. 2, FIG. 4, FIG. 5, FIG. 7, etc. are not intended to limit the present invention to the procedure shown in the above-mentioned flow, but are within the scope not departing from the spirit and technical idea of the invention. May be added / deleted or the order may be changed.

  In addition to those already described above, the methods according to the above-described embodiments and modifications may be used in appropriate combination.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

1 Online karaoke system (contributed music performance system)
21 Singing history storage unit (singing history storage means)
22 Music contribution storage section (first contribution storage means)
23 Singing Post Storage Unit (Second Post Storage Unit)
106 sound source 107 audio control unit 108 speaker 220 post data 222 score information 223 lyrics data 224 music data (karaoke music data)

In order to achieve the above object, the fourth invention is a first posting transmission means for transmitting posted music data, singing melody score information, and lyrics data related to the first music created by the first posting user. In response to transmission from the first posting transmission means, at least the posted music data, the score information, and the lyrics data are stored as first posted data together with the music identification information of the first music. In response to the transmission from the storage means, the second posting transmission means for transmitting the singing voice data by the second posting user relating to the desired second music, and at least the singing voice data in response to the transmission from the second posting transmission means. a second post storage means for storing a second contribution data, post processing system comprising a singing history storage means for storing the singing history information of each of a plurality of singing users, a is a real In the posted music playing method, the posted music data and the lyrics data included in the first posted data stored in the first posted storage unit are stored in the first posted memory based on an instruction from a specific singing user. Based on the posted music acquisition procedure acquired from the means and the instruction of the specific singing user, the first posted data including the posted music data acquired in the posted music acquisition procedure includes corresponding singing voice data. A singing history determination procedure for determining whether or not the singing history is acquired, and a singing history acquisition procedure for acquiring the corresponding singing history information of the specific singing user from the singing history storage unit based on the instruction of the specific singing user, Based on the singing history information acquired in the singing history acquisition procedure, the singing melody of the posted song data acquired in the posted tune acquisition procedure The melody knowledge determination procedure for determining the presence or absence of knowledge of the specific singing user and the singing voice determination procedure determine that the singing voice data is not included in the first post data, and the melody knowledge When it is determined in the determination procedure that there is no knowledge of the specific singing user with respect to the singing melody of the posted music data, the second posted data is read from the second posting storage means, and the second posted data By comparing any of the music identification information, the score information, and the lyrics data with any of the music identification information, the score information, and the lyrics data of the first posted data stored in the first posting storage means The second post data of the same music as the first post data is specified, and the second post data included in the second post data of the same music as the specified first post data Using the singing voice data of the posting user, the guide vocal generation procedure for generating the guide vocal voice of the music and the guide vocal voice generated in the guide vocal generation procedure were acquired in the posted music acquisition procedure. And a sound / music reproduction procedure to be reproduced together with the posted music data.

Hereinafter, the sound source 106, the sound control unit 107, and the speaker 108 are appropriately omitted and referred to as “sound source 106 etc.”.

<Host server>
The host server 20 includes information storage means (not shown) composed of, for example, a large capacity storage device. The host server 20 functionally includes a singing history storage unit 21, a music post storage unit 22, a singing post storage unit 23, and a viewing presence / absence determination unit 24. Detailed functions of these functional units will be described later.

In step S <b> 310, the control unit 101 of the second karaoke apparatus 10 </ b> B starts recording the singing voice of the posted music by the other user via the microphone 30. The other user's singing voice data acquired by recording is stored in the mass storage device 103. Thereafter, the process proceeds to step S320.

Claims (4)

First posted transmission means for transmitting posted music data, musical score information of singing melody, and lyrics data related to the first music created by the first posting user;
A first posting memory that stores at least the posted music data, the score information, and the lyrics data as first posted data together with the music identification information of the first music in response to transmission from the first posting transmitting means. Means,
Second posting transmission means for transmitting singing voice data by the second posting user relating to the desired second music;
In response to transmission from the second posting transmission means, at least second posting storage means for storing the singing voice data as second posting data;
Singing history storage means for storing singing history information of each of a plurality of singing users;
Based on an instruction from a specific singing user, posted music acquisition means for acquiring the posted music data and the lyric data included in the first posted data stored in the first posted storage means from the first posted storage means; ,
A singing voice that determines whether or not corresponding singing voice data is included in the first posted data that includes the posted music data acquired by the posted music acquisition means based on an instruction of the specific singing user. A determination means;
Based on the instruction of the specific singing user, singing history acquisition means for acquiring the corresponding singing history information of the specific singing user from the singing history storage means,
Melody knowledge determination for determining presence / absence of knowledge of the specific singing user with respect to the singing melody of the posted music data acquired by the posted music acquisition means based on the singing history information acquired by the singing history acquisition means Means,
The singing voice determination means determines that the singing voice data is not included in the first post data, and the melody knowledge determination means determines the knowledge of the specific singing user with respect to the singing melody of the posted music data. When it is determined that there is not, the second posted data is read from the second posted storage means, and any one of the music identification information, the score information, and the lyric data of the second posted data is stored in the first posted storage means. The second posted data of the same music as the first posted data is identified by comparing the music identification information, the score information, or the lyrics data of the stored first posted data, Using the singing voice data of the second posting user included in the second posting data of the same music as the specified first posting data, the guide vocal of the music And a guide vocal generating means for generating a sound,
Voice / music reproduction means for reproducing the guide vocal sound generated by the guide vocal generation means together with the posted music data acquired by the posted music acquisition means;
The contribution music performance system characterized by having. The posted music performance system according to claim 1,
Based on the singing history information acquired by the singing history acquisition means, the singing genre determining means for determining the singing genre of the specific singing user,
The guide vocal generating means includes
The posted music performance system, wherein the guide vocal sound is generated using the singing voice data of the second posting user corresponding to the singing genre determined by the singing genre determining means. The posted music performance system according to claim 2,
Scoring means for scoring the singing voice data transmitted by the second post transmission means;
The guide vocal generating means includes
Using the singing voice data of the second posting user corresponding to the singing genre determined by the singing genre determining means, and the scoring result by the scoring means being a predetermined value or more, A posted music performance system characterized by generating a guide vocal voice. In response to the transmission from the first posting transmission means, the first posting transmission means for transmitting the posted music data, the musical score information of the singing melody, and the lyrics data relating to the first music created by the first posting user. First posting storage means for storing at least the posted music data, the score information, and the lyrics data as first posted data together with the music identification information of the first music, and a second related to the desired second music. A posted music performance method executed by a posting processing system having a second posting transmission unit that transmits singing voice data by two posting users and a singing history storage unit that stores singing history information of each of a plurality of singing users. ,
A posted song acquisition procedure for acquiring the posted song data and the lyrics data included in the first posted data stored in the first posted storage unit from the first posted storage unit based on an instruction of a specific singing user; ,
Based on the instruction of the specific singing user, the singing voice for determining whether or not the corresponding singing voice data is included in the first posting data including the posted music data acquired in the posted music acquisition procedure. Judgment procedure;
Based on the instruction of the specific singing user, the singing history acquisition procedure for acquiring the corresponding singing history information of the specific singing user from the singing history storage means,
Melody knowledge determination for determining the presence or absence of knowledge of the specific singing user for the singing melody of the posted music data acquired in the posted music acquisition procedure based on the singing history information acquired in the singing history acquisition procedure Procedure and
It is determined in the singing voice determination procedure that the singing voice data is not included in the first post data, and the specific singing user's knowledge with respect to the singing melody of the posted music data in the melody knowledge determination procedure When it is determined that there is not, the second posted data is read from the second posted storage means, and any one of the music identification information, the score information, and the lyric data of the second posted data is stored in the first posted storage means. The second posted data of the same music as the first posted data is identified by comparing the music identification information, the score information, or the lyrics data of the stored first posted data, Using the singing voice data of the second posting user included in the second posting data of the same music as the identified first posting data, the guide vocal voice of the music is And a guide vocal generation procedure to be formed,
An audio / music reproduction procedure for reproducing the guide vocal audio generated in the guide vocal generation procedure together with the posted music data acquired in the posted music acquisition procedure;
A posted music performance method characterized by comprising:

Images