JP6048437B2 - Information processing device, program, karaoke system - Google Patents

Description

  The present invention relates to a technique for providing information that supports improvement of ranking based on the ranking of scoring results of a user's past singing.

  2. Description of the Related Art Conventionally, in a karaoke apparatus that performs a scoring process for scoring a song of a singer, a service is known in which singers around the country who sang the same music compete for the ranking of scoring results (see, for example, Patent Document 1). Patent Document 1 discloses a technique for determining a rank in the middle of scoring at every predetermined timing during singing, and displaying how much the rank has been raised or lowered from the previous halfway rank.

JP 2010-60631 A

  However, in the above prior art, in order to overtake a higher-order user positioned higher than a certain user, it has not been possible to notify the user as to which singing section should be sung carefully.

  The present invention has been made to solve the above problems. The purpose is to provide a technique for presenting the analysis result of the song corresponding to the target rank based on the rank of the user's past song.

An information processing apparatus according to a first aspect of the present invention includes an accepting unit, a first obtaining unit, a second obtaining unit, and a control unit.
The accepting unit accepts an instruction to select music identification information associated with the user identification information. The first acquisition means, based on the music identification information received by the receiving means, lyric data representing the lyrics of the music and the singing timing of the lyrics, and reference data representing the reference melody of the song singing from the storage means. get. The second acquisition means is a scoring result when the user represented by the user identification information has sung the music corresponding to the music identification information in the past based on the user identification information and the music identification information received by the reception means. The first singing data in which the singing is recorded from the storage means when the upper user who is in a predetermined higher order sings the music corresponding to the music identification information than the ranking is acquired. The control means displays information based on the pitch of the song represented by the first song data and the pitch of the reference melody represented by the reference data, together with the lyrics represented by the lyrics data, on the display means. Let

  According to the invention which concerns on Claim 1, the information regarding the pitch of the singing data of the high-order user and the pitch of the reference | standard melody which are located higher than the order of the scoring result of a user's song is displayed according to the lyrics of music. it can. By doing in this way, it can be shown to a user whether the rank of a higher-order user used as a target can be surpassed if singing paying attention to which singing section.

Specifically, a configuration as described in claim 2 is preferable. That is, for the lyrics represented by the lyric data, the information processing apparatus performs the pitch of the singing corresponding to the lyrics for each predetermined section in the first song data and the sound of the reference melody corresponding to the lyrics for each predetermined section in the reference data. A specifying means for specifying a difference in pitch from the pitch is further provided. The control means causes the display means to display the pitch difference specified by the specifying means together with the lyrics represented by the lyrics data. According to the invention which concerns on Claim 2, the result of having analyzed the difference of the pitch of the upper user's song data located higher than the user's singing result and the reference melody can be displayed together with the lyrics of the music. .

  Furthermore, you may comprise as described in Claim 3. That is, the information processing apparatus further includes a determination unit that determines whether the pitch difference corresponding to the lyrics for each predetermined section specified by the specifying unit is a difference equal to or greater than a predetermined value. Then, the control means causes the display means to display the difference in pitches determined by the determination means as being a difference of a predetermined value or more together with the lyrics represented by the lyrics data. By doing in this way, the characteristic part with a large difference in pitch with reference | standard data can be shown to a user in song data of a high-order user. Therefore, it can be clearly shown to the user which singing section should be sung.

The information processing apparatus according to claim 4 has the following characteristics. That is, a 2nd acquisition means further acquires the 2nd song data by which the song when the user represented by the said user identification information sang the music corresponding to the said music identification information in the past was recorded. Then, the control means represents the information based on the pitch represented by the first singing data, the pitch represented by the second singing data, and the pitch represented by the reference data by the lyric data. Along with the lyrics, it is displayed on the display means. By doing in this way, a user can contrast singing data of the upper user who becomes a target, and his past singing data.

  The information processing apparatus according to claim 5 has the following characteristics. That is, a 2nd acquisition means acquires several 1st song data when the some high-order user who is a predetermined high-order rank sings the music corresponding to the said music identification information. Then, the control means combines information based on the pitches of the plurality of songs represented by the plurality of first song data and the pitch of the reference melody represented by the reference data with the lyrics represented by the lyrics data. Display on the display means. By doing in this way, it can be shown to a user whether the order of a some high-order user can be exceeded if it sings paying attention to which singing section.

  By the way, as described in claim 6, the information processing apparatus described above may be configured as a karaoke apparatus including performance means for performing music corresponding to the music identification information received by the reception means. By doing in this way, about the music which the user requested | required performance with respect to a karaoke apparatus, the information regarding the pitch of the upper user's song data and reference | standard melody in the music can be displayed correspondingly with the lyrics of a music.

  The invention according to claim 1 can also be realized as a program executed on a computer or a storage medium for storing the program as described in claim 7.

  The invention according to claim 8 relates to a karaoke system configured such that the information processing apparatus and the management server can communicate with each other. The information processing apparatus includes a first storage unit, a reception unit, a first transmission unit, a first acquisition unit, a second acquisition unit, and a control unit. The management server includes second storage means, identification means, and second transmission means.

  The first storage means of the information processing apparatus stores the music identification information, the lyric data representing the lyrics of the music and the singing timing of the lyrics, and the reference data representing the reference melody of the singing of the music in association with each other. The receiving unit of the information processing apparatus receives an instruction to select music identification information associated with user identification information. The first acquisition unit of the information processing apparatus acquires the lyric data and the reference data corresponding to the music identification information received by the receiving unit from the first storage unit. The first transmission unit of the information processing apparatus transmits the user identification information and the music identification information received by the reception unit to the management server.

  The second storage means of the management server includes rank information in which the singing results of the plurality of users are ranked for each song, and song data in which the user's song corresponding to the rank information is recorded, for each of the plurality of users. Are stored in association with the user identification information. Based on the user identification information and the music identification information transmitted from the information processing apparatus, the identification unit of the management server can identify the user corresponding to the user identification information in the past from the rank information stored in the second storage unit. A user who has a predetermined higher rank than the rank when singing a song corresponding to the song identification information is specified. The second transmission means of the management server stores the song data when the upper user identified by the identifying means sings the song corresponding to the song identification information from the song data stored in the second storage means. Send to processing device.

  The second acquisition unit of the information processing apparatus acquires the singing data of the upper user transmitted from the management server. The control means of the information processing device displays information based on the pitch of the song represented by the song data and the pitch of the reference melody represented by the reference data, together with the lyrics represented by the lyrics data, on the display means. Display.

  According to the invention of claim 8, the information processing apparatus can acquire the singing data of the upper user from the management server. Then, the information processing apparatus can display information related to the pitch of the lyrics data received from the management server and the pitch of the reference melody in association with the lyrics of the music. By doing in this way, it can be shown to a user whether the rank of a higher-order user used as a target can be surpassed if singing paying attention to which singing section.

  Or you may comprise like the karaoke system of Claim 9. That is, the information processing apparatus includes a reception unit, a first transmission unit, a first acquisition unit, a second acquisition unit, and a control unit. The management server includes a storage unit, a first specifying unit, a second specifying unit, and a second transmitting unit.

  The receiving unit of the information processing apparatus receives an instruction to select music identification information associated with user identification information. The first acquisition means of the information processing apparatus acquires lyric data representing the lyrics of the music and the singing timing of the lyrics based on the music identification information received by the receiving means. The first transmission unit of the information processing apparatus transmits the user identification information and the music identification information received by the reception unit to the management server.

  The storage means of the management server stores the lyrics data representing the lyrics of the music and the singing timing of the lyrics, and the reference data representing the reference melody of the music singing in association with the music identification information. In addition, the storage means includes the rank information in which the singing results of the songs of the plurality of users are ranked for each piece of music, and the song data in which the songs of the users corresponding to the rank information are recorded. The information is stored in association with the information. The first specifying means of the management server is based on the user identification information and the music identification information transmitted from the information processing apparatus from among the rank information stored in the storage means. A user who has a predetermined higher rank than the rank when singing a song corresponding to the song identification information is specified. The second specifying unit of the management server corresponds to the song data when the upper user specified by the first specifying unit sings a song corresponding to the song identification information transmitted from the information processing apparatus, and the song identification information. Based on the reference data, the pitch difference between the singing pitch corresponding to each predetermined section in the singing data and the pitch of the reference melody corresponding to each predetermined section in the reference data is specified. The second transmission unit of the management server transmits information representing the pitch difference specified by the second specifying unit to the information processing apparatus.

  The second acquisition unit of the information processing apparatus acquires information representing a pitch difference transmitted from the management server. The control means of the information processing apparatus causes the display means to display information representing the difference in pitch acquired by the second acquisition means together with the lyrics expressed by the lyrics data acquired by the first acquisition means.

  According to the ninth aspect of the present invention, the management server can analyze the difference in pitch between the singing data of the upper user and the reference melody and notify the information processing apparatus of the analysis result. The information processing apparatus can display the analysis result received from the management server in association with the lyrics of the music. By doing in this way, it can be shown to a user whether the rank of a higher-order user used as a target can be surpassed if singing paying attention to which singing section.

The block diagram showing the whole structure of a karaoke system. (A) An example of the configuration of the ranking database, (b) An example of the configuration of the singing information database. The flowchart showing the procedure of the main process of a karaoke apparatus. The flowchart showing the procedure of the main process of a management server. The flowchart showing the procedure of an analysis process. The table showing an example of the analysis result of song data. The flowchart showing the procedure of a display process. Display example of lyrics telop screen.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, this invention is not limited to the following embodiment, It is possible to implement in various aspects.
[Description of karaoke system configuration]
As shown in FIG. 1, the karaoke system 1 of the embodiment includes a karaoke device 10 and a management server 20 that are communicably connected via a network 100 (for example, the Internet). In FIG. 1, only one karaoke device 10 is illustrated, but a plurality of karaoke devices 10 may be connected to the network 100.

  The karaoke apparatus 10 includes a control unit 11, a communication interface unit 12, a storage unit 13, an operation unit 14, a voice input / output unit 15, and the like. This karaoke apparatus 10 has a function of playing karaoke music requested by the user, a function of displaying lyrics telop, and a scoring function of scoring the user's song. The karaoke apparatus 10 also has a nationwide scoring function for competing ranks of singing scores among users nationwide. Specifically, the program stored in the storage unit 13 of the karaoke apparatus 10 is executed by the control unit 11 so that the function of playing karaoke music, the function of displaying lyrics telop, and the scoring function And the national scoring function is realized. The karaoke device 10 may be a commercial karaoke device installed in a karaoke store, or may be a personal computer, a high-function mobile phone (smart phone), or a game machine having a karaoke performance function. .

  The control unit 11 includes a CPU, a RAM, a ROM, and the like, and controls the karaoke apparatus 10 by operating according to a predetermined program. The communication interface unit 12 connects the karaoke apparatus 10 to the network 100 and performs communication via the network 100. The communication interface unit 12 may be connected to the network 100 via wireless communication, or may be connected to the network 100 by wire. The karaoke apparatus 10 communicates with the management server 20 via the network 100.

  The storage unit 13 is a storage device including, for example, a hard disk drive or a nonvolatile semiconductor memory. The storage unit 13 stores a karaoke database in which a lot of music data for playing karaoke music is registered, and a program for controlling the operation of the karaoke apparatus 10. In the karaoke database, performance data representing accompaniment, singing standard data representing a reference melody of a singing part, and lyric data for displaying lyrics telop are registered for each song as music data. The karaoke database may be stored in an external server device such as the management server 20. In this case, the control part 11 of the karaoke apparatus 10 acquires music data from an external server apparatus as needed.

  The performance data and singing reference data registered in the karaoke database are assumed to be composed of, for example, MIDI (Music Instrument Digital Interface) data. The singing reference data is data representing the pitch to be sung along the accompaniment sound output from the karaoke apparatus 10 according to the performance data. Specifically, the singing reference data is data in which a pitch to be sung is associated with a timing for singing the pitch.

  The lyric data includes information defining a character string constituting a lyric telop, a display step, an erasing step, and a color changing step. The display step is a time that represents the timing for displaying the character string of the lyrics. The erasing step is a time that represents the timing of erasing the displayed character string from the screen. The color change step is a time representing the color change timing of the lyrics telop for displaying the position of the character to be sung in synchronization with the progress of the MIDI performance. The “step” here is a measured time value that is a reference for MIDI performance. By sharing this timing value with the MIDI performance, the control of the performance sound and the lyrics telop is synchronized. The time measurement value may be a sound generation timing that is a reference for MIDI performance.

  The operation unit 14 is an input device for inputting an operation from a user. The operation unit 14 includes, for example, a touch panel, a key switch, and the like provided in the main body of the karaoke apparatus 10. The voice input / output unit 15 controls voice input from the microphone 17 and voice output from the speaker 18.

  Moreover, the karaoke apparatus 10 has a function with which a user can log in. The karaoke apparatus 10 performs a predetermined authentication process for user identification information and a password input from the user via the operation unit 14. The function that allows the user to log in may be provided in a remote control device (not shown) that can communicate with the karaoke device 10. In this case, the control unit of the remote control device performs a predetermined authentication process for the user identification information and password input via the operation unit of the remote control device. Alternatively, the authentication process may be executed by the management server 20. In this case, the user identification information and password input via the operation unit 14 of the karaoke device 10 or the operation unit of the remote control device are transmitted to the management server 20. Then, the management server 20 performs an authentication process based on the received user identification information and password. In this case, the authentication result is transmitted from the management server 20 to the karaoke device 10 or the remote control device.

  When the authentication is established, the karaoke apparatus 10 registers the authenticated user identification information as a login user. When this login is established, the karaoke apparatus 10 executes karaoke services such as karaoke performance, singing grading, national grading, etc., in association with the user identification information of the login user. Since other functions and configurations of the karaoke apparatus 10 are in accordance with known techniques, detailed description thereof is omitted here.

  The management server 20 includes a control unit 21, a communication interface unit 22, and a storage unit 23. The management server 20 has a function of counting the singing score data acquired from the karaoke apparatus 10 and providing information based on the counting result. The control unit 21 includes a CPU, a RAM, a ROM, and the like, and controls the management server 20 by operating according to a predetermined program. The communication interface unit 22 connects the management server 20 to the network 100 and performs communication via the network 100. The management server 20 communicates with the karaoke apparatus 10 via the network 100.

  The storage unit 23 is a storage device such as a hard disk drive. The storage unit 23 stores a program for controlling the operation of the management server 20, data used when the program is executed, and the like. The storage unit 23 is provided with a ranking database and singing information database. The configurations of the ranking database and singing information database will be described with reference to FIGS. 2 (a) and 2 (b).

  As illustrated in FIG. 2A, a rank table is stored in the rank database. The ranking table is stored for each piece of music played on the karaoke apparatus 10. In the rank table for each song, a song ID that can identify the song is registered. In the ranking table, a scoring result record is registered in association with the music ID. Here, the “record” is a unit constituting data. A plurality of items of information are collected to form one record, and the plurality of records are collected to constitute one data.

  Each scoring result record registered in the ranking table is associated with each item of “ranking”, “user ID”, and “score”. In the “ranking” item, information indicating the number obtained by ranking the scores as the singing score in the ranking table is registered. In the “score” item, a score, which is a singing score result, is registered.

  As illustrated in FIG. 2B, a singing information table is stored in the singing information database. The singing information table is stored for each piece of music played by the karaoke apparatus 10. In the song information table for each song, a song ID that can identify the song is registered. In the song information table, a record of song information is registered in association with the song ID.

  In each singing information table registered in the singing information table, items of “rank”, “user ID”, and “singing data” are registered in association with each other. The items of “rank” and “user ID” have the same contents as those in the rank table of FIG. In the “singing data” item, singing data representing the voice of the user registered in the “user ID” item singing the song represented by the song ID in the singing information table is registered.

  The procedure in which the management server 20 collects information in the ranking database and singing information database is as follows. First, the karaoke apparatus 10 starts playing according to the music performance data represented by the music ID. At this time, the karaoke apparatus 10 starts performance by the nationwide scoring function. When the karaoke apparatus 10 starts playing, the karaoke device 10 outputs a music piece according to the performance data from the speaker 18. Next, the karaoke apparatus 10 starts recording the voice input via the microphone 17. Thereby, the karaoke apparatus 10 memorize | stores the song data showing the audio | voice input via the microphone 17 in the memory | storage part 13 along with the output of a music.

  Moreover, the karaoke apparatus 10 performs a nationwide scoring function and scores the singing data representing the voice input through the microphone 17. And when the karaoke apparatus 10 completes the output of the music, the score as a scoring result, the singing data stored in the storage unit 13 along with the output of the tune, and the user ID representing the user who sang in the karaoke apparatus 10 The music ID representing the outputted music is transmitted to the management server 20. Note that the singing data may be, for example, waveform data along a time series, or may be MIDI data obtained by converting the pitch of a singing into a MIDI format and digitizing it. When the singing data is waveform data, the waveform data may be configured in a known audio compression format.

  The management server 20 registers the scoring result of the song received from the karaoke apparatus 10 in the ranking database. Specifically, the management server 20 determines the rank that is the rank of the score in the rank table corresponding to the received music ID for the score of the scoring result received from the karaoke apparatus 10. Then, the management server 20 registers a record composed of the determined rank, the received user ID, and the received score in the rank table corresponding to the received music ID. Moreover, the management server 20 registers the song data received from the karaoke apparatus 10 in the song information database. Specifically, the management server 20 registers a record including the determined order, the received user ID, and the received song data in the song information table corresponding to the received song ID.

  In addition, when the management server 20 registers the record which consists of the determined order | rank, the received user ID, and the received song data in a song information table, it matches with the date information which shows the date which registered the record. Remember. The management server 20 can identify the record associated with the date / time information representing the date / time closest to the current date / time from the records including the specific user ID by storing the record and the date / time information in association with each other. . And the management server 20 can determine the song data contained in the specified record as song data when a specific user sang last time.

  Further, when registering a record including the determined rank, the received user ID, and the score, the management server 20 stores the record in association with date / time information indicating the date / time when the record was registered. The management server 20 can identify the record associated with the date / time information representing the date / time closest to the current date / time from the records including the specific user ID by storing the record and the date / time information in association with each other. . Then, the management server 20 can determine the rank or score included in the identified record as the rank or score when the specific user sang the previous time.

[Description of main processing of karaoke equipment]
The procedure of the main process performed by the control unit 11 of the karaoke apparatus 10 will be described with reference to the flowchart of FIG. This process can be executed when the karaoke apparatus 10 is turned on.

  In S100, the control unit 11 determines whether or not a music performance instruction has been received. The control unit 11 receives a musical performance instruction via the operation unit 14 or a remote control terminal (not shown) attached to the karaoke apparatus 10. The music performance instruction is information in which the user ID of the music selector and the music ID are associated with each other. When the performance instruction of music is not received (100: NO), the control unit 11 returns to S100. On the other hand, when the performance instruction of a music is received (S100: YES), the control part 11 progresses to S102.

  In S <b> 102, the control unit 11 transmits the music ID: X represented by the accepted performance instruction and the user ID: Y of the music selector associated with the performance instruction to the management server 20. In S104, the control unit 11 receives the target rank Zr, the song data Zd, the previous rank Yr, and the song data Yd from the management server 20 as a response to the information transmitted in S102. The target rank Zr is a predetermined higher rank than the rank when the user Y who is a music selector sings the music piece X last time. Specifically, it is the rank of the upper user Z, which is a rank higher by a predetermined number than the rank when the user Y sung the song X last time. The song data Zd is song data recorded when the upper user Z sang the song X in the past. The previous ranking Yr is the ranking when the user Y sung the song X last time. The song data Yd is song data recorded when the user Y sung the song X last time.

  In the next S106, the control unit 11 executes an analysis process. The analysis process is a process of analyzing a difference in pitch between the singing reference data of the music represented by the performance instruction and the singing data Zd of the upper user Z received in S104. The detailed procedure of this analysis process will be described later. In the next S108, the control unit 11 executes display processing. The display process is a process for highlighting the lyrics telop image based on the pitch difference analyzed in the analysis process of S106. The detailed procedure of this display process will be described later. After S108, the control unit 11 returns to S100.

[Description of the main processing of the management server]
The procedure of the main process executed by the control unit 21 of the management server 20 will be described with reference to the flowchart of FIG. This process can be executed when the management server 20 is powered on.

  In S200, the control part 21 determines whether music ID: X and user ID: Y (refer S102 of FIG. 3) were received from the karaoke apparatus 10. FIG. When music ID: X and user ID: Y are not received from the karaoke apparatus 10 (S200: NO), the control part 21 returns to S200. On the other hand, when music ID: X and user ID: Y are received from the karaoke apparatus 10 (S200: YES), the control part 21 progresses to S202.

  In S202, the control unit 21 determines the previous ranking Yr of the user Y from the ranking table (see FIG. 2A) corresponding to the song ID: X based on the received song ID: X and user ID: Y. To get. Specifically, the control unit 21 acquires date / time information indicating the date / time when the music ID: X and the user ID: Y are received in step S201. This date / time information can be specified and acquired by the timing operation of the CPU provided in the control unit 21. The control unit 21 specifies a record including the received user ID: Y from the order table. And the control part 21 specifies the record matched with the date-and-time information showing the date and time nearest to the date and time which the acquired date-and-time information represents from the records including the received user ID: Y. The control unit 21 determines the rank included in the identified record as the previous rank Yr of the user Y. In next S204, the control unit 21 determines the target rank Zr based on the previous rank Yr acquired in S202. For example, the control unit 21 may determine a rank corresponding to a certain number higher than the previous rank Yr as the target rank Zr.

  In next S206, the control unit 21 sets the song data Zd of the user Z corresponding to the target rank Zr and the previous rank Yr from the song information table (see FIG. 2B) corresponding to the song ID: X. The corresponding user Y song data Yd is acquired. In S208, the control unit 21 transmits the target rank Zr, the singing data Zd, the previous ranking Yr, and the singing data Yd acquired in S202 to S206 to the karaoke apparatus 10. After S208, the control unit 21 returns to S200. In the main process of the management server 20, a plurality of target ranks may be determined, and a plurality of upper user singing data corresponding to each of the plurality of target ranks may be transmitted to the karaoke apparatus 10.

[Description of analysis processing]
The procedure of the analysis process which the control part 11 of the karaoke apparatus 10 performs is demonstrated, referring the flowchart of FIG. This process is a process executed in S106 of the main process (see FIG. 3) of the karaoke apparatus.

  In S300, the control unit 11 acquires the singing reference data and the lyric data corresponding to the music ID: X from the storage unit 13. Alternatively, the control unit 11 may acquire singing reference data and lyrics data from an external distribution server (not shown) via the network 100.

  In S <b> 302, the control unit 11 identifies one character whose pitch is to be compared from the lyrics characters represented by the lyrics data. Here, the control unit 11 specifies characters whose pitches have not been compared in order from the beginning of the character string of the lyrics represented by the lyrics data. In the next S304, the control unit 11 calculates a numerical value representing the pitch of the singing data Zd and a numerical value representing the pitch of the singing reference data for the performance time t when the lyric character specified in S302 is to be sung. A pitch difference n which is a difference is calculated. Note that it is conceivable to use, for example, the value of the color change step registered in the lyrics data as the performance time t when the characters of the lyrics are to be sung.

  In S306, the control unit 11 determines whether or not the pitch difference n calculated in S304 is zero. When the pitch difference n is 0 (S306: YES), the control unit 11 proceeds to S310. On the other hand, when the pitch difference is not 0 (S306: NO), the control unit 11 proceeds to S308. Alternatively, in S306, the control unit 11 may determine whether the pitch difference n calculated in S304 is greater than or equal to a predetermined value. In S308, the control unit 11 uses the difference data D to determine the order i of the lyric characters specified in S302, the performance time t during which the lyric characters are to be sung, and the pitch difference n calculated in S304. Save to memory.

  In next S310, the control unit 11 determines whether or not the comparison between the pitch of the singing data Zd and the pitch of the singing reference data has been completed for all the lyrics characters included in the lyric data acquired in S300. judge. If the pitch comparison has not been completed for all of the lyrics characters (S310: NO), the control unit 11 returns to S302 and specifies the characters of the next lyrics. On the other hand, when the pitch comparison is completed for all the lyrics characters (S310: YES), the control unit 11 ends the analysis processing and returns to the main routine of FIG. In addition, when the karaoke apparatus 10 acquires the singing data Zd of a plurality of higher-order users from the management server 20, the control unit 11 performs an analysis process illustrated in FIG. 5 for each of the singing data Zd. In that case, the control part 11 preserve | saves the pitch difference n specified from all the song data Zd as the difference data D. FIG.

  A specific example of the above analysis processing will be described with reference to the table of FIG. As illustrated in FIG. 6, in the lyrics data, for each character constituting the lyrics of the music, an ID number indicating the order of the characters and a performance time t when the characters of the lyrics are to be sung are registered in association with each other. ing. The control unit 11 has a numerical value of the pitch of the singing reference data (reference pitch note) generated at the timing of the performance time t corresponding to each ID number, and a numerical value of the pitch of the singing data Zd (singing pitch Z_note). And specify. And the control part 11 compares the reference pitch note in performance time t, and singing pitch Z_note, and calculates the pitch difference n.

  For example, in the example of FIG. 6, the reference pitch note is 57 and the singing pitch Z_note is 57 for the letter “A” of the lyrics corresponding to the ID number 100. That is, the pitch difference n between the reference pitch note and the singing pitch Z_note is 0. Further, for the letter “I” of the lyrics corresponding to the ID number 101, the reference pitch note is 58 and the singing pitch Z_note is 55. That is, the pitch difference n between the reference pitch note and the singing pitch Z_note is -3.

[Description of display processing]
The procedure of display processing executed by the control unit 11 of the karaoke apparatus 10 will be described with reference to the flowchart of FIG. This process is a process executed in S108 of the main process (see FIG. 3) of the karaoke apparatus. This display process is executed when displaying the lyrics telop at the stage before the performance of the music represented by the performance instruction is started. Alternatively, it may be executed at the stage of displaying the lyrics telop along with the output of the performance data in synchronization with the music performance processing. Alternatively, it may be executed at the stage of displaying the lyrics telop together with the display of the scoring results after the performance of the music.

  In S400, the control unit 11 reads the difference data D stored in the above analysis process (see FIG. 5). In S402, the control unit 11 refers to the order i of the words in the lyrics included in the read difference data D, and for the section in which characters having pitch differences continue for a predetermined threshold p (for example, 3) or more, Change the background color of the text from the normal background color. For example, in the case of FIG. 6, the pitch difference n is not 0 in the consecutive sections with ID numbers 104 to 106. Therefore, the control unit 11 changes the background color of the characters “O”, “ka”, and “ki” that are the lyrics corresponding to the ID numbers 104 to 106. Alternatively, in S402, for example, the control unit 11 changes the background color of the lyric character from the normal background color for a section in which characters having a pitch difference n greater than or equal to a predetermined value continue for a predetermined threshold value p (for example, 3) or more. It may be changed.

  Returning to the flowchart of FIG. In S404, based on the read difference data D, the control unit 11 sets the display color of the text of the lyrics to the normal display at a location where the absolute value of the pitch difference n is a predetermined threshold q (for example, 3) or more. Change from color to first highlight color. In addition to changing the display color, for example, blinking or highlighting using a pattern may be added. For example, in the example of FIG. 6, the pitch difference n is −3 at the location of the ID number 101. Therefore, the control unit 11 changes the background color of the character “I”, which is the lyrics corresponding to the ID number 101, to the first emphasized color.

  Returning to the flowchart of FIG. In S406, the control unit 11 reads the singing reference data of the music represented by the performance instruction. In step S408, the control unit 11 determines that the difference between the reference pitch notes corresponding to each of the two consecutive lyric characters is greater than or equal to a predetermined threshold r (for example, 5) based on the pitch of the read singing reference data. For the part, the display color of the text of the lyrics is changed from the normal display color to the second highlight color. In addition to changing the display color, for example, blinking or highlighting using a pattern may be added. For example, in the example of FIG. 6, the difference between the reference pitch notes is 8 in the section between two consecutive characters with ID numbers 104 and 105. Therefore, the control unit 11 changes the background color of the characters “o” and “ka”, which are the lyrics corresponding to the ID numbers 104 and 105, to the second emphasized color.

  Returning to the flowchart of FIG. In S410, the control unit 11 causes the display 16 to display a piano roll graph representing the pitch of the singing reference melody based on the singing reference data. Moreover, the control part 11 displays on the display 16 the aspect which reflected the display color changed in S402-S408 based on the lyrics data, and the lyrics telop corresponding to the display area of the displayed piano roll.

  In S412, the control unit 11 determines whether or not there is previous singing data Yd of the user Y who is the music selector. When there is no song data Yd (S412: NO), the control unit 11 returns to the main routine of FIG. On the other hand, when there is the lyrics data Yd (S412: YES), the control unit 11 proceeds to S414. In S414, the control unit 11 causes the display 16 to display a graph representing the pitch of the singing corresponding to the displayed piano roll display section on the displayed piano roll based on the singing data Yd. After S414, the control unit 11 returns to the main routine of FIG.

  A specific example of the above display process will be described with reference to the screen display example of FIG. As illustrated in FIG. 8, a graph 51 (solid line) representing the pitch of the singing reference melody is displayed at the center of the screen 50 displayed on the display 16. The graph 51 is a piano roll-shaped graph having a pitch in the vertical direction of the screen 50 and a time axis in the horizontal direction. The control unit 11 draws a graph 51 representing the pitch of the singing reference melody based on the singing reference data of the music represented by the performance instruction.

  A lyrics telop 52 is displayed below the singing melody graph 51. Based on the lyrics data, the control unit 11 displays a telop composed of a character string of the lyrics corresponding to the display section of the singing reference melody graph 51. Regarding the display position of each character of the lyrics telop in the horizontal direction of the screen, the control unit 11 uses the time axis assigned to the graph 51 of the singing reference melody as a reference, and the time axis that matches the timing at which the lyrics characters should be sung. Lay out each character so that it is displayed above.

  The example in FIG. 8 represents a state in which the display color and background color of the lyrics characters in the lyrics telop 52 are changed in accordance with the analysis result of the pitch difference n illustrated in FIG. Specifically, in the case of FIG. 6, the control unit 11 changes the display color of the character to the first highlight color for the character of “I” with the ID number 101 whose pitch difference n is −3. . Further, in the case of FIG. 6, for the characters “O”, “ka”, and “ki” with ID numbers 104 to 106 in which three characters whose pitch difference n is not 0 are consecutive, the control unit 11 determines the background color of the characters. Has changed. In the case of FIG. 6, for the characters “o” and “ka” of ID numbers 104 and 105 in which the difference between the reference pitch notes is 8 in the two consecutive character sections, the control unit 11 Is changed to the second highlight color.

  Further, a graph 53 (broken line) representing the pitch of the previous song of the user Y who is the music selector is displayed so as to overlap the display area of the graph 51 of the singing reference melody. This graph 53 is a piano roll graph having a pitch in the vertical direction and a time axis in the horizontal direction, the same as the graph 51 for the singing reference melody. The control unit 11 draws a graph 51 representing the pitch of the previous song based on the previous song data Yd acquired from the management server 20.

  Further, above the singing reference melody graph 51, a ranking display 54 is displayed which includes the ranking (100th) as the target of the user Y who is the music selector and the ranking (120th) of the previous user Y. Yes. Based on the target rank Zr acquired from the management server 20 and the previous rank Yr, the control unit 11 describes a rank display 54 including the target rank and the previous rank on the screen 50.

[effect]
According to the karaoke system 1 of the above embodiment, the following effects can be obtained.
Information regarding the pitch difference between the song data of the user higher than the ranking of the scored result of the past song of the song selector and the song reference melody can be displayed in association with the characters of the lyrics. By doing in this way, it can be shown to a music selector whether the rank of a high-order user used as a target can be surpassed if singing paying attention to which song section.

  In addition to the lyrics telop reflecting the pitch difference of the upper user, a pitch graph based on the singing data when the song selector sang in the past can be displayed superimposed on the singing reference melody graph. By doing in this way, the music selector can contrast the singing data of the target higher-order user with his past singing data.

[Modification]
In the above-described embodiment, the example in which the karaoke apparatus 10 creates the difference data D by analyzing the pitch difference n between the singing data Zd of the target rank and the singing reference data has been described. Alternatively, the management server 20 may generate the difference data D by analyzing the pitch difference n between the singing data Zd of the target rank and the singing reference data. In that case, as a premise, it is assumed that the storage unit 23 of the management server 20 stores singing reference data and lyric data of the music played in the karaoke apparatus 10 in addition to the ranking database and the singing information database.

  The specific processing procedure is as follows. The control unit 11 of the karaoke apparatus 10 transmits to the management server 20 the music ID: X of the music represented by the performance instruction received from the user and the user ID: Y of the music selector related to the performance instruction. On the other hand, the control part 21 of the management server 20 acquires the song data Zd corresponding to music ID: X similarly to the procedure of S200-S206 of FIG. Thereafter, the control unit 21 of the management server 20 creates the difference data D by analyzing the pitch difference n between the song data Zd and the song reference data in the same procedure as the analysis process of FIG. Then, the control unit 21 of the management server 20 transmits the target rank Zr and the difference data D to the karaoke apparatus 10. The control unit 11 of the karaoke apparatus 10 displays the lyrics telop using the difference data D received from the management server 20 in the same procedure as the display process of FIG.

  In the above-mentioned embodiment, the karaoke apparatus 10 demonstrated the example which acquires the song data Zd of the target rank from the management server 20. Separately from this, the storage unit 13 of the karaoke apparatus 10 may have a configuration in which a ranking database and a singing information database (see FIGS. 2A and 2B) are stored. In this case, the control unit 11 of the karaoke apparatus 10 acquires the target rank Zr and the singing data Zd from the rank database and the singing information database stored in the storage unit 13 of the own karaoke apparatus 10, and performs analysis processing (FIG. 5). ) And display processing (FIG. 7).

  The national scoring function executed by the karaoke apparatus 10 is changed in order in real time according to the input singing sound. In this case, a target rank Zr higher by a predetermined number is determined from the rank changed in real time, and each time the rank is changed, the singing data Zd of the user Z of the target rank Zr is received by the karaoke apparatus 10 or the management server 20. Obtained and the analysis process (FIG. 5) and the display process (FIG. 7) may be executed.

[Correspondence with Configurations in Claims]
The correspondence relationship between the configuration of the karaoke system 1 and the configuration described in the claims is as follows. The karaoke apparatus 10 corresponds to an information processing apparatus. The storage unit 13 corresponds to a first storage unit. S100 in FIG. 3 corresponds to the accepting unit. S300 in FIG. 5 corresponds to the first acquisition unit. S104 in FIG. 3 corresponds to a second acquisition unit. S108 in FIG. 3 corresponds to the control means. The display 16 corresponds to display means. S106 in FIG. 3 corresponds to the specifying unit of the information processing apparatus. Or in the case of the modification in which the control part 21 of the management server 20 performs the same process as S106 of FIG. S404 in FIG. 7 corresponds to the determination unit. S102 in FIG. 3 corresponds to the first transmission means. The storage unit 23 corresponds to a second storage unit. Alternatively, in the case of a modification in which the control unit 21 of the management server 20 performs the same processing as S106 in FIG. 3, the storage unit 23 corresponds to the storage unit of the management server. S202 and S204 in FIG. 4 correspond to specifying means or first specifying means of the management server. S208 in FIG. 4 corresponds to the second transmission means.

  DESCRIPTION OF SYMBOLS 1 ... Karaoke system, 10 ... Karaoke apparatus, 11 ... Control part, 12 ... Communication interface part, 13 ... Memory | storage part, 14 ... Operation part, 15 ... Voice input / output part, 16 ... Display, 17 ... Microphone, 18 ... Speaker, DESCRIPTION OF SYMBOLS 20 ... Management server, 21 ... Control part, 22 ... Communication interface part, 23 ... Memory | storage part, 100 ... Network.

Claims (9)

Accepting means for accepting an instruction to select music identification information associated with the user identification information;
Based on the music identification information received by the receiving means, the first acquisition for acquiring from the storage means lyric data representing the lyrics of the music and the singing timing of the lyrics and the reference data representing the reference melody of the singing of the music Means,
Based on the user identification information and the music identification information received by the receiving means, than the ranking of the scoring results when the user represented by the user identification information has sung the music corresponding to the music identification information in the past, Second acquisition means for acquiring, from the storage means, first singing data in which singing is recorded when a higher-ranking user having a predetermined higher rank sings the music corresponding to the music identification information;
Information based on the pitch of the song represented by the first song data and the pitch of the reference melody represented by the reference data is displayed on the display unit together with the lyrics represented by the lyrics data. Control means;
An information processing apparatus comprising: The information processing apparatus according to claim 1,
For the lyrics represented by the lyrics data, the pitch of the song corresponding to the lyrics for each predetermined section in the first song data and the pitch of the reference melody corresponding to the lyrics for each predetermined section in the reference data A specific means for identifying a difference in pitch;
The control means causes the display means to display the difference in pitches specified by the specifying means together with the lyrics expressed by the lyrics data;
An information processing apparatus characterized by the above. The information processing apparatus according to claim 2,
A determination unit for determining whether a difference in pitch corresponding to the lyrics for each predetermined section specified by the specifying unit is a difference greater than or equal to a predetermined value;
The control means causes the display means to display the difference in pitches determined by the determination means to be a difference of a predetermined value or more together with the lyrics represented by the lyrics data,
An information processing apparatus characterized by the above. The information processing apparatus according to any one of claims 1 to 3,
The second acquisition means further acquires second singing data in which a song recorded when the user represented by the user identification information sang a song corresponding to the song identification information in the past,
The control means uses the lyrics data to provide information based on the pitch represented by the first song data, the pitch represented by the second song data, and the pitch represented by the reference data. In combination with the lyrics to be displayed on the display means;
An information processing apparatus characterized by the above. The information processing apparatus according to any one of claims 1 to 4,
The second acquisition means acquires a plurality of first singing data when a plurality of higher rank users having the predetermined higher rank sing a song corresponding to the song identification information,
The control means includes information based on pitches of a plurality of songs represented by the plurality of first song data and a pitch of a reference melody represented by the reference data, and lyrics represented by the lyrics data. And displaying on the display means,
An information processing apparatus characterized by the above. The information processing apparatus according to any one of claims 1 to 5,
A karaoke apparatus comprising performance means for performing music corresponding to the music identification information received by the reception means;
An information processing apparatus characterized by the above. An acceptance procedure for receiving an instruction to select music identification information associated with the user identification information;
A first acquisition procedure for acquiring, based on the music identification information received in the reception procedure, lyric data representing the lyric of the music and the singing timing of the lyric, and reference data representing the reference melody of the singing of the music;
Based on the user identification information and the music identification information received in the reception procedure, rather than the ranking of the scoring results when the user represented by the user identification information has sung the music corresponding to the music identification information in the past, A second acquisition procedure for acquiring first singing data in which a singing is recorded when a higher-ranking user having a predetermined higher rank sings the music corresponding to the music identification information;
Information based on the pitch of the song represented by the first song data and the pitch of the reference melody represented by the reference data is displayed on the display unit together with the lyrics represented by the lyrics data. Control procedures;
A program that causes a computer to execute. A karaoke system configured to allow communication between an information processing device and a management server,
The information processing apparatus includes a first storage unit, a reception unit, a first transmission unit, a first acquisition unit, a second acquisition unit, and a control unit.
The management server includes second storage means, identification means, and second transmission means,
The first storage means stores song identification information, lyric data representing song lyrics and song singing timing, and reference data representing a reference melody of song singing in association with each other.
The accepting means accepts an instruction to select music identification information associated with user identification information,
The first acquisition means acquires the lyrics data and the reference data corresponding to the music identification information received by the reception means from the first storage means,
The first transmission means transmits user identification information and music identification information received by the reception means to the management server,
The second storage means includes rank information in which singing scores of a plurality of users are ranked for each song, and song data in which a user's song corresponding to the rank information is recorded, for each of the plurality of users. Stored in association with the user identification information of
The specifying means is based on the user identification information and the music identification information transmitted from the information processing apparatus from among the rank information stored in the second storage means. The user who is a predetermined higher rank than the rank when singing the song corresponding to the song identification information is identified,
The second transmitting means is singing data when the upper user specified by the specifying means sings the music corresponding to the music identification information from the singing data stored in the second storage means. Transmitted to the information processing device,
The second acquisition means acquires the singing data of the upper user transmitted from the management server,
The control means includes information based on the pitch of the song represented by the song data and the pitch of the reference melody represented by the reference data, together with the lyrics represented by the lyrics data, and display means To display
Karaoke system featuring A karaoke system configured to allow communication between an information processing device and a management server,
The information processing apparatus includes a reception unit, a first transmission unit, a first acquisition unit, a second acquisition unit, and a control unit.
The management server includes a storage unit, a first specifying unit, a second specifying unit, and a second transmitting unit,
The accepting means accepts an instruction to select music identification information associated with user identification information,
The first acquisition means acquires lyric data representing the lyrics of the music and the singing timing of the lyrics based on the music identification information received by the receiving means;
The first transmission means transmits user identification information and music identification information received by the reception means to the management server,
The storage means stores lyric data representing the lyric of the music and the singing timing of the lyric, and reference data representing the reference melody of the singing of the music in association with the music identification information. The ranking information in which the singing scoring results are ranked for each song and the song data in which the user's song corresponding to the ranking information is recorded are stored in association with the user identification information of each of the plurality of users. And
The first identification unit is configured to determine whether the user corresponding to the user identification information is past based on the user identification information and the music identification information transmitted from the information processing apparatus among the rank information stored in the storage unit. The user who is a predetermined higher rank than the rank when singing the song corresponding to the song identification information is identified,
The second specifying unit corresponds to the song data when the upper user specified by the first specifying unit sings a song corresponding to the song identification information transmitted from the information processing apparatus, and the song identification information. Based on the reference data to identify the pitch difference between the singing pitch corresponding to each predetermined section in the singing data and the pitch of the reference melody corresponding to each predetermined section in the reference data,
The second transmission means transmits information representing a difference in pitches specified by the second specification means to the information processing apparatus,
The second acquisition means acquires information representing a pitch difference transmitted from the management server,
The control means causes the display means to display information representing the difference in pitch acquired by the second acquisition means together with the lyrics expressed by the lyric data acquired by the first acquisition means;
Karaoke system featuring