JP2004109264A - Karaoke sing-along machine and rating result display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a karaoke sing-along machine which enables a singer to review later which part of a karaoke song is sung well and which part is not sung well. <P>SOLUTION: The singing voice of the singer is scored in parallel to playing of the karaoke song. Score marks 52 determined at specified intervals on the basis of the scoring result are displayed over lyrics to be scored by being suerimposed on a lyrics telop 51 displayed on a monitor. The score marks are classified by red, yellow, and green according to evaluation, so the singer is able to intuitively know which part is sung well and which part is not sung well by viewing the score marks displayed in time series on the lyrics telop. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a karaoke device having a singing score function, and a grading result display device in a karaoke device, a game device, or the like.
[0002]
[Prior art]
Conventionally, some karaoke apparatuses have a scoring function for scoring the skill of a singer. The scoring function that has been put to practical use in the past generally displays a scoring result after the end of a karaoke song (for example, see Patent Document 1).
[0003]
There has also been proposed a system that displays a scoring result in real time during the performance of a karaoke song (for example, see Patent Document 2).
[0004]
[Patent Document 1]
JP-A-10-49183
[Patent Document 2]
JP-A-10-161673
[0005]
[Problems to be solved by the invention]
However, with a karaoke device that displays the scoring result after the performance of the karaoke song, the singer knows the skill of singing the whole song, but the singing part of the song is good and the singing part is bad I couldn't know.
[0006]
In addition, even in a karaoke apparatus that displays a scoring result during the singing of a karaoke song, since one display changes according to the skill of the singing at that time, it changes with the progress of the karaoke song, There was a drawback that it was not possible to look back on the skill of the past singing, that is, which part of the song was good and which part was bad.
[0007]
The present invention provides a karaoke apparatus capable of looking back at which parts of a karaoke song can be sung well and which parts have not been sung well, and a scoring result display apparatus applied to a karaoke apparatus or a game apparatus. The purpose is to:
[0008]
[Means for Solving the Problems]
According to the first aspect of the present invention, there is provided a performance unit for performing a karaoke song, a singing voice input unit for inputting a singing voice, a reference data output unit for outputting reference data in synchronization with the performance of the karaoke song, A scoring means for scoring the singing voice in parallel with the performance of the karaoke song by comparing the reference data, and a scoring result display for displaying the scoring result of the scoring means in chronological order in association with the progress of the karaoke song Means.
[0009]
According to the present invention, the scoring means scores the singing voice in parallel with the performance means playing the karaoke song, and the scoring results are output continuously or in a time series at predetermined intervals. Then, the scoring result display means displays the scoring results output in time series in chronological order in association with the progress of the karaoke song. Displaying in association with the progress of the karaoke song means displaying the scoring result so that the scoring result for any part of the karaoke song can be seen later, for example, by associating with the lyrics of the karaoke song If the scoring result is displayed, the target part of the scoring result can be determined by the lyrics. In addition, if the scoring result is displayed in association with the melody display such as a musical score, it is possible to determine a target portion of the scoring result based on the melody.
[0010]
According to a second aspect of the present invention, in the first aspect of the present invention, there is provided a lyrics display unit for displaying a lyrics telop of a karaoke song, and the scoring result display unit is provided by superimposing a scoring mark indicating the scoring result on the lyrics telop. Alternatively, it is characterized in that it is a means for displaying in the vicinity thereof.
According to the present invention, a scoring mark indicating the scoring result is displayed in association with the lyrics telop. The lyrics telop has a line break and a page break in accordance with the progress of the karaoke song, and is subjected to a wipe process to guide the singing. If the scoring result is displayed in association with this, it is possible to clearly display to the singer which part of the singing was successfully sung and which part was not well sung. In addition, since the display of the scoring result is displayed by marks instead of characters or graphs, there is an advantage that the scoring result can be intuitively understood even during singing.
[0011]
According to a third aspect of the present invention, in the first and second aspects of the present invention, the performance means is provided with a rewinding means for rewinding the performance of the karaoke tune and replaying a portion which has already been played, and the scoring result display means comprises: The display of the scoring result after the start point of the replay is erased.
A technique for rewinding the performance of a karaoke song is described in detail in Japanese Patent Application Laid-Open No. 2000-99044 of the present applicant. When the performance is rewound by applying such a technique, the display of the scoring result attached to the previous singing is erased (the previous scoring result display is retained). As a result, rewind performance can be performed, and scoring can be restarted from the performance restart position.
[0012]
According to a fourth aspect of the present invention, there is provided a process execution unit for executing a predetermined process, an input processing unit for receiving an input corresponding to the progress of the process, and a reference data output unit for outputting reference data in synchronization with the progress of the process. A scoring means for scoring the accuracy of the input by comparing the input and the reference data, and a scoring result display means for displaying the scoring result of the scoring means in chronological order in association with the progress of the process, It is characterized by having.
[0013]
The present invention is applicable not only to karaoke apparatuses but also to game apparatuses and various learning support apparatuses. A process is a procedure that the device executes with its own function or in response to a user operation. The input is an input operation performed by the user in accordance with the progress of the process, for example, a dance step in a dance game device, and an input of a character displayed as a task in a type practice device. This input is scored by comparing it with reference data in which an accurate input pattern is recorded, and the scoring result is displayed in association with the progress of the process (step diagrams of the dance and character strings of the assignments), whereby The part can be made well, and which part could not be made good can be displayed to the user in an easy-to-understand manner.
[0014]
BEST MODE FOR CARRYING OUT THE INVENTION
A karaoke apparatus according to an embodiment of the present invention will be described with reference to the drawings. This karaoke apparatus performs not only a normal mode operation of outputting a background video / lyric telop to a monitor while generating a musical sound of a karaoke song, but also performs a scoring mode operation. The scoring mode of this karaoke device is a function that grades the singing skill almost in real time and displays the scoring result as a scoring mark on the lyrics telop and leaves it as it is. You can look back later to see if your singing was bad.
[0015]
FIG. 1 is a block diagram of the karaoke apparatus. The karaoke apparatus includes a CPU 10 for controlling the operation of the entire apparatus and various devices connected thereto. The hard disk 11, the RAM 12, the sound source 13, the mixer (effector) 14, the scoring device 19, the MPEG decoder 20, the synthesizing circuit 21, and the operation unit 23 are connected to the CPU 10. The hard disk 11 stores song data for playing a karaoke song, video data for displaying a background video on a monitor, and the like. The RAM 12 has an area for reading out programs and music data, and has a scoring log area for recording scoring results and the like in the scoring mode.
[0016]
The sound source 13 forms a tone signal in accordance with music data (note event data or the like) input by the music sequencer 31 executed by the CPU 10. The formed tone signal is input to the mixer 14. The mixer 14 gives effects such as echo to a plurality of tone signals generated by the sound source 13 and a singing voice signal of the singer input via the microphone 17-A / D converter 18, and the like. Mix the signals with the proper balance. The mixed digital audio signal is input to the sound system 15. The sound system includes a D / A converter and a power amplifier, converts an input digital signal into an analog signal, amplifies the signal, and emits the sound from the speaker 16. The effect of the mixer 14 on each audio signal and the balance of the mixing are controlled by the CPU 10.
[0017]
The singing voice signal converted into a digital signal by the A / D converter 18 is also input to the scorer 19. The scorer 19 compares the frequency of the input singing voice signal with a reference to determine the amount of deviation, and inputs this to the CPU 10 as deviation data. As the reference, guide melody data included in the music data is used.
[0018]
In this embodiment, the scorer 19 compares the pitch (frequency) of the singing voice signal with the pitch of the reference to determine the difference, but the comparison target is not limited to the pitch. . For example, the volume, the rhythm, and the like may be compared, and the plurality of elements may be compared.
[0019]
The background video data 41 stored in the HDD 11 is encoded in the MPEG2 format, and the background video playback program 33 executed by the CPU 10 reads this and inputs it to the MPEG decoder 20. The MPEG decoder 20 converts the input MPEG data into an NTSC video signal and inputs the video signal to the synthesizing circuit 21. The synthesizing circuit 21 is a circuit for synthesizing a lyric telop and various OSDs on the video signal of the background video. The synthesized video signal is displayed on the monitor display 22.
[0020]
The operation unit 23 includes a panel switch interface, a remote control receiving circuit, and the like, and inputs an operation signal corresponding to an operation of a panel switch or a remote control device by a user to the CPU 10. The CPU 10 detects this operation signal by the operation input processing program 35 and executes a corresponding process. This operation input processing program 35 is included in the system program.
[0021]
The panel switch and the remote controller are provided with various key switches for selecting a song number and selecting a mode such as a scoring mode. In addition, an RW button for rewinding (rewinding) the performance location during the performance of the karaoke song is also provided.
[0022]
When a song number is input by a panel switch or a remote control device, the operation input processing program 35 detects this and transmits it to the sequencer 30 as a request for a karaoke song. In response, the sequencer 30 reads out the song data of the karaoke song identified by the song number from the song data storage area 40 of the hard disk 11. The sequencer 30 includes a music sequencer 31 and a lyrics sequencer 32. The lyrics sequencer 32 includes a character pattern creation program 32a. The music sequencer 31 reads out data of a track such as a performance data track and a guide melody track in the music data, and controls the sound source 13 with the data to generate a performance sound of a karaoke music. The lyrics sequencer 32 reads out the data of the lyrics track in the music data, creates an image pattern of the lyrics telop based on the data, and outputs it to the synthesizing circuit 21. Further, the background video reproduction program 33 reads out predetermined background video data according to an instruction from the sequencer 30 and inputs the data to the MPEG decoder 20.
[0023]
Here, the music data stored in the hard disk 11 will be described with reference to FIG. As shown in FIG. 2A, the music data includes a musical sound track for playing a karaoke music, a guide melody track for generating a guide melody, a lyrics track for displaying lyrics telop, and a break in the music. The mark data track includes the mark data track on which the indicated mark data is written. The song data has a header, audio data, audio data control track, and the like in addition to the above, but is omitted in this figure for simplicity.
[0024]
Each track is described in accordance with the MIDI format, and is composed of event data and timing data indicating the read timing of each event data, as shown in FIG. The timing data can be composed of duration data indicating a time interval between event data, absolute time data indicating an absolute time from the start time of the music, and the like. The event data of the musical sound track and the guide melody track is composed of note event data indicating the pitch, volume, on / off, etc. of the musical sound. When the note event data is input to the sound source 13, the sound source 13 Produces or silences the tone corresponding to the data. The musical tone track is composed of a plurality of tracks (parts) for generating musical tones of many musical instruments, and the guide melody track is a main melody track for guiding a main melody, and guides an upper / lower melody melody. The upper / lower melody track is used.
[0025]
In the mark data track, mark data indicating various break points in the karaoke music is written. The mark data includes the first chorus mark written at the break between the introduction and the first chorus, the interlude mark written at the first chorus and the interlude break, the second chorus mark written at the interlude and the second chorus break, and the second chorus There are an ending mark written at the boundary between the eyes and the ending, and a rust start mark and a rust end mark written at the start and end points of the rust in each chorus. This mark is synchronized with the tone generated by the performance track and the guide melody track, and is described as a system exclusive message.
[0026]
On the other hand, the event data of the lyrics track is sequence data in which the lyrics telop of the karaoke song is implemented by system exclusive data, and has event data different from those of the musical sound track and the guide melody track as shown in FIG. are doing. The event data is page break data, lyrics display data, and the like.
The lyrics display data includes various data for displaying one line of lyrics telop. The page separation data is data that separates two to four pieces of lyrics display data in units of one line, and the lyrics telop of the lyrics display data separated by the page separation data is simultaneously displayed on the monitor 22 as one page. Lyrics separated by the page separation data generally correspond to musical phrases of a karaoke song.
[0027]
The lyrics display data includes display on timing, display off timing, character string data, color 1 data, color 2 data, wipe data (wipe function), and the like. The character string data includes, in addition to the text data of characters, the number of display points of each text, display coordinates, data between characters, and the like. Here, the wipe is a process of smoothly changing the character color of the lyrics telop from left to right in accordance with the progress of the singing, and according to the wipe data (wipe function) shown in FIG. Done. The color 1 data and the color 2 data are the character colors before and after wiping the characters of the lyrics telop.
[0028]
The lyrics telop is displayed at t = 0 in the wipe function of FIG. ₁ Starts the wipe. Then, the wipe proceeds based on the wipe function, and t ₂ Completes the wipe of all characters. After that, the lyrics telop is erased after all of them are displayed in color 2 only during te. The character telop image is created and wiped by the character pattern creation program 32a, and the telop display is started and erased by the synthesizing circuit 21.
[0029]
In the performance of the karaoke song in the normal mode, the sequencer 30 generates the karaoke performance sound and displays the lyrics telop as described above. In the grading mode, the grading mode processing program 34 additionally performs the following. Such processing is performed.
[0030]
First, the contents of the screen display in the scoring mode will be described with reference to FIGS. During the karaoke performance in the scoring mode, the contents as shown in FIG. The point that the background image 50 is displayed on the entire screen of the monitor 22 and the lyrics telop 51 is displayed thereon by superimposition synthesis as in the case of the karaoke performance in the normal mode.
In the grading mode, a grading mark 52 is displayed on the lyrics. The scoring mark 52 is a ball-shaped mark displayed side by side on the lyrics telop in accordance with the progress of the music. The scoring device 19 and the scoring mode processing program 34 score the skill of the singer's singing at predetermined time intervals (for example, every 150 ms), and use the scoring result as a scoring mark on the lyrics corresponding to the singing target song. To be displayed.
[0031]
In this embodiment, the skill of the singing is determined based on the difference (cent value) between the singing frequency of the singer and the pitch indicated by the reference (guide melody data). 4A, the grading mark is determined based on the grading mark determination table as shown in FIG. 4A, and the grading mark is displayed at the position of the lyrics of the singing song to be graded.
[0032]
Here, in the scoring mark determination table of FIG. 4A, the red mark (large shift), the orange mark (during shift), the yellow mark (small shift), and the green mark (no shift) according to the size of the shift. A ball-shaped mark of the color is displayed. In this table, the easy mode, the normal mode, and the hard mode are modes for setting the difficulty level (strictness of scoring). When the mode is shifted from the normal mode to the scoring mode, the mode of the difficulty level may be selected at the same time. it can.
It should be noted that the green mark may not be displayed because it is not necessary to call the singer's attention when the singer is singing well.
[0033]
Further, the shape of the mark is a ball shape, but the shape of the mark is not limited to a spherical shape, and may be a character shape such as a pig.
Further, the size of the deviation (scoring result) is distinguished by the color of the mark, but this distinction may be made by the shape and size of the mark. Further, the distinction based on color, shape, and size may be used together.
[0034]
In this scoring mark determination table, the scoring device 19 outputs displacement data indicating the frequency deviation between the singing voice signal and the reference every 50 ms, and the scoring mode processing program 34 accumulates this deviation data three times and outputs the data every 150 ms. 7 is a table for determining and displaying a grading mark on a table. Therefore, the shift amount of the red mark (large shift) in the easy mode is 300 or more when there is a shift of 100 cents (semitone) or more on average each time. If the display interval of the marking marks is other than 150 ms, the value may be increased or decreased according to the display interval.
[0035]
Further, at the top of the screen, a scoring mode display 58 which is an OSD indicating the scoring mode, a mode display 53 of the above-mentioned easy mode, normal mode or hard mode, a microphone input level 56, a guide melody setting 57, a repetition operation count 59 , And the scoring meter 54 are displayed.
[0036]
The guide melody setting 57 is an indicator for displaying the volume of the guide melody and the selected content of the guide melody track of the song data. By operating the guide melody button on the remote control device or the operation panel, the user can switch the setting of the guide melody, and the setting is reflected on the display of this indicator. As shown in FIG. 4C, the guide melody is set to “OFF”, “(main melody) volume 1”, “(main melody) volume 2”, “(main melody) volume 3”, “(up And ((lower melody) volume 3). Each time the guide melody button is turned on, the above setting is toggled.
[0037]
The number of times of repetition 59 indicates the number of times the user has operated the RW (rewind) button to rewind the performance and repeatedly play a partial section of the music. The rewind function will be described later.
[0038]
The scoring meter 54 is a bar-graph-like indicator that displays the singing skill of the entire song. In the scoring mode, the karaoke song is divided into 30 sections, the skill of the singing is determined for each section, and the section evaluation mark display area 55 of each section set on the scoring meter 54 displays the determination result of each section. The corresponding section evaluation marks (55) are sequentially displayed. As shown in FIG. 4 (B), there are seven types of section evaluation marks, and which section evaluation mark to display is determined in accordance with the progress of the performance according to the totaling result of the scoring results in that section. Each time the singing is evaluated, the mark displayed in the display area 55 of the section is updated.
[0039]
Below the scoring meter 54, a delimiter mark 61 indicating the start point (or end point) of the first chorus, the second chorus, and the chorus of the karaoke song is displayed. A cursor 60, which is a red horizontal line indicating the currently playing section, is displayed above the scoring meter in accordance with the progress of the performance of the karaoke song.
[0040]
The division of the section of the scoring meter 54 is performed by equally dividing the entire tune from the beginning of the intro to the end of the ending into 30 equally, and for example, the number of notes (the number of event data of the guide melody track) becomes equal. It is not necessary to be equal in terms of time, for example, by dividing in such a manner. It is not necessary that the target of division (display target of the scoring meter 54) is the entire performance time. For example, only a portion where a singing portion (guide melody data (event data)) exists may be set as a division target, or may be a part of a song such as only a first chorus. Further, the number of divisions is not limited to 30.
[0041]
Here, the section evaluation mark will be described with reference to FIG. There are seven types of section evaluation marks, each of which has a code of 6 to 0 for recording in the scoring log. Among them, the blue mark (code 0) is an unevaluated mark indicating a section that has not been evaluated yet. At the start of a karaoke song, all sections are marked with this blue mark. The blue-green mark (code 1) is an evaluation mark indicating that the section is currently being played and the singing is being evaluated. Further, the dark blue mark (code 2) is a mark indicating a section where there is no place to be sung, such as a prelude, an interlude, and a follower (not evaluated).
[0042]
A crown mark (code 6), a green mark (code 5), a pink mark (code 4), and a red mark (code 3) are section evaluation marks indicating evaluation for actual singing.
The crown mark is a section evaluation mark that can be determined and displayed when there is no red mark (large shift), orange mark (during shift), or yellow mark (small shift) of the marking marks in the section. It means that he was excellent.
The green mark is determined when there is no red marking mark and the orange and yellow marking marks are 5% or less of the singing time in the section, that is, the yellow counter value is 5% or less of the scoring counter value. A section evaluation mark to be displayed, which means that the singing in this section has passed.
The pink mark indicates that there is one or two red marking marks, or that the orange and yellow marking marks are 5% or more of the singing time in the section, that is, the yellow counter value is 5% of the value of the rating counter. This is a section evaluation mark determined and displayed when the percentage is equal to or more than the percentage, and means that singing in this section requires effort.
The red mark is a section evaluation mark that is determined and displayed when there are three or more red marking marks, and means that singing in this section is rejected.
If the singing voice is not input even though it is a place to sing (where there is a guide melody), no scoring mark is displayed as non-singing, but in the determination of the section evaluation mark, the same as the red scoring mark To be treated.
[0043]
FIG. 5 is a diagram showing a flow of processing of each program in the scoring mode. This figure mainly describes processing for displaying a marking mark. When playing a karaoke song, the song sequencer 31 and the lyrics sequencer 32 operate in synchronization. The music sequencer 31 reads out the event data of the performance track and inputs it to the sound source 13 to generate a musical sound. Also, the event data of the selected guide melody track is read and input to the sound source 13 to generate a guide melody. On the other hand, the lyric sequencer 32 reads out event data (lyric display data) of the lyric track, displays the lyric based on this, and changes the character color of the lyric according to the progress of the tune based on the wipe function.
[0044]
Further, the music sequencer 31 inputs the event data (pitch information) of the selected guide melody track to the scoring device 19 as a reference. Further, the singing voice of the singer who sings according to the display of the performance sound of the karaoke music and the lyrics telop is also input to the scorer 19. The scorer 19 compares the pitch detected from the singing voice with the reference pitch information, and outputs deviation data, which is the result of the comparison (the cent value of the deviation), every 50 ms. This deviation data is read by the scoring mode processing program 34. The scoring mode processing program 34 totals the deviation data a plurality of times (usually three times = 150 ms), and determines which scoring mark to display based on the totaled result.
In the scoring mark determination table of FIG. 4A, the scoring mark is determined based on the total value of the deviation data. However, the method of determining the scoring mark is not limited to this. Alternatively, it may be determined based on the number of times that any data larger than a predetermined value is input.
[0045]
When the grading mode processing program 34 determines a grading mark, the grading mode processing program 34 acquires the wipe position information at that time from the lyrics sequencer 32. Then, the display position of the scoring mark is determined based on the wipe position information. Then, by forming the graphic pattern data of the created scoring mark at this display position and outputting it to the synthesizing circuit 21, the scoring mark 52 is displayed on the lyrics telop 51. At the same time, the determined marking mark and its absolute time are recorded in a marking log.
In addition, even in a singing section to be scored (a section where a guide melody is pronounced), when a singing voice signal of the singer is not input, the scorer 19 outputs a non-singing signal. In this case, the scoring mode processing program 34 does not display the scoring mark as scoring impossible.
[0046]
Here, a method for determining the display position of the marking mark will be described with reference to FIG. In FIG. 9A, it is assumed that when the scoring mark is determined, the wipe position acquired from the lyrics sequencer 32 at that time is A. This wipe position is obtained by the wipe function of FIG. Generally, the wiping of the lyrics telop is performed prior to the performance (singing) so as to guide the singing. Therefore, when the wiping position is A, the position of B is considered to be the playing position. In other words, it is considered that the song sequencer 31 is performing the singing of the lyrics displayed at the position B. On the other hand, the scoring mark was determined based on the time required for scoring by the scoring device 19 (50 ms) and the accumulation of deviation data a plurality of times by the scoring mode processing program 34 (150 ms). Since the input of the singing voice (the first part) is delayed by about several hundred ms, when the grading mark is determined, the lyrics corresponding to the singing voice to be scored are displayed at the position C which is retroactive from the performance position by the delay time. It is thought that the lyrics are. Therefore, the scoring mode processing program 34 sets the position of C moved leftward from the wipe position A acquired from the lyrics sequencer 32 at the time of determining the scoring mark by the advance of the wipe and the scoring delay time as the scoring target position. Is displayed at this position.
[0047]
When the wipe of the lyrics telop is line-breaked, a scoring mark may be displayed at a position moved by the above distance over two lines. Also, when the lyrics telop page is switched, it is not possible to return to the previous page and display a grading mark. Therefore, the grading mark immediately after the page is switched should be displayed at the beginning of a new line. Just fine. In addition, since the singing is often interrupted at the break of the phrase at the position where the lyrics telop is to be changed, the display of the scoring mark at this point may be omitted.
[0048]
When the scoring mode processing program 34 inquires of the wipe position information, the lyrics sequencer 32 returns the preceding wipe position from the performance of the wipe and the wipe position which is delayed by a delay due to the scoring. Becomes unnecessary.
[0049]
FIG. 2B is a diagram for explaining a method of displaying a marking mark when the progress of the wipe is stopped.
For example, in the case of singing with one pronunciation of the lyrics extended, the song progresses but the lyrics do not progress. In such a case, a plurality of grading marks are sequentially determined as the music progresses, but since the lyrics telop has not progressed, the display position of the grading marks is also determined to be the same position without progressing. However, if the scoring marks are completely overlapped and displayed, the previously displayed scoring marks will be completely hidden, making it impossible to look back and see past scoring marks. Therefore, when displaying a plurality of scoring marks when the wipe has not progressed, the display position of the new scoring mark is gradually moved upward. Thereby, even if the plurality of marking marks overlap (at the left and right positions), they are shifted up and down, so that all of the plurality of marking marks can be seen later.
[0050]
Here, the scoring log 42 will be described with reference to FIG. As shown in FIG. 7A, the log of the grading mark records the absolute time (time from the start of the music) at which the grading mark is displayed and the content of the mark. Thereby, when the performance of the music is rewound and repeated by the reverse jump, the scoring mark can be displayed again. FIG. 7B is a diagram showing a log of the scoring meter. In this log, the start time and end time of each section and the evaluation of the section (code of the section evaluation mark) are recorded corresponding to the section number (1 to 30) of each section divided into 30.
[0051]
Hereinafter, the operation of the karaoke apparatus in the scoring mode will be described with reference to a flowchart.
FIG. 8 is a flowchart showing a main operation when playing a karaoke song in the scoring mode. When there is a request, music data corresponding to the request is read (s1). Then, the total playing time of the music data is divided into 30 sections (s2). Then, the start time and the end time of each of the divided sections are recorded in a scoring log (FIG. 7B) (s3). Then, the mark data track of the music data is read out, and a break mark 61 is displayed at a break position such as the start position of the first chorus and the second chorus on the scoring meter 54 (s4).
[0052]
Next, all the lyrics display data, which is the event data of the lyrics track, are scanned to determine the total number of characters in the lyrics, and the progress speed of the lyrics (wipe) being played is determined based on the ratio between the total number of characters and the playing time. Then, it is determined at which time interval the scoring mark is to be displayed based on the progress speed of the lyrics (s5). That is, if the grading marks are displayed at short intervals in a song whose lyrics progress slowly, the grading marks overlap each other, and the visibility of each grading mark deteriorates. In addition, if a grading mark is displayed at long intervals for a song whose lyrics progress rapidly, the display of the grading mark will be delayed. Therefore, the progress speed of the lyrics being played is calculated based on the number of characters of the lyrics and the performance time, and the display (time) interval of the marking marks is determined based on this. The standard display interval is 150 ms.
[0053]
Thereafter, the performance of the karaoke song is started, and the song sequencer 31 reads the data of the performance track and the guide melody track in accordance with the tempo clock and inputs the data to the sound source 13, and the lyrics sequencer 32 reads the data of the lyrics track and writes the lyrics telop. A predetermined performance process such as formation is performed (s6). The scoring device 19 and the scoring mode processing program 34 also operate in parallel with the performance process, and execute the scoring mark determination display process (s7) and the scoring meter decision display process (s8) shown in FIG. . The performance process (s6), the scoring mark process (s7), and the scoring meter process (s8) are performed in parallel until the song ends, and when the song ends (s9), the operation ends.
[0054]
9 to 11 are flowcharts showing the scoring meter processing.
FIG. 9 is a flowchart showing the cursor display processing. When the music starts, 1 is set to the section number register m indicating the section being played (s40), and a red cursor is displayed on the block (section evaluation mark display area) 54 designated by the section number m (s41). . This display is continued until this section elapses (s42). When the section elapses, 1 is added to the section number register m (s44), and the cursor is moved to the block designated by this section number m (s41). When m = 30 and the section ends (s43), the cursor is deleted (s45) and the operation ends.
Thus, the cursor is always displayed on the block corresponding to the currently playing section.
[0055]
10 and 11 are flowcharts showing the section evaluation mark display operation. When the music starts, 1 is set to the section number register n indicating the section to be evaluated (s49), various counters are cleared (s50), and the section evaluation mark display area (block) 55 of the section number n is being evaluated. The mark (blue-green mark) is displayed (s51). Then, it waits until a grading mark or a non-singing signal is input from the grading mark processing module (s52, s60) or until this section has elapsed (s65).
[0056]
When a grading mark or a non-singing signal is input (s52), 1 is added to a grading counter that counts the number of grading marks (s53), and the color of the grading mark is determined (s54). If the color is green (no deviation), the process returns to the standby routine of s52. If the color is orange (during shift) or yellow (small shift), 1 is added to the yellow counter (s55), and the process returns to the standby routine of s52.
[0057]
On the other hand, when the color of the marking mark is red (large deviation) or when a non-singing signal is input, 1 is added to the red counter (s56), and the count value of the red counter to which 1 has been added, That is, the number of red marks (including non-singing signals) appearing in this section is determined (s57). When the number of red marks is two or less, that is, one or two, a pink mark (necessary effort mark) is displayed as a section evaluation mark (instead of the evaluation mark) even in the middle of the section ( s58). Thereafter, the process returns to the standby routine of s52. When the number of red marks is three or more, a red mark (fail mark) is displayed instead of a pink mark as a section evaluation mark (s59), and evaluation of this section is performed even in the middle of the section. End and proceed to s64. This is because, when a red mark is obtained, the evaluation of the section remains unchanged. Note that the scoring mark is continuously determined and displayed even when the evaluation is completed in the middle of the section. It should be noted that the scoring mark processing module outputs a non-singing signal to the scoring meter processing module described in this flowchart when a non-singing signal is input three consecutive times from the scoring device 19.
[0058]
If the section has elapsed without the count value of the red counter becoming 3, the process proceeds from s65 to s66. In s66, the rule section evaluation mark described in FIG. 4B is determined. In other words, if there is no red, orange, or yellow marking mark, the crown (or star) mark (excellent) is determined, and there is no red marking mark, and the orange and yellow marking marks sing within the section. If the value of the yellow counter is 5% or less, that is, the value of the yellow counter is 5% or less of the value of the scoring counter, the green mark (pass mark) is determined. If the number of red scoring marks is one or two (s57, (processed in s58) or a pink mark when the orange and yellow marking marks are 5% or more of the singing time in the section, that is, when the yellow counter value is 5% or more of the scoring counter value (needs effort) To decide.
However, if the time to be sung is less than 30% of the time of the entire section, the ratio of the yellow counter for determining either the green mark or the pink mark is changed from 5% to 10% and a slight mistake is made. To prevent it from becoming a pink mark.
[0059]
The section evaluation mark thus determined is displayed in the corresponding section evaluation mark display area 55 of the scoring meter 54 (s67). Then, 1 is added to the section number n indicating the section to be evaluated (s69), and the process returns to s51.
At this time, if the current section is the last section (n = 30) and there is no next section (s68), the operation ends.
[0060]
Further, 1 is added to the section number n (s69), and when there is no place to be sung in the next section specified by this section number, for example, in the section of the interlude or the trailer where there is no singing, (S71), a dark blue mark (no singing, not evaluated) is displayed in this section (s72), and the process returns to s68 to check for the presence of singing in the next section. The presence or absence of singing can be determined by checking the guide melody track in the music data.
[0061]
The processes of s69 to s71 are repeated until a section to be sung is found. If a section to be sung is found (s71), the section of the karaoke song played by the sequencer 30 is evaluated. It waits until it catches up with the section (section number n) (s73), and when the performance section enters the evaluation target section, returns to s51 to resume the evaluation. If the section ends while the processing of s68 to s71 is repeated (if the section is a trailing section), this processing (section of the scoring meter) is performed when the section number n = 30. The evaluation mark display processing) ends.
[0062]
By the above processing, when the performance of the karaoke tune enters the interlude, the non-evaluation mark is displayed before the performance until the interlude ends, and the singer can know how far the singer can rest the singing. In addition, when the karaoke song is completed and the tune is completed, a non-evaluation mark is displayed until the end of the song, so that the singer can know that the singing is completed.
[0063]
With the above operation, the scoring mark can be displayed in parallel with the performance of the karaoke tune (display of the lyrics telop), and the section evaluation mark can be displayed on the scoring meter as the section progresses.
[0064]
As described above, this karaoke apparatus has a rewind function. The rewind function is a function that allows a part (or all) of the karaoke song to be repeatedly played by turning on the RW button (rewind button) during the performance of the karaoke song. When the function is used, the scoring mark is also erased and displayed again according to the rewinding. Further, by using the rewind jump function, it is possible to automatically jump to a section that has already been sung and has a poor evaluation.
[0065]
Hereinafter, the operation of the CPU 10 when the RW button is pressed will be described with reference to FIG. When the RW button is turned on, all musical tones generated at that time are turned off (s20). This processing is executed when the operation input processing program 35 detects an ON event of the RW button and notifies the sequencer 30 (the music sequencer 31).
[0066]
Then, whether the operation is a jump operation or a rewind operation is determined depending on whether the ON state of the RW button has been continued for one second or more or less than one second (s21, s22). That is, if the ON state continues for one second or longer, it is determined that the operation is a normal rewind operation, and if the OFF state is performed for less than one second, it is determined that the operation is a jump operation for jumping in divided sections. When the jump operation is performed in the scoring mode, the jump is automatically performed not to the head of the latest section, but to the head of the section with poor evaluation.
[0067]
When the jump operation is performed, the section of the red mark (fail) closest to the performance time at that time is searched for with reference to the log of the scoring meter (FIG. 7B) (s23). Then, a position three seconds before the start time of this section recorded in the log is set as the performance restart time. The reason for moving back three seconds is that a singer cannot sing the beginning of the section if the performance is suddenly restarted from the beginning of the section. The time to go back is not limited to 3 seconds.
[0068]
After determining the performance resumption time in this way, the lyrics display data for displaying the lyrics at the performance resumption time is searched for by referring to the timing data indicating the readout timing of the event data. At the same time as the monitor 22 (s25), the wipe is progressed at a stretch until the performance restart time (s26). Then, all of the scoring marks displayed on the lyrics telop page are once displayed (s27). This allows the singer to know what the singing was before the performance resumed. Thereafter, the scoring mark after the performance resuming time is deleted (s28), and the log of the scoring mark after the performance resuming time is deleted (s29). Thereafter, the performance is started from the performance restart time (s30).
The display position of each scoring mark can be calculated again by referring to the wipe function at each display time in the method shown in FIG. 6, but the display position information is also recorded in the log shown in FIG. By doing so, this redisplay can be expedited.
[0069]
On the other hand, if the RW button is kept pressed for one second or longer, it is not a jump operation but a rewind of an arbitrary time, and the time during which the RW button is kept on is counted in s32. When the button is turned off (s22), the time corresponding to the time that the button was turned on is subtracted from the performance time at that time to obtain a performance restart time (s33). For example, a time four times as long as the on time is subtracted to obtain a performance restart time. As described above, high-speed rewinding can be performed by subtracting a time longer than the ON time (note that the karaoke performance rewinding technique is disclosed in Japanese Patent Application Laid-Open No. 2000-99044 by the present applicant. In detail). After calculating the performance restart time, the process proceeds to s25.
[0070]
Although the display and log of the section evaluation mark are not deleted even when the rewind operation is performed, they may be deleted. Even if it is not erased, when a new section evaluation mark is determined in the same section by rewinding, the display and the log are overwritten.
[0071]
In this case, the newly determined section evaluation mark is compared with the previously displayed and logged section evaluation mark, and the newly determined section evaluation mark having a lower evaluation than the previously displayed and logged section evaluation mark If so, this may be discarded without overwriting.
[0072]
As described with reference to FIG. 6B, in the case where only singing progresses in a state where the lyrics do not progress, the scoring mark is moved upward little by little and displayed, but the moving direction is downward. It may be. In this case, instead of moving the display position, the shape of the scoring mark may be changed little by little so that the plurality of scoring marks do not completely overlap. For example, by gradually reducing the scoring marks, the scoring marks below can be seen.
[0073]
Further, in this embodiment, the frequency of the singing voice signal is compared with the frequency indicated by the reference, and the singing is scored based on the difference. However, the grading target is not limited to the frequency of the singing, and the singing frequency is not limited. Any singing element, such as volume, singing rhythm, etc., can be scored. Also, a plurality of elements may be scored individually or collectively.
[0074]
Further, in this embodiment, the invention of the present application is applied to the function of the scoring mode of the karaoke apparatus. However, the present invention can be applied to a karaoke apparatus other than the karaoke apparatus as long as the contents of the scoring and evaluation are displayed in chronological order. For example, if it is applied to a video game or an arcade game that competes for the accuracy of musical instrument playing and dance steps, not only the accuracy of each moment but also the chronological order of what was good and what was not good during the game and at the end of the game It will be possible to look back later.
[0075]
<< Invention described in the embodiment >>
In the above embodiment, the following inventions are disclosed in addition to the inventions of claims 1 to 4 described in the claims.
[0076]
(1) The karaoke apparatus according to claim 1, wherein the scoring result display means is means for displaying the scoring result at a fixed or arbitrary interval.
Various modes such as a graph-like display, a character string display, and a mark string display can be applied to the time-series display of the grading result, and by displaying these at predetermined (constant or arbitrary) intervals, It is possible to display the time-series grading results without delay and without being difficult to see. The interval in the present invention includes both a time interval and a distance interval.
[0077]
(2) The karaoke apparatus according to claim 2, wherein the scoring result display means controls a time interval for displaying the scoring mark in accordance with a progress speed of the lyrics telop.
The progress speed of the lyrics telop in the present invention means the speed of progress of the karaoke song on the lyrics telop, in other words, the wipe speed of the lyrics telop. The time interval for displaying the scoring mark is controlled in accordance with the progress speed of the lyrics telop. For example, when the progress speed of the lyrics telop is high, by shortening the time interval for displaying the scoring marks, the display of the scoring marks does not become sparse, and scoring can be performed densely in time. In addition, when the progress speed of the lyrics telop is slow, by increasing the time interval for displaying the marking marks, the display of the marking marks does not become too dense and overlap.
[0078]
(3) In the invention according to claim 2 or (2), the scoring result display means displays a plurality of scoring marks at a place where the lyrics telop does not progress even if the karaoke song progresses, in accordance with the progress direction of the lyrics telop. Is a karaoke device that displays while gradually moving or gradually deforming in another direction.
For example, in a place where one of the lyrics is extended for a long time and sings (Nobashi), the performance of the karaoke song progresses, but the lyrics telop does not progress. Even in such a place, since the song is sung in a stretch, a scoring mark scoring this is determined and displayed. When a grading mark is displayed in association with the progress of the lyrics telop, the grading mark is displayed at the same position when the lyrics telop does not progress. In this case, since the previously displayed grading mark is hidden by the later displayed grading mark and cannot be viewed later, in such a case, according to the present invention, in such a case, the moving direction differs from the direction of the lyrics telop. Displayed while gradually moving in the direction or while gradually deforming. Thus, the previously displayed scoring mark is not hidden by the previously displayed scoring mark, but can be viewed later.
[0079]
(4) In the above inventions, the karaoke apparatus is the reference data, which is data of a guide melody track included in music data used for performing a karaoke music.
By using the guide melody data of the karaoke song as the reference data, it is not necessary to separately prepare reference data, and the singing of the song can be scored simultaneously with the delivery (online delivery) of the song data of the karaoke song. In addition, since a general karaoke apparatus can produce a guide melody in parallel with the performance of a karaoke song, singing with reference to this allows the singer to obtain a good score result. Become.
[0080]
(5) In each of the above inventions, the scoring means compares one or more of a plurality of singing elements including the frequency, volume, and rhythm of the singing voice and reference data, and scores the singing based on the degree of coincidence. A karaoke device.
Singing elements include various elements such as frequency, volume, rhythm, technical elements such as vibrato and fist, and waveform elements such as voice quality. By scoring one or more of these, a karaoke song It is possible to realize a scoring function suitable for improving the singing of the song.
[0081]
【The invention's effect】
As described above, according to the present invention, singing of a karaoke song is continuously scored, and the scoring result is displayed in chronological order in association with the progress of the karaoke song. It can be displayed to the singer in an easy-to-understand manner whether the singer could not sing well.
[0082]
According to the present invention, inputs to devices such as a game device and a learning support device are continuously scored, and the results of the scoring are displayed in chronological order in association with the progress of the process of the device. It can be displayed so that the user can easily understand which part has not been input well and can confirm it later.
[0083]
[Brief description of the drawings]
FIG. 1 is a block diagram of a karaoke apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram showing a configuration example of music data used in the karaoke apparatus.
FIG. 3 is a diagram showing an example of a screen display in a grading mode of the karaoke apparatus.
FIG. 4 is a view for explaining setting of a scoring mark, a section evaluation mark, and a guide melody displayed on the karaoke apparatus.
FIG. 5 is a diagram illustrating a flow of a marking mark display operation of the karaoke apparatus.
FIG. 6 is a view for explaining a method of determining a display position of a marking mark of the karaoke apparatus.
FIG. 7 is a diagram showing a scoring log of the karaoke apparatus.
FIG. 8 is a flowchart showing a karaoke performance procedure of the karaoke apparatus.
FIG. 9 is a flowchart showing a cursor display operation of the karaoke apparatus.
FIG. 10 is a flowchart showing a section evaluation mark display operation of the karaoke apparatus.
FIG. 11 is a flowchart showing a section evaluation mark display operation of the karaoke apparatus.
FIG. 12 is a flowchart showing processing when an RW (rewind) button is pressed in the karaoke apparatus.
[Explanation of symbols]
10 CPU, 11 hard disk, 12 RAM, 13 sound source, 14 mixer, 15 sound system, 16 speaker, 17 microphone, 18 A / D converter, 19 scorer, 20 MPEG decoder, 21: synthesis circuit, 22: monitor, 23: operation unit,
Reference numeral 30: sequencer, 31: music sequencer, 32: lyrics sequencer, 32a: character pattern creation program, 33: background video reproduction program, 34: scoring mode processing program, 35: operation input processing program,
40 ... music data storage area, 41 ... background video storage area, 43 ... scoring log,
50: background video, 51: lyrics telop, 52: scoring mark, 53: (difficulty) mode display, 54: scoring meter, 55: section evaluation mark, 56: microphone input level display, 57: guide melody setting, 58 ... Scoring mode display, 59 ... Repeated operation count display, 60 ... Cursor, 61 ... Delimiter mark

Claims (4)

Performance means for playing karaoke songs,
Singing voice input means for inputting singing voice,
Reference data output means for outputting reference data in synchronization with the performance of the karaoke song;
By comparing the singing voice and the reference data, scoring means to score the singing voice in parallel with the performance of the karaoke song,
Scoring result displaying means for displaying the scoring result of the scoring means in chronological order in association with the progress of the karaoke song,
Karaoke device equipped with. Lyric display means for displaying the lyrics telop of the karaoke song,
2. The karaoke apparatus according to claim 1, wherein the scoring result display means is a means for superimposing a scoring mark indicating the scoring result on the lyrics telop or displaying the superimposed mark near the lyrics telop. The playing means has a rewinding means for rewinding the performance of the karaoke tune and replaying the already played part,
3. The karaoke apparatus according to claim 1, wherein the scoring result display unit deletes a display of the scoring result after the start point of the replay. 4. A process execution means for executing a predetermined process;
An input processing means for receiving an input corresponding to the progress of the process;
Reference data output means for outputting reference data in synchronization with the progress of the process,
By comparing the input and the reference data, scoring means for scoring the accuracy of the input,
A scoring result display means for displaying the scoring result of the scoring means in chronological order in association with the progress of the process,
Scoring result display device provided with

Images