JP2004109265A - Karaoke machine and scoring result display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a karaoke machine which enables a singer to review later which section of a karaoke song is sung well and which section not well. <P>SOLUTION: The singing voice of the singer is scored in parallel to playing of the karaoke song. The karaoke song is divided into 30 sections and sectional evaluation marks 55 are displayed by the sections. On a score meter 54, a display area (block) for displaying sectional evaluation marks of the 30 sections is formed and the sectional evaluation marks are displayed in the respective display areas one after another, so that the singer can take a look at the skill of singing by the sections in bird's-eye view. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a karaoke device having a singing scoring function, and a scoring result display device in a karaoke device or a game device.
[0002]
[Prior art]
Conventionally, some karaoke apparatuses have a scoring function for scoring the skill of a singer. The scoring function that has been put to practical use from the past generally displays a scoring result after the end of a karaoke song (see, for example, Patent Document 1).
[0003]
In addition, it has been proposed to display a scoring result in real time during the performance of a karaoke song (see, for example, Patent Document 2).
[0004]
[Patent Document 1]
Japanese Patent Laid-Open No. 10-49183
[Patent Document 2]
JP-A-10-161673
[0005]
[Problems to be solved by the invention]
With the scoring function that displays the scoring results after the song ends, the singer can know which part of the song is good and which part is bad, even if he knows how to sing the whole song could not.
[0006]
Further, even in the karaoke apparatus that displays the scoring results during the performance of the karaoke song, since one scoring result display object changes according to the skill of the singing at the time, it changes with the progress of the karaoke song. You can't look back on the skill of the past singing, that is, which part is good and which part is bad, and which section can be sung well after the performance of the karaoke song is finished There was a drawback that it was impossible to see a bird's-eye view of which section did not sing well.
[0007]
The present invention provides a karaoke device that can overlook which section of a karaoke song can be sung well and which section cannot be sung well, and a scoring result display device applied to a karaoke apparatus or a game apparatus The purpose is to do.
[0008]
[Means for Solving the Problems]
The invention of claim 1 is a performance means for playing a karaoke song, a singing voice input means for inputting a singing voice, a reference data output means for outputting reference data in synchronization with the performance of a karaoke song, and the singing voice. By comparing the reference data, the scoring means for scoring the singing voice in parallel with the performance of the karaoke song, and dividing all or part of the karaoke song into a plurality of sections, and the scoring means output And a scoring result display means for summarizing the scoring results for each section and displaying the summing results of each section side by side.
[0009]
In the present invention, the grading means scores the singing voice in parallel with the performance means playing the karaoke song. The scoring result display means divides all or part of the karaoke song into a plurality of sections and totals and displays the scoring results for each section. Here, the part of the karaoke music is, for example, only one chorus or only chorus. The tabulation results for each section are displayed side by side. Displaying side by side means that even if the aggregated result of the next section is displayed, the aggregated result of the previous section is not deleted, and when the song ends, the aggregated results of all sections are displayed in a list. . In this way, by dividing all of the karaoke songs or a part of the song to be scored into a plurality of sections and displaying the totaled score for each section, which section looks good overall. It is possible to confirm from a bird's-eye view which sections could be sung and did not sing well.
[0010]
The invention according to claim 2 is the invention according to claim 1, wherein the performance means includes rewind means for rewinding the performance of the karaoke song and replaying the already played portion, and the scoring result display means includes the The scoring results after the start point of the re-playing are recalculated.
A technique for rewinding the performance of a karaoke song is described in detail in Japanese Patent Application Laid-Open No. 2000-99044 of the present applicant. By applying such a technique, the performance is rewound, and the performance is started again from the place where it was rewound. At this time, the scoring results are counted again from this starting point. Thereby, the singer can re-sing the place that could not be sung well, make the karaoke device score again, and display the counting result again.
It should be noted that the display of the total result of each section after the rewind point may or may not be deleted, and if not deleted, it may be overwritten with the new total result of that section. In addition, when the new aggregation result is not better than the previously displayed aggregation result, it may not be overwritten.
[0011]
The invention of claim 3 comprises the lyrics display means for displaying the lyrics telop of the karaoke song in the inventions of claims 1 and 2, wherein the scoring result display means displays the scoring result output by the scoring means in the lyrics telop. While being displayed in the vicinity or in the vicinity thereof, the scoring results are totaled for each section.
In the present invention, the scoring results are displayed in association with the lyrics telop. Lyric telops are line feeds and page breaks corresponding to the progress of karaoke songs, and are wiped to guide the singing. If the scoring results are displayed in association with this, it is possible to display in an easy-to-understand manner to the singer which part of the song can be sung well and which part cannot be sung well. Then, by summing up the scoring results used for this display and creating and displaying the total result for each section, the singer can easily understand the basis of the evaluation for each section.
[0012]
The invention of claim 4 is a process execution means for executing a predetermined process, an input processing means for receiving an input corresponding to the progress of the process, a reference data output means for outputting reference data in synchronization with the progress of the process, , By comparing the input with the reference data, scoring means for scoring the accuracy of the input, and dividing all or part of the process into a plurality of sections, and the scoring results output by the scoring means for each And a scoring result display means for summarizing each section and displaying the total results of each section side by side.
[0013]
The present invention can be applied not only to a karaoke apparatus but also to a game apparatus and various learning support apparatuses. A process is a procedure that the device executes with its own function or in response to a user operation. The input is an input operation performed by the user in response to the progress of the process, for example, a dance step in a dance game device, and input of characters displayed as a task in a type practice device. The input is then scored by comparing it with reference data recorded with an accurate input pattern. Then, all or part of the process is divided into multiple sections, and the scoring results output by the scoring means are aggregated and displayed for each section according to the progress of the process (dance step diagram and assignment text). By doing so, it is possible to display in an easy-to-understand manner to the user which section has been successfully performed and which section has not been successfully performed.
[0014]
DETAILED DESCRIPTION OF THE INVENTION
A karaoke apparatus according to an embodiment of the present invention will be described with reference to the drawings. This karaoke apparatus not only performs the operation in the normal mode of outputting the background video / lyric telop to the monitor while generating the music of the karaoke song, but also executes the operation in the scoring mode. The scoring mode of this karaoke device is a scoring mark function for scoring the skill of singing in almost real time and displaying the scoring result as a scoring mark on the lyrics telop, and dividing the karaoke song into 30 sections A scoring meter function that evaluates the singing of the section based on the type, number, ratio, etc. of the scoring marks determined (displayed) within each section, and displays a list of section evaluation marks (totals) for each section It is made up of. With the scoring mark function, the singer can check in real time and in chronological order which lyric part is good and which lyric part is not good. With the scoring meter function, the singer can It is possible to see a bird's-eye view of which section sang well and which section did not sing well.
[0015]
FIG. 1 is a block diagram of the karaoke apparatus. The karaoke apparatus is composed of a CPU 10 that controls the operation of the entire apparatus and various devices connected thereto. A hard disk 11, a RAM 12, a sound source 13, a mixer (effector) 14, a grader 19, an MPEG decoder 20, a synthesis circuit 21, and an operation unit 23 are connected to the CPU 10. The hard disk 11 stores music data for playing karaoke music, video data for displaying a background video on a monitor, and the like. The RAM 12 includes an area for reading out programs and music data, and a scoring log area for recording scoring results and the like in the scoring mode is set.
[0016]
The sound source 13 forms a musical sound signal in accordance with music data (note event data or the like) input by the music sequencer 31 executed by the CPU 10. The formed tone signal is input to the mixer 14. The mixer 14 gives an effect such as echo to the plurality of musical sound signals generated by the sound source 13 and the singing voice signal of the singer input via the microphone 17 -A / D converter 18. Mix the signal with an appropriate balance. The mixed digital audio signal is input to the sound system 15. The sound system includes a D / A converter and a power amplifier, converts an input digital signal into an analog signal, amplifies it, and emits sound from the speaker 16. The effect that the mixer 14 gives to each audio signal and the balance of mixing are controlled by the CPU 10.
[0017]
The singing voice signal converted into a digital signal by the A / D converter 18 is also input to the grader 19. The grader 19 compares the frequency of the input singing voice signal with the reference to determine the amount of deviation, and inputs this to the CPU 10 as deviation data. As the reference, guide melody data included in the song data is used.
[0018]
In this embodiment, the scoring device 19 compares the pitch (frequency) of the singing voice signal with the reference pitch, and determines the difference, but the object to be compared is not limited to the pitch. . For example, the volume and rhythm may be compared, or these multiple elements may be compared.
[0019]
The background video data 41 stored in the HDD 11 is encoded in the MPEG2 format, and the background video reproduction program 33 executed by the CPU 10 reads it and inputs it to the MPEG decoder 20. The MPEG decoder 20 converts the input MPEG data into an NTSC video signal and inputs it to the synthesis circuit 21. The synthesis circuit 21 is a circuit that synthesizes lyrics telop and various OSDs on the video signal of the background video. The synthesized video signal is displayed on the monitor display 22.
[0020]
The operation unit 23 includes a panel switch interface, a remote control receiving circuit, and the like, and inputs an operation signal to the CPU 10 according to the operation of the panel switch and the remote control device by the user. The CPU 10 detects this operation signal by the operation input processing program 35 and executes a corresponding process. The operation input processing program 35 is included in the system program.
[0021]
The panel switch and the remote control device are provided with various key switches for selecting a song number and selecting a mode such as a scoring mode. Also, an RW button is provided for rewinding (rewinding) the performance portion during the performance of the karaoke song.
[0022]
When a song number is input with a panel switch or a remote control device, the operation input processing program 35 detects this and transmits it to the sequencer 30 as a request for a karaoke song. In response, the sequencer 30 reads the song data of the karaoke song identified by this song number from the song data storage area 40 of the hard disk 11. The sequencer 30 includes a song sequencer 31 and a lyrics sequencer 32, and the lyrics sequencer 32 includes a character pattern creation program 32a. The music sequencer 31 reads the data of tracks such as performance data tracks and guide melody tracks in the music data, and controls the sound source 13 with this data to generate performance sounds of karaoke music. The lyrics sequencer 32 reads the data of the lyrics track in the song data, creates a lyrics telop image pattern based on the data, and outputs the image pattern to the synthesis circuit 21. Further, the background video reproduction program 33 reads predetermined background video data in accordance with an instruction from the sequencer 30 and inputs it to the MPEG decoder 20.
[0023]
Here, the music data stored in the hard disk 11 will be described with reference to FIG. As shown in FIG. 4A, the song data includes a musical sound track for playing a karaoke song, a guide melody track for generating a guide melody, a lyrics track for displaying a lyrics telop, and a break in the song. The mark data track is written with mark data to be indicated. The song data has a header, audio data, audio data control track, etc. in addition to this, but it is omitted in this figure for the sake of simplicity.
[0024]
Each track is described according to the MIDI format, and includes event data and timing data indicating the read timing of each event data, as shown in FIG. The timing data can be composed of duration data indicating the time interval between the event data, absolute time data indicating the absolute time from the start time of the music, and the like. The event data of the musical tone track and the guide melody track is composed of note event data indicating the pitch, volume, on / off, etc. of the musical tone. By inputting the note event data to the sound source 13, the sound source 13 Sounds or mutes the musical sound corresponding to the data. The musical sound track is composed of a plurality of tracks (parts) for generating musical sounds of a large number of musical instruments, and the guide melody track guides the main melody track for guiding the main melody and the upper / lower hammer melody. It consists of top / bottom hammer melody tracks.
[0025]
Also, mark data indicating various break points in the karaoke song is written in the mark data track. Mark data includes the first chorus mark written at the beginning and the first chorus, the interlude mark written at the first chorus and interlude, the second chorus mark written at the second chorus and the second chorus. There is an ending mark or the like written at the separation between the eyes and the ending, and a rust start mark and rust end mark written at the start / end points of rust in each chorus. This mark is synchronized with the musical tone generated by the performance track and the guide melody track, and is described as a system exclusive message.
[0026]
On the other hand, the event data of the lyric track is sequence data in which the lyrics telop of this karaoke song is implemented with system exclusive data. As shown in FIG. doing. The event data is page break data, lyrics display data, and the like.
The lyric display data is composed of various data for displaying one line of lyric telop. The page break data is data that divides the lyric display data in units of one line by two to four, and the lyrics telop of the lyric display data divided by the page break data is simultaneously displayed on the monitor 22 as one page. The lyrics separated by the page break data generally correspond to musical phrases of karaoke songs.
[0027]
The lyric display data includes display on timing, display off timing, character string data, color 1 data, color 2 data, wipe data (wipe function), and the like. The character string data includes the number of display points of each text, display coordinates, data between characters in addition to text data of characters. Here, “wipe” is a process of smoothly changing the text color of the lyrics telop from left to right in accordance with the progress of the singing, according to the wipe data (wipe function) shown in FIG. Done. Color 1 data and color 2 data are character colors before and after wiping the text of the lyrics telop.
[0028]
The lyrics telop is displayed at t = 0 in the wipe function of FIG. 6D, and is displayed for a time of ts with color 1 and then t ₁ The wipe starts. Based on this wipe function, the wipe proceeds and t ₂ To finish wiping all characters. After that, after all te is displayed in color 2, this lyrics telop is deleted. The creation and wiping process of the lyrics telop image is performed by the character pattern creation program 32a, and the display start and deletion of the telop is performed by the synthesis circuit 21.
[0029]
In the performance of the karaoke music in the normal mode, the sequencer 30 generates the karaoke performance sound and the display processing of the lyrics telop as described above. In the scoring mode, in addition to this, the scoring mode processing program 34 Such processing is executed.
[0030]
First, the contents of the screen display in the scoring mode will be described with reference to FIGS. 3 is displayed on the monitor 22 during karaoke performance in the scoring mode. The background image 50 is displayed on the entire screen of the monitor 22, and the lyrics telop 51 is displayed on the superimposed image by superimposing synthesis, as in the normal mode karaoke performance.
In the scoring mode, a scoring mark 52 is further displayed on the lyrics. The scoring mark 52 is a ball-shaped mark displayed side by side on the lyrics telop corresponding to the progress of the song. The grader 19 and the scoring mode processing program 34 score the singer's skill in singing every predetermined time (for example, every 150 ms) and use the scoring result as a scoring mark on the lyrics corresponding to the singing target song. Will be displayed.
[0031]
In this embodiment, the skill of singing is determined by the magnitude of the deviation (cent value) between the singing frequency of the singer and the pitch indicated by the reference (guide melody data), depending on the degree of the deviation. Then, the scoring mark is determined based on the scoring mark determination table as shown in FIG. 4A, and the scoring mark is displayed at the position of the lyrics of the singing target song.
[0032]
Here, in the scoring mark determination table of FIG. 4A, the red mark (large deviation), orange mark (middle deviation), yellow mark (small deviation), green mark (no deviation) according to the magnitude of deviation. The ball-shaped mark of the color is displayed. In this table, easy mode, normal mode, and hard mode are modes for setting the difficulty level (severity of scoring). When shifting from the normal mode to the scoring mode, this difficulty level mode can be selected at the same time. it can.
In addition, since it is not necessary to alert a singer when he can sing well, it is also possible not to display a green mark.
[0033]
Moreover, although the shape of the mark is a ball shape, the shape of the mark is not limited to a spherical shape, and may be a character shape such as a pig.
Further, the magnitude of the deviation (scoring result) is distinguished by the color of the mark, but this distinction may be made by the shape and size of the mark. Further, distinction by color, shape, and size may be used together.
[0034]
In this scoring mark determination table, the scoring device 19 outputs deviation data representing the frequency deviation between the singing voice signal and the reference every 50 ms, and the scoring mode processing program 34 integrates this deviation data three times, and every 150 ms. This is a table for determining and displaying scoring marks. Therefore, the shift amount of the red mark (large shift) in the easy mode is 300 or more when there is a shift of 100 cents (semitone) or more on average. If the marking mark display interval is other than 150 ms, the value may be increased or decreased according to the display interval.
[0035]
In the upper part of the screen, a scoring mode display 58 which is an OSD indicating the scoring mode, the mode display 53 of the easy mode, the normal mode or the hard mode, a microphone input level 56, a guide melody setting 57, and the number of repeated operations 59. And a scoring meter 54 is displayed.
[0036]
The guide melody setting 57 is an indicator for displaying the volume of the guide melody and the selected content of the guide melody track of the song data. The user can switch the setting of the guide melody by operating the guide melody button on the remote controller or the operation panel, and the setting is reflected on the display of this indicator. As shown in FIG. 4C, the guide melody is set to “OFF”, “(Main melody) volume 1”, “(Main melody) volume 2”, “(Main melody) volume 3”, “(Up There are six types: “Hamo Melody” Volume 3 ”and“ (Lower Halo Melody) Volume 3 ”. Each time the guide melody button is turned on, the above setting is toggled.
[0037]
The repetitive operation count 59 indicates the number of times that the user rewinds the performance by operating the RW (rewind) button and repeatedly performs a part of the song. The rewind function will be described later.
[0038]
The scoring meter 54 is a bar graph-like indicator that displays the skill of the singing throughout the song. In the scoring mode, the karaoke song is divided into 30 sections, the skill of singing is determined for each section, and the determination result of each section is displayed in the section evaluation mark display area 55 of each section set on the scoring meter 54. Corresponding section evaluation marks (55) are sequentially displayed. As shown in FIG. 4 (B), there are seven types of section evaluation marks. Which section evaluation mark is displayed is determined according to the progress of the performance in accordance with the scored result of the section. Each time a song is evaluated, the mark displayed in the display area 55 of that section is updated.
[0039]
Below the scoring meter 54, a delimiter mark 61 indicating the start point (or end point) of the first chorus, the second chorus, the chorus, etc. of the karaoke song is displayed. In addition, on the upper part of the scoring meter, a cursor 60, which is a red horizontal line indicating the currently playing section, is displayed corresponding to the progress of the performance of the karaoke song.
[0040]
In the division of the scoring meter 54, in addition to a method in which all songs from the beginning of the intro to the end of the ending are equally divided into 30 in time, for example, the number of notes (the number of event data of the guide melody track) is equalized. For example, it may not be equal in time. Further, the division target (the display target of the scoring meter 54) does not have to be the total performance time. For example, only a portion where a certain singing portion (guide melody data (event data)) exists may be a division target, or may be a part of a song such as only the first chorus. Furthermore, the number of divisions is not limited to 30.
[0041]
Here, the section evaluation mark will be described with reference to FIG. There are seven types of section evaluation marks, and 6 to 0 codes are assigned for recording in the scoring log. Of these, the blue mark (code 0) is an unevaluated mark representing a section that has not been evaluated yet. At the start of the performance of the karaoke song, all the sections are marked with this blue mark. The blue-green mark (code 1) is an evaluation mark indicating that the section is currently being played and singing is being evaluated. The 紺 mark (code 2) is a mark indicating that there is no section to be sung such as prelude, interlude, and postlude (not evaluated).
[0042]
A crown mark (code 6), a green mark (code 5), a pink mark (code 4), and a red mark (code 3) are section evaluation marks indicating evaluations for an actual song.
The crown mark is a section evaluation mark that is determined and displayed when there is no scoring mark red mark (large deviation), orange mark (middle deviation), or yellow mark (small deviation) in the section. It means that it was excellent.
The green mark is determined when there is no red scoring mark and the orange and yellow scoring marks are 5% or less of the time to be sung in the section, that is, the yellow counter value is 5% or less of the scoring counter value. -It is the section evaluation mark displayed, which means that the singing in this section is acceptable.
The pink mark is one or two red scoring marks, or the orange and yellow scoring marks are 5% or more of the time to be sung in the section, that is, the yellow counter value is 5 of the scoring counter value. This is a section evaluation mark that is determined and displayed when the percentage is greater than or equal to the percentage, and means that the singing in this section is an effort.
The red mark is a section evaluation mark determined and displayed when there are three or more red scoring marks, and means that the singing in this section is unacceptable.
If the singing voice is not input even though it should be sung (where there is a guide melody), the grading mark is not displayed as non-singing, but the determination of the section evaluation mark is the same as the red grading mark. Is treated as
[0043]
FIG. 5 is a diagram showing a flow of processing of each program in the scoring mode. In this figure, a process for displaying a scoring mark is mainly described. When playing a karaoke song, the song sequencer 31 and the lyrics sequencer 32 operate synchronously. The music sequencer 31 reads out the event data of the performance track and inputs it to the sound source 13 to generate a musical sound. Also, event data of the selected guide melody track is read out and input to the sound source 13 to generate a guide melody. On the other hand, the lyrics sequencer 32 reads the event data (lyric display data) of the lyrics track, displays the lyrics based on the event data, and changes the character color of the lyrics according to the progress of the song based on the wipe function.
[0044]
The music sequencer 31 inputs the event data (pitch information) of the selected guide melody track as a reference to the scorer 19. In addition, the singing voice of a singer who sings according to the performance sound of the karaoke song and the display of the lyrics telop is input to the grader 19. The grader 19 compares the pitch detected from this singing voice with the reference pitch information, and outputs the deviation data, which is the comparison result (the cent value of the deviation amount), every 50 ms. This deviation data is read by the scoring mode processing program 34. The scoring mode processing program 34 totals deviation data of a plurality of times (usually 3 times = 150 ms), and determines which scoring mark is displayed based on the totaling result.
In the scoring mark determination table of FIG. 4A, the scoring mark is determined based on the total value of the deviation data. However, the scoring mark determination method is not limited to this, for example, the average value of the deviation data Alternatively, it may be determined based on the number of times data that is larger than a predetermined value is input.
[0045]
When the scoring mode processing program 34 determines a scoring mark, the scoring mode processing program 34 acquires the wipe position information at that time from the lyrics sequencer 32. Then, the display position of the scoring mark is determined based on this wipe position information. Then, the graphic pattern data of the created scoring mark is formed at this display position and output to the synthesizing circuit 21 so that the scoring mark 52 is displayed on the lyrics telop 51. At the same time, the determined grading mark and its absolute time are recorded in the grading log.
In addition, even if it is the singing section (section where a guide melody is pronounced) to be scored, the grading unit 19 outputs a non-singing signal when the singer's singing voice signal is not input. In this case, the scoring mode processing program 34 does not display a scoring mark because scoring is impossible.
[0046]
Here, a method for determining the display position of the scoring mark will be described with reference to FIG. In FIG. 5A, when the scoring mark is determined, it is assumed that the wipe position acquired from the lyrics sequencer 32 is A. This wipe position is obtained by the wipe function shown in FIG. Generally, the lyric telop wipe is performed prior to the performance (singing) so as to guide the singing. Therefore, when the wipe position is A, the position B is considered to be the performance position. That is, it can be considered that the music sequencer 31 is playing a song singing the lyrics displayed at the position B. On the other hand, the determination of the scoring mark is the scoring target for the current scoring mark due to the time required for scoring by the scoring machine 19 (50 ms) and the accumulation of misalignment data multiple times by the scoring mode processing program 34 (150 ms). Since the input of the singing voice (the first part) is delayed by about several hundred ms, when the grading mark is determined, the lyrics corresponding to the singing singing are displayed at the position of C that goes back from the performance position by this delay time. It is thought that the lyrics are. Therefore, the scoring mode processing program 34 is the scoring target position from the wipe position A acquired from the lyrics sequencer 32 when the scoring mark is determined, and the position of C that has moved to the left by the time preceding the wipe and the time behind the scoring. A scoring mark is displayed at this position.
[0047]
When the lyrics telop wipe is broken, a scoring mark may be displayed at the position moved by the above distance over two lines. Also, when the page of the lyrics telop is switched, the scoring mark cannot be displayed going back to the previous page, so the scoring mark immediately after switching the page should be displayed at the beginning of a new line. That's fine. It should be noted that the position where the page of the lyrics telop breaks is often interrupted once at the break of the phrase, so it is not too much to omit the display of the scoring mark at this point.
[0048]
Note that when there is an inquiry about the wipe position information from the scoring mode processing program 34, if the lyrics sequencer 32 returns the wipe position backed by the preceding part from the performance of the wipe and the delay by the scoring, the display position This calculation is unnecessary.
[0049]
FIG. 7B is a diagram for explaining a scoring mark display method when the progress of the wipe is stopped.
For example, in a scene where one pronunciation of the lyrics is sung and sung, the song progresses but the lyrics do not progress. In such a case, the music progresses and a plurality of scoring marks are sequentially determined. However, since the lyrics telop has not progressed, the display position of the scoring marks does not proceed and is determined at the same position. However, if the scoring marks are displayed so as to be completely overlaid, the scoring marks displayed earlier are completely hidden, and the past scoring marks cannot be looked back. Therefore, when a plurality of scoring marks are displayed when the wipe is not progressing, the display position of the new scoring marks is moved upward little by little. Thereby, even if a plurality of scoring marks overlap (at the left and right positions), they are shifted vertically, so that all of the plurality of scoring marks can be seen later.
[0050]
Here, the scoring log 42 will be described with reference to FIG. As shown in FIG. 7A, the scoring mark log records the absolute time (time from the start of the music) when the scoring mark is displayed and the contents of the mark. This makes it possible to redisplay the scoring mark when the performance of the song is rewound and repeated by reverse jump. FIG. 7B is a diagram showing a scoring meter log. In this log, the start time and end time of each section and the evaluation of the section (section evaluation mark code) are recorded corresponding to the section numbers (1 to 30) of each section divided into 30.
[0051]
Hereinafter, the operation of the karaoke apparatus in the scoring mode will be described with reference to a flowchart.
FIG. 8 is a flowchart showing a main operation when a karaoke piece is played in the scoring mode. If there is a request, the music data corresponding to this request is read (s1). Then, the total performance time of the music data is divided into 30 sections (s2). Then, the start time and end time of each divided section are recorded in the scoring log (FIG. 7B) (s3). Then, the mark data track of the music data is read, and a delimiter mark 61 is displayed at a delimiter position such as the start position of the first chorus and the second chorus on the scoring meter 54 (s4).
[0052]
Next, all the lyrics display data, which is the event data of the lyrics track, are scanned to determine the total number of characters in the lyrics, and the progress speed of the currently performed lyrics (wipe) is determined based on the ratio between the total number of characters and the performance time. Then, based on the progression speed of the lyrics, it is determined at which time interval the scoring mark is displayed (s5). That is, if scoring marks are displayed at short intervals in a song with slow progression of lyrics, the scoring marks overlap each other, and the visibility of each scoring mark deteriorates. In addition, if a scoring mark is displayed at a long interval in a song with a fast progression of lyrics, the scoring mark display is extended. Therefore, based on the number of characters of the lyrics and the performance time, the progress speed of the lyrics being played is determined, and based on this, the display (time) interval of the scoring marks is determined. The standard display interval is 150 ms.
[0053]
After that, the performance of the karaoke song is started, the song sequencer 31 reads the data of the performance track and the guide melody track according to the tempo clock and inputs them to the sound source 13, and the lyrics sequencer 32 reads the data of the lyrics track and reads the lyrics telop. A predetermined performance process such as forming is executed (s6). In parallel with this performance processing, the grader 19 and the scoring mode processing program 34 are also operated, and the scoring mark determination display processing (s7) and scoring meter determination display processing (s8) shown in FIG. 5 are executed. . The performance process (s6), scoring mark process (s7), and scoring meter process (s8) are executed in parallel until the music ends, and when the music ends (s9), the operation ends.
[0054]
9 to 11 are flowcharts showing the scoring meter process.
FIG. 9 is a flowchart showing cursor display processing. When the music starts, 1 is set in the section number register m representing the playing section (s40), and a red cursor is displayed on the block (section evaluation mark display area) 54 indicated by the section number m (s41). . This display is continued until this section elapses (s42). When the section elapses, 1 is added to the section number register m (s44), and the cursor is moved to the block indicated by this section number m (s41). When m = 30 and the section ends (s43), the cursor is deleted (s45) and the operation is terminated.
Thus, the cursor is always displayed on the block corresponding to the currently playing section.
[0055]
10 and 11 are flowcharts showing the section evaluation mark display operation. When the song starts, 1 is set in the section number register n indicating the evaluation target section (s49), various counters are cleared (s50), and the section evaluation mark display area (block) 55 of the section number n is being evaluated. A mark (blue-green mark) is displayed (s51). Then, it waits until a scoring mark or a non-singing signal is input from the scoring mark processing module (s52, s60) or until this section has passed (s65).
[0056]
When a scoring mark or a non-singing signal is input (s52), 1 is added to a scoring counter that counts the number of scoring marks (s53), and the color of the scoring mark is determined (s54). If the color is green (no deviation), the process directly returns to the waiting routine of s52. If the color is orange (middle of deviation) or yellow (small deviation), 1 is added to the yellow counter (s55), and the process returns to the standby routine of s52.
[0057]
On the other hand, when the color of the scoring mark is red (large deviation) or a non-singing signal is input, 1 is added to the red counter (s56), and the count value of the red counter to which 1 is added, That is, the number of red marks (including a non-singing signal) appearing in this section is determined (s57). When the number of red marks is two or less, that is, one or two, a pink mark (necessary effort mark) is displayed as a section evaluation mark (in place of the mark during evaluation) even in the middle of the section ( s58). Thereafter, the process returns to the standby routine of s52. If the number of red marks is three or more, a red mark (failed mark) is displayed instead of the pink mark as a section evaluation mark (s59), and evaluation of this section is performed even during the section. End and proceed to s64. This is because when the mark is red, the evaluation of the section does not change. Note that the scoring mark is continuously determined and displayed even if the evaluation is completed in the middle of the section. The scoring mark processing module outputs a non-singing signal to the scoring meter processing module described in this flowchart when a non-singing signal is continuously input from the scoring device 19 three times.
[0058]
If the interval has elapsed without the count value of the red counter being 3, the process proceeds from s65 to s66. In s66, the rule section evaluation mark described with reference to FIG. That is, if there is no red, orange, or yellow scoring mark, it is determined as a crown (or star) mark (excellent), and there is no red scoring mark and the orange or yellow scoring mark sings within the section. If the power time is 5% or less, that is, if the yellow counter value is 5% or less of the scoring counter value, the green mark (passing mark) is determined, and if the red scoring mark is 1 or 2 (s57, s58), or when the orange and yellow scoring marks are 5% or more of the time to be sung in the section, that is, when the yellow counter value is 5% or more of the scoring counter value (requires effort) To decide.
However, if the time to be sung is less than 30% of the time of the entire section, the ratio of the yellow counter for determining either the green mark or the pink mark is changed from 5% to 10%, and a slight mistake is made. In order not to become a pink mark.
[0059]
The section evaluation mark determined in this way is displayed in the corresponding section evaluation mark display area 55 of the scoring meter 54 (s67). Then, 1 is added to the section number n indicating the evaluation target section (s69), and the process returns to s51.
At this time, if the current section is the last section (n = 30) and there is no next section (s68), the operation is terminated.
[0060]
Moreover, 1 is added to the section number n (s69), and when there is no place to sing in the next section specified by this section number, for example, in the section where there is no singing in an interlude or follower section (S71), a 紺 mark (no singing / not evaluated) is displayed in this section (s72), and the process returns to s68 to check whether or not there is a singing in the next section. The presence or absence of singing can be determined by checking the guide melody track in the song data.
[0061]
The process from s69 to s71 is repeated until a section to be sung is found, and when a section to be sung is found (s71), the section of the karaoke song that the sequencer 30 is performing is evaluated. It waits until it catches up with the section (section number n) (s73), and when the performance section enters the evaluation target section, it returns to s51 and restarts the evaluation. In addition, when the section is ended while repeating the processing of s68 to s71 (in the case of a subsequent section), this processing (scoring meter section) is performed when section number n = 30. The evaluation mark display process) is terminated.
[0062]
By the above processing, when the performance of the karaoke song enters the interlude, the non-evaluation mark is displayed before the performance until the end of the interlude, and the singer can know how far he can rest the singing. When the singing of the karaoke song is over and the sequel is followed, a non-evaluation mark is displayed until the end of the song, so that the singer knows that the singing is finished.
[0063]
With the above operation, the scoring mark can be displayed in parallel with the performance of the karaoke song (displaying the lyrics telop), and the section evaluation mark can be displayed on the scoring meter according to the progress of the section.
[0064]
Further, as described above, this karaoke apparatus has a rewind function. The rewind function is a function that allows a part (or all) of the karaoke song to be played repeatedly by turning on the RW button (rewind button) during the performance of the karaoke song. When the function is used, the scoring mark is also erased and redisplayed according to the rewind. In addition, it is possible to automatically jump to a section that has not been evaluated well in a section that has already been sung by using a rewind jump function.
[0065]
Hereinafter, the operation of the CPU 10 when the RW button is pressed will be described with reference to FIG. When the RW button is turned on, all the musical sounds generated at that time are turned off (s20). This processing is executed when the operation input processing program 35 detects an on event of the RW button and notifies the sequencer 30 (music sequencer 31).
[0066]
Then, it is determined whether the operation is a jump operation or a rewind operation depending on whether the ON state of the RW button has continued for more than 1 second or turned off in less than 1 second (s21, s22). That is, when the on state continues for more than 1 second, it is determined that the operation is a normal rewinding operation, and when it is turned off in less than 1 second, it is determined that the operation is a jump operation for jumping in units of divided sections. When a jump operation is performed in scoring mode, it jumps automatically to the head of the section that was not evaluated well, not the head of the latest section.
[0067]
When a jump operation is performed, the section of the red mark (failed) closest to the performance time at that time is searched with reference to the scoring meter log (FIG. 7B) (s23). Then, a position that is 3 seconds after the start time of this section recorded in the log is set as the performance resumption time. The reason for going back 3 seconds is that if the performance is suddenly resumed from the beginning of the section, the singer cannot sing at the beginning of the section. The time to go back is not limited to 3 seconds.
[0068]
After determining the performance resumption time in this way, the lyric display data for displaying the lyrics at the performance resumption time is searched with reference to the timing data indicating the reading timing of the event data, and all the lyrics telops on this page are searched. While using the monitor 22 (s25), the wipe is advanced at a stretch until the performance resumption time (s26). Then, all the scoring marks displayed on the lyrics telop page are once displayed (s27). Thereby, it is possible to inform the singer of how the singing before the performance resumed was. Thereafter, the scoring mark after the performance resumption time is erased (s28), and the scoring mark log after the performance resumption time is erased (s29). Thereafter, the performance is started from the performance resumption time (s30).
The display position of each scoring mark can be re-determined by the method of FIG. 6 by referring to the wipe function at the respective display time, but the display position information is also recorded in the log of FIG. This redisplay can be made quicker.
[0069]
On the other hand, when the RW button is kept pressed for 1 second or longer, it is not a jump operation but a rewind of an arbitrary time, so the time during which the RW button is kept on is counted in s32. When the button is turned off (s22), a time corresponding to the time when the button was turned on is subtracted from the performance time at that time to obtain a performance restart time (s33). For example, a performance resumption time is obtained by subtracting four times the time that has been turned on. In this way, it is possible to perform high-speed rewinding by subtracting a time longer than the time during which it was turned on (note that the rewinding technique for karaoke performance is disclosed in Japanese Patent Application Laid-Open No. 2000-99044, which is a prior application of the present applicant). In detail). After calculating the performance resumption time, the process proceeds to s25.
[0070]
Even when the rewinding operation is performed, the display of the section evaluation mark and the log are not erased, but may be erased. Even when not erasing, if a new section evaluation mark is determined for the same section by rewinding, the display and log are overwritten.
[0071]
In this case, the newly determined section evaluation mark is compared with the one displayed and logged first, and the newly determined section evaluation mark is lower than the section evaluation mark displayed and logged first. If this is the case, it may be discarded without being overwritten.
[0072]
In this embodiment, the frequency of the singing voice signal is compared with the frequency indicated by the reference, and the singing is scored by the deviation, but the grading target is not limited to the singing frequency, Any element of the song, such as volume and singing rhythm, can be scored. Further, a plurality of elements may be scored individually or collectively.
[0073]
Alternatively, a scoring log may be stored, and when the same song is requested, a past singing scoring meter may be displayed based on the scoring log stored before starting the performance. Alternatively, the scoring meter may have a two-stage configuration, and the scoring meter for the current song may be displayed in parallel with the past scoring meter for the song.
Since the singer can be identified by the ID of the personal remote controller, etc., when the same singer requests the same song, the past singer's scoring meter may be displayed. When a singer sings the same song, a scoring meter of another singer who sang before that may be displayed.
[0074]
In this embodiment, the invention of the present application is applied to the function of the scoring mode of the karaoke apparatus. However, as long as the process is divided into a plurality of sections and the scoring and evaluation contents of each section are displayed in time series. It can also be applied to devices other than karaoke equipment. For example, if it is applied to video games and arcade games that compete for the accuracy of musical instrument performance and dance steps, not only the accuracy of each moment but also the whole game is good and where it is not good. It becomes possible to see.
[0075]
<< Invention described in the embodiment >>
In addition to the inventions described in the claims, the following inventions are also disclosed in the above embodiment.
[0076]
(1) In the invention of claim 1, the scoring result display means displays a list of the total result display area of each section, and corresponds to the total result of the section every time the performance of the karaoke song passes each section. A karaoke device that displays in the tabulation result display area.
For example, by displaying the scoring range (all or part of the karaoke song) as a list by configuring the scoring result display area of each section into a rectangle (block shape) and displaying it in a straight line (bar graph shape), It becomes easy to see the scoring range from a bird's-eye view, and the progress of the karaoke song (scoring progress) is easily understood by displaying the total result of the section every time the section passes.
[0077]
(2) In the invention of (1), the scoring result display means displays a specific display with respect to an aggregation result display area corresponding to a section in which the performance means is playing out of the aggregation result display areas displayed in the list. Karaoke device to do.
According to the present invention, in accordance with the progress of the performance of the karaoke piece by the performance means, specific display is performed on the totaling result display area corresponding to the section being played at that time, that is, the section currently being scored. The specific display is, for example, displaying a cursor in the vicinity of the corresponding count result display area. Thereby, it can be shown to a singer in an easy-to-understand manner which section is currently being played.
[0078]
(3) In the inventions of (1) and (2), the scoring result display means includes means for displaying a mark representing a delimiter of karaoke songs in association with the tabulated result display area displayed in the list.
In the present invention, a mark representing a karaoke song break is displayed in correspondence with the tabulated result display area. The karaoke song break is, for example, a karaoke song prelude, chorus, chorus, sequel, chorus, climax, or the like. By displaying this, it becomes easy to understand to which segment of each song each segment belongs, and it is possible to easily confirm which segment has been successfully sung and which segment has not been successfully sung.
[0079]
(4) In the invention of claim 2, the rewinding means is means for rewinding the performance of the karaoke song to the head of the section in which the total result is the predetermined content among the already played sections. Karaoke device to do.
[0080]
In the present invention, the rewinding means sets the replay start point at which the performance means performs again, for example, a section having a predetermined content such as a section in which the counting result is a low evaluation or a high evaluation for the singing of the section. Selectively jump to the beginning of the section. Thereby, the singer can sing again a section that has not been successfully sung or sing a section that has been successfully sung by a simple operation.
[0081]
(5) In the invention of claim 3, when the performance of the karaoke song is rewound by the rewinding means, the lyric display means displays a lyric telop including the starting point of the replaying, and the scoring result display The means re-displays the scoring result of the displayed lyrics telop.
In this invention, when the performance of the karaoke song is rewound, the lyrics telop including the replay start point is displayed and the scoring result of the page is redisplayed. Thereby, the details of the scoring of the section to be rewound and replayed can be seen, which can be used as a reference for re-singing.
For example, when a 4-minute karaoke song is divided into 30 sections, the time for one section is about 8 seconds, so if one page of lyrics is displayed, the lyrics for one section are almost included in it. be able to.
[0082]
【The invention's effect】
As described above, according to the present invention, the singing of the karaoke song is continuously scored, the karaoke song is divided into a plurality of sections, the scoring results are tabulated for each section, and the tabulated results are displayed side by side. By doing so, the scoring result of the scoring can be seen from a bird's-eye view later, and the singer can confirm which part can sing well and which part cannot sing well in an easy-to-understand manner it can.
[0083]
Further, according to the present invention, the input to the device such as the game device or the learning support device is continuously scored, the process of the device is divided into a plurality of sections, and the scoring results are totaled for each section. By displaying the tabulation results side by side, you can view the scoring tabulation results from a bird's-eye view later, making it easier for users to understand which part was successful and which part was not successful. Can be confirmed.
[0084]
[Brief description of the drawings]
FIG. 1 is a block diagram of a karaoke apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram showing a configuration example of song data used in the karaoke apparatus
FIG. 3 is a diagram showing an example of a screen display in the scoring mode of the karaoke apparatus
FIG. 4 is a diagram for explaining scoring marks, section evaluation marks, and guide melody settings displayed on the karaoke apparatus
FIG. 5 is a diagram for explaining the flow of scoring mark display operation of the karaoke apparatus
FIG. 6 is a diagram for explaining a method for determining a display position of a scoring mark of the karaoke apparatus
FIG. 7 shows a scoring log of the karaoke device
FIG. 8 is a flowchart showing a karaoke performance procedure of the karaoke apparatus.
FIG. 9 is a flowchart showing a cursor display operation of the karaoke apparatus.
FIG. 10 is a flowchart showing a section evaluation mark display operation of the karaoke apparatus.
FIG. 11 is a flowchart showing a section evaluation mark display operation of the karaoke apparatus.
FIG. 12 is a flowchart showing processing when an RW (rewind) button is pressed in the karaoke apparatus.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 10 ... CPU, 11 ... Hard disk, 12 ... RAM, 13 ... Sound source, 14 ... Mixer, 15 ... Sound system, 16 ... Speaker, 17 ... Microphone, 18 ... A / D converter, 19 ... Grader, 20 ... MPEG decoder, 21 ... Synthesis circuit, 22 ... Monitor, 23 ... Operation part,
30 ... Sequencer, 31 ... Song sequencer, 32 ... Lyric sequencer, 32a ... Character pattern creation program, 33 ... Background video reproduction program, 34 ... Scoring mode processing program, 35 ... Operation input processing program,
40 ... song data storage area, 41 ... background video storage area, 43 ... scoring log,
50 ... Background video 51 ... Lyric telop, 52 ... Scoring mark, 53 ... (Difficulty) mode display, 54 ... Scoring meter, 55 ... Section evaluation mark, 56 ... Microphone input level display, 57 ... Guide melody setting, 58 ... Scoring mode display, 59 ... Repeat operation count display, 60 ... Cursor, 61 ... Separation mark

Claims (4)

A performance means for performing karaoke songs;
Singing voice input means for inputting singing voice;
Reference data output means for outputting reference data in synchronization with the performance of a karaoke song,
A scoring means for scoring the singing voice in parallel with the performance of the karaoke song by comparing the singing voice and the reference data;
The karaoke song is divided into all or part of a plurality of sections, the scoring results output by the scoring means are tabulated for each section, and scoring result display means for displaying the tabulated results of each section side by side;
Karaoke device equipped with. The performance means includes rewind means for rewinding the performance of the karaoke song and replaying the already played portion,
2. The karaoke apparatus according to claim 1, wherein the scoring result display unit redoes counting of the scoring results after the replay start point. Includes lyrics display means for displaying lyrics telop of karaoke songs,
3. The karaoke according to claim 1, wherein the scoring result display unit displays the scoring result output from the scoring unit on or near the lyrics telop and totals the scoring results for each section. apparatus. Process execution means for executing a predetermined process;
Input processing means for receiving input corresponding to the progress of the process;
Reference data output means for outputting reference data in synchronization with the progress of the process,
A scoring means for scoring the accuracy of the input by comparing the input with the reference data;
Dividing the whole or part of the process into a plurality of sections, scoring the scoring results output by the scoring means for each section, and scoring result display means for displaying the summing up results for each section;
A scoring result display device.

Images