JP3949544B2 - Karaoke device that displays error of singing voice pitch on bar graph - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a singing practice support system for sequentially pointing out to a singer the places that could not be sung correctly during singing in a karaoke apparatus.
[0002]
BACKGROUND OF THE INVENTION
Some karaoke apparatuses have a special system for supporting singing practice. The well-known singing scoring function can be said to be one of the singing practice support systems, but if only the scoring results are displayed after the performance is completed, it is not possible to know where and how the singing has failed. Japanese Patent No. 3050129 and Japanese Patent Application Laid-Open No. 2000-29473 disclose techniques for a singing practice system in which the singing state determination result is changed to change the shape and color of the lyric display and is sequentially presented to the singer during karaoke performance. ing. Certainly, according to these techniques, a point that could not be sung in almost real time during singing is pointed out each time, so it is possible to know which part could not be sung correctly. However, when singing the same song again, if you don't remember exactly which part couldn't be sung, you're likely to make the same mistake in the same place.
[0003]
DISCLOSURE OF THE INVENTION
The karaoke apparatus according to the present invention is specified by the following items (1) to (10).
(1) It is a karaoke apparatus provided with pitch error measuring means, control means, performance means, display means, and storage means. (2) The pitch error measuring means is configured to perform accompaniment music based on karaoke data by the performance means. In the output period, the singing voice signal pitch of the singer and the main melody pitch in the karaoke data are sequentially compared and the pitch error time series data is sequentially output. (4) The first performance mode allows the performance means to perform the karaoke data of the requested song, displays lyrics subtitles on the display means based on the lyrics rendering data in the karaoke data, and (1) The first process is to display a horizontally long bar graph in which a large number of vertically long small segments are arranged horizontally on the display means. (6) The second processing is performed when the pitch error is sequentially output by the pitch error measuring means. The series data is digitized for each minute period, the display color is determined based on the numerical value, and the minute segment assigned to the minute period is colored in that color. (7) The third process is the performance of the requested song (8) The replay mode allows the performance means to play the karaoke data of the requested song, and the display means based on the lyric rendering data in the karaoke data. Displaying lyrics subtitles and performing the fourth to fifth processes (9) The fourth process is to display bar graph coloring information from the storage means at the start of performance. And displaying a bar graph colored based on the information on the display means. (10) The fifth process is to digitize the pitch error time series data sequentially output by the pitch error measuring means for each minute period, A display color is determined based on the numerical value, and the color of the minute segment assigned to the minute period is changed to the color.
DETAILED DESCRIPTION OF THE INVENTION
=== Basic configuration and operation of karaoke apparatus ===
A functional block diagram of a karaoke apparatus according to an embodiment of the present invention is shown in FIG. This karaoke apparatus 1 has substantially the same configuration as a performance terminal of a known communication karaoke system. The central control unit 11 controls each peripheral component unit to control the karaoke device 1. The hard disk device 12 includes accompaniment music data mainly composed of MIDI data and generation origins of lyrics images for many karaoke songs. Karaoke data including lyric rendering data is accumulated. The lyric rendering data includes lyric characters, lyrics character string display / erase timing, instruction information for changing the color of characters at the singing timing in the displayed character string, and the like. The karaoke data also includes table of contents information such as the titles of music and artist names, standard tempo (number of beats per minute) and performance time when playing at the standard tempo. Furthermore, the hard disk device 12 stores moving image data for a long time in a predetermined format and script data that defines a processing sequence of moving image data (such as a storage location and a processing order of moving image data to be processed). And the central control part 11 identifies the karaoke data and script data of each music by a music number, and manages this as a karaoke database. The central control unit 11 communicates with a host device connected to a predetermined information communication network via the communication control unit 23 in a timely manner, obtains karaoke data, script data, etc. about new music pieces, and contents of the karaoke database. Is updated from time to time.
[0006]
When the central control unit 11 receives a performance reservation command including a music number from the operation panel 14 or the remote control transmitter 13 provided in the main body of the karaoke apparatus 1 via the operation control unit 15, the central control unit 11 stores the number in the internal RAM. And manage in the performance processing queue. Then, the music numbers are sequentially extracted from the queue, the corresponding karaoke data is read from the hard disk device 12, the accompaniment music data in the karaoke data is transferred to the synthesizer 16 to generate accompaniment music, and the accompaniment is based on the lyric rendering data. The lyric image in which the portion to be sung in synchronism with the music changes in color in the video RAM 20 in order. Also, predetermined moving image data is sequentially transferred to the video control unit 21 in a predetermined order based on the script data, and the background moving image of the lyrics image is decoded.
[0007]
The mixing amplifier 17 mixes and amplifies the accompaniment music and the singing voice input to the microphone 19 and outputs the sound from the speaker 18. The video control unit 21 superimposes the lyric image on the decoded moving image and displays it on the display 22.
[0008]
=== Singing practice support system ===
The karaoke apparatus 1 is equipped with a system for supporting singing practice of karaoke music in addition to the above basic configuration. The singing practice support system of the present embodiment analyzes the singing situation at the time of music performance and presents the analysis result to the singer in real time, the singing situation at the previous performance at the time of replaying the music, and this The karaoke apparatus is operated by a singing practice mode that presents in parallel the analysis result of the singing situation during replay. And the pitch measurement part 30 is mounted in the karaoke apparatus 1 as concrete hardware which implement | achieves this singing practice assistance system. Each mode is activated when a song is played by inputting predetermined operation information to activate any mode following the song number input from the operation panel 14 or the remote control transmitter 13. It has become.
[0009]
=== Singing Analysis Mode ===
First, the song analysis mode will be described. The central control unit 11 obtains the pitch (pitch reference value) of the accompaniment music for each beat, and the pitch measurement unit 30 compares the pitch reference value with the singing voice pitch and outputs error information thereof. FIG. 2 shows a conceptual diagram of the pitch error measurement method. If there are a plurality of accompaniment sounds generated in one beat, the central control unit 11 acquires the pitch reference value P2 based on the sound lengths and pitches P1 of the plurality of accompaniment sounds. For example, if there are triplets in one beat, each accompaniment sound is different only in pitch with the same sound length, and the average value of the three notes is given to the pitch measurement unit 30 as the pitch reference value P2. Further, when a plurality of notes having different sound lengths are combined in one beat, a weighted average corresponding to each sound length is taken. For example, if there are a total of three notes, one octal note "do" and sixteenth note "mi" in one beat, these notes will have sixteenth note "do" 2 The sixteenth note “mi” is replaced with two notes in total, and the average of the four notes is taken to obtain the pitch reference value “re”. The central control unit 11 transfers the pitch reference values sequentially obtained in this way to the pitch measurement unit 30 in synchronization with the time signature.
[0010]
FIG. 3 shows a functional block diagram of the pitch measurement unit 30. The pitch measuring unit 30 includes a dedicated DSP 31 as a main body and includes an A / D converter 32 and a communication interface 33 with the central control unit 11. In the pitch measuring unit 30, first, the A / D converter 32 samples the singing voice signal input from the microphone 19 and converts it into digital singing voice data, and the DSP 31 extracts the singing voice pitch P3 from the singing voice data. The sampling in this embodiment is 10 times per beat, and the central control unit 11 gives the tempo information described in the karaoke data of the performance music to the DSP 31 of the pitch measurement unit 30, and the DSP 31 uses the tempo information. The required sampling period is calculated, and the A / D converter 32 samples the singing voice for each period. For example, if the tempo is 120, one beat is 500 ms, and the sampling period is 50 ms.
[0011]
The DSP 31 compares the pitch reference value P2 transferred from the central control unit 11 for each beat with the average value P4 of the ten singing pitches P3 obtained in one beat, and the cent is used as the comparison result. The pitch error ΔP is transferred to the central control unit 11. For example, if the singing pitch cannot be specified five times or more at the sampling opportunity of 10 times per beat because the singer is singing, the DSP 31 does not output the pitch error information for this beat. The central control unit 11 records the pitch error information transferred from the pitch measurement unit 30 in association with the cumulative number of beats from the start of the performance. For the beats for which no pitch error information was output, information indicating no data is associated and recorded.
[0012]
The central control unit 11 also performs control to display this error information as a bar graph in parallel with the process of recording the pitch error information. FIG. 4 shows the display state of this bar graph. A bar graph 40 in which the minute segments 41 are connected to the left and right in a strip shape is displayed on the display 22 so as not to overlap the lyrics characters 42. In this example, a bar graph 40 is formed by 30 minute segments 41. For example, if the full length of the bar graph is displayed on the left and right 720 dots of the display 22, 24 dots are assigned to each minute segment in the left-right direction. Further, the bar graph 40 indicates a time axis of performance time, and the central control unit 11 determines the color of each segment 41 one after another based on the pitch error information recorded for each minute time corresponding to each minute segment 41. The changing image is developed into a bit map in the video RAM 20 together with the lyrics image.
[0013]
The central control unit 11 first calculates the number of beats to be assigned to each minute segment by associating the total number of beats of the musical piece with the entire length of the bar graph. For example, if the song has a tempo of 120 (120 beats / minute) and 3 minutes and 30 seconds, the total number of beats is 420, and the total number of beats is divided by the number of small segments, and 14 beats are assigned to each segment. Hereinafter, the display control method of the bar graph 40 will be described by taking the music having the total number of beats 420 as an example.
[0014]
The central control unit 11 evaluates the correctness of the singing in four stages based on the pitch error information for each beat transferred from the pitch measurement unit 30 as the performance progresses, and further, the evaluation results for 14 beats Pass / fail is determined according to the breakdown. 5A and 5B show the correspondence between the pitch error information and the evaluation, the breakdown of the pitch error information for 14 beats, and the correspondence between pass / fail. Each beat is evaluated in four levels, “No Miss”, “Small Miss”, “Middle Miss”, and “Large Miss”, and “Excellent”, “Pass”, “Fail” according to the breakdown of 14 beats. Pass / fail judgment is performed.
[0015]
The central control unit 11 colors all the minute segments 41 in the same color at the start of the performance, and when the four-stage evaluation is acquired for 14 beats, the corresponding minute segments 41a to 41 are colored in accordance with the three pass / fail judgment results. 41c is colored. Note that a period in which the main melody does not exist in the performance time series is recognized as a non-singing period, and the minute segment 41d corresponding to this period is colored in a predetermined color. In addition, if a predetermined number of beats having no pitch error information are included in the 14 beats, the pass / fail determination is impossible, and the minute segment 41e corresponding to this determination failure is also colored in a predetermined color and presented to that effect. ing. While the pitch error information for 14 beats is being acquired, a cursor (▼ mark) 44 is displayed on the minute segment corresponding to the current performance, and the minute segment 41f is also colored in a predetermined color. The minute segment 41g of the unplayed portion remains the initial color.
[0016]
When the music performance is finished, the central control unit 11 displays a final bar graph 40 including the minute segments 41a to 41e colored in colors according to the evaluation results for every 14 beats, and records it throughout the performance time. The pitch error information of each beat is collected and a total score of 100 points is displayed on the display 22. FIG. 6 shows a schematic view of the display screen after the performance. In the present embodiment, the total score is calculated according to the proportion of the minute segments from which the determination results of “excellent” and “pass” were obtained with the singing section being 100%. Further, with the upper limit being 100 points, the number of minute segments whose determination result is “excellent” is added to the score as it is. Of course, an appropriate algorithm is used for calculating the total score, such as calculating the total score according to the breakdown of the four-step evaluation for all beats, or using the average value of the pitch error information for each beat as the total score. it can.
[0017]
=== Singing practice mode ===
The central control unit 11 displays a message asking the user whether or not to perform the singing practice by replaying the same song on the score display screen after the performance is completed. Here, when the user performs an operation for instructing replaying, the number of this music is registered at the head of the queue, and the same music is replayed in the singing practice mode. Of course, the corresponding music number may be registered at the end of the queue.
[0018]
In the singing practice mode, a bar graph at the end of the previous performance is displayed at the start of replay. Then, at the time of replaying, similarly to the singing analysis mode, the coloring control of the minute segment based on the pitch error information for each beat is performed again, and the minute segment of the bar graph being displayed is overwritten. As a result, the user can grasp the point of failure on the performance time axis before starting the replay, and can sing while confirming whether the previously failed segment has changed to pass this time. it can.
[0019]
Also, it is recorded at the time of the cumulative beat corresponding to each lyric character based on the correspondence between the cumulative beat number recorded at the previous performance and pitch error information and the correspondence relationship between the performance time series and the lyric character. Pitch error information is acquired, and suggestions about the error information are displayed on the corresponding characters and in the vicinity thereof. FIG. 7 shows the display state of the bar graph and suggestion information in the singing practice mode. In this example, when the colored minute segments 41a to 41e are overwritten on the basis of the pass / fail determination result at the time of re-playing, the minute segment 41f being played is displayed in a predetermined color as in the singing analysis mode. By coloring or displaying the cursor 44 on the minute segment, it is easy to confirm how the determination result of which minute segment has changed between the previous time and the current time. In addition, among the four-level evaluations for each beat recorded at the time of the previous performance, suggestions of “small mistakes”, “medium mistakes”, and “large mistakes” are displayed above the corresponding lyric characters 42 in circles 43a to 43c of different sizes and colors. is doing. The singer can confirm the part that was rejected in advance by this suggestion, and can make preparations before singing the part. Even in the singing practice mode, the final bar graph recorded in the performance, the overall score, and a message asking whether or not to perform the singing practice again are displayed at the end of the re-performance.
[0020]
The suggestion information may be more detailed information such as the level of the singing voice pitch with respect to the pitch reference value. The display format of the suggestion information is not limited to the design such as a circle, but advice may be displayed in a letter by a balloon, or the lyrics text itself may be displayed in a different color / size / font.
[0021]
=== Bar graph display control ===
The total length of the bar graph may be variable according to the total number of beats. For example, as a display specification, 768 dots can be displayed in the left-right direction, and if left and right dots are assigned to one minute segment, a maximum of 192 segments can be displayed in one screen. If the total number of beats is 192 or less, one beat can be assigned to one segment, and the total length of the bar graph depends on the total number of beats.
[0022]
Even if the total number of beats is more than 192, if the number of beats assigned to one minute segment is 2, 3, 4 ..., the total number of beats is 384, 578, 768 ... In this case as well, the total length of the bar graph is determined according to the total number of beats.
[0023]
=== Display control of minute segments ===
More detailed information such as an average value of pitch error information per minute segment may be displayed on the minute segment, not limited to the pass / fail judgment result. If the color of the minute segment is changed as a visual effect, the segment may be color-coded using more colors according to detailed information.
[0024]
Appropriate visual effects can be used to display a minute segment, such as displaying a predetermined design in the segment or changing the shape or size of the segment, not limited to coloring. Of course, the numerical value itself such as the error information average value may be displayed in the segment.
[0025]
=== Evaluation according to pitch error value ===
In the above embodiment, the evaluation according to the pitch error information is uniquely determined. It is good also as a structure which can variably set not only this example but the correspondence of pitch error information and stepwise evaluation according to a user's instruction | indication. That is, it may be possible to set a difficulty level for obtaining a passing score. FIG. 8 shows the correspondence between the pitch error information corresponding to the difficulty level and the evaluation result. As the difficulty level increases, the evaluation becomes stricter.
[0026]
=== User interface in singing practice mode ===
You may make it perform preferentially the location which failed at the time of last performance. For example, at the time of re-playing, an appropriate performance control method can be adopted, such as performing while skipping sequentially the rejected portions or cuing and playing the rejected portions according to user input.
[0027]
Also, if the user is allowed to specify a rejected part, such as by moving the cursor left and right in units of minute segments by user input, the cueing part can be set on the user side. Alternatively, even in the same rejected part, the user may be able to set the cueing point by specifying the degree of disapproval, such as cueing only at a part including the beat with the lowest evaluation.
[0028]
In the singing practice mode, the bar graph may be overwritten by scoring only points that were rejected last time. In addition, when scoring only points that have been rejected in this way, the overall score will increase each time you practice, so it is possible to configure so that the overall score is deducted according to the number of exercises It is.
[0029]
【The invention's effect】
According to the singing practice support system of the present invention, it is possible to grasp which part has not been sung well and how well it has been performed throughout the performance time of the music.
[Brief description of the drawings]
FIG. 1 is a functional block diagram of a karaoke apparatus in an embodiment of the present invention.
FIG. 2 is a conceptual diagram of the principle of a pitch measurement method by a singing practice support system in the karaoke apparatus.
FIG. 3 is a functional block diagram of a pitch measurement unit mounted on the karaoke apparatus.
FIG. 4 is a schematic view of a screen displayed on the display when the karaoke apparatus is operating in the singing analysis mode.
FIG. 5 is a correspondence diagram (A) between the pitch error information output by the pitch measurement unit for each beat and the singing evaluation, and a correspondence diagram between the breakdown of the singing evaluation for each predetermined number of beats and the pass / fail judgment result ( B).
FIG. 6 is a schematic view of a screen displayed on the display at the end of the music performance in the singing analysis mode.
FIG. 7 is a schematic view of a screen displayed on the display when the karaoke apparatus is operating in the singing practice mode.
FIG. 8 shows a correspondence diagram between pitch error information output by the pitch measurement unit for each beat and singing evaluation in an embodiment in which the difficulty level can be set by the user.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Karaoke apparatus 11 Central control part 12 Hard disk apparatus 19 Microphone 22 Display 30 Pitch measurement part 40 Bar graph 41, 41a-41f Minute segment 42 Lyric character string 43a-43c Pitch error information suggestion design

Claims (1)

A karaoke apparatus comprising pitch error measuring means, control means, performance means, display means, and storage means,
The pitch error measuring means sequentially compares the singing voice signal pitch of the singer with the main melody pitch in the karaoke data during the period when the accompaniment music based on the karaoke data is output by the performance means, and sequentially calculates the pitch error time-series data. Output,
The control means enables a first performance mode and a replay mode,
In the first performance mode, the karaoke data of the requested song is played by the performance means, the lyrics subtitles are displayed on the display means based on the lyric rendering data in the karaoke data, and the first to third processes are performed.
The first process displays a horizontally long bar graph in which a number of vertically long small segments are arranged horizontally on the display means, associates the full length of the bar graph with the performance period of the requested song, and subdivides each performance period Are assigned to each small segment in turn,
In the second process, the pitch error time series data sequentially output by the pitch error measuring means is digitized for each minute period, a display color is determined based on the numerical value, and a minute segment assigned to the minute period is determined as the color. Coloring
The third process stores the coloring information of the bar graph at the end of the performance of the requested song in the storage means,
In the replay mode, the karaoke data of the requested song is played by the performance means, the lyrics subtitles are displayed on the display means based on the lyric rendering data in the karaoke data, and the fourth to fifth processes are performed.
The fourth process reads the bar graph coloring information from the storage means at the start of the performance, displays the bar graph colored based on the information on the display means,
In the fifth process, the pitch error time series data sequentially output by the pitch error measuring means is digitized for each minute period, a display color is determined based on the numerical value, and the color of the minute segment assigned to the minute period is determined. Karaoke device to change to the color.

Images