JPH11202877A - Automatic playing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a user to sing a song repeatedly while concretely confirming what place and how to sing after singing the song. SOLUTION: Music data consisting of playing data and text data are stored on an HDD(hard disk drive) 25 and when music data selected through a remote control 10 are reproduced, voice data of a singing voice are inputted from a microphone 18; and an audio control part 15 compares the said voice data with melody data of the playing data to detect comparison result data on the strength of the singing, deviation in interval, deviation in rhythm, etc., at previously set intervals of time and a CPU 2 embeds the comparison result data in corresponding places in the music data. When the music data having the comparison result data embedded are reproduced, a graphic control part 11, etc., displays the comparison results based upon the comparison result data on a television monitor 13 in sequence in synchronism with the progress of the music data.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a personal computer having a singing ability scoring function for playing back music based on music data and scoring singing ability based on a singing voice input in accordance with the music. The present invention relates to a music performance device such as a communication device and a communication karaoke device.

[0002]

2. Description of the Related Art In recent years, music playing apparatuses such as karaoke apparatuses provided with a singing ability scoring function for playing music based on music data and scoring singing ability based on singing voice inputted in accordance with the music have been developed. It is heavily used.

A singing ability scoring function of a conventional music performance apparatus (for example, refer to Japanese Patent Application Laid-Open No. 4-356093) compares voice data from a microphone with melody data in MIDI data, which is performance data, to determine a singing voice. Detects the score of the singing ability evaluation based on the detection results, such as the strength, pitch shift, rhythm shift, etc., and displays the score in real time or at the end of music The user was able to know the overall evaluation during and after singing.

[0004]

However, with the conventional music performance apparatus, it is not possible for the user to know which part of the lyrics and how to sing the song after singing, thereby increasing the score for evaluating the singing ability. However, there is a problem that the singing ability is not easily improved even when singing repeatedly. The present invention has been made in view of the above points, and has as its object to enable a user to sing again while specifically confirming which part should be sung and how to sing after singing.

[0005]

SUMMARY OF THE INVENTION In order to achieve the above object, according to the present invention, music data storage means for storing music data composed of performance data including melody data and lyrics data, and a music piece selected from the means. Music playing means for playing music based on the performance data of the data, lyric display means for displaying lyrics based on the lyric data of the selected song data, and singing voice collection for singing along with the music. Singing voice input means for inputting the voice data, and comparing the voice data input by the means with the melody data of the performance data, the singing voice intensity, pitch shift and rhythm shift at predetermined time intervals. And the like. The comparison result data detecting means for detecting the comparison result data, etc., and the comparison result data detected by the means are embedded in corresponding portions in the music data. Means for embedding comparison result data, and comparison result display control means for sequentially displaying a comparison result based on the comparison result data in synchronism with the progress of music when reproducing song data in which the comparison result data is embedded by the means The present invention provides a music performance device provided with:

When reproducing the music data in which the comparison result data is embedded, the reproduction of the music by the music reproduction means is invalidated, and the reproduction of the comparison result data is synchronized with the progress of the display of the lyrics by the lyrics display means. It is preferable to provide a means for sequentially displaying the comparison results based on.

Further, a singing instruction data storage means for storing the singing instruction data for each of the comparison result data, and when reproducing the music data in which the comparison result data is embedded, the comparison result data is synchronized with the progress of music. It is more preferable to provide a singing instruction voice output unit that outputs a singing instruction voice based on the singing instruction data corresponding to the comparison result data stored in the singing instruction data storage unit, instead of displaying the comparison result based on the singing instruction data.

Further, when reproducing the music data in which the comparison result data is embedded, it is further preferable to provide a means for repeatedly reproducing a portion of the music data having the worst comparison result data.

According to a first aspect of the present invention, there is provided a music performance device in which music data including performance data including melody data and lyrics data is stored, and music data is selected based on the music data selected from the music data. And displays the lyrics based on the lyrics data of the selected song data, collects the singing voice sung to the music, inputs the voice data, and inputs the input voice data and The melody data of the performance data is compared to detect comparison result data such as singing voice intensity, pitch shift, rhythm shift, etc. at predetermined time intervals, and the detected comparison result data is included in the music data. When playing back music data in which the comparison result data is embedded in the corresponding locations, the comparison results based on the comparison result data are sequentially displayed in synchronization with the progress of the music. So, how to sing it good or to what point after singing Specifically, it can be known with the progress of the music, it is possible to practice again singing while confirming it.

Further, the music performance device according to a second aspect of the present invention, when reproducing the music data in which the comparison result data is embedded, invalidates the reproduction of the music and synchronizes with the progress of the display of the lyrics. Since the comparison result based on the comparison result data is sequentially displayed, when singing repeatedly while checking the comparison result in the lyrics, it is possible to hear only the singing voice of one's own and the volume without being distracted by the performance music. ,
Adjustment of pitch, rhythm, etc. can be performed easily.

Further, the music performance apparatus according to a third aspect of the present invention stores the singing instruction data for each of the comparison result data, and plays back the music progress when reproducing the music data in which the comparison result data is embedded. In synchronization with the display of the comparison result based on the comparison result data, the singing instruction voice based on the singing instruction data corresponding to the stored comparison result data is output in synchronization with the comparison result data. You can receive specific improvement guidance by voice at the place where it is, and it becomes easy to fix the bad part of the song.

Further, in the music performance apparatus according to the fourth aspect of the present invention, when reproducing the music data in which the comparison result data is embedded, the portion where the comparison result data of the music data is the worst is repeatedly reproduced. In addition, the user can repeatedly sing and practice a place where the comparison result is bad.

[0013]

Embodiments of the present invention will be specifically described below with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a communication karaoke apparatus according to an embodiment of the present invention. This communication karaoke apparatus is realized by a microcomputer, and includes a system bus 1, a CPU 2, an R
OM3, RAM4, DMAC5, INTC6, timer (TIMER) 7, serial interface (SERI)
AL / I / Fs 8 and 22, control panel 9, remote controller 10, graphic controller 11, video (VIDEO)
O) control unit 12, television monitor 13, speaker 14, audio (AUDIO) control unit 15, sound source board 16,
Amplifier 17, microphone 18, communication control unit 19, ISDN interface (ISDN I / F) 20, ISDN2
1, VCD player 23, scuzzy interface (S
CSI / I / F) 24 and hard disk drive (HD
D) It consists of 25.

The system bus 1 is a communication line for exchanging data between the above units. The CPU 2 controls the entire communication karaoke apparatus, and performs various processes according to the present invention. The ROM 3 stores various control programs executed by the CPU 2. RAM4 is CPU2
Is a work area used when performing various processes.

The control panel 9 is used to input a song number when a karaoke performance song is reserved, to input a tempo or key during performance, and to perform other input operations. Remote control 10
Performs the operation by the control panel 9 by remote control.

The graphic control unit 11 performs a process of displaying lyrics based on the lyrics data in the song data on a background image displayed on the television monitor 13, and changing the color of the lyrics in synchronism with the reproduction of the played song. And a process of displaying the comparison result based on the comparison result data in the music data on the television monitor 13, and the like.

The video control unit 12 converts a background image based on the background image data corresponding to the music data into an NTSC signal and displays the NTSC signal on the television monitor 13.
3, a process of displaying a picture-in-picture (PinP), a process of split display, and a process of displaying a comparison result based on comparison result data in music data on the television monitor 13.

The television monitor 13 displays a background image and the lyrics of the music being played on the background image, and displays a comparison result based on the comparison result data in the music data. The speaker 14 outputs karaoke performance music based on a playback signal of a music piece output from the amplifier 17 and singing sound based on a voice signal (voice data) input from the microphone 18.

The audio control unit 15 performs effect processing for an audio signal input from the microphone 18, effect processing for a reproduced signal of a musical piece, processing for detecting a comparison result according to the present invention, and the like. The sound source board 16 converts a digital reproduction signal into various musical instruments and sound effects based on the performance data in the music data, and outputs an analog reproduction signal. The amplifier 17 amplifies the reproduced signal of the musical piece output from the sound source board 16 and the audio signal input from the microphone 18 and outputs the amplified signal to the speaker 14.

The microphone 18 inputs a voice signal of a voice that the user sings along with the karaoke performance music output from the speaker 14. The communication control unit 19 includes an ISDN 21
Communication control for receiving performance data (including melody data) such as MIDI data, song data including lyrics data and other information from an external host device, and transmitting control information of the communication karaoke device to the host device via an external host device. Do.

The ISDN I / F 20 has a basic interface (I / F) such as INS64,
The connection process is performed. The VCD player 23 is a VCD
A process of reproducing and outputting image data of a background video to be displayed on the television monitor 13 recorded on a medium such as the above is performed.

The SCSI I / F 24 controls writing and reading of information such as music data and various control information to and from the HDD 25. The HDD 25 is a storage device that stores music data (comprising performance data, lyrics data, and the like) of a large number of karaoke music pieces, singing instruction data corresponding to various comparison result data, and information such as various control information. is there.

That is, the HDD 25 functions as music data storage means for storing music data composed of performance data including melody data and lyrics data.
2. The sound source board 16 and the like perform the function of music playing means for playing music based on the performance data of the music data selected from the music data storage means. The function of the lyrics display means for displaying the lyrics based on the lyrics data of.

Also, the microphone 18 functions as a singing voice input means for collecting singing voices sung along with the music and inputting the voice data. Means for comparing the melody data of the performance data with the voice data input by the means to detect comparison result data of singing voice intensity, pitch shift, rhythm shift, etc. at predetermined time intervals. And performs the function of comparison result data embedding means for embedding the comparison result data detected by the means in corresponding locations in the music data.

Further, when the CPU 2, the graphic control unit 11 or the like reproduces the music data in which the comparison result data is embedded by the comparison result data embedding means, the comparison based on the comparison result data is synchronized with the progress of the music. The function of the comparison result display control means for sequentially displaying the results is achieved.

Further, when the CPU 2 or the like reproduces the music data in which the comparison result data is embedded, the reproduction of the music by the music reproducing means is invalidated and the reproduction of the lyrics by the lyrics display means is synchronized. It functions as means for sequentially displaying the comparison results based on the comparison result data.

Further, the HDD 25 functions as a singing instruction data storage means for storing the singing instruction data for each of the comparison result data, and the CPU 2, the graphic control unit 11 and the like store the song data in which the comparison result data is embedded. When reproducing, singing instruction based on the singing instruction data corresponding to the comparison result data stored in the singing instruction data stored in the singing instruction data storage means, instead of displaying the comparison result based on the comparison result data in synchronization with the progress of music. It functions as a singing instruction voice output unit that outputs voice.

Further, when the CPU 2 or the like reproduces the music data in which the comparison result data is embedded, it functions as a means for repeatedly reproducing the portion of the music data having the worst comparison result data.

FIG. 2 is a diagram showing an example of displaying lyrics on the TV monitor 13. As shown in FIG. When reproducing the music data, the speaker 14
Output the karaoke music based on the performance data, and display on the TV monitor 13 lyrics based on the lyrics data in the music data, for example, "I do not have an umbrella but I do not want to return." . The lyrics data is edited in units of pages or lines in accordance with the music, and lyrics are sequentially displayed in units of pages or lines in synchronization with the progress of the music during reproduction. In addition, the display color of the singing part is sequentially changed in synchronization with the tempo of the music.

FIG. 3 is a diagram showing an example of the format of the lyrics color change timing data in the lyrics data. The lyrics color change timing data for the lyrics data is, for example, if the time information is a color change time of one dot, "umbrella", "no reason", "no", and "kakedo" are changed at different timings. Let it. The color change timing is created in advance by matching the progress of the music. Each piece of lyrics data is edited so as to be synchronized with the reproduction of the performance data.

Next, the processing at the time of music reproduction in the communication karaoke apparatus will be described. The CPU 2 acquires music data including performance data including melody data and lyrics data from the host by the communication control unit 19, and stores the music data in the HDD 25. Therefore, HDD2
5 stores song data of various types of karaoke songs. The HDD 25 also stores background video data of moving images and still images corresponding to each piece of music data.

When the music number of the requested music is input from the control panel 9 or the remote control 10, the CP
U2 reads the music data corresponding to the music number and the background video data corresponding to the music number from the HDD 25, and outputs the performance data in the music data to the audio control unit 15 and the lyrics data and the background video data to the video control unit 12.

The audio controller 15 sends the performance data to the sound source board 16, which reproduces a music signal based on the performance data and sends it to the amplifier 17.
Mixes and amplifies a music signal and a voice signal of a singing voice input from the microphone 18, and outputs the result from the speaker 14.

The graphic control unit 11 sends the lyrics data and the background video data to the video control unit 12 in synchronization with the reproduction of the performance data, and the video control unit 12 transmits the lyrics display signal and the background video data based on the lyrics data. And reproduces the background video signal (NTSC signal) on the TV monitor 13 and outputs the background video and lyrics synchronized with the progress of the music.

Further, when the audio control unit 15 inputs data of a singing voice signal input from the microphone 18 to the music via the amplifier 17 and the sound source board 16 while the music is being played, the audio control unit 15 inputs the data. The vocal signal is compared with the melody data of the performance data, and comparison result data (scoring data) such as singing voice strength, pitch shift, rhythm shift, etc. is taken every predetermined time (for example, 100 msec). Is detected and output.
The above-mentioned scoring data is embedded in corresponding portions in the above-mentioned performance data stored in the step No. 5 respectively.

FIG. 4A is a diagram showing a format example when the comparison result data is embedded in the performance data. The performance data is composed of time information for creating a tempo of the music, MIDI data, and page information of a synchronization code for lyrics display, and the MIDI data contains melody data. Then, the comparison result data (shown as "scoring data" in the figure) detected at every predetermined time is stored in a corresponding location so as to be synchronized at the time of music reproduction. Therefore, the next time the performance data is played,
It becomes possible to display the scoring data in synchronization with the reproduction of the music.

FIG. 4B is a diagram showing a format example when scoring data is embedded in lyrics data.
In the lyrics data, lyrics data for each page is stored as text data. The lyrics data of each page is edited so as to synchronize with the reproduction of the music data.
Then, the comparison result data (indicated as “scoring data” in the figure) detected at every predetermined time is stored in a corresponding location so as to be synchronized when the lyrics are reproduced.

In the above processing, at the time of the first performance, comparison data such as the strength of the singing voice, the shift of the pitch, and the shift of the tempo are recorded in the music data at predetermined time intervals. Then, at the time of the second and subsequent performances, based on the comparison result data in the music data, the comparison results such as the previous singing voice strength, pitch shift, and tempo shift are displayed. Therefore, the scoring data can be displayed in synchronization with the reproduction of the music without embedding the scoring data in the performance data.

Next, when reproducing the music data in which the comparison result data is embedded in the performance data, the audio control unit 1
5 detects the comparison result data embedded in the performance data and sends it to the graphic control unit 11, which sends the comparison result data to the television monitor 13 via the video control unit 12 and displays the comparison result. Let it. Therefore, the comparison result based on the comparison result data can be sequentially displayed in synchronization with the progress of the music.

When playing back the song data in which the comparison result data is embedded in the lyrics data, the graphic control unit 11 detects the comparison result data embedded in the lyrics data and, via the video control unit 12, detects the comparison result data. Monitor 13
To display the comparison results. Therefore, even in this case, the comparison result based on the comparison result data can be sequentially displayed in synchronization with the progress of the music.

FIG. 5 is a diagram showing a display example of the comparison result on the television monitor 13. For example, on the television monitor 13, if the pitch shift is indicated by the upper and lower arrows in the lyrics, the tempo shift is indicated by the left and right arrows, and the intensity of the singing voice is indicated by the color of the arrow, the user can determine the pitch of any part. It is possible to visually confirm whether the tempo and the singing volume are bad, and sing and practice again while confirming that, and the singing style can be easily improved.

Next, when the song data in which the comparison result data is embedded in the lyrics data is reproduced, when an instruction to delete (invalidate) the music is input from the control panel 9 or the remote control 10, the CPU 2 executes the audio processing. Control unit 1
5, the reproduction of the performance data is stopped, and the graphic control unit 11 reproduces the background video data and the lyrics data.

The graphic control unit 11 reproduces the background video data and the lyrics data. When the comparison result data embedded in the lyrics data is detected, the graphic control unit 11 sends the data to the television monitor 13 via the video control unit 12 to transmit the background data. The comparison result is displayed for the lyrics in the video.

When reproducing the music data in which the comparison result data is embedded in the performance data, when an instruction to delete (invalidate) the music is input from the front panel 9 or the remote controller 10, the CPU 2 executes the audio processing. Control unit 15
Is instructed to reproduce the performance data.
Output to the graphic controller 11 and the graphic controller 11 reproduces the background video data and the lyrics data.

Then, the audio control unit 15 executes the reproduction of the performance data, and outputs the data to the graphic control unit 11 when detecting the comparison result data. On the other hand, the graphic control unit 11 executes the reproduction of the background video data and the lyrics data, and upon receiving the comparison result data from the audio control unit 15, sends the data to the television monitor 13 via the video control unit 12 to convert the lyrics into the lyrics in the background video. Display the comparison result.

In this way, when singing repeatedly while checking the comparison result in the lyrics using the microphone, the user can hear only his own singing voice without being distracted by the music played. Can easily adjust the volume, pitch, and rhythm.

Next, when reproducing the music data in which the comparison result data is embedded, when an instruction to output a guidance voice is input from the control panel 9 or the remote control 10, the CPU 2 synchronizes the music with the progress of the music. Instead of displaying the comparison result based on the comparison result data, a singing instruction voice based on the singing instruction data corresponding to the comparison result data stored in the HDD 25 is output.

First, when the comparison result data is detected by the graphic control unit 11 or the audio control unit 15, the singing instruction data corresponding to the comparison result data is read from the HDD 25 and output to the audio control unit 15. Upon receiving the singing instruction data, the audio control unit 15 sends the singing instruction data to the sound source board 16, and the sound source board 16 generates a singing instruction voice based on the singing instruction data and outputs the singing instruction voice to the speaker 14 via the amplifier 17.

For example, as the singing instruction data corresponding to the comparison result data in the HDD 25, "the singing voice is too low", "the pitch is too low", "the pitch is too high", and "the tempo is too fast".
The PCM data of the singing instruction voice such as "the tempo is too slow" is registered, and the reproduction is performed in synchronization with the reproduction of the music along with the detection of the comparison result data. If the reproduction timing of the PCM data is set to be slightly earlier than the singing point, the user can hear the singing instruction before singing, and can sing correctly according to the singing instruction.

In this way, when the user sings the first sung song again, the user can receive specific improvement guidance by voice at the place where the comparison result is bad, and the bad part of the singing style can be received. Is easy to fix.

Next, when reproducing the music data in which the comparison result data is embedded, when an instruction to repeat the worst part of the comparison result is input from the control panel 9 or the remote controller 10, the CPU 2 sets the graphic control unit. 11 or the audio control unit 15 to search for a page or bar section in which the worst comparison result is embedded.
Detects the section having the worst comparison result from the data of one song, and repeats the section when the song data is reproduced. Also, only the section may be repeatedly reproduced at the same time as the reproduction is started.

In this way, the user can practice again by singing again the portion where the comparison result of the first singing was poor during the second and subsequent singing.

In the above processing, the comparison result data recorded during the first singing is used for the second and subsequent times. However, the comparison result data in the music data is erased after being used several times under the control of the CPU 2. If you rewrite or rewrite, when singing the same song, the comparison result of the part that improved after singing will not be displayed, and the number of displayed comparison results will gradually decrease as you sing repeatedly, willingness to practice And singing ability can be efficiently improved.

In the above embodiment, the case of the communication karaoke apparatus has been described. However, the present invention can be similarly applied to a personal computer or a karaoke apparatus capable of reproducing and outputting karaoke music.

[0055]

As described above, according to the music playing apparatus of the present invention, the user can sing again while singing while confirming which part should be sung and how to sing. Singing ability can be improved in time.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a communication karaoke apparatus according to an embodiment of the present invention.

FIG. 2 is a diagram showing an example of displaying lyrics on the television monitor shown in FIG. 1;

FIG. 3 is a diagram showing an example of a format of lyrics color change timing data in the lyrics data shown in FIG. 2;

FIG. 4 is a diagram showing a format example when comparison result data is embedded in performance data and a format example when scoring data is embedded in lyrics data.

FIG. 5 is a diagram showing a display example of a comparison result on the television monitor shown in FIG. 1;

[Explanation of symbols]

1: System bus 2: CPU 3: ROM 4: RAM 5: DMAC 6: INTC 7: Timer (TIMER) 8, 22: Serial interface (SERIAL I)
/ F) 9: Control panel 10: Remote control 11: Graphic control unit 12: Video (VIDEO) control unit 13: TV monitor 14: Speaker 15: Audio (AUDIO) control unit 16: Sound source board 17: Amplifier 18: Microphone 19: Communication control unit 20: ISDN interface (ISDN I / F) 21: ISDN 23: VCD player 24: Scuzzy interface (SCSI I / F) 25: Hard disk drive (HDD)

Claims (4)

[Claims] 1. A music data storage means for storing music data comprising performance data including melody data and lyrics data; and a music playback means for playing music based on performance data of music data selected from the means. Lyrics display means for displaying lyrics based on the lyrics data of the selected song data; singing voice input means for collecting singing voices sung along with the music and inputting the voice data; Comparison result data detection means for comparing the input voice data with the melody data of the performance data and detecting comparison result data such as singing voice intensity, pitch shift, rhythm shift, etc. at predetermined time intervals; Comparison result data embedding means for embedding the comparison result data detected by the means at corresponding locations in the music data, respectively; When playing the music data data is embedded, musical performance apparatus which is characterized in that a comparison result display control means in synchronization with progression of the music is sequentially displayed comparison result based on the comparison result data. 2. The music performance device according to claim 1, wherein when reproducing the music data in which the comparison result data is embedded, the reproduction of the music by the music reproduction means is invalidated,
A music performance device provided with means for sequentially displaying comparison results based on the comparison result data in synchronization with the progress of the display of lyrics by the lyrics display means. 3. The music performance device according to claim 1, wherein the singing instruction data storage means for storing singing instruction data for each of the comparison result data, and reproducing the music data in which the comparison result data is embedded. Instead of displaying the comparison result based on the comparison result data in synchronization with the progress of the music,
A singing instruction voice output unit that outputs a singing instruction voice based on the singing instruction data corresponding to the comparison result data stored in the singing instruction data storage unit. 4. The music performance device according to claim 1, wherein, when reproducing the music data in which the comparison result data is embedded, a part having the worst comparison result data of the music data is determined. A music performance device comprising means for repeatedly reproducing.