JPH06295529A - Display device - Google Patents

Abstract

PURPOSE:To display the objective comparison result of singing on the output screen of equipment which reproduces the video signal of a laser disk player, etc., in a visually easy-to-understand state by solving the problem that the singing needs to be decided depending upon subjective evaluation by comparison with standard singing and displaying the comparison result as video information of the singing on the output screen when a practice in KARAOKE is made. CONSTITUTION:A comparison part 13 compares reference singing information and compared singing information detected by a reference singing information detection part 11 and a compared singing information detection part 12. A video superposing process part 15 superposes a comparison result information signal, generated by a signal generation part 14 according to the comparison result, on an input image as video information to project the comparison result of the comparison part 13 on an output image as the video information, so that a difference in singing can be recognized as the video information.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a device capable of reproducing a video signal such as a video tape recorder or a video disc player or a singing signal processing device, and is used as a karaoke device by a singing reproduced or a singing inputted from the outside. The present invention relates to a display device that is particularly effective when used.

[0002]

2. Description of the Related Art In recent years, when performing karaoke, as a means for displaying lyrics on the screen and enlivening the atmosphere,
The simultaneous use of video is widely practiced. Video tapes and video discs on which audio signals for karaoke are recorded are used as media used at that time, and the singing signal of the original song is recorded on these karaoke media in addition to the audio signals for karaoke. Is common. The singing signal of this original song is used as a model for karaoke and recorded for the purpose of using it as a training material for karaoke.

The conventional use of the original song in a karaoke machine will be described below with reference to FIG.

In FIG. 18, reference numeral 181 denotes an amplitude adjuster, 1
Reference numeral 82 is an adder. The operation of singing the original song configured as described above will be described. First, it is necessary to adjust the singing of the original song to an amplitude that is easy for the singer to hear and to be a part of the output singing. In order to realize this, the amplitude of the original song is adjusted by the singer's amplitude control when passing through the amplitude adjuster 181. Then, the adder 182
Gives an output song that is added to the song of the singer and is mixed with the song of the singer and the original song whose amplitude has been adjusted.

In the karaoke machine including the above-mentioned configuration, the original song is added to the output song with the amplitude controlled by the singer. Then, the singer can practice the karaoke by listening to and comparing the singing of the original song output together with his own singing, and using the singing of the original song as a model for karaoke.

[0006]

However, in the above-mentioned conventional configuration, in the comparison between the original song and the song by the singer, the singer listens to the output song and subjectively interprets the difference between the songs. The result is obtained. If the singer has a good listening ability, you can understand the difference between the original song and your own song, but if you are not good at listening, the difference between the original song and your own song is difficult to understand, In addition, there is a problem that it is difficult to make an objective evaluation, and there is a drawback that the difference in singing can be grasped only from the subjective viewpoint of the singer.

The present invention solves the above-mentioned conventional problems. By detecting the information of each singing and displaying the comparison result objectively on the reproduction screen, the singing can be performed regardless of the personal ability of the singer. The purpose is to provide an environment in which the differences between can be confirmed.

[0008]

In order to achieve this object, a display device of the present invention comprises a reference song information detecting section for detecting information on a reference song and a comparative song for detecting information on a song to be compared. An information detection unit, a comparison unit that compares the detection results of the reference song information detection unit and the comparison song information detection unit, a signal generation unit that determines a signal based on the comparison result obtained from the comparison unit, and a signal is superimposed on the input video signal. The detection result of the reference song information detection unit and the comparison song information detection unit is input to the comparison unit, the signal generation unit determines the signal generated by the result of the comparison unit, this signal The configuration is such that it is input to the video processing unit.

[0009] Further, a song extracting section for extracting the reference song audio signal from the song including the reference song audio signal, a reference song information detecting section for detecting information of the reference song, and information of the compared song are detected. A comparison singing information detection unit, a comparison unit that compares the detection results of the reference singing information detection unit and the comparison singing information detection unit, a signal generation unit that determines a signal based on the comparison result obtained from the comparison unit, and a signal to the input video signal. Consists of a video processing unit that can superimpose, the detection results of the reference song information detection unit and the comparison song information detection unit is input to the comparison unit,
The signal generator determines the signal to be generated based on the result of the comparator, and the signal is input to the video processor.

Further, the reference song information detecting section for detecting the information of the reference song, the comparative song information detecting section for detecting the information of the song to be compared, and the detection of the reference song information detecting section and the comparative song information detecting section. A comparison unit that compares the results, a storage unit that stores the comparison result of the comparison unit, a signal generation unit that determines a signal by the comparison result and the storage unit obtained from the comparison unit, and a signal that is superimposed on the input video signal. It consists of a video processing unit that can, the detection results of the reference song information detection unit and the comparison song information detection unit is input to the comparison unit, the signal generation unit determines the signal to be generated by the result of the comparison unit and the storage information of the storage unit, This signal is input to the video processing unit.

Further, a progress information extracting section for extracting progress information of the reference singing voice signal from a video signal including signal information of the reference singing voice signal, and a reference singing information detecting section for detecting information of a reference singing voice signal are compared. Comparative singing information detecting section for detecting information of the singing performed, a comparing section for comparing detection results of the reference singing information detecting section and the comparative singing information detecting section, and signal generation for determining a signal by the comparison result obtained from the comparing section And a video processing unit capable of superimposing a signal on the input video signal, the detection results of the reference singing information detection unit and the comparison singing information detection unit are input to the comparison unit, and the results of the progress information extraction unit and the comparison unit. The signal generator determines the signal and the video signal including the signal and the progress information is input to the video processor.

[0012]

With this configuration, the reference singing is input to the reference singing information detecting unit, the singers' singing is input to the comparative singing information detecting unit, and the comparing unit compares the results of detecting the information of each singing, The signal generated by the comparison result is superimposed on the input video signal as video information by the video processing unit, so that the singer can objectively and easily perform the singing by the video information indicating the comparison result output from the video processing unit. Can recognize the difference in information.

[0013]

【Example】

(Embodiment 1) A first embodiment of the display device of the present invention will be described with reference to FIG.

FIG. 1 is a block diagram showing a first embodiment of the display device of the present invention. In FIG. 1, 11 is a reference song information detecting unit that detects information of a reference song, 12 is a comparative song information detecting unit that detects information of a comparative song, 13 is a reference song information detecting unit 11 and a comparative song information detecting unit 12. A comparison unit that compares detection results, 14 is a signal generation unit that determines a signal based on the comparison result obtained from the comparison unit 13, and 15 is an image superimposition processing unit that can superimpose a signal on an input image.

The display device configured as described above will be described with reference to FIG. First, the song of the original song is input to the reference song information detection unit 11 as a reference song and the information is analyzed. Similarly, the comparative song which is the song of the singer is input to the comparative song information detection unit 12 and the information is analyzed. As points when singing a song, an accurate pitch, an appropriate sound volume, an accurate singing start, etc. can be mentioned. Therefore, with respect to the singing, the pitch, the sound volume, the deviation of the starting start, etc. may be detected. Since the pitch and the volume are information for each song alone, they are detected by the reference song information detecting unit 11 and the comparison song information detecting unit 12, and the deviation of the singing is detected as a result of comparing the volume of each song. Because it is information,
The detection is performed by the comparison unit 13.

Now, the detection operations of the reference song information detecting section 11 and the comparative song information detecting section 12 will be described with reference to FIG.

FIG. 2 is a circuit diagram of the reference song information detecting section 11 and the song information detecting sections of the comparative song information detecting section 12. Two
1 is a filter, 22 is a zero-cross extraction circuit for detecting the zero-cross of the input signal, 23 is a pitch detection circuit for converting and calculating the result of the zero-cross extraction circuit 22 into a pitch, 24 is an AD converter for detecting the volume, and 25 is an AD converter Latch circuit for latching the maximum value of the volume data detected in step 26, reference clock oscillator 26, reference clock 2
A clock counter that counts 6 and a detection data synthesis circuit 28 that synthesizes the data of the pitch detection circuit 23 and the latch circuit 25 into one data.

First, a method of detecting a pitch will be described. First, the input singing signal has its DC component cut by the filter 21, and a signal corresponding to the frequency range of the vowel is taken out. The output signal of the filtered filter 21 is input to the zero-cross extraction circuit 22, and the time of the zero-cross interval where 0V is crossed is detected. Here, since the DC component of the signal input to the zero-cross extraction circuit 22 is cut by the filter 21, the time of the zero-cross interval becomes the signal cycle. The period information of this signal is input to the pitch detection circuit 23 and frequency-converted to obtain a pitch detection result. Note that when singing a song, octave-shifted songs may be regarded as the same pitch because the key relationships are the same. Therefore, as the detection processing in the pitch detection circuit 23, if one octave is divided into constant data and the pitch is assigned to each data, the pitch detection results with different octaves are all the same detection result, which is convenient. For example, if one octave is divided into 256 and the data is represented by hexadecimal 1-byte data, the same data is obtained every time the data exceeds an octave.

Next, a method of detecting the volume will be described. The level of the input singing signal is detected by the AD converter 24 operating with the reference clock from the reference clock oscillator 26. Then, the result of the AD converter 24 is sent to the latch circuit 25, and the maximum value is latched and becomes the sound volume detection result.

As described above, the pitch and the volume are detected, but since both are temporally continuous data and change from moment to moment, if all the detections are taken as the result, the amount of detection result is enormous. Therefore, it becomes necessary to collect detection results by providing detection intervals by dividing them by a fixed time. The clock counter 27 processes this operation. First, the detection interval is determined by counting the reference clock of the reference clock oscillator 26. When the detection interval time is reached, the clock counter 27 first controls the detection data synthesizing circuit 28,
A process of combining the pitch data and the volume data obtained by the pitch detection circuit 23 and the latch circuit 25 into one data is performed. When synthesized into one data, the pitch and volume detection results within the detection interval always have a one-to-one relationship, and the relationship between the pitch and volume data can be clarified. As a format for combining into one data, for example, when the data is combined into 16-bit digital data, upper 8 bits may be pitch data and lower 8 bits may be volume data. Then, the clock counter indicates that this processing is completed by the detection data synthesizing circuit 28.
From the above, the detection results of the pitch detection circuit 23 and the latch circuit 25 are cleared, and the pitch detection circuit 23 and the latch circuit 25 start detection of the next detection interval. In this way, by obtaining the detection results that are temporally separated, the detection results can be determined for each detection interval.

Here, the setting of the detection interval determined by the clock counter 27 becomes a problem. Reference clock oscillator 26
The AD converter 24 operated by can finish the processing at a very high speed, for example, in 0.1 ms. The detection interval determined by the clock counter 27 is longer than this time, and smaller than the constant time during which the comparison section, which will be described later, compares and confirms.
For example, it may be set to 10 ms. This time is much shorter than the time during which the change in the pitch or volume of the song is perceived sensuously, and is therefore sufficient for the comparison process in the comparison unit 13 described later.

When the volume of the singing voice obtained by the latch circuit 25 is not higher than a certain value, the singing voice is not higher than a certain amplitude value, and if the detected data synthesizing circuit 28 invalidates the data, the pitch is detected by noise. Even if the circuit 23 detects the pitch, the detection data synthesizing circuit 28 does not output the erroneous detection data as the detection result, and the erroneous detection for noise can be prevented.

Next, the comparison unit 13 is the reference song information detection unit 1.
1 and the detection results of the comparative singing information detection device 12 are compared, but the difference in singing can be perceptually recognized when a difference occurs continuously for a certain time, for example, for 1 second rather than an instantaneous difference. Therefore, the comparison result is fixed every fixed time. The operation for determining the comparison result at regular time intervals will be described with reference to FIG.

FIG. 3 is a circuit diagram of the comparison unit 13. Thirty
Reference numeral 1 designates the detection result information of the reference singing information detection device 11 as first detection information, and a first information separation circuit for separating this into pitch-related information and volume-related information, and 302 is a detection result of the comparative singing-information detecting device 12. A second information separation circuit that uses information as second detection information and separates this into pitch-related information and volume-related information, and 303 stores the pitch information separated by the first information separation circuit 301 in time series. A first pitch information storage circuit, 304 is a first volume information storage circuit that stores the volume information separated by the first information separation circuit 301 in time series, and 305 is separated by a second information separation circuit 302. A second pitch information storage circuit for storing the pitch information in time series, and a second volume information storage for storing the volume information separated by the second information separation circuit 302 in time series. Road, pitch comparison circuit for determining the difference in pitch compared with information stored in the first interval information storage circuit 303 in the second interval information storage circuit 305 307, 3
Reference numeral 08 is a volume comparison circuit for comparing the information stored in the first volume information storage circuit 304 and the second volume information storage circuit 306 to determine the difference in volume, and 309 is a comparison between the pitch comparison circuit 307 and the volume comparison circuit 308. A comparison data synthesizing circuit 310 for performing a process of including the result in one data is controlled by time, and the first pitch information storage circuit 303, the first volume information storage circuit 304, the second pitch information storage circuit 305 and the second pitch information storage circuit 305 are used. Is an operation control circuit for controlling the volume information storage circuit 306, the pitch comparison circuit 307, the volume comparison circuit 308, and the comparison data synthesis circuit 309.

The operation of the comparing section configured as described above will be described. First, the detection information from the reference song information detection device 11 in FIG. 1 is input to the first information separation circuit 301 as the first detection information. Similarly, FIG.
The detection information from the comparative singing information detection device 12 in
The second detection information is input to the second information separation circuit 302. In each information separation circuit, the pitch information and the volume information synthesized by the detection data synthesis circuit 28 of FIG. 2 are separated according to the synthesis format. The detection data synthesizing joint 28 determines the detection result for a time of, for example, 10 ms, which is shorter than the fixed time for the comparison unit 13 to determine the comparison data, for example, 1 second, so that the pitch information and the volume information are stored. The need arises. Therefore, the pitch information separated by the first information separation circuit 301 is stored in the first pitch information storage circuit 303, and the volume information is stored in the first volume information storage circuit 304. Similarly, the second information separation circuit 30
The pitch information separated by 2 is stored in the second pitch information storage circuit 305, and the volume information is stored in the second volume information storage circuit 306.

The information stored in the first pitch information storage circuit 303 and the second pitch information storage circuit 305 are compared by the pitch comparison circuit 307, and the second volume information storage circuit 304 and the second volume information are stored. The information stored in the information storage circuit 306 is compared by the volume comparison circuit 308. The comparison is executed by the operation control circuit 310 at fixed time intervals for determining the comparison result. Regarding the operation of the pitch comparison circuit 307, first, when a certain period of time has passed, the pitch comparison circuit 307 compares the stored information in the first pitch information storage circuit 303 and the second pitch information storage circuit 305.

At this time, the first pitch information storage circuit 303
Since the information stored in the second pitch information storage circuit 305 is stored in chronological order, the pitch comparison circuit 307 can execute the comparison process according to a temporal transition. Therefore, if the pitch comparison circuit 307 performs the comparison only on the pitch information that exists simultaneously in time, the comparison is performed only on the information for which the comparison target is clear, so that a highly reliable comparison result can be obtained.

Further, since the songs are continuously present in one bar, the pitch comparison circuit 307 determines that the result is unreliable when the comparison result of a certain number or more cannot be obtained within a certain time. False positives can be prevented if the result is not confirmed.

If the first pitch information storage circuit 303 and the second pitch information storage circuit 305 have a plurality of information storages, these are averaged and the pitch comparison circuit 3 is used.
When the comparison result is confirmed at 07, a representative value in a certain period of time can be used as the comparison result, and a highly accurate comparison result can be obtained even when there is variation in pitch information.

Further, when the pitch comparison circuit 307 establishes the comparison data by providing a reference value having a certain width that is not perceptually deviated in the comparison of pitches, the comparison result matches the hearing. For example, if it is not possible to perceptually recognize the deviation of the pitch with a deviation of 1/4 sound or less, the comparison result may be determined in units of 1/4 sound.

Although the case where the pitch comparison result is obtained has been described above, even when the volume comparison circuit 308 obtains the volume comparison result by the information of the first volume information storage circuit 304 and the second volume information storage circuit 306. By the same processing, it is possible to obtain the volume comparison result.

Here, a method of determining the deviation in singing will be described. The determination that the singing is shifted can be made by comparing the two songs by detecting the presence of only one of the songs in the state where no song is present. Therefore, if there is information that the volume exists in only one of the first volume information storage circuit 304 and the second volume information storage circuit 306, it can be determined that there is a deviation in singing.
At this time, if the volume information exists only in the first volume information detection circuit 304, it indicates that the singing is delayed, and if the volume information exists only in the second volume information detection circuit 306,
It is determined that singing has started.
If the first volume information storage circuit 304 and the second volume information storage circuit 306 both have volume information or no volume information, it is determined that the songs are in the same state. It is detected that it is not the start of singing.

Then, the comparison result determined by the pitch comparison circuit 307 and the volume comparison circuit 308 is combined into one data by the comparison data combination circuit 309 which operates similarly to the detection data combination circuit 28 in FIG. Is output as.

The operation control circuit 310 manages the above-described operation of obtaining the comparison data at regular intervals. When a certain period of time has passed, the operation control circuit 310 first starts the comparison operation of the pitch comparison circuit 307 and the volume comparison circuit 308, confirms that the comparison result has been confirmed, and then executes the operation of the comparison data synthesis circuit 309. The stored information in the first pitch information storage circuit 303, the second pitch information storage circuit 305, the first volume information storage circuit 304, and the second volume storage circuit 306 is erased.

Next, the signal generating section 14 generates a signal according to the comparison result of the comparing section 13, and the display position, color and shape are specified by the result of the comparing section 13 to give the signal meaning of the comparison result. For example, when the pitch of the comparative singing is higher than the reference singing, a signal is generated at a position above the display position when the pitches in the output video match, and when the pitch of the comparative singing is lower than the reference singing, in the output video. A signal is generated at a position below the display position when the pitches match. At this time, the color and shape are not changed. Further, when focusing on the display position in this way, if the display position information corresponding to the comparison result is included in the signal generated by the signal generation unit 14, the flow of the signal to the video signal processing unit 15 is simplified. When the comparison unit 13 determines the comparison result and the signal generation unit 14 determines the image information at the same time, the singer can obtain the comparison result closest to the current singing, which is very effective for singing practice. . Since the video signal monitored by the singer includes a telop of lyrics and is an image for enlivening the atmosphere, the singer usually sings while monitoring this.

Therefore, the signal generation unit 14 generates a signal reflecting the result of the comparison unit 13, and the image superimposition processing unit 15 superimposes this signal on the video image monitored by the singer, so that the difference in the singing information is changed. The effect that can be monitored at the same time can be obtained. In this way, the difference between the singing signal of the original song and the singing signal of the singer is output as a video signal, which the singer can confirm on the output screen.

Here, the mechanism by which the image superimposition processing unit 15 superimposes an image on an arbitrary area on the output screen will be described with reference to FIG. FIG. 4 is a configuration diagram of the inside of the image superimposition processing unit. First, a sync separation circuit 41 performs a sync separation process on an input video signal to extract a vertical sync signal and a horizontal sync signal. The position with respect to the video signal can be specified by this synchronization signal. The position in the vertical direction is first specified by the H counter 42 of the horizontal synchronizing signal which is reset by the vertical synchronizing signal. Then, the position in the horizontal direction is specified by the clock counter 43 which is reset by the horizontal synchronizing signal. The vertical decoder 44 and the horizontal decoder 45, which determine the display position based on the respective counter data, determine the timing of superimposing the superimposition signal on the video signal, and the superimposition processing unit 46 obtains the superimposed output video. The display positions of the vertical decoder 44 and the horizontal decoder 45 can be arbitrarily set from outside the video superimposing unit 15, or the display position information in which the comparison result of the comparing unit 13 is reflected in the signal generated by the signal generating unit 14. Is included, it is set by the position information extracted by the position determination circuit 47.

Next, one embodiment of the video information generated by the signal generator when paying attention to the pitch as each singing information is shown in FIG. 5 and FIG. 6 which are schematic diagrams showing screen display examples.

FIG. 5 shows an example in which an image in the shape of a note is displayed as a comparison result image with a pitch shift by the positional relationship on the screen. If the pitch deviation of each song is within the range of the reference value, the comparison result image is at the position c. When the pitch of the singer's song is higher than the reference value with respect to the pitch of the original song, the comparison result image is displayed at the position of a,
When the pitch of the singer's song is lower than the reference value with respect to the pitch of the original song, the comparison result image is displayed at the position of b.

When changing the display position of the comparison result image,
If the display position is changed stepwise from the current display position to the target display position, the display position changes smoothly, and the pitch shift direction is represented by the moving direction of the comparison result image, and the singer shifts the pitch shift. Easy to recognize. In this case, the display position may be determined by the vertical decoder 44 and the horizontal decoder 45 in FIG. 4 so that the display position is changed every fixed frame in the video signal. For example, in the embodiment of FIG. 5, when moving the display of the note indicating the comparison result between each of the points a, b, and c, the display is moved in the vertical direction of the screen. Position change in the video signal in every fixed frame, for example, 2
A position change for each frame and a fixed vertical position change, for example, a position change for 2h may be given to the displayed note. The same applies when the display position is changed in the horizontal direction. By performing such processing, the displayed image showing the comparison result visually shows continuous movement, and it becomes very easy to recognize the occurrence of the pitch deviation and the direction of the pitch deviation. .

As shown in FIG. 5, in the case where the comparison result is converted into the position and is expressed, when the comparison result that the pitch deviation is high is obtained, the display position is changed to the higher direction, and the pitch deviation is caused. When the comparison result of low is obtained, the display position change is changed to the lower direction, so the direction of the pitch shift and the direction of the display position change match, and it is easy to recognize the comparison result. There are advantages.

FIG. 6 shows an example in which a note-shaped image is displayed as a comparison result image by changing the color. The comparison result image is green when the pitch deviation is within the range of the reference value, but becomes red when the pitch of the singer's song is higher than the reference value with respect to the pitch of the original song, It is blue if the pitch of the singer's song is lower than the reference value with respect to the pitch of the song. In this case as well, when changing from the current color to the target color by changing the hue stepwise, the singer can easily recognize the pitch deviation direction, as in the case of displaying the positional relationship. At this time, in the signal generated by the signal generation unit 14, the video signal in the video superimposition processing unit 15 is changed every constant frame, for example, every two frames, and the constant hue change is performed, for example, a hue of three degrees with a color vector. You should make a change. By performing such processing, the displayed image showing the comparison result visually shows continuous movement, and it becomes very easy to recognize the occurrence of the pitch deviation and the direction of the pitch deviation. . As shown in FIG. 6, when the comparison result is converted into color and displayed, the display position of the comparison result does not change on the screen, so that the line of sight for confirming the display can be fixed, and the space of the superimposed image on the screen can be fixed. Has the advantage of being small.

In FIG. 5 and FIG. 6, the pitch deviation judgment is two judgments of whether it is high or low with respect to the reference value. It is also possible for the processing unit 15 to perform this.

Further, it is possible to display the difference in volume and the deviation in singing in the same manner as in the case of the deviation in pitch.
FIG. 7 shows an example in which a difference in sound volume is displayed, and FIG. 8 shows an example in which a shift in singing is displayed.

First, FIG. 7 showing the difference in volume will be described. The volume of the comparative singing is displayed as a multiple of the reference singing. At the position of × 1, the volume of the comparative song matches the volume of the reference song, but at the position of × 2, the volume is double, at the position of × 3, it is three times or more, and at the position of × 1/2, 1
It shows that the volume is / 2 times, and the volume is ⅓ or less at the position of ⅓. The reason why the display is limited with respect to the volume exceeding 3 times and 1/3 times is that there is infinite volume comparison data. The display is shown as a bar graph based on the position of ⅓. In the display example of FIG. 7, the comparative song has a volume of about 2.5 times that of the reference song. Note that the color representation is the same as in the case of FIG. 6 in which the pitch deviation is displayed by the difference in color, and the difference in the position of the tip of the bar graph in FIG. 7 may be replaced by the color and displayed.

Next, FIG. 8 showing the deviation in singing
Will be described. In the comparison unit 13, if the singing deviation is early, it is displayed at the position a, if the singing deviation is late, it is displayed at the position b, and if there is no singing deviation, it is displayed at the position c. In FIG. 8, the display appears at the position a, indicating that the singing was started earlier. The shape of the display is arbitrary, but in FIG. 8, it is in the shape of a musical note as in FIG. 5 when there is a pitch shift. Note that the color representation is the same as in the case of FIG. 6 in which the pitch deviation is displayed by the color difference, and the difference in the position of the note in FIG.

In the display examples shown in FIGS. 5 to 8 above,
The comparison result of the comparison unit 13 is converted into one of the shape, position, and color of the signal generated by the signal generation unit 14 and displayed. However, if there are a plurality of contents of the comparison result to be displayed, It suffices to allocate and display a plurality of elements such as the shape, position and color of the signal generated by the generation unit 14.

As described above, by displaying the difference in singing detection result in a specific video and giving the meaning of the pitch deviation to the display position and color, the singer can make a difference in the singing of the original song on the video to be monitored. You can clearly recognize the difference between your own singing and the image information such as lyrics telop, and you can practice singing from an objective point of view.

(Second Embodiment) A second embodiment of the display device of the present invention will be described with reference to FIG. FIG. 9 is a block diagram showing a second embodiment of the display device of the present invention.

In FIG. 9, reference numeral 91 is a reference song information detecting section for detecting the information of the reference song, 92 is a comparative song information detecting section for detecting the information of the comparative song, and 93 is a reference song information detecting section 91 and the comparative song information detecting section. The comparison unit that compares the detection results of the unit 92, 94 is the signal generation unit that determines the signal based on the comparison result obtained from the comparison unit 93, and 95 is the video superimposition processing unit that can superimpose the signal on the input video. The configuration is similar to that of FIG. 1 is different from the configuration of FIG.
9 is input to the reference song information detecting unit 91 and the comparative song information detecting unit 92 as shown in FIG. 9A, or the information indicating the extracting operation of the reference song extracting unit 96 is input to the input stage of FIG.
Is the point input to the comparison unit 93 as described above.

The operation of the display device configured as described above will be described below. As in the case of the first embodiment, the image generated by the signal generator 94 is determined by the difference in each song. Focusing on the medium in which the singing signal of the original song is recorded, for example, in analog sound of a sound disc of a laser disc, a monaural karaoke voice and an original song are recorded in the R channel and a monaural karaoke voice is recorded in the L channel. There is. In such a case, since it is necessary to extract only the singing signal of the original song, the L-channel signal as an accompaniment-only signal and the R-channel signal as a signal including the reference singing and accompaniment are input to the reference singing extraction unit 96. By inputting a signal, the reference singing extraction unit 96 takes out the reference singing and inputs the reference singing to the reference singing information detecting unit 91, as shown in FIG.

By the way, in the case where the monaural karaoke voice and the singing of the original song are recorded on the R channel and the monaural karaoke voice is recorded on the L channel as described above,
When the RL signal is obtained, this becomes the reference singing signal.
However, in the actual recording state, it is rare that the monaural karaoke voice is recorded in the L channel and the R channel with exactly the same amplitude, and it is necessary to adjust the amplitude of the L channel signal which is subtracted from the R channel signal. There is.

The operation of the reference song extractor in consideration of the above signal form will be described with reference to FIGS. 10 and 11.

FIG. 10 is a circuit diagram of the reference song extractor.
In FIG. 10, 101 is an amplitude adjustment circuit that obtains an output by multiplying the input by an amplitude coefficient, 102 is a phase comparison circuit,
Reference numeral 103 is an amplitude determination circuit, L is an L channel signal that is a signal only for accompaniment, and R is a signal that includes a reference song and an accompaniment.
A channel signal, 104 is a subtracter for subtracting the output signal of the amplitude adjusting circuit 101 from R.

FIG. 11 is a waveform diagram of RL 'and R. Here, L ′ is an L signal whose amplitude is adjusted by the amplitude adjusting circuit 101. First, when the signal after the amplitude coefficient is set to 1 by the amplitude adjusting circuit 101 is L ′, the subtractor 104 obtains RL ′, and the phase comparing circuit 102 obtains R and R−.
Phase comparison of L'is performed. If RL ′ in FIG. 11 is indicated by a solid line, the phase of RL ′ is the same as R, and RL ′
If is like a broken line, the opposite phase is determined. Then, the amplitude determination unit 103 determines the amplitude based on the phase relationship. If the phases of RL ′ and R are the same phase, then L> R, and if the phases are opposite, the relationship of L <R is determined. To be done. The result is fed back to the amplitude adjusting circuit 101, and if the amplitude coefficient is L> R, it is adjusted to less than 1, and if L <R, it is adjusted to be greater than 1. Then, the phase relationship between R-L 'and R is changed by changing the amplitude coefficient. In this state, the same processing as above is performed. As described above, if the RL 'is adjusted to be sufficiently smaller than the singing signal amplitude by adjusting the amplitude adjusting circuit 101 by repeating the above processing a certain number of times, the reference singing extraction processing is completed. However, when performing the above processing, it is a condition that the signal of the R channel does not include a singing signal. Considering the actual form of the song,
The intro part of the beginning of a song is almost always free of singing, and there is usually enough time to do the above process, and the detection of the beginning of a song is the case with a laser disc. If there is, it is possible by code information such as chapters. Therefore, it is possible to execute the process for extracting the song at the start point of the song, and there is no hindrance when practicing the song.

However, when the process for extracting the reference song is required, the reference song extracted by the reference song extracting unit 96 during the execution of the process includes the monaural karaoke voice. The detection of the reference song is unreliable because there is a possibility that a monaural karaoke voice is detected. Therefore, in such a case, it is meaningless that the reference song information detection unit 92 detects the information detection of the reference song and the comparison unit 93 performs the song comparison. Therefore, the operation information of the comparative song extracting unit 96 is input to the reference song information detecting unit 91 and the comparative song information detecting unit 92 in FIG. 9A, and is input to the comparing unit 93 in FIG. 9B. In FIG. 9A, the operation of the reference song information detection unit 91 and the comparison song information detection unit 92 is stopped, and in FIG. 9B, the operation of the comparison unit 93 is stopped. Can be prevented, which has the advantage of not informing the singer of incorrect comparison information.

The method of performing the stop processing as described above is as follows. As shown in FIG. 9A, when the information indicating the extraction operation of the reference song extraction unit 96 is input to the reference song information detection unit 91 and the comparison song information detection unit 92, the operation of the reference clock oscillator 26 in FIG. If stopped, the detection of singing information is stopped. Further, as shown in FIG. 9B, when the information indicating the extraction operation of the reference song extraction unit 96 is input to the comparison unit 93, if the operation of the operation control circuit 310 in FIG. To be done.

As described above, the point that the singing information is detected and the comparison result is displayed as a video is similar to the first embodiment, but the singing detection operation or the singing detection result comparison operation is performed as the reference singing extraction. By controlling by the operation of the unit, incorrect comparison information is not output on the screen. After including the action, the difference in the song detection result is displayed by a specific video,
By assigning a pitch shift to the display position and color, the singer can clearly recognize the difference between the singing of the original song and the singing of his / her own on the video to be monitored along with the video information such as the lyrics telop, etc. You can practice from an objective point of view.

(Embodiment 3) A third embodiment of the display device of the present invention will be described with reference to FIGS. FIG. 12 is a block diagram showing a third embodiment of the display device of the present invention, and FIG. 13 is a schematic diagram showing a first screen display example in the same embodiment of the present invention.

In FIG. 12, reference numeral 121 is a reference song information detecting section for detecting information on a reference song, 122 is a comparative song information detecting section for detecting information on a comparative song, and 123 is a reference song information detecting section 121 and a comparative song information detecting section. A comparison unit that compares the detection results of the unit 122, a signal generation unit 124 that determines a signal based on the comparison result obtained from the comparison unit 123, and a video superimposition processing unit 125 that can superimpose the signal on the input video. The configuration is similar to that of FIG. The difference from the configuration of FIG. 1 is that the storage unit 126 stores the result of the comparison unit 123, and the signal generation unit 124 determines the signal based on the comparison result 123 and the storage information 126.

The operation of the display device configured as described above will be described below. As in the case of the first embodiment, the signal generated by the signal generator 124 is determined by the difference in each song. In the first embodiment, the content of the signal generated by the signal generator 14 includes only the latest comparison result determined by the comparator 13. In this embodiment, the comparison result of the comparison unit 123 is stored in the storage unit 1.
26 stores the latest comparison result by the comparison unit 123 and the past comparison result stored in the storage unit 126, the signal generation unit 124 determines the signals according to the respective comparison results, and the signals are arranged in a line on the screen. They are arranged in a line.
In this case, the result by the comparison unit 123 is not always necessary.

For this reason, when the signal generator 124 determines the signal indicating the content of the stored information stored in the storage 126, for example, the order in which the signals are stored in the storage 126 from the right is a new comparison result. Add position information to the signal. The display position of the signal to which the position information is added is set by the image superimposition processing unit, and is superimposed on the video signal together with the latest comparison result determined by the comparison unit 123.

In this case, it is preferable that the display position is set so as not to overlap with the lyrics telop in the superimposed image. Further, the position information added to the signal may correspond to the arrangement of the storage area of the storage unit 126. For example, in a storage means such as a FIFO memory, since the position of a new comparison result is always fixed, it is easy to associate the position information. Further, when the storage unit 126 is a FIFO memory, since it has only a fixed amount of storage, old data is discarded every time the data is updated and the data is stored in the order closest to the latest comparison result. Since it is scrolled, there is an advantage that it is easy to see the result by following the progress of the song.

FIG. 13 is an example in which a note-shaped image is displayed in time series as a comparison result image in which the pitch deviation is the same as in FIG. The content of the comparison result is the same as in FIG. 5, and if the pitch deviation of each song is within the range of the reference value, the comparison result image is at the position c. When the pitch of the singer's singing is higher than the reference value with respect to the pitch of the singing of the original song, a comparison result image is displayed at the position a, and the pitch of the singing of the singer is compared with the pitch of the singing of the original song. If is lower than the reference value, the comparison result image is displayed at the position of b. Similar to FIG. 5, the latest comparison result of the comparison unit 123 is displayed at the position of t0, and the comparison results stored in the storage unit 126 are t-1, t-2, t-3, ... If it is displayed at the position of, the comparison result up to the present time can be confirmed in the output video of the video superimposition processing unit 125. Note that t-1, t-2, t-3, ...
The determination of the pitch deviation of the comparison result recorded in the storage unit 126 displayed at the position of ... Is the same as the latest comparison result 130 displayed at the position of t0. In the display example shown in FIG. 13, the comparison result of 130, 131, 134, and 135 is within the reference value, the comparison result of 132 is higher than the reference value, and the comparison result of 133 and 136 is lower than the reference value. This is the case.

FIG. 14 shows an example in which an image in the shape of a note is displayed as a comparison result image by changing the color, as in FIG. The content of the comparison result is the same as in FIG. 6, and the comparison result image is green when the pitch deviation is within the range of the reference value, but the pitch of the singer's song is the reference value with respect to the pitch of the original song. When the pitch is higher, it becomes red, and when the pitch of the singer's song is lower than the reference value with respect to the pitch of the original song, it becomes blue. Similar to FIG. 6, the latest comparison result of the comparison unit 123 is displayed at the position of t0, and the comparison results stored in the storage unit 126 are t-1, t-2, t-3, ... If it is displayed at the position of, the comparison result up to the present time can be confirmed in the output video of the video superimposition processing unit 125. Note that t-1, t-
The pitch deviation of the comparison result recorded in the storage unit 126 displayed at positions 2, t-3, ... Is t0.
Is the same as the latest comparison result 140. In the display example shown in FIG. 14, the comparison result of 140, 141, 144, and 145 is within the reference value, the comparison result of 142 is higher than the reference value, and the comparison result of 143 and 146 is lower than the reference value. This is the case.

In both cases of FIG. 13 and FIG.
Each time the comparison result of the comparison unit 123 is updated and displayed at the position of t0, t0 → t-1, t-1 → t-2, t-2 → t−.
The display position of the comparison result is changed in the order of 3, t-3 → t-4, .... The storage state of the comparison result in the storage unit at this time will be described with reference to FIG. When storing new data, that is, the previous comparison result t0 in the storage unit, the data is shifted to provide a location for storing the previous comparison result. That is, in FIG. 15, all the data of t-n are stored in the place of t- (n + 1). After the processing is completed, t0 is stored in t-1.
In this way, each time the comparison result of the comparison unit 123 is displayed at the position of t0, the storage unit of the storage unit 126 is updated. In this way, in the method of moving the storage location of the stored data each time new data is stored, the relationship between the display position of the data and the location of the storage location does not change, so the signal generating unit 124 Display position Storage unit 1
Since it suffices to pay attention only to the storage location of the data in 26, there is an advantage that the control of the signal generation section 124 from the storage section 126 becomes simple.

As described above, displaying the difference in the singing detection results by a specific video and giving the meaning of the singing detection result to the display position and color is the same as in the first embodiment. By storing the information and displaying the stored information as a video, the singer can clearly recognize the difference in the singing of the original song and the difference between the singing and the singing of the song by the output video along with a temporal transition. Therefore, in the first embodiment in which only the latest singing difference can be recognized, the transition of the singing difference depends on the memory of the singer, but in this embodiment, the singing difference is displayed on the output video screen from the viewpoint of time. Therefore, when the song practice is repeatedly performed, the points of the practice can be clearly recognized, and the song practice can be effectively performed.

(Embodiment 4) A fourth embodiment of the display device of the present invention will be described with reference to FIGS. FIG. 16 is a block diagram showing a fourth embodiment of the display device of the present invention, and FIG. 17 is a schematic diagram showing a screen display example in the same embodiment of the present invention.

A fourth embodiment of the present invention having a progress information extraction unit will be described below with reference to FIGS. 16 and 17.

FIG. 16 is a block diagram of a display device showing a fourth embodiment of the present invention. In FIG. 16, 161 is a reference song information detection unit that detects information of a reference song, 162 is a comparison song information detection unit that detects information of a comparative song, and 163 is a reference song information detection unit 161 and a comparison song information detection unit 162. A comparison unit that compares the detection results, 164 is a signal generation unit that determines a signal based on the comparison result obtained from the comparison unit 163, and 1
Reference numeral 65 denotes an image superimposing processing unit capable of superimposing a signal on an input image, which has the same configuration as that of FIG. The difference from the configuration of FIG. 1 is that there is a progress information extraction unit 166 that extracts the progress information of the reference singing voice signal from the video signal,
The progress information extraction unit 166 is that the progress information is extracted by specifying the color change of the lyrics telop in the video signal input to the video superimposition processing unit 165, and the extracted progress information is input to the signal generation unit 164.

The operation of the display device configured as described above will be described below. As in the case of the first embodiment, the signal generated by the signal generator 164 is determined by the difference in each song. The difference from the first embodiment is that the comparison result of the comparison unit 163 in the signal generated by the signal generation unit 164 is not the display position of the signal generated by the signal generation unit 164, but the signal generated by the signal generation unit 164. This is the point included in the shape.

Further, in the third embodiment, the comparison result is displayed by paying attention to only the time transition, whereas in the present embodiment shown in FIG. 16, the video signal displaying the lyrics telop in different colors as the song progresses. When there is, the progress information extraction unit 166 extracts the color change of the lyrics telop and displays the comparison result together with the color change of the lyrics telop, which has the advantage that the comparison result of the singing and the contrast of the lyrics can be clearly recognized. There is.

FIG. 17 is a schematic diagram of an embodiment in which the comparison result obtained by the comparison unit 163 is compared with the lyrics telop on the video signal and output on the output screen. Regarding the content of the comparison result, if the pitch deviation of each song is within the range of the reference value, the comparison result image is a circle. In FIG. 17, the displays of 1701, 1702, 1707, and 1708 correspond. When the pitch of the singer's song is higher than the reference value with respect to the pitch of the original song, the comparison result image is an upward arrow. In FIG. 17, 1703 and 1
The displays of 704 and 1709 correspond. When the pitch of the singer's song is lower than the reference value with respect to the pitch of the original song, the comparison result image is a downward arrow. In FIG. 17, the displays of 1705, 1706, and 1710 correspond. Reference song information detector 161 and comparative song information detector 1
Similar to the first embodiment, the comparison unit 163 determines the comparison result based on the song detection result of 62. And
When the comparison result of the comparison unit 163 is confirmed, the progress information extraction unit 166 identifies the progress based on the location where the color change of the extracted current lyrics telop is progressing, and the signal generation unit 164 uses the progress information to identify the progress of the lyrics telop. The signal is determined so that the place where the color change is progressing and the comparison result of the comparison unit 163 are compared on the output screen. Further, when the progress of the lyrics telop being displayed is finished, the lyrics telop is cleared and the next lyrics telop appears, the signal generation unit 1
64 clears the generated signal and prepares for the next comparison result display.

If the comparison result image once displayed on the screen is kept at that position until the lyrics telop contrasted with the comparison result image is cleared, if the signal generation unit 164 holds the generated signal, the comparison result image is compared. It is not necessary to particularly memorize the result and lyrics progress information. This point is different from the third embodiment, and means for storing the comparison result is not necessary.

As described above, displaying the difference in the song detection results by a specific video and giving the meaning of the song detection result to the display is the same as in the first embodiment, but the comparison result is compared with the lyrics. By displaying the image as the contrast while clarifying the contrast, the singer can clearly recognize the difference in the singing of the original song and the difference in the singing of the song with the progression of the lyrics by the output image. Therefore, in the first embodiment in which only the latest singing difference can be recognized, the transition of the singing difference depends only on the memory of the singer, but in this embodiment, the difference in singing is output from the viewpoint of comparison with lyrics. Since it can be recognized on the screen, the point of the practice can be clearly recognized when the song practice is repeatedly performed, and the song practice can be effectively performed.

[0076]

As described above, according to the present invention, the standard singing information detecting section, the comparative singing information detecting section, the comparing section, the signal generating section, and the image superposition processing section are provided so that the singer can monitor. Since the difference between the singer's singing and the reference singing can be monitored simultaneously as video information on the screen, the singing person can objectively understand the difference in singing and can practice the song effectively. It is possible to realize to provide an excellent display.

[Brief description of drawings]

FIG. 1 is a block diagram showing a first embodiment of a display device of the present invention.

FIG. 2 is a circuit diagram of a song information detection unit in the same embodiment.

FIG. 3 is a circuit diagram of a comparison unit in the same embodiment.

FIG. 4 is a circuit diagram of a video superimposition processing unit in the embodiment.

FIG. 5 is a schematic diagram showing a first screen display example in the embodiment.

FIG. 6 is a schematic diagram showing a second screen display example in the embodiment.

FIG. 7 is a schematic diagram showing a third screen display example in the same embodiment.

FIG. 8 is a schematic diagram showing a fourth screen display example in the same embodiment.

FIG. 9A is a first block diagram of a second embodiment of the display device of the present invention, and FIG. 9B is a second block diagram of the second embodiment of the display device of the present invention.

FIG. 10 is a circuit configuration diagram of a comparative song extraction unit in the same embodiment.

FIG. 11 is a waveform diagram in the example.

FIG. 12 is a block diagram of a display device according to a third embodiment of the invention.

FIG. 13 is a schematic diagram showing a first screen display example in the embodiment.

FIG. 14 is a schematic diagram showing a second screen display example in the embodiment.

FIG. 15 is a diagram showing a storage processing operation of a storage section in the embodiment.

FIG. 16 is a block diagram of a display device according to a fourth embodiment of the present invention.

FIG. 17 is a schematic diagram showing a screen display example in the embodiment.

FIG. 18 is a block diagram showing a conventional singing signal control circuit.

[Explanation of symbols]

 11 Reference Singing Information Detecting Section 12 Comparative Singing Information Detecting Section 13 Comparison Section 14 Signal Generating Section 15 Video Superimposition Processing Section 91 Reference Singing Information Detecting Section 92 Comparative Singing Information Detecting Section 93 Comparing Section 94 Signal Generating Section 95 Video Superimposition Processing Section 96 Comparison Singing extraction unit 121 Reference song information detection unit 122 Comparative song information detection unit 123 Comparison unit 124 Signal generation unit 125 Image superimposition processing unit 126 Storage unit 161 Reference song information detection unit 162 Comparative song information detection unit 163 Comparison unit 164 Signal generation unit 165 Video superimposition processing unit 166 Progress information extraction unit

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Kenji Muraki 1006 Kadoma, Kadoma City, Osaka Prefecture Matsushita Electric Industrial Co., Ltd.

Claims (38)

[Claims] 1. A reference singing information detecting means for detecting information of a reference singing voice signal, a comparison singing information detecting means for detecting information of a comparative singing voice signal, the reference singing information detecting means and the comparison at fixed time intervals. Comparing means for comparing the detection results of the singing information detecting means, signal generating means for determining a signal according to the result of the comparing means, and video processing for superimposing the signal generated by the signal generating means on the video signal input from the outside. A display device comprising means. 2. The display device according to claim 1, wherein the comparison unit executes the comparison operation when the detection results of the reference song information detection unit and the comparison song information detection unit are obtained at the same time. 3. The comparison means, when the detection results of the reference singing information detecting means and the comparison singing information detecting means are equal to or more than a certain number of times at which the comparison means performs the comparison, a comparison result at every certain time. The display device according to claim 1, wherein 4. The comparison means, when a plurality of comparison results are obtained in a certain time during which the comparison means performs the comparison, an average value of the obtained plurality of comparison results is set as a comparison result in the certain time. The display device according to claim 1. 5. The signal generating means retains the signal generated until the signal to be generated next is determined when the signal to be generated is determined, and when the comparison means determines the comparison result, the comparison result of the comparison means is displayed. The display device according to claim 1, wherein the signal is updated to a suitable content. 6. The display device according to claim 1, wherein the reference song information detecting means and the comparative song information detecting means detect the pitch of the input song. 7. The display device according to claim 1, wherein the reference song information detecting means and the comparative song information detecting means perform detection on an input song signal having a certain amplitude or more. 8. The display device according to claim 1, wherein the signal generating means specifies any one of the shape, position and color of the generated signal according to the comparison result of the comparing means. . 9. The signal generating means, when changing the position of the signal superimposed by the video signal processing means, adds a constant position change amount for every constant frame in the video signal input to the video signal processing means. The display device according to claim 1, wherein the display device is a display device. 10. The signal generating means, when changing the color of the signal superimposed by the video signal processing means, adds a constant hue change amount for each constant frame in the video signal input to the video signal processing means. The display device according to claim 1, wherein the display device is a display device. 11. A singing extraction means for extracting a reference singing voice signal from a voice including a reference singing voice signal, a reference singing information detecting means for detecting information of the reference singing voice signal, and information of a comparative singing voice signal. Comparative singing information detection means,
Comparing means for comparing the detection results of the reference song information detecting means and the comparative song information detecting means at regular time intervals,
A signal for inputting the signal generated by the signal generating means to the image processing means, the signal generating means for determining the signal based on the result of the comparing means, and the image processing means for superimposing the signal on the image signal input from the outside. A display device characterized by the following. 12. The display device according to claim 11, wherein the comparison unit executes the comparison operation when the detection results of the reference song information detection unit and the comparison song information detection unit are obtained at the same time. 13. The comparison means, when the detection results of the reference singing information detecting means and the comparison singing information detecting means are equal to or more than a certain number of times at a certain time period during which the comparison means performs the comparison, the comparison result at every certain time period. 12. The display device according to claim 11, characterized in that 14. The comparison means, when a plurality of comparison results are obtained in a fixed time period during which the comparison means performs the comparison, an average value of the plurality of obtained comparison results is used as a comparison result in the constant time. The display device according to claim 11. 15. The signal generating means holds a signal to be generated until a signal to be generated next is determined when the signal to be generated is determined, and when the comparison means determines the comparison result, the comparison result of the comparison means is stored. The display device according to claim 11, wherein the signal is updated to match the contents. 16. The display device according to claim 11, wherein the reference song information detecting means and the comparative song information detecting means detect the pitch of the input song. 17. The display device according to claim 11, wherein the reference song information detecting means and the comparative song information detecting means perform detection with respect to an input song signal having a certain amplitude or more. 18. The display device according to claim 11, wherein the signal generating means specifies any one of a shape, a position and a color of the generated signal according to a comparison result of the comparing means. . 19. The signal generating means, when changing the position of the signal superimposed by the video signal processing means, adds a constant position change amount for every constant frame in the video signal input to the video signal processing means. Claim 1 characterized by
The display device according to 1. 20. The signal generating means, when changing the color of the signal superimposed by the video signal processing means, adds a constant hue change amount for each constant frame in the video signal input to the video signal processing means. Claim 11 characterized by
Display device according to. 21. The display device according to claim 11, wherein the comparison operation of the comparison means is stopped when the song extraction means has not finalized the song extraction. 22. The display device according to claim 11, wherein the detection operations of the reference song detection means and the comparative song detection means are stopped when the song extraction means has not finalized the song extraction. 23. A reference singing information detecting means for detecting information of a reference singing voice signal, a comparison singing information detecting means for detecting information of a comparative singing voice signal, and the comparison with the reference singing information detecting means at regular time intervals. A comparing means for comparing the detection results of the singing information detecting means, a storing means for storing the result of the comparing means, a signal generating means for determining a signal based on the result of the comparing means and the stored information of the storing means, and from the outside. A display device comprising video processing means for superimposing a signal on an input video signal, wherein the signal generated by the signal generating means is a signal to be input to the video processing means. 24. The display device according to claim 23, wherein the comparison unit executes the comparison operation when the detection results of the reference song information detection unit and the comparison song information detection unit are obtained at the same time. 25. The comparison means, when the detection results of the reference singing information detection means and the comparison singing information detection means are equal to or more than a certain number at every certain time period when the comparison means performs the comparison, the comparison result at every certain time period. The display device according to claim 23, characterized in that 26. The comparison means is characterized in that, when a plurality of comparison results are obtained in a fixed time period during which the comparison means performs the comparison, an average value of the plurality of obtained comparison results is set as the comparison result in the constant time. The display device according to claim 23. 27. When the signal to be generated is determined, the signal generating means holds the signal to be generated until the signal to be generated next is determined, and when the comparison means determines the comparison result, the comparison result of the comparison means is stored. 24. The display device according to claim 23, wherein the signal is updated to match the contents. 28. The display device according to claim 23, wherein the reference song information detecting means and the comparative song information detecting means detect the pitch of the input song. 29. The display device according to claim 23, wherein the reference song information detecting means and the comparative song information detecting means perform detection on an input song signal having a certain amplitude or more. 30. The signal generating means, when determining the signal indicating the content of the stored information stored in the storage means, has position information such that the signals are arranged in a specific direction in the order stored in the storage means. The display device according to claim 23, wherein: 31. A progress information extracting means for extracting progress information of the reference singing voice signal from a video signal including progress information of the reference singing voice signal, and a reference singing information detecting means for detecting information of the reference singing voice signal. Comparative singing information detecting means for detecting information of a singing voice signal, comparing means for comparing detection results of the reference singing information detecting means and the comparative singing information detecting means at regular time intervals, and signal generation for determining an arbitrary signal And a video processing means for superimposing a signal on a video signal input from the outside, wherein the signal generating means determines an output signal based on the progress information extraction result of the progress information extracting means and the result of the comparing means, The image processing means,
A display device, wherein a video signal including the output signal of the signal generating means and the progress information of the reference singing voice signal is used as an input signal. 32. The display device according to claim 31, wherein the comparison unit executes the comparison operation when the detection results of the reference song information detection unit and the comparison song information detection unit are obtained at the same time. 33. The comparison means, when the comparison results of the reference singing information detecting means and the comparison singing information detecting means are equal to or more than a constant number of times at which the comparison means performs the comparison, the comparison result at each constant time. 32. The display device according to claim 31, characterized in that 34. The comparison means, when a plurality of comparison results are obtained in a fixed time period during which the comparison means executes the comparison, an average value of the plurality of obtained comparison results is used as a comparison result in the constant time. The display device according to claim 31. 35. When the signal to be generated is determined, the signal generating means holds the signal to be generated until the next signal to be generated is determined, and when the comparison means determines the comparison result, the comparison result of the comparison means is displayed. The display device according to claim 31, wherein the signal is updated to match the contents. 36. The display device according to claim 31, wherein the reference song information detecting means and the comparative song information detecting means detect the pitch of the input song. 37. The display device according to claim 31, wherein the reference song information detecting means and the comparative song information detecting means perform detection with respect to an input song signal having a certain amplitude or more. 38. The display device according to claim 31, wherein the progress information detecting means identifies the progress by detecting a change in color of an image showing the progress information.