JP2007156330A - Karaoke device with compatibility determination function - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a karaoke device with a compatibility determination function that can determine compatibility such as cooperation and harmony between a plurality of singers when they sing together and display a determination result with scores, characters, pictures, etc. <P>SOLUTION: A karaoke device body 15 displays a background image and a lyrics telop on a TV monitor 12 while playing selected music. Pitches, rhythms, and loudness as featured parts of voices input from the singers 23 and 24 are extracted, their compatibility is determined from how much waveforms of both the singers match each other, and contents showing whether they are compatible with each other are displayed on the TV monitor 12. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a karaoke apparatus having a function of judging and displaying compatibility of two people from the characteristics of their voices, singing characteristics, and the like when singing karaoke with a duet, for example.

There has been a karaoke apparatus equipped with a function for scoring the singing ability of a ugly person, and when a duet song is sung by a plurality of people, a device for scoring it is proposed.
Patent Document 1 is a karaoke apparatus having a function capable of scoring duet music.
This proposal solves the shortcoming that each person's singing voice cannot be properly evaluated because the signal mixed with the singing voice input from multiple microphones is compared with the reference of the vocal part. The feature is that each person's singing voice is legitimately evaluated and an accurate scoring result can be obtained.
JP 2000-330580 A

  Therefore, in a conventional karaoke device that can score duet singing, the average result of two people is scored and evaluated, and each person sings to the guide melody individually, and how much faithful they sing. It was a comprehensive evaluation of singing ability and judgment of each person's ability, badness, etc. The traditional method of scoring duet singing is not important for the combination of the two, and even if the two singing is in sigh, the overall singing ability and individual singing ability are scored, The scoring content was difficult to understand and lacked excitement.

In addition, when attention is paid to compatibility, there is a karaoke device that has the function of entering blood type, constellation, etc., but it is based on blood type, constellation, not about song compatibility. .
The present invention has been made in view of the above situation, and its purpose is to determine compatibility of a plurality of people, such as coordination and breathing, when singing with a plurality of ugly hands, and to obtain a determination result score or letter, An object of the present invention is to provide a karaoke apparatus with a compatibility determination function that can be displayed with a picture or the like.

In order to achieve the above object, claim 1 of the present invention is directed to voice input means for inputting voices of two or more cradle hands, music performance control means for playing music, and the voice according to the melody of the music. Pitch / rhythm difference and sound volume measuring means for measuring the volume of each cradle as well as the pitch / rhythm difference of the speech between two or more crawls input from the input means, and the pitch rhythm difference of the speech between each crawl And a compatibility judgment means for judging the compatibility of two or more crawlers based on the difference in volume measured by each cradle, And scoring means for scoring a specific performance range.
According to a second aspect of the present invention, in the first aspect of the invention, the pitch rhythm difference and volume measuring means further measures a pitch rhythm difference between the melody of the music and the voice of each ugly hand. The compatibility determining means further compares the pitch / rhythm difference between the melody of the music and the sound of each ugly hand with a predetermined value.
According to a third aspect of the present invention, in the first aspect of the present invention, the compatibility determination means obtains a pitch rhythm difference and a volume difference between voices input by two or more crawlers at predetermined time intervals, and When the pitch rhythm difference and the volume difference are in a range that is recognized as matching, each has a counting means that counts +1 every predetermined time, and the scoring means counts the count values by the counting means, The total value is scored as a score, or the result is displayed in characters or pictures.
According to a fourth aspect of the present invention, in the invention according to the second aspect, the compatibility determination means includes a pitch rhythm difference between voices input by two or more cradle hands, a melody of the music piece, and voices of the ugly hands. A pitch / rhythm difference and a volume difference between the two are obtained every predetermined time, and when the difference between the pitch / rhythm difference and the volume is within a range that is recognized as a match, a count that counts +1 for each predetermined time And the scoring means sums up the count values obtained by the counting means, and scores the summed values as scores, or displays the results as characters or pictures.
According to a fifth aspect of the present invention, in the first, second, third, or fourth aspect of the invention, the compatibility judging means recognizes that the compatibility is matched during the compatibility diagnosis, and matches the position or compatibility in which the count is added. It is characterized by having a display control means for displaying a character or a picture that means that the compatibility is matched on the screen at a position where it is not counted, or a character or a picture that means that the compatibility is not matched.

  According to the above configuration, it is not an absolute evaluation such as scoring, but it is possible to analyze and judge, for example, the relationship between the characteristics of two people and to evaluate each other's cooperation and breathing condition. Because the relationship between the two singing methods is a point, it is possible to increase the chances of singing while taking important communication in a duet, making it possible to enjoy regardless of the ability of singing ability.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a diagram showing an outline of a karaoke apparatus with a compatibility determination duet function according to the present invention.
The scolding hands 23 and 24 are duets, each holding a microphone 14a and 14b, singing a song by accompaniment of the music, and the singing voice is output from the speaker 13. The karaoke apparatus main body 15 transmits the lyrics telop 22 together with the background image 21 to the TV monitor 12, and the background image 21 and the lyrics telop 22 are displayed on the TV monitor 12.
The karaoke device 15 extracts the pitch, rhythm and volume, which are the features of the voice input from each ugly hand, and performs a compatibility diagnosis based on how well these waveforms match between them. The contents are displayed on the TV monitor 12.

FIG. 2 is a block diagram showing an embodiment of a circuit of a karaoke apparatus with a compatibility judgment duet function according to the present invention, and FIG. 3 is a diagram for explaining functional blocks of a CPU.
The karaoke apparatus main body 15 has an operation unit 20 on the front surface, and is connected to a TV monitor (CRT) 12, a speaker 13, and microphones 14a and 14b. The internal circuit of the main body 15 includes a CPU 1, work RAM 2, video RAM 3, VDP (video display processor) 4, DSP (digital signal processor) 5, phoneme data storage 6, D / A converter 7, A / D The converter 8, the HDD controller 9, the HDD 10, and the system bus 11 are included.

The voice of the ugly hand inputted from the microphones 14a and 14b is converted into a digital voice signal by the A / D converter 8. The DSP 5 reproduces the music data into a digital music waveform signal, adds the effect and sends it to the D / A converter 7, and adds an effect such as echo to the digital audio signal from the microphones 14 a and 14 b to the D / A converter 7. The D / A converter 7 converts the digital music waveform signal and the digital audio signal into analog signals and outputs them from the speaker 13. The digital audio signals from the microphones 14a and 14b are sent to the CPU 1, and the CPU 1 extracts the characteristic portion and performs processing for compatibility diagnosis.
The HDD controller 9 controls writing and reading of the HDD 10 based on commands from the CPU 1. The HDD 10 stores a large number of music data including duet music, lyrics telop data corresponding to each music, and video data such as a background image.

  The CPU 1 reads out a control program (not shown) stored in the HDD 10 and executes it to control the entire karaoke apparatus. The CPU 1 reads the music data from the HDD 10 according to the performance start operation of the selected music and reproduces it into the digital music waveform signal by the DSP 5, and the melody from the speaker 13 together with the audio signals input from the microphones 14a and 14b as described above. And output audio. Further, as functional units directly related to the present invention, the performance control unit 1a, pitch / rhythm difference and volume measurement unit 1b, compatibility judgment / display control unit 1c, scoring processing unit 1d, and scoring result display unit 1e are provided. Yes.

The performance controller 1a reads the selected music from the HDD 10, plays the music on the DSP 5, and displays the lyrics and the background image on the CRT 12 by the VDP 4.
The pitch / rhythm difference and volume measuring unit 1b extracts a waveform component indicating a pitch rhythm and a waveform component indicating a volume, which are characteristic portions of two voices input from the microphone 14a and the microphone 14b. Then, the difference in pitch (pitch) between the voices of the two people, the difference in pitch between the voices of the two people and the guide melody, the difference in the accent (rhythm) of the voices of the two people, and the volume of the two people are obtained. This measurement is performed at predetermined time intervals, for example, every 80 ms.

The compatibility determination / display control unit 1c determines the pitch difference between the two voices, the pitch difference between the two voices and the guide melody, and the accent (rhythm) of the two voices. The difference of the means for comparing) is compared with predetermined values E, F, G, respectively, and the pitch difference between the two voices and the pitch difference between the two voices and the guide melody are compared with the predetermined values E, If it is smaller than G, it is judged that the compatibility is good, and each count is incremented by +1. As for the difference in accent between the two voices, the two voices are different on the condition that the pitch difference between the two voices is smaller than a predetermined value E. If the pitch difference between one of the voices and the guide melody is smaller than the predetermined value F, it is determined that the compatibility is good and the count is incremented by one.
Also, the pitch difference between the two voices and the pitch difference between the two voices and the guide melody are smaller than the predetermined values E and F, and the compatibility is good, and the accent difference between the two voices is the predetermined value. If it is smaller than H, the count is further incremented by one.
Similarly, if the difference in volume between the two persons, that is, the volume change is in the same direction (increase or decrease), it is determined that the compatibility is good and the count is incremented by one. Even if the volume changes in a different direction or only one, it is not counted. In addition, if the count value is increased to a certain value or more at predetermined time intervals (for example, 20 seconds) after counting in this way, a phrase indicating that the compatibility is met during the duet is a part of the TV monitor 12. Can be displayed.

The scoring processing unit 1d uses the determination result of the compatibility determination / display control unit 1c as a score counted for one song or a specific performance range, and determines whether or not the score is greater than a predetermined value. "Scoring is not good".
It is possible to select in the process of initial music selection whether the evaluation is scored for the entire music or only a specific range of the music is selected.
The scoring result display unit 1e displays the result of the scoring processing unit 1d on the TV monitor 12.
The work RAM 2 is used as a work area when the CPU 1 performs the four rules, function calculations, logical calculations, and the like, and also holds temporary data.

  VDP 4 is a video display processor for displaying lyrics telop and graphics (CG). Image data is developed in the video RAM 3 by a command sent from the CPU 1, and a background image and lyrics telop are sent to the TV monitor (CRT) 12. On the TV monitor 12, a telop and a background image that change color are displayed.

FIG. 4 is a flowchart for explaining the flow of duet scoring.
In the standby state (step (hereinafter referred to as “S”) 01), the CPU 1 monitors whether or not an input for duet scoring has been made on the operation unit 20 (S02). When a duet scoring is input, the display unit 15a provided on the front surface of the karaoke apparatus main body 15 is turned on to indicate that the duet scoring is in progress (S03). In addition, a message to that effect is also displayed on a part of the TV monitor 12.
Next, it is monitored whether or not there is a song request (S04). If a song is selected, it is monitored whether or not a performance start operation for the song has been performed (S05).

When a performance start operation is performed, the selected music flows and a lyrics telop is displayed on the TV monitor 12 to change the color of the telop word to be sung. According to this telop display, the two ugly hands sing a song.
In the karaoke apparatus, a duet scoring process is performed (S06). When the duet scoring process ends, the CPU 1 determines whether or not an operation for canceling the duet scoring has been performed (S07). If there is a duet scoring cancel input, a duet scoring end process is performed (S08), and the process returns to the monitoring step of whether there is a duet scoring input (S02).

FIG. 5 is a flowchart showing details of duet scoring display processing.
When the performance is started, the CPU 1 extracts pitch rhythm and volume waveform components from the voices input from the microphones 14a and 14b (S061, S062).
The MIDI guide melody and the pitch of each voice are compared to measure how much the pitch differs from the guide melody. Then, the difference in the sound pitch between the two is also measured, and the difference in the volume waveform component between the two is also measured (S063, S064).
Next, the pitch difference between the two voices, the difference between the pitches of the guide melody and the respective pitches, and the accent difference are compared with respective predetermined values E, F, G, H, and the volume change between the two is further compared. If it is smaller than the predetermined values E and G, respectively, it is determined that the compatibility is good if it is smaller than the predetermined value E and smaller than the predetermined value F, further smaller than the predetermined values E and F, and smaller than the predetermined value H. . If the volume change is in the same direction, it is determined that the compatibility is good. In cases other than these, the compatibility is judged to be not good (S065).

If it is determined that the pitch (pitch) and the accent (rhythm) are compatible at every fixed time interval, +1 is counted. Similarly, if the volume is determined to be compatible at every fixed time interval, +1 is set. Count (S066). Then, when the added value of the count becomes a certain value or more every predetermined time interval (for example, 20 seconds), a phrase or a picture (see FIG. 8) indicating compatibility is displayed on the TV monitor 12 (S067). ).
In this way, the compatibility determination is advanced, and it is then determined whether or not the performance is finished (S068). If it is not the end of the performance, the process returns to S061 and S062, the component indicating the pitch rhythm and the component indicating the volume of the duet sound are extracted, and the compatibility determination step is repeated.

  Then, when the performance of the music is finished, the predetermined number for determining the duet scoring is compared with the count value counted in S066 (the count value determined every 80 ms and added when the compatibility is good), The compatibility is judged based on the size (S069). Based on the scoring result, characters and pictures such as “compatible” and “not compatible” are displayed on the TV monitor 12 (S070).

FIG. 6 is a diagram for explaining an example of a duet scoring method.
The compatibility determination / display control unit 1c has the compatibility determination criteria (1) to (6), and when the criteria are met, the score +1 is counted.
(1). If the difference between the pitches of the voices input from the microphone 1 and the microphone 2 is within ½ of the semitone (predetermined value E), +1 is counted.
(2). When the condition of (1) is satisfied and the difference in pitch between the microphone 1 and the microphone 2 with respect to the MIDI guide melody is within ½ of the semitone (predetermined value F), +1 is counted.
(3). When the accent positions of the microphone 1 and the microphone 2 match (within a predetermined value G), +1 is counted.
(4). When the condition (2) is satisfied and the accent of either microphone 1 or microphone 2 matches the MIDI guide melody (within a predetermined value H), +1 is counted.
(5). If there is a place where the volume of both microphone 1 and microphone 2 is increased, +1 is counted.
(6). If there is a place where the volume of both microphone 1 and microphone 2 is reduced, +1 is counted.

FIG. 7A is a diagram illustrating a specific waveform example of a duet sound, and is a diagram for explaining a method of measuring a difference between a pitch and an accent.
The horizontal axis represents time and is divided at predetermined time intervals t. The vertical axis indicates the pitch level of the microphone input. For ease of explanation, the waveforms of the microphone input 1 and the microphone input 2 are schematically shown in a rectangular shape by taking the average value of the waveform components at regular intervals. The contents determined in this example are the above (1) and (3).
At time t between times T ₁ and T ₂ , the difference between the pitches of microphone 1 and microphone 2 is within ½, so score +1 is counted, and the pitches of microphone 1 and microphone 2 are counted between other times. Since the difference is 1/2 or more, it is not counted. Since the accent positions of the microphone 1 and the microphone 2 coincide with each other at the time T ₃ (within the predetermined value H), the score +1 is counted, and the accent position is outside the range of the predetermined value H at other times. Not counted.

FIG. 7B is a diagram illustrating a specific waveform example of a duet sound, and is a diagram for explaining a method of measuring a difference in volume (direction of volume change) between the two.
The horizontal axis is the same as that in FIG. 7A, the vertical axis indicates the volume level, and the waveform is schematically shown. At time T ₂ , the volume of both microphone 1 and microphone 2 increases, and at time T ₃ and T ₄ , the volume decreases. Therefore, score +1 is counted.
At time T ₁ , the volume level of the microphone 1 is increased, but since the volume level of the microphone 2 is not changed, no score is counted.

  In the above embodiment, the count is +1 if the compatibility is good compared to the reference value set in advance at each time interval, and the compatibility is good as the judgment of each part during the duet. An example is shown in which the compatibility is judged comprehensively based on whether or not the total count value is larger than the scoring judgment count value set in advance when the performance is finished. There are various time intervals as measurement units of (pitch) / accent (rhythm) and volume, and the same effect can be obtained even when measuring at time intervals other than the embodiment.

  Moreover, although the case where it performed by a duet was demonstrated, the compatibility diagnosis can be performed by performing the same process also when singing by three or more persons. For example, in the case of three people, the difference in accent / pitch and volume between the first and second cradle, between the second and third cradle, and between the third and first cradle The compatibility can be determined by obtaining and comparing the largest difference among these combinations with a predetermined value.

  This is a karaoke apparatus having a function capable of making a compatibility determination by detecting whether or not a characteristic part of sound between a plurality of scolding hands is matched.

It is a figure which shows the outline of the karaoke apparatus with a compatibility judgment function by this invention. It is a block diagram which shows embodiment of the circuit of the karaoke apparatus with a compatibility judgment function by this invention. It is a figure for demonstrating the functional block of CPU. It is a flowchart for demonstrating the flow of a duet scoring. It is a flowchart which shows the detail of a duet scoring display process. It is a figure for demonstrating an example of the determination method of the score of a duet scoring. It is a figure which shows the example of a specific waveform of a duet sound, and is a figure for demonstrating the method to measure the difference of a pitch and an accent. It is a figure which shows the example of a specific waveform of a duet sound, and is a figure for demonstrating the method to measure the difference of both volume. It is a figure which shows an example of the character and picture which show that compatibility with TV monitor is good.

Explanation of symbols

1 CPU
2 Work RAM
3 Video RAM
4 VDP (Video Display Processor Lyrics / CG)
5 DSP (digital signal processor music playback / voice recognition)
6 Phoneme data storage unit 7 D / A converter 8 A / D converter 9 HDD controller 10 HDD (music data / telop data / video data)
11 System bus 12 CRT (TV monitor)
13 Speaker 14a, 14b Microphone 15 Karaoke device body 23
24 Blue Hand B

Claims (5)

Voice input means for inputting the voices of two or more ugly hands,
Music performance control means for playing music;
Pitch and rhythm difference and volume measuring means for measuring the volume of each ugly hand together with the difference in pitch and rhythm of the voice between two or more crammed hands input from the voice input means according to the melody of the music;
A compatibility judgment means for comparing the pitch and rhythm difference of the sound between each of the crawls with a predetermined value, and judging the compatibility of two or more crawls based on the difference in the volume measured by each crawl;
Scoring means for scoring the judgment result by the compatibility judgment means for one song or a specific performance range;
A karaoke apparatus with a compatibility judgment function characterized by comprising:   The pitch rhythm difference and volume measuring means further measures a pitch rhythm difference between the melody of the music and the sound of each ugly hand, and the compatibility determining means further includes the melody of the music. 2. The karaoke apparatus with a compatibility judgment function according to claim 1, wherein a pitch / rhythm difference between each ugly hand voice is compared with a predetermined value. The compatibility determination means obtains a pitch / rhythm difference and a volume difference between sounds input by two or more scolders every predetermined time, and a range in which the pitch / rhythm difference and the volume difference are recognized as matching. And having counting means for counting +1 for each predetermined time,
2. The karaoke apparatus with a compatibility judgment function according to claim 1, wherein the scoring means sums up the count values by the counting means and scores the summed values as scores, or displays the results as characters or pictures. The compatibility determination means calculates a pitch rhythm difference between voices input by two or more cradle hands, a pitch rhythm difference between the melody of the music and the voices of the ugly hands, and a volume difference for a predetermined time. Each having a counting means for counting +1 for each predetermined time when the difference between the pitch rhythm difference and the volume difference is within a range that is recognized as a match,
3. The karaoke apparatus with a compatibility determination function according to claim 2, wherein the scoring means sums up the count values by the counting means and scores the summed values as scores, or displays the results as characters or pictures.   The compatibility determination means is a character or picture indicating that the compatibility is matched on the screen at the position where the compatibility is recognized and the count is added during the compatibility diagnosis, or at the position where the compatibility does not match and is not counted. 5. The karaoke apparatus with a compatibility determination function according to claim 1, 2, 3 or 4, further comprising display control means for displaying a character or a picture meaning that the compatibility is not suitable.

Images