JP3562223B2 - Karaoke equipment - Google Patents

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a karaoke apparatus having a function of scoring a singing ability of a user.
[0002]
[Prior art]
Conventionally, various karaoke apparatuses having a function of scoring the singing ability of a singer have been developed. Generally, in this type of karaoke apparatus, the volume and pitch (pitch) of the singer's singing voice are compared with the vocal part reference included in the karaoke music information, and the singing is performed according to the degree of agreement. It is designed to score power.
[0003]
[Problems to be solved by the invention]
Meanwhile, in a conventional karaoke apparatus, when a song composed of a plurality of vocal parts such as a duet song is sung, the singing ability is scored by mixing singing voices input from a plurality of microphones (hereinafter, referred to as microphones). The obtained signal is compared with a vocal part reference (usually, a reference value of the main vocal). Therefore, the singing voice of each part could not be properly evaluated, and an accurate scoring result could not be obtained.
[0004]
In such a case, it is conceivable that the singing ability is scored by comparing each singing voice with the guide melody of each part and summing up the grading results of both parts. There are the following problems when scoring.
First, if one singer sings correctly and the other singer does not sing, simply adding the results of the two scores to give a comprehensive score would result in the inability of the other singer to sing. As a result, the singing ability of a singer who sings correctly is not properly reflected in the scoring results.
In addition, duet songs have a male singing section in which men and women sing at the same time, a male singing section in which only men sing, and a female singing section in which only women sing, but in sections where only one singer sings. If the total of the score results of the two is taken, the other singing voice that should not be sung is also targeted for scoring, and an accurate scoring result cannot be obtained.
[0005]
Further, in the karaoke apparatus corresponding to the above-mentioned duet music, it is necessary to score each part at the same time, so it is premised that two systems of the scorers are prepared. On the other hand, the songs sung by the karaoke apparatus are usually not only duet songs but also ordinary songs composed of a single vocal part. In this case, the singing ability can be graded by using one scoring machine, but it is convenient if the scoring accuracy can be improved by using the other scoring machine.
[0006]
The present invention has been made under such a background, and when a plurality of vocal parts are sung like a duet song, it is necessary to properly evaluate the singing voice of each part and obtain an accurate scoring result. It is an object of the present invention to provide a karaoke apparatus that can perform music. Another object is to improve the singing ability scoring accuracy.
[0007]
[Means for Solving the Problems]
In order to solve the above-mentioned problem, the invention according to claim 1 is: A karaoke apparatus for playing music data, comprising a selection means, a first comparison means, a second comparison means, a supply means, a calculation means, and an evaluation means, wherein the music data has a first reference value, In addition to the two reference values, the mixed singing section, the first single singing section, and the second single singing section are identifiable. When the performance is in the mixed singing section, the singing input from the first microphone is performed. A voice signal is output from the first output terminal, a singing voice signal input from the second microphone is output from the second output terminal, and when the performance is in the first single singing section, the singing input from the first microphone is performed. A voice signal is output from the first and second output terminals, and when the performance is in the second single singing section, a singing voice signal input from the second microphone is output from the first and second output terminals, and the first singing voice signal is output from the first and second output terminals. The comparing means includes: The feature of the singing voice signal output from the input terminal is compared with the supplied first or second reference value, and the second comparing means is supplied with the feature of the singing voice signal output from the second output terminal. The supply means supplies the first reference value to the first comparison means and the second reference value to the second comparison means when the performance is in a mixed singing section, When the performance is in the first single singing section, the first reference value is supplied to the first comparing means and the second comparing means. When the performance is in the second single singing section, the second reference value is compared with the first comparing value. To the second comparing means, the calculating means calculates and outputs an average value of the comparison results of the first comparing means and the second comparing means, and the evaluating means evaluates the singing ability based on the output of the calculating means. It is characterized by the following.
[0010]
Claims 2 The invention described in 2. The karaoke apparatus according to claim 1, wherein each of the first and second comparison means detects a case where a singing voice signal is not input as a non-singing period, and calculates an average when the non-singing period is detected. Instead of the value, the comparison result of the first or second comparison means that is not in the non-singing period is output as it is. It is characterized by the following.
[0011]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
A: Overall configuration of the embodiment
FIG. 1 is a block diagram showing the overall configuration of a karaoke apparatus according to one embodiment of the present invention. In FIG. 1, reference numeral 30 denotes a CPU that controls each unit of the apparatus. The CPU 30 includes, via a bus BUS, a ROM 31, a RAM 32, a hard disk drive (HDD) 37, a communication control unit 36, a remote control receiving unit 33, a display panel 34, a panel switch 35, a sound source device 38, an audio data processing unit 39, A DSP 40, a character display unit 43, an LD changer 44, a display control unit 45, and an audio processing DSP 49 are connected.
[0012]
The ROM 31 stores an initial program necessary for starting the karaoke apparatus. When the power of the apparatus is turned on, the system program and the application program stored in the HDD 37 are loaded into the RAM 32 by the initial program. The HDD 37 stores, in addition to the system program and the application program, a music data file 370 for storing music data of about 10,000 music played during karaoke performance.
[0013]
Here, the contents of the music data will be described with reference to FIGS. FIG. 2 is a diagram showing a format of music data for one music. FIGS. 3 and 4 are diagrams showing the contents of each track of the music data.
In FIG. 2, the music data includes a header, a musical sound track, a guide melody track, a lyrics track, an audio track, an effect track, and an audio data section. Various information regarding the music data is written in the header, and data such as a music number, a music title, a genre, a release date, and a music playing time (length) are written in the header.
[0014]
As shown in FIGS. 3 and 4, each track of the tone track or the effect track is composed of sequence data including a plurality of event data and duration data Δt indicating a time interval between each event. The CPU 30 reads the data of each track in parallel by a sequence program (application program for karaoke performance) at the time of karaoke performance. When reading the sequence data of each track, Δt is counted by a predetermined tempo clock, and when the counting is completed, the subsequent event data is read and output to a predetermined processing unit. As shown in FIG. 3, tracks of various parts including a melody track and a rhythm track are formed on the musical tone track.
[0015]
As shown in FIG. 4, the melody of the vocal part of the karaoke tune, that is, the melody sequence data to be sung by the singer is written in the guide melody track. The CPU 30 generates reference pitch data and volume data based on the data and compares the generated data with the singing voice. When there are a plurality of vocal parts (for example, a main melody and a chorus melody) as in a duet song, there is a guide melody track corresponding to each part.
[0016]
The lyrics track is composed of sequence data for displaying lyrics on the monitor 46. Although this sequence data is not tone data, this track is also described in the MIDI data format in order to unify the implementation and facilitate the work process. The type of data is a system exclusive message. The lyrics track usually includes a character code corresponding to one line of lyrics displayed on the monitor, its display coordinates on the monitor screen, display time, and wipe sequence data. The wipe sequence data is sequence data for changing the display color of the lyrics in accordance with the progress of the song. The timing of changing the display color (time from when the lyrics are displayed) and the change position (coordinates) ) Is data sequentially recorded over the length of one line.
[0017]
The audio track is a sequence track that specifies the generation timing of the audio data n (n = 1, 2, 3,...) Stored in the audio data section. The voice data section stores a human voice such as a back chorus which is difficult to synthesize by the sound source device 38. In the audio track, the audio designation data and the reading interval of the audio designation data, that is, the duration data Δt that designates the timing of outputting the audio data to the audio data processing unit 39 and forming the audio signal, are written. The voice designation data includes a voice data number, pitch data, and volume data. The audio data number is an identification number n of each audio data recorded in the audio data section. The pitch data and the volume data are data for specifying the pitch and volume of the audio data to be formed. That is, a back chorus such as "Ah" or "Wawa Wawa" without words can be used many times by changing the pitch and volume. The pitch and volume are shifted based on and used repeatedly. The audio data processing unit 39 sets the output level based on the volume data, and sets the pitch of the audio signal by changing the reading interval of the audio data based on the pitch data.
[0018]
In the effect track, DSP control data for controlling the effect DSP 40 is written. The effect DSP 40 applies reverberation or other reverberation-based effects to signals input from the sound source device 38 and the audio data processing unit 39. The DSP control data is composed of data for specifying the kind of the effect and data for specifying the degree of effect application such as the delay time and the echo level.
[0019]
Such music data is read from the HDD 37 at the start of the karaoke performance and loaded into the RAM 32.
[0020]
Next, the contents of the memory map of the RAM 32 will be described with reference to FIG. As shown in the figure, the RAM 32 temporarily stores a program storage area 324 for storing loaded system programs and application programs, an execution data storage area 323 for storing music data for karaoke performance, and a guide melody. A MIDI buffer 320, a reference data register 321 for storing reference data extracted from the guide melody, and a difference data storage area 322 for storing difference data obtained by comparing the reference with the singing voice are set. . The reference data register 321 includes a pitch data register 321a and a volume data register 321b. The difference data storage area 322 includes a pitch difference data storage area 322a and a volume difference data storage area 322b.
[0021]
Now, the configuration of the karaoke apparatus will be described again with reference to FIG. In the figure, a communication control unit 36 downloads music data and the like from a host computer (not shown) via an ISDN line, and transfers music data received by an internal DMA controller directly to the HDD 37 without passing through the CPU 30.
The remote control receiver 33 receives the infrared signal sent from the remote controller 51 and restores the input data. The remote controller 51 includes a command switch such as a music selection switch, a numeric key switch, and the like. When the user operates these switches, an infrared signal modulated with a code corresponding to the operation is transmitted.
The display panel 34 is provided on the front of the karaoke apparatus, and displays the currently playing music code and the number of reserved music. The panel switch 35 is provided on the front of the karaoke apparatus, and includes a music code input switch, a key change switch, and the like. Further, the on / off of the scoring function can be designated by the remote controller 51 or the panel switch 35.
[0022]
The sound source device 38 forms a tone signal based on the data of the tone track of the music data. The music data is read by the CPU 30 during a karaoke performance, and the guide melody track, which is comparison data, is read in parallel with the musical sound track. The tone generator 38 reads out the data of each of the musical tone tracks in parallel, and simultaneously generates musical tone signals of a plurality of parts.
[0023]
The audio data processing unit 39 forms an audio signal having a specified length and a specified pitch based on the audio data included in the music data. The audio data is a signal waveform that is hardly generated electronically by the sound source device 38 such as a back chorus and is directly converted into ADPCM data and stored. The tone signal formed by the sound source device 38 and the sound signal formed by the sound data processing section 39 are karaoke performance sounds, which are input to the effect DSP 40. The effect DSP 40 adds effects such as reverb and echo to the karaoke performance sound. The karaoke performance sound to which the effect has been added is converted into an analog signal by the D / A converter 41 and then output to the amplifier speaker 42.
[0024]
47a and 47b are singing microphones. Singing voice signals V1 and V2 input from the microphones 47a and 47b are amplified by a preamplifier (not shown) and then input to the amplifier speaker 42 and the selector 48, respectively. Is done.
[0025]
The selector 48 selects each of the singing voice signals V1 and V2 under the control of the CPU 30, and outputs a voice processing DSP 49. In this case, switching of the selector 48 includes a straight mode in which the singing voice signal V1 supplied to the input terminal X1 is output from the output terminal Y1 and the singing voice signal V2 supplied to the input terminal X2 is output from the output terminal Y2. There is a mix mode in which the singing voice signals V1 and V2 supplied to the input terminals X1 and X2 are mixed and then output to the output terminals Y1 and Y2.
Here, the selection of the mode is determined by a combination of the music data and the operation of the remote controller 51. For example, some songs have data of a hamori part, but whether or not to use the hamori function is left to the discretion of the user. Specifically, when the user wants to sing using the hamori function, the user operates the remote controller 51 and inputs that fact, and the hamori part and the main vocal part are performed. If there is no performance, only the main vocal part is performed. In this case, the straight mode is used when the hamori function is used, and the mixed mode is used when not used. In other words, the mode is selected based on the music data set by the user, including various effects.
[0026]
Each of the singing voice signals V1 and V2 input to the voice processing DSP 49 is converted into a digital signal, and then subjected to signal processing for scoring processing. The configuration of the voice processing DSP 49 and the CPU 30 realizes the function of the scoring processing unit 50. This will be described later.
The amplifier speaker 42 amplifies the input karaoke performance sound and each singing voice signal, gives an effect such as an echo to each singing voice signal, and emits the sound from the speaker.
[0027]
When a character code is input, the character display unit 43 reads font data such as a song title and lyrics corresponding to the character code from an internal ROM (not shown) and outputs the data. The LD changer 44 reproduces the background video of the corresponding LD based on the input video selection data (chapter number). The video selection data is determined based on the genre data of the karaoke song. This genre data is written in the header of the music data, and is read by the CPU 30 at the start of the karaoke performance. The CPU 30 determines which background video is to be reproduced based on the genre data, and outputs video selection data specifying the background video to the LD changer 44. The LD changer 44 contains about five laser disks, and can reproduce about 120 scenes of background video. One background video is selected from among them according to the video selection data, and is output as video data. The video data and font data such as lyrics output from the character display unit 43 are superimposed by the display control unit 45, and the composite image is displayed on the monitor 46. When the scoring result is calculated by the scoring processing unit 50, a character corresponding to the scoring result is output from the character display unit 43 and displayed on the monitor 46.
[0028]
B: About the scoring unit 50
Next, the scoring processing unit 50 of the present embodiment will be described. The scoring processing unit 50 is configured by hardware such as the above-described voice processing DSP 49 and CPU 30 and scoring software. FIG. 6 is a block diagram illustrating a configuration of the scoring processing unit 50. In the figure, the scoring processing unit 50 includes a first scoring unit 50A, a second scoring unit 50B, a combining unit 50C, and an evaluation unit 50D.
The first and second scoring units 50A and 50B are composed of a pair of A / D converters 501a and 501b, data extraction units 502a and 502b, comparison units 503a and 503b, and filters 504a and 504b.
[0029]
The A / D converters 501a and 501b each convert the singing voice signal output from the selector 48 into a digital signal. The data extraction units 502a and 502b extract pitch data and volume data from each digitized singing voice signal every 100 ms. The comparing units 503a and 503b compare the pitch data and the volume data extracted from each singing voice signal with the pitch data and the volume data of the reference melody data #A and #B, respectively, and calculate the difference therebetween. , And differential data Diffa and Diffb.
[0030]
Here, the difference data Diffa and Diffb are composed of the following data.
Ti: Measurement time data (measured by relative time of performance clock)
ΔT: Duration data (time since last measurement time)
Mi: Reference melody status data
(Whether the section requires singing, "1" for singing section, "0" for non-singing section)
Si: Singing state data (singing presence / absence, “1” during singing, “0” during non-singing)
Fi: Pitch difference data (pitch difference is indicated by log scale (cent unit))
Li: Volume difference data (indicating the volume difference on a log scale (dB unit))
Here, “i” indicates that it is the i-th sample.
[0031]
In this case, since the pitch difference data Fi and the volume difference data Li are expressed on a log scale, the calculation of the synthesis unit 50C at the subsequent stage can be simplified.
The reference melody state data Mi is generated by the CPU 30 based on music data corresponding to each part recorded on the guide melody track. Specifically, it is generated from the note-on status and the note-off status in the music data.
The singing state data Si is generated by each of the comparison units 503a and 503b by comparing each volume data supplied from the data extraction units 502a and 502b with a predetermined threshold. In this case, the threshold is set to a level at which it is possible to determine whether the user is singing.
[0032]
Here, the singing voice data, the reference data, and the difference data Diff will be described with reference to FIG. FIGS. 7A and 7B are diagrams showing examples of a guide melody as a reference. FIG. 7A shows the guide melody in a staff notation, and FIG. 7B shows the contents of the staff converted into pitch data and volume data with a gate time of about 80%. The volume rises and falls according to the instruction of mp → crescendo → mp. On the other hand, FIG. 3C shows an example of a singing voice. Both the pitch and volume slightly fluctuate from the values indicated by the reference. The singing state data Si in this case becomes “1” when the volume data exceeds the threshold as shown in the figure, and becomes “0” when the volume data is lower than the threshold. The evaluation unit 50D, which will be described later, does not treat a sample whose singing state data Si is “0” as a valid sample. The reason for ignoring the low-volume part is that, in this section, the proportion of the noise component in the pitch difference data Fi or the volume difference data Li is large, and the scoring accuracy is degraded.
[0033]
By the way, the pitch difference data Fi and the volume difference data Li usually fluctuate within a certain range, and when these values fluctuate suddenly, it is assumed that erroneous calculation was performed due to malfunction due to noise or the like. You can think. If the singing ability is scored based on the pitch difference data Fi and the volume difference data Li affected by the noise, the singing ability of the singer cannot be properly evaluated. The filters 504a and 504b are provided to invalidate the pitch difference data Fi and the volume difference data Li in such a case.
[0034]
Each of the filters 504a and 504b has a buffer, a subtractor, and a comparator therein. The buffer stores pitch difference data Fi-1 and volume difference data Li-1 calculated for the immediately preceding sample. Then, when the pitch difference data Fi and the volume difference data Li corresponding to the current sample are input, the subtractor calculates ΔLi = | Li−Li−1 | and ΔFi = | Fi−Fi−1 | You. The comparator compares ΔLi and ΔFi with predetermined thresholds Lr and Fr, respectively. Together A control signal that becomes “0” is output. Here, each threshold value is determined so that an invalid sample can be determined from various types of actually measured data. Then, when the control signal is "1", the filters 504a and 504b invalidate the current pitch difference data Fi and the volume difference data Li.
As a result, it is possible to invalidate a sample whose change is larger than that of the previous sample and to properly evaluate the singing ability of the singer.
[0035]
Next, the combining unit 50C combines the difference data Diffa and Diffb at the same time by referring to the measurement time data Ti to generate combined difference data Diffc. The synthetic difference data Difffc is composed of synthetic reference melody state data Mi ′, synthetic singing state data Si ′, synthetic pitch difference data Fi ′, and synthetic volume difference data Li ′, in addition to the measurement time data Ti and the duration data ΔT. You.
[0036]
Here, assuming that each data constituting the difference data Diffa is represented by a suffix “1” and each data relating to the difference data Diffb is represented by a suffix “2”, the combined reference melody state data Mi ′ is represented by Mi1 and Mi2. As a logical sum, the synthesized singing state data Si 'is calculated as a logical sum of Si1 and Si2. The synthesized pitch difference data Fi ′ and the synthesized volume difference data Li ′ are calculated according to the following equations according to Mi1 and Mi2 and Si1 and Si2.
[0037]
1) When Mi1 * Mi2 * Si1 * Si2 = 1
In this case, regardless of the scoring performed by any scoring unit, it is a valid singing section and a period during which the singer sings. Therefore, an average value of the difference data is calculated.
Fi ′ = (Fi1 + Fi2) / 2
Li ′ = (Li1 + Li2) / 2
[0038]
2) Mi1 * Si1 = 1, Mi2 * Si2 = 0
In this case, the scoring performed by the second scoring unit 50B is not in the non-singing section or during singing. On the other hand, the scoring performed by the first scoring unit 50A is a period during which the singer is singing in the effective singing section. Therefore, the difference data Diffb is ignored. Fi '= Fi1
Li '= Li1
[0039]
3) Mi1 * Si1 = 0, Mi2 * Si2 = 1
In this case, the scoring performed by the first scoring unit 50A is not in a non-singing section or during singing. On the other hand, the scoring performed by the second scoring unit 50B is a period during which the singer is singing in the effective singing section. Therefore, the difference data Diffa is ignored.
Fi '= Fi2
Li '= Li2
[0040]
Combined like this Department By configuring 50C, for example, in a mixed singing section of a duet song, if a male singer sings correctly and a female singer does not sing, a female singer will not sing. won The part is excluded from the scoring, and the singing ability of the male singer who sings correctly can be used as both singing ability.
In addition, in a single singing section of a duet song, singing voices that should not be sung originally are not to be scored, and accurate scoring results can be obtained based only on originally planned singing voices.
[0041]
Next, the evaluation unit 50D includes a storage unit and the like (not shown), and calculates a scoring result based on the difference data Diffa, Diffb or the combined difference data Diffc. When the difference data Diffa, Diffb or the combined difference data Diffc is input, the difference data Diffa, Diffb, or the combined difference data Diffc is stored in the storage unit (that is, the difference data storage area 322 of the RAM 32). In this case, the CPU 30 controls which data among Diffa, Diffb, and Diffc is stored in the storage unit. This accumulation is performed at any time during the performance of the music.
[0042]
When the performance of the music is completed, the evaluation unit 50D sequentially reads out the difference data stored in the storage unit, accumulates the difference data for each musical element of pitch and volume, and gives a score based on each accumulated value. Find the subtraction value for Then, each subtraction value is subtracted from the full score (100 points) to obtain a score for each music element, and the average value of these is output as a scoring result.
[0043]
C: Scoring operation of the embodiment
Next, the scoring operation (that is, the operation of the scoring processing unit 50) according to the present embodiment will be described. In this example, unless otherwise specified, it is assumed that the singer is singing in the section to be sung and the singing state data Si = 1.
C-1: Scoring operation when singing a battle song
First, a case where two singers sing a battle song will be described. In this case, the selector 48 is set to the straight mode, and the same reference melody data #A is supplied to the first scoring unit 50A and the second scoring unit 50B. As a result, when the singing voice signals V1 and V2 are input to the first and second scoring units 50A and 50B, the first scoring unit 50A and the second scoring unit 50B generate difference data Diffa and Diffb. I do. In this case, since it is necessary to perform the scoring for each singer, the evaluation unit 50D generates a scoring result based on the difference data Diffa and a scoring result based on the difference data Diffb.
[0044]
C-2: Scoring operation when singing a normal song
Next, a case where one singer sings a normal song will be described. In this case, the difference data may be generated by one of the scoring units, but in the present embodiment, the first and second scoring units 50A and 50B simultaneously process the difference data in order to reduce noise. And scoring is performed based on the average value.
Therefore, the selector 48 is set to the mix mode, and the same reference melody data #A is supplied to the first scoring unit 50A and the second scoring unit 50B. Then, the combining unit 50C calculates an average value of the difference data Diffa and the difference data Diffb, and outputs the result as combined difference data Diffc.
[0045]
In general, since the noise component is random noise, averaging reduces the component by 3 dB. On the other hand, the signal component does not change even if the average is taken. Therefore, the SN ratio of the synthetic pitch difference data Fi ′ and the synthetic volume difference data Li ′ in the synthetic difference data Diffc is improved by 3 dB as compared with those of the difference data Diffa and the difference data Diffb.
As a result, in the A / D converters 501a and 501b, it is possible to reduce a noise component generated due to an error generated at the time of quantization and an error at the time of detecting a pitch, and to score the singing ability with high accuracy. It becomes possible.
[0046]
C-3: Scoring operation when singing duet music
Next, a case where male and female singers sing a duet song will be described. In a duet song, there are generally a male singing section in which only men sing, a female singing section in which only women sing, a mixed singing section in which men and women sing simultaneously, and a prelude / interlude section in which both do not sing. In the hybrid section, since both sing at the same time, it is necessary to score the singing power in each of the first and second scoring units 50A and 50B. On the other hand, in the male singing section or the female singing section, scoring can be performed by generating difference data in one of the sections, but in the present embodiment, in order to improve the scoring accuracy, this is performed. Also in this case, difference data is generated using both the scoring units, and the difference data is averaged by the combining unit 50C to obtain combined difference data.
[0047]
This point will be specifically described with reference to FIG. In this example, it is assumed that a man sings with the microphone 47a and a woman sings with the microphone 47b. FIG. 8A shows an example of the progress of a duet song. The duet music in this example is a prelude section T1 → a male singer section T2 → a female singer section T3 → a mixed singer section T4 → an interlude section. T5 Proceed in the order of 8B shows the mode of the selector 48. FIG. 8C shows the reference melody data supplied to the first scoring unit 50A, and FIG. 8D shows the second scoring. It shows reference melody data supplied to the unit 50B. Note that #M indicates reference melody data corresponding to the male part and #W indicates reference melody data corresponding to the female part.
[0048]
First, since the prelude section T1 and the interlude section T5 are not the original singing sections, no guide melody exists as shown in FIGS. 8B and 8C, and are excluded from scoring. Therefore, the switching mode of the selector 48 may be either the slate mode or the mix mode.
[0049]
Next, in the male singing section T2, the selector 48 is set to the mix mode. In this case, the CPU controls the input terminal X1 of the selector 48 to connect to the output terminals Y1 and Y2, and controls the input terminal X2 of the selector 48 to open. Therefore, the male singing voice signal V1 output from the microphone 47a is supplied to the first scoring unit 50A and the second scoring unit 50B. In this section, since the reference melody data #M is supplied to the first and second scoring units 50A and 50B, the male singing voice signal V1 and the male part reference melody data #M are scored in two parts. The comparison is performed by the units 50A and 50B, and the average value is generated in the combining unit 50C. The evaluation unit 50D scores the section based on the combined difference data Diffc from the combining unit 50C. In this case, the combined difference data Diffc has an improved SN ratio as compared with the difference data Diffat and Diffb.
[0050]
Next, in the female singing section T3, the selector 48 is set to the mix mode as in the male singing section T2. However, the connection state inside the selector 48 is different from the male singing section T2. In this case, the CPU performs control so that the input terminal X2 of the selector 48 is connected to the output terminals Y1 and Y2, and the input terminal X1 of the selector 48 is opened. Therefore, the male singing voice signal V1 is not output from the selector 48. In the section where only one of the two singers is to sing, both singing voice signals are not mixed and output to the output terminals Y1 and Y2, and the input from the other microphone is opened, for example, This is because, when the male clapping in the singing section T3, the clapping is performed as noise, and the singing ability of the female cannot be properly evaluated.
[0051]
Thus, when the female singing voice signal V2 is supplied to the first and second scoring units 50A and 50B, the first and second scoring units 50A and 50B perform comparison based on the reference melody data #W. . When the comparison result is averaged by the combining unit 50C and output as combined difference data Diffc, the evaluation unit 50D scores the section based on the combined difference data Diffc. Also in this case, similarly to the male singing section T, the combined difference data Diffc has an improved SN ratio compared to the difference data Diffat and Diffb.
[0052]
Next, in the mixed singing section, the selector 48 is set to the straight mode. In this case, the CPU 30 controls the input terminal X1 and the output terminal Y1 of the selector 48 to be connected, and controls the input terminal X2 to be connected to the output terminal Y1. Therefore, the male singing voice signal V1 is supplied to the first scoring unit 50A, and the female singing voice signal V2 is supplied to the second scoring unit 50B. In this section, since the reference melody data #M and #W are supplied to the first and second scoring units 50A and 50B, respectively, they are different from the first and second scoring units 50A and 50B. Difference data Diffa and Diffb are output. The combining unit 50C calculates an average value of the two, and generates combined difference data Diffc.
[0053]
Here, if a woman does not sing in a part (T4 ′) of the section, the singing state data Si2 related to the second scoring unit 50B is as shown in FIG. 8E. Therefore, during the period T4 ′, the combining unit 50C does not calculate the average value, but combines the pitch difference data Fi1 and the volume difference data Li1 generated by the first scoring unit 50A with the combined difference data Li1. Since it is output as Diffc, comprehensive scoring can be performed based on male singing ability.
[0054]
As described above, according to the present embodiment, based on the combination of the music data and the operation of the remote controller 51, the CPU 30 switches the selector 48 and supplies the reference guide melody data to be supplied to the first and second scoring units 50A and 50B. Is controlled, the first and second scoring units 50A and 50B can be effectively utilized, and a highly accurate and appropriate scoring result can be calculated.
That is, when one singer sings, a scoring result can be obtained based on the synthetic difference data Diffc with an improved SN ratio. In a duet song, the operation of the synthesizing unit 50C depends on the nature of the singing section. By switching, accurate and appropriate scoring results can be calculated.
[0055]
D: Modified example
Note that the present invention is not limited to the above-described embodiment, and various modifications as described below are possible.
(1) For example, in the embodiment, the case of performing a karaoke performance of a duet song has been described as an example. In this case, the scoring processing unit 50 may be extended to a system corresponding to the number of parts, and guide melody may be prepared by the number of tracks corresponding to the number of parts.
(2) Further, instead of obtaining the average value of each music element as the scoring result as in the embodiment, the score of the pitch, volume or rhythm may be output as the scoring result for each music element.
(3) In the grading process, the grading is performed collectively after the song is completed. However, the basic evaluation may be performed in units of phrases and musical notes, and the results may be totaled after the tune is completed. Further, the scoring result may be displayed on the monitor 46 for each phrase unit, and the final scoring result may be displayed after the end of the music.
(4) In the embodiment, the average value of the scores obtained for each vocal part in the duet music is output. However, the average value may be output individually, or both may be output. . In the case of outputting individually, the scoring result may be calculated by the evaluation unit 50D based on each of the difference data Diffa and Diffb.
(5) In addition, the user's enjoyment can be further increased by adopting various display modes such as highlighting the score of the highest scoring result among the plurality of singing voices.
[0056]
【The invention's effect】
As described above, according to the present invention, when a plurality of vocal parts are sung, for example, duet songs, comprehensive singing ability can be scored. The scoring accuracy can be improved.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of a karaoke apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram showing a data format of music data in the embodiment.
FIG. 3 is a diagram showing a configuration of a music track of the music data.
FIG. 4 is a diagram showing a configuration of a track other than a musical tone track of the music data.
FIG. 5 is a diagram showing contents of a memory map of a RAM in the karaoke apparatus.
FIG. 6 is a block diagram showing a configuration of a scoring processing unit in the karaoke apparatus.
FIG. 7A is a diagram showing an example of a guide melody in the embodiment in a staff notation, FIG. 7B is a diagram showing pitch data and volume data of a reference based on the guide melody, and FIG. It is a figure which shows pitch data, volume data, and singing state data.
FIG. 8 is a timing chart in the case of singing a duet song in the karaoke apparatus.
[Explanation of symbols]
30 CPU (control means, scoring means), 31 ROM, 32 RAM, 37 hard disk device, 38 sound source device, 47a, 47b microphones (first and second microphones), 49 DSP for voice processing .. 50 scoring processing units, 501a, 501b A / D converters, 502a, 502b... Data extraction units (first and second extraction means), 503a, 503b... Comparison units (first and second comparison means) .

Claims (2)

A karaoke apparatus that includes a selection unit, a first comparison unit, a second comparison unit, a supply unit, a calculation unit, and an evaluation unit, and plays music data.
The music data includes a first reference value and a second reference value, and a hybrid singing section, a first single singing section, and a second single singing section can be identified,
The selection means
When the performance is in the mixed singing section, the singing voice signal input from the first microphone is output from the first output terminal, and the singing voice signal input from the second microphone is output from the second output terminal;
When the performance is in the first single singing section, a singing voice signal input from the first microphone is output from the first and second output terminals,
When the performance is in the second single singing section, a singing voice signal input from the second microphone is output from the first and second output terminals,
The first comparing means compares the characteristic amount of the singing voice signal output from the first output terminal with the supplied first or second reference value,
The second comparing means compares the characteristic amount of the singing voice signal output from the second output terminal with the supplied first or second reference value,
The supply means is
When the performance is in a mixed singing section, the first reference value is supplied to the first comparing means, and the second reference value is supplied to the second comparing means.
When the performance is in the first singing section, the first reference value is supplied to the first comparing means and the second comparing means,
When the performance is in the second single singing section, the second reference value is supplied to the first comparing means and the second comparing means,
The calculating means calculates and outputs an average value of the comparison results of the first comparing means and the second comparing means,
The evaluator evaluates the singing ability based on an output of the calculator.
Karaoke equipment. Each of the first and second comparing means detects a case where no singing voice signal is input as a non-singing period,
When the non-singing period is detected, the calculating means outputs the comparison result of the first or second comparing means which is not the non-singing period as it is, instead of the average value.
The karaoke apparatus according to claim 1.

Images