JP2007334364A - Karaoke machine - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a Karaoke machine having a scoring function that can accurately determine whether an actual singing is good. <P>SOLUTION: Basic points are calculated by scoring the frequency of a singing, and additional points are also calculated by scoring other singing elements such as vibratos, intonation, voice quality, timing, and bending, of the singing. The additional points are added to the basic points to obtain final scores. Consequently, although the scoring is performed principally based upon the singing frequency, other singing elements are taken in consideration for the scoring and final scores matching whether the actual singing is good can be calculated. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an improvement in scoring accuracy in a karaoke apparatus having a singing scoring function.

  Conventionally, some karaoke apparatuses have a scoring function for scoring the skill of a singer. The scoring function that has been practically used in the past compares the pitch extracted from the reference such as a guide melody with the frequency extracted from the singing voice (for example, Patent Document 1), and adds the evaluation of the volume change to this. (Patent Document 2).

Japanese Patent Laid-Open No. 10-49183 JP-A-10-161673

  However, since the guide melody is MIDI data in which event data (note-on event data and note-off event data) indicating pitches is arranged, the conventional scoring function scores only the singing frequency, which is a basic singing element. It was not possible to correctly evaluate and score other skillful singing elements. For this reason, there was a problem that it was impossible to calculate a score that correctly evaluated the true skill of singing.

  An object of the present invention is to provide a karaoke apparatus with a scoring function that can accurately determine the skill of actual singing.

The invention of claim 1 is a karaoke apparatus comprising performance means for playing karaoke music, singing input means for inputting singing voice, and scoring means for scoring the inputted singing voice,
The scoring means is: (1) the singing frequency and the reference frequency are separated by a certain distance or more at the start timing of the note; (2) the singing frequency finally reaches within the allowable range of the reference frequency; (3 ) Skillful singing skill that gradually raises the pitch when the singing melody is in the rising tone form, based on whether or not it conforms to the rules including the singing frequency rising smoothly It is characterized by scoring whether it was sung by skill.

The invention according to claim 2 is characterized in that the scoring means is based on whether or not the scoring technique is based on whether or not (4) the singing frequency decreases before the singing frequency starts increasing. It is characterized by scoring whether or not it was sung.

The invention of claim 3 is for scoring performance means for playing karaoke music, singing input means for inputting singing voice, singing frequency detecting means for detecting the frequency of the inputted singing voice, and technical singing elements. A karaoke apparatus comprising storage means for storing the rules and scoring means for scoring the input singing voice,
The performance means forms a musical sound signal of the karaoke song based on the music data, and outputs a reference frequency synchronized with the musical sound signal of the karaoke song,
The scoring means scoring by comparing the frequency of the singing voice with the reference frequency, and scoring the technical singing elements of the singing voice using the rules, and the frequency scoring means for calculating a basic score. Singing element scoring means for calculating an additional point, and final score calculating means for obtaining a final score by adding the additional point to the basic score.

  The invention according to claim 4 is the invention according to claim 3, wherein the frequency scoring means scores the singing voice for each note and calculates a basic score by summing up the scoring results for each note. .

The invention of claim 5 is the invention of claims 3 and 4, wherein the frequency scoring means scores using a low-pass filtered (LPF) frequency of the singing voice detected by the singing frequency detecting means, The singing element scoring means scores using the frequency of the singing voice detected by the singing frequency detecting means as it is.

The invention of claim 6 is the invention of claims 3 to 5, wherein the singing element scoring means is a vibrato that is a periodic frequency variation of the singing, and a volume of the singing phrase as the technical singing element . It is characterized by scoring one or a plurality of singing elements of inflection that is variation, singing sound quality, singing timing of each note, and screaming that is a transition waveform of pitch.

The invention according to claim 7 is the invention according to claims 3 to 5, wherein the singing element scoring means is (1) that the singing frequency and the reference frequency are separated by a certain distance or more at the start timing of the note, and (2) finally. Is based on whether the singing frequency is within the allowable range of the reference frequency, and (3) the singing frequency rises smoothly. It is characterized by scoring whether or not it was sung with the skill of screaming, which is a singing skill that gradually raises the pitch gradually.

The invention of claim 8 is the invention of claim 7, wherein the singing element scoring means further complies with the rule that (4) the single-point frequency is lowered before the singing frequency starts to rise. Based on the above, it is characterized by scoring whether or not the song is sung by the skill of the shawl.

  In the above-described invention, in addition to the singing frequency which is a basic singing element, other singing elements such as vibrato, intonation, voice quality, timing, and pitch transition waveform (shearing) are also scored. And, by making the result of scoring the singing frequency the center of the score (basic score), by adding (subtracting) the score obtained from the scoring result of other singing elements as additional points, the singer's singing skill is correctly It can also be determined to match the audience's evaluation.

  As described above, according to the present invention, the final score can be calculated by evaluating other singing elements such as vibrato, intonation, voice quality, timing, and sneezing based on the singing frequency scoring result. It is possible to score according to the skill of actual singing that correctly evaluated the elements of.

A karaoke apparatus according to an embodiment of the present invention will be described with reference to the drawings.
In a karaoke device, the performance of a karaoke song is the operation of outputting the background video / lyric telop to the monitor while generating the music of the karaoke song, but if the scoring mode is set, in addition to the performance of this karaoke song, the singer's performance The singing voice is scored by comparing it with a reference to calculate a score, and a scoring operation is performed to display the score after the end of the song.

  The scoring is basically based on the frequency of the singing (pitch / pitch) and the basic score is calculated. In addition to this, it is based on the degree of vibrato, the degree of inflection, the quality of sound quality, the quality of timing, the number of squeaks, etc. Bonus points are calculated and added (subtracted) to the basic score.

  FIG. 1 is a block diagram of the karaoke apparatus. The karaoke apparatus is composed of a CPU 10 that controls the operation of the entire apparatus and various devices connected thereto. Connected to the CPU 10 are a hard disk 11, a RAM 12, a sound source 13, a mixer (effector) 14, a vocal adapter 19, an MPEG decoder 20, a synthesis circuit 21, and an operation unit 23. The hard disk 11 stores music data for playing karaoke music, video data for displaying a background video on a monitor, and the like. The hard disk 11 also stores a point calculation table shown in FIG. This point calculation table is a table for determining additional points based on singing elements such as intonation and vibrato (details will be described later). In the RAM 12, an area for reading out programs and music data, a scoring log area for recording scoring results and the like in the scoring mode are set.

  The sound source 13 forms a musical sound signal in accordance with music data (note event data or the like) input by the music sequencer 31 executed by the CPU 10. The formed tone signal is input to the mixer 14. The mixer 14 gives an effect such as echo to the plurality of musical sound signals generated by the sound source 13 and the singing voice signal of the singer input via the microphone 17 -A / D converter 18. Mix the signal with an appropriate balance. The mixed digital audio signal is input to the sound system 15. The sound system 15 includes a D / A converter and a power amplifier. The input digital signal is converted into an analog signal, amplified, and emitted from the speaker 16. The effect that the mixer 14 gives to each audio signal and the balance of mixing are controlled by the CPU 10.

  The singing voice signal converted into a digital signal by the A / D converter 18 is also input to the vocal adapter 19. The vocal adapter 19 calculates the singing frequency from the input singing voice signal and also calculates the reference frequency input from the music sequencer 31 of the CPU 10. And this singing frequency and a reference frequency are synchronized and it inputs into CPU10 (scoring mode process 34) every 30 ms. As the reference, guide melody data included in the song data is used. The determined frequency is expressed as a cent value from C0.

  The background video data 41 stored in the HDD 11 is encoded in the MPEG2 format, and the background video reproduction program 33 executed by the CPU 10 reads it and inputs it to the MPEG decoder 20. The MPEG decoder 20 converts the input MPEG data into an NTSC video signal and inputs it to the synthesis circuit 21. The synthesizing circuit 21 is a circuit that synthesizes an OSD such as a lyrics telop or a scoring result display on the video signal of the background video. The synthesized video signal is displayed on the monitor display 22.

  The operation unit 23 includes a panel switch interface, a remote control receiving circuit, and the like, and inputs an operation signal to the CPU 10 according to the operation of the panel switch and the remote control device by the user. The CPU 10 detects this operation signal by the operation input processing program 35 and executes a corresponding process. The operation input processing program 35 is included in the system program.

  The panel switch and the remote control device are provided with various key switches for selecting a song number and selecting a mode such as a scoring mode.

  When a song number is input with a panel switch or a remote control device, the operation input processing program 35 detects this and transmits it to the sequencer 30 as a request for a karaoke song. In response, the sequencer 30 reads the song data of the karaoke song identified by this song number from the song data storage area 40 of the hard disk 11. The sequencer 30 includes a song sequencer 31 and a lyrics sequencer 32, and the lyrics sequencer 32 includes a character pattern creation program 32a. The music sequencer 31 reads the data of tracks such as performance data tracks and guide melody tracks in the music data, and controls the sound source 13 with this data to generate performance sounds of karaoke music. The lyrics sequencer 32 reads the data of the lyrics track in the song data, creates a lyrics telop image pattern based on the data, and outputs the image pattern to the synthesis circuit 21. Further, the background video reproduction program 33 reads predetermined background video data in accordance with an instruction from the sequencer 30 and inputs it to the MPEG decoder 20.

  Here, the music data stored in the hard disk 11 will be described with reference to FIG. As shown in FIG. 1A, the song data includes a musical sound track for playing a karaoke song, a guide melody track for generating a guide melody, a lyrics track for displaying a lyrics telop, and a break in the song. The mark data track is written with mark data to be indicated. The song data has a header, audio data, audio data control track, etc. in addition to this, but it is omitted in this figure for the sake of simplicity.

  Each track is described according to the MIDI format. For example, the guide melody track is composed of event data such as note-on event data and note-off event data and timing data indicating the read timing of each event data, as shown in FIG. The note-on event data includes pitch data, and specifies the pitch of a musical tone (guide melody) generated by the note-on. This musical tone continues until the next note-off event data is read out.

  The timing data can be composed of duration data indicating the time interval between the event data, absolute time data indicating the absolute time from the start time of the music, and the like.

  The event data of the musical tone track and the guide melody track is composed of the note event data indicating the pitch, volume, on / off, etc. of the musical tone as described above, and by inputting this note event data to the sound source 13, the sound source Reference numeral 13 sounds or mutes the musical sound corresponding to the event data. The musical sound track is composed of a plurality of tracks (parts) for generating musical sounds of a large number of musical instruments, and the guide melody track is composed of single melody MIDI data for guiding the singing melody.

  Also, mark data indicating various break points in the karaoke song is written in the mark data track. Mark data includes the first chorus mark written at the beginning and the first chorus, the interlude mark written at the first chorus and interlude, the second chorus mark written at the second chorus and the second chorus. There is an ending mark or the like written at the separation between the eyes and the ending, and a rust start mark and rust end mark written at the start / end points of rust in each chorus. This mark is synchronized with the musical tone generated by the performance track and the guide melody track, and is described as a system exclusive message.

  On the other hand, the event data of the lyrics track is sequence data in which the lyrics telop of the karaoke song is implemented by system exclusive data, and has event data different from the musical tone track and the guide melody track. The event data is page break data, lyrics display data, and the like.

  In the performance of karaoke music in the normal mode, the sequencer 30 generates the karaoke performance sound and displays the lyrics telop as described above. In the scoring mode, the scoring process is performed by the scoring mode processing program 34 in addition to this. The action is executed.

  In order to execute the scoring mode processing program 34, a storage area as shown in FIG. This storage area is an area where the singing frequency and the reference frequency output from the vocal adapter 19 every 30 ms are sequentially stored in time series, and the LPF singing obtained by LPF processing (see FIG. 4) for the singing frequency and the reference frequency. An area for storing frequency and LPF reference frequency, an envelope of amplitude (singing volume level) is detected from the singing voice signal, and an area for storing the singing level value, and input from the song sequencer 31 via the vocal adapter 19 This is an area for storing note-on information, note-off information, and mark data information. The scoring mode processing program checks the input buffer every 30 ms, takes in the various data, and writes it into the list memory.

Here, with reference to the functional block of FIG. 4, the process of each part at the time of scoring mode is demonstrated.
The singing voice signal input from the microphone 17 is converted into a digital voice signal by the A / D converter 18 and input to the vocal adapter 19 (at the same time input to the mixer 14, but only the operation in the scoring mode is described here. To do). The vocal adapter 19 outputs the digital audio signal as it is to the scoring mode processing program 34, detects the singing frequency (cent value) by the singing frequency detection unit 102, and outputs it to the scoring mode processing program 34.

  On the other hand, reference data is input from the song sequencer 31 to the reference frequency detector 101 of the vocal adapter 19 in synchronization with the performance of the karaoke song. As described above, guide melody data is used as the reference data. The reference frequency detector 101 extracts pitch information from the note-on event data of the input MIDI data, and outputs the pitch cent value as a reference frequency to the scoring mode processing program 34.

  Since the vocal adapter 19 receives control information such as note-on information, note-off information, and mark data information from the music sequencer 31, the vocal adapter (reference frequency detection unit 101) uses the scoring mode processing program 34. Output to. The reason why the music sequencer 31 does not directly input the scoring mode processing program 34 is to synchronize the control information such as the note on / off information with the singing frequency data and the reference frequency data.

  The detection of the singing frequency by the singing voice detection unit 102 and the detection of the reference frequency by the reference frequency detection unit 101 are performed in synchronization every 30 ms, and the detection result is input to the scoring mode processing program 34 every 30 ms.

  The scoring mode processing program 34 writes the input singing frequency and reference frequency in the list memory of FIG. 3, and performs low-pass filter (LPF) processing (105, 106) on these frequency data. The LPF process for the reference frequency is a process for smoothing the pitch change of a reference (see FIG. 5A), which is a mechanical pitch sequence, and approaching a human song. Further, the LPF processing for the singing frequency is processing for obtaining flat singing frequency information by removing techniques such as vibrato.

  The low-pass filter process will be described with reference to FIG. FIG. 5A shows an example of guide melody data used as a reference. The reference data is mechanical data in which the pitch changes discontinuously at an accurate beat timing even in a legato section in which notes are continuous. By performing LPF processing on such a discontinuous reference, the pitch gradually changes between notes as shown in FIG. It is possible to make the pitch change similar to that of singing. Note that rest sections where notes are interrupted, places where singing with non-legato, etc. are excluded from the LPF processing. As a result, it is possible to prevent the LPF processing from becoming unnatural due to the data of the section without sound.

  FIG. 6C is a diagram showing an example of singing voice frequency data. The singing voice frequency has a gentle transition (so-called “scribbling”) at the transition of notes (pitch), and has a periodic frequency change such as vibrato in the stretched part of the sound. . By performing LPF processing on this singing voice frequency data, it is possible to remove fine frequency changes such as overshoot and vibrato in the squeaky part, as shown in Fig. 4 (D), and accurately extract the frequency that was sung. Will be able to.

  The audio signal input from the microphone 17 includes various noises as well as the singing audio signal. When the level of the noise component is large, the frequency detection unit 102 may detect the frequency by regarding the noise component as a singing voice signal. If such a noise component is input to the LPF processing unit 106, not only the one sample but also erroneous data will be output after that. Therefore, if there is a sudden pitch change of 150 cents or more, which is difficult to consider as a frequency change of the singing voice, ignore the data (adopt the previous sample data again) and perform LPF processing. , It can prevent adverse effects due to noise.

  Since the data sequence of the singing frequency and the reference frequency is discrete data every 30 ms, the LPF processing unit 106 for the singing frequency uses a secondary filter with a cut-off frequency of 5.5 Hz in order to suitably achieve the above processing. The LPF processing unit 105 for the reference frequency uses a secondary filter having a cutoff frequency of 5 Hz.

  The LPF-processed singing frequency (LPF singing frequency) and reference frequency (LPF reference frequency) are written in the list memory of FIG. The scoring unit 107 in FIG. 4 compares the singing frequency with the reference frequency, calculates a difference (cent value), and determines a pass note and a fail note for each note (note) based on the difference. Since the note-on information / note-off information is input from the reference frequency detection unit 101 to the scoring unit 107, the singing frequency matches the pitch of the singing melody for a predetermined (one or more) samples ( If the number of times the singing frequency matches the pitch of the singing melody is less than the above-mentioned predetermined sample, the “failed note” is determined. It is determined that

  The basic score is calculated by two types of methods, and the higher score is adopted. The first method calculates the basic score based on the value obtained by dividing the number of accepted notes by the total number of notes, and the second method ranks (weights) the accepted notes according to their length. The basic score is calculated based on a value obtained by dividing the weighted total value of the accepted notes by the total number of notes.

  In the first method, 50 to 95 points are calculated by adding 50 to a value obtained by dividing the number of accepted notes by the total number of notes and multiplying by 45. The reason why 50 points are obtained at the minimum is that the karaoke apparatus is an entertainment apparatus. The reason why the highest score is 95 is that when the additional points described later are added, the maximum score becomes 100 points.

  Also, in the weighting scoring that is the second method, the number of accepted notes is totaled for each rank, multiplied by the respective weighting factors, the sum of the weighted values is divided by the total number of notes, and this divided value 50 is added to the value obtained by multiplying (quotient) by 45 to calculate a score of 50 to 95 points.

  FIG. 6A is a diagram showing ranking and weighting of each rank. Since shorter notes are more difficult to match the singing pitch, the shorter notes are given greater weight. In this example, a note having a length of 10 samples (300 ms) or less is given as a rank A, and a weight of 1.2 is given. In addition, a note longer than 33 samples (about 1 second) is set to C rank, because it is a long note that can be easily sung, and has a weight of 0.8. The middle 11 to 33 sample notes are given normal weights and given a weight of 1.

  Moreover, in the said embodiment, although the notebook is ranked into three steps of A / B / C based on the length of time, ranking is not limited to three steps. Moreover, the boundary line of each rank is not limited to 10 samples and 33 samples. Moreover, the weighting coefficient of each rank is not limited to 1.2 / 1.0 / 0.8.

  Instead of classifying each note into a plurality of ranks, as shown in FIG. 6B, a weighting coefficient corresponding to each length may be given. This change curve (including straight lines and broken lines) is not limited to the illustrated one.

  Moreover, in the said embodiment, although the passing note is weighted with the length, you may make it weight a failure note and weight a point. That is, in the above embodiment, the passing notes are accumulated with a weight of 1.2 / 1.0 / 0.8, and the failing notes are uniformly 0, but even if the failing notes are short notes, In this case, a score of about 0.1 to 0.8 is added instead of 0. Also, when a long note fails, a point may be deducted instead of 0.

  Next, in addition to the singing frequency, this scoring mode processing program detects singing elements such as singing vibrato, intonation, voice quality, timing, and screaming, and based on this, calculates additional points to obtain the basic score. The final score is obtained by adding (subtracting). The weight of this additional point varies depending on the size of the basic score, and the higher the basic score, the lower the point (in a direction in which the added points decrease).

Hereinafter, a method for detecting and determining each singing element will be described.
FIG. 7 is a diagram illustrating a method for detecting sneezing. For detection of this squealing, a raw singing frequency data sequence and a reference frequency data sequence not subjected to LPF processing are used.

  Shakuri is a singing technique that gradually and smoothly raises the pitch when the rising tone form as shown in the singing frequency curve of FIG. The start of the rise almost coincides with the start timing of the later note, and the singing frequency reaches the reference frequency of the note later. Detected based on whether the singing frequency change curve satisfies the condition that the pitch gradually increases from around the note start timing, and if there is a singing frequency change that meets this condition, Judged as a skill of singing.

As a rule for judging whether or not the condition of the squealing is satisfied (1) The singing frequency and the reference frequency are separated by a certain distance at the note start timing. (2) Eventually, the singing frequency is within the allowable range of the reference frequency. (3) Singing frequency rises smoothly FIG. 7 (A) shows a change in singing pitch that meets this condition. Here, in order to determine the above three conditions, in the scoring mode processing program, it is checked that the singing frequency is not applied to the hatched portion (prohibited area) in FIG. That is, when the singing frequency does not enter the prohibited area and becomes a passing note, it is determined that the skill is scooping. In the case of more strict determination, it may be determined whether or not the singing frequency curve passes between the oblique broken line and the prohibited area shown in the figure.

In addition to the rules (1) to (3) above, when judging a more advanced skill,
(4) Add a rule that the frequency once decreases before the singing frequency starts increasing. If the singing frequency changes in this way, squealing will be emphasized. An example of the change curve of the singing frequency that satisfies this condition is shown in FIG. It can be seen that the singing frequency is once lowered at the position of the white arrow in the figure, and is a change curve that conforms to the rule (4).

  If the screaming is detected, the monitor 22 displays that the screaming “shearing” has been performed. After the end of the karaoke song, the screaming point is calculated based on the number of screaming detected in the song and added to the basic score.

  FIG. 8 is a diagram for explaining a timing (difference) detection method. FIG. 9 is a diagram illustrating a timing point table for calculating timing points based on the timing difference. For the detection of this timing difference, a singing frequency data sequence and a reference frequency data sequence that are not normally subjected to LPF processing are used, but an LPF singing frequency data sequence subjected to LPF processing may be used for the singing frequency.

  In FIG. 8, when the singer operates the utterance while trying to sing a note (note), the singing timing is the singing timing, and when singing is started from a portion where there is no song such as singing, As shown, the singing voice is input to the singing frequency detection unit 102, and the timing d at which the frequency detection is started is set as the singing timing. The time difference between the singing timing and the reference sounding timing R is the timing difference.

  On the other hand, when a plurality of notes are continuous in legato singing or the like, the timing a when the singing frequency approaches within a predetermined range (allowable range) near the sounding timing R as shown in FIG. To do.

  Moreover, it is good also as a singing timing catching the timing when the singer started trying to transfer to this note from the previous note. That is, in FIG. 6A, the timing b at which the pitch change starts immediately before the timing a approaching within the allowable range, the timing c at which the change slope becomes a predetermined value or more, and the like are set as the singing timing. May be.

  Note that FIG. 4A describes the change (rise) from a note with a low pitch to a high note, but the top and bottom is only inverted for the change (down) from a note with a high pitch to a low note. The same is true.

  In addition, the singing timing a in FIG. 9A is a delay direction, and the singing timings b and c and the singing timing d in FIG. Is not to be done.

  In addition, the range in which the timing difference between the sound generation timing R and the singing timings a, b, and c is detected is 1/2 to 1/1 each of the length of the previous note and the subsequent note (note generated at the sound generation timing R). A range of up to about 3 is acceptable. This is because even if the singing frequency meets this condition at a timing further away, it cannot be specified that this is a pitch change for the pronunciation of this note.

  The above singing timing detection method detects the singing timing by monitoring the change of the singing frequency. However, the method shown in FIG. The reference frequency and the singing frequency of the note and the subsequent note are moved in the time axis direction to obtain a cross-correlation, which determines the maximum position, and the position of the maximum cross-correlation and the original data position. Let the amount of deviation be the timing difference (e). With this method, the singing timing can be determined based on not only the waveform at the time of pitch change but also the waveform of the entire note.

  In the above comparison, instead of simply comparing the singing frequency and the reference frequency at the same timing, the reference frequency is moved back and forth on the time axis, and the corresponding singing voice is at a position where the cross-correlation between both sample sequences is maximum. The frequency is compared with the reference frequency. Cross correlation is

  However, it is also possible to take the difference between samples corresponding to each other when shifted and to set the position where the integrated value of the difference is minimum as the maximum correlation point.

  When the timing difference is detected by the above method, the timing point is determined by referring to the timing point table based on the timing difference.

  FIG. 9 is a diagram illustrating an example of a timing point table. FIG. 4A shows an example of a timing point table corresponding to “enka”. In the case of enka, in order to deal with “song” which is a singing technique that is delayed from just timing, a large + point (additional point) is given within the range of delay from just timing. On the other hand, since a singing song (push-in) is heard in impatience, a minus point (decrease) is given.

  On the other hand, FIG. 5B shows an example of a timing point table corresponding to “pops” karaoke songs. In the case of pops, since the rhythm is engraved with an accurate beat, singing is also required to be just timing, and it becomes a point even if it is greatly delayed or greatly advanced. A + point is given in the range of just timing and the range of slight advance.

  When a karaoke song is selected, a timing point table is selected according to the genre of the karaoke song, and a timing point is determined for each singing note. And when a karaoke song is complete | finished, the average value of all the timing points is calculated, and it is set as a timing point.

  FIG. 9 shows only timing point tables for enka and pop karaoke songs. However, timing point tables for various other genres may be provided. You may apply to all karaoke songs. The timing point calculation method is not limited to the timing point table, and other methods such as a function may be used.

  In this embodiment, the timing point table is provided for each genre, but may be provided for each karaoke song. For example, a timing point table may be included in the song data of karaoke songs, and delivered together with the delivery of karaoke songs. And in the case of the old music data which does not have the timing point table according to music, the timing point table according to the genre provided beforehand should just be used.

  FIG. 10 is a diagram illustrating a method for detecting intonation. Judgment is made for each phrase. A phrase is a unit of one segment of a singing segmented by rests or sound cuts. FIG. 10 shows one phrase. Since the singing is interrupted before and after the phrase, the volume envelope is almost silent. By monitoring the volume envelope, the scoring mode processing program 34 can detect a phrase.

  First, a method for determining inflection based on an average value in a phrase will be described with reference to FIG. When the volume envelope data for one phrase is accumulated, the average value Aa is first obtained. Then, each note section is divided based on reference note-on information and note-off information, and volume average values A1 to An for each note are obtained. And the average deviation with average value Aa of the whole phrase of average value A1-An of each note is calculated | required.

  Next, a method for determining inflection based on a peak value in a phrase will be described with reference to FIG. When the volume envelope data for one phrase is accumulated, first, the peak value Pa in the phrase is obtained. Then, each note section is divided based on reference note-on information and note-off information, and volume peak values P1 to Pn for each note are obtained. Then, an average value (average deviation) of differences between the peak values P1 to Pn of each note and the peak value Pa in the phrase is obtained.

  And after completion | finish of a karaoke song, the average value of the average deviation of all the phrases is calculated | required, and an inflection point is calculated based on this value.

  For detection of inflection, raw data that has not been subjected to LPF processing may be used, or LPF data that has been subjected to LPF processing may be used.

  Vibrato is determined using a raw singing frequency data sequence that has not been subjected to LPF processing, and detecting the periodicity of frequency fluctuations of the singing. When periodicity is detected, it is determined that there is vibrato. When the presence of vibrato is detected, the point size is determined by the magnitude of the amplitude (frequency fluctuation).

  The voice quality is determined by passing the input singing voice waveform through a band pass filter (BPF) in the fundamental frequency band and a BPF of the harmonic component, and comparing the magnitude of the fundamental frequency component with the magnitude of the harmonic component. The higher the overtone component ratio (closer to the level of the fundamental frequency component), the better the voice quality, the higher the point.

Processing of the scoring mode processing program 34 will be described with reference to the flowcharts of FIGS. 11 and 12.
FIG. 11 is a flowchart showing the scoring processing operation of the scoring mode processing program 34. In this operation, the input register is checked every 30 ms, and singing level data, singing frequency sample data, reference frequency sample data and volume level value (volume envelope sample value), note on / off information, and mark data information are stored. It monitors whether it has been input. When the singing level data, singing frequency and reference frequency are input (s1), the singing level data is first written in the list memory (see FIG. 3) (s5), and the raw singing frequency data and reference frequency data not subjected to LPF processing are written. Is written into the list memory (s6). Then, LPF processing is executed on both the singing frequency data and the reference frequency data (s7), and the sample data subjected to the LPF processing is written in the list memory (s8).

  When note-on information is input from the vocal adapter 19 (s2), it is written in the list memory (s10). The position where the note-on information is written corresponds to the sound generation timing R of the reference in the timing detection of FIG.

  When note-off information is sent (s3), it is written in the list memory (s11), and the pass / fail of the scoring target note is based on the LPF singing frequency data and the LPF reference frequency data stored in the list memory. A pass is determined (s12). This determination is a pass / fail determination based on the pitch (frequency difference). Further, scoring for various scoring elements is executed (s13 to s15). In s13, vibrato is determined. As described above, the vibrato is detected by detecting the periodicity of the singing frequency data sequence not subjected to the LPF process, and when there is a periodicity, it is determined that there is vibrato, and ranking is performed according to the frequency variation depth. It is processing to do.

  In s14, the timing is determined. This timing determination is a process of detecting the time difference between the change of the singing frequency and the change of the reference frequency as shown in FIG. 8, and subtracting the timing point table of FIG. 9 from this time difference to determine the timing point.

  In s15, the presence / absence of sneezing is determined. The determination of sneezing is to determine whether the singing frequency changes with a waveform that satisfies the conditions shown in FIG. 7. Count up the number of times. After the end of the karaoke song, a scoop point is determined based on the number of scoops.

  After the above pass / fail note determination and various singing element determinations, the pass / fail result and determination result are stored (s16), and the process returns to the standby routine. Then, the above process is repeated for each note-off. When the music ends (s4), the score totaling process (s17) is executed.

  FIG. 12 is a flowchart showing the score totaling process. This operation is performed in s17. First, the total number of notes and the number of accepted notes are totaled (s30), the value obtained by dividing the number of accepted notes by the number of all notes is multiplied by 45 and 50 is added to calculate the first basic score (s31). Next, the passing notes are weighted and summed based on the ranking of the note length (s32), and a value obtained by dividing the summed value by the total number of notes is multiplied by 45 and 50 is added to calculate a second basic score. (S33). Of these first and second basic scores, the higher score is adopted as the basic score of this song (s34).

  Next, various singing elements are tabulated. First, inflection is determined (s35). The determination of inflection is processing for obtaining a deviation by comparing the average value or peak value of each note with the average value or peak value of a phrase as shown in FIG. The greater the deviation, the greater the inflection. Then, based on the average value of the deviations of all phrases, the inflections are ranked into five levels A, B, C, D, and E.

Then, based on the rank and the basic score, an inflection point is determined by referring to the point calculation table of FIG. 13A (s36).
This point calculation table is a table for determining how many points are given to each rank of A, B, C, D, and E according to the basic score. The higher the basic score, the lower the score to be given. When the basic score is high, minus points are given to low ranks (C, D, E). Thereby, in the case of a singer (a good singer) with a high basic score, each singing element is also not good if it is not good.

  Next, the voice quality is determined (s37). During the performance of a karaoke song, a singing voice signal at an appropriate location is stored, and the voice quality is determined using the singing voice signal. In this determination process, the singing voice signal is passed through the BPF in the fundamental frequency band and the BPF in the harmonic frequency band, and the voice quality is ranked in five stages of A, B, C, D, and E according to the magnitude of the harmonic component. The higher the harmonic component, the higher the rank (A, B, etc.). Based on this rank and the basic score, a voice quality point is determined by referring to the point calculation table of FIG. 13A (s38).

  Next, the results of vibrato determination performed for each note are tabulated, and the vibrato is ranked into five levels of A, B, C, D, and E (s39). For example, the ranking is determined in such a manner that the higher the vibrato accumulated time, the higher the rank. The determination of vibrato may be performed for each note in the processing operation of FIG. Based on this rank and the basic score, a vibrato point is determined by referring to the point calculation table of FIG. 13A (s40).

  Next, the timing difference evaluations are totalized, and the timing is ranked into five levels of A, B, C, D, and E (s41). Based on this rank and the basic score, the point calculation table of FIG. 13A is referred to determine a timing point (s42).

Next, the number of times of sneezing is totaled, and the number of times of sneezing is ranked into five levels of A, B, C, D, and E (s43). Based on this rank and the basic score, the point calculation table in FIG. 13B is referred to, and a timing point is determined (s44).
The point calculation table in FIG. 13B is a table set so as to give a plus point only when the basic score is low, and when the basic score becomes 70 points or more, for example, this singing element (shakuri) is not considered in the score. .

  The total score is calculated by adding the points of the various singing elements calculated in the above process to the basic score (s45). If the basic score is 95 points and all of the singing elements excluding screaming are in A rank, it will be 99 points, but only in that case it will be determined whether or not screaming is A rank, and in the case of A rank The total score is 100 points. It may be a scoring method in which the total score may exceed 100 points. Eventually, it may be rounded to 100 points. The total score (final score) calculation method is not limited to this.

  In s46, it is determined whether the total score is 60 points or more (s46). If the score is 60 or more, the score is displayed on the monitor 22 as the final score (s49).

  If the score is less than 60, a search is made as to whether any one of the five singing elements has an A rank (s47). If there is at least one A rank, 70 points are determined as the final score as a bonus score regardless of the total score, assuming that there is “one performance” (s48). If there is no A rank, the total score is used as the final score. Thereafter, the final score is displayed on the monitor 22 (s49).

  In this way, giving a suitable (not low) score for a singing song, regardless of the final score of the scoring result, is because such a song will boil the audience, Is evaluated.

  The threshold score for evaluating one performance is not limited to 60 points. Also, the number of points determined as bonus points is not limited to 70 points.

  In this embodiment, the basic score is calculated by scoring the singing frequency as a basic singing element, and additional points are determined by determining vibrato, intonation (volume), voice quality, timing, and sneezing as various singing elements. However, volume and timing may be added in addition to frequency as a basic singing element. Moreover, various singing elements are not limited to the above. Some of them may be added, and other elements may be added.

  Further, the point calculation table is not limited to that shown in FIG. In this embodiment, the same point calculation table is applied to the vibrato, intonation (volume), voice quality, and timing, but the additional points are calculated. However, a separate point calculation table is applied to each singing element. You may make it do. Further, the ranking is not limited to five levels. Furthermore, it is not limited to the stepwise rank division (point change), and a point value that continuously changes according to the determination result may be given.

The block diagram of the karaoke apparatus which is embodiment of this invention The figure which shows the structural example of the song data used with the karaoke apparatus The figure which shows the structure of the list memory of the karaoke apparatus The figure which shows the functional block of the scoring process of the karaoke apparatus The figure explaining LPF processing in the karaoke apparatus The figure explaining ranking of notes of the karaoke device The figure explaining the detection method of sneezing in the karaoke apparatus The figure explaining the detection method of the timing difference in the karaoke apparatus The figure which shows the example of the table which calculates the timing point in the karaoke apparatus The figure explaining the detection method of intonation in the karaoke apparatus Flow chart showing scoring processing operation of the karaoke apparatus The flowchart which shows the score totaling process of the same karaoke device The figure which shows the example of the point calculation table of the karaoke apparatus

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... CPU, 11 ... Hard disk, 12 ... RAM, 13 ... Sound source, 14 ... Mixer, 15 ... Sound system, 16 ... Speaker, 17 ... Microphone, 18 ... A / D converter, 19 ... Vocal adapter, 20 ... MPEG decoder, 21 ... Synthesis circuit, 22 ... Monitor, 23 ... Operation part,
30 ... Sequencer, 31 ... Song sequencer, 32 ... Lyric sequencer, 32a ... Character pattern creation program, 33 ... Background video playback program, 34 ... Scoring mode processing program, 35 ... Operation input processing program,
40 ... song data storage area, 41 ... background video storage area, 43 ... scoring log,
DESCRIPTION OF SYMBOLS 101 ... Reference frequency detection part, 102 ... Singing frequency detection part, 105, 106 ... Low pass filter process part, 107 ... Scoring part, 108 ... Envelope detection part

Claims (8)

A karaoke apparatus comprising performance means for playing a karaoke song, singing input means for inputting singing voice, and scoring means for scoring the input singing voice,
The scoring means is
(1) The singing frequency and the reference frequency are more than a certain distance at the note start timing.
(2) Ultimately, the singing frequency must be within the allowable range of the reference frequency.
(3) The singing frequency should rise smoothly
  A karaoke device that scores whether or not the song is sung with the skill of screaming, which is a singing skill that gradually raises the pitch when the melody is in the rising tone form, based on whether or not it conforms to the rules including . The scoring means further includes
(4) The single point frequency drops before the singing frequency starts to rise.
The karaoke apparatus according to claim 1, wherein the karaoke apparatus scores whether or not the song is sung with the skill of the shawl based on whether or not the rule is satisfied. A performance means for performing karaoke songs;
Singing input means for inputting singing voice;
Singing frequency detection means for detecting the frequency of the input singing voice;
Storage means for storing rules for scoring technical singing elements;
Scoring means for scoring the input singing voice;
A karaoke device equipped with
The performance means forms a musical sound signal of the karaoke song based on the music data, and outputs a reference frequency synchronized with the musical sound signal of the karaoke song,
The scoring means is
Frequency scoring means for scoring by comparing the frequency of the singing voice with the reference frequency and calculating a basic score;
Singing element scoring means for scoring technical singing elements of the singing voice using the rules and calculating additional points;
A final score calculating means for obtaining a final score by adding the additional points to the basic score;
A karaoke apparatus comprising:   The karaoke apparatus according to claim 3, wherein the frequency scoring unit scores the singing voice for each note, and calculates a basic score by totaling the scoring results for each note. The frequency scoring means is scored by using a low-pass filtered frequency of the singing voice detected by the singing frequency detecting means,
The singing element scoring means scores using the frequency of the singing voice detected by the singing frequency detecting means as it is.
The karaoke apparatus of Claim 3 or Claim 4 . The singing element scoring means, as the technical singing element,
Vibrato, which is the periodic frequency variation of the singing,
Inflection, which is the variation in volume within a singing phrase
Singing sound quality,
Singing timing of each note,
Scribbling, which is the transition waveform of the pitch,
The karaoke apparatus according to any one of claims 3 to 5, wherein one or more singing elements are scored. The singing element scoring means is:
(1) The singing frequency and the reference frequency are more than a certain distance at the note start timing.
(2) Ultimately, the singing frequency must be within the allowable range of the reference frequency.
(3) The singing frequency should rise smoothly
  Whether or not the song is sung with the skill of screaming, which is a singing skill that gradually raises the pitch when the singing melody is in a rising tone form, based on whether or not it conforms to the rules including
  The karaoke apparatus according to any one of claims 3 to 5. The singing element scoring means further includes:
(4) The single point frequency drops before the singing frequency starts to rise.
8. The karaoke apparatus according to claim 7, wherein the karaoke apparatus scores whether or not the song is sung based on whether or not the rule is satisfied.

Images