JPS6135479A - Scorer - Google Patents

Abstract

(57) [Summary] This bulletin contains application data before electronic filing, so abstract data is not recorded.

Description

[Detailed Description of the Invention] Industrial Application Field The present invention is used in conjunction with an audio signal recording/reproducing device such as a karaoke machine to compare an audio signal sung by a user with an audio signal reproduced from a standard magnetic tape or the like. This invention relates to a scoring device that automatically scores a user's singing ability.

Conventional configurations and their problems One field of audio equipment is the reproduction of music signals played by musical instruments recorded on recording media such as magnetic tape.

The sound is amplified, and when the user sings along with this, the sound is mixed with the performance music signal and amplified. There is something commonly called ``Karaoke Machine-1'', which is widely used for general home or business use.

By singing using the above-mentioned "karaoke device," users can gain joy and satisfaction, but in recent years, an increasing number of people want to improve their singing ability.
Some people seek guidance from singing teachers to improve their singing ability, but it is not something that anyone can do.One way to study singing on your own is by using a magnetic tape called ``audio multiplex tape.'' Audio multiplex recording media such as tapes are rapidly becoming popular. In the case of a magnetic tape as an example of this audio multiplexing recording medium, as shown in FIG. These performance music signals are recorded respectively. When using this magnetic tape, an audio multiplexing system with the configuration shown in Figure 2 is used.
A karaoke device is used to transfer the vocal signals and performance music signals recorded on the magnetic tape 1 to the magnetic head 201.
A first magnetic tape reproducing means 2 consisting of an amplifier 202 and a second tape reproducing means 3 consisting of a magnetic head 3o1 and an amplifier 302 reproduce these two outputs to a microphone input means consisting of a microphone 401 and an amplifier 402. The mixed amplifier 5 mixes and power-amplifies the output of the signal and outputs the signal from the speaker 6 as an acoustic signal.

It is said that you can improve your singing ability by listening to vocal signals recorded on a recording medium using the above device and practicing singing along with the vocal signals yourself, but no matter how much you practice, However, the drawback is that users themselves cannot tell how close their singing style is to the modeled vocal signal, in other words, how much their singing ability has improved. Also, even if you are singing the wrong way, the user will not notice it! ! ,
This has the disadvantage that when practicing on an individual basis, there are limits to the practice, and there are many cases where one loses interest and loses the desire to practice67,-.

OBJECT OF THE INVENTION The present invention solves the above-mentioned conventional problems, and compares the vocal signal recorded on an audio multiplexing recording medium with the audio signal sung by the user, and calculates the degree of matching as a score. The purpose is to provide an objective means of evaluating the user's singing ability by displaying the information.

Structure of the Invention The scoring device of the present invention includes a first scale change detection means for detecting a change in pitch of a first audio signal inputted, and a change in pitch of a second audio signal inputted. a second scale change detection means for detecting the change in pitch; and a first counting storage means for counting and storing the number of changes in pitch of the first audio signal;
A second device that counts and stores the number of changes in height of the second audio signal.
a first pitch detection means for detecting the fundamental frequency of the first audio signal; a second audio signal detection means for detecting the fundamental frequency of the second audio signal; a level change detection means for detecting a change in the signal level of the audio signal; and a comparison operation between the information stored in the first count storage means and the information stored in the second count storage means. , the degree to which the first audio signal matches the second audio signal in scale change is calculated as a score P1, and the level change detection means detects that the level of the second audio signal has changed. Comparing and calculating the fundamental frequency of the first audio signal, which is the output of the first pitch detection means near the time, and the fundamental frequency of the second audio signal, which is the output of the second pitch detection means. Then, the degree to which the pitches of the first audio signal and the second audio signal match is calculated as a score P2, and the score P1
and the score P2 to calculate a total score, and a score display means to display the score. With this configuration, the user's singing voice signal as the first voice signal, and the second voice as the first voice signal. By using the reproduced audio signal of the vocal signal recorded on the recording medium as a model song as the signal, the score is determined by how well the user's singing audio signal matches the reproduced audio signal of the vocal signal on the recording medium. The user can recognize the level of his or her singing ability compared to the vocal signal on the recording medium.

DESCRIPTION OF THE EMBODIMENT FIG. 3 is a block diagram showing an embodiment of the present invention. 4
numeral 401 is a microphone and 402 is an amplifier. 2 is a first magnetic tape reproducing means for reproducing the vocal signal recorded on the recording medium of the audio multiplexer;
201 is a magnetic head, and 202 is an amplifier. 7 is the first
This waveform conversion means converts the voice signal sung by the user into a pulse signal. 8 is a second waveform conversion means that converts the vocal signal on the recording medium into a pulse signal. Reference numeral 9 denotes a first scale change detection means, which detects changes in the scale of the voice sung by the user. Reference numeral 10 denotes a second scale change detection means, which detects a change in the scale of the vocal signal. Reference numeral 11 denotes a first counting storage means, which counts and stores the number of changes in pitch of the pitch of the voice sung by the user. Reference numeral 12 denotes a second counting storage means, which counts and stores the number of changes in pitch of the scale of the vocal signal. Reference numeral 13 denotes a first pitch detection means, which detects the fundamental frequency of the voice sung by the user. 14 is a second pitch detection means for detecting the fundamental frequency of the vocal signal. Reference numeral 15 denotes level change detection means, which detects level changes in the vocal signal. 16 is a score calculation means which compares and calculates the number of changes in the pitch of the voice sung by the user and the number of changes in the pitch of the vocal signal, and calculates how much the scale changes between the voice signal sung by the user and the vocal signal. In addition to calculating whether they match as a score P1, the fundamental frequency of the voice sung by the user around the time when the signal level of the vocal signal changes is compared with the fundamental frequency of the vocal signal to determine the voice signal sung by the user and the vocal. The degree to which the pitch matches the signal is determined as score P2, and score P1 and score P
2 and the overall score is calculated.

o1 17 is a score display means, which displays the score in order to inform the user of the score calculated by the score calculation means 16.

FIG. 4 is a block diagram showing the specific configuration of this embodiment.
The functions of detecting scale changes in the user's singing voice, counting and storing the number of changes, and detecting pitches, detecting pitch changes in vocal signals, counting and storing the number of changes, detecting pitches, and calculating scores.
This was realized using a microcomputer 18.

FIG. 5 shows an actual circuit example of the first waveform converting means 7. Normally, the same circuit is often used for the first waveform converting means 7 and the second waveform converting means 8. , 1st
The circuit of the waveform converting means 7 will be representatively explained with reference to the operation explanatory diagram of FIG.

701 is an input terminal, 702.704.705.

708.710,711 are resistors, 703,706°7
09 is a capacitor, 707 is an operational amplifier (hereinafter abbreviated as OP amplifier), 712 is a transistor, and 713 is an output terminal.

OP amplifier 707 and resistors 702 and 704.

11' to 706 and capacitors 703 and 706 constitute a low-pass type active filter, and the high-frequency components of the audio electrical signal input to the input terminal 701 as shown in FIG. 6(a) are At the same time, the necessary signal amplification is performed by the amplification action of the OP amplifier 707, and a time constant circuit consisting of a resistor 708 and a capacitor 709 removes the high-frequency components that are not sufficiently removed by the active filter. auxiliary removal. The audio electrical signal shown in FIG. 6(b) from which the high-frequency components have been removed by the necessary amount is processed by resistors 710, 711 and transistor 712 into a pulse waveform as shown in FIG. 6(c). It will be converted to . In this way, the first waveform converting means 7 converts the user's singing voice signal, which is the output of the microphone input means 4, into a pulse waveform, and the second waveform converting means 8 similarly converts the voice signal sung by the user into a pulse waveform. The vocal signal that is the output of is also converted into a pulse waveform. Further, the level change detection means 16 can be realized by comparing the current level and the previous level using an analog-to-digital converter or a sample-and-hold circuit using conventional analog technology and digital technology.

The operation of this embodiment will be explained below based on the flowchart shown in FIG. 7 which shows the main parts of the processing operation of the microcomputer.

First, it is assumed that the power of the device is turned on and that the memory elements and the like inside the microcomputer 18 have also been initialized. The audio signal sung by the user is turned into an electrical audio signal by the microphone input means 4, amplified, converted into a pulse signal by the first waveform conversion means 7, and inputted to the microcomputer 18. In step 19, the time width of the input pulse is Convert to digital quantity. That is, by counting the H'' period of the pulse signal shown in FIG. 6(0) using the clock signal of the microcomputer itself, the time width of the input pulse can be converted into a digital quantity. In this way, from tl to t2 in FIG. 6(C)
13 conversions are performed in the following order: time width from t5 to t4, time width from t5 to t6, etc. Note that when this time width increases, it indicates that the scale has become lower, and when it decreases, it indicates that the scale has become higher.

Next, in step 20, it is determined whether the time width of the pulse signal has increased proportionally to the previous time width, that is, the sixth
In the pulse signal waveform in Figure (C), if it is the time when the time width from t3 to t4 is currently detected, compared to the time width from tl to t2, which is the data of the previous time width, from t3 to t4.
It is determined whether the time width has increased, and if the time width has increased, in step 22, N11, which indicates the number of times the scale of the user's audio signal has become low, is increased by 1, and the time width is increased. If not, proceed to step 21.

In step 21, it is determined whether the time width of the pulse signal has decreased compared to the previous time width, and if the time width has decreased, step 24 indicates the number of times the scale of the user's audio signal has increased. N13 is increased by 1, and if the time width has not decreased, the process proceeds to step 23, where N12, which indicates the number of times the scale of the user's audio signal does not change, is increased by 1.

14 peno As mentioned above, steps 19, 20.21 realize the function of the first scale change detection means 9, and steps 22.23.2
4 realizes the function of the first count storage means 110.

On the other hand, the vocal signal recorded on the magnetic tape 1 which is an audio multiplexing type recording medium is transmitted to the first magnetic tape reproducing means 2.
The second waveform conversion means 3 converts the input pulse into a Hullless signal and inputs it to the microcomputer 18. In step 25, the time width of the input pulse is converted into a digital quantity, and in step 26, the time width is changed to the previous time width. If the time width has increased, N2j, which indicates the number of times the scale of the vocal signal has become lower, is increased by 1 in step 28, and if the time width has not increased, it is determined whether the time width has increased. Proceed to step 27. In step 27, it is determined whether the time width of the pulse signal has decreased compared to the previous time width, and if the time width has decreased, step 3o indicates the number of times the scale of the vocal signal has become higher.N23
is increased by 1, and if the time width is decreasing, go to step 29 (15).

N2 indicates the number of times the scale of the vocal signal does not change.
Increase 2 by 1.

As mentioned above, steps 25, 26, and 27 realize the function of the second scale change detection means 1o, and steps 2B, 29
．． 30 realizes the function of the second count storage means 12. '□゛□゛Next, in step 31, similarly to step 19, the time width of the pulse signal of the voice signal sung by the user is converted into a digital quantity and stored. That is, by counting one period of the pulse signal shown in FIG. 6(C) using the clock signal that the microcomputer itself has, the time width of the input pulse can be converted into a digital quantity. In this way, from tl to t in FIG. 6(0)
Conversion is performed in the order of time width 5, time width from t5 to t5, time width from t5 to tl, and so on. Note that this time width is the reciprocal of the fundamental frequency of the audio signal, and when it increases, it indicates that the pitch has become lower, and when it decreases, it indicates that the pitch has become higher.

Next, in step 32, the time width of the pulse signal of the vocal signal recorded on the magnetic tape is converted into a digital amount and stored.

As described above, steps 31 and 32 implement the functions of the first pitch detection means 13 and the second pitch detection means 14, respectively. .

Next, the output signal of the level change detection means 16 is input to the microcomputer 18, and it is determined in step 33 whether or not the signal level has increased.
Proceed to step 4. Here, two types of time widths, which are information on the fundamental frequencies of the two audio signals, are compared, and a determination is made in step 35. If there is a match here, the process advances to step 36 and 1 is added to the number of matches N. On the other hand, if they do not match, the process proceeds to step 37, and 1 is added to the number of non-matches ND.

Next, in step 38, it is determined whether it is time to start scoring. The decision to start scoring may be based on information from a push button switch (not shown) that designates the start of scoring, or the performance music 17.7 recorded on the magnetic tape 1 may be used. The presence or absence of the signal may be detected and the scoring may be started when the performance music signal disappears. It is also possible to record an end signal indicating the end of the song in advance, and use the point in time when the end signal is detected or the point in time when the end of the magnetic tape is detected.

If it is not yet the time to start scoring, the process proceeds from step 38 to step 19, where N11. N12. N15゜'21 + N22
+N25 data collection, etc. will be carried out.

Then, when it comes time to start scoring, the process proceeds from step 38 to step 39, where the score is calculated. Step 39 has the function of score calculation means 16.

First, the scale change score P1 will be explained. This score is calculated based on time width change data N11+''12+N15*N2j of the pulse signal created from the user's voice signal and the vocal signal of the magnetic tape 1.

It is based on N23 and is calculated to give a maximum of 30 points. An example of the formula for calculating the score is α, β,
With γ as a constant, score P1 is 18,... P1 = 30X((N2+N22+N25)-(α11
t1+ -N2+ l+βI Ni 2-N221+γ
IL+3N23 l ))/(N21+N22+N25
) and then perform the calculation.

Obtained by the above calculation formula, Baba, Ni1=”21・N12
-N22・”+5=N23, the perfect score is 30 points, which means that the number of changes in the scale of the user's singing voice signal and the number of changes in the scale of the vocal signal on the magnetic tape are higher. This is a case in which the three items of , change to the lower side, and unchanged are all the same number of times, that is, the change in the scale of the audio signal sung by the user is the same as the change in the scale of the vocal signal on magnetic tape 1. This means that you will receive a perfect score.

On the other hand, in the above calculation formula, N11-0. N12-0°N1
Constants α, β, so that the score is 0 in the case of 5-〇
γ is determined in advance. This is to ensure that the score becomes 0 when the user does not sing at all.

Next, the pitch score P2 will be explained. This gain 19 point is calculated based on NR + ND, which is the result of comparing the values of one period of the pulse signal created from the user's audio signal and the vocal signal of the magnetic tape 1, and the maximum value is 70.
Calculate to get a perfect score. As an example of the calculation formula for the score, the score P2 is P2=70XNV'(Nx+Nn
) and then perform the calculation.

The score based on the above calculation formula is 70 points, which is a perfect score, when the score is ND-〇.This means that the pitch of the user's singing voice signal and the pitch of the vocal signal on the magnetic tape change when the level of the vocal signal changes. This means that they match each time they are compared.

Then, the scale change score P1 and the pitch score P2 are added together to obtain a final score.

After the score calculation is completed, the process proceeds to step 4o, where the score is displayed.

Here, when the signal level of the vocal signal increases,
The reasons for comparing the pulse time width intervals of two types of audio signals and for expressing the final score as the sum of the scale change score P1 and the pitch score P2 will be explained.

FIG. 8(1) shows an example of a user's song inputted from a microphone, and FIG. 8(2) shows an example of a vocal signal of an audio multiplexed medium by a professional singer. As shown in Figures 8(b) and (el), amateur kneelers detect changes in frequency and signal level within a single vocalization, called hump and vibration, just like the vocal signals of professional singers. If you do it freely, you will often not be able to do it. In the case shown in the example shown in FIG. 8, if the respective frequencies of the user's song and the vocal signal are continuously compared and scored, the influence of these fists and vibrations will be significant. For example, the signal level of the audio signal in Figure 8 /'(f
As seen after the 2G point in 'l, the frequency of the vocal signal by a professional singer changes greatly due to vibration, while the frequency of the user's song is almost constant because there is no vibration, and this part receives a very low score. There are times when things cannot be done. There are large individual differences in these levels and vibrations, even among professional singers.
Also, since it cannot occur in the same way every time even with the same singer,
When scoring a song, if you continuously compare and score songs including LiL and vibration, the dispersion of the scoring results will become very large.

However, without comparing the fist and vibration areas, it is impossible to evaluate the true quality of the singer's singing. To avoid this, compare fists and vibrations by comparing scale changes, but allocate fewer points. Based on this idea, in this embodiment, the pitch score P1 is given 70 points, and the scale change score P2 is given 30 points for comprehensive evaluation.

As described above, according to this embodiment, the voice signal of the user's singing and the signal of the magnetic tape or the like are used, and the signal level of the vocal signal is increased at a portion not affected by fists or vibrations. The fundamental frequency of the audio signal of the user's song is compared with the fundamental frequency of the vocal signal to evaluate the degree of matching of the pitches, and also to evaluate the degree of matching of the pitches. .

By conducting a comparative evaluation of scale changes, including the parts affected by the scale changes, and by allocating fewer points for the comparative evaluation of scale changes, evaluations with less variation can be made, and people who are good at it can get high scores as they are good at it. is obtained. As a result, the final score is close to the evaluation score when humans actually listen and evaluate with their ears, and a very accurate scoring result can be obtained, providing an objective means of assessing the user's singing ability. I can do it.

In this example, the user's singing voice signal was used as the subject of scoring, and the vocal signal recorded on magnetic tape, which is an audio multiplexing recording medium, was used as the scoring standard. Any audio signal such as a sine wave signal or a person's voice may be used.

In addition, in this embodiment, a waveform conversion means using a low-pass active filter and a transistor was used to convert the audio signal into a pulse signal, but this converts the audio signal waveform directly into an analog-to-digital converter. A circuit for converting into a digital value pulse signal may be used.

In addition, in this embodiment, a scale change detection means, a pitch detection means,
Although the counting storage means and the like are realized by a microcomputer, it goes without saying that they may be realized and used by conventional general-purpose logic circuits and the like.

In addition, in this embodiment, a waveform conversion means and a scale change detection means are provided separately for processing the user's audio signal and vocal signal processing, but these are only one system, and the user's audio signal is processed in a time-sharing manner. , and vocal signal processing may be performed.

In addition, in this embodiment, the time width in the case of H" of the pulse signal which is the output of the waveform conversion means is expressed as tl in FIG. 6(0).
The time width from t3 to t3 is followed by the time width from t5 to t5, and so on, to detect three types of changes in the audio signal: a change in the higher direction of the musical scale, a change in the lower direction, and an unchanged change. However, for example, in Fig. 6(C), the time width from tl to t3 is followed by the time width from t5 to tl 0, and so on. Examining the time width of the period of the pulse signal that is the output of the waveform converting means for a certain period that is sufficiently long compared to the time width of one period of the pulse signal that is the output of the means, for all pulses or for a part of the pulses, 1. The average time width, maximum time width, etc. per pulse may be determined, and changes in the musical scale and pitch of the audio signal may be detected based on changes in the average time width, etc.; Of the three types of changes, such as a change in a lower direction and a change that remains unchanged, only one or two types of changes may be detected.

Effects of the Invention As described above, the present invention includes two waveform conversion means for converting two audio signals into pulse signals, and detects how the scales of the two audio signals have changed based on the outputs thereof. 2
2. Detecting information representing the fundamental frequencies of two audio signals based on the outputs of two scale change detection means, two counting storage means for counting and storing their outputs, and two waveform conversion means.
2.257 pitch detecting means; 2.257 pitch detecting means;
Comparing and calculating three types of two systems of information: the number of times a transition to a higher scale was detected, the number of times a transition to a lower scale was detected, and the number of times it was detected as unchanged, which are stored in the counting storage means of <-2. The degree of agreement between the scale changes of the two audio signals is obtained as a score P1, and the output of the level change detection means is used to obtain information on the fundamental frequency around the time when the signal level of the audio signal changes, which is the standard for scoring. By comparing and calculating the pulse time widths (periods) of two audio signals, the degree of agreement between the pitches of these two audio signals is determined as a score P2,
The final score can be accurately obtained by adding the score P1 and the score P2.

This means that people who practice singing using audio multiplexed recording media can use the vocal signals recorded on the audio multiplexed recording media as a singing teacher to evaluate the singing ability of the singing teacher. This means that it is possible to provide an objective means of determining how many points a person has in terms of singing ability. In other words, for those who practice singing, the goal of practice becomes clear, such as, ``I'm going to sing this song and practice until I get a score of 80 or higher.''
26 cases, the desire to practice increases, and if you sing and don't get good points, think about why you don't get good points, and look for the bad points in your own singing style, and further improve your ability. can be done, and the effects are great.

[Brief explanation of the drawing]

Figure 1 is an explanatory diagram of an audio multiplex track on a magnetic tape, which is one type of audio multiplex recording medium, and Figure 2 is an illustration of a so-called audio multiplex track using magnetic tape, which is one type of audio multiplex recording medium. 3 is a block diagram of a main part of an embodiment of the present invention, FIG. 4 is a block diagram showing a specific configuration of this embodiment, and FIG. 5 is a block diagram of a main part of an embodiment of the present invention. 6 is an operational explanatory diagram for explaining the operation of the first waveform converting means. FIG. 7 is a circuit diagram showing the specific configuration of the first waveform converting means. FIG. FIG. 8 is an explanatory diagram of changes in the singing style for explaining temporal changes in the singing style in this embodiment. Completion...First waveform conversion means, 8...Second waveform 27,... Conversion means, 9...First scale change detection means, 1
0... Second scale change detection means, 11...
...First count storage means, 12...Second count storage means, 13...First pitch detection means, 14
... Second pitch detection means, 15 ... Level change detection means, 16 ... Score calculation means, 1
7...Score display means. Name of agent: Patent attorney Toshio Nakao and 1 other person No. 1
Figure 2 Dragon size
u′）To So So Ku Ei 2 S (Ko Castle

Claims (1)

[Claims] a first converting the input first audio signal into a pulse signal;
Based on the output pulse signal of the waveform converting means and the first waveform converting means, whether the scale of the first audio signal has shifted to a higher level, shifted to a lower level, or remains unchanged. a first pitch change detection means for detecting a fundamental frequency of the first audio signal based on the output pulse signal of the first waveform conversion means;
a second converting the input second audio signal into a pulse signal;
Based on the output pulse signal of the waveform converting means and the second waveform converting means, it is determined whether the scale of the second audio signal has shifted to a higher scale, a lower scale, or remains unchanged. a second scale change detection means for detecting;
a second pitch detection means for detecting the fundamental frequency of the second audio signal based on the output pulse signal of the waveform conversion means; and a high pitch detection means based on the output of the first scale change detection means. a first counting storage means for counting and storing the number of times a shift to a lower scale is detected, the number of times a shift to a lower scale is detected, and the number of times a change is detected; and a second scale change detecting means. a second counting storage means for counting and storing, based on the output, the number of times a shift to a higher scale was detected, the number of times a shift to a lower scale was detected, and the number of times no change was detected; level change detection means for detecting a signal level change of a second audio signal; and the number of times a transition to a higher scale has been detected and the number of times a transition to a lower scale has been detected, which are stored by the first count storage means. 3 of the number of times it occurred and the number of times it was detected that there was no change.
information and stored by the second count storage means,
The first audio signal and the second audio signal are calculated by comparing three pieces of information: the number of times a shift to a higher scale was detected, the number of times a shift to a lower scale was detected, and the number of times a change was detected. The first pitch detecting means calculates the extent to which the pitch change matches the signal as a score P_1, and the first pitch detecting means near the time when the level change detecting means detects that the level of the second audio signal has changed. The fundamental frequency of the first audio signal, which is the output of the first audio signal, and the fundamental frequency of the second audio signal, which is the output of the second pitch detecting means, are compared and A scoring device comprising a score calculation means for calculating a score P_2 based on the degree to which the pitches of the second audio signals match, and calculating a total score from the score P_1 and the score P_2.