JPS60262187A - Scoring apparatus - Google Patents

Abstract

(57) [Summary] This bulletin contains application data before electronic filing, so abstract data is not recorded.

Description

[Detailed Description of the Invention] Industrial Application Field The present invention is used in conjunction with an audio signal recording/reproducing device such as a karaoke machine to compare an audio signal sung by a user with an audio signal reproduced from a standard magnetic tape or the like. This invention relates to a scoring device that automatically scores a user's singing ability.

Conventional configurations and their problems As a field of audio equipment, playback of musical signals recorded on recording media such as magnetic tape and performed by musical instruments, etc.

The sound is amplified, and when the user sings along with this, the sound is mixed with the performance music signal and amplified. There is something commonly called a "karaoke machine", and it is widely used for general home or business use.

By singing using the above-mentioned "karaoke device," users can gain joy and satisfaction, but in recent years, an increasing number of people want to improve their singing ability.
Some people receive guidance from a singing teacher to improve their singing ability, but this is not possible for everyone, and magnetic tape called ``audio multiplex tape'' is one way to study singing on your own. Audio multiplexing recording media such as these are rapidly becoming popular. In the case of a magnetic tape as an example of this audio multiplexing recording medium, as shown in FIG. Each performance music signal is recorded. When using this magnetic tape, an audio multiplexing type "karaoke apparatus" having the configuration shown in FIG. a first magnetic tape reproducing means 2;
A second team consisting of a magnetic head 301 and an amplifier 302
These two outputs are mixed and power amplified by a mixing amplifier 5 together with the output of a microphone input means consisting of a microphone 401 and an amplifier 402, and output as an acoustic signal from a speaker 6.

It is said that you can improve your singing ability by listening to vocal signals recorded on a recording medium using the above device and practicing singing along with the vocal signals yourself, but no matter how much you practice, However, the drawback is that users themselves cannot tell how close their singing style is to the modeled vocal signal, in other words, how much their singing ability has improved. Also, even if the user has a wrong singing ability, the user may not be aware of it, and when practicing individually, there will naturally be a limit, and the user may lose interest and lose the desire to practice. It had the disadvantage of being too large.

OBJECT OF THE INVENTION The present invention solves the above-mentioned conventional problems, and compares the vocal signal recorded on an audio multiplexing recording medium with the audio signal sung by the user, and calculates the degree of matching as a score. The purpose is to provide an objective means of evaluating the user's singing ability by displaying the information.

Structure of the Invention The scoring device of the present invention includes a first pitch detecting means for detecting the fundamental frequency of an inputted first audio signal, and a second pitch detecting means for detecting the fundamental frequency of an inputted second audio signal. a detection means, a first level change detection means for detecting a change in the signal level of the first audio signal, a second level change detection means for detecting a change in the signal level of the second audio signal, and a first level change detection means for detecting a change in the signal level of the second audio signal;
The fundamental frequency of the first audio signal around the time when the level of the audio signal changes and the fundamental frequency of the second audio signal around the time when the level of the second audio signal changes are calculated. The device is comprised of a score calculation means for calculating a score based on how well the first audio signal matches the second audio signal, and a score display means for displaying the score. By using the audio signal sung by the user and the reproduction audio signal of the vocal signal recorded on the recording medium that serves as a song model as the second audio signal, the audio signal sung by the user is the reproduction audio signal of the vocal signal on the recording medium. Since the degree to which the song matches the signal is displayed as a score, the user can recognize the level of his or her singing ability compared to the vocal signal on the recording medium.

DESCRIPTION OF THE EMBODIMENT FIG. 3 is a block diagram showing an embodiment of the present invention. 4
numeral 401 is a microphone and 402 is an amplifier. 2 is a first magnetic tape reproducing means for reproducing a vocal signal recorded on an audio multiplex recording medium;
201 is a magnetic head, and 202 is an amplifier. 7 is the first
This waveform conversion means converts the voice signal sung by the user into a pulse signal. Reference numeral 8 denotes a second waveform converting means, which converts the vocal signal on the recording medium into a pulse signal. Reference numeral 9 denotes a first pitch detection means, which detects the fundamental frequency of the voice sung by the user. Reference numeral 10 denotes a second pitch detection means for detecting the fundamental frequency of the vocal signal.

Reference numeral 11 denotes a first level change detection means, which detects a level change in the voice sung by the user.

12 is! The second level change detection means detects level changes in the vocal signal. 13 is a score calculation means that compares and calculates the fundamental frequency of the user's voice around the time when the signal level of the user's singing voice changes and the fundamental frequency of the vocal signal around the point when the signal level of the vocal signal changes. The score is calculated based on the degree to which the user's voice signal matches the vocal signal. Reference numeral 14 denotes a score display means, which displays the score in order to inform the user of the score calculated by the score calculation means 13.

FIG. 4 is a block diagram showing the specific configuration of this embodiment.
Pitch detection of the user's singing voice Pitch detection of vocal signal pitch detection and score calculation functions are provided with microphone 11□'...B,
- This was realized in Ta.5.

FIG. 5 shows an actual circuit example of the first waveform converting means 7. Normally, the same circuit is often used for the first waveform converting means 7 and the second waveform converting means 8. , 1st
The circuit of the waveform converting means 7 will be representatively explained with reference to the operation explanatory diagram of FIG.

701 is an input terminal, 702.704.705.

708.710,711 are resistors, 703,706°7
09 is a capacitor, 07 is an operational amplifier (hereinafter abbreviated as OP amplifier), 712 is a transistor, and 713 is an output terminal.

OP amplifier 707 and resistors 702 and 704.

705 and capacitors 703 and 706 constitute a low-pass active filter, which removes high-frequency components of the audio electrical signal input to the input terminal 701 as shown in FIG. 6(a), and simultaneously Necessary signal amplification is performed by the amplification action of the OP amplifier 707, and a time constant circuit composed of a resistor 708 and a capacitor 709 supplementally removes high-frequency components that are not sufficiently removed by the active filter. do. The audio electrical signal shown in FIG. 6(b) from which the high-frequency components have been removed by the necessary amount is processed by resistors 710, 711 and transistor 712 into a pulse waveform as shown in FIG. 6(c). It will be converted to . In this way, the first waveform converting means 7 converts the user's singing voice signal, which is the output of the microphone input means 4, into a pulse waveform, and the second waveform converting means 8 similarly converts the voice signal sung by the user into a pulse waveform. The vocal signal that is the output of the converter is also converted into a pulse waveform. or,
The first level change detection means 11 and the second level change detection means 12 compare the current level with the previous level using an analog-to-digital converter or a sample-and-hold circuit using conventional analog technology and digital technology. realizable.

The operation of this embodiment will be described below with reference to the flowchart shown in FIG. 7 which shows the main part of the processing operation of the microcomputer.

It is assumed that the power of the device is turned on, and the memory elements inside the microcomputer 15 are also initialized. The audio signal sung by the user is turned into an electrical audio signal by the microphone input means 4, is amplified, and it is checked in step 16 whether the signal level has increased based on the output of the first level change detection means 11, and if it has increased, In step 17, the time width of the input pulse, which is the output of the first waveform converting means 7, input to the microcomputer 15 is converted into a digital quantity and registered in the microcomputer 15. That is, I of the pulse signal shown in FIG. 6 (C1)
By counting the period of "LH" using the clock signal of the microcomputer itself, it is possible to convert the time width of the input pulse into a digital quantity.In this way, in FIG. Conversion is performed in the following order: time width, time width from t3 to t4, time width from t5 to t6, etc. Note that this time width is information representing the fundamental frequency of the voice, and as it increases, the pitch increases. This indicates that the pitch has become lower, and a decrease indicates that the pitch has become higher.

On the other hand, the vocal signal recorded on the magnetic tape 1 which is an audio multiplexing type recording medium is transmitted to the first magnetic tape reproducing means 2.
It is checked in step 18 whether or not the signal level has increased based on the output of the second level change detection means 12, and the second waveform input to the microcomputer 15 in step 19 is checked. The time width of the input signal representing the fundamental frequency of the voice, which is the output of the converting means 8, is converted into a digital quantity, and the time width is converted into a digital quantity.
will be registered.

Next, in step 20, the time width of the pulse signal of the user's audio signal and the time width of the pulse signal of the vocal signal are divided.
It is checked whether both types of time width information have been registered. If both types are registered, the process proceeds to step 21, and the two types of time width information, which are the fundamental frequency information of the two audio signals, are checked. Compare the widths, calculate the degree of matching, and calculate the score depending on the match. An example of the method for calculating the score in step 21 will be described below. For example, if the pulse signal time width of the first audio signal is 9.5 (ms) and the pulse signal time width of the second audio signal is 1o (msl),
Baso. The degree of matching is (10-9,5)/1°xl. . -5 [
%] The degree of agreement is calculated as follows, and the distribution of points reflected in the score will be changed depending on the degree of agreement. −
For example, if the degree of match is within 3%, it will give you 100 points, if it is 3-5%, it will be 80 points, and if it is more than 5-7, it will be 60 points.

Points are given in such a way that scores of A and above are given 0 points, and the number of times the degree of agreement of the time width has been calculated in the songs that are to be scored - times is N [times] every time the degree of agreement of the time width of 2 hours has been calculated. The points allocated for each time are Pn
When [point] is assumed, the score P indicating the degree of matching between the first audio signal and the second audio signal is expressed as follows, as an example.

To give an example of score calculation using the above formula, in the songs to be scored - times, the degree of matching of duration is calculated by 1o.
3 times are within 3 sections, 4 times are 3 to 6 sections, 1 time is 5 sections.
Assuming that there were ~7 animals and the degree of agreement was 7% or higher twice, and the points were distributed as described above, the score P would be P2 (3 x 100 + 4 x 80 + l x 60 + 2 x o) / 1 out of 100 points.
It is calculated as follows: 02680/10:=:59 (points).

Next, in step 22, it is determined whether it is time to end the scoring. The decision to end the scoring may be based on information from a push button switch (not shown) that specifies the end of the scoring, or whether there is a performance music signal recorded on the magnetic tape 1. It is also possible to detect this and start scoring when the performance music signal disappears. It is also possible to record an end signal indicating the end of the song in advance and use the time point at which the end signal is detected or the time point at which the end of the magnetic tape is detected.

If it is not yet the end of scoring, proceed from step 22.
The process proceeds to step 23, where the registered pulse signal time width data is cleared, and the process proceeds to step 16 in preparation for the next collection of time width information, comparison, and score calculation.

When the scoring is finished, the process proceeds from step 22 to step 24, where the scores are displayed.

Now, the meaning of registering and comparing the pulse time width of the audio signal around the time when the level of the audio signal increases will be explained using the diagram of individual differences in singing shown in FIG. 8. Figure 8 (7) shows the user's song input from the microphone,
FIG. 8(A) is an example of a vocal signal of an audio multiplexed medium by a professional singer. As shown in Figures 8 (a) and (d), amateur users sing at a later timing than the vocal signals of professional singers, and (To) and +8) in Figure 8).
As shown in , users are often unable to freely change the frequency and signal level within a single vocalization, which is called vibration or vibration, like a professional singer who sings a vocal signal.

For this reason, in a case like the example in Figure 8, if you compare the respective frequencies in real time, it will be difficult to compare the respective frequencies in real time, for example, the 1D point in Figure 8 (C1) and the 2E point in Figure 8 (fl). You can compare the frequencies of many different lyrics, and compare the frequencies of very different lyrics.
), the frequencies may also be compared at the positions of the pipe lanes after the 2o point, resulting in the inconvenience that only a very low evaluation score can be calculated.

The present invention solves the above-mentioned inconveniences and improves the singing style of fists and vibrations around the points where the signal level increases significantly, such as points 1A and 2A and points 1B and 2B in the example of FIG. It is possible to evaluate the fundamental frequency that matches the lyrics of the user's song and the lyrics of the vocal signal's song without being influenced by individual differences or timing differences in singing style, so humans can actually listen to it with their ears and evaluate the score. This allows for more accurate scoring that is closer to the evaluation score when

As described above, according to the present embodiment, information on the fundamental frequency of the user's voice signal around the time when the signal level of the user's singing voice signal changes and information on the fundamental frequency around the time when the signal level of the vocal signal of the anger tape etc. changes. It is possible to compare the information on the fundamental frequency of the audio signal of the vocal signal and calculate and display the degree of matching as a score, so users can eliminate individual differences in singing style such as fists, vibrations, and timing differences when singing. 11 for the singing ability of
It is possible to provide an accurate and objective evaluation method.

In this example, the user's singing voice signal was used as the subject of scoring, and the vocal signal recorded on magnetic tape, which is an audio multiplexing recording medium, was used as the scoring standard. Any audio signal such as a sine wave signal or a person's voice may be used.

In addition, in this embodiment, a waveform conversion means using a low-pass active filter and a transistor is used to convert an audio signal into a pulse signal, but this converts the audio signal waveform directly into a digital value p using an analog-to-digital converter. A circuit for converting into a pulse signal may also be used.

Further, in this embodiment, the pitch detection means, score calculation means, etc. are realized by a microcomputer, but it goes without saying that these may be realized and used by conventional general-purpose logic circuits.

Furthermore, in this embodiment, a waveform converting means, a level change detecting means, and a pitch detecting means are provided separately for processing the user's audio signal and for processing the vocal signal, but these are provided in only one system, and the processing is performed in a time-sharing manner. The processing of the user's audio signal and the processing of the vocal signal may be performed.

In addition, in this embodiment, the time width when the pulse signal which is the output of the waveform conversion means is H'' is expressed as tl in FIG. 6(C).
After the time width from t2 to t2, the time width from t3 to t4 is detected to detect the fundamental frequency of the audio signal, that is, the pitch. For example, as shown in FIG. 6(C).
The time width may be detected one by one, such as the time width from t5 to t6 after the time width from t to t2, or the time width from t to t2 may be detected one by one.
The time width of the pulse signal that is the output of the waveform converting means during one leg period that is sufficiently long compared to the one time width of ``H'' is investigated for all pulses or for a part of the pulses, and The average time width, maximum time width, etc. of
Instead of the time width of L, the time width corresponding to the pulse period may be used for processing, such as the time width from the rise of H''' to the rise of the next H power.

Effects of the Invention As described above, the present invention includes two waveform converting means for converting two audio signals into pulse signals, and two pitch converters for detecting information representing the fundamental frequencies of the two audio signals based on the outputs thereof. a detection means, two level change detection means for detecting a change in the signal level of the two audio signals, and two audio signals that are information of fundamental frequencies around the time when the signal level of each of the two audio signals changes. By comparing and calculating the pulse time widths of the two audio signals, it is possible to obtain a score on the degree of matching between the two audio signals, excluding individual differences in singing style such as fists, vibrations, and timing shifts when singing.

This means that people who practice singing using audio multiplexed recording media can use the vocal signals recorded on the audio multiplexed recording media as a singing teacher to evaluate the singing ability of the singing teacher. It is possible to provide an objective means of determining how many points a person has in terms of singing ability, and the effect is that of a dog.

[Brief explanation of drawings]

Figure 1 is an explanatory diagram of an audio multiplex track on a magnetic tape, which is one type of audio multiplex recording medium, and Figure 2 is an illustration of a so-called audio multiplex track using magnetic tape, which is one type of audio multiplex recording medium. 3 is a block diagram of a main part of an embodiment of the present invention, FIG. 4 is a block diagram showing a specific configuration of this embodiment, and FIG. 5 is a block diagram of a main part of an embodiment of the present invention. Figure 6 is a circuit diagram showing the specific configuration of the waveform converter stage 1.
FIG. 7 is a flow chart showing the main part of the processing operation of the microcomputer of this embodiment, and FIG. It is a difference explanatory diagram. 7...First waveform conversion means, 8...Second
waveform converting means, 9...first pitch detecting means, 1
0...Second pitch detection means, 11...First level change detection means, 12...Second level change detection means, 13...Score Calculation means, 14.
...Score display means. 1 “31.A, +7)”8”jP31 “l” J?
M"F'!75-14Figure 1Figure 2Figure 4Figure 6

Claims (1)

[Claims] A first converter that converts the first audio signal that can be input into a pulse signal.
a first pitch detecting means for detecting the fundamental frequency of the first audio signal based on the output pulse signal of the first waveform converting means; and a signal of the first audio signal. A first level change detection means for detecting a change in level, a second waveform conversion means for converting an inputted second audio signal into a pulse signal, and an output pulse signal of the second waveform conversion means. a second pitch detecting means for detecting the fundamental frequency of the second audio signal; a second level change detecting means for detecting a change in the signal level of the second audio signal; The fundamental frequency of the first audio signal, which is the output of the first pitch detecting means, around the time when the level change detecting means detects that the level of the first audio signal has changed, and the second level. Comparing and calculating the fundamental frequency of the second audio signal which is the output of the second pitch detecting means near the time when the change detecting means detects that the level of the second audio signal has changed; A scoring device comprising: score calculation means for calculating a score based on how much the first audio signal matches the second audio signal.