JPS6083098A - Scoring apparatus - Google Patents

Abstract

(57) [Summary] This bulletin contains application data before electronic filing, so abstract data is not recorded.

Description

DETAILED DESCRIPTION OF THE INVENTION Field of Industrial Application The present invention is used with an audio signal recording and reproducing device, such as a commonly called "karaoke device," to convert the user's sung audio signal into a reproduced audio signal from a magnetic tape, etc., which serves as a reference. The present invention relates to a scoring device that automatically scores a user's singing ability by comparing it with the user's singing ability.

Conventional configurations and their problems As a field of audio equipment, music signals played by musical instruments recorded on recording media such as magnetic tape are reproduced and expanded, and when a user sings along with the signals, the music is reproduced. There is what is commonly called a ``karaoke device,'' which mixes with the signal and amplifies the sound, and is widely used for home and business use.

By singing using the above-mentioned "karaoke device," users can gain joy and satisfaction, but in recent years, an increasing number of people want to improve their singing ability.
Some people receive guidance from a singing teacher to improve their singing ability, but this is not possible for everyone, and magnetic tape called ``audio multiplex tape'' is one way to study singing on your own. Audio multiplexing recording media such as these are rapidly becoming popular. For example, in the case of a magnetic tape, this audio multiplexing type recording medium is a magnetic tape, as shown in FIG. The performance music signals are recorded respectively. When using this magnetic tape, an audio multiplexing system with the configuration shown in Figure 2 is used.
A karaoke device is used to transfer the vocal signals and performance music signals recorded on the magnetic tape 1 to the magnetic head 201.
and a first magnetic tape reproducing means 2 consisting of an amplifier 202 and a second tape reproducing means 3 consisting of a magnetic head 301 and an amplifier 302, and these two outputs are transmitted to a microphone input means consisting of a microphone 401 and an amplifier 402. The mixed amplifier 6 mixes and power-amplifies the output of the signal and outputs the signal from the speaker 6 as an acoustic signal.

It is said that you can improve your singing ability by listening to vocal signals recorded on a recording medium using the above device and practicing singing along with the vocal signals yourself, but no matter how much you practice, However, the drawback is that users themselves cannot tell how close their singing style is to the modeled vocal signal, in other words, how much their singing ability has improved. Also, even if the user sings in the wrong way, the user may not be aware of it, and when practicing individually, there will naturally be a limit, and the user may lose interest and lose the desire to practice. It had the disadvantage of being too large.

OBJECT OF THE INVENTION The present invention solves the above-mentioned conventional problems, and compares the vocal signal recorded on an audio multiplexing recording medium with the audio signal sung by the user, and calculates the degree of matching as a score. It can be used as an objective evaluation method for the user's singing ability, and in particular, it can be used to more accurately measure the degree of matching by not affecting the score even if the user makes noise during the interlude of the song. The purpose is to provide a scoring machine that calculates the score.

Structure of the Invention The scoring device of the present invention includes a first scale change detection means for detecting a change in pitch of a first audio signal inputted, and a change in pitch of a second audio signal inputted. a second scale change detection means for detecting a second sound signal; a first counting storage means for counting and storing the number of changes in pitch of the first sound signal only when there is a second sound signal; a second counting storage means for counting and storing the number of changes in the pitch of the musical scale of the signal; a first pause detection means for detecting a no-signal portion of the first audio signal; and a no-signal portion of the second audio signal. a second pause detection means for detecting a pause in the second audio signal; a third counting storage means for counting and storing the number of times a pause is detected by the second pause detection means; pause simultaneous release detection means for detecting whether or not the pause of the first audio signal has also been canceled at approximately the same time by looking at the output information of the first pause detection means when the cancellation is detected; a fourth count storage means for counting and storing the number of times the pause simultaneous release detection means detected that the pause release of the audio signal was substantially simultaneous with the pause release of the second audio signal; and the first count recording means. The information stored in the second count storage means is compared with the information stored in the second count storage means, and the information stored in the third count storage means is compared with the information stored in the fourth count storage means. The first audio signal becomes the second audio signal according to the ratio of
Since the score is calculated based on the degree to which the vocal signal matches the vocal signal of the recording medium, the user can recognize the level of their own singing ability compared to the vocal signal of the recording medium. During interludes, when the vocal signal is paused, even if the user makes noise, it does not affect the score, allowing for more accurate scoring.

DESCRIPTION OF THE EMBODIMENT FIG. 3 is a block diagram showing an embodiment of the present invention. 4
numeral 401 is a microphone and 402 is an amplifier. 2 is a first magnetic tape reproducing means for reproducing a vocal signal recorded on an audio multiplex recording medium;
201 is a magnetic head, and 202 is an amplifier. 7 is the first
The waveform conversion means converts the voice sung by the user into a pulse signal. Reference numeral 8 denotes a second waveform converting means, which converts the vocal signal of the recording medium into a pulse signal. Reference numeral 9 denotes a first scale change detection means, which detects changes in the scale of the voice sung by the user. 10
is a second scale change detecting means, which detects a change in the scale of the vocal signal. 11 [The first divisor storage means stores the divisor of the number of times there is a change in the pitch of the scale of the voice sung by the user only when there is a vocal signal. Reference numeral 12 denotes a second counting storage means, which counts and stores the number of changes in pitch of the scale of the vocal signal.

Reference numeral 13 denotes a first pause detection means, which detects pauses caused by breaths or the like in the user's singing voice. Reference numeral 14 denotes a second pause detection means, which detects a pause due to a pause or the like in the vocal signal on the magnetic tape. 41 is the third
is a counting storage means for storing the number of pauses in the vocal signal on the magnetic tape as a divisor based on the output of the second pause detection means. Reference numeral 15 denotes a pause simultaneous release detection means, which detects the voice signal sung by the user at almost the same time when the pause in the vocal signal is removed for one night, that is, when the vocal signal changes from a no-signal state to a signal-present state. This is to detect whether the pause is to be released or not. Reference numeral 16 denotes a fourth counting storage means for counting and storing the number of times that the pause simultaneous release is detected by the pause simultaneous release detection means.

17 is a score division means that compares and calculates the number of changes in the pitch of the famous scale sung by the user and the number of changes in the pitch of the vocal signal, and further calculates the number of detected pauses in the vocal signal and the vocal signal. A score is calculated based on the ratio of the number of times the user's voice signal is detected to be released from a pause at approximately the same time as the pause is released, and the degree to which the user's voice signal matches the vocal signal on the magnetic tape is calculated. be.

FIG. 4 is a block diagram showing the specific configuration of this embodiment.
Detecting scale changes in the user's voice and storing counts in the change circuit, detecting scale changes in the vocal signal and storing counts in the number of changes, detecting pauses in the vocal signal and storing numbers in the detection circuit, detecting pauses in the user's singing signals. The microcomputer 18 realizes the functions of detecting the cancellation of the pause in the user's singing signal almost simultaneously with the cancellation of the pause in the vocal signal, counting and storing the number of detections, and calculating the score.

FIG. 5 shows an actual circuit example of the first waveform converting means 7. Normally, the same circuit is often used for the first waveform converting means 7 and the second waveform converting means. The circuit of the first waveform converting means 7 will be representatively explained with reference to the operational diagram of FIG. 6.

701 is an input terminal, 702. 704. 705°70
8.710,711 are resistors, 703.706°709
707 is an operational amplifier (hereinafter referred to as OP amplifier), 712 is a transistor, and 713 is an output terminal.

○P amplifier 707, resistors 702, 7.04° 705, and capacitors 703, 706 constitute a low-pass active filter, which is input to input terminal 701 as shown in FIG. 6(a). It removes the high-frequency components of the audio electrical signal, and at the same time performs the necessary signal amplification by the amplification action of the ○P amplifier 707.
8 and a capacitor 709, the high-frequency components that are not sufficiently removed by the active filter are auxiliary removed. The audio electrical signal shown in FIG. 6(b) from which the high-frequency components have been removed by the necessary amount is processed by the resistors 710, 711 and the transistor 712 as shown in FIG. 6(c). In this way, the first waveform converting means 7 converts the user's singing voice signal output from the microphone input means 4 into a pulse waveform, and similarly converts the second waveform into a pulse waveform. Conversion means 8
The vocal signal is then converted into a pulse waveform of the vocal signal, which is the output of the first magnetic tape reproducing means.

The operation of this embodiment will be explained below based on the flowchart shown in FIG. 7 which shows the main part of the processing operation of the microcomputer.

It is assumed that the power of the device has already been turned on, and that the memory elements inside the microcomputer 18 have also been initialized. A vocal signal recorded on a magnetic tape 1, which is an audio multiplexing recording medium, is reproduced by a first magnetic tape reproduction means 2, converted into a pulse signal by a second waveform conversion means 8, and inputted to a microcomputer 18. Then, in step 26, it is determined whether or not the vocal signal is in a resting state by looking at the pulse signal obtained from the vocal signal.

If the vocalist is in a pause state, the process proceeds to step 27, where it is determined whether the vocal signal has started to pause, that is, there was a vocal signal just before the pause, and now there is no vocal signal for the first time, and whether the vocal signal has started to pause. If so, proceed to step 28 and select N indicating the number of pauses in the vocal signal.
Increase 3 by 1. That is, steps 26.27
realizes the function of the second pause detection means 14, and step 28 realizes the function of the third count storage means 41.

Conversely, if it is determined in step 26 that the vocal signal is not in a resting state, the vocal signal is released from the resting state in step 29, that is, the vocal signal was in a no-signal state at the last moment, and now there is a signal for the first time. It is determined whether or not the state has been reached.

If it is a vocal signal or the pause is released, the process proceeds to step 30, and the process proceeds to step 31 only if the user's singing voice signal input from the microphone releases the pause almost at the same time. In step 31, the vocal signal begins to rise almost simultaneously with the release of the pause. Singing audio signal, 1
Pause o Except for 5 yts.

N4 indicating the number of times is added by 1. That is, step 30 performs the function of the first pause detection means 13, steps 26, 29, and 30 perform the function of the pause simultaneous release detection means 16, and step 31 performs the function of the first pause detection means 13. The function of the il number storage means 16 of 4 is realized.

Next, in step 32, the time width of the input pulse is converted into a digital quantity. In other words, by dividing the "H" period of the pulse signal shown in FIG. 6(C) by the clock signal of the microcomputer itself, the time width of the input pulse can be converted into a digital quantity. . In this way, conversion is performed in the order of the time width from tl to t2, the time width from t3 to t4, the time width from t5 to t6, etc. in FIG. 6(C). Note that when this time width increases, it indicates that the scale has become lower, and when it decreases, it indicates that the scale has become higher.

In step 33, it is determined whether or not the time width has increased compared to the previous time width, and if the time width has increased, in step 35, the number of times the scale of the syllable signal has become lower is determined. N21 is increased by 1, and if the time width has not increased, the process proceeds to step 34.

In step 34, it is determined whether the time width of the pulse signal has decreased compared to the previous time width, and if the time width has decreased, in step 37, the number of times the scale of the syllable signal has increased is determined. N23 indicating the number of times the scale of the vocal signal does not change is increased by 1, and if the time width has not decreased, the process proceeds to step 36.

As mentioned above, steps 32, 33, and 34 realize the function of the second scale change detection means 10, and steps 3, 6, and 36
．． 37 realizes the function of the second divisor storage means 120.

Next, the process proceeds to step 42, and by checking the pulse signal obtained from the angular vocal signal, it is determined whether or not the vocal signal is in a rest state. If the vocal signal is in a paused state, the process advances to step 38. If it is determined that the vocal signal is not in a resting state, the process proceeds to step 20. Step 20
In step 20, the voice signal sung by the user is turned into an electric voice signal by the microphone input means 4, amplified, converted into a pulse signal by the first waveform conversion means 7, and inputted to the microcomputer 18. In step 20, the time width of the input pulse is changed. Convert to digital quantity.

Next, in step 21, it is determined whether the time width of the pulse signal has increased compared to the previous time width.

That is, in the pulse signal waveform of FIG. 6(C), currently t3
If it is the time when the time width from t4 is detected, it is determined whether the time width from t3 to 14 has increased compared to the time width from tl to t2, which is the data of the previous time width, If the time width has increased, N11 is increased by 1 without indicating the number of times the scale of the user's audio signal has become lower in step 23, and if the time width has not increased, step 22
Proceed to. In step 22, it is determined whether the time width of the pulse signal has decreased compared to the previous time width, and if the time width has decreased, step 26 indicates the number of times the scale of the user's audio signal has increased. Increase N13 by 1, and if the time width has not decreased, proceed to step 24,
N12 indicates the number of times the scale of the user's audio signal does not change
Increase by 1.

As mentioned above, steps 20, 21.22 realize the function of the first scale change detection means 9, and steps 23.24.2
5 realizes the function of the first count storage means 11.

Next, in step 38, it is determined whether it is time to start scoring. The decision to start scoring may be based on push button switch information that designates the start of scoring, or by detecting the presence or absence of performance music signals recorded on the magnetic tape 1. Scoring may start when the music signal disappears. It is also possible to record in advance an end signal indicating the end of the song being cut, and to utilize the point in time when the end signal is detected or the point in time when the end of the magnetic tape is detected.

If it is not yet time to start scoring, proceed from step 38.
Proceeding to step 20 or step 26, N11°N12/N13 which is the change data of the time width of the pulse signal
・N21, N22, N23 and 7''': Number of pauses in the one-ka'' signal N3, N number of times the voice signal sung by the user also became paused at approximately the same time as the pause in the vocal signal was cancelled.
4 data collection is performed.

Then, when it comes time to start scoring, the process proceeds from step 38 to step 39, where the score is calculated. Step 39 has a score calculation means 170 function, and the score calculation is performed using time width change data N of the curse signal created from the user's voice signal and the vocal signal of the magnetic tape 1.
11. N12. N13°N21. N22. N23, the number of pauses in the vocal signal N3, and the number of times N4 that the user's singing voice signal also paused at approximately the same time as the pause in the vocal signal was released, and is calculated to give a maximum of 100 points. . The Ushizu basic formula will be explained as an example of a formula for calculating the score. With α, β, and γ as constants, the score P is P−100×((N21+N22+N25)−(αlN
11-N211 +β1N12-N22++γlN13
-N231))/(N21+N22+N25)...
・・・・・・・・・Define as 0 expression.

The score according to the above formula 0 is N11-N21°N1
2-N22 + " 13 = N23, which gives a perfect score of 100 points, whichever is higher. In other words, the change in the scale of the voice signal sung by the user is the same as the change in the scale of the vocal signal on magnetic tape 1. If you do so, you will receive a full score.

On the other hand, in the above formula 0, constant a is set so that the score is 0 in the case of N11-○, N1°-0°N13-0.

β and γ are determined in advance. This is to ensure that the score becomes 0 when the user does not sing at all.

Next, an example of the score calculation formula in this embodiment will be explained. Similar to the calculation formula 0 above, a.

Let β and γ be constants, and K1. 2 is also a constant, the score P is set to P-1×((N21+N22+N25)-(hat N11
-N21++β1N12-N221+γlN13-N2
31))/(N21+N22+N25) 2/10×N4/
N3・・・・・・・・・・・・■Define as formula.

The first term of the above formula (■) is the number 100 in the above formula
The explanation is omitted because it has been replaced by the constant . ■To explain the meaning of 2XN4/N3, which is the second term in the equation, N3 is the number of times the vocal signal pauses, and N4 is the number of times the user sings when the vocal signal has a pause. This indicates the number of times that the paused audio signal was released at approximately the same point in time.

More specifically, N3 is the number of times the singer in the vocal signal, which is used as a model for scoring, takes a breath and does not sing, and N4 is the number of times the singer in the vocal signal does not sing while taking a breath. , it shows the number of times when the user started singing from a state where they were not singing at the same time when they started singing, and since there is a relationship of N4≦N3, N4/N3 is a positive number less than or equal to 1. N3 indicates the rate at which the vocal signal and the user's sung audio signal start at almost the same time, and can be considered an element that indicates the sense of rhythm and tempo matching of singing ability. Multiplying this N4/N3 by the constant 2 and adding it to the first term of the above formula (■) gives 10
Constants a, β, and γ so that 0 points is a perfect score.

K1. By setting 2 to 2, it is possible to calculate a score more accurately than the above-mentioned formula 0 because it takes into account the sense of rhythm and how the tempo matches.

In this way, in step 39, the user uses the information on the change in the scale of the user's audio signal, the information on the change in the scale of the vocal signal on the magnetic tape 1, and the information indicating the sense of rhythm and tempo matching of the user's audio signal. It can be seen that the score is calculated based on the extent to which the audio signal of the magnetic tape 1 matches the vocal signal of the magnetic tape 1. After calculating the score, the score is displayed on the score display means 19 in step 40.

Since the user's audio signal is captured in the first count storage means only when the vocal signal is not in a resting state,
The following formula holds true.

N21+N22+N23≧N11 +N12+N13
``'''' ■In other words, if the vocal signal is at rest and there is only a performance, for example, even if the user says something during an interlude in a song, it will be recorded as data in the first divisor function 1. It has the feature that it does not affect the score because it is not captured.If the vocal signal is not paused and the user does not sing, N2
There is also the effect that the difference between 1+N22+N23 and N41+N12+N13 becomes larger, and the score shown by the formula (■) becomes lower.

As described above, according to this embodiment, changes in the scale of an audio signal sung by a user are compared with changes in the scale of a vocal signal such as a magnetic tape, and the sense of rhythm and tempo are determined based on the vocal signal. Since the degree of matching can be calculated and displayed as a score, it is possible to provide an objective evaluation means for the user's singing ability.

In this example, the user's singing voice signal was used as the scoring target, and the vocal signal recorded on magnetic tape, which is an audio multiplexing recording medium, was used as the scoring standard. Any audio signal may be used, such as a wave signal or a person's voice.

In addition, this embodiment deals with a waveform conversion means using a low-pass active filter and a transistor in order to convert an audio signal into a pulse signal. A circuit that converts the value into a pulse signal may be used.

Further, in this embodiment, the scale change detection means, the count storage means, etc. are realized by a microcomputer, but it goes without saying that these may be realized and used by conventional general-purpose logic circuits.

Furthermore, in this embodiment, waveform conversion means and scale change detection means are provided separately for processing the user's audio signal and vocal signal processing, but these are provided in only one system, and the user's audio signal is processed in a time-sharing manner. - signal processing and vocal signal processing may be performed.

In addition, in this embodiment, the time width in the case of H°' of the pulse signal which is the output of the waveform conversion means is expressed as t in FIG. 6(C).
The time width from l to t2 is followed by the time width from t3 to t4, and so on, and three types of changes in the musical scale of the audio signal are detected: a change in the higher direction, a change in the lower direction, and a constant change. However, for example, in FIG. 6(C), changes in the time width may be detected one by one, such as the time width from tl to t2 (from t6 to t6), or the waveform "H'" of the pulse signal that is the output of the conversion means
The time width of the pulse signal that is the output of the waveform converting means during a certain period that is sufficiently long compared to the one time width that becomes "H" is investigated for all pulses or a part of the pulses, and the average per pulse is calculated. A time width, a maximum time width, etc. may be determined, and changes in the scale of the audio signal may be detected based on changes in this average time width, etc., or changes in the higher direction, lower direction, or unchanged Of the three types of changes, only one type or only two types of changes may be detected.

For example, if there are two types of changes in musical scales: a change to a lower force and a change to no change, the scoring formula will be 0.
...If the equation 0 is set as α-β-1, there is no case when the user does not sing, that is, when N114-N12=O, so N11+
When N12-Q, it is forced to become P-Q.

Comparing formula ■ and formula 0, it is clear that formula 0 gives a higher score. In this way, it is possible to have two difficulty levels, beginner and advanced, in the same seven notes.

Furthermore, in this embodiment, the number of changes in the scale of the second audio signal is independently counted, and the number of changes in the scale is divided only when the second audio signal is included in the first audio signal. The second audio signal may also be divided by the number of scale changes only when the first audio signal is present.

Effects of the Invention As described in section 2, the present invention includes two waveform converting means for converting two audio signals into pulse signals, and two waveform converting means that convert two audio signals into pulse signals.
two scale change detection means for detecting whether the scale of one audio signal has changed as shown in and two for counting and storing the output.
The number of times it was detected that the scale shifted to a higher scale, the number of times it was detected that the scale shifted to a lower scale, and the number of times that it was detected as unchanged, which are stored by two count storage means.
Compare and calculate information on two strains of seeds, and further develop a sense of rhythm.

By checking how the tempos match, it is possible to more accurately obtain a score based on the degree of matching between the two audio signals. It has the feature that even if the user makes noise when the vocal signal is paused, such as during an interlude during a break, the score will not be affected. This means that people who practice singing using audio multiplexed recording media can use the vocal signals recorded on the audio multiplexed recording media as a singing teacher to evaluate the singing ability of the singing teacher. This means that it is possible to provide an objective means of determining how many points a person has in terms of singing ability. In other words, for people who practice singing, the goal of practicing becomes clearer, and their motivation to practice increases, such as saying, ``I'm going to sing this song and practice until I get a score of 80 or higher.'' If you don't get any good points, you can think about why you don't get any good points, and look for the bad points in your singing style, and you can further improve your singing ability.

[Brief explanation of drawings]

Figure 1 is an explanatory diagram of an audio multiplex track on a magnetic tape, which is one type of audio multiplex recording medium, and Figure 2 is an illustration of a so-called audio multiplex track using magnetic tape, which is one type of audio multiplex recording medium. 3 is a block diagram of a main part of an embodiment of the present invention, FIG. 4 is a block diagram showing a specific configuration of this embodiment, and FIG. 6 is a block diagram of a main part of an embodiment of the present invention. 6 is a circuit diagram showing a specific configuration of the first waveform converting means, FIG. 6 is an operation explanatory diagram for explaining the operation of the first waveform converting means, and FIG. 7 is an outline of the processing operation of the microcomputer of this embodiment. FIG. 7...First waveform conversion means, 8...Second
waveform conversion means, 9...first scale change detection means, 1°...second scale change detection means, 11.
...First divisor storage means, 12...Second count storage means, 13...First pause detection means, 1
4...second pause detection means, 15...pause simultaneous release detection means, 41...third divisor storage means, 16...fourth Count storage means, 17...
...Score calculation method. Name of agent: Patent attorney Toshio Nakao and 1 other person No. 4
Figure 4 Figure 6 T, H62LaI3 ti L6D7Lθzy Figure 7

Claims (2)

[Claims] (1) A first waveform converter converts an input first audio signal into a pulse signal, and the scale of the first audio signal is determined based on the output pulse signal of the first waveform converter. ,
A first scale change detection means for detecting whether the scale has shifted to a higher scale, a lower scale, or no change; and a second waveform conversion means to convert an inputted second audio signal into a pulse signal. and, based on the output pulse signal of the second waveform converting means, detecting whether the scale of the second audio signal has shifted to a higher scale, a lower scale, or has changed. the number of times a shift to a higher scale is detected based on the outputs of the second scale change detection means and the first scale change detection means, and only when there is an output pulse signal from the second waveform conversion means; , a first counting storage means for counting and storing the number of times a shift to a lower scale is detected and the number of times a change is detected, respectively, and a higher scale based on the outputs of the second scale change detecting means. a second counting storage means for counting and storing the number of times a shift to a lower scale is detected, the number of times a shift to a lower scale is detected, and the number of times a change is detected; and a no signal of the first audio signal. a first pause detection means for detecting a no-signal portion of the second audio signal; a second pause detection means for detecting a no-signal portion of the second audio signal; and counting and storing the number of times a pause is detected by the second pause detection means. the output of the first pause detection means at the time when it is detected that the pause of the second audio signal is released based on the output of the third count storage means and the second pause detection means; Pause simultaneous release detection means detects whether the pause of the first audio signal is also canceled at substantially the same time by looking at information; a fourth counting storage means for counting and storing the number of times the second audio signal is released from a pause, and the number of times a transition to a higher scale was detected, which is stored by the first counting storage means; , the number of times a transition to a lower scale was detected, the number of times a change was detected as no change, and the number of times a transition to a higher scale was detected, which is stored in the second divisor storage means;
Comparing and calculating three pieces of information: the number of times a transition to a lower scale was detected and the number of times a change was detected, and further a pause is detected by the second pause detection means stored in the third count storage means. according to the ratio between the number of times the pause of the first audio signal is canceled and the number of times that the pause of the first audio signal is almost simultaneously divided by the pause of the second audio signal, which is stored by the fourth counting storage means. and score calculation means for calculating as a score the degree to which the first audio signal matches the second audio signal. (2) Out of the three types of information: the number of times a shift to a higher scale was detected, the number of times a shift to a lower scale was detected, and the number of times a change was detected, the user's scale change is only one type or two types. Claim 1, characterized in that change detection is performed, and when the data obtained in the first count storage means is zero, the score is displayed as ○ points.
Scoring device described in section.