JP2007011090A - Karaoke device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow a proper score result to be obtained regardless of emission of a guide melody from a speaker when scoring singing performance in a karaoke (orchestration without lyrics) device. <P>SOLUTION: An analog audio signal output from a microphone 25 to which singing voice having performance sounds of karaoke music and the guide melody added thereto is input is converted to a digital audio signal by an A/D converter 26. A performance signal of the karaoke music and a sound signal of the guide melody which are played from musical piece data by karaoke performance are subtracted from the audio signal from the A/D converter 26 to generate a signal for scoring. A sound pitch difference is calculated from sound pitch data of the generated signal for scoring and sound pitch data extracted from guide melody data of musical piece data, and signing performance is scored in accordance with the calculated sound pitch difference. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to singing scoring in a karaoke apparatus, and more particularly to a technique for obtaining a more appropriate scoring result.

  Conventionally, a scoring function is known as an incidental function of a karaoke apparatus. This scoring function is the following function. That is, singing data indicating the singing state such as pitch, volume or tempo uttered by the singer is generated by sampling the voice signal of the singer input from the microphone. Next, the singing data is compared with scoring reference data such as main melody part data in karaoke data, and a predetermined score is given based on the comparison result to generate scoring data. When the singing part ends, the scores in the scoring data are totaled to calculate a total score. The total score is displayed as it is on a scoreboard or a display, or a video reflecting the total score such as a video including a predetermined message or predetermined expression content is output to the display (for example, see Patent Document 1).

  In addition, when a plurality of people sing a duet song, etc., a karaoke device having a scoring function for scoring each person's singing voice (see, for example, Patent Document 2) or scoring a scoring part by selecting one of the plurality of parts. There is a karaoke device having a function (see, for example, Patent Document 3).

Some karaoke apparatuses having the scoring function described above have a function of emitting a guide melody from a speaker in order to guide a karaoke song. In such a karaoke apparatus, a guide melody can be emitted from a speaker to guide karaoke singing even when singing a song.
Japanese Patent No. 3261990 JP 2000-330580 A JP 2004-109260 A

  However, in the above-described karaoke apparatus, since the melody of the guide melody emitted from the speaker is also input to the microphone in addition to the voice of the singer even when singing, the singer's voice signal and the guide melody The signal added with the sound signal is scored singing, and it tends to be an unwilling scoring result for the singer. In particular, when there is no voice signal of the singer, that is, when the singer is not singing, only the sound of the guide melody emitted from the speaker is input to the microphone, which may result in the highest scoring result. was there.

  Therefore, the present invention relates to singing singing in a karaoke apparatus, and an object thereof is to obtain an appropriate grading result even when a guide melody is emitted from a speaker.

  The karaoke apparatus of the present invention made to solve the above-mentioned problem is “a melody for singing, even when a guide melody and a performance sound of a karaoke song are emitted from the speaker to guide karaoke singing. The scoring is performed based on the scoring signal generated by subtracting the sound signal corresponding to the guide melody emitted from the sound and the performance sound of the karaoke song.

  Specifically, the audio signal input means (26: In this column, in order to facilitate understanding of the invention, the components described in the “Best Mode for Carrying Out the Invention” column are included as necessary. Although shown in parentheses, this description is not meant to limit the scope of the claims.) Inputs the voice signal of a karaoke song. Then, the music data storage means (16) stores the music data including the pitch data of the singing melody of the karaoke music. The karaoke performance reproduction means (24) reproduces the music data stored in the music data storage means (16) as a sound signal, and the reproduced sound signal and the voice signal of the karaoke song input from the audio signal input means, Is output to the speaker (28). Further, the generating means (24) corresponds to the first signal corresponding to the sound signal output from the karaoke performance reproducing means (24) and the karaoke song sound signal input from the sound signal input means (26). The scoring signal is generated by comparing the second signal with the second signal and subtracting the first signal from the second signal.

  Here, the first signal corresponding to the sound signal output from the karaoke performance reproduction means (24) indicates the sound signal of the guide melody and the performance signal of the karaoke song, and is input from the sound signal input means (26). The second signal corresponding to the karaoke singing voice signal indicates a sound signal corresponding to the singing voice to which the guide melody emitted from the speaker and the performance sound of the karaoke song are added.

  A pitch extraction means (24) extracts pitch data from the scoring signal. Further, the gain setting means sets a gain for subtracting the first signal from the second signal based on the scoring signal.

  And the pitch difference between the pitch data of the singing melody of the karaoke song stored in the music data storage means (16) and the pitch data of the scoring signal extracted by the pitch extraction means (24) is calculated, The scoring means (12) scores based on the calculated pitch difference.

  As described above, the sound signal reproduced by the karaoke performance reproducing means (24) is the sound signal of the guide melody and the performance signal of the karaoke song, and the guide melody and the performance sound of the karaoke song are emitted from the speaker. Therefore, even when singing, the sound of the guide melody emitted from the speaker is input to the microphone separately from the voice of the singer.

  However, according to the karaoke apparatus (1) of the first aspect, with respect to singing, even when a guide melody and a performance sound of a karaoke song are emitted from the speaker in order to guide the karaoke song, the karaoke device is released from the speaker. Since scoring is performed based on the scoring signal generated by subtracting the sound signal corresponding to the played guide melody and the performance sound of the karaoke song, an appropriate scoring result can be obtained.

  Further, in the karaoke apparatus according to claim 1 described above, the “guide melody sound signal and karaoke song performance signal, which are to be reduced when the scoring signal is generated, as in the karaoke apparatus according to claim 2. It is desirable that the input value of the “first signal corresponding to” can be adjusted appropriately and automatically.

  That is, in the karaoke apparatus according to claim 1, as in the karaoke apparatus according to claim 2, whether the gain setting means (24) is a singing period based on the performance reproduction progress in the karaoke performance reproduction means (24). Singing period determining means (24) for determining whether or not, detecting means (24) for detecting the signal level of the scoring signal generated by the generating means (24), and amplification capable of amplifying the signal level of the first signal Means (24) and adjusting means (24) for adjusting the signal level of the first signal by the amplifying means (24).

  When the singing period determining means (24) determines that it is not the singing period, the detecting means (24) detects the signal level of the scoring signal generated by the generating means (24), and the adjusting means (24) adjusts the signal level of the first signal by the amplification means (24) so that the signal level of the scoring signal detected by the detection means (24) is minimized.

  The input value of the sound signal corresponding to the guide melody emitted from the speaker input to the microphone and the performance sound of the karaoke song is subject to variations in attenuation and amplification depending on the installation environment conditions of the karaoke device such as the speaker and the air. However, if the above-mentioned device is devised, it is possible to automatically adjust the input value of the sound signal corresponding to the melody of the guide melody and the performance sound of the karaoke song, which is excluded from such fluctuations, and more appropriate scoring results Can be obtained.

  Moreover, in the karaoke apparatus according to claim 2 described above, the period in which the singing period determining means determines that it is not the singing period as in the karaoke apparatus according to claim 3 may be a prelude period and an interlude period. desirable. According to such a karaoke apparatus, the above-mentioned “automatically adjusting the input value of the sound signal corresponding to the guide melody that is excluded even for such fluctuations and the performance sound of the karaoke song” Karaoke performance can be performed not only in the prelude period but also in each interlude period. Therefore, during a karaoke performance of a song, the singer changes the volume of the speaker and the position of the microphone between immediately after the karaoke performance and immediately before the interlude period, or immediately after the interlude period and immediately before the next interlude period. Even if the input value of the sound signal corresponding to the guide melody emitted from the speaker and the performance sound of the karaoke song fluctuates, the sound of the guide melody included in the scoring signal for each interlude period The signal level of the signal and the performance signal of the karaoke song can be automatically adjusted to be minimized. That is, it is possible to prevent the scoring error after the start of singing from expanding during the singing.

Embodiments of the present invention will be described below with reference to the drawings.
[Description of schematic configuration of karaoke equipment function]
FIG. 1 is a diagram showing a schematic configuration centering on the function of the karaoke apparatus. Among the functions shown in FIG. 1, the data extraction unit M6, the comparison unit M8, the sequencer M14, the scoring unit M24, the difference extraction unit M34, the switch control unit M36, and the adjustment unit M37 are realized mainly by the CPU and software. is doing.

  First, the karaoke apparatus has a scoring function, and the singing accuracy is determined by digitizing and capturing the voice signal of the karaoke song and comparing it with the pitch of the guide melody, which is a song melody. Since the volume varies greatly depending on the vocabulary, gender, age, etc., the score may be different from the actual skill of singing. Moreover, it is very difficult to create volume reference data for the above reasons. Furthermore, by not using the volume for determination, the algorithm can be simplified and the accuracy of singing can be determined in a short time. Therefore, the accuracy of singing is determined by comparing the pitches.

  Next, as shown in FIG. 1, a microphone M2 (hereinafter, abbreviated as a microphone) for a singer to input karaoke singing voice is connected to an amplifier M18 and to an A / D converter M4. ing. In addition, music data including karaoke performance data and guide melody data is stored in the data storage unit M10. Of the song data, one song selected by the karaoke singer is read to the execution memory M12, and is sequentially read by the sequencer M14 during performance. The karaoke performance data read out by the sequencer M14 is input to the musical tone generator M16. Further, the guide melody data sequentially read by the sequencer M14 is input to the comparison unit M8. The musical sound generator M16 generates a performance signal for karaoke music based on the input karaoke performance data, and this performance signal is input to the amplifier M18. The amplifier M18 amplifies the karaoke performance signal and the singing voice signal input from the microphone M2, and outputs the amplified signal to the speaker M20. This is the basic function of karaoke equipment.

  Since this guide melody data corresponds to the singing melody of karaoke music, it is also used when realizing a function output from the speaker M20 together with the accompaniment music as a so-called guide melody function. The guide melody function can be switched on / off by the user (karaoke singer), and the user who thinks that the function is necessary can be turned on by operating an operation panel or a remote control (not shown). Then, not only the karaoke accompaniment but also the singing melody is output from the speaker M20 as a guide melody, and it is possible to sing with reference to it. On the other hand, if the function is turned off, the guide melody is not output from the speaker M20, and the guide melody data is used only for scoring.

  In the following description, it is assumed that the guide melody function is on. Therefore, the karaoke song performance signal and the guide melody signal are added to the singing voice signal input from the microphone M2. In the following description, the term “singing voice signal” refers to a singing voice signal in which the performance signal of the karaoke song and the sound signal of the guide melody are added, and the term “singing voice” simply refers to the performance of the karaoke song. It refers to a singing voice to which a sound and a guide melody are added.

  On the other hand, the singing voice signal input to the A / D converter (ADC) M4 is converted into a digital signal and then input to the signal generation unit M30. The musical tone generator M16 described above generates a karaoke song performance signal and a guide melody sound signal based on the inputted karaoke performance data and the guide melody data. The karaoke song performance signal and the guide melody sound are generated. The signal is input to the variable gain amplifier M32, amplified by the variable gain amplifier M32, and input to the signal generation unit M30. Then, the signal generation unit M30 is based on the singing voice signal converted to the digital signal input from the A / D converter (ADC) M4, the performance signal of the karaoke song input from the variable gain amplifier M32, and the sound signal of the guide melody. A scoring signal is generated and input to the data extraction unit M6 and to the difference extraction unit M34. The scoring signal input to the difference extraction unit M34 is adjusted by a switch control unit M36 via a switch M38, which is controlled to be connected (hereinafter simply referred to as ON) or disconnected (hereinafter also simply referred to as OFF). Input to the unit 37. Then, the adjustment unit 37 instructs the gain to the variable gain amplifier M32 so that the signal level of the scoring signal input to the adjustment unit 37 is minimized. Also, the karaoke performance data read by the sequencer M14 is input to the musical sound generating unit M16 via the switch M40, which is controlled by the switch control unit M36 to be connected or disconnected.

Here, the switch control unit M36 determines whether or not it is a singing period from the music data read by the sequencer M14, and controls the switch M38 and the switch M40.
FIG. 2 shows the on / off changes of the switch M38 and the switch M40 and the change of the output signal level from the variable gain amplifier M32 with respect to the elapsed time after the karaoke performance, the karaoke performance period, and the end of the karaoke performance. It is explanatory drawing. Before the karaoke performance, the switch M38 and the switch M40 are turned off. However, when the sequencer M14 reads out the music data and enters the karaoke performance period, the switch control unit M36 controls the switch M40 to turn it on. Keep it on until the end of the performance, and turn it off when the karaoke performance ends. When the switch control unit M36 determines whether or not it is a singing period from the music data read out by the sequencer M14 and determines that it is not a singing period, that is, when it determines that it is a prelude period or an interlude period, When M38 is controlled to be turned on and it is determined that it is a singing period, the switch M38 is controlled to be turned off. Here, “the switch control unit M36 determines whether or not it is a singing period from the music data read out by the sequencer M14”, will be described later in [Description of scoring process of the audio control unit 24]. "It is determined whether or not it is a period in which the prelude period or the interlude period is not sung by the section division data indicating the start point of the singing section of the karaoke song stored in the control data track delivered from the sequence program for performing the karaoke performance. "

  When it is determined that it is not the singing period, that is, when it is determined that the prelude period or the interlude period, the switch M38 is controlled to be turned on, and the scoring signal input from the difference extraction unit M34 to the adjustment unit 37 The adjustment unit 37 instructs the gain to the variable gain amplifier M32 so that the signal level becomes minimum (see FIG. 2). Therefore, when it is determined from the music data that it is not the singing period, that is, during the prelude period or the interlude period, the signal level of the scoring signal is adjusted to be minimum.

  On the other hand, when it is determined that it is the singing period, the switch M38 is controlled to be turned off, so that the variable gain amplifier M32 is not instructed by the adjusting unit 37, and the output signal level from the variable gain amplifier M32 Is fixed (see FIG. 2). The data extraction unit M6, to which the scoring signal generated by the signal generation unit M30 is input, calculates the pitch from the digitized scoring signal every 50 ms, for example, and inputs it as the pitch data to the comparison unit M8. . The comparison unit M8 compares the pitch data of the scoring signal input from the data extraction unit M6 with the pitch data of the guide melody (hereinafter also simply referred to as reference) input from the sequencer M14 in real time. Note that 50 ms corresponds to a thirty-second note with a metronome tempo of 120, and has a sufficient resolution for extracting the characteristics of singing.

  The comparison unit M8 calculates the difference between the scoring signal and the reference every 50 ms in accordance with the timing at which the scoring signal is input. This is output to the scoring unit M24 as real-time difference data (pitch difference data). In the scoring unit M24, the pitch difference data is totaled for each section of the karaoke music and stored in the data storage unit M10. And in the scoring part M24, the difference data of each section is totaled and a scoring result is obtained.

The scoring result is displayed on the display unit M26.
In FIG. 1 showing a schematic configuration centering on the function of the karaoke apparatus, the A / D converter (ADC) M4 corresponds to “audio signal input means”, and the data storage unit M6 corresponds to “music data storage means”. Equivalent to. The sequencer M14 corresponds to “karaoke performance reproduction means”, the signal generation unit M30 corresponds to “generation means”, and the data extraction unit M6 corresponds to “pitch extraction means”. The switch control unit M36, the switch M38, the switch M40, the difference extraction unit M34, the variable gain amplifier M32, and the adjustment unit M37 correspond to “gain setting unit”. Further, the switch control unit M36, the switch M38, and the switch M40 correspond to “singing period determination unit”, the difference extraction unit M34 corresponds to “detection unit”, and the variable gain amplifier M32 serves as “amplification unit”. The adjustment unit M37 corresponds to “adjustment means”. The scoring unit M24 corresponds to “scoring means”. The speaker M20 corresponds to a “speaker”.

  Next, the scoring signal and reference will be described with reference to FIG. The dotted line illustrated in FIG. 3 is obtained by converting the guide melody that is a reference into pitch data, and general guide melody data is mechanically very accurate. On the other hand, the solid line illustrated in FIG. 3 shows the scoring signal converted to pitch data. The pitch data of the scoring signal varies up and down from the value indicated by the pitch data of the guide melody, and there is no pitch data of the scoring signal in the prelude and interlude.

Although FIG. 1 shows a schematic configuration centering on the function of the karaoke apparatus, FIG. 4 is a block diagram showing a specific hardware configuration of the karaoke apparatus.
[Description of configuration of karaoke apparatus 1]
FIG. 4 is a block diagram showing a configuration of the karaoke apparatus 1. As shown in FIG. 4, the karaoke apparatus 1 includes a control unit 12 that controls the operation of the karaoke apparatus 1 as a whole, an interface unit 14 for connecting the karaoke apparatus 1 to the network 100, music contents that indicate the accompaniment content and lyrics of a performance tune. A hard disk (HDD) 16 for storing data, video data, etc., an operation unit 18 comprising a plurality of keys and switches, an infrared communication unit 20 for receiving infrared signals from the remote control terminal 2 and mobile phone by infrared communication, an operation unit An operation processing unit 22 that processes a signal from 18, generates an audio signal (signal related to sound and sound) of a musical composition from music data stored in the hard disk 16, and inputs a singing voice through the generated audio signal and the microphone 25. Output to the A / D converter 26 and digitized by the A / D converter 26. An audio control unit 24 that amplifies each audio signal that has been generated and outputs it to the speaker 28, a MIDI sound source 30, a video RAM 32 that temporarily stores video information, and a video playback unit that controls playback of video based on video data 34, a video control unit 38 for controlling display of video information stored in the video RAM 32 and video displayed by the video playback unit 34 on the display unit 36, and the like.

  The control unit 12, interface unit 14, HDD 16, infrared communication unit 20, operation processing unit 22, video RAM 32, video playback unit 34, and video control unit 38 are connected by a bus 39. The control unit 12 and the audio control unit 24 are connected by a USB 40. In addition, the control part 12 and the audio | voice control part 24 perform the various processes mentioned later.

  Among them, the HDD 16 is provided with a music data memory area 50 for storing music data and a scoring information memory area 52 for storing scoring information corresponding to pitch difference data, as illustrated in FIG. It has been. The music data stored in the music data memory area 50 includes a music track, a guide melody track, and a control data track as illustrated in FIG. 5B. In the music track, a track of various parts including a melody track and a rhythm track is formed. The guide melody track stores the melody sequence data of the karaoke song, that is, the melody that the singer should sing. The control data track stores section division data indicating the starting point of the singing section of the karaoke song.

  The scoring information corresponding to the pitch difference data stored in the scoring information memory area 52 has a data structure in which the pitch difference data is associated with the scoring as illustrated in FIG. For example, “100 semitones” as pitch difference data is associated with “100 points” as a scoring.

  The ROM (not shown) built in the voice control unit 24 is provided with a guide melody buffer 60, a reference data register 62, and a difference data storage area 64, as illustrated in FIG. 5C. The guide melody buffer 60 temporarily stores the read guide melody data. The reference data register 62 stores a reference extracted from the guide melody data (that is, pitch data of the guide melody). The difference data storage area 64 stores difference data between the reference and the singing voice. The reference data register 62 is a pitch data register, and the difference data storage area 64 is a pitch difference data storage area.

  In the present embodiment, the A / D converter 26 corresponds to “audio signal input means”, and the HDD 16 corresponds to “music data storage means”. In addition, the voice control unit 24 includes “karaoke performance reproduction means”, “generation means”, “pitch extraction means”, “gain setting means”, “singing period determination means”, “detection means”, “amplification means”, and It corresponds to “adjustment means” and the control unit 12 corresponds to “scoring means”. The speaker 28 corresponds to a “speaker”.

[Description of scoring process of control unit 12]
Below, the procedure of the "scoring process of the control part 12" which the control part 12 of the karaoke apparatus 1 performs is demonstrated based on the flowchart of Fig.6 (a).

  The music selection number data of the karaoke performance music received by the operation unit 18 is transmitted to the control unit 12 by the operation processing unit 22, and the control unit 12 determines whether or not the music selection number data is received ( S110). When the music selection number data transmitted from the operation processing unit 22 is received (S110: YES), the music data corresponding to the music selection number is read from the music data memory area illustrated in FIG. 5 stored in the HDD 16 (S120). ). Next, the read music data is transmitted to the voice control unit (S130).

Then, when the process of S130 is completed, the “scoring process of the control unit 12” is completed.
[Description of scoring process of voice control unit 24]
Next, the procedure of the “scoring process of the voice control unit 24” executed by the voice control unit 24 of the karaoke apparatus 1 will be described based on the flowcharts of FIGS. The operation program related to the scoring process is executed in parallel with the sequence program for executing the karaoke performance, and data exchange with the sequence program is also performed.

  First, the voice control unit 24 determines whether or not the music data transmitted from the control unit 12 has been received (S210). When the music data is received (S210: YES), the music data is reproduced and the karaoke performance is started (S215). Also, the reference counter (entire) is initialized (S220).

  Next, it is determined whether it is a period during which the prelude period or the interlude period is not sung (S225). This determination in S225 is made by determining whether the prelude period or interlude is based on the segment divided data indicating the predecessor period, the singing period, and the start point of the interlude period of the karaoke song stored in the control data track delivered from the sequence program that performs the karaoke performance. It is determined whether or not it is a period, that is, a period during which singing is not performed. If it is not the prelude period or the interlude period, that is, if it is the singing period (S225: NO), a comparison process described later is executed (S230). On the other hand, in the case of a prelude period or an interlude period (S225: YES), an adjustment process described later is executed (S235). When the comparison process is executed (S230) or when the adjustment process is executed (S235), it is determined whether or not the karaoke performance is finished (S240). If the karaoke performance has not ended (S240: NO), the process returns to S225 to perform the above-described processing.

  On the other hand, when the karaoke performance has been completed (S240: YES), the entire pitch difference data stored in the difference data storage area 64 of the ROM (not shown) built in the voice control unit 24 by the scoring process described later is used as a whole. The pitch difference data is extracted (S245), and the total pitch difference data is divided by the reference counter value to average the pitch difference data (S250). Then, the scoring information (see FIG. 12) corresponding to the pitch difference data stored in the scoring information memory area 52 of the HDD 16 is used to score according to the pitch difference data (S255). The scored score data is transmitted to the control unit 12 (S260). Then, when the process of S260 is completed, the “scoring process of the voice control unit 24” is completed.

  In the above scoring, the singing skill is judged by comparing the pitch data. That is, the volume level is not reflected in the score. This is because the sound volume varies widely depending on the vocabulary, gender, age, etc., so that it may take a point far from the skill of actual singing. Also, by not using the volume for scoring, the algorithm can be simplified and the accuracy of singing can be determined in a short time.

(1) Description of scoring process FIG. 9 is a flowchart showing a data fetching process.
First, FIG. 9A shows a procedure of data capture processing executed by the A / D converter 26 and the audio control unit 24.

  The A / D converter 26 converts the analog audio signal output from the microphone 25 to which the singing audio is input into a digital audio signal. Then, a scoring signal is generated by subtracting the reproduction signal of the music data reproduced by the karaoke performance from the audio signal from the A / D converter 26 (S2300). Then, the voice control unit 24 performs frequency counting (S2302) in units of 50 ms frames using this scoring signal. The calculated frequency count value is read every 50 ms. This point will be described later with reference to a flowchart showing the comparison process in FIG.

  Here, the voice signal is the singing voice input to the microphone 25 converted into an analog signal by the microphone 25 and output to the A / D converter 26, and the output analog signal is converted to the A / D converter 26. Refers to the signal converted to digital form by.

  In the following description, “audio signal” simply refers to a digital audio signal. When it is necessary to distinguish between analog and digital formats, an analog audio signal and a digital audio signal, respectively. It is described as a signal.

  FIG. 9B is a flowchart showing a procedure of guide melody data fetching processing executed by the voice control unit 24. This process is executed when the event data of the guide melody track is delivered from the sequence program that executes the karaoke performance. First, the guide melody data passed from the sequence program is taken into the guide melody buffer 60 of the ROM (not shown) built in the voice control unit 24 (S2304). Pitch data (that is, reference) is extracted from the guide melody data (S2306). Then, the reference data register 62 in the ROM (not shown) built in the voice control unit 24 is updated with the pitch data extracted in this way (S2308). Therefore, the reference data register 62 is updated each time new guide melody data is input.

  Next, FIG. 10 is a flowchart showing details of the comparison process (S230 in FIG. 7) of the “scoring process of the voice control unit 24” executed by the voice control unit 24. This process takes the frequency count value of the scoring signal, converts it into pitch data and frequency data of the scoring signal, and compares it with the pitch data of the reference data obtained by the reference data input operation of FIG. 9B. Thus, the difference data is obtained. This comparison operation is executed every 50 ms, which is one frame time of the singing voice signal.

  First, it is determined whether or not the reference is updated (S2310). If the reference is not updated (S2310: NO), the process returns. When the reference is updated (S2310: YES), the reference counter (entire) is incremented (S2312). Then, the frequency count value described above is read (S2314), and pitch data is generated based on the frequency count value (S2316). Next, the scoring signal and the reference pitch data are compared to calculate the difference (S2318), and the calculated difference is stored as pitch difference data in the storage area corresponding to the current section of the difference data storage area 64. (S2320).

(2) Description of Adjustment Process Next, details of the above-described adjustment process (S235 in FIG. 7) will be described based on the flowchart in FIG.

  First, the A / D converter 26 converts the analog audio signal output from the microphone 25 to which the singing audio is input into a digital audio signal. Then, a scoring signal is generated by subtracting the reproduction signal of the music data reproduced by the karaoke performance from the audio signal from the A / D converter 26 (S2350). Then, the voice control unit 24 detects the signal level of the scoring signal (S2352). Next, it is determined whether the signal level of the scoring signal is equal to or higher than a specified value (S2354). If the signal level of the scoring signal is equal to or higher than the specified value (S2354: YES), the reproduction signal of the music data reproduced by the karaoke performance is amplified (S2356). Specifically, as illustrated in FIG. 1, the gain is instructed to the variable gain amplifier M32, and the signal level of the scoring signal is adjusted to be equal to or less than a specified value.

  On the other hand, if the signal level of the scoring signal is not equal to or higher than the specified value (S2354: NO), the process returns. This adjustment process is executed every 50 ms, which is one frame time of the singing voice signal. Therefore, control is performed so that the signal level of the scoring signal becomes equal to or less than the specified value every 50 ms.

[Description of scoring display processing of control unit 12]
Below, the procedure of the "scoring display process of the control part 12" which the control part 12 of the karaoke apparatus 1 performs is demonstrated based on the flowchart of FIG.6 (b).

  First, the control unit 12 determines whether or not the scoring data transmitted by the voice control unit 24 has been received (S310). When the scoring data transmitted by the voice control unit 24 is received (S310: YES), the scoring is controlled to be displayed on the display unit 36 (S320).

For example, the scoring data is displayed on the display unit 36 as shown in FIG. In this example, the scoring result “80” is displayed.
Then, when S320 ends, the present “scoring display processing of the control unit 12” ends.

[Description of effects]
(1) In the conventional singing scoring system, since the microphone 25 also receives the sound of the guide melody emitted from the speaker 28 in addition to the singer's voice, the singer's voice signal and the guide are also used. The signal added with the sound signal of the melody is scored singing, and it tends to be an unwilling scoring result for the singer.

  On the other hand, according to the karaoke apparatus 1 of the present embodiment, an analog audio signal output from the microphone 25 to which a singing voice to which a performance sound of a karaoke song and a guide melody are added is input as a digital audio signal. Is converted by the A / D converter 26. Then, from the audio signal from the A / D converter 26, the performance signal of the karaoke song reproduced from the music data by the karaoke performance and the sound signal of the guide melody are subtracted to generate a scoring signal. Next, a pitch difference is calculated from the pitch data of the generated scoring signal and the pitch data extracted from the guide melody data of the music data, and the score is scored according to the calculated pitch difference.

  Therefore, according to such a karaoke apparatus 1, regarding a singing score, even when a guide melody is emitted from the speaker 28 to guide the karaoke song, a sound signal corresponding to the guide melody emitted from the speaker 28 is obtained. Since scoring is performed based on the scoring signal generated by subtracting, an appropriate scoring result can be obtained.

  (2) Also, according to the karaoke apparatus 1 of the present embodiment, the prelude by the segment division data indicating the starting point of the singing segment of the karaoke song stored in the control data track delivered from the sequence program for executing the karaoke performance. It is determined whether or not the period or interlude period is not sung. In the case where the singing voice in which the performance sound of the karaoke song and the guide melody are added is input during the period in which the prelude period or the interlude period is not sung, the analog audio signal output from the microphone 25 to which the singing voice to which the melody is added is input in a digital format. The A / D converter 26 converts the audio signal. Then, from the audio signal from the A / D converter 26, the performance signal of the karaoke song reproduced from the music data by the karaoke performance and the sound signal of the guide melody are subtracted to generate a scoring signal. Next, the signal level of the generated scoring signal is detected, and the performance signal of the karaoke song and the guide melody reproduced from the music data by the karaoke performance so that the detected signal level of the scoring signal is equal to or less than the specified value. Adjust the output signal level of the sound signal.

  Therefore, the input value of the sound signal corresponding to the guide melody emitted from the speaker 28 input to the microphone 25 is subject to fluctuations depending on the volume of the speaker and the position of the microphone changed by the singer. By doing so, it is possible to automatically adjust the input value of the sound signal corresponding to the guide melody, which is reduced even for such fluctuations, and to obtain a more appropriate scoring result.

[Other embodiments]
In the above embodiment, the music data is MIDI data, but is not limited to this. Music data is roughly divided into MIDI data and data other than MIDI data. Data other than MIDI data includes PCM music data generally called PCM or raw sound as illustrated in FIG. In the case of a song to be scored with such PCM music data, scoring data other than PCM data is assigned in advance, and the voice control unit 24 extracts the scoring data from the PCM music data during karaoke performance, and uses it as scoring data. Even with PCM music data, scoring can be performed.

It is a figure which shows schematic structure centering on the function of the karaoke apparatus. It is explanatory drawing which shows the timing chart of switch M38, switch M40, and variable gain amplifier M32 before a karaoke performance and after a karaoke performance. It is explanatory drawing which shows the pitch data of the guide melody data of a music database, and the pitch data of the signal for scoring. 1 is a block diagram illustrating a configuration of a karaoke apparatus 1. FIG. (A) is explanatory drawing which shows the memory area provided in HDD16, (b) is explanatory drawing which shows the structure of music data, (c) is in ROM (not shown) which the audio | voice control part 24 incorporates. It is explanatory drawing which shows the provided guide melody buffer 60, the reference data register 62, and the difference data storage area 64. (A) is a flowchart which shows the procedure of the "scoring process of the control part 12" which the control part 12 performs, (b) is the flowchart which shows the procedure of the "scoring display process of the control part 12" which the control part 12 performs It is. It is a flowchart which shows the first half of the procedure of "the scoring process of the audio | voice control part 24" which the audio | voice control part 24 performs. 10 is a flowchart showing the second half of the procedure of “scoring process of voice control unit 24” executed by the voice control unit 24; 10 is a flowchart showing a procedure of data fetching processing performed in [Scoring processing] of “Scoring processing of voice control unit 24” executed by the voice control unit 24; It is a flowchart which shows the procedure of the comparison process implemented in [Scoring process] of "Scoring process of the audio | voice control part 24" which the audio | voice control part 24 performs. It is a flowchart which shows the procedure of the adjustment process implemented in [Adjustment process] of "Scoring process of the audio | voice control part 24" which the audio | voice control part 24 performs. It is explanatory drawing which shows the scoring information according to the data of pitch difference. It is explanatory drawing which shows the example which displayed the scoring result on the display part. It is explanatory drawing which shows the music data structure other than MIDI data.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Karaoke apparatus, 2 ... Remote control terminal, 12 ... Control part, 14 ... Interface part, 16 ... Hard disk (HDD), 18 ... Operation part, 20 ... Infrared communication part, 22 ... Operation processing part, 24 ... Voice control part, 25, 25a, 25b ... microphone, 26 ... A / D converter, 28 ... speaker, 30 ... MIDI sound source, 32 ... video RAM, 34 ... video playback unit, 36 ... display unit, 38 ... video control unit, 39 ... bus, 40 ... USB, 50 ... music data memory area, 52 ... scoring information memory area, 60 ... guide melody buffer, 62 ... reference data register, 64 ... difference data storage area, 100 ... network.

Claims (3)

An audio signal input means for inputting an audio signal of karaoke singing;
Music data storage means for storing music data including pitch data of singing melody of karaoke music;
Karaoke performance reproduction means for reproducing the music data stored in the music data storage means as a sound signal, and outputting the reproduced sound signal and the voice signal of the karaoke song input from the voice signal input means to a speaker;
The first signal corresponding to the sound signal output from the karaoke performance reproducing means is compared with the second signal corresponding to the karaoke singing voice signal input from the voice signal input means, and the second signal is Generating means for generating a scoring signal obtained by subtracting the first signal;
Pitch extraction means for extracting pitch data from the scoring signal generated by the generation means;
Gain setting means for setting a gain for subtracting the first signal from the second signal based on the scoring signal generated by the generating means;
The pitch difference between the pitch data of the singing melody of the karaoke song stored in the music data storage means and the pitch data of the scoring signal extracted by the pitch extraction means is calculated, and the calculated pitch difference Scoring means for scoring based on
A karaoke apparatus comprising: The karaoke apparatus according to claim 1,
The gain setting means is
Singing period determination means for determining whether or not it is a singing period based on the performance playback progress status in the karaoke performance playback means,
Detecting means for detecting a signal level of the scoring signal generated by the generating means;
Amplifying means capable of amplifying the signal level of the first signal;
Adjusting means for adjusting the signal level of the first signal by the amplifying means;
With
When the singing period determining means determines that it is not a singing period, the detecting means detects the signal level of the scoring signal generated by the generating means, and the adjusting means is detected by the detecting means. A karaoke apparatus characterized by adjusting the signal level of the first signal by the amplifying means so as to minimize the signal level of the scored signal. The karaoke apparatus according to claim 2,
The karaoke apparatus characterized in that the period for which the singing period determining means determines that it is not a singing period is a prelude period and an interlude period.

Images