JP4470821B2 - Karaoke device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain more appropriate graded results, when several people are trying to sing on a KARAOKE machine having grading function. <P>SOLUTION: This Karaoke machine calculates the difference between the sound volume data of each sound signal, extracted from the sound signals in Karaoke singing into microphones 25a to 25c and the sound volume data of the main melody part and several harmory part read from the musical data, and grades the various singing based on the calculated sound volume difference. It chooses one piece grading data for each part from the graded results of the main melody part and each harmory part so that all the voice signals differ in each graded result, and sets an overall grading on the basis of the highest mark in the total points of the all chosen graded results (S268). <P>COPYRIGHT: (C)2007,JPO&amp;INPIT

Description

  The present invention relates to a singing score in a karaoke apparatus, and relates to a technique for obtaining a more appropriate scoring result when there are a plurality of singers.

  Conventionally, a scoring function is well known as an incidental function of a karaoke apparatus. This scoring function generates singing data indicating the singing state such as pitch, volume or tempo uttered by the singer by sampling the singer's voice signal input from the microphone. The singing data is compared with scoring reference data such as main melody part data in karaoke data, and a predetermined score is given based on the comparison result to generate scoring data. When the singing part ends, the scores in the scoring data are totaled to calculate a total score. The total score is displayed as it is on the scoreboard or the display, or a video reflecting the total score such as a video including a predetermined message or predetermined expression content is output to the display. (For example, refer to Patent Document 1).

A karaoke device for scoring each person's singing voice when a plurality of people sing, such as a karaoke device for selecting one of a plurality of scoring parts and scoring (for example, see Patent Literature 2) or duet music (for example, Patent Literature) 3). These conventional technologies preset each microphone corresponding to the main melody part and the humor part, singing data generated from the singer's voice signal input from each microphone, and the main melody part in the karaoke data, The scoring standard data with the Hamori part was compared, and the main melodic part and the Hamori part were scored based on the comparison results. Next, instead of setting each microphone in advance corresponding to the main melody part and the humor part, the microphone of the main melody part and the microphone of the humor part are automatically set based on the voice signal of the singer input from the microphone. A method of determining and scoring in this way can be considered.
Japanese Patent No. 3261990 JP 2004-109260 A JP 2000-330580 A

  In such a conventional method, the number of microphones is two in total, one for the main melody part and one for the hamori part. Therefore, instead of setting each microphone in advance corresponding to the main melody part and the hamori part, the microphone of the main melody part and the microphone of the hamori part are automatically determined from the voice signal of the singer input from the microphone. In this case, if one of the microphones can be identified as a main melody part microphone, the other can be uniquely determined as a hammer part microphone.

  However, in the case of the karaoke field, if the group sings, the number of singers may exceed two, and if the number of singers exceeds two, the number of microphones exceeds two corresponding to the number of singers. If the number of microphones is three or more and the number of parts of the hamori part is two or more, even if the main melody part microphone can be specified, the number of remaining microphones is two or more and the hamori part There are two or more parts.

  Therefore, it is not possible to associate the singing data generated from the singer's voice signal input from two or more microphones with the scoring reference data of two or more kinds of morimori parts in the karaoke data. And the singing data generated from the voice signal of the singer input from two or more microphones by the scoring means and the scoring reference data of two or more kinds of humor parts in the karaoke data are mistakenly associated and compared. As a result of scoring the main melody part and scoring the hamori part based on the comparison result, the overall score of the scoring result may be deteriorated.

Here, the hamori part is a part that sings with respect to the main melody part, for example, at 3 degrees (or 5 degrees, etc.).
Therefore, the present invention relates to singing in a karaoke apparatus, and when there are a plurality of singers, the singers' singing parts are automatically recognized in order to make the singers or listeners happy as entertainment. The purpose is to make it possible to obtain a scoring result with a high score as a field-specific scoring.

  The karaoke apparatus of the present invention made to solve the above-mentioned problems (1: In this section, in order to facilitate the understanding of the invention, “the best mode for carrying out the invention” is necessary as necessary. The components described in the column are shown in parentheses, but this description does not mean that the scope of the claims is limited.) “The sound of each audio signal extracted from each audio signal of a karaoke song” The pitch difference between the high data and the pitch data of the humor part corresponding to the type information of the main melody part and the humor part read from the music data is calculated for each sound signal. Based on the height difference, scoring data of the main melody part and scoring data of the spider part corresponding to the type information of the spider part are generated. From the scoring data of the spider part corresponding to the generated spider part type information, one scoring data is selected for each part so that the sound signals corresponding to each scoring data are all different, and the selected In all combinations of scoring data, total score data is generated based on the scoring data, and the generated total score data is compared, and as a result of comparison, the total score is scored based on the highest score. Do it. ”

  Specifically, the music data storage means (16) stores music data including karaoke performance data and pitch data of singing melody of karaoke music. The plurality of audio signal input means (26a to 26c) input the karaoke singing audio signal, and the audio signal storage means (16) receives the respective audio signals input by the plurality of audio signal input means (26a to 26c). Remember.

  The audio signal storage / readout control means (24) performs storage / readout control of each audio signal to the audio signal storage means (16). Moreover, a pitch extraction means (24) extracts pitch data of a karaoke song from each voice signal. A plurality of audio signal input detecting means (27a to 27c) are provided corresponding to each of the plurality of audio signal input means (26a to 26c), and each audio signal from the plurality of audio signal input means (26a to 26c) is provided. Detect whether input is possible. Further, the hamori type correspondence storage means (12) stores the correspondence between the number of hame parts and the type information of the hame parts. Further, the scoring means (12) based on the pitch data of the singing melody of the karaoke song read from the music data storage means (16) and each pitch data of the karaoke song extracted by the pitch extracting means (24). ) Will be scored.

  Then, the scoring means (12) determines whether or not to execute the hamori scoring process when the music data has the pitch data of the main melody part and one or more hamori parts. If it is determined to execute, the hammer scoring process shown in (A) to (D) below is executed.

  (A) A plurality of sound signal input means (27a to 27c) capable of inputting sound signals are detected via a plurality of sound signal input detection means (27a to 27c), and the detected sound signal input means ( 27a to 27c), the number of parts of the hammer part is determined, and the type information of the hammer part corresponding to the determined part number of the part is read from the hammer type correspondence storage means (12).

  (B) Each voice signal stored in the voice signal storage means (16) is read by the voice signal storage / reading control means (24), and pitch data is extracted from each voice signal by the pitch extraction means (24). To do. Then, the music data having the pitch data of the hamori part corresponding to the type information of the main melody part and the hamori part is read from the music data storage means (16), and the main melodies part and the hamori part type information is read from the music data. The pitch data of the corresponding hamori part is read out, the pitch data is extracted from the audio signal by FFT operation from each audio signal, and the pitch data of the hamori part corresponding to the type information of the main melody part and the hamori part and each audio signal The pitch difference corresponding to the pitch data is calculated for each audio signal, and the scoring data of the main melody part and the scoring data of the hammer part corresponding to the type information of the hammer part based on the respective pitch differences, , Generate.

  Here, the pitch difference corresponding to the pitch data of the hamori part corresponding to the type information of the main melody part and the hamori part and the pitch data of each audio signal are calculated, and the main melody is calculated based on the respective pitch differences. When generating scoring data of a hamori part corresponding to the type information of the part and the hamori part, the section of the music for calculating each pitch difference can be a section of one entire music. In addition, if a flag for starting recording and a flag for ending recording are incorporated in advance in the music data, it is possible to make the section shorter than the entire one song designated by the flag group in one song instead of the entire song. .

  (C) From the generated scoring data of the main melodic part and the scoring data of the spider part corresponding to the generated spider part type information, one scoring data for each part corresponds to each scoring data. The audio signals to be selected are selected to be different from each other, and total score data is generated based on the score data in all combinations of the selected score data.

  (D) From the generated scoring data of the main melodic part and the scoring data of the spider part corresponding to the generated spider part type information, one scoring data for each part corresponds to each scoring data. The audio signals to be selected are selected to be different from each other, the total score data in all combinations of the selected scoring data are compared, and the total score is scored based on the highest score as a result of the comparison.

  According to such a karaoke apparatus, when there are a plurality of singers regarding the singing score in the karaoke apparatus, the singer's singing part is automatically recognized so that the singer or the listener can be pleased as entertainment. In addition, it is possible to obtain a scoring result with a high score as a scoring unique to the karaoke field.

  In the karaoke apparatus according to claim 1 described above, the melody scoring process is performed when the music data has pitch data of the main melody part and one or more humor parts, but the music data is the main melody part. When the pitch data of the karaoke part is not included, it is desirable to use the karaoke apparatus according to claim 2.

  In other words, the karaoke apparatus according to claim 2 has the same components as in claim 1, and the scoring means has the pitch data of the main melody part and the pitch data of the hamori part. If not, it is determined whether or not to execute the hammering scoring process, and if it is determined to execute the hammering scoring process, the hammering scoring process shown in (E) to (H) below is executed.

  (E) A plurality of sound signal input means (27a to 27c) capable of inputting sound signals are detected via a plurality of sound signal input detection means (27a to 27c), and the detected plurality of sound signal input means ( 27a to 27c), the number of parts of the hamori part is determined, and the type information of the hame part corresponding to the determined part number of the hame part is read from the hame type correspondence storage means (12).

  (F) Each voice signal stored in the voice signal storage means (16) is read by the voice signal storage / reading control means (24), and pitch data is extracted from each voice signal by the pitch extraction means (24). To do. Then, the music data having the pitch data of the main melody part is read from the music data storage means (16), the pitch data of the main melody part is read from the music data, and the hamori part corresponding to the type information of the hamori part is read. Pitch data is generated from the pitch data of the main melody part, the pitch data is extracted from the voice signal by FFT calculation from each voice signal, and the pitch of the hammer section corresponding to the type information of the main melody part and the generated hammer section The pitch difference corresponding to the data and the pitch data of each voice signal is calculated for each voice signal, and the scoring data of the main melody part and the type information of the hammer part based on each pitch difference Scoring data of the hamori part is generated.

  (G) From the generated scoring data of the main melodic part and the scoring data of the spider part corresponding to the generated spider part type information, one scoring data for each part corresponds to each scoring data. The audio signals to be selected are selected to be different from each other, and total score data is generated based on the score data in all combinations of the selected score data.

  (H) From the generated scoring data of the main melodic part and the scoring data of the spider part corresponding to the generated spider part type information, one scoring data for each part corresponds to each scoring data. The audio signals to be selected are selected to be different from each other, the total score data in all combinations of the selected scoring data are compared, and the total score is scored based on the highest score as a result of the comparison.

  According to such a karaoke apparatus, when it is desired to sing not only the main melody part but also a hamori part (for example, 3 degrees (5 degrees) up and down with respect to the main melody part) by a plurality of people, Therefore, not only the main melody part but also the hamori part can be recognized and a high scoring result can be obtained. Therefore, for a singer who wants to sing a hamori part, the number of songs that can be scored can be increased. Moreover, since a plurality of audio signal input means (26a to 26c) are provided, even if a song having only the main melody part is sung by adding the hamori part, the audio signal can be input separately into the main melody part and the hamori part. It is possible to prevent scoring with a voice in which the singing voice of the hamori part is added to the singing voice of the main melody part. In particular, the microphone used by the main melody part singer and the hamori part singer is not set in advance, and the voice signal of the main melody part and the voice signal of the humor part cannot be specified in advance. Even when the voice volume of the singer of the morimori part is large, it is possible to prevent a bad grading result from being scored with the voice of the morimori part having a large voice volume.

  Not only the total score based on the highest score is displayed, but also the scoring data of the main melodic part and the scoring data of the spider part corresponding to the generated spider part type information, one for each part. It is also possible to select two scoring data so that the audio signals corresponding to the respective scoring data are all different, and display the total score in all combinations of the selected scoring data.

That is, in the karaoke apparatus according to claim 1 or 2, as in the karaoke apparatus according to claim 3, the display means (36) for displaying the scoring result and the scoring displayed by the display means (36). Display switching receiving means (18) for receiving a display switching instruction for the result. According to such a karaoke apparatus, the scoring means (12) causes the display means to display the total score based on the highest score, which is the result of comparing the total score data in all combinations of the scoring data, as the scoring result. It is determined whether or not to switch the display of the scoring result displayed by the display unit (36) depending on whether or not the instruction to switch the display of the scoring result is received via the switching receiving unit (18), and the scoring result When it is determined that the display switching is executed, one of the total score data in all combinations of the scoring data can be displayed as a scoring result on the display means . Therefore, even if the part that the singer himself intended to sing is different from the part of the scoring data that is the basis of the overall score, the overall score that combines the scoring data for the part that the singer intends to sing is displayed. You can also

  Further, in the karaoke apparatus according to any one of claims 1 to 3, when the user looks at the music menu of the quick sample and knows that the music is a music that scores the hamori part, or the user When the music menu displayed on the display shows that the music is to be scored, the correspondence storage means (16) uses the music selection number corresponding to the karaoke music, as in the karaoke device according to claim 4. It is preferable to store a correspondence relationship with the hamori scoring information indicating whether or not to score the hamori part, and the music selection number receiving means (18) receives the music selection number. That is, the scoring means (12) reads out the hamori scoring information corresponding to the music selection number received via the music selection number receiving means (18) from the correspondence storage means (16), and performs the hamori scoring process based on the hamori scoring information. It can be determined whether or not to execute.

Then, when the read hamori scoring information is a music that scores the hamori part, the hamori scoring process shown in claim 1 is executed.
On the other hand, in the case where the read humor score information is a tune that does not score the humor part, in the karaoke device according to any one of claims 2 to 4, as in the karaoke device according to claim 5, The hamori scoring reception means (18) may receive an instruction to score the hamori part. That is, the scoring means (12) can determine whether or not to execute the hamori scoring process based on whether or not an instruction for scoring the hamemori part is received via the hamori scoring reception means (18).

And when the instruction | indication which scores a hamori part is received via the hamori scoring reception means (18), the hamori scoring process shown in claim 2 is executed.
On the other hand, when the instruction for scoring the spider part is not received via the spider scoring receiving means (18), the spider scoring process is not executed.

    Further, as shown in claim 6, when the scoring means in the karaoke apparatus according to any one of claims 1 to 5 is realized by a computer, it can be provided as a program executed by the computer, for example. Such a program is recorded on a computer-readable recording medium such as a flexible disk, a magneto-optical disk, a CD-ROM, a hard disk, a ROM, or a RAM, and is loaded into a computer for execution as necessary. A function as a scoring means can be realized by loading and executing the program.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing the configuration of the karaoke apparatus.
[Description of configuration of karaoke apparatus 1]
As shown in FIG. 1, the karaoke apparatus 1 includes a control unit 12 that controls the operation of the karaoke apparatus 1 as a whole, an interface unit 14 for connecting the karaoke apparatus 1 to the network 100, a musical piece that shows the accompaniment content and lyrics of a performance piece. A hard disk (HDD) 16 for storing data, video data, etc., an operation unit 18 comprising a plurality of keys and switches, an infrared communication unit 20 for receiving infrared signals from the remote control terminal 2 and mobile phone by infrared communication, an operation unit An operation processing unit 22 that processes a signal from 18, an audio signal (signal related to sound and sound) of a musical composition is generated from music data stored in the hard disk 16, and the generated audio signal and microphone (hereinafter referred to as a microphone) are generated. Singing voice is input by 25a-25c, A / D converter 26a- 6c, the audio control unit 24 that amplifies each audio signal digitized by the A / D converters 26a to 26c and outputs the amplified audio signal to the speaker 28, and each audio digitized by the A / D converters 26a to 26c Audio input switches 27a to 27c that detect whether a signal is in an input state or a disconnected state, a MIDI sound source 30, a video RAM 32 that temporarily stores video information, a video playback unit 34 that controls playback of video based on video data, and a video RAM 32 And a video control unit 38 for controlling the display on the video display unit 36 of video information stored in the video playback unit 34.

  The control unit 12, interface unit 14, HDD 16, infrared communication unit 20, operation processing unit 22, video RAM 32, video playback unit 34, and video control unit 38 are connected by a bus 39. The control unit 12 and the audio control unit 24 are connected by a USB 40. In addition, the control part 12 and the audio | voice control part 24 perform the various processes mentioned later.

  Among these, as shown in FIG. 2A, the HDD 16 has a music database memory area 50 for storing a music database, and a voice signal / scoring data memory area (memory A, memory for storing voice signals and scoring data). B, memory C) 52, total point data memory area (memory D) 54 for storing total point data, period memory area (memory E) 56 for storing the digitized period, and pitch difference data A scoring information memory area 58 for storing scoring information is provided. Hereinafter, data stored in each memory area will be described in order.

(A) Music Database The music database stored in the music database memory area 50 has a data structure that associates the score information, the music selection number, and the file name as illustrated in FIG. For example, “90001” as the music selection number is associated with “hamori scoring music” as the hamori scoring information and “CA090001.MIDI” as the file name. Hamori scoring information and file names are also associated with other music selection numbers.

  Here, hamori means that the singing voice of the first person who sings the main melody part is superimposed with another singing voice by the second person, and the first person and the second person sing at the Kyowa interval. To create a harmony (chord) state by the first person and the second person.

  Generally speaking, in terms of pitch, singing three times above the main melody part. 3 degrees above means a pitch that is 3 times higher. For example, if the main sound emitted by the first person is “Do”, the main sound emitted by the second person is “Mi”. It is.

In other words, the hamori part is a part that sings at 3 degrees (or 5 degrees, etc.) of the Kyowa pitch with respect to the main melody part.
Therefore, the pitch reference for scoring the hammer part is set to 3 degrees, 3 degrees, 5 degrees, and 5 degrees below the pitch of the main melody part as illustrated in FIG. Further, for example, a combination illustrated in FIG. 3 can be set for a combination with respect to the main melody part when singing by two to five people.

  As for the pitch difference that is the basis of scoring, as shown in FIG. 4, the pitch difference is calculated from the pitch data of the main melody part of the singer and the pitch data of the main melody part of the music data. Also, a pitch difference is calculated from the pitch data of the singer's hammer part and the pitch data of the song part of the song data. Further, the pitch data of the music data shown in FIG. 4 shows a special case in which the pitch data value is assumed to be constant for both the main melody part and the hamori part for easy explanation.

(B) Audio signal The audio signal means that the singing voice input to the microphones 25a to 25c is converted into an analog signal by the microphones 25a to 25c and output to the corresponding A / D converters 26a to 26c. A signal obtained by converting the converted analog signal into a digital format by the A / D converters 26a to 26c.

  In the following description, “audio signal” simply refers to a digital audio signal. When it is necessary to distinguish between analog and digital formats, an analog audio signal and a digital audio signal, respectively. It is described as a signal.

  As shown in FIG. 6A, each audio signal is stored in the audio signal memory area A (n) in the memory A, memory B, and memory C provided corresponding to the microphone numbers (microphones 25a to 25c). ), B (n), and C (n) are stored by the control unit 12, respectively.

  For example, the audio signal corresponding to the microphone number of the microphone 25a is stored in the audio signal memory area A (n) in the memory A by the control unit 12. Similarly, audio signals corresponding to microphone numbers of other microphones are stored by the control unit 12 in the audio signal memory areas B (n) and C (n) in the memory B and the memory C, respectively.

  Each audio signal has a digit “1 to n” of the digitized period (1 to n) and a microphone number for each digitized period (1 to n) as illustrated in FIG. Are stored in the memory areas A (n), B (n), and C (n) by the control unit 12, respectively. For example, the voice signal corresponding to the microphone number of the microphone 25a and the digitized period (1) is stored in the memory area by the control unit 12 together with the digitized period value “1” and the microphone number of the microphone 25a. Stored in A (1).

  Here, the period to be digitized is equal to the sampling period (seconds) that is the reciprocal of the sampling frequency. For example, when the sampling frequency is 48 KHz, the period to be digitized is 20.83 microseconds.

(C) Scoring data The scoring data is the pitch difference between the pitch data of each voice signal extracted from each voice signal of karaoke singing and the pitch data of the singing melody read from the song data. Data that is calculated for each audio signal and scored based on the pitch difference.

  As shown in FIG. 6A, each scoring data is a memory of +3 pitch scoring data in memory A, memory B, and memory C provided corresponding to the microphone numbers (microphones 25a to 25c). Areas A (n + 1), B (n + 1), C (n + 1), memory areas A (n + 2), B (n + 2), C (n + 2) for high melody high scoring data, And -3 pitch scoring data memory areas A (n + 3), B (n + 3), and C (n + 3) are stored by the control unit 12, respectively.

  For example, the +3 pitch scoring data corresponding to the microphone number of the microphone 25a is stored by the control unit 12 in the memory area A (n + 1) of the +3 pitch scoring data in the memory A. Similarly, the +3 pitch scoring data corresponding to the microphone numbers of the microphones 25b and 25c is stored by the control unit 12 in the memory areas B (n + 1) and C (n + 1) of the +3 pitch scoring data in the memory B and the memory C, respectively. Is done. The same applies to the main melody high score data and -3 pitch data.

  Note that the +3 pitch scoring data, the main melody scoring data, and the -3 pitch scoring data are represented by a numerical value “1” in the digitized numerical value “n” of the final period n as illustrated in FIG. A numerical value “n + 1”, “n + 2”, “n + 3” obtained by adding a numerical value “2”, a numerical value “3”, and a memory area A (n + 1), B (n + 1), associated with a microphone number, Control to C (n + 1), A (n + 2), B (n + 2), C (n + 2), A (n + 3), B (n + 3), C (n + 3) Each of them is stored by the unit 12. For example, the +3 pitch scoring data corresponding to the microphone number of the microphone 25a is stored in the memory area A (n + 1) by the control unit 12 together with the numerical value “n + 1” and the microphone number of the microphone 25a.

(D) Overall score data The overall score data is one of all score data of the hamori part corresponding to the type information of the main melody part and the hamori part, and an audio signal corresponding to the score data. In all combinations of scoring data selected to be different from each other, it refers to data that is scored based on the scoring data.

  As shown in FIG. 7A, each total score data is transferred to the memory areas D (1) to D (7) provided corresponding to the scoring results 1 to 7 in the memory D. Is stored respectively. As an example, the total score data corresponding to the scoring result 1 is stored in the memory area D (1) by the control unit 12. Similarly, the total score data corresponding to the scoring results 2 to 7 is also stored in the memory areas D (2) to D (7) by the control unit 12, respectively.

  Note that the total score data is a numerical value “m” corresponding to the scoring results 1 to 7, as shown in FIG. 7B, +3 pitch part scoring data and its microphone number, main melody scoring data and its microphone number. , And -3 pitch part scoring data and their microphone numbers are associated with each other and stored in the memory areas D (1) to D (7) by the control unit 12, respectively. For example, the total score data corresponding to the scoring result 1 is a numerical value “1” corresponding to the scoring result 1, scoring data of +3 pitch part and its microphone number, scoring data of main melody and its microphone number, and − The three-pitch part scoring data and its microphone number are stored by the control unit 12 in the memory area D (1).

(E) Digitization period The digitization period refers to the sampling period (seconds), which is (b) the reciprocal of the sampling frequency, as described above for the audio signal.

  Now, the digitized period is stored in the memory area E by the control unit 12 as illustrated in FIG. For example, the numerical value “1” of the period (1) to be digitized is stored in the memory area E by the control unit 12.

(F) Scoring information according to pitch difference data Scoring information according to pitch difference data has a data structure in which pitch difference data and scoring are associated with each other as illustrated in FIG. . For example, “100 semitones” as pitch difference data is associated with “100 points” as a scoring.

  Further, the ROM (not shown) built in the control unit 12 stores the type information of the hammer part. As shown in FIG. 5, the type information of this hamori part has a data structure in which the number of parts of the hame part and the type of the hame part are associated with each other. As an example, the numerical value “1” as the number of parts of the hamori part is associated with “the third degree of hamori” as the type of the hamori part.

  In the present embodiment, the HDD 16 corresponds to “music data storage means”, “audio signal storage means”, and “correspondence relation storage means”, and the ROM (not shown) built in the control unit 12 is “corresponding to the type of memory”. The A / D converters 26a to 26c correspond to “audio signal input means”. The voice control unit 24 corresponds to “voice signal storing / reading control means” and “pitch extraction means”, and the control unit 12 corresponds to “scoring means”. The operation unit 18 corresponds to “music selection number receiving means”, “hamo scoring receiving means”, and “display switching receiving means”, the display unit 36 corresponds to “display means”, and the voice input switches 27a to 27c are “ This corresponds to “audio signal input detection means”.

[Explanation of the outline of the scoring process]
Below, before demonstrating the detail of the hamori scoring process of the karaoke apparatus 1, the outline | summary of a hamori scoring process is demonstrated based on FIG.

  First, with respect to the pitch data of each voice signal extracted from each voice signal of the karaoke song corresponding to the microphones A, B, and C, and the pitch data of the main melody part read from the music data, the main melody A pitch difference is calculated between the pitch data of the +3 pitch part that is 3 degrees above the Kyowa pitch and the pitch data of the -3 pitch part that is 3 degrees below the main melody. The pitch difference block 60 of each part for each set number illustrated in FIG. 17 shows the calculated pitch differences arranged for each set number 1-6. Here, the set numbers 1 to 6 are one each from the pitch difference of the main melody part, the pitch difference of the +3 pitch part, and the pitch difference of the -3 pitch part, and their pitches. Numbers are assigned to all combinations of pitch differences selected so that the microphones A, B, and C corresponding to the differences are all different. In the pitch difference block 60 of each part for each group number, the main melody part is “main melody”, the +3 pitch part 3 degrees higher than the main melody is “+3 pitch”, and the main melody The -3 pitch part 3 degrees below the Kyowa pitch is called "-3 pitch".

  Based on the calculated pitch difference, the score is scored from the scoring information corresponding to the pitch difference data illustrated in FIG. 14 stored in the HDD 16 described above. The scoring block 62 of each part for each group number illustrated in FIG. 17 shows the scoring results scored corresponding to the pitch differences arranged in the pitch difference block 60 of each part for each group number. It is.

  Next, corresponding to the group number of the scoring block 62 of each part for each group number, the scoring results of the microphones A, B, and C are weighted and averaged to score. The total score block 64 for each set number illustrated in FIG. 17 indicates the total score scored corresponding to the set number of the scoring block 62 of each part for each set number.

  Then, the total points scored in the total score block 64 for each set number are compared, and the total score having the highest score is determined. The highest total score block 66 illustrated in FIG. 17 indicates the highest score total score determined.

  Further, the total score having the highest score determined in the highest total score block 66 is set as the highest total score. The highest total score block 68 illustrated in FIG. 17 indicates the highest total score having the highest score. Next, details of the hammering scoring process of the karaoke apparatus 1 will be described.

[Explanation of execution determination processing of hammer scoring process]
Below, the procedure of "execution judgment processing of the hammer scoring process" executed by the control unit 12 of the karaoke apparatus 1 will be described based on the flowchart of FIG.

  The music selection number data of the karaoke performance music received by the operation unit 18 is transmitted to the control unit 12 by the operation processing unit 22, and the control unit 12 determines whether or not the music selection number data is received ( S110). When the music selection number data transmitted from the operation processing unit 22 is received (S110: YES), the harmony scoring information corresponding to the music selection number is read from the music database illustrated in FIG. 2 stored in the HDD 16 (S115). .

  It is determined whether the read-out score information is a score score song (S120). If the read-out score information is “scoring score” (S120: YES), the file name of the karaoke performance song corresponding to the selected song number is read from the song database stored in the HDD 16 (S125). .

  Next, the music data of the karaoke performance music corresponding to the file name data is read from the music data stored in the HDD 16 to control the karaoke performance (S130). Then, whether the audio signal is in the input state or the disconnected state is detected via the audio input switches 27a to 27c, and the number of the audio input switches in which the audio signal is in the input state is counted (S135). The number obtained by subtracting the numerical value “1”, which is the number of parts of the main melody, from the counted number of the voice input switches 27a to 27c is determined as the number of parts of the hammer part (S140). Then, the type of the hammer part corresponding to the determined number of part of the hammer part is read from the kind part information illustrated in FIG. 5 stored in the HDD 16 (S145). Further, the start signal of the hammer scoring process (1) and the type information of the hammer part are transmitted to the voice control unit 24 (S150). Note that the hammer mark scoring process (1) (see FIG. 9 and FIG. 10) will be described later in the item [hamlet scoring process (1)].

  On the other hand, if the harmony scoring information read in the previous S120 is “non-scoring scored music” (S120: NO), the file name data of the karaoke performance music corresponding to the music selection number is stored in the HDD 16. Is read from the music database (S155). Then, the music data of the karaoke performance music corresponding to the file name data is read from the music data stored in the HDD 16, and the karaoke performance is controlled (S160).

  Next, the data for instructing “scoring scoring” received by the operating unit 18 is transmitted to the control unit 12 by the operation processing unit 22, but has the control unit 12 received data instructing “scoring scoring”? It is determined whether or not (S165). Then, when data indicating “scoring scoring” transmitted from the operation processing unit 22 is received (S165: YES), it is detected whether the audio signal is in an input state or a disconnected state via the audio input switches 27a to 27c. The number of voice input switches in which voice signals are input is counted (S170). In addition, the number obtained by subtracting the numerical value “1” that is the number of parts of the main melody from the counted value of the voice input switches 27a to 27c is determined as the number of parts of the hammer part (S175). Then, the type of the hammer part corresponding to the determined number of the part of the hammer part is read from the kind part information illustrated in FIG. 5 stored in the HDD 16 (S180). In addition, the start signal of the hammer scoring process (2) and the type information of the hammer part are transmitted to the voice control unit 24 (S185). Note that the hammer mark scoring process (2) (see FIG. 11 and FIG. 12) will be described later in the item [hamlet scoring process (2)].

Then, when the process of S150 or S185 is completed, the present “scoring process execution determination process” is completed.
[Explanation of Hamori Scoring Process (1)]
Next, the procedure of “hamo scoring process (1)” executed by the voice control unit 24 of the karaoke apparatus 1 will be described based on the flowcharts of FIGS. 9 and 10. In this description, it is assumed that the number of audio input switches in which the audio signal counted in S135 of FIG. 8 is in the input state is three.

  First, the voice control unit 24 determines whether or not the start signal for the hammer scoring process (1) transmitted from the control unit 12 has been received (S210). When the start signal for the hammer scoring process (1) is received (S210: YES), the mathematical expression “n = 1” is stored in a memory (not shown) of the voice control unit 24 (S212). Next, it is determined whether or not the digitized period has elapsed (S214). Here, the digitized period is 20.83 microseconds when the sampling frequency is 48 KHz, for example, as described in the above item [Description of the configuration of the karaoke apparatus 1]. Further, the measurement of the digitized period is performed by a timer (not shown) that measures the time of the voice control unit 24.

  When the digitization period elapses (S214: YES), the singing voice is input through the microphone 25a, and the voice signal output to the A / D converter 26a and digitized by the A / D converter 26a is converted to the current variable. The value of n and the microphone number of the microphone 25a are stored in the memory area A (1) of the HDD 16 illustrated in FIGS. 6A and 6B (S216).

  In addition, the singing voice is input by the microphone 25b, and the voice signal output to the A / D converter 26b and digitized by the A / D converter 26b is converted into the current value of the variable n and the microphone number of the microphone 25b as shown in FIG. The data is stored in the memory area B (1) of the HDD 16 exemplified in (a) and (b) (S218).

  Further, the singing voice is input through the microphone 25c, and the voice signal output to the A / D converter 26c and digitized by the A / D converter 26c is converted into a voice signal together with the current value of the variable n and the microphone number of the microphone 25c. The data is stored in the memory area C (1) of the HDD 16 exemplified in (a) and (b) (S220).

  Then, the numerical value “1” is added to the mathematical formula “n = 1” stored in the memory (not shown) included in the voice control unit 24 to obtain the mathematical formula “n = 2”, and the memory (not shown) included in the voice control unit 24. The mathematical expression “n = 2” is stored (S222).

  Next, when the karaoke performance ends, the control unit 12 transmits a karaoke performance end signal to the voice control unit 24, and the voice control unit 24 receives the karaoke performance end signal transmitted from the control unit 12. Whether or not (S224). If the karaoke performance end signal is not received (S224: NO), the process returns to S214 and the above-described processing is performed. On the other hand, when the karaoke performance end signal is received (S224: YES), the numerical value “n” stored in the memory (not shown) of the voice control unit 24 is the memory of the HDD 16 illustrated in FIG. 6C. It memorize | stores in the area | region E (S226).

  Subsequently, the voice control unit 24 reads the numerical value “n” stored in the memory area E of the HDD 16 illustrated in FIG. 6C (S228). And the audio | voice signal memorize | stored in memory area A (1) -A (n) of HDD16 illustrated to Fig.6 (a), (b) is read (S230). In addition, the audio signal stored in the memory areas B (1) to B (n) of the HDD 16 is read (S232). Further, the audio signal stored in the memory areas C (1) to C (n) of the HDD 16 is read (S234). Then, each song is scored based on the read audio signal. Next, the scoring process (S236 to S252) of each song will be described.

(1) Scoring A1 (S236)
Sound corresponding to each pitch data based on each audio signal read from the memory areas A (1) to A (n) of the HDD 16 and from +3 pitch part pitch data read from the HDD 16 A pitch difference is calculated, and a score is calculated based on the calculated pitch difference. Then, the scored data is stored in the memory area A (n + 1) of the HDD 16 together with the numerical value “n + 1” obtained by adding the numerical value “1” to the numerical value “n” read out in S228 and the microphone number of the microphone 25a ( S236). This scoring result is referred to as scoring A1. This process will be described in detail as follows.

  First, each pitch data corresponding to each voice signal is extracted from each voice signal read from the memory areas A (1) to A (n) of the HDD 16 by FFT calculation. Further, the music data of the karaoke performance music stored in the HDD 16 is read, and the pitch data of the +3 pitch part is read from the music data. Then, a pitch difference corresponding to each is calculated from the pitch data of the +3 pitch part read from the HDD 16 and each pitch data based on the singing voice. Subsequently, +3 pitch parts are scored from the scoring information corresponding to the pitch difference data illustrated in FIG. 14 stored in the HDD 16 described above based on the calculated pitch differences. Then, the scored data is stored in the memory area A (n + 1) of the HDD 16 together with the numerical value “n + 1” obtained by adding the numerical value “1” to the numerical value “n” read out in S228 and the microphone number of the microphone 25a ( S236).

In the following description of each scoring process, a detailed description of the scoring process is omitted.
(2) Scoring B1 (S238)
Sound corresponding to each pitch data based on each audio signal read from the memory areas B (1) to B (n) of the HDD 16 and from the pitch data of the +3 pitch part read from the HDD 16 A pitch difference is calculated, and a score is calculated based on the calculated pitch difference. Then, the scored data is stored in the memory area B (n + 1) of the HDD 16 together with the numerical value “n + 1” obtained by adding the numerical value “1” to the numerical value “n” read in S228 and the microphone number of the microphone 25b ( S238). This scoring result is referred to as scoring B1.

(3) Scoring C1 (S240)
Sound corresponding to each pitch data based on each audio signal read from the memory area C (1) to C (n) of the HDD 16 and from the pitch data of the +3 pitch part read from the HDD 16 A pitch difference is calculated, and a score is calculated based on the calculated pitch difference. Then, the scored data is stored in the memory area C (n + 1) of the HDD 16 together with the numerical value “n + 1” obtained by adding the numerical value “1” to the numerical value “n” read in S228 and the microphone number of the microphone 25c ( S240). This scoring result is referred to as scoring C1.

(4) Scoring A2 (S242)
A pitch difference corresponding to each pitch data based on each voice signal read from the memory areas A (1) to A (n) of the HDD 16 and the pitch data of the main melody part read from the HDD 16. Is scored based on the calculated pitch difference. Then, the scored data is stored in the memory area A (n + 2) of the HDD 16 together with the numerical value “n + 2” obtained by adding the numerical value “2” to the numerical value “n” read in S228 and the microphone number of the microphone 25a ( S242). This scoring result is referred to as scoring A2.

(5) Scoring B2 (S244)
A pitch difference corresponding to each pitch data based on each voice signal read from the memory areas B (1) to B (n) of the HDD 16 and the pitch data of the main melody part read from the HDD 16. Is scored based on the calculated pitch difference. The scored data is stored in the memory area B (n + 2) of the HDD 16 together with the numerical value “n + 2” obtained by adding the numerical value “2” to the numerical value “n” read in S228 and the microphone number of the microphone 25b ( S244). This scoring result is referred to as scoring B2.

(6) Scoring C2 (S246)
A pitch difference corresponding to each pitch data based on each voice signal read from the memory areas C (1) to C (n) of the HDD 16 and the pitch data of the main melody part read from the HDD 16. Is scored based on the calculated pitch difference. Then, the scored data is stored in the memory area C (n + 2) of the HDD 16 together with the numerical value “n + 2” obtained by adding the numerical value “2” to the numerical value “n” read in S228 and the microphone number of the microphone 25c ( S246). This scoring result is referred to as scoring C2.

(7) Scoring A3 (S248)
Corresponding to each pitch data based on each audio signal read from the memory areas A (1) to A (n) of the HDD 16 and from the pitch data of the -3 pitch part read from the HDD 16 respectively. A pitch difference is calculated, and a score is calculated based on the calculated pitch difference. Then, the scored data is stored in the memory area A (n + 3) of the HDD 16 together with the numerical value “n + 3” obtained by adding the numerical value “3” to the numerical value “n” read in S228 and the microphone number of the microphone 25a ( S248). This scoring result is referred to as scoring A3.

(8) Scoring B3 (S250)
Corresponding to each pitch data based on each audio signal read from the memory areas B (1) to B (n) of the HDD 16 and from the pitch data of the -3 pitch part read from the HDD 16 respectively. A pitch difference is calculated, and a score is calculated based on the calculated pitch difference. Then, the scored data is stored in the memory area B (n + 3) of the HDD 16 together with the numerical value “n + 3” obtained by adding the numerical value “3” to the numerical value “n” read in S228 and the microphone number of the microphone 25b ( S250). This scoring result is referred to as scoring B3.

(9) Scoring C3 (S252)
Corresponding to each pitch data based on each audio signal read from the memory areas C (1) to C (n) of the HDD 16 and from the pitch data of the -3 pitch part read from the HDD 16 respectively. A pitch difference is calculated, and a score is calculated based on the calculated pitch difference. Then, the scored data is stored in the memory area C (n + 3) of the HDD 16 together with the numerical value “n + 3” obtained by adding the numerical value “3” to the numerical value “n” read in S228 and the microphone number of the microphone 25c ( S252). This scoring result is referred to as scoring C3.

  Next, each comprehensive point process will be described. The total score process selects one of the scores A1, B1, and C1 of the +3 pitch part (eg, scoring A1), and excludes the memory area A (n + 1) corresponding to the score of the selected +3 pitch part. One is selected from the scoring of the main melody part corresponding to the region B (n + 1) and the memory region C (n + 1) (eg scoring B2), and the memory region A (corresponding to the scoring of the selected +3 pitch part and the main melody part ( n + 1), one of the -3 pitch part scores corresponding to the memory area C (n + 3) excluding the memory area B (n + 2) is selected (score C3), and the selected +3 pitch part score ( Score A1), the selected main melody part (score B2), and the selected -3 pitch part (score C3) are weighted and averaged.

(10) Overall point D1 (S254)
In the description of the overall score processing, as described in parentheses (for example,...), The score of +3 pitch part is selected as A1, the score of the main melody part is selected as B2, and the pitch of -3 pitch is selected. For part scoring, C3 is selected and weighted averaged. Then, the weighted average total score data is set to a numerical value “1” corresponding to the scoring result 1, scoring data of scoring A1, the microphone number of the microphone 25a, scoring data of scoring B2, the microphone number of the microphone 25b, and scoring The C3 scoring data and the microphone number of the microphone 25c are stored in the memory area D (1) of the HDD 16 (S254). This scoring result is referred to as a total score D1.

(11) Overall point D2 (S256)
A1 is selected for the scoring of the +3 pitch part, C2 is selected for the scoring of the main melody part, and B3 is selected for the scoring of the -3 pitch part. Then, the weighted average total score data is set to a numerical value “2” corresponding to the scoring result 2, scoring data of scoring A1, the microphone number of the microphone 25a, scoring data of scoring C2, the microphone number of the microphone 25c, and scoring The B3 scoring data and the microphone number of the microphone 25b are stored in the memory area D (2) of the HDD 16 (S256). This scoring result is referred to as a total score D2.

(12) Overall point D3 (S258)
B1 is selected for scoring the +3 pitch part, A2 is selected for scoring the main melody part, and C3 is selected for scoring the -3 pitch part. Then, the weighted average total score data is set to a numerical value “3” corresponding to the scoring result 3, scoring data of scoring B1, the microphone number of the microphone 25b, scoring data of scoring A2, the microphone number of the microphone 25a, and scoring The score data of C3 and the microphone number of the microphone 25c are stored in the memory area D (3) of the HDD 16 (S258). This scoring result is referred to as a total score D3.

(13) Overall point D4 (S260)
B1 is selected for scoring the +3 pitch part, C2 is selected for scoring the main melody part, and A3 is selected for scoring the -3 pitch part. Then, the weighted average total score data is set to a numerical value “4” corresponding to the scoring result 4, scoring data of scoring B1, the microphone number of the microphone 25b, scoring data of scoring C2, the microphone number of the microphone 25c, and scoring The score data of A3 and the microphone number of the microphone 25a are stored in the memory area D (4) of the HDD 16 (S260). This scoring result is referred to as a total score D4.

(14) Overall point D5 (S262)
C1 is selected for scoring the +3 pitch part, A2 is selected for scoring the main melody part, and B3 is selected for scoring the -3 pitch part. Then, the weighted average total score data is set to a numerical value “5” corresponding to the scoring result 5, scoring data of scoring C1, the microphone number of the microphone 25c, scoring data of scoring A2, the microphone number of the microphone 25a, and scoring The score data of B3 and the microphone number of the microphone 25b are stored in the memory area D (5) of the HDD 16 (S262). This scoring result is referred to as a total score D5.

(15) Overall point D6 (S264)
C1 is selected for scoring the +3 pitch part, B2 is selected for scoring the main melody part, and A3 is selected for scoring the -3 pitch part. Then, the weighted average total score data is set to a numerical value “6” corresponding to the scoring result 6, scoring data of scoring C1, the microphone number of the microphone 25c, scoring data of scoring B2, the microphone number of the microphone 25b, and scoring The score data of A3 and the microphone number of the microphone 25a are stored in the memory area D (6) of the HDD 16 (S264). This scoring result is referred to as a total score D6.
Next, the scoring process for the highest overall score will be described. In the scoring process of the highest overall score, the scores of the scoring results obtained by the respective overall score processes are compared, and the overall score having the highest score is determined (S266). Then, the determined overall score having the highest score is set as the highest overall score, and the total score data is set to the numerical value “7” corresponding to the scoring result 7, +3 pitch part scoring data, the microphone number, and the main melody part. Are stored in the memory area D (7) of the HDD 16 together with the scoring data and the microphone number thereof, and the scoring data of the -3 pitch part and the microphone number (S268). This scoring result is referred to as a total score D7.

Next, after executing the above scoring process (S210 to S268), an end signal of the hammering scoring process (1) is transmitted to the control unit 12 (S270).
When the end signal of the hammering scoring process (1) in S270 is transmitted to the control unit 12, the present “hamoling scoring process (1)” is finished.

[Explanation of Hamori Scoring Processing (2)]
Next, the procedure of “hamo scoring process (2)” executed by the voice control unit 24 of the karaoke apparatus 1 will be described based on the flowcharts of FIGS. 11 and 12. In this description, it is assumed that the number of voice input switches in which the voice signal counted in S170 of FIG. 8 is in the input state is three.

  First, the voice control unit 24 determines whether or not the start signal for the hammer scoring process (2) transmitted from the control unit 12 has been received (S310). When the start signal for the hammer scoring process (2) is received (S310: YES), the formula “n = 1” is stored in a memory (not shown) of the voice control unit 24 (S312). Next, it is determined whether or not the digitized period has elapsed (S314). Here, the digitized period is 20.83 microseconds when the sampling frequency is 48 KHz, for example, as described in the above item [Description of the configuration of the karaoke apparatus 1]. Further, the measurement of the digitized period is performed by a timer (not shown) that measures the time of the voice control unit 24.

  When the digitization period elapses (S314: YES), the singing voice is input through the microphone 25a, output to the A / D converter 26a, and the voice signal digitized by the A / D converter 26a is expressed by the formula “n”. = 1 ”and the microphone number of the microphone 25a are stored in the memory area A (1) of the HDD 16 illustrated in FIGS. 6A and 6B (S316).

  In addition, the singing voice is input through the microphone 25b, the voice signal output to the A / D converter 26b and digitized by the A / D converter 26b is converted into the numerical value “1” of the formula “n = 1” and the microphone of the microphone 25b. The number is stored in the memory area B (1) of the HDD 16 illustrated in FIGS. 6A and 6B together with the number (S318).

  Further, the singing voice is input by the microphone 25c, the voice signal output to the A / D converter 26c and digitized by the A / D converter 26c is converted into the numerical value “1” of the formula “n = 1” and the microphone of the microphone 25c. The number is stored in the memory area C (1) of the HDD 16 illustrated in FIGS. 6A and 6B together with the number (S320).

Then, the numerical value “1” is added to the mathematical formula “n = 1” stored in the memory (not shown) included in the voice control unit 24 to obtain the mathematical formula “n = 2”, and the memory (not shown) included in the voice control unit 24 The mathematical expression “n = 2” is stored (S322).
Next, when the karaoke performance ends, the control unit 12 transmits a karaoke performance end signal to the voice control unit 24, and the voice control unit 24 receives the karaoke performance end signal transmitted from the control unit 12. Whether or not (S324). When the karaoke performance end signal is not received (S324: NO), the process returns to S314 and the above-described processing is performed. On the other hand, when the karaoke performance end signal is received (S324: YES), the numerical value “n” stored in the memory (not shown) of the voice control unit 24 is the memory of the HDD 16 illustrated in FIG. 6C. It memorize | stores in the area | region E (S326).

  Subsequently, the voice control unit 24 reads the numerical value “n” stored in the memory area E of the HDD 16 illustrated in FIG. 6C (S328). Then, the audio signals stored in the memory areas A (1) to A (n) of the HDD 16 illustrated in FIGS. 6A and 6B are read (S330). Further, the audio signal stored in the memory areas B (1) to B (n) of the HDD 16 is read (S332). Further, the audio signal stored in the memory areas C (1) to C (n) of the HDD 16 is read (S334). Then, each song is scored based on the read audio signal. Next, each scoring process (S336 to S352) will be described.

(1) Scoring A1 (S336)
+3 sounds generated based on each pitch data based on each audio signal read from the memory areas A (1) to A (n) of the HDD 16 and the pitch data of the main melody part read from the HDD 16 The pitch difference corresponding to each is calculated from the pitch data of the high part, and scoring is performed based on the calculated pitch difference. Then, the scored data is stored in the memory area A (n + 1) of the HDD 16 together with the numerical value “n + 1” obtained by adding the numerical value “1” to the numerical value “n” read out in S328 and the microphone number of the microphone 25a ( S336). This scoring result is referred to as scoring A1. This process will be described in detail as follows.

  First, each pitch data corresponding to each voice signal is extracted from each voice signal read from the memory areas A (1) to A (n) of the HDD 16 by FFT calculation. Further, the music data of the karaoke performance music stored in the HDD 16 is read out, the pitch data of the main melody part is read out from the music data, and the pitch data of the +3 pitch part is generated. And the pitch difference corresponding to each is calculated from the pitch data of the generated +3 pitch part and each pitch data based on the singing voice. Subsequently, +3 pitch parts are scored from the scoring information corresponding to the pitch difference data illustrated in FIG. 14 stored in the HDD 16 described above based on the calculated pitch differences. Then, the scored data is stored in the memory area A (n + 1) of the HDD 16 together with the numerical value “n + 1” obtained by adding the numerical value “1” to the numerical value “n” read out in S328 and the microphone number of the microphone 25a ( S236). In the following description of each scoring process, a detailed description of the scoring process is omitted.

(2) Scoring B1 (S338)
+3 sounds generated based on each pitch data based on each audio signal read from the memory areas B (1) to B (n) of the HDD 16 and the pitch data of the main melody part read from the HDD 16 The pitch difference corresponding to each is calculated from the pitch data of the high part, and scoring is performed based on the calculated pitch difference. Then, the scored score data is stored in the memory area B (n + 1) of the HDD 16 together with the numerical value “n + 1” obtained by adding the numerical value “1” to the numerical value “n” read in S328 and the microphone number of the microphone 25b ( S338). This scoring result is referred to as scoring B1.

(3) Scoring C1 (S340)
+3 sound generated based on each pitch data based on each sound signal read from the memory area C (1) to C (n) of the HDD 16 and the pitch data of the main melody part read from the HDD 16 The pitch difference corresponding to each is calculated from the pitch data of the high part, and scoring is performed based on the calculated pitch difference. Then, the scored data is stored in the memory area C (n + 1) of the HDD 16 together with the numerical value “n + 1” obtained by adding the numerical value “1” to the numerical value “n” read out in S328 and the microphone number of the microphone 25c ( S340). This scoring result is referred to as scoring C1.

(4) Scoring A2 (S342)
A pitch difference corresponding to each pitch data based on each voice signal read from the memory areas A (1) to A (n) of the HDD 16 and the pitch data of the main melody part read from the HDD 16. Is scored based on the calculated pitch difference. Then, the scored data is stored in the memory area A (n + 2) of the HDD 16 together with the numerical value “n + 2” obtained by adding the numerical value “2” to the numerical value “n” read in S328 and the microphone number of the microphone 25a ( S342). This scoring result is referred to as scoring A2.

(5) Scoring B2 (S344)
A pitch difference corresponding to each pitch data based on each voice signal read from the memory areas B (1) to B (n) of the HDD 16 and the pitch data of the main melody part read from the HDD 16. Is scored based on the calculated pitch difference. Then, the scored data is stored in the memory area B (n + 2) of the HDD 16 together with the numerical value “n + 2” obtained by adding the numerical value “2” to the numerical value “n” read in S328 and the microphone number of the microphone 25b ( S344). This scoring result is referred to as scoring B2.

(6) Scoring C2 (S346)
A pitch difference corresponding to each pitch data based on each voice signal read from the memory areas C (1) to C (n) of the HDD 16 and the pitch data of the main melody part read from the HDD 16. Is scored based on the calculated pitch difference. Then, the scored data is stored in the memory area C (n + 2) of the HDD 16 together with the numerical value “n + 2” obtained by adding the numerical value “2” to the numerical value “n” read out in S328 and the microphone number of the microphone 25c ( S346). This scoring result is referred to as scoring C2.

(7) Scoring A3 (S348)
-3 generated based on each pitch data based on each audio signal read from the memory areas A (1) to A (n) of the HDD 16 and the pitch data of the main melody part read from the HDD 16 The pitch difference corresponding to each is calculated from the pitch data of the pitch part, and scoring is performed based on the calculated pitch difference. Then, the scored data is stored in the memory area A (n + 3) of the HDD 16 together with the numerical value “n + 3” obtained by adding the numerical value “3” to the numerical value “n” read in S328 and the microphone number of the microphone 25a ( S348). This scoring result is referred to as scoring A3.

(8) Scoring B3 (S350)
-3 generated based on each pitch data based on each audio signal read from the memory areas B (1) to B (n) of the HDD 16 and the pitch data of the main melody part read from the HDD 16 The pitch difference corresponding to each is calculated from the pitch data of the pitch part, and scoring is performed based on the calculated pitch difference. Then, the scored score data is stored in the memory area B (n + 3) of the HDD 16 together with the numerical value “n + 3” obtained by adding the numerical value “3” to the numerical value “n” read in S328 and the microphone number of the microphone 25b ( S350). This scoring result is referred to as scoring B3.

(9) Scoring C3 (S352)
-3 generated based on each pitch data based on each audio signal read from the memory areas C (1) to C (n) of the HDD 16 and the pitch data of the main melody part read from the HDD 16 The pitch difference corresponding to each is calculated from the pitch data of the pitch part, and scoring is performed based on the calculated pitch difference. The scored data is stored in the memory area C (n + 3) of the HDD 16 together with the numerical value “n + 3” obtained by adding the numerical value “3” to the numerical value “n” read out in S328 and the microphone number of the microphone 25c ( S352). This scoring result is referred to as scoring C3.

Next, each comprehensive point process will be described. The overall score process is performed according to the procedure described in the above item [Horimori scoring process (1)], and thus the description thereof is omitted.
Note that S254 to S264 of the above-mentioned item [Horimori scoring process (1)] correspond to S354 to S364 of the item [Harmor scoring process (2)].

  Next, the scoring process for the highest overall score will be described. In the scoring process of the highest comprehensive score, the scores of the scoring results obtained by the respective comprehensive score processes are compared, and the comprehensive score having the highest score is determined (S366). Then, the determined overall score having the highest score is set as the highest overall score, and the total score data is set to the numerical value “7” corresponding to the scoring result 7, +3 pitch part scoring data, the microphone number, and the main melody part. Are stored in the memory area D (7) of the HDD 16 together with the scoring data and the microphone number, the scoring data of the -3 pitch part and the microphone number (S368). This scoring result is referred to as a total score D7.

Next, after executing the above scoring process (S310 to S368), an end signal of the hammer scoring process (2) is transmitted to the control unit 12 (S370).
When the end signal of the hammering scoring process (2) of S370 is transmitted to the control unit 12, the present "harmory scoring process (2)" is finished.

[Horimori scoring process and total score display switching process]
Below, the procedure of the "harmory scoring process and the total score display switching process" executed by the control unit 12 of the karaoke apparatus 1 will be described based on the flowchart of FIG.

  First, the control unit 12 determines whether or not an end signal of the hammer scoring process (1) transmitted by the voice control unit 24 has been received (S410). When the end signal of the main hammer scoring process (1) transmitted by the voice control unit 24 is not received (S410: NO), the control unit 12 receives the end signal of the hammer scoring process (2) transmitted by the voice control unit 24. It is determined whether or not it has been received (S412). Then, when the end signal of the main humor scoring process (1) transmitted by the voice control unit 24 is received (S410: YES), or when the end signal of the main humor scoring process (2) transmitted by the voice control unit 24 is received (S412: YES), the total point data stored in the memory area D (7) of the HDD 16 is read, and the total point D7 is controlled to be displayed on the display unit 36 (S414).

  Then, the +3 pitch part scoring data, the main melody part scoring data, and the −3 pitch part scoring data stored in the memory area D (7) of the HDD 16 are read, and the +3 pitch part corresponding to the total score D7 is read out. The scoring results of the main melody part and the -3 pitch part are controlled to be displayed on the display unit 36 (S416).

  Further, the microphone number of the microphone corresponding to the scoring data of the +3 pitch part stored in the memory area D (7) of the HDD 16, the microphone number of the microphone corresponding to the scoring data of the main melody part, and the -3 pitch part The microphone number of the microphone corresponding to the scoring data is read, and control is performed so that the microphone number of the microphone corresponding to each scoring result is displayed on the display unit 36 (S418).

  For example, as shown in FIG. 15A, the total score data, the +3 pitch part scoring data and the microphone number, the main melody part scoring data and the microphone number, the -3 pitch part scoring data and the microphone number The number is displayed on the display unit 36. In this example, the overall scoring result “70”, the +3 pitch part scoring result “65” and the microphone number “A”, the main melodic part scoring result “90” and the microphone number “C”, and the −3 pitch The part scoring result “55” and the microphone number “B” are displayed. The total score “70” is obtained from the weighted average of the +3 pitch part, the main melody part, and the −3 pitch part.

  Next, as shown in FIG. 15C, for example, data indicating “overall point display switching” received by the “overall point display changeover switch” provided in the key input means included in the operation unit 18 is the operation processing unit. 22, the control unit 12 determines whether or not data instructing “total point display switching” has been received (S <b> 420).

  When the data for instructing “total point display switching” transmitted from the operation processing unit 22 is received (S420: YES), the mathematical expression “x = 1” is written in the memory (not shown) of the control unit 12. (S422). Subsequently, the total point data stored in the memory area D (1) of the HDD 16 is read, and the total point D1 corresponding to the total point Dx is controlled to be displayed on the display unit 36 (S424). Then, the +3 pitch part scoring data, the main melody part scoring data, and the −3 pitch part scoring data stored in the memory area D (1) of the HDD 16 are read, and the +3 pitch part corresponding to the total score D1 is read. The scoring results of the main melody part and the -3 pitch part are controlled to be displayed on the display unit 36 (S416).

  In addition, the microphone number corresponding to the scoring data of the +3 pitch part stored in the memory area D (1) of the HDD 16, the microphone number corresponding to the scoring data of the main melody part, and the scoring data of the −3 pitch part The number of the microphone corresponding to is read, and control is performed so that the numbers of the microphones 25a to 25c corresponding to the respective scoring results are displayed on the display unit 36 (S418).

  For example, as shown in FIG. 15B, the total score data, the +3 pitch part scoring data and the microphone number, the main melody part scoring data and the microphone number, the -3 pitch part scoring data and the microphone number The number is displayed on the display unit 36. In this example, the overall scoring result “50”, the +3 pitch part scoring result “65” and the microphone number “A”, the main melodic part scoring result “45”, the microphone number “B”, and the −3 pitch The part scoring result “40” and the microphone number “C” are displayed. The total score “50” is obtained from the weighted average of the +3 pitch part, the main melody part, and the −3 pitch part.

  Then, the numerical value “1” is added to the mathematical formula “x = 1” stored in the memory (not shown) of the control unit 12 to obtain the mathematical formula “x = 2”, and the mathematical formula is transferred to the memory (not shown) of the control unit 12. “X = 2” is stored (S430). Further, the control unit 12 waits for one second to elapse by a timer (not shown) that measures the time (S432). When one second has elapsed, it is determined whether or not the numerical value “x” exceeds the numerical value “7” (S434). If the numerical value “x” does not exceed the numerical value “7” (S434: NO), the process returns to S424 and the above-described processing is performed. On the other hand, when the numerical value “x” exceeds the numerical value “7” (S434: YES), this “harm scoring process” ends.

[Description of effects]
(1) In the conventional multi-singer singing system, when the number of microphones is three or more and the number of humor parts is two or more, it is generated from the voice signal of the singer input from the microphone. As a result of comparing the singing data and the scoring reference data of the hamori part in the karaoke data by making a mistake and associating and scoring the main melody part and scoring the hamori part based on the comparison result, the total score of the scoring results Could get worse.

  On the other hand, according to the karaoke apparatus 1 of the present embodiment, the voice control unit 24 uses the pitch data of each voice signal extracted from each voice signal of the karaoke song corresponding to the microphones 25a to 25c, and the music data. The pitch difference between the read pitch data of the main melody part, the pitch data of the +3 pitch part, and the pitch data of the -3 pitch part is calculated, and based on the calculated pitch difference Score each. Then, from the scoring results of the main melody part, +3 pitch part, and -3 pitch part, the voice control unit 24 changes one scoring data for each part, and the voice signals corresponding to each scoring result are all different. The total score is scored based on the highest score among the total scores of all combinations of the selected scoring results.

  Therefore, when there are two or more singers regarding the singing score in the karaoke apparatus 1, the singing part of the singer is automatically recognized in order to make the singer or the listener happy as entertainment, and the karaoke field is specific. A scoring result with a high score can be obtained.

  (2) Further, according to the karaoke apparatus 1 of the present embodiment, when the data for instructing “total point display switching” received by the operation unit 18 is transmitted to the control unit 12 by the operation processing unit 22, the control unit 12. Are controlled to display the total points in all the combinations on the display unit 36. Therefore, for example, if the part of the scoring data on which the singer himself sang is different from the part of the scoring data on which the singer himself sang, the total score obtained by combining the scoring data for the part the singer himself intends to sing Can be displayed.

[Other embodiments]
As mentioned above, although embodiment of this invention was described, this invention is not limited to the said embodiment, It is possible to implement in the following various aspects.

  (1) In the above embodiment, the music data is MIDI data, but the present invention is not limited to this. Music data is roughly divided into MIDI data and data other than MIDI data. Data other than MIDI data includes PCM music data generally called PCM or live sound as illustrated in FIG. In the case of such a PCM music data, the score data other than the PCM data is assigned in advance, so that even the PCM music data can be scored.

  (2) In the above embodiment, when determining the main melody part and one or more hammer sections, the music section for calculating each pitch difference is the whole music section, but this is not limitative. Absent. If a flag for starting recording and a flag for ending recording are incorporated in advance in the music data, the pitch is not the entire music but the duration of the section shorter than the entire music specified by the flag group in one music. The difference may be calculated.

  Specifically, for example, only the first section (one chorus section) in the music composed of lyrics up to the third is used. In order to specify one chorus section, a part of the configuration shown below that implements one chorus function (for example, one chorus cut of Joy Sound JS70 (trademark)), which is a technique of a conventional karaoke apparatus, is used.

  The 1 chorus function is a function for playing only one chorus section from the beginning of a song when performing karaoke singing, and a flag for identifying one chorus section is incorporated in MIDI data in advance. The voice control unit 24 performs a karaoke performance for one chorus section by extracting the flag from the MIDI data.

  Accordingly, since it is not necessary to repeat the same melody for music No. 1, No. 2, No. 3, etc., the capacity of the HDD (16) for recording the audio signal of the main melody part and one or more hammer parts can be saved, and each sound can be saved. The calculation time for the height difference is also shortened.

  (3) In the above embodiment, the hammer part is three degrees above and below the main melody part, but this is not restrictive. As illustrated in FIG. 3, it may be up and down by 5 degrees, and various hammer parts may be arbitrarily set.

  (4) In the above embodiment, there are three microphones, but this is not a limitation. For example, five microphones may be used. And when there are five types of singing parts combined with the main melody part and the hamori part, there are 120 types of all combinations of scoring, and there are also 120 total points. In addition, scoring data of five types of pitch parts is given to each total point, but the same procedure as in the above embodiment can be performed only by increasing the type, calculation time, and memory capacity.

  (5) In the above embodiment, the voice input switches 27a to 27c detect whether the respective voice signals digitized by the A / D converters 26a to 26c are in the input state or the disconnected state, but the present invention is not limited to this. Whether the audio control unit 24 can input audio signals from the A / D converters 26a to 26c individually based on the signal levels of the respective digitized audio signals output from the A / D converters 26a to 26c. A method of judging may be used.

  (6) In the above embodiment, comprehensive scoring is carried out by weighted averaging of the scoring of the main melody part and one or more hammer parts, but this is not restrictive. For example, a high weight can be set for the scoring of the main melody part, and conversely, a high weight can be set for the scoring of the hammer part. Further, the hamori part may be obtained as a weighted average of one or more hamori parts, and the scoring of the main melodic part may be set with a one-to-one weighting.

  (7) In the above embodiment, the pitch is used as a scoring standard, but the scoring standard is not limited to the pitch alone. For example, a plurality of factors such as volume, rhythm, and singing rate may be added to the pitch and used as a scoring standard.

(8) In the above embodiment, scoring of the main melody part and one or more hammer parts is used, but this is not restrictive. Of course, it can also be applied to duet songs.
(9) In the above embodiment, the reception of the song selection number of the karaoke performance music and the “hamo scoring” is received via the operation unit 18 of the karaoke apparatus 1, but from the operation unit (not shown) of the remote control terminal 2. It may be accepted.

  (10) In the above embodiment, the operation unit 18 accepts the “total point display switching” via the operation unit 18 of the karaoke apparatus 1, but the operation unit (not shown) of the remote control terminal 2. You may accept from.

1 is a block diagram illustrating a configuration of a karaoke apparatus 1. FIG. (A) is explanatory drawing which shows the memory area provided in HDD16, (b) is explanatory drawing which shows the structure of a music database. It is explanatory drawing which shows the combination with respect to the hammer part and main melody part to score. It is explanatory drawing which shows the pitch data of a singer and music data about a main melody part and a hamori part. It is explanatory drawing which shows the combination with respect to the number of parts of a hamori part, and the type information of a hamori part. (A) is explanatory drawing which shows the memory area of an audio | voice signal and scoring data, (b) is explanatory drawing which shows the data structure of an audio | voice signal and scoring data, (c) is the memory area and data structure of the memory E It is explanatory drawing which shows. (A) is explanatory drawing which shows the memory area | region of total point data, (b) is explanatory drawing which shows the data structure of total point data. It is a flowchart which shows the procedure of the "judgment scoring process execution judgment process" which the control part 12 performs. It is a flowchart which shows the procedure of the first half of the "harm scoring process (1)" which the audio | voice control part 24 performs. It is a flowchart which shows the procedure of the second half of the "harm scoring process (1)" which the audio | voice control part 24 performs. It is a flowchart which shows the procedure of the first half of the "harm scoring process (2)" which the audio | voice control part 24 performs. It is a flowchart which shows the procedure of the second half of the "harm scoring process (2)" which the audio | voice control part 24 performs. It is a flowchart which shows the procedure of the "harmory scoring process and total score display switching process" which the control part 12 performs. It is explanatory drawing which shows the scoring information according to the data of pitch difference. (A) is explanatory drawing which shows the example which displayed the highest comprehensive scoring result on the display part 36, (b) is the example which displayed the scoring result of the comprehensive score by comprehensive point display switching on the display part 36 FIG. 4C is an explanatory diagram illustrating a total point display changeover switch provided in a key input unit included in the operation unit 18. It is explanatory drawing which shows the music data structure other than MIDI data. It is explanatory drawing which shows the outline | summary of a hammer scoring process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Karaoke apparatus, 2 ... Remote control terminal, 12 ... Control part, 14 ... Interface part, 16 ... Hard disk (HDD), 18 ... Operation part, 20 ... Infrared communication part, 22 ... Operation processing part, 24 ... Voice control part, 25a, 25b, 25c ... microphone, 26a, 26b, 26c ... A / D converter, 27a, 27b, 27c ... audio input switch, 28 ... speaker, 30 ... MIDI sound source, 32 ... video RAM, 34 ... video playback unit, 36 ... Display unit, 38 ... Video control unit, 39 ... Bus, 40 ... USB, 50 ... Music database memory area, 52 ... Audio signal / scoring data memory area (memory A, memory B, memory C), 54 ... Total score data Memory area (memory D), 56... Periodic memory area (memory E), 58 scoring information memory area, 60... Rock, 62 ... set numbers for each of the scoring Buroku of each part, comprehensive point blocks for every 64 ... set number, 66 ... total score block of the highest score, 68 ... highest overall score block, 100 ... network.

Claims (6)

Music data storage means for storing music data including data for karaoke performance and pitch data of singing melody of karaoke music;
A plurality of voice signal input means for inputting voice signals of karaoke singing;
Audio signal storage means for storing each audio signal input by the plurality of audio signal input means;
Voice signal storage / reading control means for executing storage / reading control of each voice signal to the voice signal storage means;
Pitch extraction means for extracting pitch data of karaoke singing from each voice signal;
A plurality of audio signal input detecting means provided corresponding to each of the plurality of audio signal input means and detecting whether or not each audio signal input from the plurality of audio signal input means is possible;
Hamori type correspondence storage means for storing the correspondence between the number of parts of the Hamori part and the type information of the Hamori part;
Scoring means for scoring based on the pitch data of the singing melody of the karaoke song read from the music data storage means and the pitch data of the karaoke song extracted by the pitch extracting means;
With
The scoring means determines whether or not to execute the hamori scoring process when the music data includes the pitch data of the main melody part and one or more hamori parts, and determines to execute the hamori scoring process. In such a case, the karaoke apparatus is characterized by executing the following hammer scoring process.
(1) The plurality of audio signal input means capable of inputting an audio signal are detected via the plurality of audio signal input detection means, and the part of the hammer part is based on the detected number of the plurality of audio signal input means. The number is determined, and the type information of the hamori part corresponding to the determined number of hame parts is read from the hame type correspondence storage unit.
(2) Each audio signal stored in the audio signal storage means is read by the audio signal storage / reading control means, and pitch data is extracted from each audio signal by the pitch extraction means.
Then, the pitch data of the hamori part corresponding to the type information of the main melody part and the hamori part is read from the music data storage means, and the pitch data of each audio signal and the type information of the main melody part and the hamori part are supported. The pitch difference between the humor part and the humor part corresponding to the melody part type information and the scoring data of the main melody part based on each pitch difference is calculated. And scoring data.
(3) From the generated scoring data of the main melodic part and the scoring data of the spider part corresponding to the generated spider part type information, one scoring data for each part is converted into each scoring data. The corresponding audio signals are all selected to be different, and total score data is generated based on the score data in all combinations of the selected score data.
(4) From the generated scoring data of the main melodic part and the scoring data of the spider part corresponding to the generated spider part type information, one scoring data for each part is converted into each scoring data. The corresponding audio signals are all selected to be different, the total score data in all combinations of the selected scoring data are compared, and the total score is scored based on the highest score as a result of the comparison. Music data storage means for storing music data including data for karaoke performance and pitch data of singing melody of karaoke music;
A plurality of voice signal input means for inputting voice signals of karaoke singing;
Audio signal storage means for storing each audio signal input by the plurality of audio signal input means;
Voice signal storage / reading control means for executing storage / reading control of each voice signal to the voice signal storage means;
Pitch extraction means for extracting pitch data of karaoke singing from each voice signal;
A plurality of audio signal input detecting means provided corresponding to each of the plurality of audio signal input means and detecting whether or not each audio signal input from the plurality of audio signal input means is possible;
Hamori type correspondence storage means for storing the correspondence between the number of parts of the Hamori part and the type information of the Hamori part;
Scoring means for scoring based on the pitch data of the singing melody of the karaoke song read from the music data storage means and the pitch data of the karaoke song extracted by the pitch extracting means;
With
The scoring means determines whether or not to execute a hamori scoring process when the music data includes the pitch data of the main melody part and does not include the pitch data of the hamori part. A karaoke apparatus characterized in that, when it is determined that a scoring process is to be executed, the following hammer scoring process is executed.
(1) The plurality of audio signal input means capable of inputting an audio signal are detected via the plurality of audio signal input detection means, and the part of the hammer part is based on the detected number of the plurality of audio signal input means. The number is determined, and the type information of the hamori part corresponding to the determined number of hame parts is read from the hame type correspondence storage unit.
(2) Each audio signal stored in the audio signal storage means is read by the audio signal storage / reading control means, and pitch data is extracted from each audio signal by the pitch extraction means.
And while reading the pitch data of the main melody part from the music data storage means, generating pitch data corresponding to the type information of the hamori part from the pitch data of the main melody part, The pitch difference between the main melody part and the pitch data of the hamori part corresponding to the generated type information of the hamori part is calculated for each audio signal, and the main melody part is calculated based on the pitch difference. The scoring data and the scoring data of the hammer part corresponding to the kind information of the hammer part are generated.
(3) From the generated scoring data of the main melodic part and the scoring data of the spider part corresponding to the generated spider part type information, one scoring data for each part is converted into each scoring data. The corresponding audio signals are all selected to be different, and total score data is generated based on the score data in all combinations of the selected score data.
(4) From the generated scoring data of the main melodic part and the scoring data of the spider part corresponding to the generated spider part type information, one scoring data for each part is converted into each scoring data. The corresponding audio signals are all selected to be different, the total score data in all combinations of the selected scoring data are compared, and the total score is scored based on the highest score as a result of the comparison. In the karaoke apparatus according to claim 1 or 2,
Display means for displaying the scoring results;
Display switching accepting means for accepting an instruction to switch the display of the scoring results displayed by the display means;
With
The scoring means causes the display means to display a total score based on the highest score, which is a result of comparing the total score data in all combinations of the scoring data, as the scoring result, and scoring via the display switching accepting means It is determined whether or not to switch the display of the scoring results displayed by the display means depending on whether or not the instruction to switch the display of the results is accepted, and to switch the display of the scoring results. In some cases, the karaoke apparatus displays one of the total score data in all combinations of the scoring data on the display means as the scoring result . In the karaoke apparatus in any one of Claims 1-3,
Correspondence relationship storage means for storing the correspondence relationship between the song selection number corresponding to the karaoke song and the harmony scoring information indicating whether or not to score the harmony part;
A music selection number receiving means for receiving the music selection number;
Have
Whether the scoring means reads out the hamori scoring information corresponding to the music selection number received via the music selection number accepting means from the correspondence storage means, and executes the scoring process of the hamori part based on the hamori scoring information A karaoke apparatus characterized by determining whether or not. In the karaoke apparatus in any one of Claims 2-4,
Having a hamori scoring acceptance means for accepting an instruction to score the hamori part;
2. The karaoke apparatus according to claim 1, wherein the scoring means determines whether or not to execute the scoring process for the hamori part based on whether or not an instruction for scoring the hamori part is accepted through the hamori scoring accepting means.   The program for functioning a computer as said scoring means in the karaoke apparatus in any one of Claims 1-5.

Images