JP2008225114A - Karaoke device, singing evaluation method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a karaoke device, a singing evaluation method, and a program capable of detecting and evaluating wandering singing and long tone singing. <P>SOLUTION: When a pitch of singer's voice is detected for longer than a predetermined period in a detection area which is a predetermined pitch region corresponding to the pitch of a guide melody, the karaoke device can be accumulated its periods. When the wandering singing is evaluated, as the accumulated periods Ttotal or its rate Ttotal/Tall gets larger, a period of time in which become steady at a pitch shifted from a correct pitch is prolonged, and the singer is in a state of the wandering singing. On the other hand, when the long tone singing is evaluated, the singer can performs long tone singing, since the singer sings the tone to be prolonged in a stable pitch. Thereby, influences of the wandering singing and the long tone singing can be added to a score result. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a technique for evaluating pitch stability in a karaoke apparatus for scoring a song.

Some karaoke apparatuses have a scoring function for displaying the skill of a singer's singing in points. Of these scoring functions, actual singing skill and scoring results correspond as much as possible, and data such as pitch data and volume data extracted from the singer's singing voice signal and karaoke song melody ( Some have a comparison function between the guide melody) and the corresponding data (for example, Patent Document 1).
Japanese Patent Laid-Open No. 10-69216

  The karaoke apparatus provided with such a scoring function makes it possible to compare and score changes in pitches for each note, and this scoring function is in the MIDI (Musical Instrument Digital Interface) format. Since it was compared with the singer's singing based on the guide melody that was converted into data, the scoring was based on the notes on the score. Therefore, when such a scoring is performed, the scoring result may differ from the actual skillful impression. For example, when the singing pitch (hereinafter referred to as the pitch) reaches a predetermined pitch and there is time to stabilize at a pitch that deviates from the original pitch, the singer does not know the original pitch and the pitch You will feel unskilled because you get the impression that it is a singing song (hereinafter referred to as a singing song), but if the time matches the original pitch is the same, Regardless of the case, the same scoring result may be obtained. Also, a singer who can sing by extending the sound that should be extended for a long time with a stable pitch (hereinafter referred to as long-tone singing) will sound skillfully, but even if such a singing can be performed, the grading result is not necessarily Did not improve.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a karaoke apparatus, a singing evaluation method, and a program for detecting and evaluating a lost song and a long tone song.

  In order to solve the above-mentioned problems, the present invention corresponds to the progress of music, storage means for storing pitch range data defining one or more pitch ranges indicating a predetermined pitch range, and the progress of the music A voice input means for generating singer voice data based on the singer's singing input, and extracting the pitch of the singer's singing corresponding to the progress of the song based on the singer voice data A pitch extracting unit that detects that the pitch extracted by the pitch extracting unit is included in a pitch range defined by the pitch range data in correspondence with the progress of the music, and the detecting unit detects the music Identification information indicating that the time continuously detected with respect to the progress of the time and when the measured time is equal to or longer than the predetermined time indicates that the measured time is equal to or longer than the predetermined time Providing a karaoke apparatus characterized by comprising an output measuring means.

  Further, the present invention provides a storage means for storing pitch range data defining one or more pitch ranges indicating a predetermined pitch range corresponding to the progress of the music, and a song input corresponding to the progress of the music Voice input means for generating singer voice data based on the singer's singing, and pitch extraction means for extracting the pitch of the singer's singing corresponding to the progress of the music, based on the singer voice data; Detecting means for detecting that the pitch extracted by the pitch extracting means is included in the pitch range defined by the pitch range data in correspondence with the progress of the music; and the detecting means is continuous with respect to the progress of the music. When the measured time is equal to or longer than a predetermined time, a measuring means for outputting time information indicating the measured time and a time information from the measuring means. Is output, and an evaluation unit that evaluates the singing of the singer based on the time accumulated by the accumulation unit. A karaoke apparatus is provided.

  In another preferred embodiment, an accumulation unit that measures the number of times identification information is output from the measurement unit, and an evaluation that evaluates the song of the singer based on the number of times that the accumulation unit measures. And a means.

  In another preferable aspect, the pitch range data defines a plurality of pitch ranges, and the detecting means includes the pitch extracted by the pitch extracting means in each pitch range defined by the pitch range data. Is detected for each pitch range corresponding to the progress of the music, and the measuring means measures the time continuously detected by the detection means for the progress of the music for each pitch range, When the measured time is equal to or longer than the predetermined time, time information indicating the measured time and a pitch range corresponding to the measured time is output, and the accumulating means receives time information from the measuring means. Each time it is output, the time indicated by the output time information is accumulated for each pitch range, and the evaluation means accumulates the time for each pitch range accumulated by the accumulation means. Based on, it may be evaluated for singing of the singing person.

  In another preferred embodiment, the pitch range data defines a plurality of pitch ranges, and the detecting means includes the pitch extracted by the pitch extracting means in each pitch range defined by the pitch range data. Is detected for each pitch range corresponding to the progress of the music, and the measuring means measures the time continuously detected by the detection means for the progress of the music for each pitch range, When the measured time is equal to or longer than a predetermined time, identification information indicating that the measured time is equal to or longer than the predetermined time and a pitch range corresponding to the measured time is output, The number of times identification information is output from the measuring means is measured for each pitch range, and the evaluating means is based on the number of times the accumulating means measures each pitch range. It may be evaluated for the singing of the singer.

  In another preferred embodiment, the storage means further stores guide melody data indicating a melody to be sung by a singer in accordance with the progress of the music, and each sound constituting the melody indicated by the guide melody data is stored. Pitch calculation means for calculating the pitch is further provided, and the pitch range data indicates the pitch range relative to the pitch of each sound constituting the melody calculated by the pitch calculation means, It may be data that prescribes.

  In another preferred embodiment, the pitch range data stored in the storage means may be data in which a pitch range is defined based on the pitch of each sound constituting the melody indicated by the guide melody data. .

  In another preferable aspect, the information processing apparatus may further include a determining unit that determines the predetermined time corresponding to the progress of the music based on the length of each sound constituting the melody indicated by the guide melody data. .

  In another preferred embodiment, the storage means further stores time data indicating a predetermined time corresponding to each sound constituting the melody indicated by the guide melody data, and the progress of the music is based on the time data. A determining means for determining the predetermined time corresponding to the above may be further provided.

  In another preferred aspect, at least one of the pitch ranges defined by the pitch range data is a pitch range including the pitch of each sound constituting the melody calculated by the pitch calculation means. May be.

  In another preferred embodiment, the pitch range defined by the pitch range data may be a pitch range that does not include the pitch of each sound constituting the melody calculated by the pitch calculation means.

  Further, the present invention provides a storage process for storing pitch range data defining one or more pitch ranges indicating a predetermined pitch range in a storage unit in response to the progress of the music, and an input corresponding to the progress of the music A voice input process for generating singer voice data based on the singer's singing, and a pitch extraction for extracting a pitch of the singer's singing corresponding to the progress of the music based on the singer voice data A detection process for detecting that the pitch extracted in the pitch extraction process is included in the pitch range defined by the pitch range data corresponding to the progress of the music, and the progress of the music in the detection process. In addition to measuring the time continuously detected, if the measured time is equal to or longer than a predetermined time, an identification indicating that the measured time is equal to or longer than the predetermined time It provides a singing evaluation method characterized by comprising a measuring step of outputting a broadcast.

  Further, the present invention provides a storage process for storing pitch range data defining one or more pitch ranges indicating a predetermined pitch range in a storage unit in response to the progress of the music, and an input corresponding to the progress of the music A voice input process for generating singer voice data based on the singer's singing, and a pitch extraction for extracting the singer's singing pitch in accordance with the progress of the song based on the singer voice data A detection process for detecting that the pitch extracted in the pitch extraction process is included in the pitch range defined by the pitch range data corresponding to the progress of the music, and the progress of the music in the detection process. A measurement process for measuring time continuously detected and outputting time information indicating the measured time when the measured time is equal to or longer than a predetermined time; Every time time information is output by the measurement process, the accumulation process of accumulating the time indicated by the output time information, and the singing of the singer based on the time accumulated in the accumulation process A singing evaluation method characterized by comprising an evaluation process for performing the evaluation.

  According to another aspect of the present invention, there is provided a storage function for storing pitch range data defining one or more pitch ranges indicating a predetermined pitch range corresponding to the progress of music, and input corresponding to the progress of the music. A voice input function for generating singer voice data based on the singer's singing, and a pitch extraction for extracting a pitch of the singer's singing corresponding to the progress of the music based on the singer voice data A detection function for detecting that the pitch extracted by the pitch extraction function is included in the pitch range defined by the pitch range data in accordance with the progress of the music, and the progress of the music in the detection function. In contrast, the time continuously detected is measured, and when the measured time is equal to or longer than the predetermined time, the measured time is equal to or longer than the predetermined time. A computer readable program for realizing the measurement function of outputting different information.

  According to another aspect of the present invention, there is provided a storage function for storing pitch range data defining one or more pitch ranges indicating a predetermined pitch range corresponding to the progress of music, and input corresponding to the progress of the music. A voice input function for generating singer voice data based on the singer's singing, and a pitch extraction for extracting the pitch of the singer's singing corresponding to the progress of the music based on the singer voice data A detection function for detecting that the pitch extracted by the pitch extraction function is included in the pitch range defined by the pitch range data in accordance with the progress of the music, and the progress of the music in the detection function. A measuring instrument that measures time continuously detected and outputs time information indicating the measured time when the measured time is equal to or longer than a predetermined time. And an accumulation function for accumulating the time indicated by the output time information each time time information is output by the measurement function, and the time of the singer based on the time accumulated in the accumulation function. A computer-readable program for realizing an evaluation function for evaluating a song is provided.

According to the present invention, it is possible to provide a karaoke apparatus, a singing evaluation method, and a program that detect and evaluate a lost song and a long tone song.

  Hereinafter, an embodiment of the present invention will be described.

<First Embodiment>
In the first embodiment, a karaoke apparatus 1 capable of evaluating a lost song will be described. First, the hardware configuration of the karaoke apparatus 1 will be described with reference to FIG. FIG. 1 is a block diagram showing a hardware configuration of a karaoke apparatus 1 according to the first embodiment of the present invention.

  A CPU (Central Processing Unit) 11 reads out a program stored in a ROM (Read Only Memory) 12, loads it into a RAM (Random Access Memory) 13, and executes it, thereby executing a bus for each part of the karaoke apparatus 1. 10 to control. The RAM 13 functions as a work area when the CPU 11 performs data processing.

  The storage unit 14 is, for example, a large-capacity storage unit such as a hard disk, and includes a music data storage area 14a, a singer voice data storage area 14b, and a pitch range data storage area 14c. The song data storage area 14a stores a plurality of song data of karaoke songs, and each song data has a guide melody track, an accompaniment data track, and a lyrics data track.

  The guide melody track is data that indicates the melody of the vocal part of the music, and reads and executes event data such as note-on that indicates a sound generation command, note-off that indicates a mute command, and control change, and the next event data. Delta time data indicating the time until. With this delta time, the time of event data to be executed can be associated with the passage of time since the progression of music began. Note on and note off each have a note number indicating the pitch of the sound to be sounded and muted. Thereby, each sound which comprises the melody of the vocal part of a music can be prescribed | regulated by note-on, note-off, and delta time. The accompaniment data track is composed of a plurality of tracks of each accompaniment instrument, and each instrument track has the same data structure as the above-described guide melody track. In the case of the present embodiment, MIDI format data is stored.

  The lyric data track changes the color of text data indicating the lyrics of music, display timing data indicating the timing of displaying lyrics telop on the display unit 15 to be described later according to the progress of the music, Wipe timing data indicating timing for performing wipe. Then, the CPU 11 reproduces the music data stored in the music data storage area 14a, outputs the audio data generated based on the accompaniment data track of the music data to the audio processing unit 18 described later, and outputs it to the lyrics data track. Based on this, a lyrics telop is displayed on the display unit 15.

  In the singer voice data storage area 14b, voice data (hereinafter referred to as singer voice data) A / D converted from the microphone 17 (to be described later) via the voice processing unit 18 is time-sequentially in, for example, the WAVE format or the MP3 format. Is remembered. By storing in chronological order in this way, it is possible to associate the time elapsed since the progression of the music started with each frame having a predetermined time length of the singer's voice data.

  Further, the pitch range data storage area 14c has pitch range data for determining a lost song. The pitch range data is data defining a pitch range indicating a pitch range based on the pitch determined from the note number of the guide melody track. Specifically, it is data indicating a predetermined pitch range (hereinafter referred to as a sharp region) in a pitch region higher than a reference pitch and a predetermined pitch range (hereinafter referred to as a flat region) in a lower pitch region. Hereinafter, a region combining the sharp region and the flat region is referred to as a detection region. As described above, the detection area at each time is determined in accordance with the progress of the music by being set relative to the reference pitch. In the present embodiment, the sharp region is set as a range of +30 cent to +70 cent pitch with respect to the reference pitch, and the flat region is set as a range of -30 cent to -70 cent pitch with respect to the reference pitch. Here, cent is a unit indicating a relative pitch difference of the pitch, and the pitch indicated by +100 cent indicates a pitch that is a semitone above the reference pitch. Note that the pitch range defining the detection area can be changed by operating the operation unit 16 described later.

  The display unit 15 is a display device such as a liquid crystal display. The display unit 15 is controlled by the CPU 11, and based on the lyrics data track stored in the music data storage area 14a of the storage unit 14, a background image or the like according to the progress of the music. A lyrics telop is also displayed. In addition, various screens such as a menu screen for operating the karaoke apparatus 1 and a singing evaluation result screen are displayed. The operation unit 16 is, for example, a keyboard, a mouse, a remote controller, and the like. When the user of the karaoke apparatus 1 operates the operation unit 16, data representing the operation content is output to the CPU 11.

  The microphone 17 picks up a singer's song. The voice processing unit 18 performs A / D conversion on the voice collected by the microphone 17 to generate singer voice data. The singer voice data is stored in the singer voice data storage area 14b of the storage unit 14 as described above. The audio processing unit 18 D / A converts the audio data input by the CPU 11 and emits the sound from the speaker 19.

  Next, functions realized by the CPU 11 executing programs stored in the ROM 12 will be described. FIG. 2 is a block diagram showing a software configuration showing the functions realized by the CPU 11.

  The pitch extraction unit 101 reads out the singer's voice data stored in the singer's voice data storage area 14b, and extracts the pitch of the singer's voice data related to the singer's voice data in units of frames having a predetermined time length. Then, singing pitch data indicating the pitch of the singing extracted in units of frames is output to the normal evaluation unit 103 and the lost singing evaluation unit 105. The pitch may be extracted from a spectrum generated by FFT (Fast Fourier Transform) or may be extracted by other known methods.

  The pitch calculation unit 102 reads the guide melody track of the music to be evaluated from the music data storage area 14a, and recognizes the melody of the music from the read guide melody track. In addition, for each sound constituting the recognized melody, a pitch is calculated in units of frames having a predetermined time length. Then, melody pitch data indicating the pitch of the guide melody calculated for each frame is output to the normal evaluation unit 103 and the lost song evaluation unit 105. In addition, since the pitch of each sound which comprises a melody is prescribed | regulated by the note number, a pitch will be determined corresponding to a note number. For example, when the note number is 69 (A4), the pitch is 440 Hz. At this time, if a table that associates the note number with the pitch is stored in the storage unit 14, the pitch calculation unit 102 may calculate the pitch with reference to the table.

  The normal evaluation unit 103 compares the singing pitch data output from the pitch extraction unit 101 and the melody pitch data output from the pitch calculation unit 102 in units of frames, and generates normal evaluation data indicating the degree of pitch matching. , Output to the scoring unit 104. Here, the degree of coincidence may be calculated from the difference between the pitch of the sound that composes the melody and the pitch of the singing in each frame, or the pitch of the sound that composes the melody and the pitch of the singing substantially match. That is, it may be calculated from a time ratio within a predetermined pitch range with respect to the pitch of the sound constituting the melody. Note that the normal evaluation unit 103 may not only evaluate the singing pitch but also evaluate the sound volume and other feature quantities. In this case, an extraction unit that extracts each necessary feature amount from the singing is provided, and a feature amount serving as a reference for evaluation may be stored in the storage unit 14.

  The lost song evaluation unit 105 includes a detection unit 1051, a measurement unit 1052, an accumulation unit 1053, and an evaluation unit 1054. The song pitch data output from the pitch extraction unit 101 and the melody pitch data output from the pitch calculation unit 102 And based on the pitch range data memorize | stored in the pitch range data storage area 14c, the lost song evaluation data which shows the evaluation result of a lost song is produced | generated, and it outputs to the scoring part 104. Hereinafter, each part which comprises the lost song evaluation part 105 is demonstrated.

  The detection unit 1051 reads pitch range data from the pitch range data storage area 14c. Then, by applying the pitch range indicated by the pitch range data to the pitch corresponding to each frame indicated by the melody pitch data output from the pitch calculation unit 102, the sharp area and the flat area are recognized for each frame. These are collectively recognized as a detection region. The detection unit 1051 sequentially compares the detection area recognized as the singing pitch data output from the pitch extraction unit 101 in units of frames, and the detection result of whether or not the pitch of each frame indicated by the singing pitch data is included in the detection area. Is output to the measurement unit 1052. When the comparison is completed for all the frames, the end information indicating the completion and the information indicating the total number Tall of the compared frames are output to the evaluation unit 1054.

  The measuring unit 1052 measures the number of Tcounts, which is the number of frames in which the pitch related to the singing pitch data is continuously included in the detection area, based on the determination information output from the detecting unit 1051, and sets predetermined conditions. When it is satisfied, information indicating Tcount is output to the accumulating unit 1053. Here, the predetermined condition is that Tcount at the time when the judgment information indicating the result that the pitch related to the singing pitch data is not included in the detection area is output from the detection unit 1051 is larger than a preset set value k. That is, the number of frames in which the pitch related to the singing pitch data is continuously included in the detection area is larger than the set value k, and this is a condition for detecting that the singing by the singer is in a confused singing state. If the predetermined condition is not satisfied, the count of Tcount is reset to “0”. Note that the set value k set by the number of frames can be converted to time since the time of one frame is determined. The set value k may be changed by operating the operation unit 16.

  The accumulation unit 1053 accumulates the Tcount indicated by the information output from the measurement unit 1052. The accumulated value is called Ttotal. In a case where the end information and the information indicating the total number of frames Tall are output from the detection unit 1051, the evaluation unit 1054 reads Ttotal that is a value accumulated by the accumulation unit 1053 from the accumulation unit 1053, and the Ttotal Is output to the scoring unit 104 as to the singing evaluation data indicating the ratio to the total number of frames Tall. The lost song evaluation data is not limited to the one indicating Ttotal / Tall as long as it is generated based on Ttotal. For example, it may indicate Ttotal itself.

  The scoring unit 104 calculates the evaluation score of the singer's song based on the normal evaluation data output from the normal evaluation unit 103 and the lost song evaluation data output from the lost song evaluation unit 105. The calculated evaluation score is displayed on the display unit 15 by the CPU 11.

  Next, the operation of the karaoke apparatus 1 will be described. First, the singer operates the operation unit 16 to select a song to be sung. The CPU 11 reads the music data corresponding to the music selected by the singer from the music data storage area 14a, and releases the music accompaniment from the speaker 19 based on the accompaniment data track of the read music data as the music progresses. The lyric is wiped on the display unit 15 based on the lyric data track of the read music data. When the singer sings along with the progress of the music, the singing is picked up by the microphone 17 and stored in the singer voice data storage area 14b as singer voice data.

  When the music is finished by proceeding to the end, the CPU 11 starts to evaluate the singer's singing. The pitch extraction unit 101 reads the singer voice data stored in the singer voice data storage area 14 b and outputs the singing pitch data to the normal evaluation unit 103 and the detection unit 1051 of the lost song evaluation unit 105. The pitch calculation unit 102 reads the guide melody track of the music serving as the evaluation reference from the music data storage area 14a, and outputs the melody pitch data to the normal evaluation unit 103 and the lost song evaluation unit 105.

  The normal evaluation unit 103 compares the singing pitch data output from the pitch extraction unit 101 and the melody pitch data output from the pitch calculation unit 102 in units of frames, and generates normal evaluation data indicating the degree of pitch matching. , Output to the scoring unit 104. The lost song evaluation unit 105 evaluates the singing pitch data output from the pitch extraction unit 101, the melody pitch data output from the pitch calculation unit 102, and the pitch range data stored in the pitch range data storage area 14c. Lost song evaluation data indicating the result is generated and output to the scoring unit 104.

  Here, the flow of evaluation of the lost song evaluation unit 105 will be described in detail with reference to FIG. FIG. 3 is a flowchart showing a flow of evaluation performed by the lost song evaluation unit 105.

  First, when evaluation in the lost song evaluation unit 105 is started, Tall, Ttotal, and Tcount, which are parameters used in the lost song evaluation unit 105, are initialized to all “0” (step S1). Next, the detection unit 1051 increments the value of Tall indicating the number of frames compared by “1” and counts up (step S <b> 2), and outputs the singing pitch data output from the pitch extraction unit 101 and the pitch calculation unit 102. The comparison of the first frame is started with respect to the detection area recognized by applying the pitch range data to the melody pitch data.

  The detection unit 1051 determines whether or not the pitch related to the singing pitch data is included in the detection area in the comparison of the first frame (step S3). If it is determined that it is included (step S3; Yes), the detection unit 1051 outputs determination information indicating that it is included to the measurement unit 1052. The measuring unit 1052 then increments Tcount by “1” and counts up (step S4). And it progresses to step S8 mentioned later.

  On the other hand, when it is determined that the pitch related to the singing pitch data is not included in the detection area (step S3; No), the detection unit 1051 determines that it is not included (has not detected inclusion) ) Is output to the measurement unit 1052. Then, the measuring unit 1052 determines whether or not Tcount is larger than a preset setting value k (step S5).

  When Tcount is larger than the set value k (step S5; Yes), the measurement unit 1052 outputs information indicating Tcount to the accumulation unit 1053. Then, the accumulating unit 1053 adds Tcount indicated by the output information to Ttotal to obtain a new Ttotal (step S6). Then, the measurement unit 1052 resets the count of Tcount to “0” (step S7), and then proceeds to step S8 described later. On the other hand, when Tcount is equal to or less than the set value k (step S5; No), the measurement unit 1052 resets the count of Tcount to “0” without performing the process of step S6 (step S7). Then, the process proceeds to step S8 described later. As described above, the accumulation unit 1053 adds to Ttotal each time information indicating Tcount is output from the measurement unit 1052, so that Ttotal is the accumulation result of Tcount indicated by the information output from the measurement unit 1052. It becomes. And it progresses to step S8 mentioned later.

  When the processing in steps S4, S6, and S7 ends, the detection unit 1051 determines whether or not the music has ended based on the singing pitch data output from the pitch extraction unit 101 or the melody pitch data output from the pitch calculation unit 102. Is determined (step S8). If it is determined that the music has not ended (step S8; No), the above-described processing is repeated from step S2. On the other hand, if it is determined that the music has ended (step S8; Yes), the detection unit 1051 outputs the end information and information indicating Tall to the evaluation unit 1054. When the end information is output from the detection unit 1051, the evaluation unit 1054 reads Ttotal that is the result of accumulation in the accumulation unit 1053. Then, the evaluation unit 1054 scoring the lost song evaluation data indicating Ttotal / Tall, which is the ratio of the pitch related to the singer's voice data to the time of the guide melody that is continuously included in the detection region for a predetermined time or more. It outputs to 104 (step S9). Note that, as described above, the lost song evaluation data is not limited to the one indicating Ttotal / Tall as long as it is generated based on Ttotal. For example, it may indicate Ttotal itself. Further, when Tcount is larger than the set value k when the music ends, that is, when the pitch related to the singing pitch data is included in the detection area, the measuring unit 1052 gives the accumulating unit 1053 The information indicating Tcount may be output. In this case, the detection unit 1051 may send end information to the evaluation unit 1054 and output determination information indicating that the pitch related to the singing pitch data is not included in the detection region to the measurement unit 1052. .

  Here, the case of a certain sound as shown in FIG. 4 is demonstrated as a specific example of the process in the confusing song evaluation part 105. FIG. FIG. 4 is an explanatory diagram for explaining melody pitch data, singing pitch data, and detection areas. Here, the vertical axis indicates the pitch height, and the horizontal axis indicates time. The hatched area is a detection area corresponding to the sound in the center of the figure, and the upper +30 cent to +70 cent area is a sharp area and the lower -30 cent to -70 cent is based on the pitch of the sound. The area is a flat area. Further, k shown in the figure indicates a preset set value k, which is expressed by converting the number of frames into time. In addition, the content regarding the frame described above will be described as being converted into time in the following description. Moreover, Ttotal before evaluating the sound is assumed to be α.

  First, the pitch indicated by the singer pitch data is included in the flat region at time t1a, and the measuring unit 1052 counts up Tcount. Then, when the time becomes t1b and the pitch indicated by the singer pitch data is not included in the flat region, the time continuously included in the flat region is t1 (t1 = t1b−t1a), so Tcount = t1. Here, since t1 is less than or equal to k, the count of Tcount is reset and Tcount = 0.

  Next, the pitch indicated by the singer pitch data is included in the sharp region at time t2a, and the measuring unit 1052 counts up Tcount. When the time is t2b and the pitch related to the singer pitch data is not included in the sharp area, the time that the pitch related to the singer pitch data is continuously included in the sharp area is t2 (t2 = t2b). -T2a), Tcount = t2. Here, since t2 is larger than k, t2 which is the count of Tcount is added to Ttotal, and Ttotal = α + t2. Then, the count of Tcount is reset and Tcount = 0. Similarly, since the next t3 is also larger than k, t3 is further added, and Ttotal = α + t2 + t3. Since t4 is equal to or less than k, the count of Tcount is reset without being added to Ttotal. Thus, in the sound given as an example, Ttotal increases from α to α + t2 + t3.

  In this way, the process in the singing singing evaluation unit 105 is performed for all frames. Then, the evaluation unit 1054 outputs, to the scoring unit 104, confusing singing evaluation data indicating Ttotal / Tall.

  Then, the scoring unit 104 determines the evaluation score of the song of the singer by a predetermined algorithm based on the normal evaluation data output from the normal evaluation unit 103 and the lost song evaluation data output from the lost song evaluation unit 105. calculate. Then, the calculation result is displayed on the display unit 15.

  As described above, the karaoke apparatus 1 according to the present embodiment sets the time when a singing pitch is continuously detected for a predetermined time or more in a detection area that is a predetermined pitch range corresponding to the pitch of the guide melody. Can be accumulated. As the accumulated time Ttotal or the ratio Ttotal / Tall is larger, the singer has a longer period of time to stabilize at a pitch deviating from the correct pitch, and it can be said that the singing is in a state of hesitation. The effect of singing singing can be added to the scoring results based on the evaluation of the person's singing.

Second Embodiment
In 2nd Embodiment, the karaoke apparatus 1 which can perform evaluation of a long tone song is demonstrated. The hardware configuration of the karaoke apparatus 1 according to the second embodiment is the same as that of the first embodiment, except for the pitch range data related to the pitch range data storage area 14c of the storage unit 14 shown below, and thus the description thereof is omitted. To do.

  The pitch range data storage area 14c has pitch range data for determining a long tone song. The pitch range data is data defining a pitch range indicating a predetermined range of pitches based on the pitch determined from the note number of the guide melody track. In the present embodiment, the pitch is set in the range of −10 cent to +10 cent with respect to the reference pitch. The difference from the first embodiment is that the detection area is not an area set apart from the reference pitch, such as a sharp area or a flat area, but an area including the reference pitch.

  Next, functions realized by the CPU 11 of the karaoke apparatus 1 according to the second embodiment executing a program stored in the ROM 12 will be described with reference to FIG. FIG. 5 is a block diagram illustrating a software configuration showing functions realized by the CPU 11. Note that description of blocks having the same functions as those of the software configuration according to the first embodiment is omitted.

  An LPF (Low Pass Filter) 106 is a low-pass filter that removes high frequency components of the singing pitch data output from the pitch extracting unit 101 and outputs the high frequency component to the detecting unit 1071 of the long tone singing evaluation unit 107. When the pitch related to the singing pitch data output from the pitch extraction unit 101 is a pitch as indicated by a broken line as shown in FIG. 6, for example, the LPF 106 removes the influence of a short-time fluctuation (arrow part). The singing pitch data having the pitch shown by the solid line is output. In this way, it is possible to remove fine pitch fluctuations that are hardly audible in practice as singing pitch fluctuations, and to generate evaluation data for more accurate scoring.

  The long tone song evaluation unit 107 includes a detection unit 1071, a measurement unit 1072, an accumulation unit 1073, and an evaluation unit 1074. These functions have the same functions as those of the detection unit 1051, the measurement unit 1052, the accumulation unit 1053, and the evaluation unit 1054 that constitute the stray singing evaluation unit 105 in the first embodiment. Omitted. Here, the evaluation unit 1074 has a long-tone song evaluation indicating a ratio (Ttotal / Tall) of Ttotal to the total number of frames Tall as evaluation data corresponding to the confusing song evaluation data output by the evaluation unit 1054 according to the first embodiment. The data is output to the scoring unit 104. Note that, similarly to the lost song evaluation data, the long tone song evaluation data is not limited to Ttotal / Tall as long as it is generated based on Ttotal.

  Here, as a specific example of processing in the long tone singing evaluation unit 107, a case of a certain sound as shown in FIG. 7 will be described. FIG. 7 is an explanatory diagram illustrating melody pitch data, singing pitch data, and detection areas. Here, as in FIG. 4, the vertical axis indicates the pitch height, and the horizontal axis indicates the time. The hatched area is a detection area corresponding to the sound in the center of the figure, and is from −10 cent to +10 cent with reference to the pitch of the sound. Further, k shown in the figure indicates a preset set value k, which is expressed by converting the number of frames into time. In addition, the content regarding the frame described above will be described as being converted into time in the following description. Moreover, Ttotal before evaluating the sound is assumed to be α.

  First, the pitch indicated by the singer pitch data is included in the detection area at time t1a, and the measurement unit 1072 counts up Tcount. When the time becomes t1b and the pitch indicated by the singer pitch data is not included in the detection area, the time continuously included in the flat area is t1 (t1 = t1b−t1a), so Tcount = t1. Here, since t1 is larger than k, t1 which is the count of Tcount is added to Ttotal, and Ttotal = α + t1. Then, the count of Tcount is reset and Tcount = 0.

  First, the pitch indicated by the singer pitch data is included in the detection area again at time t2a, and the measuring unit 1072 counts up Tcount. When the time becomes t2b and the pitch indicated by the singer pitch data is not included in the flat area, the time continuously included in the flat area is t2 (t2 = t2b−t2a), so Tcount = t2. Here, since t2 is equal to or less than k, the count of Tcount is reset and Tcount = 0. Thus, in the long tone singing evaluation unit 107 for the sound given as an example, Ttotal increases from α to α + t1.

  In this way, the processing in the long tone singing evaluation unit 107 is performed for all frames. Then, the evaluation unit 1074 outputs Ttotal / Tall to the scoring unit 104 as long tone song evaluation data.

  The scoring unit 104 evaluates the song of the singer by a predetermined algorithm based on the normal evaluation data output from the normal evaluation unit 103 and the long tone song evaluation data output from the long tone song evaluation unit 107. Calculate points. Then, the calculation result is displayed on the display unit 15.

  As described above, the karaoke apparatus 1 according to the present embodiment sets the time when a singing pitch is continuously detected for a predetermined time or more in a detection area that is a predetermined pitch range corresponding to the pitch of the guide melody. Can be accumulated. As the accumulated time Ttotal or the ratio Ttotal / Tall is larger, the singer is singing the sound that should be extended for a longer period of time with a stable pitch. The effect of long-tone singing can be added to the scoring results based on the evaluation of the person's singing. Note that the evaluation of the lost song in the first embodiment and the evaluation of the long tone song in the second embodiment can be performed simultaneously.

  As mentioned above, although embodiment of this invention was described, this invention can be implemented in various aspects as follows.

<Modification 1>
In the first embodiment, the detection unit 1051 distinguishes between the sharp area and the flat area when determining whether the pitch indicated by the singer pitch data is included in the sharp area and the flat area constituting the detection area. Although not performed, each may be distinguished. In this case, the detection unit 1051 determines whether the pitch indicated by the singer pitch data is included in the sharp region, the flat region, or not included in any region, and indicates the determination. The determination information may be output. The measuring unit 1052 uses the Tcount1 indicating the number of frames continuously included in the sharp area and the Tcount2 indicating the number of frames continuously included in the flat area, instead of the Tcount. For 1053, instead of Ttotal, Ttotal1 which is a value obtained by accumulating Tcount1 and Tcount2 which is a value obtained by accumulating Tcount1 may be used.

  In this way, it is possible to separately evaluate the lost song in the sharp area and the lost song in the flat area, and weight the scoring results. For example, the effect of scoring singing in the sharp area has a large impact on scoring, for example, the amount of deductions can be increased, and when there are many singing songs in the sharp area, there are many singing songs in the flat area However, the effect that the singing cannot be skillfully heard can be reflected in the scoring results.

<Modification 2>
As described in the description of each embodiment, the detection area in each embodiment is set as a relative pitch range for each sound constituting the melody with reference to the pitch of the sound. By changing the contents of the pitch range data stored in the range data storage area 14c, it can be set in various modes as described below.

  First, the detection area does not have to be symmetrical with respect to the reference pitch as in the embodiments on the higher and lower pitch sides. For example, the pitch range in the sharp region may be set between +20 cent and +75 cent, and the pitch range in the flat region may be set from −40 cent to −70 cent. Such settings may be changed according to various situations such as the genre of music, the singer's singing level, and a preset level.

  In this case, a plurality of pitch range data may be stored in the pitch range data storage area 14c. Then, by operating the operation unit 16, one pitch range data may be selected from a plurality of pitch range data and the pitch range data to be used may be determined. Moreover, in order to change according to the genre of a music, you may make it memorize | store the table which matches each pitch range data with each music data memorize | stored in the music data storage area 14a in the memory | storage part 14. FIG. Moreover, the pitch range data can also be automatically switched by a singer by memorize | storing in the memory | storage part 14 the table which matches a singer and the song level of the singer, and the table which matches a singing level and pitch range data. The user may make the CPU 11 recognize the singer by operating the operation unit 16.

  Second, the pitch range may be changed as time progresses, for example, a flat region shown in FIG. In this case, the pitch range data may be data of a pitch range that changes in response to a change in time. In this case, for example, in the case of FIG. 8, when a singing technique such as “shakuri” that changes from a low pitch to a correct pitch is intentionally used, it is erroneously evaluated as a lost song. Can be prevented.

  Thirdly, the detection area (in the first embodiment, the sharp area or the flat area) may be changed for each sound constituting the melody. In this case, the pitch range data may be data indicating the pitch range for each melody sound indicated by the guide melody track. In this way, the evaluation criteria can be changed for each sound constituting the melody. As described above, not only the pitch range data indicating the pitch range for each sound constituting the melody, but also the pitch (note number) and the sound length (from note-on to note-off) for each sound constituting the melody. It may be set automatically based on time). For example, the width of the detection area may be changed according to the pitch of the pitch.

  Fourth, the pitch range data may define the pitch range as an absolute pitch value, rather than defining the pitch range relative to the reference pitch. In this case, the pitch range data is data indicating an absolute pitch range corresponding to the progression of the music (or each sound constituting the melody), and the pitch range defined thereby is the detection area. do it. In this way, the detection units 1051 and 1071 can perform the same processing without using the melody pitch data output from the pitch calculation unit 102.

<Modification 3>
In each embodiment, the setting value k set in the measurement units 1052 and 1072 is set in advance, but may be changed in the music. For example, you may make it set automatically based on the sound length for every sound which comprises a guide melody. Further, if the pitch range data has time data indicating the set value k to be set corresponding to the progress of the music (or each sound constituting the melody), the detection units 1051 and 1071 can detect the pitch range data. Can be set for the measurement units 1052 and 1072. In this way, a different set value k can be set for each sound constituting the melody.

<Modification 4>
In the second embodiment, the evaluation of the long tone song is performed based on the stability of the pitch of the song. However, the stability of the volume level may be added to the evaluation of the long tone song. In this case, a level extraction unit that extracts the volume level of a song related to the singer's voice data read from the singer's voice data storage area 14b, generates singing volume level data indicating the volume level, and outputs it to the detection unit 1071. May be provided. Then, the detection unit 1071 detects the stability of the volume level indicated by the singing volume level data output from the level extraction unit, and adds the information on the stability of the volume level to the determination information output to the measurement unit 1072. You can do it. When the measurement unit 1072 determines that the stability of the volume level indicated by the determination information output from the detection unit 1071 is more stable than the preset stability in addition to the conditions in the second embodiment In this case, Tcount may be counted up. In this way, the evaluation of the long tone song can be performed with higher accuracy.

<Modification 5>
In the second embodiment, the evaluation of the long tone song is performed based on the time when the pitch is stable. However, the quality of the long tone song may be weighted and evaluated from the stability of the pitch in the long tone song. . In this case, the following may be performed. When the detection unit 1071 outputs determination information indicating that the pitch related to the singing pitch data output from the LPF 106 is included in the detection area, the detection unit 1071 responds to the progress of the song with respect to the singing pitch data indicating the pitch. And buffer it. Then, when outputting the Tcount, the measuring unit 1072 acquires the singing pitch data buffered in the detecting unit 1071, and measures the difference between the maximum value and the minimum value of the pitch related to the acquired singing pitch data. The smaller the difference, the smaller the pitch variation, so the stability is high, and it is evaluated as a high-quality long tone song. Then, the measuring unit 1072 may be weighted so that Tcount becomes larger as the quality is higher, and output to the accumulating unit 1073. In this way, as the number of high-quality long tone songs increases, Ttotal increases, and the quality of the long tone song can be added to the evaluation.

  Further, the evaluation of the quality of the long tone song may not be the difference between the maximum value and the minimum value of the pitch in the measuring unit 1072. For example, a BPF (Band Pass Filter) that extracts a predetermined frequency band or a High Pass Filter (HPF) that extracts a frequency band equal to or higher than a predetermined frequency with respect to pitch fluctuations related to singing pitch data buffered in the detection unit 1071. Is converted into singing pitch data from which low frequency components are removed. And what is necessary is just to evaluate the quality of a long tone song on the basis of the grade of the fluctuation | variation of the pitch which concerns on the converted song pitch data. As for the degree of pitch fluctuation, the average value and effective value of the waveform indicated by the pitch fluctuation may be used, and if the average value and effective value are small, the fluctuation is small, so the stability is high and the quality is high. Evaluate it as a long-tone song. Then, as described above, the measurement unit 1072 may perform weighting so that the higher the quality, the larger the Tcount becomes. As for the singing pitch data buffered by the detecting unit 1071, the singing pitch data not processed by the LPF 106 is acquired directly from the pitch extracting unit 101 instead of the singing pitch data output from the LPF 106, and is buffered. Also good. In this way, since the singing pitch data for quality evaluation does not use the LPF 106, it is possible to leave a high frequency component necessary for quality evaluation, and therefore it is possible to make a more accurate determination.

<Modification 6>
In each embodiment, Ttotal used for evaluation was obtained by counting and accumulating the number of frames in which the pitch of the song related to the singer pitch data was continuously included in the detection region. You may make it count the frequency | count that the measurement parts 1052 and 1072 satisfy | fill the conditions which output the information which shows Tcount. In this case, when the information indicating Tcount is output from the measuring units 1052 and 1072, the accumulating units 1053 and 1073 instead of adding Tcount to Ttotal (step S 6 in FIG. 3), the value of Ttotal Is increased by “1” (Ttotal = Ttotal + 1). Even if it does in this way, the effect similar to each embodiment can be acquired. Note that the information output from the measurement units 1052 and 1072 may not be information indicating Tcount, and the number of frames in which the pitch related to the singing pitch data is continuously included in the detection region is greater than the set value k. That is, any information may be output as long as it is identification information indicating that the detection units 1051 and 1071 have continuously detected the singing pitch for a predetermined time or more.

<Modification 7>
In the second embodiment, the LPF 106 is used to remove high-frequency components from the pitch variation related to the singer pitch data, but the LPF 106 is not necessarily used. Conversely, in the first embodiment, the LPF 106 is not used, but by using it for the singer pitch data as in the second embodiment, the high-frequency component is removed from the pitch variation related to the singer pitch data. It may be.

  Here, the LPF 106 is a filter that removes high-frequency components that are equal to or higher than a set frequency (hereinafter referred to as a cut-off frequency). However, the pitch range of the detection region may be set based on the set cut-off frequency. . For example, when the cut-off frequency is set to a lower frequency, processing is performed in a direction in which the pitch related to the singer pitch data is stabilized. Therefore, the CPU 11 detects the pitch range so as to narrow the detection range. You may set to 1051,1071.

<Modification 8>
The pitch indicated by the singer pitch data generated by the pitch extraction unit 101 in each embodiment may be shifted by one octave (1200 cent) depending on the detection, but the detection area is set so as to be able to cope with this case as well. Also good. In this case, the detection units 1051 and 1071 include a range shifted from 1200 cent, 2400 cent,... On both the higher and lower pitch sides of the detection area where the detection area is set. A region may be used. Specifically, in the second embodiment, in addition to −10 cent to +10 cent, the detection region may be set to +1190 cent to +1210 cent and −1190 cent to −1210 cent.

<Modification 9>
In each embodiment, the processing by the confusing singing evaluation unit 105 and the long tone singing evaluation unit 107 is performed after the music sung by the singer is finished. However, the processing may be sequentially performed during the singing. Good. In this case, the pitch extraction unit 101 sequentially extracts the pitch of the singing from the singer voice data that is the data of the already sung portion according to the progress of the music, and the singing pitch evaluation unit 105 or the singing pitch data is lost. What is necessary is just to make it output to the long tone song evaluation part 107. FIG. Then, the lost song evaluation unit 105 and the long tone song evaluation unit 107 may perform processing sequentially in accordance with the song pitch data sequentially output from the pitch extraction unit 101. In this way, since the process is completed in a short time after the music is completed, the evaluation result can be quickly displayed on the display unit 15. In addition, when the timing at which the measurement units 1052 and 1072 output Tcount, that is, when a lost song or a long tone song is detected, the CPU 11 can also display on the display unit 15 that the detection has been performed. .

It is a block diagram which shows the structure of the hardware of the karaoke apparatus which concerns on 1st Embodiment. It is a block diagram which shows the structure of the software of the karaoke apparatus which concerns on 1st Embodiment. It is a flowchart which shows the flow of the evaluation of the lost song in the lost song evaluation part which concerns on 1st Embodiment. It is explanatory drawing which shows a part of evaluation of the lost song in the lost song evaluation part which concerns on 1st Embodiment. It is a block diagram which shows the structure of the software of the karaoke apparatus which concerns on 2nd Embodiment. It is explanatory drawing which shows the pitch of the song before and behind the process in LPF which concerns on 2nd Embodiment. It is explanatory drawing which shows a part of evaluation of the long tone song in the long tone song evaluation part which concerns on 2nd Embodiment. 11 is an explanatory diagram illustrating an example of a detection region according to Modification Example 2. FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Karaoke apparatus, 10 ... Bus, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Memory | storage part, 14a ... Music data storage area, 14b ... Singer voice data storage area, 14c ... Pitch range data storage area, DESCRIPTION OF SYMBOLS 15 ... Display part, 16 ... Operation part, 17 ... Microphone, 18 ... Audio | voice processing part, 19 ... Speaker, 101 ... Pitch extraction part, 102 ... Pitch calculation part, 103 ... Normal evaluation part, 104 ... Scoring part, 105 ... Lost Singing evaluation unit, 1051 ... detection unit, 1052 ... measurement unit, 1053 ... accumulation unit, 1054 ... evaluation unit, 106 ... LPF, 107 ... long tone singing evaluation unit, 1071 ... detection unit, 1072 ... measurement unit, 1073 ... progress Arithmetic unit, 1074 ... evaluation unit

Claims (15)

Storage means for storing pitch range data defining one or more pitch ranges indicating a predetermined pitch range in accordance with the progress of the music;
Voice input means for generating singer voice data based on a singer's singing input corresponding to the progress of the music;
Based on the singer voice data, pitch extraction means for extracting the pitch of the singer's singing corresponding to the progress of the music;
Detecting means for detecting that the pitch extracted by the pitch extracting means is included in the pitch range defined by the pitch range data in accordance with the progress of the music;
An identification indicating that the detection means measures the time continuously detected with respect to the progress of the music and that the measured time is a predetermined time or more when the measured time is a predetermined time or more. A karaoke apparatus comprising: a measuring means for outputting information. Storage means for storing pitch range data defining one or more pitch ranges indicating a predetermined pitch range in accordance with the progress of the music;
Voice input means for generating singer voice data based on a singer's singing input corresponding to the progress of the music;
Based on the singer voice data, pitch extraction means for extracting the pitch of the singer's singing corresponding to the progress of the music;
Detecting means for detecting that the pitch extracted by the pitch extracting means is included in the pitch range defined by the pitch range data in accordance with the progress of the music;
Measuring means for measuring the time continuously detected by the detecting means with respect to the progress of the music and outputting time information indicating the measured time when the measured time is equal to or longer than a predetermined time; ,
Accumulating means for accumulating the time indicated by the output time information each time time information is output from the measuring means;
A karaoke apparatus comprising: evaluation means for evaluating the singer's singing based on the time accumulated by the accumulating means. Accumulating means for measuring the number of times the identification information is output from the measuring means;
The karaoke apparatus according to claim 1, further comprising: an evaluation unit that evaluates the singing of the singer based on the number of times the accumulation unit has measured. The pitch range data defines a plurality of pitch ranges,
The detection means detects that the pitch extracted by the pitch extraction means is included in each pitch range defined by the pitch range data for each pitch range corresponding to the progress of the music,
The measuring means measures the time continuously detected by the detecting means with respect to the progress of the music for each pitch range, and when the measured time is equal to or longer than a predetermined time, the measured time And time information indicating the pitch range corresponding to the measured time,
The accumulation unit accumulates the time indicated by the output time information for each pitch range each time time information is output from the measurement unit,
3. The karaoke apparatus according to claim 2, wherein the evaluation unit evaluates the song of the singer based on the time for each pitch range accumulated by the accumulation unit. The pitch range data defines a plurality of pitch ranges,
The detection means detects that the pitch extracted by the pitch extraction means is included in each pitch range defined by the pitch range data for each pitch range corresponding to the progress of the music,
The measuring means measures the time continuously detected by the detecting means with respect to the progress of the music for each pitch range, and when the measured time is equal to or longer than a predetermined time, the measured time Output identification information indicating that the time is equal to or longer than the predetermined time and the pitch range corresponding to the measured time,
The accumulation means measures the number of times identification information is output from the measurement means for each pitch range,
The karaoke apparatus according to claim 3, wherein the evaluation unit evaluates the singing of the singer based on the number of times the accumulating unit measures each pitch range. The storage means further stores guide melody data indicating a melody to be sung by the singer in accordance with the progress of the music,
A pitch calculating means for calculating the pitch of each sound constituting the melody indicated by the guide melody data;
The pitch range data is data defining a pitch range by indicating a relative pitch range with respect to a pitch of each sound constituting a melody calculated by the pitch calculation means. The karaoke apparatus in any one of Claims 1 thru | or 5. The pitch range data stored in the storage means is data in which a pitch range is defined based on a pitch of each sound constituting a melody indicated by the guide melody data. Karaoke equipment. 7. The apparatus according to claim 6, further comprising a determination unit that determines the predetermined time corresponding to the progress of the music based on the length of each sound constituting the melody indicated by the guide melody data. 8. The karaoke apparatus according to 7. The storage means further stores time data indicating a predetermined time corresponding to each sound constituting the melody indicated by the guide melody data,
8. The karaoke apparatus according to claim 6, further comprising a determining unit that determines the predetermined time corresponding to the progress of the music based on the time data. The pitch range including at least one pitch range among pitch ranges defined by the pitch range data includes a pitch of each sound constituting a melody calculated by the pitch calculation means. The karaoke apparatus according to claim 9. The pitch range defined by the pitch range data is a pitch range that does not include the pitch of each sound constituting the melody calculated by the pitch calculation means. Karaoke apparatus as described in 1. A storage step of storing in the storage means pitch range data defining one or more pitch ranges indicating a predetermined pitch range in accordance with the progress of the music;
A voice input process for generating singer voice data based on a singer's singing input corresponding to the progress of the music;
Based on the singer voice data, a pitch extraction process of extracting the pitch of the singer's singing corresponding to the progress of the music;
A detection process for detecting that the pitch extracted in the pitch extraction process is included in the pitch range defined by the pitch range data in accordance with the progress of the music;
In the detection process, the time continuously detected with respect to the progress of the music is measured, and when the measured time is equal to or longer than the predetermined time, the identification indicating that the measured time is equal to or longer than the predetermined time A singing evaluation method comprising: a measurement process for outputting information. A storage step of storing in the storage means pitch range data defining one or more pitch ranges indicating a predetermined pitch range in accordance with the progress of the music;
A voice input process for generating singer voice data based on a singer's singing input corresponding to the progress of the music;
Based on the singer voice data, a pitch extraction process of extracting the pitch of the singer's singing corresponding to the progress of the music;
A detection process for detecting that the pitch extracted in the pitch extraction process is included in the pitch range defined by the pitch range data in accordance with the progress of the music;
A measurement process of measuring time continuously detected with respect to the progress of the music in the detection process and outputting time information indicating the measured time when the measured time is equal to or longer than a predetermined time; ,
An accumulation process for accumulating the time indicated by the output time information each time time information is output by the measurement process;
A singing evaluation method comprising: an evaluation step of evaluating the singing of the singer based on the time accumulated in the accumulation step. On the computer,
A storage function for storing pitch range data defining one or more pitch ranges indicating a predetermined pitch range in correspondence with the progress of the music;
A voice input function for generating singer voice data based on a singer's singing input corresponding to the progress of the music;
Based on the singer voice data, a pitch extraction function for extracting the pitch of the singer's singing corresponding to the progress of the music;
A detection function for detecting that the pitch extracted in the pitch extraction function is included in the pitch range defined by the pitch range data in accordance with the progress of the music;
In the detection function, the time continuously detected with respect to the progress of the music is measured, and when the measured time is equal to or longer than the predetermined time, the identification indicating that the measured time is equal to or longer than the predetermined time A computer-readable program that realizes a measurement function that outputs information. On the computer,
A storage function for storing pitch range data defining one or more pitch ranges indicating a predetermined pitch range in correspondence with the progress of the music;
A voice input function for generating singer voice data based on a singer's singing input corresponding to the progress of the music;
Based on the singer voice data, a pitch extraction function for extracting the pitch of the singer's singing corresponding to the progress of the music;
A detection function for detecting that the pitch extracted in the pitch extraction function is included in the pitch range defined by the pitch range data in accordance with the progress of the music;
A measurement function for measuring time continuously detected with respect to the progress of the music in the detection function, and outputting time information indicating the measured time when the measured time is equal to or longer than a predetermined time; ,
An accumulation function for accumulating the time indicated by the output time information each time time information is output by the measurement function;
The computer-readable program for implement | achieving the evaluation function which evaluates about the said song of the said singer based on the time accumulated in the said accumulation function.

Images