JP5929001B2 - Singing support device - Google Patents

Description

  The present invention relates to a technique for supporting a singer's singing.

  2. Description of the Related Art Conventionally, a technique is known in which a voice (singing voice) sung by a singer in karaoke or the like is evaluated in comparison with a standard to be sung and the result is displayed as an image. In Patent Document 1, a three-dimensional image is displayed so as to pop out larger as the pitch of the singing voice is higher than the pitch to be sung, and to be displayed higher by lowering the singing voice. A technique is described that allows a singer to recognize how much the pitch of his singing voice is relative to high.

Japanese Patent Laid-Open No. 10-011080

By the way, for a singer, even if it recognizes that the evaluation of the singing voice is low, for example, the pitch of the singing voice deviates from the standard pitch to be sung, the song with the same pitch is being sung. It is difficult to improve. It is difficult to know when the next pitch will be the same pitch as the standard pitch that should have been sung when the pitch was shifted, or even if you knew it, it would be difficult to achieve the timing while singing. It is because.
The present invention has been made in view of such circumstances, and one of its purposes is to give the singer in advance the timing at which the sound having the same characteristics as the sound that the singer has received a specific evaluation is re-emitted. It is to tell.

In order to solve the above problem, the present invention includes storage means for storing the reference data indicating the music data indicating a music piece, a reference associated with each period corresponding to each sound before Symbol song, the reading means for reading the reference data and contact the music data in accordance with progression of the music, the singing voice represented by the audio signal supplied from the sound collecting means, the result of comparing the reference indicated by the reference data read A first calculation unit that calculates a corresponding evaluation value, and a period subsequent to the period when the evaluation value calculated by the first calculation unit satisfies a predetermined condition, and the period specifying a time period having a common feature and the specifying means, and notification means for notifying before the time specified by the specifying means the period starts, the A second calculating unit that calculates an evaluation score according to the evaluation value calculated by the one calculating unit, an evaluation value calculated by the first calculating unit during the period specified by the specifying unit, and the specifying unit A singing support device is provided , comprising: a changing unit that changes the evaluation score calculated by the second calculation unit according to a difference from the evaluation value used when specifying .

Moreover, in another preferable aspect, the memory | storage means which memorize | stores the music data which show a music, and the reference data which show the reference | standard matched with each of the period corresponding to each sound in the said music, The said progress according to the progress of the said music An evaluation value is calculated in accordance with a result of comparing the singing voice indicated by the audio signal supplied from the music data and the reference data, the audio signal supplied from the sound pickup means, and the reference indicated by the read reference data. When the evaluation value calculated by the first calculation means and the first calculation means is a period that satisfies a predetermined condition, the period is a period that follows the period and has characteristics common to the period specifying means for specifying a, and a notifying means for notifying a specific time period prior to the period starts by the specifying means, before The notification unit includes a display unit and a display control unit that controls the display unit, and the display control unit includes the evaluation value calculated by the first calculation unit during the period specified by the specifying unit, and the specifying unit. The difference between the period and the evaluation value used when specifying the period is used as a parameter, and an image corresponding to the parameter is displayed .
Also, storage means for storing music data indicating a music, and reference data indicating a reference corresponding to each period corresponding to each sound in the music, and the music data and the reference data according to the progress of the music Reading means, first singing means for calculating an evaluation value according to a result of comparing the singing voice indicated by the audio signal supplied from the sound collecting means and the reference indicated by the read reference data; In a case where the evaluation value calculated by the first calculation means is a first period that satisfies a predetermined condition, a reference that is subsequent to the first period and compared when calculating the evaluation value Means for identifying a period in which different types of features are in common with the first period, and a period identified by the identifying means before the period starts. Characterized in that it comprises a notifying means for notifying.
In another preferred aspect, the different type of feature is a difference in the reference corresponding to a length of a period or a previous period.

  In another preferred embodiment, the notification unit includes a display unit and a display control unit that controls the display unit, and the display control unit uses the evaluation value calculated by the first calculation unit as a parameter, An image corresponding to the parameter is displayed on the display unit before the period specified by the specifying unit using the evaluation value is started.

Moreover, in another preferable aspect, the first calculation means calculates an evaluation value according to a result of comparing the singing voice and each of a plurality of the different standards.
The specifying means specifies the period for each of a plurality of the criteria,
The notification means includes display means and display control means for controlling the display means, and the first calculation means is compared with a reference that is common to a reference and a type associated with a period specified by the specification means. The evaluation value calculated by the above is used as a parameter, and an image corresponding to the parameter is displayed.

  In another preferred embodiment, the display means can display an image as a stereoscopic stereoscopic image, and the display control means causes the display means to display the image stereoscopically. And

  In another preferable aspect, the display control means causes the display means to display the image by changing the aspect of the stereoscopic image according to the parameter.

  According to the present invention, it is possible to inform the singer in advance of the timing at which a sound having the same characteristics as the sound that the singer has received a specific evaluation for is re-emitted.

It is a block diagram which shows the whole structure of the karaoke apparatus which concerns on embodiment. It is a block diagram which shows the functional structure of the control part of a karaoke apparatus. It is a figure which shows an example of the screen displayed on a display. It is a table | surface which shows the evaluation value or average value calculated from the singing voice for every pitch. It is a figure which shows an example of the image displayed according to an evaluation value. It is a figure which shows an example of the image displayed according to an evaluation value. It is a figure which shows an example of the image displayed according to an evaluation value. It is a figure which shows the example of the image displayed according to an evaluation value. It is a figure which shows the functional block diagram of the function which operate | moves by the process which adds an evaluation point. It is a figure which shows the example of the image displayed according to the evaluation value which concerns on a modification.

[Embodiment]
Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing the overall configuration of the karaoke apparatus 1. The karaoke apparatus 1 is installed in, for example, a karaoke shop, and provides a user with a so-called karaoke function, evaluates a voice (singing voice) sung by the user (singer), and sings based on the evaluation. It is an apparatus to support, and corresponds to an example of a “singing support apparatus” according to the present invention. The karaoke apparatus 1 includes a control unit 10, an operation unit 21, an acoustic processing unit 22, a sound collection unit 23, a sound emission unit 24, a stereoscopic image display unit 25, and a storage unit 30.
The control unit 10 includes a CPU (Central Processing Unit) and a memory. The CPU controls each unit of the karaoke apparatus 1 by executing a program stored in the memory. The memory includes a ROM (Read Only Memory) and a RAM (Random Access Memory), and stores programs and data used by the CPU.
The operation unit 21 includes a plurality of operation buttons, and supplies operation data indicating the contents operated by the user to the control unit 10.
The sound collection unit 23 is a sound collection unit such as a microphone, and receives a singing voice emitted by a singer and outputs an audio signal indicating the singing voice to the acoustic processing unit 22.
The sound emitting unit 24 is a sound emitting unit such as a speaker, and emits an audio signal output from the sound processing unit 22.
The acoustic processing unit 22 includes a signal processing circuit such as a DSP (Digital Signal Processor), a sound source that generates an audio signal from a MIDI (Musical Instrument Digital Interface) format signal, and the like. The sound processing unit 22 performs A / D conversion on the audio signal input from the sound collection unit 23 and outputs the audio signal to the control unit 10. The sound processing unit 22 receives MIDI format data from the control unit 10 and generates an audio signal based on the data. The sound processing unit 22 performs signal processing such as effect processing and amplification processing on the audio signal thus generated, the audio signal output from the control unit 10, the audio signal input from the sound collection unit 23, and the like. The sound is output to the sound emitting unit 24.
The stereoscopic image display unit 25 includes a display capable of displaying an image as a stereoscopic image representing the stereoscopic image, and displays a stereoscopic image corresponding to image data indicating the stereoscopic image supplied from the control unit 10. . Here, the image is a concept including a video (moving image) expressed by moving the image. The stereoscopic image display unit 25 corresponds to an example of a “display unit” according to the present invention.

The storage unit 30 includes a hard disk, and stores a music database 310 and an image material database 320. In the music database 310, data related to music played in karaoke is recorded, and in detail, accompaniment data 311, reference data 312 and lyric data 313 are recorded.
The accompaniment data 311 is data indicating a music piece, and indicates an accompaniment part of the music piece. The accompaniment data 311 is described in the MIDI format, for example. Accompaniment data 311 is accompanied by reproduction time data indicating a temporal reproduction position when the accompaniment is reproduced. The reproduction time data indicates the time position by an elapsed time (hereinafter referred to as “reproduction elapsed time”) starting from the time when the reproduction of the accompaniment data 311 is started. The accompaniment data 311 corresponds to an example of “music data” according to the present invention.
The reference data 312 is data indicating a standard to be sung, and is described in, for example, a MIDI format. Specifically, the reference data 312 indicates a reference pitch (hereinafter referred to as “reference pitch”) associated with each period of each sound in the music. The period of each sound is shown in association with the elapsed playback time, and in detail, the start and end are indicated by the elapsed playback time. These periods are periods used for evaluating the singing voice (hereinafter referred to as “evaluation period”).
The lyrics data 313 includes data indicating the contents of the lyrics of the music and data indicating the timing for changing the color of the lyrics telop displayed on the stereoscopic image display unit 25.
The image material database 320 stores image data representing the material of the image displayed by the stereoscopic image display unit 25 during singing. Specifically, the image data represents an image such as a character, code, mark, or figure. Is recorded.

Next, functional blocks constructed when the control unit 10 executes a functional program in such a hardware configuration will be described with reference to FIG.
FIG. 2 is a block diagram illustrating a functional configuration of the control unit 10. The control unit 10 includes a reproduction unit 111, a first calculation unit 112, a second calculation unit 113, a specifying unit 114, a trial calculation unit 115, an image generation unit 116, and a display control unit 117.
When the operation data instructing the reproduction of the music is supplied from the operation unit 21, the reproduction unit 111 reproduces the accompaniment data 311 of the music, and accompaniment data 311 and reference data corresponding to the elapsed reproduction time according to the progress of the music. 312 is read. Then, the playback unit 111 supplies the accompaniment data 311 to the sound processing unit 22 to emit the accompaniment sound, and supplies the lyrics data 313 to the display control unit 117 to display the lyrics. The reproduction unit 111 supplies these data so that the accompaniment sound is emitted and the lyrics are displayed in synchronization. Further, while the accompaniment data 311 is being reproduced, the reproduction unit 111 periodically reproduces the reproduction time data and the reference data 312 accompanying the read accompaniment data 311, the first calculation unit 112, the second calculation unit 113, and the image. The data is supplied to the generation unit 116 and the display control unit 117. The reproduction unit 111 corresponds to an example of “reading unit” according to the present invention.

  The 1st calculation part 112 is a means to calculate the evaluation value according to the result which compared the song voice of a singer with the reference pitch, and it operates as follows in detail. The first calculation unit 112 includes the pitch of the singing voice represented by the audio signal supplied from the sound collection unit 23 illustrated in FIG. 1 via the sound processing unit 22, and the reference read and supplied by the reproduction unit 111. The reference pitch indicated by the data 312 is compared, and the difference value is calculated, for example, as a cent value. The first calculation unit 112 calculates the difference value as a positive value if the pitch of the singing voice is lower than the reference pitch, and as a negative value if it is higher. The first calculation unit 112 calculates the difference value every time the reference data 312 is supplied from the reproduction unit 111. And the 1st calculation part 112 calculates what averaged the value of the difference calculated in the evaluation period as an evaluation value. The first calculation unit 112 supplies data indicating the calculated evaluation value to the second calculation unit 113. The first calculation unit 112 supplies data indicating the calculated evaluation value and data indicating the reference pitch compared to the singing voice when calculating the evaluation value to the specifying unit 114 and the trial calculation unit 115.

  When the evaluation value indicated by the supplied data is greater than or equal to the first threshold value, the second calculation unit 113 performs a process of subtracting (decreasing) from the score that is the basis of the evaluation score. The second calculation unit 113 performs this process until the reproduction of the accompaniment data 311 is completed, and calculates the resulting score as a final evaluation score. As described above, the evaluation score increases as the value of the evaluation value increases, that is, as the pitch moves away from the reference pitch, and as the evaluation period is deducted, that is, the evaluation value becomes equal to or higher than the first threshold value. The higher the number of times, the lower. Note that the first threshold is a value indicating the degree to which the pitch difference between the singing voice and the constituent voices is allowed. For example, if the singing is strictly evaluated, the first threshold is reduced, and if the singing is evaluated gently, the first threshold is increased. good. When the accompaniment playback ends, that is, when the playback time data is no longer supplied, the second calculation unit 113 supplies the image generation unit 116 with data indicating the calculated evaluation score.

  The specifying unit 114 is a means for specifying an evaluation period in which the result evaluation score calculated in the future by the first calculation unit 112 is likely to be lowered. Specifically, the specifying unit 114 operates as follows. First, the specifying unit 114 determines whether or not the evaluation value indicated by the supplied data is greater than or equal to the second threshold value. At this time, if the evaluation value calculated for the reference pitch that is compared with the singing voice and the reference pitch with the same pitch is calculated in the past, the specifying unit 114 calculates these evaluation values. It is determined whether the included average value is greater than or equal to the second threshold value. The second threshold value is larger than the first threshold value, and the sound of the singing voice is greatly deviated from the reference pitch, that is, the singer cannot sing well along the reference pitch. It is a value for judging the sound. Similarly to the first threshold value, the second threshold value may be reduced when singing is evaluated strictly, and may be increased when evaluated gently. When the specifying unit 114 determines that any one of the above values is equal to or greater than the second threshold, it is associated with the reference pitch indicated by the data supplied together with the data indicating the evaluation value during the evaluation period indicated by the reference data 312. An evaluation period that is subsequent to the evaluation period and that has a reference pitch common to the evaluation period is specified. The specifying unit 114 supplies data indicating the specified evaluation period (for example, data indicating the elapsed playback time at which the evaluation period starts and the elapsed playback time to end) to the trial calculation unit 115 and the image generation unit 116.

  The trial calculation unit 115 makes a trial calculation of how to output a voice necessary for setting the singing voice in the evaluation period specified by the specification unit 114 to be less than the first threshold. Specifically, if the evaluation value calculated by the first calculation unit 112 is a positive value, that is, if the pitch of the singing voice is lower than the reference pitch, the trial calculation unit 115, for example, this singing Assuming that the voice is “semitone higher”, the evaluation value is calculated under this assumption. This assumption is expressed by whether the pitch of the singing voice is high or low, and its degree (semitone or single tone, etc.). Then, if the estimated evaluation value is less than the first threshold, the trial calculation unit 115 supplies the image generation unit 116 with data indicating the content assumed by the trial calculation (“semitone higher”). Also, if the estimated evaluation value is equal to or greater than the first threshold value, the trial calculation unit 115 performs the calculation assuming that the singing voice is “one note higher” until an evaluation value less than the first threshold is calculated. repeat. The trial calculation unit 115 supplies the image generation unit 116 with data indicating the contents assumed when the evaluation value less than the first threshold is calculated. This assumed content represents the degree of difference between the singing voice and the reference pitch, and is determined according to the evaluation value.

When the data is supplied from the specifying unit 114, the image generation unit 116 reads image data indicating an image corresponding to the evaluation period indicated by the data from the image material database 320, and when the data is supplied from the trial calculation unit 115, Image data indicating an image corresponding to the assumed content indicated by this data is read from the image material database 320. The image according to the assumed content here is also an image according to the evaluation value. That is, the evaluation value is used as a parameter for generating an image, and corresponds to an example of a “parameter” according to the present invention. In each case, the image generation unit 116 generates image data obtained by editing or synthesizing these images according to the reproduction elapsed time indicated by the supplied reproduction time data, and the generated image data is displayed on the display control unit. 117. A specific example of the image generated here will be described later.
The display control unit 117 controls the stereoscopic image display unit 25 to display the image represented by the image data supplied from the image generation unit 116 on the display described above according to the elapsed playback time indicated by the supplied playback time data. Let For example, if the display control unit 117 is an image corresponding to the above-described evaluation period, the display control unit 117 displays the image before the evaluation period starts. The timing at which each image is displayed will be described later.
When data is supplied from the second calculation unit 113, the image generation unit 116 generates image data indicating an image corresponding to the evaluation score indicated by the data, and the display control unit 117 indicates the image data. Display the image on the display. Thereby, the calculated evaluation score is transmitted to the singer.

An image displayed on the display of the stereoscopic image display unit 25 shown in FIG. 1 by the operation of each unit described above will be described.
FIG. 3 is a diagram illustrating an example of a screen displayed on the display. The lyrics telop a is an image showing a character string representing lyrics. The lyrics telop a is obtained when the character string representing the lyrics corresponding to the portion reproduced so far in the accompaniment data 311 shown in FIG. 1 changes from a white character to a black character (changes color). It is displayed so that the position to sing can be understood. In this example, the character string “ABCDE” is color-changed, and an image in which the color change of the character string “F” has progressed halfway is displayed, indicating that the part “F” should be sung now. .
The reference image b is an image showing the reference pitch of the singing voice described above, and in detail, is a bar-shaped image showing the reference pitch of each constituent sound and its evaluation period. The reference image b is displayed so as to be superimposed on the staff, and the time is defined in the direction indicated by the arrow r1 along each line. This direction is the direction in which the time defined in the staff goes, and is hereinafter referred to as “traveling direction r1”. The reference image b represents the reference pitch depending on where it is displayed on the staff, and the evaluation period is represented by the length in the traveling direction r1. The reference image b is displayed based on the reference pitch indicated by the reference data 312 shown in FIG. 1 and the evaluation period associated therewith. In FIG. 3, ten reference images b from b1 to b10 are displayed, and represent evaluation periods from x1 to x10, respectively.
The singing result line c is a line showing the pitch trajectory of the singing voice superimposed on the staff score displayed together with the reference image b, and is indicated by a two-dot chain line in the following figures. Specifically, the singing result line c is a point that the pitch of the voice represented by the audio signal output from the sound collection unit 23 shown in FIG. It is the line which connected in order.

FIG. 4 is a table showing the evaluation value or average value calculated from the singing voice indicated by the singing result line c in FIG. 3 for each pitch. FIG. 4 will be described with reference to FIG. In this table, the pitches are represented from “C” to “G”. In this embodiment, the first threshold value is 20 and the second threshold value is 80. In this table, the relationship between the evaluation value at each pitch and each threshold value is shown.
The pitch “C” is the reference pitch indicated by the reference image b1, and the evaluation value is calculated as “35” as a result of comparing the reference pitch with the pitch indicated by the singing result line c in the evaluation period x1. Has been. In this case, since the evaluation value is equal to or greater than the first threshold value, the evaluation score is deducted, while the evaluation value is less than the second threshold value, and thus the evaluation period is not specified. The pitch “D” is a reference pitch indicated by the reference images b2 and b4. In this case, as a result of comparing the reference pitch with the pitch indicated by the singing result line c in the evaluation periods x2 and x4, the evaluation values are calculated as “5” and “25”, respectively, and the average value is “15”. Is calculated. In this case, since the average value is less than the first threshold value, neither the deduction of the evaluation score nor the evaluation period is specified. The pitch “E” is a reference pitch indicated by the reference image b3. As a result of comparing the reference pitch and the pitch indicated by the singing result line c in the evaluation period x3, the evaluation value is “95”. It is calculated. In this case, since the evaluation value is equal to or greater than the second threshold value, the evaluation score is deducted and the evaluation period is specified. The pitch “F” is a reference pitch whose evaluation value has not yet been calculated in FIG. 3. The pitch “G” is the reference pitch indicated by the reference image b5. As a result of comparing the reference pitch and the pitch indicated by the singing result line c in the evaluation period x5, the evaluation value is calculated as “0”. Has been. In this case, since the evaluation value is less than the first threshold, neither the deduction of the evaluation score nor the evaluation period is specified.
The image displayed according to the evaluation value calculated as described above will be described with reference to FIGS. 5A, 5B, and 5C.

5A, 5B, and 5C are diagrams each illustrating an example of an image displayed in accordance with the calculated evaluation value. On the screen on which these images are displayed, the reference pitch (that is, the pitch) in which the reference pitch and the pitch in the evaluation period x3 in which the evaluation value calculated in FIGS. 3 and 4 is equal to or greater than the second threshold is common. Reference pitch of “E” is indicated by the reference image b18. The reference image b18 shows an evaluation period x18 associated with this reference pitch. The evaluation period x18 starts at time t0.
FIG. 5A shows a screen displayed at time t1 before time T1 from the start of the evaluation period x18 (time t0). In this screen, “KL” in the character string indicating the lyrics is displayed in a color-changed manner.
The image e1 is an image in which a character string “CAUTION!” Is surrounded by a frame, and is displayed according to the evaluation period indicated by the data supplied from the specifying unit 114 described above. Specifically, the image e1 is displayed at a position where the time t1 is defined in the traveling direction r1 when the time t1 before the time T1 from the time t0 when the evaluation period starts. The image e1 is an image for informing the singer that a sound whose pitch has been shifted in the past singing voice, that is, a sound that should be carefully sung (a sound to be noted) will soon appear.

The image e2 is an image displayed according to the assumed content indicated by the data supplied from the trial calculation unit 115 described above. In this example, the image e2 is referred to as “increase semitone” according to the assumed content “semitone higher”. It is an image showing a character string. That is, the image e2 is an image displayed according to the degree to which the pitch of the singing voice is different from the reference pitch. The image e2 is an image displayed according to the evaluation period indicated by the data supplied from the specifying unit 114 described above. In this example, the image e2 is displayed at a position where the evaluation period x18 is defined in the traveling direction r1. ing. The image e2 is a timing at which a sound that is difficult for a singer to sing according to the reference pitch appears, that is, a timing at which the singing voice is likely to be evaluated low (time t0 when the evaluation period x18 starts), and the singing It is an image for telling the person how to sing (singing with a semitone higher). By displaying the images e1 and e2, it is possible to make it easier for the singer to notice that a sound to be sung half a tone higher than before (a sound to be noted) will soon appear.
The time T1 is a time for the singer to prepare for singing the sound whose pitch has shifted, and the singer understands at what timing and how to sing and sings. However, it is desirable that the length is sufficient to measure the timing.

FIG. 5B shows a screen displayed at time t2 before time t0. Time t2 is the time when the evaluation period x17 before the evaluation period x18 starts. In this screen, “KLMNOP” in the character string indicating the lyrics is displayed in a color-changed manner. The image e3 is an image for indicating that the sound to be noted is the next sound, and is an image showing the character string “next!” Displayed at time t2. By displaying the image e <b> 3, the singer can grasp the timing at which a sound to be noted is emitted immediately before the sound.
FIG. 5C shows the screen displayed at time t0. In this screen, “KLMNOPQ” in the character string indicating the lyrics is displayed in a color-changed manner. The image e <b> 4 is an image for indicating that the sound to be noted is now, and is an image indicating a character string “Now!” Displayed at time t <b> 0. That is, since the image e4 is displayed at a timing at which a sound to be watched should be emitted, the singer can visually confirm this timing. As described above, the karaoke apparatus 1 displays the images e1, e2, e3, and e4 to notify the singer of the evaluation period specified by the specifying unit 114 shown in FIG. 2 before the evaluation period starts. To do. These images are displayed by the cooperation of the image generation unit 116, the display control unit 117, and the stereoscopic image display unit 25 shown in FIG. 2, and these units function as “notification means” according to the present invention.

FIG. 6 is a diagram illustrating an example of an image corresponding to the result of calculating the evaluation value. In FIG. 6A, an image f1 indicating a symbol “!” Is shown. By displaying a symbol such as the image f1, it is possible to alert the singer in a shorter time than displaying a character string.
In FIG. 6B, an image f2 showing a character string “semitone” in a white portion of a block arrow and an image f3 showing a character string “1 sound” are shown. The image f2 is displayed so that the direction indicated by the arrow is directed upward in the vertical direction, thereby indicating the content of the assumption “semitone higher”. The image f3 is displayed so that the direction indicated by the arrow is directed downward in the vertical direction, thereby indicating the assumed content of “lower semitone”.
In FIG. 6C, an image f4 in which the character string “Vibrato do your best!” Is shown together with a wavy line, and an image f5 in which the distance between the wavy lines of the image f4 is close. These wavy lines represent the vibration of the sound trembling with vibrato, and represent the amplitude and wavelength of the sound to be vibratoed, respectively. It should be noted that the amplitude and the wavelength do not have to be expressed strictly, and may be transmitted to the extent that it is “more or less”. As shown in FIGS. 6 (b) and 6 (c), by indicating the content to be conveyed with a graphic or a picture, the content can be conveyed to the singer in a shorter time than indicated by a character string.
FIG. 6D shows images f6, f7, and f8 that are displayed so that the image e2 shown in FIGS. 5A, 5B, and 5C protrudes in a three-dimensional manner. In FIG. 6D, the directions are indicated by orthogonal x-axis, y-axis, and z-axis, the horizontal direction of the display is the x-axis direction, the vertical direction is the y-axis direction, and the direction perpendicular to the display surface of the display is the z-axis direction. Indicated. Further, in FIG. 6D, the extent to which each image appears to protrude three-dimensionally is indicated by deviations z6, z7, z8 (z6 <z7 <z8) in the direction indicated by the arrow z from the non-stereo image. It is assumed that the larger the is, the more popping out in three dimensions. These images are displayed in the order of images f6, f7, and f8 as the timing for generating a sound to be noted approaches. Thereby, the singer can know the timing at which the time t0 approaches even if the images e1, e3, and e4 shown in FIGS. 5A, 5B, and 5C are not displayed. In FIG. 6 (d), the entire image is displayed so as to pop out. However, only the portion of the character string may be popped out, or the characters may be popped out one by one as time passes. Also good.
These images shown in FIG. 6 correspond to examples of “images according to parameters” according to the present invention. Each image shown in FIG. 6D corresponds to an example of an “image” according to the present invention displayed “changing the aspect of a stereoscopic image according to a parameter”.

[Modification]
The above-described embodiment is merely an example of implementation of the present invention, and various applications and modifications are possible as follows, and can be combined as necessary.

(Modification 1)
In the control unit of the karaoke apparatus according to the present invention, the evaluation value calculated in the evaluation period in which the start timing is displayed is smaller than the evaluation value (or the average value thereof) used when specifying the evaluation period. If so, the evaluation of this singing voice may be further enhanced. For example, in this case, the control unit may add a predetermined score to the evaluation score.
FIG. 7 is a diagram illustrating a functional block diagram of functions that operate in the process in which the control unit 10a according to the present modification adds an evaluation score. Below, it demonstrates centering on a different point from embodiment mentioned above. The control unit 10a includes a first calculation unit 112a, a second calculation unit 113a, a specifying unit 114a, an image generation unit 116, and a change unit 118. The first calculation unit 112a supplies the change unit 118 with data indicating the calculated evaluation value and data indicating the reference pitch compared with the singing voice when the evaluation value is calculated. The second calculation unit 113a supplies the calculated evaluation score to the change unit 118. The specifying unit 114a supplies data indicating the specified evaluation period to the changing unit 118.
The changing unit 118 evaluates according to the difference between the evaluation value calculated by the first calculating unit 112a during the evaluation period specified by the specifying unit 114a and the evaluation value used when the specifying unit 114a specifies the evaluation period. Change the point. For example, the first calculation unit 112a calculates an evaluation value during the evaluation period x3 shown in FIG. 3, and the specifying unit 114a evaluates the evaluation period associated with the reference pitch that is common to the reference pitch of the evaluation period x3. x18 is specified. The change unit 118 compares the evaluation value calculated in the evaluation period x3 (referred to as “first evaluation value” for convenience of description) with the evaluation value calculated by the first calculation unit 112a in the specified evaluation period x18. (Similarly, “second evaluation value”) is small, a predetermined value is added (added) to the evaluation score. The changing unit 118 supplies data indicating the evaluation points thus changed to the image generating unit 116. Then, each unit after the image generation unit 116 operates, and an image representing the evaluation point indicated by this data is displayed on the display.

  Thereby, the singer can improve an evaluation score efficiently by singing well in the displayed evaluation period, and can recover the deduction by the past singing voice. And the karaoke apparatus can make a singer pay more attention to this image compared with the case where the said evaluation score is not changed by enhancing the effect that the displayed image improves the evaluation score. . In addition, in this modification, when the evaluation value is large on the contrary, the evaluation of the singing voice may be further lowered, for example, a predetermined score may be subtracted from the evaluation score. Thereby, the karaoke apparatus can attract more attention of the singer with respect to this image by deducting extra points if attention is not paid to the image to be displayed. In the above-described embodiment, the larger the evaluation score, the better the performance was, but the smaller the evaluation score, the better the performance, the change unit 118 may indicate the evaluation score. You can deduct instead of adding points. In any case, the changing unit 118 may change the evaluation score according to the difference between the first evaluation value and the second evaluation value.

(Modification 2)
In the case of the first modification described above, when the second evaluation value is smaller than the first evaluation value, that is, when the pitch difference of the singing voice is improved, an image for informing that is displayed. You may let them. For example, in this case, the karaoke apparatus may reduce the images e2 and e4 shown in FIG. In addition, in this case, the karaoke apparatus may display an image (for example, a character string such as “I sang well”) to indicate that the pitch deviation has been improved, in addition to these images. good. Thereby, the singer can confirm that the evaluation score has improved, for example, by singing according to the content shown in the image e2 (“To raise semitones”). In addition, in embodiment mentioned above, it showed that it was able to sing well, so that evaluation value is small, but it may show that it was able to sing well, so that evaluation value is large, In that case, a karaoke apparatus is 2nd evaluation value. When is larger than the first evaluation value, an image for indicating that may be displayed. In any case, the karaoke apparatus may display an image corresponding to the difference between the first evaluation value and the second evaluation value. That is, the “difference” here is used as a parameter for generating an image, and corresponds to an example of a “parameter” according to the present invention.

(Modification 3)
The control unit of the karaoke apparatus according to the present invention is not limited to the pitch and may use various types of standards. For example, the control unit may use volume or sound length as a reference, or may use a singing technique such as “vibrato” or “fall” as a reference.
In the case where “vibrato” is used as a reference, the control unit, in an evaluation period longer than a predetermined time (hereinafter referred to as “vibrato period”), exceeds the reference pitch associated with the vibrato period. When the singing voice repeats a high pitch and a low pitch, the evaluation value is calculated as having been vibratoed. Specifically, the control unit calculates a smaller evaluation value as the repetition period and amplitude are closer to values predetermined for each. Then, the control unit, when there is no vibrato in the vibrato period (that is, there is no repetition) or the vibrato is poor (that is, the calculated evaluation value is equal to or greater than the second threshold value), the vibrato period that appears next It is advisable to display “Caution on vibrato” immediately before. Note that the control unit may use a known technique such as the technique described in Japanese Patent Application Laid-Open No. 2008-268369 for the process of evaluating the vibrato.
In the case of using “fall” as a reference, the control unit uses a reference pitch associated with the fall period in a predetermined evaluation period to be fallen (hereinafter referred to as “fall period”). Also, when the pitch of the singing voice changes from a pitch higher than a predetermined cent value to a reference pitch, an evaluation value is calculated as having fallen. In this case, the control unit may calculate the evaluation value smaller as the pitch change is larger. The control unit may display “let's fall” immediately before the next fall period. Note that the control unit may use a known technique such as the technique described in Japanese Patent Application Laid-Open No. 2008-225115 for the process of evaluating the fall.

(Modification 4)
When the evaluation value calculated in a certain evaluation period is equal to or greater than the second threshold, the control unit of the karaoke apparatus according to the present invention compares the reference (pitch in the above-described embodiment) compared when calculating the evaluation value. May specify the evaluation period using different types of criteria. Further, the control unit may specify the evaluation period by using the length of the evaluation period or the difference between the standard corresponding to the evaluation period and the standard corresponding to the immediately preceding evaluation period. The reference, length, difference, and the like used here are all determined in accordance with the evaluation period, and are common in that they represent the characteristics of the evaluation period. That is, when the evaluation value is greater than or equal to the second threshold value, the control unit specifies an evaluation period having a feature common to the evaluation period for which the evaluation value is calculated.
For example, it is assumed that whether the length of the evaluation period is less than a certain length or more than the length is a feature of the evaluation period. That is, the evaluation period is divided into a short period and a long period according to this feature. In this case, if the calculated evaluation value is equal to or greater than the second threshold, for example, if the evaluation period for which the evaluation value is calculated is long, the control unit is a period subsequent to the evaluation period, More evaluation periods, that is, evaluation periods having characteristics in common with the evaluation period for which the evaluation value is calculated are specified. As a result, the control unit responds to the sound that a “long sound” sound appears for a singer who, for example, has a long evaluation period, that is, a sound that has a long sound length and cannot sing as well as the reference pitch. You can tell before the period to start.

(Modification 5)
The control unit of the karaoke apparatus according to the present invention determines the evaluation period when the evaluation values having the same characteristics are calculated in a plurality, and in the above-described embodiment, the average value is equal to or greater than the second threshold value. Although specified, if the calculated evaluation value is greater than or equal to the second threshold, the evaluation period may be specified each time. Further, the control unit may always specify the evaluation period if the largest evaluation value among the calculated evaluation values is equal to or greater than the second threshold value. In this case, the calculated evaluation value is further determined to be the first threshold value. If it is less than that, the operation of always specifying the evaluation period may be stopped thereafter. In any case, the control unit specifies the evaluation period when the calculated evaluation value satisfies a predetermined condition.

(Modification 6)
The control unit of the karaoke apparatus according to the present invention may calculate a plurality of evaluation points by comparing each of a plurality of different standards with respect to the singing voice in parallel. When different evaluation periods are specified for different types of criteria as a result of calculating a plurality of evaluation values, the control unit may display an image corresponding to each evaluation period on the display. At that time, the control unit may emphasize and display the evaluation period specified by the kind of criterion having a small calculated evaluation value, for example, may be displayed so as to appear to protrude greatly in three dimensions. Thereby, the singer can know the type of reference whose evaluation value is lower, and can focus on improving the effective type of reference in order to improve the evaluation score. Note that the control unit may display the image so that it appears to be greatly retracted three-dimensionally instead of displaying the image so as to protrude greatly in three dimensions in the above example. What is necessary is just to change and display the aspect of a stereo image according to a value. These evaluation values correspond to examples of “parameters” according to the present invention. Note that the form of the three-dimensional image referred to here may be expressed by varying the position of the entire image in the vertical direction of the display surface of the display, or by varying the size of the relief of the three-dimensional object represented by the image in that direction. It may be expressed as

(Modification 7)
In the karaoke apparatus according to the present invention, the stereoscopic image may be displayed in various ways. For example, the karaoke apparatus displays an image displayed so as to pop out three-dimensionally on the display by shifting the size or position in the horizontal direction (x-axis direction) or vertical direction (y-axis direction) of the display. May be. Hereinafter, the image f6 shown in FIG. 6D will be described as an example.
FIG. 8 is a diagram illustrating an example of an image displayed according to the evaluation value according to the present modification. In FIG. 8A, the length in the x-axis direction and the length in the y-axis direction are changed as the distance in the z-axis direction from the non-stereo image changes to z6, z9, and z10 (z6 <z9 <z10). The images f6, f9, and f10 in which are changed. The images f6, f9, and f10 have lengths in the x-axis direction of x6, x9, and x10 (x6 <x9 <x10), respectively, and lengths in the y-axis direction are y6, y9, and y10 (y6 <y9 <y10), respectively. These images appear to pop out with the passage of time, and the characters are displayed in large size, so that the karaoke device makes it easier for the singer to notice these images and does not display the character string in a large size. Compared to the case, the contents (that is, character strings) conveyed by these images can be easily recognized.
In FIG. 8B, the position in the x-axis direction and the position in the y-axis direction change as the distance in the z-axis direction with the non-stereo image changes to z6, z11, and z12 (z6 <z11 <z12). Images f6, f11, and f12 are shown. The image f11 is an image that is shifted from the non-stereo image by a distance z11 in the z-axis direction, shifted by a distance x11 in the positive x-axis direction, and shifted by a distance y11 in the negative y-axis direction. The image f12 is an image that is shifted from the non-stereo image by a distance z12 in the z-axis direction, shifted by a distance y12 in the negative x-axis direction, and shifted by a distance y12 in the positive y-axis direction. . These images appear to jump out over time and appear to swing in the diagonal direction of the display. Thereby, compared with the case where the karaoke apparatus does not change the position of an x-axis direction and a y-axis direction, a singer can make it easy to notice these images.

(Modification 8)
In the present invention, the evaluation value may be calculated by various methods. In the above-described embodiment, the first calculation unit 112 calculates the average of the above-described difference values calculated during the evaluation period as the evaluation value. However, for example, the first calculation unit 112 may calculate the total of these values. Of these values, the ratio of those that are equal to or greater than the first threshold value may be calculated as the evaluation value. In any case, the first calculator 112 may calculate an evaluation value corresponding to the result of comparing the pitch of the singing voice compared in the above-described embodiment with the reference pitch.

(Modification 9)
In the present invention, the user may be able to select the type of reference for the singing voice to be compared when calculating the evaluation value. For example, the karaoke device displays a reference type of singing voice that can be compared on the display, and calculates the evaluation value by comparing the singing voice indicated by the reference data with respect to the type selected by the operation of the operation unit. It ’s fine. Thereby, the singer can practice while confirming the timing at which a sound that is not suitable for singing according to the standard is selected by selecting the type of the standard that the singer wants to practice.

(Modification 10)
In the karaoke apparatus according to the present invention, the time at which the singer should sing or the position at which the singer should sing may be specified not only by the accompaniment sound but also by an image or the like. For example, in the above-mentioned embodiment, as shown in FIG. 3, since the boundary where the color changes by changing the color of the lyrics telop a is designated as the current position to be sung, Even if there is no, you can know where to sing. Further, the present invention is not limited to this, and a mark indicating the currently reproduced position may be displayed on the staff shown in FIG. 3, and the position to be sung may be designated by moving in the direction of the arrow r1. The “reproduction time data”, “lyric data 313”, and the data for displaying the mark according to this modification according to the above-described embodiment are all data for specifying the position where the music should be sung when reproduced. This corresponds to an example of “position designation data” according to the present invention.

(Modification 11)
The control unit according to the present invention is not limited to the method described in the above-described embodiment, and may calculate the evaluation score by various methods. For example, when the evaluation value calculated by the control unit is less than or equal to the first threshold value, two points are added, and when the evaluation value is less than or equal to the second threshold value, one point is added, and the total is used as the evaluation point. May be. The evaluation period is the length of each constituent sound, but it may be a different period, for example, a certain time such as 1 second or 2 seconds, a period such as 1 beat, 2 beats, or 1 measure, 1 phrase Such a period may be set as the evaluation period, or the length of the evaluation period may be set by the user by operating the operation unit 21 or the like.

(Modification 12)
The control unit according to the present invention is not limited to the method described in the above-described embodiment, and may specify the evaluation period by various methods. For example, in the above-described embodiment, the control unit specifies the evaluation period when the evaluation value is equal to or greater than the second threshold value. However, when the evaluation value is equal to or greater than the first threshold value, It is good also as being in various ranges, such as the case where it is 1 threshold or more and less than 2nd threshold. Moreover, you may specify a control part, when smaller than a 2nd threshold value or a 1st threshold value. In this case, the specified evaluation period is a period in which the singing voice is close to the reference pitch, that is, the singing sound having the same pitch as the sound that the singer sang well along the reference pitch. It is. Therefore, if the control unit displays an image indicating that the singer sang well (for example, an image such as a character string or a portrait such as “This sound was perfect” or “You are the eighteenth”). Good. Thereby, the singer can know the timing of singing the sound that he sang well, and can be prepared with awareness of singing as before. In any case described above, the control unit may specify the evaluation period when the evaluation value satisfies a predetermined condition. Thereby, the karaoke apparatus can tell the singer during the singing the timing at which singing can be performed with reference to the result of evaluating the singing voice.

(Modification 13)
In the embodiment described above, the karaoke apparatus according to the present invention includes means for displaying a stereoscopic image (stereoscopic image display unit 25). However, the present invention is not limited to this, and means for displaying a two-dimensional image, for example, You may provide the image display part which has a display which can display a two-dimensional image. This image display unit corresponds to an example of a “display unit” according to the present invention. In this case, the image generation unit may generate an image that appears three-dimensionally as shown in FIG. 6D as a two-dimensional image using a perspective method. Further, in the present invention, it is possible to display only a planarly represented image without displaying a stereoscopically visible image. In this case, the image can be changed by changing the size, color, or shape. You can adjust how easy it is to be aware of singers. For example, as the timing at which the above-mentioned sound to be noted appears approaches, the image may be changed from a small image to a large image, or the color of the image may be changed from an achromatic color to a chromatic color.

(Modification 14)
The program according to the present invention is provided in a form recorded on a recording medium such as an optical disk, or is provided in a form such that it is downloaded to a computer via a network such as the Internet, and is installed and made available. It is also possible to do.

(Modification 15)
In the embodiment described above, the display for alerting the singer is one note before the note to be noted, but instead of this, it may be two notes before or one beat. In short, it may be set as appropriate so that the singer can easily grasp the timing of the sound to be noted. If the next measure or phrase contains a note to be noted, a warning may be displayed at the start of the measure or at the end of the measure immediately before the measure. Furthermore, a character or an image indicating that “how many notes of which measure name is noteworthy” or “the first note of rust is noteworthy” may be displayed.

(Modification 16)
In the above-described embodiment, the alert is displayed on the display device, but instead, at the timing to alert, the sound processing unit 22 is controlled to emit a sound from the sound emitting unit 24. The vibration part 40 may be provided as shown by a broken line in FIG. 1, and the vibration part 40 may be vibrated at a timing to be alerted to notify the singer. Note that the vibration unit 40 may be incorporated in the housing of the sound collection unit 23. Moreover, you may make it alert | report to a singer simultaneously by combining an image and a sound. In this case, the karaoke apparatus 1 may notify a singer by operating a plurality of devices such as the stereoscopic image display unit 25 and the vibration unit 40 simultaneously or continuously.

DESCRIPTION OF SYMBOLS 1 ... Karaoke apparatus 10, 10a ... Control part, 21 ... Operation part, 22 ... Sound processing part, 23 ... Sound collection part, 24 ... Sound emission part, 25 ... Three-dimensional image display part, 30 ... Memory | storage part, 40 ... Vibration 111, reproduction unit 112, 112a ... first calculation unit 113, 113a ... second calculation unit 114, 114a ... identification unit 115 ... trial calculation unit 116 ... image generation unit 117 ... display control unit 118 ... change unit, 310 ... music database, 311 ... accompaniment data, 312 ... reference data, 313 ... lyrics data, 320 ... image material database

Claims (8)

Storage means for storing music data indicating a music and reference data indicating a reference associated with each of the periods corresponding to each sound in the music;
Reading means for reading the music data and the reference data according to the progress of the music;
First calculation means for calculating an evaluation value according to a result of comparing the singing voice indicated by the audio signal supplied from the sound pickup means and the reference indicated by the read reference data;
A specifying means for specifying a period that is a period subsequent to the period and having characteristics common to the period when the evaluation value calculated by the first calculation unit is a period that satisfies a predetermined condition; ,
Informing means for informing the period specified by the specifying means before the period starts;
Second calculation means for calculating an evaluation score according to the evaluation value calculated by the first calculation means;
Calculated by the second calculating means according to the difference between the evaluation value calculated by the first calculating means during the period specified by the specifying means and the evaluation value used when the specifying means specifies the period A singing support device comprising: a changing means for changing the evaluated score. Storage means for storing music data indicating a music and reference data indicating a reference associated with each of the periods corresponding to each sound in the music;
Reading means for reading the music data and the reference data according to the progress of the music;
First calculation means for calculating an evaluation value according to a result of comparing the singing voice indicated by the audio signal supplied from the sound pickup means and the reference indicated by the read reference data;
A specifying means for specifying a period that is a period subsequent to the period and having characteristics common to the period when the evaluation value calculated by the first calculation unit is a period that satisfies a predetermined condition; ,
An informing means for informing the period specified by the specifying means before the period starts ;
Equipped with a,
The notification unit includes a display unit and a display control unit that controls the display unit, and the display control unit includes the evaluation value calculated by the first calculation unit during the period specified by the specifying unit, and the specifying unit. A singing support apparatus characterized in that a difference from the evaluation value used when the means specifies the period is used as a parameter, and an image corresponding to the parameter is displayed . Storage means for storing music data indicating a music and reference data indicating a reference associated with each of the periods corresponding to each sound in the music;
Reading means for reading the music data and the reference data according to the progress of the music;
First calculation means for calculating an evaluation value according to a result of comparing the singing voice indicated by the audio signal supplied from the sound pickup means and the reference indicated by the read reference data;
In a case where the evaluation value calculated by the first calculation means is a first period that satisfies a predetermined condition, a reference that is subsequent to the first period and compared when calculating the evaluation value Means for identifying a period in which different types of features are in common with the first period;
A singing support apparatus comprising: an informing means for informing the period specified by the specifying means before the period starts. The singing support apparatus according to claim 3, wherein the different type of characteristic is a difference in the reference corresponding to a length of a period or a period immediately before. The notification unit includes a display unit and a display control unit that controls the display unit, and the display control unit uses the evaluation value calculated by the first calculation unit as a parameter, and an image according to the parameter, 5. The singing support apparatus according to claim 1, wherein the display unit displays the period before the period specified by the specifying unit using the evaluation value is started. The first calculation means calculates an evaluation value according to a result of comparing the singing voice and each of a plurality of the different standards.
The specifying means specifies the period for each of a plurality of the criteria,
The notification means includes display means and display control means for controlling the display means, and the first calculation means is compared with a reference that is common to a reference and a type associated with a period specified by the specification means. 6. The singing support apparatus according to claim 1, wherein the evaluation value calculated by the step is used as a parameter, and an image corresponding to the parameter is displayed. The display means is capable of displaying an image as a stereoscopic stereoscopic image,
The singing support apparatus according to claim 5, wherein the display control unit displays the image three-dimensionally on the display unit. The singing support apparatus according to claim 7, wherein the display control unit causes the display unit to display the image by changing a mode of the stereoscopic image according to the parameter.

Images