JP6389128B2 - Karaoke device and karaoke display control program - Google Patents

Description

  The present invention relates to a karaoke apparatus having a function of evaluating an input sound signal. Specifically, the present invention relates to a karaoke apparatus that displays an effect image suitable for an evaluation result of an input sound signal on a display unit.

  Conventionally, various devices for evaluating user operations and displaying images representing the evaluation have been proposed. For example, the game system described in Patent Literature 1 evaluates the player's operation based on the input timing and the evaluation timing, and displays the effect image in association with the target character based on the evaluation result. The effect image to be displayed is GOOD or BAD characters. When the evaluation result is good, GOOD is displayed, and when it is bad, BAD is displayed as the evaluation result.

JP 2010-88688

  In general, a karaoke apparatus has a function of evaluating an input sound signal. Consider a case in which the evaluation result display technique disclosed in Patent Document 1 is adopted in a karaoke apparatus. In this case, based on the evaluation result of the sound signal, it is conceivable to display GOOD on the background image as an effect image when the evaluation result is good and BAD as the effect image when the evaluation result is bad.

  However, in the karaoke apparatus adopting the technique disclosed in Patent Document 1, since either one of the two types of characters GOOD and BAD is displayed as an effect image of the evaluation result, the display contents of the evaluation result Becomes monotonous. For this reason, the singer stops paying attention to the change in his / her evaluation result during the singing, resulting in less enjoyment of the singing. In particular, when the singer is a young child, simply displaying the character evaluation result may cause the user to get bored with the singing.

  Therefore, the present invention has been made in view of the above-described problems, and the object of the present invention is to select a user's effect from a plurality of effect images set for each of the evaluation-related images displayed on the display unit. Provided is a karaoke apparatus that alerts a user to a change in an evaluation result by determining an effect image related to the evaluation result and displaying the effect image on a display unit.

  In order to achieve the above object, a karaoke apparatus according to the first aspect of the present invention is input by a reproducing means for reproducing music, a music signal representing the music reproduced by the reproducing means, and an input means. An evaluation calculation means for comparing the sound signal and calculating an evaluation score of the sound signal, an evaluation determination means for determining whether or not the evaluation score calculated by the evaluation calculation means satisfies the first condition, and an evaluation related Evaluation related image storage means for storing a plurality of image data, and at least one evaluation related image data is read from the evaluation related image storage means, and an evaluation related image is displayed on the display unit based on the read evaluation related image data A plurality of first-type effect image data and second-type effect image data, which are display effect control data to be displayed and effect image data set in the evaluation-related image data. The first type of effect image data or the second type of effect image data is set in the effect image storage means and the evaluation related image data representing the evaluation related image displayed on the display unit, and Effect image determination means for determining whether or not a plurality of evaluation related images based on the evaluation related image data set with the effect image data are displayed on the display unit; and the evaluation related information set with the effect image data When the effect image determination means determines that a plurality of the evaluation related images represented by the image data are displayed, a second condition is selected from the plurality of effect image data respectively set for the plurality of evaluation related image data. An effect image determination means for determining one effect image data based on the above, and when the evaluation determination means determines that the first condition is satisfied, When the effect image determining unit determines that a plurality of the evaluation related images represented by the evaluation related image data in which the first type of effect image data is set are displayed, based on the second condition, When the effect image determination means determines one first type effect image data and the evaluation determination means determines that the first condition is not satisfied, and the second type effect image data is set. When the effect image determining means determines that a plurality of the evaluation related images represented by the evaluation related image data are displayed, the effect image determining means has one of the second types of the effect image determining means based on the second condition. The effect image data is determined, and the display control means reads the determined effect image data from the effect image storage means, and based on the read effect image data And it displays the result image on the display unit.

  The karaoke apparatus according to claim 2, wherein the display control means reads evaluation-related image data for each predetermined section of the musical performance from the evaluation-related image storage means, and based on the read evaluation-related image data. At least one evaluation-related image is displayed on the display unit, and when a predetermined number of evaluation-related images are displayed on the display unit, the predetermined number of evaluation-related images displayed on the display unit The display of at least one evaluation-related image is terminated.

  4. The karaoke apparatus according to claim 3, wherein the display control means is configured to display the specific effect image displayed on the display unit when a predetermined time has elapsed since the specific effect image was displayed on the display unit. And the display of the specific evaluation related image displayed based on the evaluation related image data in which the effect image data representing the specific effect image is set is terminated.

  5. The karaoke apparatus according to claim 4, wherein the evaluation calculating unit compares the music signal with the sound signal, calculates an evaluation score of the sound signal for each predetermined section of the music performance, and displays the display. When the time corresponding to a predetermined section of the music performance has elapsed as the predetermined time after the specific effect image is displayed on the display unit, the control means includes the specific effect image and the specific evaluation-related image The display of is terminated.

  6. The karaoke apparatus according to claim 5, wherein the display control means has a predetermined number of evaluations displayed on the display unit when the evaluation-related images displayed on the display unit reach a predetermined number. The display of the evaluation related image displayed first among the related images is terminated.

  The karaoke apparatus according to claim 6, wherein the evaluation calculation unit compares the music signal with the sound signal, calculates an evaluation score of the sound signal for each predetermined section of the music performance, and performs the evaluation. The determination means compares the current evaluation score calculated in the current predetermined section by the evaluation calculation means with the previous evaluation score calculated in the previous predetermined section, and the current evaluation score is equal to or higher than the previous evaluation score. Is determined as the first condition.

  8. The karaoke apparatus according to claim 7, wherein the effect image storage means is the first type related to a good evaluation result in which the current evaluation score calculated by the evaluation calculation means is equal to or higher than the previous evaluation score. A plurality of effect image data and the second type of effect image data related to a bad evaluation result in which the current evaluation score calculated by the evaluation calculation means is less than the previous evaluation score are stored.

  In the karaoke apparatus according to the invention described in claim 8, the evaluation determination means determines, as the first condition, that the evaluation score calculated by the evaluation calculation means is equal to or greater than a predetermined threshold score.

  10. The karaoke apparatus according to claim 9, wherein the effect image storage means is the first type related to a good evaluation result in which the evaluation score calculated by the evaluation calculation means is equal to or higher than a predetermined threshold score. And a plurality of second-type effect image data related to a bad evaluation result in which the evaluation score calculated by the evaluation calculation means is less than a predetermined threshold score.

  The karaoke apparatus according to claim 10, wherein the effect image determination means includes a content indicated by at least one of a plurality of types of user-related data set in the effect image data as the second condition. Judge as.

  The karaoke apparatus according to claim 11, wherein the effect image is an image including a figure that is conceptually related to the evaluation-related image, and the effect image storage means includes a plurality of different effect images that are conceptually different. A plurality of the effect image data to be represented is stored.

  According to a twelfth aspect of the present invention, there is provided a program according to the present invention, which compares a reproduction means for reproducing music, a music signal representing a music reproduced by the reproduction means, and a sound signal input by the input means. Evaluation calculation means for calculating the evaluation score of a signal, evaluation related image storage means for storing a plurality of evaluation related image data, and effect image data set in the evaluation related image data, the first type of effect image data And an effect image storage means for storing a plurality of second-type effect image data, wherein the evaluation score calculated by the evaluation calculation means satisfies the first condition. An evaluation determination step for determining whether or not there is at least one evaluation related image data from the evaluation related image storage means, and the read evaluation related image A display control step for displaying an evaluation-related image on the display unit based on the data, and the evaluation-related image data representing the evaluation-related image displayed on the display unit, the first type of effect image data, or the first An effect image determination step for determining whether or not two types of effect image data are set and a plurality of evaluation related images based on the evaluation related image data for which the effect image data is set are displayed on the display unit; When the effect image determining step determines that a plurality of the evaluation related images represented by the evaluation related image data in which the effect image data is set are displayed, the plurality of the evaluation related image data are set respectively. An effect image determining step for determining one effect image data based on a second condition from the plurality of effect image data, A plurality of evaluation related images represented by the evaluation related image data in which the first type of effect image data is set, and when the evaluation determining step determines that the first condition is satisfied. If it is determined by the effect image determination step that it is displayed, the effect image determination step determines one first type of effect image data based on the second condition, and does not satisfy the first condition And the effect image determining step determines that a plurality of the evaluation related images represented by the evaluation related image data in which the second type of effect image data is set are displayed. If it is determined, the effect image determination step determines one second type of effect image data based on the second condition, and the display Please step reads out effect image data the determined from the effective image storing means, thereby the effect image on the basis of the effect image data read is displayed on the display unit.

  In the invention according to claim 1, the effect image determination means sets the first type effect image data or the second type effect image data in the evaluation related image data representing the evaluation related image displayed on the display unit. In addition, it is determined whether or not a plurality of evaluation related images based on the evaluation related image data in which the effect image data is set are displayed on the display unit. The effect image determining means is set to each of the plurality of evaluation related image data when the effect image determining means determines that a plurality of evaluation related images represented by the evaluation related image data set with the effect image data are displayed. One effect image data is determined based on the second condition from the plurality of effect image data. The effect image determining unit displays a plurality of evaluation related images represented by the evaluation related image data in which the first type of effect image data is set, when the evaluation determining unit determines that the first condition is satisfied. If it is determined by the effect image determination means, one first type of effect image data is determined based on the second condition. The effect image determining means displays a plurality of evaluation related images represented by the evaluation related image data in which the second type of effect image data is set when the evaluation determining means determines that the first condition is not satisfied. Is determined by the effect image determination means, one second type of effect image data is determined based on the second condition. The display control means displays the effect image on the display unit based on the determined effect image data. As a result, compared to displaying the same effect image on the display unit, the effect image to be displayed is changed by determining the effect image from a plurality of types of effect images and displaying it on the display unit. Therefore, the display content does not become monotonous, and the user can call attention to changes in his / her evaluation results.

  In the invention according to claim 2, the display control means displays at least one evaluation related image on the display unit based on the evaluation related image data for each predetermined section of the music performance, and the evaluation related displayed on the display unit. When the predetermined number of images is reached, the display of at least one evaluation related image from the predetermined number of evaluation related images displayed on the display unit is terminated. As a result, when the predetermined number of evaluation-related images has been reached, the display of at least one evaluation-related image ends, and a new evaluation-related image is displayed for each predetermined section. It is possible to sing while visually enjoying evaluation-related images that change every predetermined interval on the screen.

  In the invention according to claim 3, the display control means includes the specific effect image displayed on the display unit when the predetermined time has elapsed since the specific effect image was displayed on the display unit, and the specific effect image. The display with the specific evaluation-related image displayed based on the evaluation-related image data for which the effect image data representing is set is ended. As a result, the effect image and the evaluation related image displayed on the screen of the display unit change every time a predetermined time has elapsed since the specific effect image related to the evaluation result is displayed on the display unit. The display content of the evaluation result does not become monotonous, and the user can call attention to a change in his / her evaluation result.

  In the invention according to claim 4, the evaluation calculation means compares the music signal with the sound signal, and calculates the evaluation score of the sound signal for each predetermined section of the music performance. The display control means ends the display of the specific effect image and the specific evaluation-related image when a time corresponding to a predetermined section of the music performance has elapsed as a predetermined time after the specific effect image is displayed on the display unit. . As a result, since an effect image different from the effect image related to the evaluation result is displayed for each predetermined section, the display content of the user's own evaluation result does not become monotonous, and the user changes to his / her evaluation result. You can call attention.

  In the invention according to claim 5, when the display-related means has reached a predetermined number of evaluation-related images displayed on the display unit, the display control means first of the predetermined number of evaluation-related images displayed on the display unit. The display of the displayed evaluation related image is terminated. As a result, when the evaluation-related images reach a predetermined number, the display of the evaluation-related images that are displayed first ends, so that the user can visually enjoy the evaluation-related images that change for each predetermined section. I can sing.

  In the invention according to claim 6, the evaluation calculation means compares the music signal with the sound signal, and calculates an evaluation score of the sound signal for each predetermined section of the music performance. The evaluation judging means compares the current evaluation score calculated in the current predetermined section by the evaluation calculating means with the previous evaluation score calculated in the previous predetermined section, and the current evaluation score is equal to or higher than the previous evaluation score. Is determined as the first condition. As a result, the user can easily recognize the result of whether or not the current evaluation score is equal to or higher than the previous evaluation score by viewing the displayed effect image.

  The effect image storage means includes the first type of effect image data related to a good evaluation result in which the current evaluation score calculated by the evaluation calculation means is equal to or higher than the previous evaluation score, and the evaluation calculation. A plurality of second-type effect image data related to a bad evaluation result whose current evaluation score calculated by the means is less than the previous evaluation score is stored. As a result, the user can easily recognize the result of whether or not the current evaluation score is equal to or higher than the previous evaluation score from the type of the effect image by looking at the displayed effect image.

  In the invention according to claim 8, the evaluation determination means determines as a first condition that the evaluation score calculated by the evaluation calculation means is equal to or greater than a predetermined threshold score. As a result, the user can easily recognize the result of whether or not the effect image displayed on the display unit is greater than or equal to a threshold value determined in advance by viewing the effect image displayed. .

  In the invention according to claim 9, the effect image storage means includes the first type of effect image data related to a good evaluation result in which the evaluation score calculated by the evaluation calculation means is equal to or higher than a predetermined threshold score, and evaluation A plurality of second-type effect image data related to a bad evaluation result in which the evaluation score calculated by the calculation means is less than a predetermined threshold score is stored. As a result, with respect to the result of whether or not the effect image displayed on the display unit is equal to or higher than a predetermined threshold score, the user can determine the effect image type by viewing the displayed effect image. It can be easily recognized.

  In the invention described in claim 10, the effect image determination means determines, as the second condition, the content indicated by at least one of the plurality of types of user related data set in the effect image data. As a result, since the effect image related to the user is displayed on the display unit, the user can easily understand the contents of the effect image and can sing while enjoying the effect image visually. .

  In the invention described in claim 11, the effect image is an image including a figure that is conceptually related to the evaluation-related image, and the effect image storage means stores a plurality of effect image data representing a plurality of types of effect images that are conceptually different. Remember. As a result, the user who is singing while watching the evaluation-related image can easily display the effect image in association with the evaluation-related image by displaying the effect image that is conceptually related to the evaluation-related image. Can be recognized.

  In the twelfth aspect of the invention, the evaluation determination step determines whether or not the evaluation score calculated by the evaluation calculation means satisfies the first condition. In the display control step, at least one evaluation related image data is read from the evaluation related image storage means, and the evaluation related image is displayed on the display unit based on the read evaluation related image data. In the effect image determination step, the first type effect image data or the second type effect image data is set in the evaluation related image data representing the evaluation related image displayed on the display unit, and the effect image data is It is determined whether or not a plurality of evaluation related images based on the set evaluation related image data are displayed on the display unit. The effect image determination step is set for each of the plurality of evaluation related image data when the effect image determination step determines that a plurality of evaluation related images represented by the evaluation related image data for which the effect image data is set are displayed. One effect image data is determined based on the second condition from the plurality of effect image data. In the effect image determination step, when it is determined by the evaluation determination step that the first condition is satisfied, and a plurality of evaluation related images represented by the evaluation related image data in which the first type of effect image data is set are displayed. If it is determined in the effect image determination step, one first type of effect image data is determined based on the second condition. In the effect image determination step, when the evaluation determination step determines that the first condition is not satisfied, a plurality of evaluation related images represented by the evaluation related image data in which the second type of effect image data is set are displayed. Are determined by the effect image determination step, one second type of effect image data is determined based on the second condition. The display control step reads the determined effect image data from the effect image storage unit, and displays the effect image on the display unit based on the read effect image data. As a result, compared to displaying the same effect image on the display unit, the effect image to be displayed is changed by determining the effect image from a plurality of types of effect images and displaying it on the display unit. Therefore, the display content does not become monotonous, and the user can call attention to changes in his / her evaluation results.

It is a block diagram which shows the structure of the karaoke system 1 provided with the karaoke apparatus 2 which concerns on embodiment of this invention. It is a figure which shows the content of the image database in the karaoke apparatus. It is a figure which shows the display screen of the monitor 3 at the time of the music performance start in the karaoke apparatus. It is a figure which shows a mode that the evaluation related image 310 in which the effect image 320 is not set was displayed on the monitor 3. FIG. It is a figure which shows a mode that the evaluation related image 310A in which the effect image 320 is not set, and the evaluation related image 310B in which the effect image 320 is set were displayed on the monitor 3. FIG. It is a figure which shows a mode that the effect image 320B relevant to a good evaluation result was displayed on the monitor 3, when the effect image 320 relevant to a good evaluation result is set to the evaluation related image 310. FIG. It is a figure which shows the mode of the monitor 3 which complete | finished the display of the evaluation related image 310B and the effect image 320B relevant to the evaluation result being good. It is a figure which shows a mode that the some evaluation related image 310 by which the effect image 320 relevant to a good evaluation result is set was displayed on the monitor 3. FIG. It is a figure which shows a mode that the effect image 320C relevant to a good evaluation result was displayed on the monitor 3, when the effect image 320 relevant to a good evaluation result is set to the evaluation related image 310. FIG. It is a figure which shows the mode of the monitor 3 which complete | finished the display of the evaluation related image 310C and the effect image 320C relevant to the evaluation result being good. It is a figure which shows a mode that the evaluation related image 310 in which the effect image 320 related to bad evaluation result is not set was displayed on the monitor 3. FIG. It is a figure which shows a mode that the evaluation related image 310F by which the effect image 320 relevant to a bad evaluation result is set was displayed on the monitor 3. FIG. When the effect image 320 related to a bad evaluation result is set to the evaluation related image 310, it is a figure which shows a mode that the effect image 320F related to a bad evaluation result was displayed on the monitor 3. FIG. It is a figure which shows the mode of the monitor 3 which complete | finished the display of the evaluation related image 310F which the evaluation related image 310F and the effect image 320F relevant to a bad evaluation result have displayed, and the evaluation related image 310A more than predetermined time passed since it displayed. It is a figure which shows a mode that the some evaluation related image 310 in which the effect image 320 relevant to a bad evaluation result is set was displayed on the monitor 3. FIG. When the effect image 320 relevant to bad evaluation results is set to the evaluation relevant image 310, it is a figure which shows a mode that the effect image 320G relevant to bad evaluation results was displayed on the monitor 3. FIG. It is a figure which shows the mode of the monitor 3 which complete | finished the display of the evaluation related image 310G and the effect image 320G relevant to bad evaluation result. It is a flowchart which shows the music performance process in the karaoke apparatus. It is a flowchart which shows the effect image determination process in the karaoke apparatus. It is a flowchart which shows the effect image determination process in case the evaluation result in the karaoke apparatus 2 is good. It is a flowchart which shows the effect image determination process in case the evaluation result in the karaoke apparatus 2 is bad. It is a flowchart which complete | finishes the display of the evaluation related image currently displayed on the monitor 3, and the effect image effect image in the karaoke apparatus.

<Electrical Configuration of Embodiment>
A karaoke apparatus 2 according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration of the karaoke system 1. The karaoke system 1 mainly includes a karaoke device 2 according to the present embodiment, a monitor 3, a camera 4, a singing microphone 5, a speaker 6, a remote control device 7, and a karaoke host 8.

(Configuration of Karaoke device 2)
The karaoke apparatus 2 includes a control unit 20, a hard disk (hereinafter referred to as HDD) 21, an operation processing unit 22, an operation unit 23, an infrared communication unit 24, a LAN communication unit 25, a memory 26, and a video RAM 27. And an image reproduction unit 28, an image control unit 29, and an acoustic control unit 30.

  The control unit 20 includes a CPU, a RAM, and a ROM, and is a computer that processes data based on a predetermined program stored in advance in the ROM while using a temporary storage function of the RAM. The control unit 20 executes various controls in the karaoke apparatus 2. The control unit 20 can instruct various processes to peripheral components such as the sound control unit 30 and the image reproduction unit 28 by executing a program stored in a storage unit such as the HDD 21. The control unit 20 includes a main CPU that executes music performance processing and a sub CPU that executes scoring application processing. The main process is a process for controlling the entire karaoke apparatus. The main CPU and the sub CPU exchange data with each other.

  The HDD 21 includes a music data storage area and a scoring application storage area. The music data storage area stores music data 100.

  The music data 100 includes metadata and actual data. The metadata is various pieces of information related to music data, and includes music identification data for identifying music data, music title, singer name, songwriter name, composer name, background image designation data, and section data. The background image designation data is data for designating an image displayed on the screen of the monitor 3 when the performance data is played. The section data is data that divides the music into a plurality of sections such as a prelude, A melody, B melody, chorus, interlude, C melody, and follower. The actual data is data for executing various processes such as performance, and includes performance data, lyrics telop data, guide melody data, and harmony part data. The performance data is composed of control data for an electronic musical instrument based on the MIDI standard, compressed audio data obtained by recording an actual performance, or the like, and data for playing accompaniment sounds of karaoke. The lyrics telop data is data that is displayed in synchronization with the performance data for singing assistance. The guide melody data is data representing the melody of the song, and serves as an example of the pitch that the user should sing. The harmony part data is data created in advance with a pitch relationship that matches the melody with respect to the pitch data of the guide melody data. Harmony part data is created with reference to chords. For example, referring to the chord “So Shi Le”, if the pitch data of the guide melody data is “Si”, the pitch of the corresponding harmony part data is “So” or “Le”.

  The scoring application storage area stores the scoring application 110. The scoring application 110 includes a song evaluation program and an image database. The singing evaluation program is a program for causing the control unit 20 to execute a singing evaluation process for evaluating a singing and evaluating a user's singing voice input from a singing microphone 5 described later for each predetermined section.

  The image database has the contents shown in FIG. 2 and includes an image file name, evaluation-related image data, effect image file name, effect image data, evaluation data, and user-related data. As the user-related data, popularity ranking, popularity ranking by age, usage time zone, and singing evaluation score are used. The user-related data is set based on the user's preference, the time that the user uses the karaoke device, and the user's singing evaluation. Since the user's preference is assumed to be different for each age, the user-related data is set based on the user's preference for each age.

  The image file name is a file name for identifying an evaluation-related image. The image file name is included in the image database of FIG. jpg, heart. jpg, eighth note. jpg, flowers. jpg, star. jpg, balloons. jpg, black cat. jpg, thunder. jpg, crow. jpg, and rain clouds. jpg or the like.

  Evaluation-related image data is data representing an evaluation-related image. Evaluation-related images represent various shapes such as shapes of objects around the user. The image data related to evaluation is included in the image database of FIG. 2 and includes “sun”, “heart”, “eighth note”, “flower”, “star”, “balloon”, “black cat”, “lightning”, “Crows” and “Rain clouds”. The compression format of the evaluation related image data is, for example, the JPEG method. The image includes a moving image and a still image.

  The effect image file name is a file name for identifying an effect image. The effect image file name is included in the image database of FIG. jpg, note. jpg, petals. jpg, shooting star. jpg, balloon bundle. jpg, nails. jpg, lightning. jpg, and drop. jpg or the like.

  The effect image data is data representing an effect image. The effect image is an image including a figure that is conceptually related to the evaluation-related image. That is, the effect image is an image including a figure associated with the evaluation-related image. The notional association will be described by taking evaluation-related image data and effect image data included in the image database of FIG. 2 as an example. The evaluation-related image data of “heart” representing feeling is related to the effect image data of “continuous heart” using a plurality of hearts representing the same feeling, and the heart representing feeling. Also, the evaluation-related image data of the black cat is related to the effect image data of “three lines pulled by the cat's claws” representing the line scratched by the cat's claws in the cat that is an animal. The evaluation-related image data of “rain cloud” that causes rain is related to the effect image data of “rain drop” that represents a drop of rain that has fallen by the rain cloud, and rain that represents the weather.

  Evaluation data is data which shows the evaluation result evaluated for every predetermined section in song evaluation processing. The evaluation data included in the image database of FIG. 2 includes “plus” indicating that the evaluation result is good and “minus” indicating that the evaluation result is bad. The first type of effect image data is effect image data in which “plus” evaluation data is set. The second type of effect image data is effect image data in which “minus” evaluation data is set. Specifically, when the evaluation result of the current section is equal to or higher than the evaluation result of the previous section, the evaluation data is “plus”. When the evaluation result of the current section is less than the evaluation result of the previous section, the evaluation data is “minus”. Moreover, as evaluation data, “plus” is represented by a numeral 0, and “minus” is represented by a numeral 1.

  The popularity ranking included in the image database of FIG. 2 includes level data such as level 1, level 2, level 3, level 4, and level 5. The popularity ranking levels 1 to 5 are set in the effect image data. The level of popularity ranking is set based on the popularity of users of evaluation-related images. For example, a low level is set for an image that is less popular by users of evaluation-related images. A high level is set for an image that is highly popular among users of evaluation-related images.

  The popularity ranking by age included in the image database of FIG. 2 includes level data such as level 1, level 2, level 3, level 4, and level 5. Levels 1 to 5 of the popularity ranking by age are set in the effect image data, respectively. The level of popularity ranking is set based on the popularity of evaluation-related images for each user age. In the popularity ranking by age included in the image database of FIG. 2, the level data of “popularity ranking by age (0 to 6 years old)” is set based on popularity by users aged 0 to 6 years. The level data of “popularity ranking by age (7 to 12 years old)” is set based on popularity by users aged 7 to 12 years. The level data of “popularity ranking by age (13 years old-)” is set based on popularity by users over 13 years old. As the level data, a low level is set for an image having low popularity by users of evaluation-related images. A high level is set for an image that is highly popular among users of evaluation-related images.

  The use time zones included in the image database of FIG. 2 include time zone data such as morning, morning and noon, daytime, night, and midnight. The usage time zone is set for each of the effect image data. The usage time zone included in the image database of FIG. 2 is from 6:00 to 12:00 in the morning, from 13:00 to 18:00 at noon, from 19:00 to 22:00 at night, and from 23:00 to 5:00 at midnight. The time zone is set.

  The evaluation score included in the image database of FIG. 2 includes rank data in which evaluation scores such as A, B, and C are ranked. The rank data is set for each effect image data. As rank data included in the image database of FIG. 2, A is set from 0 to 50, B is from 51 to 70, and C is from 71 to 100.

  When the user operates the operation unit 23, the operation processing unit 22 generates operation input data corresponding to the operation and supplies the operation input data to the control unit 20.

  The operation unit 23 includes a selection operation unit that allows the user of the karaoke apparatus 2 to select a song that the user wants to sing, a pitch adjustment operation unit that adjusts the pitch related to the performance output of the song, and a balance that adjusts the volume balance between the performance and the song. The input device includes an adjustment operation unit and an adjustment operation unit that performs various adjustments such as echo, volume, and tone. The operation unit 23 includes a touch panel, operation buttons, a knob, and the like.

  The infrared communication unit 24 performs wireless communication between the karaoke device 2 and an input device such as the remote control device 7. The infrared communication unit 24 functions as a remote control receiving unit that receives a remote control signal transmitted from the remote control device 7.

  The LAN communication unit 25 is connected to the LAN 200. The LAN communication unit 25 can transmit and receive data to and from the karaoke host 8 or the remote control device 7 via the LAN 200.

  The memory 26 temporarily stores data necessary for executing various programs stored in the HDD 21.

  The video RAM 27 temporarily stores image data that is referred to when the image reproducing unit 28 reproduces an image.

  The image reproduction unit 28 reproduces an image based on a signal instructing reproduction of the image input from the control unit 20 and the image data stored in the video RAM 27.

  The image control unit 29 causes the monitor 3 to display images such as a lyrics telop, an evaluation related image, and an effect image in accordance with a signal for instructing display of the image input from the control unit 20. The image control unit 29 displays a predetermined image on the monitor 3 based on the image data transmitted from the camera 4. The image control unit 29 is connected to the monitor 3 and the camera 4.

  The sound control unit 30 reads one piece of performance data from the music data 100 stored in the HDD 21 in accordance with a signal for instructing reproduction of sound input from the control unit 20. The acoustic control unit 30 generates an acoustic signal based on the read performance data and supplies the acoustic signal to the speaker 6. The acoustic control unit 30 converts an analog sound signal received from the singing microphone 5 described later into a digital sound signal. The acoustic control unit 30 transmits a digital sound signal to the control unit 20 for evaluation processing by the scoring application 110 described later.

(Configuration of monitor 3)
The monitor 3 displays the image shown in FIG. 9 according to a signal instructing reproduction of the image input from the image control unit 29. FIG. 9 shows a screen displayed on the monitor 3. The screen displayed on the monitor 3 includes an image 300 photographed by the camera 4, an evaluation-related image 310, an effect image 320, and a lyrics telop 330.

  The captured image 300 is displayed at the center of the screen shown in FIG. In the present embodiment, the captured image is an image of the upper body of the user.

  In the screen shown in FIG. 9, as the evaluation related image 310, the sun evaluation related image 310A, the heart evaluation related image 310C, and the flower evaluation related image 310D are displayed. The evaluation related image 310 indicates a generic name of the entire evaluation related image. One evaluation-related image data is read out at random from a plurality of evaluation-related image data included in the scoring application 110. As a random reading technique, for example, a method can be used in which each of the evaluation-related image data is numbered sequentially from 1 and the evaluation-related image data having a number corresponding to the random number based on the calculation result using the random number table is read out. It is. Each evaluation-related image is displayed on the monitor 3 so as not to overlap.

  The effect image 320 is an image related to a user's singing evaluation result. The effect image 320 is a generic name for the entire effect image. One effect image data determined by the control unit 20 is read from a plurality of effect image data included in the scoring application 110. In FIG. 9, as the effect image 320, a continuous heart effect image 320C in which the concept is related to the heart evaluation related image 310C is displayed. A large number of effect images 320 </ b> C are displayed around the three evaluation-related images, and are also displayed around the captured image 300 and displayed on the entire screen of the monitor 3.

  The lyrics telop 330 is an image representing the lyrics of the music being played. The lyrics telop 330 is displayed according to the lyrics telop data included in the music data 100. The lyrics telop 330 is displayed below the screen shown in FIG.

(Configuration of camera 4)
The camera 4 is connected to the karaoke apparatus 2. Image data representing the image of the user who sings or the image of the user who plays the musical instrument photographed by the camera 4 is output to the image control unit 29 of the karaoke apparatus 2.

(Configuration of microphone 5 and speaker 6)
The singing microphone 5 receives the user's singing voice and outputs an analog sound signal to the acoustic control unit 30 of the karaoke apparatus 2. The speaker 6 receives and emits the music signal mixed by the acoustic control unit 30.

(Configuration of remote control device 7)
The remote control device 7 includes a touch panel display screen, and can display various data to the user and accept various operations by the user. The remote control device 7 can wirelessly communicate with the karaoke device 2 via an access point 210 installed on the LAN 200. Further, the remote control device 7 and the karaoke device 2 can perform short-range communication using the infrared communication unit 24 or the like. The karaoke apparatus 2 has a function of displaying the evaluation result of the singing on the monitor 3 for the singer. The display output destination by the karaoke device 2 may be the remote control device 7 instead of the monitor 3.

(Composition of karaoke host 8)
The karaoke host 8 is connected to the karaoke apparatus 2 via the Internet in order to provide various services to the user, and includes a storage unit 31. The storage unit 31 stores data necessary for various services such as music data and user personal data. The karaoke host 8 is configured to transmit / receive various data to / from the karaoke device 2 or the remote control device 7 via the router 220.

  The user personal data includes various types of information related to a social network service intended for the user of the karaoke apparatus 2. The social network service refers to a member-based community-type website that provides services such as information browsing only between members who have been registered as members in advance. In the following description, the social network service is abbreviated as SNS. The user personal data includes, for each user, data relating to karaoke performance and the identification data (user ID) of the user in association with each other. As the data related to the karaoke performance, the data related to the store visit history of the store corresponding to the karaoke device 2 used by the user in the past (the store where the karaoke device 2 is installed), and the user as the eighteenth song in the karaoke performance by the karaoke device 2 Data related to registered performances (performances that are set so that music selection can be input by simple operations), music selection history that the user has selected in the past in karaoke performance by the karaoke device 2 (the music is selected in the past in the karaoke device 2) Data relating to the history of musical performances) and data relating to evaluation results of karaoke performances performed by the user using the karaoke apparatus 2 in the past. The store visit history may be data including a store ID of a store used (visited) by the user in the past, or data including a device ID of the karaoke apparatus 2 used (used) by the user in the past. Also good.

  User personal data is used for login authentication to the user's name (nickname), date of birth, actual age, gender, email address, user address or location, blood type, constellation, SNS Passwords, questions and answers for forgotten passwords, data on avatars (humanoid images that symbolize users on the net), data such as the user's song age, and user IDs for each user In association with. The song age is virtual age data indicating what age (how many years) the user's favorite tendency of the musical piece corresponds to, and the target user uses the karaoke device 2. This value is determined based on the music data selected when performing the karaoke performance.

<Operation and Action of Embodiment>
The operation and action of this embodiment will be described with reference to FIG. FIG. 18 is a flowchart showing main processing executed by the main CPU of the control unit 20. The process in each step shown in FIG. 18 is a process executed by the main CPU of the control unit 20. When the power of the karaoke apparatus 2 is turned on, main processing for controlling the entire karaoke apparatus 2 is executed.

(Main processing)
In step SA1, it is determined whether or not a scoring application start request has been received. Specifically, when the user operates the operation unit 23 or the remote control device 7 to instruct the start of the scoring application, it is determined whether a scoring application start request is received from the operation processing unit 22. When the determination at step SA1 is NO, the processing after step SA3 is executed, but when the determination at step SA1 is YES, step SA2 is executed.

  In step SA2, a scoring application start command is transmitted. Specifically, a scoring application start command is transmitted to the sub CPU of the control unit 20 in accordance with the scoring application start request. In accordance with the start command, the sub CPU executes the scoring application.

  In step SA3, it is determined whether or not a music selection number has been received. Specifically, when the user operates the operation unit 23 or the remote control device 7 to set the music selection number, it is determined whether or not a music reservation request is received from the operation processing unit 22. The music reservation request includes the set music selection number. If the determination in step SA3 is NO, the processes in and after step SA5 are executed. If the determination in step SA3 is YES, step SA4 is executed.

  In step SA4, the received music selection number is registered. Specifically, the music selection number included in the music reservation request is stored at the end of the reserved music database provided in the RAM.

  In step SA5, it is determined whether or not the music selection number is registered in the reserved music database. Specifically, it is determined whether or not the music selection number is stored in the reserved music database in the RAM. When the determination at step SA5 is NO, the processing after step SA1 is executed again. When the determination at step SA5 is YES, step SA6 is executed.

  In step SA6, a musical performance is instructed based on the music selection number registered in the reserved music database. Specifically, the music data 100 is read from the HDD 21 in accordance with the first music selection number stored in the reserved music database. The music data 100 is temporarily stored in the RAM. Each performance data included in the music data 100 temporarily stored in the RAM is sequentially read out and transmitted to the sound control unit 30. The acoustic control unit 30 causes the performance sound to be emitted from the speaker 6 based on the received performance data.

  In step SA7, it is determined whether or not the performance based on the performance data has been completed. Specifically, it is determined whether or not reading of all performance data included in the music data 100 has been completed. When the determination at step SA7 is NO, the process after step SA6 is executed again. However, when the determination at step SA7 is YES, the process after step SA1 is executed again.

(Score application processing)
FIG. 19 is a flowchart showing the scoring application process executed by the sub CPU of the control unit 20. The process of each step shown in FIG. 19 is a process executed by the sub CPU of the control unit 20. When receiving the scoring application start command from the main CPU, the sub CPU reads the scoring application 110 from the scoring application storage area of the HDD 21. The read scoring application 110 is temporarily stored in the RAM. The scoring application 110 program temporarily stored in the RAM is executed. By executing the scoring application 110, each step shown in FIG. 19 is sequentially executed. The scoring application 110 is executed in parallel with the main process shown in FIG.

  In step SB1, an instruction is given to display an image photographed by the camera 4 on the monitor 3. Specifically, a shooting start command and an image display command are transmitted to the image control unit 29. The image control unit 29 activates the camera 4 in accordance with the shooting start command. Captured image data representing an image captured by the camera 4 is transmitted to the image control unit 29. When the captured image data is received, the image control unit 29 displays the captured image on the monitor 3 according to the image display command.

  In step SB2, an evaluation related image to be displayed on the monitor 3 is read. Specifically, one evaluation related image data is read out from a plurality of evaluation related image data included in the scoring application 110 stored in the RAM. In the execution of the second and subsequent routine processes after the first routine process, which is the first series of processes from step SB1 to step SE3 after the scoring application 110 shown in FIG. Step SB2 is executed every second. In the present embodiment, the time interval of 20 seconds is a time interval for reading evaluation-related image data, an interval for scoring time Ts, and a time interval for ending display of evaluation-related image data and effect image data. As the evaluation-related image data to be read, evaluation-related image data different from the evaluation-related image data represented by the image file name temporarily stored in the RAM described later is read. When the number of image file names stored in the RAM reaches a predetermined number N, the evaluation related image data is not read even at the timing of reading the evaluation related image data. In the present embodiment, the predetermined number N is a number that can be recognized and recognized by the user within a time corresponding to the interval of the scoring time Ts, for example, five.

  In step SB3, the monitor 3 is instructed to display an evaluation-related image. The evaluation related image data read in step SB2 and a display command including a predetermined coordinate value indicating a position for displaying the read evaluation related image data are transmitted to the image control unit 29. Further, the image file name for identifying the read evaluation-related image data and the coordinate value are temporarily stored in the RAM in a state where they are associated with each other. The image control unit 29 causes the monitor 3 to display the evaluation related image according to the coordinate value and the evaluation related image data included in the received display command.

  After the scoring application 110 is started, the coordinate values are stored in the RAM in the second and subsequent routine processing after the first routine processing, which is the first series of processing from step SB1 to step SE2, is executed. The coordinate value that keeps a certain distance (x, y) from the coordinate value temporarily stored in is calculated.

  In step SB4, the user's singing voice is scored. Specifically, according to the singing evaluation program included in the scoring application 110, the pitch data of the guide melody data included in the performance data of the music data 100 read for each scoring time Ts and the sound control unit 30 are transmitted. The digital sound signal is compared. A score is calculated for each section from the comparison result. The scoring time Ts is a predetermined time interval, and is, for example, a time every 20 seconds from the start of reproduction of music data of one song. The score is calculated every 20 seconds from the reproduction of the music data. A memory command including a score for each predetermined time interval calculated by the singing evaluation program is transmitted to the memory 26. The memory 26 stores a score for each predetermined time interval in accordance with the received storage command.

  In step SB5, the calculated score is compared with the score of the previous predetermined time interval, and it is determined whether or not the comparison result is equal to or more than the score of the previous predetermined time interval. Specifically, a score read request for reading the score of the previous predetermined time interval, which is the predetermined time interval immediately before the current predetermined time interval for which the score is calculated in step SB4, is transmitted to the memory 26. In accordance with the received score reading request, the score for the previous predetermined time interval is read from the memory. The control unit 20 receives the read score of the previous predetermined time interval.

  When the determination at step SB5 is NO, the process after step SD1 is executed. However, when the determination at step SB5 is YES, the process after step SC1 is executed. When step SB5 is executed first after the scoring application 110 shown in FIG. 19 is started, the score of the previous predetermined time section does not exist, so the score of the previous predetermined time section is “0”. As a score, step SB5 is executed. In this case, the determination in step SB5 is YES, and the next process proceeds to step SC1.

(Processing of scoring application when the score is more than the previous score)
FIG. 20 is a flowchart showing the scoring application process executed by the sub CPU of the control unit 20 when the previous score is exceeded. If the determination in step SB5 shown in FIG. 19 is YES, the processing in each step shown in FIG. 20 is executed.

  In step SC1, it is determined whether one or more evaluation-related images are displayed on the monitor 3. Specifically, it is determined whether one or more image file names are stored with reference to the RAM. When the determination at step SC1 is NO, the process after step SC8 is executed. When the determination at step SC1 is YES, step SC2 is executed.

  In step SC2, it is determined whether or not two or more evaluation-related images are displayed on the monitor 3. Specifically, it is determined whether or not two or more image file names are stored in the RAM with reference to the RAM. If the determination in step SC2 is NO, step SC9 is executed. If the determination in step SC2 is YES, step SC3 is executed.

  In step SC3, it is determined whether or not an effect image is set for the evaluation-related image displayed on the monitor 3. Specifically, with reference to the image database shown in FIG. 2, it is determined whether or not effect image data is set for the image file name temporarily stored in the RAM. If the determination in step SC3 is NO, step SC8 is executed, but if the determination in step SC3 is YES, step SC4 is executed.

  In step SC4, it is determined whether or not the effect image set in the evaluation-related image displayed on the monitor 3 is the first type effect image. With reference to the evaluation data of the image database shown in FIG. 2, it is determined whether or not the effect image data set in the image file name temporarily stored in the RAM is the first type of effect image data. If the determination in step SC4 is NO, step SC8 is executed, but if the determination in step SC4 is YES, step SC5 is executed.

  In step SC5, it is determined whether or not a plurality of evaluation-related images in which the first type of effect image data is set are displayed on the monitor 3. Specifically, it is determined whether or not two or more image file names in which the first type of effect image data is set are stored in the RAM. If the determination in step SC5 is NO, step SC11 is executed, but if the determination in step SC5 is YES, step SC6 is executed.

  In step SC6, the first type of effect image data is determined based on the second condition. Specifically, the first type of effect image data is determined based on the second condition from among the first type of effect image data set for a plurality of image file names temporarily stored in the RAM. The second condition is the content indicated by one of the user related data included in the image database shown in FIG. For example, referring to the popularity ranking of the image database shown in FIG. 2, the first type of effect image data for which the lowest level is set is determined.

  In step SC7, the determined first-type effect image data is read out, and an instruction is given to display the effect image on the monitor 3. Specifically, the first type of effect image data determined in step SC6 or step SC11 is read out from a plurality of effect image data included in the scoring application 110 stored in the RAM. An effect image display command including the read first type effect image data is transmitted to the image control unit 29. Also, the effect image file name for identifying the read effect image data is temporarily stored in the RAM.

  In step SC8, it is determined whether or not the performance is finished. If the determination in step SC8 is NO, step SE1 is executed. If the determination in step SC8 is YES, the entire routine shown in FIG. 20 ends.

  In step SC9, it is determined whether or not an effect image is set for the evaluation-related image displayed on the monitor 3. Specifically, it is determined with reference to the image database shown in FIG. 2 whether or not effect image data is set for the image file name temporarily stored in the RAM. If the determination in step SC9 is NO, step SC8 is executed. If the determination in step SC9 is YES, step SC10 is executed.

  In step SC10, it is determined whether or not the effect image set in the evaluation-related image displayed on the monitor 3 is the first type effect image. Specifically, referring to the evaluation data of the image database shown in FIG. 2, whether or not the effect image data set in the image file name temporarily stored in the RAM is the first type of effect image data. To be judged. If the determination in step SC10 is NO, step SC8 is executed. If the determination in step SC10 is YES, step SC11 is executed.

  In step SC11, the first type of effect image data is determined. Specifically, the effect image data determined to be the first type of effect image data in step SC10 is determined. When the effect image data is determined in step SC11, steps SC7 and after are executed.

(Processing of scoring application when less than the previous score)
FIG. 21 is a flowchart showing the scoring application process executed by the sub CPU of the control unit 20 when the score is less than the previous score. If the determination in step SB5 shown in FIG. 19 is NO, the processing of each step shown in FIG. 21 is executed.

  In step SD1, it is determined whether one or more evaluation-related images are displayed on the monitor 3. Specifically, it is determined whether one or more image file names are stored with reference to the RAM. When the determination at step SD1 is NO, the process after step SD8 is executed. When the determination at step SD1 is YES, step SD2 is executed.

  In step SD2, it is determined whether or not two or more evaluation-related images are displayed on the monitor 3. Specifically, it is determined whether or not two or more image file names are stored in the RAM with reference to the RAM. If the determination in step SD2 is NO, step SD9 is executed. If the determination in step SD2 is YES, step SD3 is executed.

  In step SD3, it is determined whether or not an effect image is set for the evaluation-related image displayed on the monitor 3. Specifically, with reference to the image database shown in FIG. 2, it is determined whether or not effect image data is set for the image file name temporarily stored in the RAM. If the determination in step SD3 is NO, step SD8 is executed, but if the determination in step SD3 is YES, step SD4 is executed.

  In step SD4, it is determined whether or not the effect image set in the evaluation-related image displayed on the monitor 3 is the second type effect image. With reference to the evaluation data of the image database shown in FIG. 2, it is determined whether or not the effect image data set in the image file name temporarily stored in the RAM is the second type of effect image data. If the determination in step SD4 is NO, step SD8 is executed, but if the determination in step SD4 is YES, step SD5 is executed.

  In step SD5, it is determined whether or not a plurality of evaluation-related images in which the second type of effect image data is set are displayed on the monitor 3. Specifically, it is determined whether or not two or more image file names in which the second type of effect image data is set are stored in the RAM. If the determination in step SD5 is NO, step SD11 is executed, but if the determination in step SD5 is YES, step SD6 is executed.

  In step SD6, the second type of effect image data is determined based on the second condition. Specifically, the second type of effect image data is determined based on the second condition from the second type of effect image data set for a plurality of image file names temporarily stored in the RAM. The second condition is the content indicated by one of the user related data included in the image database shown in FIG. For example, referring to the popularity ranking of the image database shown in FIG. 2, the second type of effect image data for which the lowest level is set is determined.

  In step SD7, the determined second type of effect image data is read and the effect image is displayed on the monitor 3. Specifically, the second type of effect image data determined in step SD6 or step SD11 is read out from the plurality of effect image data included in the scoring application 110 stored in the RAM. An effect image display command including the read second type effect image data is transmitted to the image control unit 29. Also, the effect image file name for identifying the read effect image data is temporarily stored in the RAM.

  In step SD8, it is determined whether or not the performance is finished. If the determination in step SD8 is NO, step SE1 is executed, but if the determination in step SD8 is YES, the entire routine shown in FIG. 21 ends.

  In step SD9, it is determined whether or not an effect image is set for the evaluation-related image displayed on the monitor 3. Specifically, with reference to the image database shown in FIG. 2, it is determined whether or not effect image data is set for the image file name temporarily stored in the RAM. If the determination in step SD9 is NO, step SD8 is executed, but if the determination in step SD9 is YES, step SD10 is executed.

  In step SD10, it is determined whether or not the effect image set in the evaluation-related image displayed on the monitor 3 is the second type effect image. Specifically, it is determined whether or not the effect image data set for the image file name temporarily stored in the RAM is the second type of effect image data. If the determination in step SD10 is NO, step SD8 is executed, but if the determination in step SD10 is YES, step SD11 is executed.

  In step SD11, the second type of effect image data is determined. Specifically, the effect image data determined to be the second type of effect image data in step SD10 is determined. When the effect image data is determined in step SD11, steps SD7 and after are executed.

(Scoring application processing when ending image display)
FIG. 22 is a flowchart illustrating the scoring application process executed by the sub CPU of the control unit 20 when the display of the evaluation-related image and the effect image is terminated. When the determinations at step SC8 shown in FIG. 20 and step SD8 shown in FIG. 21 are NO, the processing of each step shown in FIG. 22 is executed.

  In step SE1, it is determined whether or not an effect image is displayed on the monitor 3. Specifically, it is determined whether or not the effect image file name is temporarily stored in the RAM. If the determination in step SE1 is NO, step SE4 is executed. If the determination in step SE2 is YES, step SE2 is executed.

  In step SE2, an effect image for which the scoring time Ts has elapsed since it was displayed on the monitor 3 and an evaluation-related image in which the effect image is set are determined as images to end the display. Specifically, the evaluation-related image in which the effect image file name for which the scoring time Ts has elapsed since being temporarily stored in the RAM in step SC7 or step SD7 and the effect image data indicating the temporarily stored effect image file name are set. The data image file name is determined.

  In step SE3, the effect image and the evaluation related image indicated by the determined effect image file name and the image file name are deleted from the monitor 3. Specifically, an image end command including the effect image data indicating the effect image file name and the image file name determined in step SE2 and the evaluation related image data is transmitted to the image control unit 29. Further, both file names are deleted from the RAM in which the determined effect image file name and the image file name are temporarily stored. The image control unit 29 ends the display of the effect image and the evaluation related image indicated by the two image data included in the received image erasure command.

  In step SE4, it is determined whether or not the number of evaluation-related images displayed on the monitor 3 reaches a predetermined number N. Specifically, it is determined whether or not the number of image file names temporarily stored in the RAM reaches a predetermined number N in step SB3. If the determination in step SE4 is NO, step SB6 is executed. If the determination in step SE4 is YES, step SE5 is executed. In the present embodiment, the predetermined number N is a number that can be recognized and recognized by the user within the scoring time range, for example, five.

  In step SE5, the display of the evaluation related image displayed first among the evaluation related images displayed on the monitor 3 is terminated. Specifically, an image end command including evaluation-related image data indicating the image file name stored first among the image file names temporarily stored in the RAM in step SB3 is transmitted to the image control unit 29. In addition, the image file name temporarily stored in the RAM is deleted. The image control unit 29 ends the display of the evaluation related image indicated by the evaluation related image data included in the received image erasure command.

  In step SE6, it is determined whether or not there is an evaluation related image for which a time equal to or greater than a predetermined multiple of the scoring time Ts has elapsed since being displayed on the monitor 3. Specifically, it is determined whether or not there is an image file name for which a time more than a predetermined multiple of the scoring time Ts has elapsed since being temporarily stored in the RAM in step SB3. If the determination in step SE6 is NO, step SB2 and subsequent steps are executed. If the determination in step SE6 is YES, step SE7 is executed. In the present embodiment, the predetermined multiple is a multiple that is set based on the time during which the user may be bored with the evaluation-related images that are continuously displayed. For example, 5 times.

  In step SE7, the evaluation-related image that has passed a predetermined multiple of the scoring time Ts after being displayed on the monitor 3 is deleted. Specifically, the image control unit 29 issues an image end command including evaluation-related image data representing an image file name for which it has been determined that a time more than a predetermined multiple of the scoring time Ts has elapsed since it was displayed on the monitor 3 in step SE4. Sent to. In addition, the image file name temporarily stored in the RAM is deleted. The image control unit 29 ends the display of the evaluation related image data included in the received image erasure command. Step SB2 and subsequent steps are executed after step SE7 is executed.

(Usage form of embodiment)
Next, the usage pattern of this embodiment will be described with reference to FIGS. This usage pattern is related to the user's voice scoring results after the image 300 and the evaluation-related image 310 are displayed on the monitor 3 as the music is played in a situation where the scoring application is being executed. The effect image 320 is displayed until the display of the evaluation-related image 310 and the effect image 320 ends.

  When the karaoke device 2 reads music data from the HDD 21 according to the music selection number and starts playing, a performance start screen is displayed on the monitor 3. On the performance start screen, a song name, a singer name, a songwriter name, and a composer are displayed, and a scoring app title indicating that the scoring application is being executed is displayed.

  When the display of the performance start screen and the scoring application title ends, the screen of the monitor 3 moves to the screen of FIG. FIG. 3 is a diagram in which an image 300 captured by the camera 4 is displayed. Specifically, an image 300 obtained by photographing a human figure with the camera 4 is displayed on the monitor 3.

  FIG. 4 is a diagram showing a screen of the monitor 3 on which the sun evaluation-related image 310A is displayed. Specifically, the music is played and the control unit 20 displays the sun evaluation-related image 310 </ b> A read in step SB <b> 2 in FIG. 19 on the monitor 3. In the image database shown in FIG. 2, no evaluation data is set for the sun evaluation-related image 310A. Also, no effect image data is set. Since no effect image data is set in the sun evaluation-related image 310A, the screen of the monitor 3 does not change even when the score calculated this time in step SB5 in FIG. 19 is determined to be equal to or higher than the previous score.

  FIG. 5 is a diagram illustrating a screen of the monitor 3 on which an eighth note evaluation-related image 310B is displayed after 20 seconds have elapsed since the sun evaluation-related image 310A was displayed. Specifically, the evaluation-related image 310B of the eighth note read in step SB2 in FIG. In the eighth note evaluation-related image 310B, as shown in the image database of FIG. 2, positive evaluation data and note effect image data related to a good evaluation result are set.

  FIG. 6 is a diagram showing a screen of the monitor 3 on which a note effect image 320B related to a good evaluation result is displayed. Specifically, when it is determined in step SB5 of FIG. 19 that the score calculated this time is equal to or greater than the previous time, the evaluation data shown in the image database of FIG. A large number of note effect images 320B are displayed on the entire screen of the monitor 3.

  FIG. 7 is a diagram showing a screen of the monitor 3 on which the display of the eighth note evaluation-related image 310B and the note effect image 320B is finished. Specifically, the display of the eighth note evaluation-related image 310B and the note effect image 320B is terminated immediately after 20 seconds have elapsed since the note effect image 320B was displayed on the monitor 3.

  FIG. 8 shows a screen of the monitor 3 on which the sun evaluation-related image 310A in which the effect image data is not set, and the heart evaluation-related image 310C and the flower evaluation-related image 310D in which the effect image data are respectively set are displayed. FIG. Specifically, in FIG. 7, immediately after the display of the eighth note evaluation-related image 310B and the note effect image 320B is completed, the heart evaluation read by the control unit 20 in step SB2 of FIG. The related image 310C is displayed on the monitor 3. In the heart evaluation related image 310C read out in step SB2, a continuous heart effect image related to a good evaluation result is set as shown in the image database of FIG. When it is determined in step SB5 in FIG. 19 that the score calculated this time is less than the previous score, the effect image data related to the bad evaluation result is not set, and the screen of the monitor 3 does not change. Twenty seconds after the heart-related evaluation-related image 310C is displayed on the monitor 3, the controller 20 displays the flower-related evaluation-related image 310D read in step SB2 of FIG. As shown in the image database of FIG. 2, petal effect image data related to good evaluation results is set in the flower evaluation-related image 310 </ b> D.

  FIG. 9 is a diagram showing a screen of the monitor 3 on which the continuous heart effect image 320C is displayed. Specifically, if the control unit 20 determines that the score calculated this time in step SB5 of FIG. 19 is equal to or higher than the previous score, the effect image data set in the evaluation-related image 310 displayed on the monitor 3 is displayed. From the inside, a large number of continuous heart effect images 320C set in the heart evaluation-related image 310C determined in step SC6 of FIG.

  The effect image 320 is determined based on the popularity ranking, age popularity ranking, usage time zone, and singing evaluation score shown in the image database of FIG. Specifically, the popularity rankings “Level 2” and “Level” set respectively for the heart evaluation-related image 310C and the flower evaluation-related image 310D in which “plus” is set as the evaluation data of the image database in FIG. Among the plurality of levels such as “5”, continuous heart effect image data in which “level 2”, which is the lowest level, is set is determined. The effect image data for which the highest level is set may be determined.

  FIG. 10 is a diagram showing the screen of the monitor 3 on which the display of the heart evaluation-related image 310C and the continuous heart effect image 320C has been completed. Specifically, immediately after 20 seconds have elapsed since the continuous heart effect image 320C is displayed on the monitor 3, the display of the heart evaluation-related image 310C and the continuous heart effect image 320C is terminated.

  FIG. 11 shows a sun evaluation-related image 310A and a crow evaluation-related image 310E in which effect image data is not set, and a flower evaluation-related image 310D in which effect image data related to a good evaluation result is set. It is a figure which shows the screen of the monitor 3 made. Specifically, immediately after 20 seconds have passed since the continuous heart effect image 320C is displayed on the monitor 3, the control unit 20 displays the crow evaluation-related image 310E read in step SB2 in FIG. Is displayed. In the image database shown in FIG. 2, evaluation data and effect image data are not set in the crow evaluation-related image 310E. When it is determined in step SB5 of FIG. 19 that the score calculated this time is less than the previous score, no effect image data related to the bad evaluation result is set in the evaluation related image 310 displayed on the monitor 3. Therefore, the screen of the monitor 3 does not change.

  FIG. 12 is a diagram illustrating a screen of the monitor 3 on which the related image 310F of the evaluation black cat is displayed after 20 seconds have elapsed from the time when the crow evaluation related image 310E is displayed. Specifically, after 20 seconds have passed since the crow evaluation-related image 310E is displayed on the monitor 3, the control unit 20 causes the black cat evaluation-related image 310F read in step SB2 of FIG. Is displayed. In the image database shown in FIG. 2, negative evaluation data and three-line effect image data caught by a cat's claws related to poor evaluation results are set in the black cat evaluation-related image 310F.

  FIG. 13 is a diagram showing a screen of the monitor 3 on which a three-line effect image 320F scratched by a cat's claw related to a bad evaluation result is displayed. Specifically, when it is determined in step SB5 of FIG. 19 that the score calculated this time is less than the previous score, the evaluation data 310F of the black cat whose evaluation data shown in the image database of FIG. A large number of three-line effect images 320 </ b> F that are pulled by the set cat's claws are displayed on the entire screen of the monitor 3.

  FIG. 14 is a diagram showing a screen of the monitor 3 in which the display of the sun evaluation-related image 310A, the black cat evaluation-related image 310F, and the three-line effect image 320F scratched by the cat's claws is finished. Specifically, the evaluation related image 310F of the black cat and the effect image 320F of the three lines scratched with the cat's nails are displayed 20 seconds after the three-line effect image 320F scratched with the cat's nails is displayed on the monitor 3. Is terminated. Further, when it is determined by the control unit 20 that the number of evaluation-related images 310 displayed on the monitor 3 in step SE4 in FIG. 22 reaches the predetermined number N, from among the evaluation-related images 310 displayed on the monitor 3 The display of the sun-related image 310A that is displayed first is terminated.

  FIG. 15 is a diagram showing a screen of the monitor 3 on which a crow evaluation-related image 310E in which no effect image data is set, a rain cloud evaluation-related image 310G and a lightning evaluation-related image 310H in which the effect image data are respectively set are displayed. It is. Specifically, in FIG. 14, immediately after the display of the sun evaluation-related image 310 </ b> A, the black cat evaluation-related image 310 </ b> F, and the three-line effect image 320 </ b> F scratched by the cat's nails, the control unit 20 Thus, the rain cloud evaluation-related image 310G read in step SB2 of FIG. In the rain cloud evaluation-related image 310G, as shown in the image database of FIG. 2, effect image data of rain drops related to a bad evaluation result is set. In step SB5 in FIG. 19, when it is determined that the score calculated this time is equal to or more than the previous score, the effect image of the petal related to the fact that the evaluation result set in the flower evaluation-related image 310D is good is not shown. Are displayed on the screen of the monitor 3. 20 seconds after the rain cloud evaluation-related image 310G is displayed on the monitor 3, the controller 20 displays the lightning evaluation-related image 310H read in step SB2 of FIG. In the lightning evaluation-related image 310H, as shown in the image database of FIG. 2, lightning effect image data related to a bad evaluation result is set.

  FIG. 16 is a diagram showing a screen of the monitor 3 on which a drop effect image 320G is displayed. Specifically, when the control unit 20 determines that the score calculated this time in step SB5 of FIG. 19 is less than the previous score, the effect image data set in the evaluation-related image 310 displayed on the monitor 3 is displayed. From the inside, many drop effect images 320G set in the rain cloud evaluation-related image 310G determined in step SD6 of FIG. 20 are displayed on the entire screen of the monitor 3.

  Regarding the determination of the effect image 320, specifically, the popularity set respectively for the rain cloud evaluation-related image 310G and the lightning evaluation-related image 310H set as “minus” as the evaluation data shown in the image database of FIG. Drop effect image data in which the lowest level is set among the plurality of ranking levels is determined. The effect image data for which the highest level is set may be determined.

  FIG. 17 is a diagram illustrating a screen of the monitor 3 in which the display of the rain cloud evaluation-related image 310G and the drop effect image 320G has been completed. Specifically, after 20 seconds have passed since the drop effect image 320G is displayed on the monitor 3, the display of the rain cloud evaluation-related image 310G and the drop effect image 320G is terminated.

<Effect of embodiment>
According to the present embodiment, when the sound signal evaluation result of the user is good, the continuous heart effect image 320C set in the heart evaluation related image 310C displayed on the screen of the monitor 3 is as shown in FIG. Are displayed around the displayed evaluation-related images 310A, 310C, 310D and around the photographed user image 300, so that the user can sing while conscious of their own evaluation results. It becomes.

  An effect image 320 related to a good evaluation result is set in each of the heart evaluation related image 310C and the flower evaluation related image 310D displayed on the screen of the monitor 3, and the sound signal of the user is displayed. When the evaluation result is good, a number of continuous heart effect images 320C related to the user's evaluation result are displayed based on the popularity ranking level as shown in FIG. Is alerted.

  By ending the display of the displayed continuous heart effect image 320C and the heart evaluation related image 310C in which the continuous heart effect image 320C is set, the screen greatly changes from the screen of FIG. 9 to the screen of FIG. Therefore, the user can sing without getting tired of the content displayed on the screen. When the displayed number of evaluation-related images 310 reaches a predetermined number N, the display of the evaluation-related image 310A displayed first from the displayed evaluation-related images 310 is terminated, and a new evaluation-related image is displayed. By displaying 310G, the display content of the screen changes, and the user can sing while enjoying the display content of the screen. Furthermore, since the display screen is changed by ending the display of the sun evaluation related image 310A in which the effect image 320 determined to be displayed for a predetermined time or more after the display is not set, the user is bored of singing Nothing will happen.

<Correspondence between Configuration of Embodiment and Configuration of Invention>
The combination of the control unit 20 and the acoustic control unit 30 is an example of the reproducing means of the present invention. The singing microphone 5 is an example of the input means of the present invention. The digital sound signal is an example of the sound signal of the present invention. The combination of the control unit 20 and step SB4 in FIG. 19 is an example of the evaluation calculation unit of the present invention. The combination of the control unit 20 and step SB5 in FIG. 19 is an example of the evaluation determination unit of the present invention. The image database of the scoring application 110 of the HDD 21 is an example of the evaluation related image storage unit of the present invention. The combination of the control unit 20, step SB2 and step SB3 in FIG. 19 is an example of the display control means of the present invention. The image database of the scoring application 110 in the HDD 21 is an example of the effect image storage unit of the present invention. The combination of the control unit 20, step SC5 in FIG. 20, and step SD5 in FIG. 21 is an example of the effect image determination unit of the present invention. The combination of the control unit 20, step SC6 in FIG. 20, and step SD6 in FIG. 21 is an example of the effect image determination unit of the present invention.

  The operation by the combination of the control unit 20, step SB2 and step SB3 in FIG. 19, and step SE4 and step SE5 in FIG. 22 is the operation for displaying the evaluation related image of the present invention and the evaluation displayed on the display unit. It is an example with the operation | movement which complete | finishes the display of a related image.

  The operation by the combination of the control unit 20 and step SE1, step SE2, and step SE3 in FIG. 22 is an operation for ending the display of the specific effect image and the specific evaluation related image displayed on the display unit of the present invention. It is an example.

  The combination of the control unit 20, step SB4 in FIG. 19, and step SE1, step SE2, and step SE3 in FIG. 22 is a combination of a specific effect image and a specific evaluation related image when a predetermined time of the present invention has elapsed. This is an example of terminating the display of.

  The operation by the combination of the control unit 20 and step SE4 and step SE5 in FIG. 22 is the display of the evaluation related image that is displayed first when the predetermined number of evaluation related images are displayed on the display unit of the present invention. It is an example of the operation | movement which complete | finishes.

  The determination condition in step SB5 in FIG. 19 is an example of a first condition in which the current evaluation score of the present invention is equal to or higher than the previous evaluation score.

  The “effect image data” included in the image database of the scoring application 110 of the HDD 21 includes the first type of effect image data related to a good evaluation result in which the current evaluation score of the present invention is equal to or higher than the previous evaluation score, and the current It is an example with the 2nd type effect image data relevant to the bad evaluation result whose evaluation score is less than the last evaluation score.

  “Popularity ranking”, “Popularity ranking by age”, “Usage time zone”, and “Singing evaluation score” included in the image database of the scoring application 110 of the HDD 21 are contents indicated by the user related data of the present invention. It is an example of the second condition.

  A plurality of types of effect images represented by a plurality of “effect image data” included in the image database of the scoring application 110 of the HDD 21 are examples of a plurality of types of effect images that differ from the concept of the present invention.

<Modification>
The embodiment of the present invention has been described above, but various modifications can be made by those skilled in the art without departing from the spirit of the present invention.

  In the present embodiment, the music signal representing the music is pitch data of guide melody data included in the performance data. Instead of this embodiment, the music signal representing the music may be a signal representing the volume of the guide melody data. Specifically, the volume is a reference for the loudness of the voice when the user sings, and the evaluation score is calculated by comparing the volume of the guide melody data with the user's singing volume input by the input means. May be.

  In the present embodiment, an evaluation-related image 310 in which effect image data is set and an evaluation-related image 310 in which no effect image data is set are stored in the image database in FIG. Instead of this embodiment, effect image data may be set for all of the evaluation-related images 310.

  In the present embodiment, the image 300 captured by the camera 4 is displayed as the image 300 displayed on the monitor 3 in FIG. Instead of this embodiment, a background image designated by background image designation data included in the music data may be displayed.

  In the present embodiment, as the image 300 displayed on the monitor 3 of FIG. 3, an image taken by the camera 4 installed in the karaoke store is displayed. Instead of this embodiment, an image captured using a camera provided in a mobile terminal owned by the user may be transmitted to the karaoke apparatus 2 and displayed on the monitor 3.

  In the present embodiment, the effect image 320 displayed on the monitor 3 in FIG. 6 and the like is a still image. Instead of this embodiment, the effect image 320 may be a moving image.

  In the present embodiment, many effect images 320B of the same type are displayed as the effect image 320 displayed on the monitor 3 in FIG. Instead of this embodiment, different types of effect images 320 may be displayed on the monitor 3. For example, the evaluation calculation means compares the current evaluation score calculated in the current predetermined section with the previous evaluation score calculated in the previous predetermined section to calculate the difference in evaluation score, and the difference between the calculated evaluation scores Based on this, the number of types of effect images 320 to be displayed may be increased or decreased. Specifically, a plurality of evaluation-related images 310 in which effect images 320 related to good evaluation results are set are displayed on the monitor 3, and the evaluation calculation means calculates the current evaluation score and the previous evaluation score. And the difference in evaluation score is calculated, and when the calculated difference in evaluation score is increased by 10 points or more, 2 of the plurality of effect images 320 respectively set in the plurality of evaluation-related images 310 More than one type of effect image 320 may be displayed on the monitor 3.

  In the present embodiment, the evaluation-related image 310 whose display is to be ended is determined in the processing of step SE2, step SE5, and step SE7 in FIG. Instead of this embodiment, the evaluation-related image 310 that ends the display may be determined based on the score calculated in step SB4. Specifically, when an evaluation score is set for each evaluation-related image 310 and the score calculated in step SB4 in FIG. 19 is equal to or higher than the score set for the evaluation-related image, the evaluation-related image 310 The display may be terminated.

  In the present embodiment, the image file name is temporarily stored in the RAM in the process of step SB3 in FIG. Instead of this embodiment, a number for identifying the evaluation-related image 310 may be temporarily stored in the RAM.

  In the present embodiment, the scoring in step SB4 in FIG. 19 is executed in a section every predetermined time. Instead of this embodiment, a predetermined time may be set according to the performance time of the music. For example, a predetermined time is 20 seconds for music less than 4 minutes, a predetermined time is 25 seconds for music longer than 4 minutes and less than 5 minutes, and a predetermined time is 30 seconds for music longer than 5 minutes. In addition, the predetermined scoring section may be set based on section data determined in advance for each piece of music. The section data includes data for dividing a song such as A melody, B melody, chorus, and C melody into a plurality of sections. For example, the absolute value of the difference between the pitch data of the guide melody and the pitch data of the singing sound from the start to the end of the A melody is integrated, and the scoring value is calculated at the end of the A melody. The section data such as A melody, B melody, chorus and C melody are determined in advance when the karaoke piece data is produced. The section to sing in the music is roughly divided into melody and chorus. The chorus is the most exciting section of the music, and the melody is the other section. The A melody is the first melody of the music, the B melody is the melody following the A melody, and the C melody is the melody following the last chorus. As an example of music, the sections arrive in the order of prelude, A melody, B melody, chorus, interlude, A melody, B melody, chorus, interlude, C melody, chorus, and follower. The predetermined scoring interval may also be set based on the measure. A bar is a unit of music, and in 4/4 time, it is 1 bar with 4 quarter notes, and in 4/3 time, it is 1 bar with 3 quarter notes. For example, if the predetermined scoring section is set to 8 bars, the integration of absolute values of differences starts at the 1st bar, and the scoring value is calculated when the 8th bar ends.

  In the present embodiment, in the process of step SB5 of FIG. 19, the calculated score and the score of the previous section are compared, and it is determined whether or not the score is equal to or higher than the score of the previous section. In addition to this embodiment, the condition that the sound signal of the singing sound input from the singing microphone 5 is greater than or equal to a predetermined threshold volume may be included in the first condition. In the modification, the determination process using the evaluation score as a condition and the determination process using the sound volume as a condition may be alternately executed for each predetermined section.

  In the present embodiment, in the process of step SB5 of FIG. 19, the calculated score and the score of the previous section are compared, and it is determined whether or not the score is equal to or higher than the score of the previous section. Instead of this embodiment, it may be determined whether or not the evaluation score calculated in the process of step SB4 in FIG. 19 is equal to or greater than a predetermined threshold score. The predetermined threshold score may be changed based on the elapsed performance time of one song. For example, the threshold score increases each time the A-melody, B-melody, chorus, and C-melody section data is played based on the section data predetermined for each piece of music. Or, every time the scoring time Ts elapses after the music is played, the threshold score decreases. The condition that the evaluation score is equal to or greater than a predetermined threshold score is an example of the first condition of the present invention.

  In the present embodiment, for the evaluation data shown in the image database of FIG. 2, “plus” indicates that the evaluation score of the current section is equal to or higher than the evaluation score of the previous section, and “minus” indicates the current section. This indicates that the evaluation score is less than the evaluation score of the previous section. Instead of this embodiment, for evaluation data, “plus” indicates that the evaluation score calculated by the evaluation calculation means is equal to or greater than a predetermined threshold score, and “minus” indicates that the evaluation score is predetermined. It may represent that the score is less than the threshold value. The effect image data related to a good evaluation result whose evaluation score is equal to or higher than a predetermined threshold evaluation score and the effect image data related to a bad evaluation result whose evaluation score is less than a predetermined evaluation score are It is an example of the 1st type effect image data and 2nd type effect image data of invention.

  In the present embodiment, as an example of the karaoke device 2, a business karaoke device used in a karaoke store is cited. Instead of this embodiment, a device having a function that allows the user to perform karaoke, such as a consumer game machine, personal computer, mobile phone, and portable information terminal, may be used as the karaoke device.

  In this embodiment, in step SC6 of FIG. 20 and step SD6 of FIG. 21, the effect image 320 is determined based on the popularity ranking of the image database shown in FIG. Instead of this embodiment, the effect image 320 may be determined based on the popularity ranking by age, usage time zone, and singing evaluation score of the image database shown in FIG.

  Specifically, the effect image 320 is determined based on the level of popularity ranking by age corresponding to the age of the user of the karaoke apparatus. For example, the user authenticates the SNS user based on the user ID and password input from the remote controller or the like, and if the authentication is normally performed, the user is permitted to log in to the SNS. When the SNS login is permitted, the actual age of the user or the singing age is acquired from the user data stored in the karaoke host 8. Alternatively, the age of the user is acquired from the acceptance screen by displaying a screen that accepts the input of the user's age on the screen of the remote control device or the like. The level of popularity ranking by age corresponding to the acquired age is referred. When the acquired user age is 5 years, the level of “popular ranking by age (0 to 6 years)” in the image database shown in FIG. The effect image 320 set to the evaluation related image 310 having the lowest popularity ranking (0-6 years old) is determined.

  The effect image 320 is determined based on the time during which the karaoke apparatus 2 is used. For example, time data during which the karaoke device 2 is used is acquired from the karaoke device 2. When the acquired time data is 20:37, an effect image 320 in which “night: 19:00 to 22:00” in the usage time zone of the image database shown in FIG. 2 is set is determined.

  The effect image 320 is determined based on the evaluation score calculated in the process of step SB4 of FIG. For example, when the evaluation score calculated in the process of step SB4 in FIG. 19 is 66, the effect image 320 to which “B: 51 to 70” of the singing evaluation score in the image database shown in FIG. 2 is set is determined. Is done.

  In the present embodiment, in step SC6 in FIG. 20 and step SD6 in FIG. 21, the effect image 320 is determined based on the popularity ranking of the image database shown in FIG. Instead of this embodiment, the effect image 320 may be determined based on two or more of the popularity ranking of the image database shown in FIG. 2, the popularity ranking by age, the usage time zone, and the singing evaluation score.

  In the present embodiment, a large number of effect images 320 </ b> C are displayed around the captured image 300 and the displayed evaluation-related image 320 in FIG. 9. Instead of this embodiment, the effect image 320 may be displayed around the lyrics 330. By being displayed in the vicinity of the lyrics 330, the user's eyes looking at the lyrics also face the display position of the effect image 320, so that the user can easily confirm his / her own evaluation result.

  In the present embodiment, in step SB2 of FIG. 19, one evaluation related image data is randomly read from a plurality of evaluation related image data. Instead of this embodiment, an equivalent number of evaluation-related image data in which effect image data related to good evaluation results and effect image data related to bad evaluation results are set are read out. It may be displayed on the monitor 3. Specifically, step SB2 in FIG. 19 is performed so that the ratio between the positive and negative evaluation data set in the evaluation-related image data indicated by the image file name temporarily stored in the RAM in step SB3 in FIG. 19 is the same. Then, evaluation-related image data is read out.

  In this embodiment, in step SB2 of FIG. 19, the evaluation related image data is randomly read from the plurality of evaluation related image data. Instead of this embodiment, evaluation-related image data may be read based on the popularity ranking of the image database shown in FIG. Specifically, the popularity ranking levels 1 to 5 are set for all the evaluation-related image data in the image database shown in FIG. As the evaluation related image data, evaluation related image data set so that the popularity ranking levels are all different is read out. By reading out evaluation-related image data with different levels of popularity ranking, not only evaluation-related image data with low popularity by users but also evaluation image data with high popularity are read out, so the user can display the evaluation-related You can sing while visually enjoying the images.

  In the present embodiment, one evaluation related image data is read out in step SB2 of FIG. Instead of this embodiment, two or more evaluation-related image data may be read at a time. Specifically, in the first process of step SB2 in FIG. 19, a predetermined number N of evaluation related image data may be read.

  In the present embodiment, in step SE2 of FIG. 22, the effect image for which the scoring time Ts has elapsed since it was displayed and the evaluation-related image in which the effect image is set are determined as images for which display is to be ended. Instead of this embodiment, the display of the evaluation related image 310 may not be ended until the determination as to whether or not the evaluation related image has reached the predetermined number N in step SE4 of FIG. 22 is YES. Specifically, if YES is determined in step SE1 in FIG. 22, display of effect image 320 is terminated. Next, it is determined whether or not the evaluation-related images 310 have reached the predetermined number N. If YES, the display of the evaluation-related images 310 for setting the effect image 320 for which display has ended is ended. When it is determined that the predetermined number N has not been reached, the display of the evaluation-related image 310 that sets the effect image 320 whose display has ended is not ended.

  In this embodiment, in step SB3 of FIG. 19, the evaluation related image is displayed based on a predetermined coordinate value. Instead of this embodiment, the position of the user's face is specified using the face recognition technology from the image 300 captured by the camera 4, and the evaluation-related image approaches the specified position of the user's face, or You may move to a position away.

  In the present embodiment, an effect image related to the evaluation result is displayed on the monitor 3. Instead of this embodiment, the score indicating the evaluation result may be displayed on the monitor 3 together with the effect image.

  In the present embodiment, the image database in FIG. 2 is included in the scoring application stored in the HDD 21. Instead of this embodiment, the image database may be distributed from the host to the karaoke apparatus 2 via the Internet periodically, for example, once a month.

2 ... Karaoke device, 3 ... Monitor, 5 ... Singing microphone, 20 ... Control unit, 21 ... HDD (hard disk), 100 ... Music data, 110 ... Scoring application 310 ... Evaluation-related images, 320 ... Effect images

Claims (12)

Playback means for playing back music;
An evaluation calculation means for comparing the music signal representing the music reproduced by the reproduction means with the sound signal input by the input means, and calculating an evaluation score of the sound signal;
Evaluation judging means for judging whether or not the evaluation score calculated by the evaluation calculating means satisfies a first condition;
Evaluation-related image storage means for storing a plurality of evaluation-related image data;
Display control means for reading at least one evaluation related image data from the evaluation related image storage means and displaying the evaluation related image on the display unit based on the read evaluation related image data;
Effect image storage means for storing a plurality of first-type effect image data and second-type effect image data, which are effect image data set in the evaluation-related image data;
The first type effect image data or the second type effect image data is set in the evaluation related image data representing the evaluation related image displayed on the display unit, and the effect image data is set. Effect image determination means for determining whether or not a plurality of evaluation related images based on the evaluation related image data are displayed on the display unit;
When the effect image determining unit determines that a plurality of the evaluation related images represented by the evaluation related image data in which the effect image data is set are displayed, a plurality of sets respectively set in the plurality of evaluation related image data Effect image determining means for determining one effect image data based on a second condition from the effect image data of
When it is determined by the evaluation determination means that the first condition is satisfied, and a plurality of the evaluation related images represented by the evaluation related image data in which the first type of effect image data is set are displayed. If it is determined by the effect image determination means, the effect image determination means determines one of the first type of effect image data based on the second condition,
When it is determined by the evaluation determining means that the first condition is not satisfied, and a plurality of the evaluation related images represented by the evaluation related image data in which the second type of effect image data is set are displayed. If it is determined by the effect image determining means, the effect image determining means determines one second type of effect image data based on the second condition;
The karaoke apparatus, wherein the display control means reads the determined effect image data from the effect image storage means, and displays an effect image on the display unit based on the read effect image data. The display control means reads evaluation-related image data for each predetermined section of the music performance from the evaluation-related image storage means, and displays at least one evaluation-related image on the display unit based on the read evaluation-related image data And when the predetermined number of evaluation-related images displayed on the display unit has reached a predetermined number, the display of at least one evaluation-related image from the predetermined number of evaluation-related images displayed on the display unit is terminated. The karaoke apparatus according to claim 1. The display control means includes a specific effect image displayed on the display unit and effect image data representing the specific effect image when a predetermined time elapses after the specific effect image is displayed on the display unit. The karaoke apparatus according to claim 1 or 2, wherein the display of the specific evaluation-related image displayed based on the set evaluation-related image data is terminated. The evaluation calculation means compares the music signal with the sound signal, calculates an evaluation score of the sound signal for each predetermined section of the music performance,
When the time corresponding to a predetermined section of the music performance has elapsed as the predetermined time after the specific effect image is displayed on the display unit, the display control means is configured to associate the specific effect image with the specific evaluation The karaoke apparatus according to claim 3, wherein the display with the image is terminated. The display control unit is configured to display an evaluation-related image that is first displayed among a predetermined number of evaluation-related images displayed on the display unit when the predetermined number of evaluation-related images displayed on the display unit is reached. The karaoke apparatus according to any one of claims 1 to 4, wherein the display of is terminated. The evaluation calculation means compares the music signal with the sound signal, calculates an evaluation score of the sound signal for each predetermined section of the music performance,
The evaluation judging means compares the current evaluation score calculated in the current predetermined section by the evaluation calculation means with the previous evaluation score calculated in the previous predetermined section, and the current evaluation score is equal to or higher than the previous evaluation score. The karaoke apparatus according to any one of claims 1 to 5, wherein it is determined as the first condition. The effect image storage means includes the first type of effect image data related to a good evaluation result in which the current evaluation score calculated by the evaluation calculation means is equal to or higher than the previous evaluation score, and the current value calculated by the evaluation calculation means. The karaoke apparatus according to claim 6, wherein a plurality of the second-type effect image data related to a bad evaluation result whose evaluation score is less than the previous evaluation score is stored. The evaluation evaluation means determines, as the first condition, that the evaluation score calculated by the evaluation calculation means is equal to or greater than a predetermined threshold score. The karaoke device according to crab. The effect image storage means calculates the first type effect image data related to a good evaluation result in which the evaluation score calculated by the evaluation calculation means is equal to or higher than a predetermined threshold score, and the evaluation calculation means calculates The karaoke apparatus according to claim 8, wherein a plurality of the second type effect image data related to bad evaluation results whose evaluation score is less than a predetermined threshold score are stored. The said effect image determination means judges the content which at least 1 data of the multiple types of user relevant data set to the said effect image data shows as said 2nd condition. Item 10. The karaoke apparatus according to any one of Items 9. The effect image is an image including a figure that is conceptually related to the evaluation-related image,
The karaoke apparatus according to any one of claims 1 to 10, wherein the effect image storage unit stores a plurality of the effect image data representing a plurality of types of effect images that are different in conception. Reproduction means for reproducing music, evaluation signal calculation means for comparing the music signal representing the music reproduced by the reproduction means, and the sound signal input by the input means, and calculating the evaluation score of the sound signal, and evaluation Evaluation related image storage means for storing a plurality of related image data, effect image data set in the evaluation related image data, and a plurality of first type effect image data and second type effect image data. A program executed in a karaoke apparatus comprising:
An evaluation determination step of determining whether or not the evaluation score calculated by the evaluation calculation means satisfies a first condition;
A display control step of reading at least one evaluation-related image data from the evaluation-related image storage means, and displaying an evaluation-related image on a display unit based on the read evaluation-related image data;
The first type effect image data or the second type effect image data is set in the evaluation related image data representing the evaluation related image displayed on the display unit, and the effect image data is set. An effect image determination step for determining whether or not a plurality of evaluation related images based on the evaluation related image data are displayed on the display unit;
When it is determined in the effect image determination step that a plurality of the evaluation related images represented by the evaluation related image data in which the effect image data is set are displayed, a plurality of sets respectively set in the plurality of evaluation related image data An effect image determination step of determining one effect image data based on a second condition from the effect image data of
To the computer of the karaoke machine,
When it is determined by the evaluation determination step that the first condition is satisfied, and a plurality of the evaluation related images represented by the evaluation related image data in which the first type of effect image data is set are displayed. If it is determined by the effect image determination step, the effect image determination step determines one first type of effect image data based on the second condition;
When it is determined in the evaluation determination step that the first condition is not satisfied, and a plurality of the evaluation related images represented by the evaluation related image data in which the second type of effect image data is set are displayed. If it is determined by the effect image determination step, the effect image determination step determines one second type of effect image data based on the second condition;
The display control step reads the determined effect image data from the effect image storage means and causes the display unit to display an effect image based on the read effect image data.

Images