JP6624982B2 - Karaoke system - Google Patents

Description

  The present invention relates to a karaoke system for singing along with an accompaniment.

  Conventionally, in karaoke boxes and night shops, karaoke for enjoying singing along with accompaniment has been performed. Some karaoke apparatuses used for performing accompaniment in karaoke are provided with various additional functions in addition to simply performing accompaniment.

  Patent Literature 1 discloses that a target vocal level to be uttered by a singer is displayed, and the input vocal level actually input by the singer and input from a microphone is compared with the target vocal level. There is disclosed a voice volume level determination system that reports whether or not the user is uttering voice at a voice volume. With such a configuration, the singer can check whether or not the singer can generate the voice at the target voice volume level.

  Further, in Patent Document 2, a part of the lyrics telop displayed on the TV monitor is hidden, and it is determined whether or not the lyrics sung by the singer are correctly pronounced in one song or a specific performance range. A karaoke apparatus with a singing ability scoring game function for scoring and evaluating is disclosed.

  Patent Document 3 discloses a physical condition judging unit that judges a user's physical condition based on input information about a sound, and a music reproducing device that displays a result determined by the physical condition judging unit.

JP 2013-15554 A JP 2007-114492 A JP-A-2004-226589

  Patent Literature 1 to Patent Literature 3 disclose that when playing a music, vocal volume is determined by singing (Patent Literature 1), whether the user remembers the lyrics (Patent Literature 2), and the physical condition of the user by singing. (Patent Document 3) is disclosed. The music used in these prior arts is a music selected by the user himself. By the way, when performing a diagnosis using a singing voice, it is conceivable that there is a piece of music suitable for the item to be diagnosed or a piece of music that is not suitable. However, the music suitable for the item to be diagnosed is not always the music that the user likes. Therefore, when the diagnosis is performed using music suitable for the item to be diagnosed, the user may not be able to enjoy the singing and may be distressed, and the diagnosis may not be appropriate.

  In view of such circumstances, an object of the present invention is to provide a karaoke system that allows a user to make a proper diagnosis while enjoying a song.

Therefore, the karaoke system according to the present invention is characterized by adopting the following configuration.
A login process for logging in the user,
Diagnosis items, and music selection processing of selecting music corresponding to the user information of the user performing music selection,
At the time of reproduction of the music selected in the music selection processing, lyrics display processing for controlling display of the lyrics of the music in accordance with the diagnosis item;
Diagnostic value calculation processing for voice-recognizing a singing voice input to the microphone, and calculating a diagnostic value based on a matching rate between the displayed lyric character and the recognized lyric character ,
And a notification process of notifying a diagnosis result based on the diagnosis value calculated in the diagnosis value calculation process .

Further, in the karaoke system according to the present invention,
The lyrics display processing changes the size of the lyrics displayed on the display means,
The diagnostic value calculation processing is characterized in that a diagnostic value is calculated based on a matching rate between the lyrics character recognized as speech and the displayed lyrics character .

Further, in the karaoke system according to the present invention,
The lyric display processing is characterized by displaying lyric characters different from the lyrics specified in the music.

Further, in the karaoke system according to the present invention,
The lyrics display process hides some of the lyrics characters displayed on the display means,
The diagnostic value calculation processing is characterized in that a diagnostic value is calculated based on a matching rate between the lyrics character recognized as speech and the displayed lyrics character .

Further, in the karaoke system according to the present invention,
The music selection process is characterized by using history information of the selected music in the user information.

Further, in the karaoke system according to the present invention,
The music selection process is characterized by using, in the user information, registration information in which the user has registered a song or singer.

Further, in the karaoke system according to the present invention,
The music selection process is characterized in that one diagnosis item can be selected from a plurality of diagnosis items.

Further, in the karaoke system according to the present invention,
The music selection process selects multiple songs with different diagnostic items,
A plurality of pieces of music selected in the music selection processing are reproduced in a medley form, so that diagnosis of a plurality of diagnostic items is performed.

  ADVANTAGE OF THE INVENTION According to the karaoke system which concerns on this invention, a diagnosis is performed using the music corresponding to the user information of the user who performs a diagnosis item and music selection, and a user can perform a diagnosis appropriately, enjoying a song. It becomes possible.

The figure which shows the karaoke system of this embodiment Diagram showing various data structures used in the present embodiment FIG. 7 is a diagram illustrating a top screen at the time of login according to the present embodiment. FIG. 3 is a diagram illustrating a data configuration of user information used in the present embodiment. Flow chart showing music selection processing (at the time of a medical examination) of the present embodiment The figure which shows the diagnosis item selection screen of this embodiment. The figure which shows the music confirmation screen of this embodiment Flow chart showing music playback processing of the present embodiment Flow chart showing visual acuity diagnosis processing of the present embodiment FIG. 7 is a diagram for explaining screen transition during visual acuity diagnosis according to the present embodiment. FIG. 5 is a diagram illustrating a diagnosis result display screen during visual acuity diagnosis according to the present embodiment. Flow chart showing the memory diagnostic processing of the present embodiment FIG. 7 is a view for explaining a screen transition at the time of memory ability diagnosis according to the present embodiment. Flow chart showing voice volume diagnosis processing of the present embodiment Flow chart showing the hearing diagnosis processing of the present embodiment FIG. 4 is a diagram illustrating a screen at the time of a hearing diagnosis according to the present embodiment. FIG. 7 is a diagram illustrating a diagnosis result display screen at the time of comprehensive diagnosis according to the present embodiment.

  FIG. 1 is a diagram showing a configuration of the karaoke system of the present embodiment. The karaoke system according to the present embodiment includes a karaoke device 2 (sometimes called a commander) and a remote control device 1. The karaoke device 2 and the remote control device 1 are connected so as to form a network using the LAN 100 and the access point 130.

  The karaoke apparatus 2 installed in a store such as a karaoke box includes an acoustic control unit 25 as a playing unit for playing music. In addition, the karaoke apparatus 2 includes an operation unit 21 that receives various inputs from a user. The karaoke apparatus 2 includes an operation processing unit 22 that interprets an input from the operation unit 21 and transmits the input to the CPU 30. Further, the karaoke apparatus 2 includes a hard disk 32 as a storage unit for storing various information. The karaoke apparatus 2 includes a LAN communication unit 24a as communication means for connecting to the LAN 100 and joining the network. The karaoke apparatus 1 according to the present embodiment also includes a wireless LAN communication unit 24b, and performs wireless network connection using the wireless LAN communication unit 24b instead of wired network connection using the LAN communication unit 24a. Is also possible.

  In addition, the karaoke apparatus 2 includes a video playback unit that displays a lyrics video and a background video on the monitor 41. The video playback means includes a video playback unit 29 for playing back a video based on video information, a video RAM 28 for temporarily storing the video to be played back, a video for superimposing lyrics telop on the played back video, and giving a video effect. The control unit 31 is provided.

  Further, in the karaoke apparatus 2, various information can be displayed on the touch panel monitor 33 in addition to the monitor 41 connected to the outside. The touch panel monitor 33 includes a display unit 35 that displays video information input from the video control unit 31 and a touch panel 34 that outputs a touch input position to the operation processing unit 22. The touch panel monitor 33 functions as an input unit, like the operation unit 21 of the karaoke apparatus 2 or the touch panel monitor 11 of the remote control device 1. The user can perform various operations on the karaoke device 2 such as making the karaoke device 2 make a reservation directly by selecting a song on the touch panel monitor 33.

  Further, the karaoke apparatus 2 is configured to include a control unit including a CPU 30 for integrally controlling each component, and a memory 27 for temporarily storing information necessary for executing various programs.

  With such a configuration, the karaoke apparatus 2 executes various processes. As the main functions of the karaoke apparatus 2, music reservation processing and music reproduction processing can be executed. The music reservation process is a process for designating and reserving music based on a designation from a user, and is executed in cooperation with the remote control device 1. The reservation information formed by the music selection processing of the remote control device 1 is transmitted to the karaoke device 2. The karaoke apparatus 2 registers the received reservation information in a reservation table in the memory 27. The music reproduction process is a process of reproducing a reserved music, and is a process in which the music performance process and the lyrics display process are executed in synchronization.

  The music performance process is a process of causing the acoustic control unit 25 to perform a performance based on the performance information included in the music information. The music played by the sound controller 25 is emitted from the speaker 42 together with the singing voice input from the microphones 43a and 43b. The lyrics display processing is processing for performing singing assistance by displaying the lyrics information included in the music information on the monitor 41. A background video display process may be performed to display a background video superimposed on the lyrics displayed in the lyrics display process.

  On the other hand, the remote control device 1 can execute a music selection process of searching for a music based on an instruction from the user and transmitting reservation information to the karaoke device 2 for the music for which the reproduction instruction has been given. Further, the remote control device 1 can receive various information from the karaoke device 2 or the host device 5 connected to the Internet and execute various processes. In the present embodiment, an operation unit 17 and a touch panel monitor 11 are provided as a user interface for receiving various instructions from a user. The touch panel monitor 11 includes a display unit 11a and a touch panel 11b, displays various interfaces on the display unit 11a, and can receive a touch input from a user.

  Further, the remote control device 1 serves as a storage unit for storing a database, various programs required for music selection processing, and various information generated in accordance with the execution of the programs, and a memory 14 for controlling these components collectively. And a remote control unit. The remote controller includes a CPU 15, a video controller 13 for forming a video to be displayed on the touch panel monitor 11, a video RAM 12 for temporarily storing video information to be displayed, and an input from the touch panel monitor 11 or the operation unit 17. And an operation processing unit 18 for transmitting the information to the CPU 15.

  The remote control device 1 is connected to the network constituted by the LAN 100 by being wirelessly connected to the access point 130 by the wireless LAN communication unit 16. Each remote control device 1 is associated with a specific karaoke device 2 in advance. Various commands output from the remote control device 1 are received by the associated karaoke device 2.

  With such a configuration of the remote control device 1, the karaoke device 2 can receive various inputs from the user from the touch panel monitor 11 or the operation unit 17, and provide video information to the karaoke device 2 by providing various information through display on the touch panel monitor 11. Various processes, such as a music selection process of transmitting reservation information to be output to the user, can be performed.

  FIG. 2A is a diagram illustrating a data configuration of music information according to the present embodiment. The music information has meta information including various information related to the music information and actual information for executing various processes such as performance and display of lyrics. The meta information includes song IDs for identifying song information, song titles, singer names, genres, and other song-related information. The music-related information can be used as a search target item when the user searches for music. The actual information of the music information includes performance information, lyrics information, background video information, and the like. The performance information is control information for an electronic musical instrument based on the MIDI standard, or information for playing a karaoke accompaniment sound, including compressed audio information obtained by recording an actual performance. The lyrics information is information displayed in synchronization with the performance information to assist the singing, and the color of the displayed lyrics may be changed in synchronization with the performance. The singing evaluation information is information for evaluating the singing voice of the user at the time of music reproduction, and includes melody to be sung. When performing singing evaluation at the time of music reproduction, by comparing the singing voice input to the microphones 43a and 43b with the singing evaluation information, it is possible to calculate a score value and the like.

  The karaoke system according to the present embodiment is capable of performing a health check on various items of a singing user when reproducing music information. When performing a health check, music that is appropriate for the item of the health check is used. Also, in order to use information about the singing user, the user logs into the karaoke system and selects a song.

  FIG. 3 is a diagram illustrating a top screen at the time of login according to the present embodiment. The top screen is a screen displayed when the user logs in to the karaoke system. Here, the top screen when the user logs in using the remote control device 1 is shown. In the present embodiment, considering that a plurality of users use the karaoke, a plurality of users can log in at the same time. Information on a plurality of logged-in users is displayed above the top screen. In the login user column 103, alternation images 103a to 103e (in this embodiment, face portions) of the user who is logged in to the karaoke system are displayed. In the login user column 103, the user whose background is highlighted (white) at the right end is the active user 103e (Mr. A in this example), and a service for the active user 103e, that is, user information of the active user 103e. The service using is running. Switching of the active user can be performed by operating the user switching button 101. A user who has not registered as a user can operate the guest button 102 to use the karaoke system as a guest user.

  FIG. 4 is a diagram for explaining user information stored for each user registered as a member. In the present embodiment, the user information includes various information about the user, such as personal information, registered music information (my song), registered singer information (my artist), and history information.

  The user information is associated with a user ID and a password for the user to log in and use the information. The personal information includes a user name (not limited to an actual name, but may be a nickname), gender, age, and the like. These various types of information can be set by logging in using the remote control device 1 or a personal computer or a portable information terminal connected to the network.

  The registered music information (my song) contains music registered by the user and includes at least a music ID for identifying the music. In addition, the highest score (scoring information) scored when singing, a pitch setting value for adjusting to the singing range of the user, and the like may be registered. By reading out the registered music information, the user can easily select music registered in advance.

  The singer registered by the user is registered in the registered singer information (my artist), and includes a singer ID for identifying the singer. By calling up the registered singer information, the user can read a singer registered in advance, and can easily select a song related to the singer by referring to the database.

  The history information records the songs selected by the user so far, and includes performance date and time, song ID, singing date and time, interval setting value, scoring information, and the like. The scoring information is information indicating a result of the scoring unit when singing, and the pitch setting value is information indicating a pitch set when singing.

  In the present embodiment, it is also possible to select a song recorded in the history information. By performing music selection using the history information, the user can play the music specified in the past again.

  On the top screen, a menu display column 104 for using various services in the karaoke system is displayed. By operating the button described as “health checkup”, a music selection process for the health checkup by karaoke is started. FIG. 5 is a flowchart showing the music selection processing (at the time of a health check) of the present embodiment. In the present embodiment, a user can select a desired diagnosis item from a plurality of diagnosis items and perform a health check. Therefore, when the button labeled "Health Diagnosis" is selected on the top screen of FIG. 3, a diagnostic item selection screen is displayed, and the user selects a desired diagnostic item (S101).

  FIG. 6 is a diagram illustrating a diagnosis item selection screen according to the present embodiment. In the present embodiment, it is possible to select any one of the four diagnostic items (sight, memory, voice volume, and hearing). Therefore, diagnosis item selection buttons 105a to 105d corresponding to the respective diagnosis items are provided. By the way, when performing a diagnosis, it is conceivable that a trader prepares music suitable for each diagnosis item or music dedicated to the diagnosis item. However, in such a case, if the music is unknown to the user, it may be impossible to sing well or it may not be fun to sing. In the present embodiment, by referring to the music selection history of the user and using a song sung by the user in the past or a song related to the song, the user can perform a health check while enjoying the song.

  First, a case where visual acuity is selected as a diagnostic item, that is, a case where a visual acuity diagnostic item selection button 105a is selected on the diagnostic item selection screen (S103: visual acuity) will be described. First, the history information of the active user who is performing the music selection is obtained (S104). As described with reference to FIG. 4, the history information is configured to include a set of a performance date and a music ID of the music selected by the karaoke system. When visual acuity is used as a diagnostic item, in the case of a recently sung song, it is possible that the user has memorized the lyrics. In the present embodiment, one piece of music selected from music pieces selected a predetermined time or more in the history information is selected as a music piece used for visual acuity diagnosis (S105). When a song is selected, a song confirmation screen is displayed to allow the user to confirm whether the song is acceptable (S106).

  FIG. 7 is a diagram illustrating a music confirmation screen according to the present embodiment. The music confirmation screen according to the present embodiment is provided with various music-related information items such as a singer name, a song name, and a song start, similarly to the normal (non-health checkup) music selection process. In the visual acuity diagnosis, since the user's visual acuity is determined based on whether or not the lyrics are visible, the item of singing out of the music related information is not displayed. The user uses the displayed singer name and song name to check whether the song is a song to be sung. In the present embodiment, since the karaoke system is automatically selected, if the user does not want to sing the selected music, the user can change the music by operating the reselection button 106. When the reselection button 106 is operated (S117: Yes), the music is selected again for the selected diagnosis item, and the music confirmation screen is displayed. At that time, it is preferable to exclude the music once selected. On the other hand, when singing the song displayed on the song confirmation screen, the user operates the reservation button 107. In this embodiment, a pitch setting section 105 is provided for setting a pitch change (key change) during performance in advance. In the pitch setting section 105, it is possible to make a reservation by changing to a desired pitch setting value.

  When the reservation button 107 is operated (S118: Yes), the reservation information is transmitted from the remote control device 1 to the karaoke device 2 (S119). FIG. 2B is a diagram showing a data structure of the reservation information. The reservation information includes a music ID corresponding to the music displayed on the music confirmation screen, a user ID corresponding to the active user who made the reservation, a pitch setting value set using the pitch setting column 105, and a diagnosis item. Have been. The diagnosis items are "0": normal song selection and no diagnosis item designation, "1": visual acuity as a diagnosis item, "2": memory ability as a diagnosis item, "3". : When the voice volume (vital capacity) is set as the diagnostic item, "4": An identifier when the hearing is set as the diagnostic item is described. The karaoke apparatus 2 that has received the reservation information adds the reservation information to the reservation table stored and managed in the memory 27.

  In the music selection processing according to the present embodiment, the user selects the music selection based on the diagnosis item and the history information of the user on the music confirmation screen described with reference to FIG. The form which does not use is also considered. In such a case, it is conceivable that the user does not know who the music is for when reproducing the music. Therefore, a device such as notifying the user name at the start of the music reproduction can be considered. Such a form in which it is not known which music is to be reproduced until the reproduction is started is effective when the visual acuity or the memory is used as a diagnostic item because the user cannot confirm the lyrics before the reproduction of the music is started. Further, the reselection button 106 provided on the music confirmation screen in FIG. 7 may not be provided, so that reselection may not be performed. Alternatively, a configuration may be adopted in which a plurality of songs suitable for the condition are presented as candidates, and the user can select from the presented songs. In such a form, when memory is used as a diagnostic item, it is also possible to present the memory information for each level of memory diagnostic based on the performance date and time in the history information. In this case, the older the performance date and time, the higher the memory diagnosis level is set.

  Similarly, for the diagnosis items (memory, voice volume, and hearing) other than the visual acuity, the music selection is performed using the history information, but the content is different in the music selection method. When memory is selected as a diagnostic item (S103: memory), the music selected before a predetermined period or more is targeted for music selection, as in the case of visual acuity, by referring to the history information of the user. When the voice volume is selected as the diagnosis item (S103: voice volume), a song including a long tone portion (a portion of the song that is sung for a long time) in the user's history information is selected. When hearing is selected as a diagnosis item (S103: hearing), a music piece whose interlude portion is as quiet as possible is selected. In addition, in any of the diagnosis items, when there is no music that satisfies the condition in the history information, the music corresponding to the singer of the music in the history information may be selected as the music selection target, so that the music selection target may be expanded. Alternatively, it is conceivable to expand the music selection target to music corresponding to the music genre in the history information. Such a song is likely to be a song that the user can sing or a song that is interesting, so that it is a song that can be sung happily even when performing a medical examination. In addition, when the visual acuity was used as the diagnostic item, the singing out item was not displayed in the music confirmation screen, but when the memory was used as the diagnostic item, it was tested whether or not the lyrics were stored. Similarly to the above, it is preferable that the item of singing out is not displayed.

  The karaoke apparatus 2 plays the reserved music by executing the music reproduction processing. FIG. 8 is a flowchart showing the music reproduction processing of the present embodiment. The karaoke apparatus 2 checks the reservation table stored and managed in the memory 27, and checks the music to be played (S201). If there is a song to be reproduced next (S202: Yes), the diagnosis item included in the reservation information is checked, and whether or not the diagnosis item is specified is checked. When the diagnosis item has not been specified (S203: No). The music information corresponding to the music ID in the reservation information is read and the reproduction of the music is started (S208). When the reproduction of the music is completed (S209: Yes), the process returns to the beginning of the music reproduction processing, and the next music to be reproduced is confirmed.

  On the other hand, when the diagnosis item is specified in the reservation information (S203: Yes), the music information corresponding to the music ID in the reservation information is read and the reproduction of the music is started (S204). At that time, diagnostic processing (S210, S220, S230, S240) corresponding to the specified diagnostic item is executed.

  First, the visual acuity diagnosis process (S210) executed when the visual acuity is designated as the diagnosis item will be described. FIG. 9 is a flowchart showing the visual acuity diagnosis processing (S210) of the present embodiment, and FIG. 10 is a diagram for explaining screen transition during visual acuity diagnosis of the present embodiment. In the eyesight diagnosis processing, the size of the lyrics displayed on the monitor 41 is changed, and the eyesight is diagnosed based on whether or not the displayed lyrics have been sung. Like the normal lyrics display processing, the lyrics are displayed on the monitor 41 for each predetermined phrase (S211). FIG. 10A shows a screen of the monitor 41 during visual acuity diagnosis. At the start of music reproduction, lyrics characters 401a are displayed in a standard size. The karaoke apparatus 2 acquires the lyrics sung by the user by recognizing the singing voice input to the microphones 43a and 43b (S212).

  If the coincidence rate between the displayed lyric character and the recognized lyric character is equal to or greater than a predetermined value (S213: Yes), the visual acuity diagnosis value is updated to be highly evaluated (S214). Then, the lyrics size is set small (S215). The lyrics phrase displayed next is displayed according to the set lyrics size. FIG. 10 (B) shows an example of a screen when it is diagnosed that the lyrics characters 401a displayed in FIG. 10 (A) have been sung, that is, the lyrics characters displayed on the monitor 41 have been read. . On the monitor 41, a lyrics character 401b having a smaller lyrics size than the lyrics characters 401a is displayed. As described above, at the time of the visual acuity diagnosis, the lyrics size is changed until the user becomes illegible, thereby making a diagnosis as to how small a character the user can read.

  On the other hand, when the matching rate between the displayed lyrics and the lyrics recognized by speech is lower than a predetermined value (S213: No), the visual acuity diagnosis value is updated to be low (S216). Then, the lyrics size is set large (S217). FIG. 10C shows an example of a screen when it is diagnosed that the lyrics characters 401a displayed in FIG. 10A cannot be sung, that is, the lyrics characters displayed on the monitor 41 cannot be read sufficiently. It is shown. On the monitor 41, the lyrics characters 401b having a larger lyrics size than the lyrics characters 401a are displayed. As described above, in the present embodiment, by changing the size of the displayed lyric character, it is possible to determine how small a character that the subject user can read is.

  If it is determined that the reproduction of the music has been completed (S218: Yes), the process returns to the music reproduction processing of FIG. 8, and the diagnosis result is displayed on the monitor 41 (S207). FIG. 11 is a diagram illustrating a diagnosis result display screen during visual acuity diagnosis according to the present embodiment. In the present embodiment, during the visual acuity diagnosis processing, the visual acuity diagnostic value updated in S214 and S216 and the visual acuity age obtained by converting the visual acuity diagnostic value into age are displayed. The user can check the diagnosis status of his or her visual acuity by referring to the diagnosis result display screen.

  In the karaoke system, the size of the displayed lyric character may vary depending on the size of the monitor 41 used. Therefore, it is preferable to set the size (such as the number of inches) of the monitor 41 used in the karaoke apparatus 2. At the time of visual acuity diagnosis, the user is notified based on the set size of the monitor 41, "Please sing at a position xx meters away from the monitor." Alternatively, when the distance to be diagnosed is determined, the size of the lyric character may be changed according to the distance to be diagnosed.

  Also, at the time of visual acuity diagnosis, it is not always necessary to display lyrics based on the lyrics information included in the music information. For example, lyrics characters different from the original lyrics information may be displayed, such as changing the words of the lyrics information to random words, exchanging the lyrics of A melody and B melody. In this case, the visual acuity diagnosis is performed by comparing the displayed lyrics and the voice recognition result of the singing voice. It is also possible to perform an accurate eyesight diagnosis on a song for which the user remembers the lyrics.

  Next, the memory diagnosis process (S220) executed when the memory is specified as the diagnosis item will be described. FIG. 12 is a flowchart illustrating the memory diagnosis process (S220) according to the present embodiment, and FIG. 13 is a diagram illustrating a screen transition during the memory diagnosis according to the embodiment. In the memory diagnosing process, a part of the lyrics displayed on the monitor 41 is hidden, and the memory is diagnosed based on whether the displayed lyrics can be sung. In the memory ability diagnosis processing (S220), first, a non-display part is provided and displayed in the lyrics phrase displayed on the monitor 41 (S222). FIG. 13A shows a screen of the monitor 41 during the memory ability diagnosis. Some lyrics are hidden from the displayed lyrics characters 401d. In the present embodiment, an asterisk “*” is displayed for each character of the hidden lyrics. It is conceivable that the non-display portion in the lyrics character is determined at random or set in advance in the lyrics information. The karaoke apparatus 2 acquires the lyrics sung by the user by recognizing the singing voice input to the microphones 43a and 43b (S222).

  If the matching rate between the non-displayed lyric character and the lyric character recognized by voice is equal to or greater than a predetermined value (S223: Yes), the memory diagnostic value is updated to be highly evaluated (S224). Then, the number of non-display characters is set to be increased (S225). The phrase of the lyrics to be displayed next is displayed using the enlarged non-display portion. FIG. 13B shows an example of a screen when a non-display portion of the lyrics character 401d displayed in FIG. 13A can be sung. The monitor 41 displays a lyric character 401e having a non-display portion in which the number of characters is increased as compared with FIG. 13B. In this way, at the time of memory ability diagnosis, a diagnosis to test the memory ability of the user is performed by increasing the number of characters in the non-display portion.

  On the other hand, if the coincidence rate between the non-displayed lyric character and the lyric character recognized by voice is smaller than a predetermined value (S223: No), the memory diagnostic value is updated so as to have a low evaluation (S226). Then, the number of non-display characters is set to decrease (S227). FIG. 13C shows an example of a screen when the lyrics characters in the lyrics characters 401d displayed in FIG. 13A cannot be sung. On the monitor 41, the lyrics characters 401f in which the number of characters in the non-display portion is smaller than the lyrics characters 401d are displayed. As described above, in the present embodiment, when the user does not remember the lyrics on the previous screen, the degree of the hint given to the user is changed by reducing the number of characters in the non-displayed part on the next screen. .

  If it is determined that the reproduction of the music has been completed (S228: Yes), the process returns to the music reproduction processing of FIG. 8, and the diagnosis result is displayed on the monitor 41 (S207). As in the case where the visual acuity has been diagnosed, the diagnostic result display screen (not shown) displays the memory diagnostic value and the memory age obtained by converting the memory diagnostic value into the age.

  When the diagnosis items described above are “sight” and “memory”, lyrics display processing for controlling the display of the lyrics of the music in accordance with the diagnosis items is executed, so that the diagnosis items such as “sight” and “memory” are displayed. The corresponding diagnosis is executed.

  Next, the memory ability diagnostic processing (S230) executed when the voice volume is designated as the diagnostic item will be described. FIG. 14 is a flowchart showing the voice volume diagnosis processing (S230) of the present embodiment. In the voice volume diagnosis processing, the user's voice volume is diagnosed based on how long a stable singing was performed without taking a breath using a long tone portion in the music. In a sense, it can also be referred to as spirometry diagnosis. In the voice volume diagnosis, a long tone portion is detected during the music reproduction period. The long tone part is a part that sings after being extended for a long time. It can be determined by analyzing performance information or by describing in advance in the performance information that it is a long tone part. It is. When the performance reaches the long tone portion, the singing voice input to the microphones 43a and 43b is acquired (S233), and the singing voice is determined to be persistent or stable (S234). Persistence can be determined using the duration of the singing voice in the long tone portion. Further, the stability can be determined by comparing the singing evaluation information and the singing voice in the music information. The voice volume diagnostic value is updated based on the determined continuity and stability of the singing voice (S235).

  When it is determined that the reproduction of the music has been completed (S231: Yes), the process returns to the music reproduction processing of FIG. 8, and the diagnosis result is displayed on the monitor 41 (S207). The diagnosis result display screen (not shown) displays the voice volume diagnosis value and the memory age obtained by converting the voice volume diagnosis value into age.

  Next, the hearing diagnosis process (S230) executed when the hearing is designated as the diagnosis item will be described. FIG. 15 is a flowchart showing the hearing diagnosis processing (S230) of the present embodiment, and FIG. 16 is a diagram showing a screen at the time of hearing diagnosis of the present embodiment. The hearing diagnosis processing is performed using the interlude section of the music. A test sound different from the music is output from the speaker 42 in the interlude section of the music, and the hearing is diagnosed by inputting sounds from the microphones 43a and 43b to notify the user of the hearing. Since the interlude section is a portion where no singing is performed, it can be determined from the lyrics information. Alternatively, the performance information or the like may preliminarily define the interlude interval.

  During the performance period (S242: Yes), the karaoke apparatus 2 outputs the inspection sound from the speaker 42 at appropriate timing (S233). As shown in FIG. 16, during the interlude interval, the test sound flows (is emitted) on the monitor 41, and when the test sound is heard, the action to be taken by the user (in this example, the microphones 43 a and 43 b indicate “ "I heard it." The karaoke apparatus 2 recognizes the singing voice input to the microphones 43a and 43b during the interlude period, and monitors a signal from the user that "I heard it". The test sound is output and a signal from the user is confirmed within a certain period of time, that is, if there is a voice input during a period corresponding to the test sound output timing (S234: Yes), the hearing diagnosis value is evaluated as high. Is updated (S235). On the other hand, if there is no voice input during the period according to the test sound output timing (S234: No), the audio diagnostic value is updated so as to have a low evaluation (S236). Further, in the present embodiment, when the test sound cannot be heard (S234: Yes), the volume of the test sound is greatly changed to make it easier to hear, and the test sound that can be heard by the user can be determined. Instead of changing the volume of the test sound, the frequency of the test sound may be changed to a frequency band that is easy to hear.

  When it is determined that the reproduction of the music has been completed (S241: Yes), the process returns to the music reproduction processing of FIG. 8, and the diagnosis result is displayed on the monitor 41 (S207). A diagnosis result display screen (not shown) displays a hearing diagnosis value and a memory age obtained by converting the hearing diagnosis value into an age.

  Although the karaoke system of the present embodiment has been described as performing a health check on various items, the karaoke system of the present embodiment performs a diagnosis item based on history information indicating songs selected by the user so far. By selecting a song that is suitable for the music, the user can use the song that the user knows or is interested in, sing the song happily, and perform a health checkup. In the karaoke system according to the present embodiment, one of four diagnostic items is selected. However, a diagnosis may be performed on a plurality of diagnostic items. For example, a form is conceivable in which a plurality of diagnosis items and one piece of music corresponding to the history information are selected, and the diagnosis of the plurality of diagnosis items is performed during the music piece reproduction processing of one piece of music. However, in such an embodiment, since the conditions for music selection become strict, it is conceivable that the music to be selected is limited, or there is no music to be selected. Therefore, the music corresponding to the history information may be selected for each diagnosis item, and the selected music may be reproduced in a medley format. During the playback period of each song played in the medley format, a diagnosis is performed on a diagnostic item corresponding to each song being played, and a diagnostic value for each diagnostic item is calculated.

  FIG. 17 is a diagram showing a diagnosis result display screen at the time of comprehensive diagnosis according to the present embodiment, which is a diagnosis result display screen when a diagnosis is made for a plurality of diagnosis items. In this example, four diagnostic items of visual acuity, memory, voice volume, and hearing are performed. For each diagnostic item, a diagnostic value, a value obtained by converting the diagnostic value to age, and all diagnostic items are used. The calculated health age is displayed as the comprehensive evaluation. In this way, it is also possible to diagnose a plurality of diagnosis items in one music reproduction process. In addition, a diagnosis item may be set in advance as a comprehensive diagnosis in addition to a form selected by the user for each diagnosis item.

  Also, in the present embodiment, the user is familiar with the history information in the user information and selects the music suitable for the diagnosis item, but only the music related to the history information in the user information is selected. Alternatively, the personal information, the registered music information, and the registered singer information may be used to select the music related to the user. For example, when using registered music information, it is conceivable to select music registered in the registered music information. When the registered singer information is used, it is conceivable to select a song of the singer registered in the registered singer information. Alternatively, a song may be selected by combining a plurality of pieces of personal information, registered song information, registered singer information, and history information.

  Although the present invention has been described using the karaoke system, the present invention is not limited to the karaoke system. At present, a form in which karaoke is performed on a smartphone by installing an application (program) on the smartphone is also known. A karaoke program that realizes the functions of the present invention by being installed in such an information processing device such as a smartphone also belongs to the category of the present invention.

1: Remote control device 30: CPU
2: Karaoke device 31: Video control unit 5: Host device 32: Hard disk 11: Touch panel monitor 33: Touch panel monitor 11a: Display unit 34: Touch panel 11b: Touch panel 35: Display unit 12: Video RAM 41: Monitor 13: Video control unit 42: Speaker 14: Memory 43a, 43b: Microphone 15: CPU 101: User switching button 16: Wireless LAN communication unit 102: Guest button 17: Operation unit 103: Login user column 18: Operation processing unit 103a to 103e: Alternate image 21 : Operation unit 104: menu display column 22: operation processing unit 105: pitch setting column 24a: LAN communication units 105a to 105d: diagnostic item selection button 24b: wireless LAN communication unit 106: reselection button 25: sound control unit 107: reservation button 7: memory 130: access point 28: Video RAM 401a~401d: lyrics character 29: video playback unit

Claims (8)

A login process for logging in the user,
Diagnosis items and music selection processing for selecting music corresponding to the user information of the user performing music selection,
At the time of reproduction of the music selected in the music selection processing, lyrics display processing for controlling display of the lyrics of the music in accordance with the diagnosis item;
Diagnostic value calculation processing for voice-recognizing a singing voice input to the microphone, and calculating a diagnostic value based on a matching rate between the displayed lyric character and the recognized lyric character ,
A karaoke system for performing a notification process of notifying a diagnosis result based on the diagnosis value calculated in the diagnosis value calculation process . The lyrics display processing changes the size of the lyrics displayed on the display means,
2. The karaoke system according to claim 1, wherein the diagnostic value calculation processing calculates a diagnostic value based on a matching rate between the lyrics characters recognized by the voice and the displayed lyrics characters . 3. The karaoke system according to claim 2, wherein the lyric display processing displays lyric characters different from the lyrics specified in the music. The lyrics display process hides some of the lyrics characters displayed on the display means,
2. The karaoke system according to claim 1, wherein the diagnostic value calculation processing calculates a diagnostic value based on a matching rate between the lyrics characters recognized by the voice and the displayed lyrics characters . 3. The karaoke system according to any one of claims 1 to 4, wherein the music selection process uses history information of the selected music in the user information. The karaoke system according to any one of claims 1 to 5, wherein the music selection process uses registration information in which a song or a singer is registered by the user in the user information. The karaoke system according to any one of claims 1 to 6, wherein the music selection process allows one diagnostic item to be selected from a plurality of diagnostic items. The music selection process selects multiple songs with different diagnostic items,
The karaoke system according to any one of claims 1 to 6, wherein a plurality of diagnosis items are diagnosed by reproducing a plurality of music pieces selected in the music selection processing in a medley format.