JP2013050670A - Karaoke device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a karaoke device for efficiently assisting improvement of singing in the first line of a song.SOLUTION: A karaoke device comprises a performance evaluation means 98 for evaluating performance in the first line of a song related to switching to a singing section where a guide melody is output, according to a predetermined relation on the basis of voice information input by a microphone 40, at the time of the switching to the singing section after a non-singing section has continued for a specified time or more, where a guide melody corresponding to a vocal part of the song has not been output. Therefore, it can be objectively determined whether or not the first line of each song related to the switching from the non-singing section to the singing section in the song can be properly sung.

Description

  The present invention relates to a karaoke apparatus used in a karaoke box or the like, and more particularly, to an improvement for efficiently assisting the improvement of singing.

  2. Description of the Related Art A karaoke apparatus is known that outputs a performance song selected from a large number of performance songs and displays a lyric text image of the performance song on a video display device. According to such a karaoke device, the music information of the karaoke performance song selected (selected) by the remote control device or the like from a large number of karaoke performance songs stored in the storage device in advance is output, and the lyrics information of the karaoke performance song is output. By displaying the included video on the screen in synchronization with the output, it is possible to enjoy the karaoke performance of the desired song.

  In the karaoke performance by the karaoke apparatus, it has been pointed out that it is difficult to sing a singing song in the performance music, for example, a so-called A melody part that should be spoken first from the prelude in each performance music. That is, the timing of such a singing part cannot be grasped, and there are many users who cannot sing even though the vocal part has been started or the vocal part has started, and this tendency was particularly strong for karaoke beginners. In order to solve such a problem, a technique for supporting the singing of the singing portion has been proposed. For example, it is a karaoke apparatus described in Patent Document 1. According to this technology, the sound signal collected by the microphone is emitted, and the guide sound for supporting the singing of the singer is emitted toward the singing position of the singer, so that other customers It is said that only the singer can hear the guide sound that supports the singing without being noticed, and can support the singing portion suitably.

JP 2008-209597 A

  However, since the conventional technique merely emits a guide sound to the singer, even if the singing portion is sung according to the guide sound, the singing portion is correctly sung by the user. It was not possible to judge objectively whether or not it was possible. For this reason, there was an adverse effect that it did not lead to drastic improvement in singing skills in the singing part and had to rely on guide sounds forever. In other words, karaoke equipment that efficiently assists the improvement of singing has not yet been developed, and such problems have been studied by the present inventors with the intention of improving the usability of the karaoke equipment. It was newly found in the process of continuing.

  The present invention has been made against the background of the above circumstances, and an object of the present invention is to provide a karaoke apparatus that efficiently assists the improvement of singing.

  In order to achieve such an object, the gist of the present invention is a karaoke apparatus for outputting a performance tune selected from a large number of performance tunes, which is a guide melody corresponding to the vocal part of the performance tune. When a non-singing section in which no is output continues for a specified time or longer, when switching to a singing section in which the guide melody is output, the switching is based on voice information input by the voice input device from a predetermined relationship. A performance evaluation means for performing performance evaluation of singing is provided.

  In this way, a predetermined relationship is established when switching to a singing section in which the guide melody is output after a non-singing section in which the guide melody corresponding to the vocal part of the performance music is not output for a predetermined time or longer. Since it is provided with performance evaluation means for performing performance evaluation of singing related to switching based on voice information input from the voice input device, switching from a non-singing section to a singing section in each performance piece It is possible to objectively determine whether or not the singing is correctly performed. That is, it is possible to provide a karaoke apparatus that efficiently assists in the improvement of singing.

  Here, it is preferable that the performance evaluation unit performs the performance evaluation based on a pitch and an output timing of voice information input from the voice input device corresponding to the first note in the singing section. is there. In this way, it is possible to objectively and practically determine whether or not the singing related to switching from the non-singing section to the singing section in each performance piece can be performed correctly.

  Preferably, the performance evaluation means performs a deduction in the performance evaluation when audio information is input from the audio input device before an output timing corresponding to the first sound in the singing section. It is. In this way, it is possible to objectively and practically determine whether or not the singing has been sung correctly by lowering the evaluation when the voice is uttered during the singing.

  Preferably, at the time of switching from the non-singing section to the singing section in the output of the performance music, based on the performance evaluation result by the performance evaluation means related to the performance music, the singing timing related to the switching is notified. The information control means to perform is provided. If it does in this way, based on the performance evaluation result of the singing concerning the change from the non-singing section to the singing section in each performance music, it is possible to notify the necessary and sufficient singing for each user.

  Preferably, the notification control means selectively outputs a plurality of types of notification sounds for notifying the singing timing related to the switching based on a performance evaluation result by the performance evaluation means. In this way, based on the performance evaluation result of singing related to switching from a non-singing section to a singing section in each performance piece, it is preferable and practical to notify the singing necessary and sufficient for each user. Can be done.

It is the schematic explaining the karaoke system to which the karaoke apparatus of this invention is applied suitably. It is a block diagram which illustrates the composition of the karaoke device which is one example of the present invention. It is a block diagram explaining the structure of the server apparatus with which the karaoke system of FIG. 1 was equipped. It is a functional block diagram explaining the principal part of the control function with which CPU of the karaoke apparatus of FIG. 2 was equipped. It is a figure explaining determination of the singing part by CPU of the karaoke apparatus of FIG. It is a figure which shows an example of the performance evaluation result memorize | stored for every user in the SNS database with which the server apparatus of FIG. 3 was equipped. It is a figure which shows an example of the relationship between the singing evaluation result of the performance music which becomes the object, and the alerting | reporting sound alert | reported at the singing timing which concern on the singing assistance control by CPU of the karaoke apparatus of FIG. It is a flowchart explaining the principal part of login / logout control by CPU of the karaoke apparatus of FIG. It is a flowchart explaining the principal part of the singing assistance control by CPU of the karaoke apparatus of FIG.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a schematic diagram illustrating a karaoke system 10 to which the karaoke apparatus of the present invention is preferably applied. As shown in FIG. 1, in the karaoke system 10, a plurality of private rooms 14 a, 14 b, 14 c,... Karaoke devices 16a, 16b, 16c, which are one embodiment of the present invention (hereinafter referred to simply as karaoke devices unless otherwise specified). 16). The plurality of karaoke devices 16 are connected to a communication line 18 such as a public telephone line via a router 28, and are connected to a server device (center device) 20 of a karaoke service providing company connected to the communication line 18. Information can be communicated between each other via the communication line 18.

  The server device 20 is a server that performs basic control of storage and input / output management of digital contents (Digital Contents) such as karaoke information (music data), background video information, and information between songs. The content is regularly distributed to the karaoke device 16 via the karaoke device 16 and a predetermined function control program is transmitted in response to a request from the karaoke device 16. The karaoke system 10 includes a plurality of electronic quick sample devices 22a, 22b, 22c,... (Hereinafter simply referred to as the electronic quick sample device 22 unless otherwise distinguished). 1 to several electronic quick sample devices 22 are lent for each user (group) and are used as remote control devices for the karaoke device 16 in each private room 14 as will be described later. ing. A LAN 24 for connecting the plurality of karaoke apparatuses 16 to each other is laid in the store 12, and an input to the karaoke apparatus 16 from the electronic quick sample apparatus 22 is made via a predetermined access point 26 and the LAN 24. This is performed by LAN communication or the like.

  FIG. 2 is a block diagram illustrating the configuration of the karaoke apparatus 16. As shown in FIG. 2, the karaoke device 16 includes a video display device 30 such as a CRT (Cathode-ray Tube) or TFT (Thin Film Transistor Liquid Crystal), and a video output control such as a video board (graphics board). Unit 32, video information decoder 34, video mixer 36, synthesizer 38 as a sound source, microphone 40 as an audio input device, and A / D for converting audio input from the microphone 40 into a digital signal Converter 41, amplifier mixer 42, speaker 44, operation panel 46, input / output interface 48 that processes input signals from the operation panel 46, CPU 50 that is a central processing unit, and ROM 52 that is a read-only memory A RAM 54 that is a read / write memory as needed, and a hard disk 56 that is a storage device. , A modem 58, a LAN port 60, and a remote control receiver 62 for receiving a remote control signal from the input device such as the electronic Hayami the device 22 or the remote control device 64 is configured to include.

  The video output control unit 32 functions as a character video output device that outputs a character video (telop) such as a lyric character video generated by the CPU 50, and also displays for controlling various video displays by the video display device 30. It is a control device. The video information decoder 34 is a background video playback device that plays back (decodes) a predetermined background video based on background video information stored in the hard disk 56 when a user sings while referring to lyrics. . The background video information is, for example, MPEG (Moving Picture Experts Group) format data, and the background video reproduced by the video information decoder 34 based on the MPEG data is sent to the video mixer 36. The video mixer 36 synthesizes the character video generated by the CPU 50 and output from the video output control unit 32 with the background video reproduced by the video information decoder 34 to the video display device 30. This is a video composition device to be displayed.

  The synthesizer 38 is a sound source that generates a music signal such as a musical instrument performance signal based on performance information of a karaoke performance song read from the hard disk 56 and sent. The performance information is, for example, data in MIDI (Musical Instrument Digital Interface) format, and the music signal generated by the synthesizer 38 based on the MIDI data is converted into an analog signal and sent to the amplifier mixer 42. The amplifier mixer 42 mixes the transmitted music signal and the singing voice of the user (player) input through the microphone 40, and those signals are electrically amplified and output from the speaker 44. The The A / D converter 41 converts voice information as an analog signal input from the microphone 40 as a voice input device into a digital signal and supplies the digital signal to the CPU 50 and the like.

  The operation panel 46 allows the user of the karaoke apparatus 16 to select a karaoke performance song that the user wants to sing, adjust the pitch of the performance song, adjust the volume balance between the performance and the song, and perform echo and volume. , An input device provided with operation buttons (switches) or knobs for performing various adjustments such as tone. Further, the karaoke device 16 is provided with a remote control device 64 that functions as an input device for remotely executing a part of the function of the operation panel 46, and the remote control receiving unit 62 is connected to the remote control device 64 from the remote control device 64. A remote control signal to be transmitted is received and supplied to the CPU 50. In addition, the association (sticking) processing between the karaoke device 16 and the electronic quick sample device 22 is also performed via the remote control receiving unit 62, and thus the electronic quick sample device associated with the karaoke device 16. 22 also functions as an input device. In this embodiment, an input device such as the remote control device 64 provided in the karaoke device 16 or the electronic quick sample device 22 subjected to the association processing also constitutes a part of the karaoke device 16. The following will be described.

  The CPU 50 is a so-called microcomputer that processes and controls electronic information based on a predetermined program stored in advance in the ROM 52 using the temporary storage function of the RAM 54, and the electronic quick sample device 22 and the remote control device 64. When a predetermined karaoke performance song is selected by the above, etc., the selected karaoke performance song is registered in the reserved song table 88 (see FIG. 4) provided in the RAM 54, or the performance order of the reserved song table 88 is set. The performance information and lyrics information etc. of the selected karaoke performance music are read from the hard disk 56 to the RAM 54 according to the above, or the performance information is transmitted from the RAM 54 to the synthesizer 38 as the performance of the karaoke performance music progresses. The lyric character image is generated based on the lyric information and the image output control unit 32 When a song is selected, a song title character video is generated and sent to the video output control unit 32, the video information decoder 34 is controlled to reproduce a predetermined background video, or while a karaoke performance is not performed, that is, a song In addition to basic control such as information output control between the server device 20 via the communication line 18 and output of information between songs such as new music information, music selection ranking, store advertisement, etc. Various controls such as the singing assistance control of this embodiment are executed.

  The modem 58 is a device for connecting the karaoke device 16 to a communication line 18 such as a public telephone line, converts a digital signal output from the CPU 50 into an analog signal and sends it to the communication line 18. The analog signal transmitted via the communication line 18 is converted into a digital signal and supplied to the CPU 50. In addition, the aspect by which any karaoke apparatus 16 is equipped with the function of the said router 28 among the several karaoke apparatuses 16 with which the said store 12 was equipped, and is connected to the said communication line 18 as a master commander is also considered, In that case, The modem 58 is required for the karaoke device 16 that functions as the master commander, but is not necessarily provided for other karaoke devices 16 that communicate information with the server device 20 via the master commander. Not necessary.

  The LAN port 60 is a connector for connecting the karaoke device 16 to other devices such as the other karaoke device 16 and the electronic quick sample device 22 via the LAN 24, and the karaoke device 16 is used as such. By being connected via the LAN 24, information can be transmitted / received to / from other devices such as the other karaoke apparatus 16 and the electronic quick sample apparatus 22. For example, the music selection input from the electronic sample device 22 received via the access point 26 is received and stored in the reserved music table 88 provided in the RAM 54, or the karaoke device via the access point 26. The mutual exchange of information between the karaoke device 16 and the electronic quick sample device 22 is performed via radio waves, such as transmitting predetermined information from the electronic device 16 to the electronic quick sample device 22.

  The hard disk 56 stores a music database 66 for storing a large number of music data (karaoke data) for outputting a karaoke performance music, and a plurality of types of notification voice information used for singing assist control of the embodiment described later. Various databases such as a notification voice database 68 (see FIG. 4) are provided. For example, the karaoke device 16a, which is a predetermined karaoke device 16 among a plurality of karaoke devices 16 provided in a store such as a karaoke box, is connected to the communication line 18 via the modem 58, and New music data and the like are distributed from the server device 20 via the communication line 18 so that new music can always be played by the karaoke device 16 or new notification voice can be output at any time. And stored in the music database 66 of the hard disk 56. In addition, communication is performed via the LAN 24 between the karaoke device 16 a that has acquired information from the server device 20 and the other karaoke devices 16, and is stored in the hard disk 56 of each karaoke device 16. And the contents of the music database 66 and the like are equivalent.

  The music database 66 stores a large number (for example, tens of thousands of songs) of music data (karaoke data) corresponding to performance music that can be output by the karaoke device 16. The music data includes performance information for generating a performance sound of a predetermined instrument by the synthesizer 38, lyrics information for generating a lyrics character image (lyric telop), and lyrics generated based on the lyrics information. It includes lyrics color change information for sequentially changing the color of the character image in accordance with the progress of the performance, and is identified by a music selection number unique to each performance song as the content ID. In addition, the notification sound database 68 stores a plurality of types of notification sound information that is output at the time of switching from the non-singing section to the singing section in each performance piece output by the karaoke apparatus 16. This notification audio information is equivalent to a clock sound (notification sound) that the clock keeps ticking, such as “Chip, Tick, Tick, (Singing)”, or “Singing in another 5 seconds” Thus, various modes such as those corresponding to the announcement sound (notification sound) such as synthesized voice or recorded real voice can be considered. The notification audio information will be described later together with the description of the singing assist control of the present embodiment.

  FIG. 3 is a block diagram illustrating the configuration of the server device 20. As shown in FIG. 3, the server device 20 uses a CPU 70 which is a central processing unit, a program stored in advance in a ROM 72 which is a read-only memory while using a temporary storage function of a RAM 74 which is a read / write memory as needed. A so-called Neumann computer that performs signal processing according to the above, and in addition to basic control including content distribution control such as music data in response to a distribution request from the karaoke device 16, the user of the karaoke system 10 is Various controls related to the karaoke system 10 of this embodiment, such as control for managing and operating a target social network service, are performed. This social network service refers to, for example, a member-based community-type website that provides services such as information browsing only between members who are registered in advance. In the following description, the social network service is abbreviated as SNS.

  The server device 20 connects the video display device 76 such as CRT and TFT controlled by the video board 78, the input device 80 such as a keyboard connected via the interface 82, and the CPU 70 to the communication line 18. And a modem 84, which is a device for this purpose. The server device 20 is connected to the communication line 18 via the modem 84, so that information can be transmitted to and received from the plurality of karaoke devices 16 connected to the communication line 18. ing. The server device 20 is provided with various databases such as an SNS database 86 for storing information related to the SNS in addition to a music database (not shown) that stores a large number of the karaoke data to be distributed to the karaoke device 16. ing.

  The SNS database 86 is a storage device that stores information related to karaoke performance using the karaoke device 16 for each user who uses the karaoke system 10 in association with identification information (user ID) of the user. is there. In this SNS database 86, preferably, for each user, the user's name (nickname), date of birth, actual age, gender, e-mail address, region, blood type, constellation, password have been forgotten Attribute information such as questions and answers for time, passwords used for log-in authentication to the SNS, and the user's song age are stored in association with the user ID of the user. The song age is virtual age information indicating how much age (how many years) the user's preference of the music piece corresponds to, and the target user uses the karaoke device 16 It is a value determined based on a performance song that has been selected (played) in the past. Preferably, a performance song previously selected (played) by the target user is used as a reference for calculation, and the user's karaoke performance It is a value derived from the viewpoint of how much age the tendency corresponds to.

  Preferably, in the SNS database 86, as information related to karaoke performance using each karaoke device 16 of each user, for example, the store 12 corresponding to the karaoke device 16 used by the user in the past (that The store visit history, which is information related to the store 12) where the karaoke device 16 is installed, and the performance song that the user has registered as the eighteenth song in the karaoke performance by the karaoke device 16 (the music selection input can be performed by simple operation) Information on the musical composition), information on the musical composition as a music selection history (history of musical compositions previously selected in the karaoke apparatus 16) selected by the user in the karaoke performance by the karaoke apparatus 16, and the user Evaluation of performance evaluation performed in the past in karaoke performance by the karaoke device 16 Information about the result, and the user information concerning other users registered as friends are stored in association with the user ID of the user for each user.

  The CPU 70 of the server device 20 performs information registration control regarding the SNS in the karaoke system 10. Specifically, a new user (user) is added to the SNS database 86 in response to an input operation by the electronic quick sample device 22 as an input device of the karaoke 16 or a personal computer (not shown) connected to the communication line 18. ), Changing (updating) the registered content stored in the SNS database 86, registering a plurality of users stored in the SNS database 86 as friends, and registering the karaoke The overall management control of the SNS in the karaoke system 10 is performed such that the evaluation result by the device 16 is stored for each user or the song age corresponding to the user and the performance music described above is updated. .

  FIG. 4 is a functional block diagram illustrating the main part of the control function provided in the CPU 50 of the karaoke apparatus 16. 4 may be provided in the CPU or the like of the electronic quick sample apparatus 22. The login authentication control means 90 shown in FIG. 4 performs login authentication of the user to the karaoke apparatus 16 according to a predetermined input operation. For example, login authentication of a user is performed according to information such as identification information (user ID) and a password input from a touch panel display of the electronic quick sample apparatus 22, and the identification is performed when the authentication is normally performed. With the information, the user is allowed to log in to the karaoke device 16 (service by the karaoke system 10). For example, such login authentication is performed by making an inquiry to the server device 20 based on information input by the electronic sample device 22. That is, whether the password stored in the SNS database 86 of the server device 20 in association with the identification information matches the identification information and the login password input by the electronic sample device 22 is input. If they match, normal authentication is performed. If they do not match, an error is determined. In addition, regarding this login authentication, substantial control (determination) may be performed on the server device 20 side. Also, preferably, when normal authentication is performed by the login authentication control means 90, various information stored in the SNS database 86 in association with the user permitted to log in, for example, the name of the user Information such as (nickname) and performance evaluation results (especially performance evaluation results of singing to be described later) is downloaded from the server device 20 via the communication line 18 and can be displayed on the electronic quick sample device 22 or the like. It is stored in the device 16.

  The music selection input control means 92 accepts a music selection input for selecting and reserving a predetermined performance music from among a large number of music performances that can be performed by the karaoke apparatus 16. For example, a predetermined musical piece selected from a large number of musical pieces stored in the musical piece database 66 of the karaoke device 16 in accordance with a user's touch input operation on the touch panel display of the electronic quick sample device 22 is reserved music. Control is performed so as to be stored in the reserved music table 88 formed in the RAM 54 or the like as (awaiting performance music). Here, preferably, the reserved music table 88 associates the music selection number as the reserved music with the identification information of the user who has selected the reserved music (the user who entered the music selection) and stores it in the reserved music table 88. That is, preferably, in the electronic sample device 22 or the like, an operation such as music selection input can be performed individually for each identification information (user ID) authenticated by the login authentication control means 90. The corresponding user ID is transmitted to the karaoke device 16 together with the song selection input information and stored in the reserved song table 88. The reserved music table 88 stores the reserved music whose input has been received by the music selection input control means 92 so that the reserved music previously input is ranked higher in the order of input.

  The performance control means 94 controls the output of the performance tune at the time of the karaoke performance by the karaoke apparatus 16. Specifically, the music data corresponding to the music selection number of the reserved music stored in the reserved music table 88 is read out from the music database 66 in order from the upper reserved music in the reserved music table 88 (that is, in the order of input). Based on the performance information included in the music data, the output of the performance music is controlled. That is, based on the MIDI data as performance information, the synthesizer 38 outputs the performance sound (music information) of the musical instrument corresponding to the track or channel as the score information in the MIDI data, and the speaker through the amplifier mixer 42. 44. Moreover, the output of the lyric character video concerning the performance music is controlled based on the lyric information included in the music data. That is, a lyric character image is generated based on the lyric information, and the lyric character image is displayed on the image display device 30 via the image output control unit 32. Further, as the karaoke performance progresses, the lyric character video is switched and displayed, and the lyric character video is sequentially color-changed and displayed based on the lyric color change information.

  The singing determination unit 96 determines a singing part in the performance tune outputted by the performance control unit 94. This singing part is a switch to a singing section in which the guide melody is output after a non-singing section in which the guide melody corresponding to the vocal part of the target performance piece is not output continues for a predetermined time or more. It corresponds to a portion, in other words, it corresponds to a switching portion from a section where the singer should not sing to a section where singing should be performed. That is, the singing determination means 96 outputs the guide melody after a non-singing section in which the guide melody corresponding to the vocal part in the performance tune outputted by the performance control means 94 is not output for a predetermined time or longer. The switching portion to the singing section is determined as the singing portion. This specified time is a fixed time of, for example, about 10 to 20 seconds, which corresponds to a time when the player feels that the singing is once paused and starts to sing again, and is preferably a plurality of times output by the karaoke device 16. Although it is uniformly set as a judgment criterion common to the performance songs, for example, a predetermined time different for each genre may be set in advance. That is, pops, rock, R & B, hip hop, enka, anime songs, folk songs, western music, war songs, etc. that indicate the direction of each performance corresponding to each of a large number of performances stored in the music database 66. At least one genre, which is a classification, is determined for each performance song, and a different specified time is predetermined for each genre and the length of the beat of each performance song, that is, the speed (tempo) of the beat. It may be a thing. The display time of the title screen prior to the start of performance output by the performance control means 94 is longer than this specified time. In other words, the singing start determination unit 96 determines that at least the part to be switched to the singing section after the no singing section has continued for the display time of the title screen is at least the singing section. The above determination may be made in real time when the performance control means 94 outputs the musical composition, but preferably, by referring to the performance information of the target musical composition data prior to the output. Done.

FIG. 5 is a diagram for explaining the determination of the singing part by the singing determination unit 96. As shown in FIG. 5, the music data stored in the music database 66 preferably has a plurality of predetermined divisions in MIDI data or the like as performance information. This category is, for example, a performance category defined in the meta information of the MIDI data. For each predetermined performance time, for example, an Intro, Amelo, B melody ( Bmelo), Cmelo, Fill, chorus, interlude, later performance, and variable beat are defined. Here, the chorus corresponds to a portion where the most impressive and exciting phrase is arranged among the performance songs corresponding to each piece of music data, and is also referred to as a bridge or the like. In the example shown in FIG. 5, the guide melody corresponding to the vocal part exists in A melody, B melody, and chorus, while the guide melody corresponding to the vocal part does not exist in the prelude, the interlude, and the subsequent play. Therefore, before the A melody guide melody starts at time t1, there is a non-singing section of time T1 related to the prelude, etc., and when this time T1 is equal to or longer than the specified time T _bo (T1 ≧ T _bo ) t1 is determined as a singing portion related to switching from a non-singing section to a singing section. Also, before the B melody guide melody starts at time t2, there is a non-singing section of time T2 related to the interlude, and when this time T2 is equal to or longer than the prescribed time T _bo (T2 ≧ T _bo ), time t2 Is determined as a singing portion related to switching from a non-singing section to a singing section. On the other hand, before the chorus melody starts at time t3, there is a non-singing section of time T3 related to the interlude, but when this time T3 is less than the specified time T _bo (T3 <T _bo ), time t3 Is not determined as a singing part.

  The performance evaluation means 98 shown in FIG. 4 basically responds to the sound input from the microphone 40 along with the output of the performance tune when the karaoke apparatus 16 outputs the performance tune based on the predetermined music data. To evaluate the performance. For example, a performance output by the synthesizer 38 based on audio information input by the microphone 40 and converted into a digital signal by the A / D converter 41 and performance information (MIDI data) read from the karaoke database 66. Perform performance evaluation (singing evaluation) by comparing with sound. Preferably, the audio information converted into a digital signal by the A / D converter 41 is continuously stored in the storage device such as the RAM 54 during the period from the start to the end of output of the performance tune to be evaluated. In addition, the evaluation is periodically performed at a predetermined timing (for example, once every 0.5 seconds) while the target performance music is output, that is, from the start to the end of the performance. Preferably, the evaluation is performed for each phrase (a melody or a lyric division that becomes a performance break in each performance music) related to the performance music to be evaluated. As an aspect of this evaluation, for example, scoring may be performed numerically, such as how many points out of 100 points, or acceptable (evaluation is equal to or higher than a predetermined threshold) or impossible (evaluation is predetermined). It may be as simple as determining which one falls below (the threshold value below).

  The performance evaluation means 98 preferably performs a plurality of types of performance evaluations with different evaluation criteria and evaluation methods, respectively, when a performance tune is output based on predetermined karaoke information by the karaoke device 16. For example, (a) pitch evaluation, (b) singing evaluation, (c) vibrato evaluation, and (d) stability evaluation are executed in parallel. This pitch evaluation is to evaluate a relative shift between a basic pitch such as a guide melody in the performance music to be processed and a pitch extracted from the voice input by the microphone 40, and the shift is small. It is highly rated. Further, the vibrato evaluation is a change in the pitch (predetermined) extracted from the sound input by the microphone 40 with respect to a portion where a predetermined vibrato is to be output in the target musical piece, the last portion of each phrase, or the like. The periodic fluctuation between the high and low sounds at the rate of change in the frequency is evaluated. In addition, the stability evaluation means that the sound input by the microphone 40 has a constant volume and a portion that should be extended with a certain pitch (a so-called long tone that should be uttered at a certain pitch) in the target performance piece. It evaluates whether or not it continues at a certain pitch. The singing evaluation will be described later.

  FIG. 6 is a diagram showing an example of performance evaluation results stored in the SNS database 86 for each user. As shown in FIG. 6, in the karaoke system 10 of the present embodiment, the results of a plurality of types of performance evaluation by the performance evaluation means 98 are associated with the music selection number of the performance music for each performance music. Is remembered. For example, corresponding to the song with the song selection number “20667519”, the pitch evaluation is “79/100”, the singing evaluation is “62/100”, the vibrato evaluation is “86/100”, and the stability evaluation is “90/100”. In addition, the number of performance evaluation results of each type out of 100 points is stored. Here, when each user performs a plurality of performances with respect to a predetermined performance piece and the performance evaluation means 98 performs a plurality of performance evaluations, an average value is stored for each of the plurality of types of performance evaluations. The performance evaluation result of each time may be sequentially stored. Preferably, a plurality of types of performance evaluation results by the performance evaluation means 98 are displayed on the video display device 30 via the video output control unit 32 or the like when the performance of the target performance music is completed. .

  The performance evaluation means 98 performs performance evaluation related to the singing start portion determined by the singing start determination means 96 as the singing start evaluation. In other words, after a non-singing section where a guide melody corresponding to the vocal part of the target performance piece is not output continues for a specified time or longer, when switching to a singing section where the guide melody is output, the voice is heard from a predetermined relationship. Based on the audio information input by the microphone 40 as an input device, performance evaluation of singing related to the switching is performed.

  The performance evaluation means 98 is preferably based on the pitch and output timing of audio information input from the microphone 40 corresponding to the first note in the singing section after the non-singing section has continued for a specified time or longer. Perform performance evaluation of the above singing. Here, the first sound in the singing section is preferably a sound that first appears in the singing section and corresponds to a predetermined length (for example, a quarter note). In other words, the performance evaluation means 98 preferably determines whether or not a sound is input at an output timing corresponding to the first sound in the singing section. The relative deviation between the pitch corresponding to the pitch and the pitch extracted from the input speech is evaluated. For example, the smaller the deviation, the higher the evaluation. When no sound is input at the output timing corresponding to the first sound in the singing section, a deduction (minus evaluation) is performed in the performance evaluation. In addition, even when a sound is input at an output timing corresponding to the first sound in the singing section, the sound information is received from the microphone 40 before an output timing corresponding to the first sound in the singing section. If entered, a deduction is made in the performance evaluation.

  For example, in the example shown in FIG. 5, the performance evaluation means 98 performs performance evaluation of singing related to switching from a non-singing section to a singing section at time points t1 and t2. For example, at time t1, the performance evaluation is performed based on the pitch and output timing of the audio information input from the microphone 40 corresponding to the first sound in the A melody that is the singing section immediately after the time t1. . In addition, when the voice information is input from the microphone 40 before the output timing corresponding to the first sound in the A melody, the performance evaluation of the singing at the time point t1 is deducted. Similarly, for the time point t2, the performance evaluation of the singing is performed corresponding to the first sound in the B melody that is the singing section immediately after the time point t2. Then, after the performance of the target musical piece is finished, the evaluation result of the singing through the entire song is calculated based on the evaluation result at the time point t1 and the evaluation result at the time point t2. In the example shown in FIG. 5, the evaluation result of singing through the entire song may be an average value of the evaluation result at the time point t1 and the evaluation result at the time point t2, or may be the total of the evaluation results. . The evaluation result calculated in this way is stored in the SNS database 86 in association with the user ID of the user who is the performance subject.

  In the singing part determined by the singing determination unit 96, the notification control unit 100 shown in FIG. 4 is based on the performance evaluation result by the performance evaluation unit 98 related to the performance music to be processed, and the singing related to the switching is performed. The delivery timing is notified. Preferably, the information is stored in the notification voice database 68 based on the result of the singing evaluation by the performance evaluation means 98 related to the target performance music stored in the SNS database 86 corresponding to each user. At least one type of notification voice information is selected from the plurality of types of notification voice information, and the selected notification voice information is selected at a predetermined timing before the singing start portion determined by the singing determination unit 96. Output. This output timing is individually determined for each notification audio information, and preferably, a predetermined time before the singing time with reference to the singing time point related to the switching from the non-singing section to the singing section. Timing information such as (for example, 5 seconds before) is stored in advance as attribute information of each broadcast audio information. Further, the notification control unit 100 displays the video image at a predetermined timing before the singing-out portion determined by the singing determination unit 96 based on the result of the singing evaluation of the target musical piece. For example, the device 30 may display an image such as a predetermined telop such as “a song starts in another 5 seconds”.

  FIG. 7 is a diagram illustrating an example of a relationship between a singing evaluation result of a target performance song and a notification voice notified at the singing timing. As shown in FIG. 7, preferably, the lower the result of singing evaluation, the more types of notification voices are output. For example, when the result of the singing evaluation related to the target performance music is within the range of 51 to 70 out of 100 points, for example, from a predetermined time before singing (for example, 3 seconds before) to the singing time “ A notification sound of a “clock sound” that causes the clock to tickle time, such as “Chi, Chichi, Chichi, (Singing)” is output. In addition, when the result of the singing evaluation related to the target performance music is within the range of 31 to 50 out of 100, it is accompanied by (or as an alternative to) the notification sound of the “clock sound”. For example, a notification sound of “countdown” for counting “3, 2, 1, high (singing)” from a predetermined time before singing (for example, 3 seconds before) to the time of singing is output. In addition, when the result of the singing evaluation related to the target musical piece is in the range of 0 to 30 points out of 100 points, in parallel with the notification sound of “clock sound” and “countdown”, for example, “Announcement voice” that outputs voice information such as “The song is about to begin-is ready?” That tells you that the singing is approaching a predetermined time before the singing (for example, 10 seconds before) The notification voice is output. Also, preferably, when the result of the singing evaluation of the target performance song is equal to or greater than a predetermined threshold (for example, 71 points out of 100 in the example shown in FIG. 7), the performance song No notification voice is output when singing.

  FIG. 8 is a flowchart for explaining a main part of the login / logout control by the CPU 50 of the karaoke apparatus 16 and is repeatedly executed at a predetermined cycle.

  First, in step (hereinafter, step is omitted) SA1, it is determined whether or not login information, that is, identification information (user ID) and a login password have been input via the electronic sample device 22 or the like. If the determination at SA1 is negative, the processing below SA7 is executed. If the determination at SA1 is affirmative, at SA2, the identification information and login password entered at SA1 are stored in the server. Transmitted to the device 20. Next, in SA3, it is determined whether or not a response indicating that the server apparatus 20 has successfully logged in is returned. If the determination at SA3 is affirmative, login processing is normally performed at SA4, and information such as the user's name (nickname) is transferred from the SNS database 86 of the server device 20 to the communication line 18 at SA5. After being downloaded and stored in the karaoke device 16 so that it can be displayed on the electronic quick sample device 22 or the like, the processing below SA7 is executed, but if the determination of SA3 is negative, in SA6, After the fact that an error has occurred is displayed on the electronic quick sample device 22 or the like, it is determined in SA7 whether or not there has been an input for performing a logout process of a predetermined user by the electronic quick sample device 22 or the like. If the determination at SA7 is negative, the routine is terminated. If the determination at SA7 is affirmative, after the logout process of the target user is performed at SA8, This routine is terminated. In the above control, SA1 to SA6 correspond to the operation of the login authentication control means 90.

  FIG. 9 is a flowchart for explaining a main part of the singing assist control by the CPU 50 of the karaoke apparatus 16 and is repeatedly executed at a predetermined cycle.

  First, in S1, it is determined whether or not the singing assist mode is set. If the determination in S1 is negative, the routine is terminated accordingly. If the determination in S1 is affirmative, in S2, a predetermined performance is performed by an input operation using the electronic quick sample apparatus 22 or the like. It is determined whether or not a song selection input operation for selecting a song as a reserved song has been performed. If the determination in S2 is negative, the processing from S4 onward is executed. If the determination in S2 is affirmative, in S3, the musical composition that has been selected and input by the electronic quick sample device 22 or the like. Are stored in the reserved music table 88 as reserved music in association with the user ID of the user who is the main music selection. Next, in S4, whether or not the karaoke performance of the predetermined performance music is started by the karaoke device 16 at the timing of starting the performance of the highest-order reserved music stored as the reserved music in the reserved music table 88. It is determined whether or not. When the determination at S4 is negative, the processing after S2 is executed again. However, when the determination at S4 is positive, the processing after S5 is executed.

  In S5, the karaoke performance by the karaoke device 16 is started, and the singing part in the performance tune, that is, the part to be switched to the singing section after the non-singing section continues for a predetermined time or more is determined. Next, in S6, an inquiry is made to the server device 20, and information stored in the SNS database 86 corresponding to the user who is the subject of the performance is added to the performance music played by the karaoke device 16. It is determined whether or not the corresponding singing start evaluation result is stored. If the determination in S6 is negative, the processing from S9 is executed. If the determination in S6 is positive, in S7, the SNS database 86 is associated with the user who is the subject of the performance. The result of the singing out evaluation corresponding to the performance music played by the karaoke device 16 is read (downloaded). Next, in S8, at least one type of notification voice information is selected from the plurality of types of notification voice information stored in the notification voice database 68 based on the result of the singing evaluation read in S7. . Next, in S9, it is determined whether or not it is a predetermined time before the singing part that is the output timing of the singing part or the notification voice information determined in S5. If the determination in S9 is negative, the determination is made to wait by repeating the determination in S9. However, if the determination in S9 is affirmative, processing in S10 and subsequent steps is executed.

  In S10, the notification sound information selected in S8 is read from the notification sound information database 68, and the notification sound based on the notification sound information is output from the speaker 44. Next, in S11, performance evaluation relating to the singing portion is performed. For example, the singing evaluation is performed based on the pitch and output timing of the voice information input from the microphone 40 corresponding to the first sound in the singing section when singing. Next, in S12, it is determined whether or not the karaoke performance is to be terminated, for example, when the performance piece that has been played by the karaoke apparatus 16 has been played to the end. If the determination in S12 is negative, the processing from S9 is executed. If the determination in S12 is affirmative, in S13, the singing evaluation throughout the entire song is performed based on the evaluation result in S11. The result is calculated and the evaluation result is displayed on the video display device 30. Next, in S14, the result of the singing evaluation calculated in S13 is transmitted to the server device 20 in association with the user ID of the user who is the performance subject and the music selection number of the target performance song (upload). And stored as information relating to the user in the SNS database 86, the routine is terminated.

  In the above control, S2 and S3 are the operation of the music selection input control means 92, S4 and S12 are the operation of the performance control means 94, S5 is the operation of the singing determination means 96, and S11 and S13 are the performances. S8 and S10 correspond to the operation of the evaluation control unit 98, respectively.

  As described above, according to this embodiment, after a non-singing section in which a guide melody corresponding to the vocal part of the performance song is not output continues for a predetermined time or longer, when switching to a singing section in which the guide melody is output, It is provided with performance evaluation means 98 (S11 and S13) for performing performance evaluation of singing related to the switching based on voice information input by the microphone 40 which is a voice input device from a predetermined relationship. Therefore, it is possible to objectively determine whether or not the singing related to the switching from the non-singing section to the singing section in each performance piece can be performed correctly. That is, it is possible to provide the karaoke apparatus 16 that efficiently assists the improvement of singing.

  Further, the performance evaluation means 98 performs the performance evaluation based on the pitch and output timing of the voice information input from the microphone 40 corresponding to the first sound in the singing section. It is possible to objectively and practically determine whether or not the singing related to the switching from the non-singing section to the singing section in the song can be performed correctly.

  Further, the performance evaluation means 98 performs a deduction in the performance evaluation when audio information is input from the microphone 40 before the output timing corresponding to the first sound in the singing section. By lowering the evaluation when a voice is produced by flying at the time of singing, it can be judged objectively and practically whether or not the singing can be performed correctly.

  Also, when switching from the non-singing section to the singing section in the output of the performance music, based on the performance evaluation result by the performance evaluation means 98 related to the performance music, notification control for notifying the singing timing related to the switching Since it is provided with the means 100 (S8 and S10), it is necessary and sufficient for each user to sing based on the performance evaluation result of the singing related to the switching from the non-singing section to the singing section in each performance piece. Can be notified.

  Further, the notification control unit 100 outputs at least one type of notification voice among a plurality of types of notification voices for notifying the singing timing related to the switching based on the performance evaluation result by the performance evaluation unit 98. Therefore, based on the performance evaluation results of singing related to switching from a non-singing section to a singing section in each performance piece, notification of necessary and sufficient singing is performed in a suitable and practical manner for each user. Can do.

  The preferred embodiments of the present invention have been described in detail with reference to the drawings. However, the present invention is not limited to these embodiments, and may be implemented in other modes.

  For example, in the above-described embodiment, the login authentication control means 90, the music selection input control means 92, the performance control means 94, the singing determination means 96, the performance evaluation means 98, and the notification control means 100 are all the karaoke apparatus 16. However, a part or all of these control functions may be provided as individual control devices. A part of the control function may be provided in an input device such as the electronic sample device 22 or the server device 20. For example, in the aspect in which login authentication for the karaoke system 10 is substantially performed on the server device 20 side, the karaoke device 16 only needs to input or transmit a user ID and a login password. It may be performed on the server device 20 side.

  Further, in the above-described embodiment, the performance evaluation means 98 performs the pitch and output of the voice information input from the microphone 40 corresponding to the first sound in the singing section after the non-singing section continues for a predetermined time or more. Although the performance evaluation is performed based on the timing, the present invention is not limited to this. For example, the first two to three sounds in the singing section after the non-singing section continues for a predetermined time or more. The singing evaluation based on the pitch and the output timing may be performed corresponding to sounds corresponding to a plurality of scales. In such singing evaluation, the volume of the voice information input from the microphone 40 may be added as an evaluation element at the beginning of the singing section. For example, an evaluation that adds points (plus evaluation) as the volume increases. Is done.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

  16: Karaoke device, 40: Microphone (voice input device), 98: Performance evaluation means, 100: Notification control means

Claims (5)

A karaoke device for outputting a performance song selected from a large number of performance songs,
After a non-singing section in which no guide melody corresponding to the vocal part of the performance music is output continues for a specified time or longer, when switching to a singing section in which the guide melody is output, input by a voice input device from a predetermined relationship A karaoke apparatus comprising performance evaluation means for performing performance evaluation of singing related to the switching based on voice information to be performed.   The said performance evaluation means performs the said performance evaluation based on the pitch and output timing of audio | voice information input from the said audio | voice input apparatus corresponding to the first one sound in the said song section. Karaoke equipment.   The performance evaluation means performs a deduction in the performance evaluation when audio information is input from the audio input device before an output timing corresponding to the first sound in the singing section. 2. The karaoke apparatus according to 2.   When switching from the non-singing section to the singing section in the output of the performance music, a notification control means for informing the singing timing related to the switching based on a performance evaluation result by the performance evaluation means related to the performance music is provided. The karaoke apparatus according to any one of claims 1 to 3, wherein the karaoke apparatus is one.   5. The karaoke apparatus according to claim 4, wherein the notification control unit selectively outputs a plurality of types of notification voices for notifying a singing timing related to the switching based on a performance evaluation result by the performance evaluation unit. .

Images