JP5123012B2 - Karaoke system - Google Patents

Description

  The present invention relates to a karaoke system using a karaoke apparatus that outputs a predetermined performance tune selected from a large number of performance tunes, and more particularly, to an improvement for realizing performance evaluation close to an impression actually felt by a user. .

  2. Description of the Related Art Music playback apparatuses that output a predetermined performance song selected from a large number of performance songs are known. For example, a karaoke device used in a karaoke box or the like. According to such a karaoke apparatus, music information of a predetermined karaoke performance song selected from a large number of karaoke performance songs stored in advance in a storage device is output, and an image including lyrics information of the karaoke performance song is output. Karaoke performance of a desired song can be enjoyed by displaying it on the screen in synchronization with.

  By the way, the karaoke apparatus that has been widely used in recent years evaluates (scores) singing ability and the like based not only on the function as the music playback apparatus as described above but also on voice information input from a voice input device (microphone). Some have a performance evaluation function. For example, it is a karaoke apparatus described in Patent Document 1. According to such a karaoke device, by comparing the voice information input from the voice input device with the performance information of the karaoke performance song based on the pitch, tempo, volume, etc., singing according to the input voice information Can be scored.

JP-A-9-101794

  However, performance evaluation as in the prior art described above is usually performed mechanically based on performance information such as MIDI (Musical Instrument Digital Interface) data according to a predetermined algorithm. The user's feelings and performance evaluation do not necessarily match, such as a person who is actually good at performing is not given a legitimate evaluation, or conversely, depending on how they sing, a poor evaluation is given a high evaluation. There was a bug. For this reason, there has been a demand for the development of a karaoke system that realizes performance evaluation close to the impression that users actually feel.

  The present invention has been made against the background of the above circumstances, and an object of the present invention is to provide a karaoke system that realizes performance evaluation close to the impression that a user actually feels.

In order to achieve such an object, the gist of the present invention is to output a predetermined performance song selected from a large number of performance songs and amplify and output a voice input by a voice input device. A karaoke system using a karaoke device, and recording control means for recording a digital signal of a voice input by the voice input device corresponding to an output of a predetermined performance song; A database for storing information related to the sound recorded by the recording control means in association with the corresponding performance music piece, and a sound output means for outputting a sound corresponding to the information based on the information related to the sound stored in the database When the voting evaluation control means for accepting a vote evaluated for sound outputted by the sound output unit, a predetermined musical piece In the output, and a performance evaluation control means for playing evaluated based on the information about the audio that is associated with the musical piece and stored in the database, wherein the database, the voting result of evaluation by said voting evaluation control means, The performance evaluation control means stores the information related to the sound and the voting evaluation result stored in the database in association with the performance music when outputting the predetermined performance music. The performance evaluation is performed based on the above.

According to this configuration, in response to the output of a predetermined performance song, the recording control means for recording the digital input of the voice input by the voice input device as information related to the voice, and the recording control means A database for storing information related to the recorded voice in association with the corresponding performance music, a voice output means for outputting a voice corresponding to the information based on the information about the voice stored in the database, and the voice output performing a voting evaluation control means for receiving a voting evaluation for the voice output by means, when the output of a given music piece, the performance evaluation on the basis of information about the audio that is associated with the musical piece and stored in the database a performance evaluation control means, wherein said database, the voting result of evaluation by said voting evaluation control means The performance evaluation control means stores the information related to the sound and the voting evaluation result stored in the database in association with the performance music when outputting the predetermined performance music. The performance evaluation is based on the user's actual singing, and the performance evaluation is based on the result of the voting evaluation. A karaoke system that realizes evaluation can be provided.

Here , it is preferable that the database stores information related to the sound of the user's performance in association with each of the plurality of users in association with the corresponding performance music. If it does in this way, performance evaluation based on the information equivalent to the user's actual song can be realized for a predetermined user.

  Preferably, the apparatus further comprises notification control means for notifying whether or not information relating to the sound corresponding to the performance music is stored in the database when a music selection of a predetermined performance music is performed. is there. In this way, it is possible to suitably notify whether or not performance evaluation is possible based on information corresponding to the user's actual singing.

  Preferably, the performance evaluation control means is configured to output the pitch and volume of the voice input by the voice input device and the voice stored in the database in association with the performance song when outputting a predetermined performance song. The performance evaluation is performed by comparing the pitch and volume. If it does in this way, performance evaluation can be performed in a practical aspect based on information equivalent to a user's actual song.

  Preferably, the database stores performance evaluation results by the performance evaluation control means regarding a plurality of performance songs corresponding to each of a plurality of users, and the performance evaluation control means stores the performance evaluation results. The performance evaluation is performed based on the average of the evaluation results. In this way, performance evaluation closer to the impression that the user actually feels can be realized by performing performance evaluation based on the performance evaluation results of the user for a predetermined user. .

  Preferably, the database stores voting evaluation results by the voting evaluation control means for a plurality of performance songs corresponding to each of a plurality of users, and the performance evaluation control means stores the voting results. The performance evaluation is performed based on the average of the evaluation results. In this way, performance evaluation that is closer to the impression that the user actually feels can be realized by performing performance evaluation for a predetermined user based on past vote evaluation results for the user. .

  Preferably, the database stores a plurality of users as friends in association with each other, and the performance evaluation control means stores the performance tunes relating to a predetermined user in the database. The performance evaluation is performed on the basis of the information about the voice stored in association with the performance music corresponding to the user's friend. If it does in this way, the performance evaluation based on the information equivalent to the actual song of the user who was registered as a friend in a social network service is realizable.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a schematic diagram illustrating a karaoke system 10 to which the present invention is preferably applied. As shown in FIG. 1, in the karaoke system 10 of the present embodiment, a plurality of private rooms 14a, 14b, 14c,... In a store 12 such as a karaoke box, snack, inn, etc. One or a plurality of karaoke apparatuses 16a, 16b, 16c,... (Hereinafter referred to simply as karaoke apparatus 16 unless otherwise specified). Is installed. The plurality of karaoke devices 16 are connected to a communication line 18 such as a public telephone line via a router 28, and are connected to a server device (center device) 20 of a karaoke service providing company connected to the communication line 18. Information can be communicated between each other via the communication line 18. In addition to basic control such as storage and input / output management of digital contents (Digital Contents) such as karaoke information (music data), background video information, and information between songs, the server device 20 manages social network services described later. A server that performs control and the like, and periodically distributes content to the karaoke device 16 via the communication line 18 and transmits a predetermined function control program in response to a request from the karaoke device 16. is there. The karaoke system 10 includes a plurality of electronic quick sample devices 22a, 22b, 22c,... (Hereinafter simply referred to as the electronic quick sample device 22 unless otherwise distinguished). In use, one electronic quick sample device 22 is lent for each user (group) and used as a remote control device for the karaoke device 16 in each private room 14 as will be described later. A LAN 24 for connecting the plurality of karaoke apparatuses 16 to each other is laid in the store 12, and an input to the karaoke apparatus 16 from the electronic quick sample apparatus 22 is made via a predetermined access point 26 and the LAN 24. This is performed by LAN communication or the like.

  FIG. 2 is a block diagram illustrating the configuration of the karaoke apparatus 16. As shown in FIG. 2, the karaoke device 16 includes a video display device 30 such as a CRT (Cathode-ray Tube) or a TFT (Thin Film Transistor Liquid Crystal), a video output control unit 32 such as a CRT controller, and a video. An information decoder 34, a video mixer 36, a synthesizer 38 as a sound source, an audio information decoder 39 as an audio output means, a microphone 40 as an audio input device, an A / D converter 41, an amplifier mixer 42, and a speaker 44 An operation panel 46, an input / output interface 48 that processes input signals from the operation panel 46, the CPU 50 that is a central processing unit, a ROM 52 that is a read-only memory, and a RAM 54 that is a read / write memory as needed. A hard disk 56 as a storage device, a modem 58, a LAN port 60, and the electronic And a remote control receiving unit 62 for receiving a remote control signal from the input device such as the device 22 or the remote control device 64 is configured to include.

  The video output control unit 32 functions as a character video output device that outputs a character video (telop) such as a lyric character video generated by the CPU 50, and also displays for controlling various video displays by the video display device 30. It is a control device. The video information decoder 34 is a background video playback device that plays back (decodes) a predetermined background video based on background video information stored in the hard disk 56 when a user sings a song while referring to lyrics. is there. The background video information is, for example, MPEG (Moving Picture Experts Group) format data, and the background video reproduced by the video information decoder 34 based on the MPEG data is sent to the video mixer. The video mixer 36 combines the character video generated by the CPU 50 and output from the video output control unit 32 with the background video reproduced by the video information decoder 34 to the video display device 30. This is a video composition device to be displayed.

  The synthesizer 38 is a sound source that generates a music signal such as a musical instrument performance signal based on performance information of a karaoke performance song read from the hard disk 56 and sent. The performance information is, for example, data in MIDI (Musical Instrument Digital Interface) format, and the music signal generated by the synthesizer 38 based on the MIDI data is converted into an analog signal and sent to the amplifier mixer 42. The amplifier mixer 42 mixes the transmitted music signal and the user's singing voice input via the microphone 40, and those signals are electrically amplified and output from the speaker 44. The A / D converter 41 converts voice information as an analog signal input from the microphone 40 as a voice input device into a digital signal and supplies the digital signal to the CPU 50 and the like.

  The audio information decoder 39 is an audio output means (audio output unit) that outputs audio corresponding to the audio information based on the audio information read out and transmitted from the SNS database 84 or the like of the server device 20 described later. is there. The audio information is, for example, MPEG (Moving Picture Experts Group) format data, and the audio reproduced by the audio information decoder 39 based on the MPEG data is output from the speaker 44 via the amplifier mixer 42. The A configuration in which the sound output from the sound information decoder 39 is directly output from the speaker 44 without passing through the amplifier mixer 42 is also conceivable. The function of the audio information decoder 39 may be replaced by the video information decoder 34, or the karaoke apparatus 16 may be provided with only one of them.

  The operation panel 46 allows the user of the karaoke apparatus 16 to select a karaoke performance song that the user wants to sing, adjust the pitch of the performance song, adjust the volume balance between the performance and the song, and perform echo and volume. , An input device provided with operation buttons (switches) or knobs for performing various adjustments such as tone. Further, the karaoke device 16 is provided with a remote control device 64 that functions as an input device for remotely executing a part of the function of the operation panel 46, and the remote control receiving unit 62 is connected to the remote control device 64 from the remote control device 64. A remote control signal to be transmitted is received and supplied to the CPU 50. In addition, the association (sticking) processing between the karaoke device 16 and the electronic quick sample device 22 is also performed via the remote control receiving unit 62, and thus the electronic quick sample device associated with the karaoke device 16. 22 also functions as an input device.

  The CPU 50 is a so-called microcomputer that uses the temporary storage function of the RAM 54 to process and control electronic information based on a predetermined program stored in the ROM 52 in advance, and the electronic quick reference device 22 and the remote control device 64. When a predetermined karaoke performance song is selected by the above or the like, the selected karaoke performance song is registered in the reserved song table provided in the RAM 54, or from the hard disk 56 to the RAM 54 according to the performance order of the reserved song table. The performance information and lyric information etc. of the selected karaoke performance song are read, the performance information is transmitted from the RAM 54 to the synthesizer 38 as the performance of the karaoke performance song progresses, and the lyric character is based on the lyric information. Generate a video and send it to the video output control unit 32. A new character information is generated while a name character image is generated and sent to the image output control unit 32, a predetermined background image is reproduced by controlling the image information decoder 34, that is, during a karaoke performance, that is, between songs. In addition to basic control such as information communication control with the server device 20 via the communication line 18, the login authentication control to be described later, Various controls such as performance evaluation control, recording control related to the performance evaluation control and voice output control, and information communication control with the server 20 related to the performance evaluation control are executed.

  The modem 58 is a device for connecting the karaoke device 16 to a communication line 18 such as a public telephone line, converts a digital signal output from the CPU 50 into an analog signal and sends it to the communication line 18. The analog signal transmitted via the communication line 18 is converted into a digital signal and supplied to the CPU 50. In addition, the aspect by which any karaoke apparatus 16 is equipped with the function of the said router 28 among the several karaoke apparatuses 16 with which the said store 12 was equipped, and is connected to the said communication line 18 as a master commander is also considered, In that case, The modem 58 is required for the karaoke device 16 that functions as the master commander, but is not necessarily provided for other karaoke devices 16 that communicate information with the server device 20 via the master commander. Not necessary.

  The LAN port 60 is a connector for connecting the karaoke device 16 to other devices such as the other karaoke device 16 and the electronic quick sample device 22 via the LAN 24, and the karaoke device 16 is used as such. By being connected via the LAN 24, information can be transmitted / received to / from other devices such as the other karaoke apparatus 16 and the electronic quick sample apparatus 22. For example, the music selection input from the electronic quick sample device 22 received through the access point 26 is received and stored in a reserved music table provided in the RAM 54, or the karaoke device 16 through the access point 26. Thus, mutual exchange of information between the karaoke device 16 and the electronic quick sample device 22 is performed via radio waves, such as transmitting predetermined information to the electronic quick sample device 22.

  The hard disk 56 is provided with various databases including a karaoke database 86 for storing a large number of karaoke information (music data) for outputting karaoke performance music. Among a plurality of karaoke devices 16 provided in a store such as a karaoke box, a predetermined karaoke device 16 such as the karaoke device 16a is connected to the communication line 18 via the modem 58, and the plurality of karaoke devices. 16, new music data or the like is distributed from the server device 20 via the communication line 18 and stored in the karaoke database 86 or the like of the hard disk 56 so that new music can always be played. In addition, communication is performed via the LAN 24 between the karaoke device 16 a that has acquired information from the server device 20 and the other karaoke devices 16, and is stored in the hard disk 56 of each karaoke device 16. And the contents of the karaoke database 86 and the like are equivalent.

  The karaoke information stored in the karaoke database 86 is composed of performance information for generating a performance sound and lyric information for generating a lyric character image (lyric telop). It is identified by a unique music selection number. The performance information included in the karaoke information is, for example, MIDI data for outputting a predetermined performance sound by the synthesizer 38, the type of performance sound (instrument) related to the output, and the score information corresponding to each performance sound, Is included. The lyric information is data for outputting a lyric character video of a performance tune through the video output control unit 32 and the like, and is combined with the text information of the lyric corresponding to the lyric character video and the performance output. Switch timing information for switching the display of the lyrics character image and color change timing information for sequentially changing the color of the lyrics character image in parallel with the performance output.

  FIG. 3 is a block diagram illustrating the configuration of the server device 20. As shown in FIG. 3, the server device 20 includes a so-called microcomputer system that performs signal processing according to a program stored in advance in a ROM 68 by using a temporary storage function of a RAM 70 by a CPU 66 as a central processing unit. In addition to basic control including content distribution control such as karaoke information to the karaoke device 16, various controls such as SNS management control described later are executed. Also, an image display device 74 such as a CRT or TFT controlled by the video board 72, an input device 76 such as a keyboard connected via an interface 78, and a device for connecting the CPU 66 to the communication line 18. A modem 80 is provided. In addition, various databases such as a karaoke database 82 for storing a lot of karaoke information for distribution to the karaoke device 16 and an SNS database 84 for storing information on SNS described later are provided in a large-capacity storage device such as a hard disk. ing.

  The SNS database 84 associates information related to karaoke performance using the karaoke device 16 for each user who uses the karaoke system 10, particularly information related to a social network service by the karaoke system 10 with identification information of the user. Storage device. This social network service refers to, for example, a member-based community-type website that provides services such as information browsing only between members who are registered in advance. In the following description, the social network service is abbreviated as SNS.

  The SNS database 84 includes, for each user, questions and answers for when the user's name (nickname), date of birth, gender, e-mail address, region, blood type, constellation, password are forgotten, and SNS A password used for log-in authentication is stored in association with the identification information of the user. Moreover, as information regarding the karaoke performance using the karaoke device 16 of each of the above-mentioned users, the user has registered the performance song registered as the eighteenth song in the karaoke performance by the karaoke device 16 (set so that music selection input can be performed by a simple operation) Information related to the musical composition), information related to the musical composition as the music selection history (the history of musical compositions previously selected in the karaoke apparatus 16) selected by the user in the karaoke performance by the karaoke apparatus 16, and the user Information on performance evaluation results of performance songs performed in the past by the device 16, information on performance evaluation ranking (nationwide song ranking) based on SNS members calculated by statistics based on performance evaluation results of each performance music, To other users that the user has registered as friends To the store 12 where the user's karaoke device 16 is installed, information about the music piece that the user has voted for in the past, information about the music piece that the user has registered as a watch list (monitored music piece) The information related to the store visit history, the information related to the group registration (group history), and the like are stored for each user in association with the identification information of the user. In addition, model performance information used for performance evaluation control of this embodiment, which will be described later, performance evaluation results corresponding to the model performance information, vote evaluation results, and the like are also stored in the SNS database 84 in association with each user.

  FIG. 4 is a functional block diagram illustrating a main part of control functions provided in the CPU 50 of the karaoke apparatus 16 and the CPU 66 of the server apparatus 20. The SNS management means 90 shown in FIG. 4 is functionally provided in the CPU 66 of the server device 20. The login authentication means 92, performance control means 94, recording control means 96, transmission control means 98, performance evaluation. The control means 100, the notification control means 102, and the vote evaluation control means 104 are functionally provided in the CPU 50 of the karaoke apparatus 16. Hereinafter, these functions will be described in detail with reference to FIGS.

  The SNS management means 90 performs SNS information registration control in the karaoke system 10. Specifically, a new user (user) is registered in the SNS database 84 or the registered content stored in the SNS database 84 is changed (updated) in response to an input operation by the electronic quick sample device 22 or the like. SNS, and a plurality of users stored in the SNS database 84 are registered in association with each other as friends. Further, in relation to performance evaluation control, which will be described later, in response to a transmission request from the karaoke apparatus 16 related to the performance evaluation control, it is associated with the model performance information stored corresponding to a predetermined user or the model performance information. Information such as performance evaluation results and voting evaluation results is transmitted to the karaoke apparatus 16 via the communication line 18.

  Moreover, the said SNS registration control means 90 can set the browsing level of the information regarding the karaoke performance using the said karaoke apparatus 16 of each user suitably. This browsing level is related to browsing for other users of information related to karaoke performance using the karaoke apparatus 16 stored in the SNS database 84 corresponding to the user. Browsing in stages, such as “can browse even if there are”, second level “can browse to friends of friends”, third level “friends can browse”, and fourth level “anyone cannot browse” The level can be set. The browsing level may be set individually for each of the items such as the eighteenth song, performance evaluation, music selection history, etc., or may be set in a lump. Moreover, it may be as simple as “public” or “private” regardless of whether it is a friend or not. In the following description, a mode in which the browsing level is set in two stages of “public” or “non-public” for each item collectively will be described.

  In addition, the SNS registration control means 90 sends the SNS database 84 to the SNS database 84 in accordance with an input operation of not only the electronic sample device 22 but also an external device such as a personal computer or a mobile phone connected to the communication line 18. Various controls such as new user registration and registration information update are performed. That is, the SNS of the present embodiment in the karaoke system 10 is mainly the karaoke system 10, but new registration, access, and information can be obtained through an external communication system that is not directly involved in the karaoke system 10. Can be updated.

  The login authentication unit 92 authenticates the SNS user in the karaoke system 10 according to identification information (user ID) input by a predetermined input operation via a touch panel display or the like of the electronic quick sample device 22; When the authentication is normally performed, the user is permitted to log in to the SNS with the identification information. For example, when identification information and a password are input by the electronic quick sample device 22, the server device determines whether the password associated with the identification information and stored in the SNS database 84 matches the input. In the case of a match, normal authentication is performed. On the other hand, if they do not match, an error is assumed. The login authentication means 92 may transmit the identification information and password input in the karaoke device 16 to the server device 20, and substantial authentication is performed on the server device 20 side. It does not matter.

  The performance control means 94 controls the output of a performance tune when the karaoke device 16 performs the karaoke performance. Specifically, the karaoke information corresponding to the music selection number of the performance music stored in the reserved music table is read from the karaoke database 86 in the order of performance in the reserved music table stored in the RAM 54 or the like and included in the karaoke information. The output of the performance music is controlled based on the performance information. That is, on the basis of MIDI data as performance information, the synthesizer 38 outputs musical instrument performance sounds (music information) corresponding to tracks or channels as musical score information in the MIDI data, and the amplifier mixer 42 is used to output the performance data. Output from the speaker 44.

  The recording control means 96 records information related to the sound input by the microphone 40 which is a sound input device in response to the output of a predetermined performance song by the performance control means 94. Preferably, the pitch and volume of the audio information input by the microphone 40 and converted into a digital signal by the A / D converter 41 are set in units of, for example, 25 to 50 [ms] (40 to 80 [Hz]). Record in time series. Thus, for example, data arranged in the order of [pitch] / [volume] / [pitch] / [volume] / [pitch] / [volume]... [Pitch] / [volume] is created. The time corresponding to the volume can be determined by the number of data from the beginning. The recording control means 96 preferably records (records) the audio information itself input by the microphone 40 and converted into a digital signal by the A / D converter 41 in the form of MPEG data or WAV data. To do. Such information is temporarily stored in a storage device such as the RAM 54 or the hard disk 56. Then, when the output (performance) of the target performance music is completed, it is associated with the music selection number of the performance music related to the performance and the identification information of the user, and the transmission control means 98 via the communication line 18 It is transmitted (uploaded) to the server device 20. In the server device 20 that has received the information, the information is stored in the SNS database 84 by the SNS management means 90 in association with the music selection number of the musical piece as user performance data corresponding to the identification information. .

  The performance evaluation control means 100 performs performance evaluation based on information related to the voice stored in the SNS database 84 in association with the performance music, that is, when the performance control means 94 outputs a predetermined performance music. I do. Specifically, among the model performance information associated with a predetermined user and stored in the SNS database 84, the model performance information stored in association with the performance music related to performance evaluation, that is, the performance music to be evaluated. The model performance information corresponding to the same performance music is read (downloaded), the pitch and volume of the model performance information, and the pitch and volume of the voice input by the microphone 40 in parallel with the output of the performance music The performance is evaluated by comparing the two. As an aspect of this performance evaluation, for example, there may be a numerical scoring such as how many points out of a thousand points, or a simple one such as determining which of 20 grades is applicable. It may be. Further, such performance evaluation control may be one in which evaluations performed multiple times for each section in parallel with the performance are totaled at the end of the performance, and are input to the RAM 54 and the like by the recording control means 96. Audio information may be recorded, and may be performed collectively by comparing it with model performance information at the end of the performance.

  FIG. 5 is a diagram for explaining the performance evaluation control by the performance evaluation control means 100. The sample performance read from the SNS database 84 by the solid line represents the waveform of the input speech information corresponding to the speech input from the microphone 40. Each waveform of information is shown by a one-dot chain line. The performance evaluation control means 100 performs performance evaluation related to the input voice information in accordance with, for example, the area (area of the area shown by hatching) S between the input voice information and the model performance information shown in FIG. That is, an evaluation is derived based on the area S based on a predetermined relationship such that the smaller the area S (closer to 0), the higher the evaluation, and the lower the area S, the lower the evaluation. To do. Here, as described above, since the recording control means 96 delimits the unit by an appropriate time width when recording the input voice (recording), simply comparing the deviation with the recorded data, Actually, even a slight difference may cause a large deviation. Therefore, preferably, a smooth curve is obtained by taking N points of pitch data and performing interpolation (for example, well-known Lagrangian interpolation or the like) with an N-1 degree polynomial, and performance evaluation is performed based on the curve. In actual performance evaluation, the area S is calculated by accumulating (integrating) the absolute values of the differences between the two pitch curves thus obtained. In this case, it is desirable that the time resolution is set to be somewhat finer than the unit time of the pitch. Further, the average value of the deviations is calculated by dividing the total of the absolute values of the differences by the performance time (time during which sound is generated). By calculating the average value of the deviations in this way, it is possible to realize scoring that considers the deviation with respect to time and the deviation of the pitch at the same time. Similarly, with respect to the volume, the input voice information and the model voice information are compared in the same manner as the pitch, and the performance evaluation related to the input voice information is performed based on these results.

  The performance evaluation result by the performance evaluation control means 100 is associated with the identification information of the user related to the performance evaluation and the music selection number of the performance music, and the server apparatus 20 via the communication line 18 by the transmission control means 98. Sent (uploaded). In the server device 20 that has received the information, the information is stored in the SNS database 84 by the SNS management means 90 in association with the music selection number of the musical piece as the performance evaluation result of the user corresponding to the identification information. . Further, it may be stored in association with the model performance information used as a reference for performance evaluation or the identification information of the user related to the model performance information.

  Returning to FIG. 4, when the electronic music sample device 22 or the like inputs a song selection of a predetermined performance song, the notification control means 102 stores model performance information corresponding to the performance song in the SNS database 84. It is notified whether it is memorized or not. Preferably, it is notified whether or not the model performance information corresponding to the performance music is stored in the SNS database 84 in association with the user's friend related to the performance (performance evaluation) of the performance music. In other words, the performance evaluation control means 100 is preferably associated with the performance music in the SNS database 84 when the performance control means 94 for the predetermined user outputs the predetermined performance music. Performance evaluation is performed based on the model performance information stored in association with the friend. In other words, the performance evaluation control means 100 targets only the model performance information stored in association with the user's friend when the performance control means 94 for the predetermined user outputs the predetermined performance music. Then, performance evaluation control based on the model performance information is performed.

  The notification control means 102 associates model performance information corresponding to a performance music piece with the user's friend when the music selection input of the performance music piece related to a predetermined user is performed by the electronic quick sample device 22 or the like. In the case where the server device 20 is inquired whether or not it is stored in the SNS database 84 (as the model performance information of the friend) and the corresponding model performance information is stored, for example, as shown in FIG. As described above, a plurality of friends corresponding to the model performance information are displayed on the video display device 30 via the video output control unit 32 or the like so as to be selectable by the electronic quick sample device 22, the remote control device 64, or the like. The evaluation result by the performance evaluation control means 100 corresponding to the model performance information or the average thereof (or the evaluation result by the vote evaluation control means 104 described later or the average thereof) is limited to friends having a predetermined value or more. Such display may be performed. Then, when any one of a plurality of friends displayed so as to be selectable as shown in FIG. 6 is selected, information (identification information, etc.) of the selected friend is sent by the transmission control means 98. The model performance information transmitted to the server device 20 and associated with the friend from the SNS database 84 of the server device 20 is transmitted to the karaoke device 16 via the communication line 18, and the model performance information is used as a reference. Performance evaluation control by the performance evaluation control means 100 is performed. As shown in FIGS. 8 to 9, for example, the result of such performance evaluation is obtained via the video output control unit 32 and the like together with the name (nickname) of the user (friend) related to the model performance information as an evaluation standard. It is displayed on the video display device 30.

  Further, when the model performance information corresponding to the target performance piece is not stored in the SNS database 84 in association with the user's friend, the notification control means 102, for example, as shown in FIG. The fact that there is no corresponding model performance information associated with the user's friend is displayed on the video display device 30 via the video output control unit 32 or the like. Further, preferably, as shown in FIG. 7, a user who has model performance information of the target musical piece following the display (stored as information associated with the user) is a new friend. Friend search processing is executed.

  Returning to FIG. 4, the voting evaluation control means 104 accepts the user's artificial voting evaluation with respect to the model performance information (digitized voice information) stored in the SNS database 84. Specifically, the model performance information to be evaluated is read from the SNS database 84, and the model performance information is decoded by the audio information decoder 39 and output from the speaker 44. When the output is completed, a voting evaluation input standby screen as shown in FIG. 10 is displayed on the video display device 30 via the video output control unit 32 or the like. According to the display, when a score for voting evaluation is input and a transmission operation is performed, the voting evaluation result is transmitted to the server device 20 by the transmission control means 98, and the SNS database 84 of the server device 20 It is stored in association with target model performance information. The voting evaluation control by the voting evaluation control means 104 may be executed only on the model performance information of the friend of the user who is the subject of the voting evaluation, or any irrelevant relationship with the friend. It may be performed on the user's model performance information.

  Through the control as described above, the SNS database 84 stores performance evaluation results by the performance evaluation control means 100 for a plurality of performance songs corresponding to (associated with) each of a plurality of users. Also, the voting evaluation results by the voting evaluation control means 104 regarding a plurality of performance songs are stored corresponding to (associated with) each of the plurality of users. Here, the performance evaluation control means 100 preferably performs an average of performance evaluation results stored in the SNS database 84 in association with the model performance information in performance evaluation based on predetermined model performance information. Average of performance evaluation results (corresponding to a plurality of performance songs) stored in the SNS database 84 in association with the user corresponding to the model performance information) The performance evaluation is performed based on the above. Preferably, in performance evaluation based on predetermined model performance information, an average of voting evaluation results stored in the SNS database 84 in association with the model performance information (when only one evaluation is stored) The performance evaluation is performed based on the average of the vote evaluation results (corresponding to a plurality of performance songs) stored in the SNS database 84 in association with the user corresponding to the model performance information. For example, an average of performance evaluation results (voting evaluation results) stored in the SNS database 84 in association with target model performance information, or in the SNS database 84 in association with a user corresponding to the model performance information. The evaluation is performed using the average of the stored performance evaluation results (voting evaluation results) as the upper limit value of the performance evaluation by the performance evaluation control means 100. In this way, the user's model performance information having a high average performance evaluation or vote evaluation is automatically selected as the standard for performance evaluation, and the performance evaluation close to the impression that the user actually feels is based on the model performance information. Realized.

  FIG. 11 is a flowchart for explaining a main part of the model performance evaluation control by the CPU 50 of the karaoke apparatus 16 and is repeatedly executed at a predetermined cycle.

  First, in step (hereinafter, step is omitted) SA1, it is determined whether or not a music selection input operation in the model scoring mode has been performed by the electronic quick sample device 22, the remote control device 64, or the like. If the determination of SA1 is negative, the processing from SA6 is executed. If the determination of SA1 is affirmative, in SA2, it is associated with the user's friend related to the music selection input in SA1. Then, the server device 20 is inquired whether or not the model performance information corresponding to the performance music related to the music selection is stored in the SNS database 84. When the determination of SA2 is negative, that is, when it is determined that the model performance information corresponding to the SNS database 84 is not stored (the server device 20 returns that fact), in SA3, For example, after the video notifying that there is no friend who has the model performance information as shown in FIG. 7 is displayed on the video display device 30, the processing of SA6 and below is executed, but the determination of SA2 is affirmative. If it is determined that the model performance information corresponding to the SNS database 84 is stored (that is, the server device 20 returns that effect), in SA4, for example, in FIG. As shown, the friend corresponding to the corresponding model performance information can be selected by the electronic quick sample device 22, the remote control device 64, or the like. After serial displayed on the image display device 30, in SA5, whether or not an operation prescribed friend is selected is performed according to the display is determined. When the determination of SA5 is denied, the determination is repeated to wait, but when the determination of SA5 is affirmed, it is associated with information (identification information) about the selected friend, After the performance music selected in SA1 is reserved in the reserved music table such as the RAM 54, the processes in SA6 and subsequent steps are executed.

  In SA6, it is determined whether or not the model karaoke performance is started, that is, the performance order of the predetermined performance music reserved in the reserved music table such as the RAM 54 is set, and the predetermined music performance information is associated with the performance music. It is determined whether or not. If the determination of SA6 is negative, the processing after SA1 is executed again, but if the determination of SA6 is positive, in SA7, the model performance information associated with the performance piece related to the start of the performance. Is downloaded from the SNS database 84 of the server device 20. Next, in SA8, the karaoke performance of the target musical piece is started, and in SA9 corresponding to the operation of the recording control means 96, the information related to the voice input by the microphone 40 (sound pitch and volume, or digital) Audio information itself) is recorded (recorded) in the RAM 54 or the like as needed. In synchronism with the processing of SA9, performance evaluation based on the model performance information downloaded in SA7 is performed in SA10 corresponding to the operation of the performance evaluation control means 100. Next, in SA11, it is determined whether or not the karaoke performance of the target musical piece is finished. When the determination at SA11 is negative, the processing after SA8 is executed again. When the determination at SA11 is positive, performance evaluations at SA10 are totaled at SA12 and the evaluation results are shown. The images shown in FIGS. 8 to 9 are displayed on the image display device 30. Next, in SA13, the performance evaluation result is transmitted to the server device 20 in association with the music selection number of the performance tune to be evaluated, the user identification information, etc., and then this routine is terminated. In the above control, SA3 and SA4 correspond to the operation of the notification control means 102, and SA8 and SA11 correspond to the operation of the performance control means 94, respectively.

  FIG. 12 is a flowchart for explaining a main part of the user vote evaluation control by the CPU 50 of the karaoke apparatus 16 and is repeatedly executed at a predetermined cycle.

  First, in SB1, it is determined whether or not a user scoring (voting evaluation) start operation for predetermined model performance information has been performed by the electronic quick sample device 22, the remote control device 64, or the like. If the determination at SB1 is negative, the routine is terminated accordingly. If the determination at SB1 is affirmative, at SB2, the target model performance is obtained from the SNS database 84 of the server device 20. Information is downloaded. Next, in SB3 corresponding to the operation of the audio information decoder 39, the model performance information downloaded in SB2 is decoded, and the audio corresponding to the model performance information is output from the speaker 44. Next, in SB4, it is determined whether or not the output of the target model performance information has been completed. If the determination at SB4 is negative, the processes after SB3 are executed again. However, if the determination at SB4 is affirmative, the voting evaluation waiting image as shown in FIG. It is displayed on the video display device 30, and a score input operation and a determination transmission operation are waited for via the electronic quick sample device 22, the remote control device 64, and the like. Next, at SB6, it is determined whether or not a decision transmission operation has been performed by the electronic quick sample device 22, the remote control device 64, or the like. When the determination at SB6 is negative, the processing after SB5 is executed again. When the determination at SB6 is affirmative, at SB7, the model performance information and the evaluation subject whose voting score results are the subject. After being transmitted to the server device 20 in association with the user identification information, etc., this routine is terminated. In the above control, SA13 and SB7 correspond to the operation of the transmission control unit 98, and SB2 to SB7 correspond to the operation of the vote evaluation control unit 104, respectively.

  As described above, according to the present embodiment, the recording control means 96 (SA9) for recording the information related to the voice input by the microphone 40 as the voice input device in response to the output of the predetermined performance music, The SNS database 84 for storing information related to the sound recorded by the recording control means 96 in association with the corresponding performance tune, and when outputting a predetermined performance tune, the SNS database 84 is stored in association with the performance tune. Since the performance evaluation control means 100 (SA10) for performing performance evaluation based on information related to sound is provided, the performance evaluation is performed by performing performance evaluation based on information corresponding to the user's actual singing. It is possible to provide the karaoke system 10 that realizes performance evaluation close to the impression that a person actually feels.

  The information related to the sound is obtained by converting the sound input from the microphone 40 into a digital signal, and the sound corresponding to the information is output based on the information related to the sound stored in the SNS database 84. The SNS database 84 includes an audio information decoder 39 (SB3) as output means and voting evaluation control means 104 (SB2 to SB7) for receiving voting evaluation for the audio output by the audio information decoder 39. The voting evaluation control means 104 stores the voting evaluation result in association with the corresponding performance music, and the performance evaluation control means 100 stores the performance music in the SNS database 84 when outputting the predetermined performance music. Information related to the voice stored in association with the The performance evaluation is based on the performance of the user, so the vote evaluation is accepted for the actual singing of the user, and the performance evaluation is performed based on the result of the vote evaluation. Performance evaluation can be realized.

  Further, since the SNS database 84 stores information related to the sound of the user's performance in association with each of a plurality of users in association with the corresponding performance music, the SNS database 84 is intended for a predetermined user. As a result, performance evaluation based on information corresponding to the user's actual singing can be realized.

  In addition, notification input means 102 (SA3 and SA4) for notifying whether or not information related to the sound corresponding to the performance music is stored in the SNS database 84 when the music selection input of the predetermined performance music is performed. Since it is provided, it is possible to suitably notify whether or not performance evaluation is possible based on information corresponding to the user's actual song.

  In addition, the performance evaluation control means 100 outputs the pitch and volume of the voice input by the microphone 40 and the pitch and volume of the voice stored in the SNS database 84 in association with the performance song when outputting a predetermined performance song. Since the performance evaluation is performed by comparing the volume, the performance evaluation can be performed in a practical manner based on information corresponding to the user's actual song.

  The SNS database 84 stores performance evaluation results by the performance evaluation control means 100 for a plurality of performance songs corresponding to a plurality of users, and the performance evaluation control means 100 stores the performance evaluation results. Since the performance evaluation is performed based on the average of the evaluation results, the user actually feels further by performing the performance evaluation based on the past performance evaluation results of the user for a predetermined user. Performance evaluation close to the impression can be realized.

  Further, the SNS database 84 stores voting evaluation results by the voting evaluation control means 104 for a plurality of performance songs corresponding to each of a plurality of users, and the performance evaluation control means 100 Since the performance evaluation is performed based on the average of the evaluation results, the user actually feels further by performing the performance evaluation based on the past vote evaluation results for the predetermined user. Performance evaluation close to the impression can be realized.

  The SNS database 84 stores a plurality of users as friends, and the performance evaluation control unit 100 stores the performance tunes related to a predetermined user in the SNS database 84. Since the performance evaluation is performed based on the information related to the voice stored in association with the performance song corresponding to the friend of the user, the actual singing of the user registered as the friend in the social network service is performed. Performance evaluation based on corresponding information can be realized.

  The preferred embodiments of the present invention have been described in detail with reference to the drawings. However, the present invention is not limited to these embodiments, and may be implemented in other modes.

  For example, in the above-described embodiment, the login authentication unit 92, the performance control unit 94, the recording control unit 96, the transmission control unit 98, the performance evaluation control unit 100, the notification control unit 102, and the vote evaluation control unit 104 are the karaoke unit. The CPU 50 of the device 16 is functionally provided. However, the present invention is not limited to this, and some of these functions are performed by the CPU 66 of the server device 20 or the electronic sample device 22. A CPU or the like may be functionally provided. For example, the notification control means 102 may be provided in the electronic quick sample device 22 and images as shown in FIGS. 6 to 10 may be displayed on the touch panel display of the electronic quick sample device 22.

  In the above-described embodiment, the performance evaluation control means 100 obtains a smooth curve by taking N points of pitch data and interpolating with an N-1 degree polynomial, and performs performance evaluation based on the curve. However, for example, the waveform of each of the input voice information and the model performance information input from the microphone 40 is captured as an image, and performance evaluation is performed by an image processing method based on these images based on a predetermined relationship. Also good. That is, various evaluation methods by the performance evaluation control means 100 can be appropriately selected and used.

  In the above-described embodiment, the information related to the voice recorded by the recording control unit 96 is stored in the SNS database 84 in association with the user related to the voice. Or it may be stored in a predetermined storage device independently of the social network service in the karaoke system 10. Furthermore, it is conceivable that all the model performance information is stored as anonymous data without being associated with the identification information of the user, and the performance evaluation control is performed based on the model performance information.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

It is the schematic explaining the karaoke system to which this invention is applied suitably. It is a block diagram which illustrates the structure of the karaoke apparatus with which the karaoke system of FIG. 1 was equipped. It is a block diagram explaining the structure of the server apparatus with which the karaoke system of FIG. 1 was equipped. It is a functional block diagram explaining the principal part of the control function with which CPU of the karaoke apparatus of FIG. 2 and CPU of the server apparatus of FIG. 3 were equipped. It is a figure explaining the performance evaluation control by CPU of the karaoke apparatus of FIG. 2, The waveform of the input audio | voice information corresponded to the audio | voice input from a microphone with a continuous line, and the waveform of the model performance information read from a SNS database with a dashed-dotted line Each is shown. 3 is an image showing that there is a friend having model performance information in the SNS database, which is displayed on the image display device during performance evaluation control by the CPU of the karaoke apparatus of FIG. 2. 3 is an image showing that there is no friend having model performance information in the SNS database, which is displayed on the image display device during performance evaluation control by the CPU of the karaoke apparatus of FIG. 2. It is an example of the evaluation result image | video displayed on a video display apparatus at the time of completion | finish of the performance evaluation control by CPU of the karaoke apparatus of FIG. It is another example of the evaluation result image | video displayed on a video display apparatus at the time of completion | finish of the performance evaluation control by CPU of the karaoke apparatus of FIG. FIG. 3 is a voting score waiting image displayed on a video display device during voting evaluation control by the CPU of the karaoke apparatus of FIG. 2. FIG. It is a flowchart explaining the principal part of the model performance evaluation control by CPU of the karaoke apparatus of FIG. It is a flowchart explaining the principal part of user vote evaluation control by CPU of the karaoke apparatus of FIG.

Explanation of symbols

10: Karaoke system 16: Karaoke device 39: Audio information decoder (audio output means)
40: Microphone (voice input device)
84: SNS database 96: recording control means 100: performance evaluation control means 102: notification control means 104: vote evaluation control means

Claims (7)

A karaoke system using a karaoke apparatus that outputs a predetermined performance tune selected from a large number of performance tunes and amplifies and outputs a voice input by a voice input device,
Corresponds to the output of a given music piece, a recording control means for recording those digital signal of the voice input by the voice input device as the information related to the sound,
A database for storing information related to the sound recorded by the recording control means in association with the corresponding performance song;
Sound output means for outputting sound corresponding to the information based on the information about the sound stored in the database;
Voting evaluation control means for receiving voting evaluation for the sound output by the sound output means;
Upon output of a given music piece, a playing evaluation control means for playing evaluated on the basis of information relating to audio stored associated with the musical piece in the database
With
The database stores the voting evaluation result by the voting evaluation control means in association with the corresponding performance music,
The performance evaluation control means performs performance evaluation based on information related to the sound stored in the database in association with the performance music and a voting evaluation result when outputting a predetermined performance music. Karaoke system to do. 2. The karaoke system according to claim 1 , wherein the database stores, in correspondence with each of a plurality of users, information related to a sound played by the user in association with the corresponding performance music. 3. A notification control means for notifying whether or not information relating to the sound corresponding to the performance music is stored in the database when a music selection input of a predetermined performance music is performed. Karaoke system as described in. The performance evaluation control means compares the pitch and volume of the voice input by the voice input device with the pitch and volume of the voice stored in the database in association with the performance song when outputting a predetermined performance song. Karaoke system according to any one of claims 1 to 3 and performs the playing evaluated by. The database stores performance evaluation results by the performance evaluation control means regarding a plurality of performance songs corresponding to each of a plurality of users, and the performance evaluation control means is based on an average of the performance evaluation results. Karaoke system according to claim 1 in any one of the 4 and performs the playing evaluation Te. The database stores, for each of a plurality of users, voting evaluation results by the voting evaluation control means regarding a plurality of performance songs, and the performance evaluation control means is based on an average of the voting evaluation results. Karaoke system according to any one of claims 1 to 5 and performs the playing evaluation Te. The database stores a plurality of users as friends in association with each other, and the performance evaluation control means corresponds to the user's friends in the database when outputting a performance song related to the predetermined user. The karaoke system according to any one of claims 2 to 6 , wherein performance evaluation is performed on the basis of information relating to the voice stored in association with the performance tune.

Images