JP2006162916A - Music reproducing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a music reproducing apparatus having a fresh playing evaluation function to provide a user with joy to play music. <P>SOLUTION: The apparatus includes: a sensor 46 for detecting the action of at least a portion of the body of the user 54 as an evaluation object; an action judgment means 58 for judging the action of the evaluation object according to the detection result by the sensor 46; and an action evaluation means 60 for evaluating the action of the evaluation object by comparing the judgment result by the action judgment means 58 and the predetermined model action of the evaluation object. Hence, the body action, such as choreography in playing of playing music, is evaluated, and the fresh playing evaluation rich in enjoyableness is realized. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a music playback device such as a karaoke device used in, for example, a karaoke box, and more particularly to improvement of a performance evaluation function.

  2. Description of the Related Art Music playback apparatuses that output a predetermined performance song selected from a large number of performance songs are known. For example, a karaoke device used in a karaoke box or the like. According to such a karaoke apparatus, music information of a predetermined karaoke performance song selected from a large number of karaoke performance songs stored in advance in a storage device is output, and an image including lyrics information of the karaoke performance song is output. Karaoke performance of a desired song can be enjoyed by displaying it on the screen in synchronization with.

  By the way, the karaoke apparatus that has been widely used in recent years has not only a function as a music reproducing apparatus as described above but also a performance evaluation function that evaluates (scores) singing ability based on voice information input from a microphone. There is something. For example, it is a karaoke apparatus described in Patent Document 1. According to such a karaoke apparatus, by comparing the voice information input from the microphone with the performance information of the karaoke performance song based on the pitch, tempo, volume, etc., the evaluation of the singing according to the input voice information Can be scored.

JP-A-9-101794

  However, in recent years, the karaoke apparatus having a performance evaluation function has become widespread so that the conventional performance evaluation function described above is not particularly new. Furthermore, it has become widely known that its function is to evaluate performance based on the pitch, tempo, volume, etc., and the selection of songs and singing methods to achieve high scores has been established. It became a tendency to decline. Accordingly, the present inventor has conducted intensive research on user trends in order to develop a music playback device having a new performance evaluation function that is rich in entertainment. Focusing on the fact that there are many cases, we have devised a technique for evaluating such physical movement as part of the performance.

  The present invention has been made in the background of the above circumstances, and an object of the present invention is to provide a music playback device having a new performance evaluation function that gives a user a pleasure to perform.

  In order to achieve such an object, the gist of the present invention is a music playback device for outputting a predetermined performance song selected from a large number of performance songs, and at least a part of a user's body. A sensor for detecting the motion as an evaluation target, a motion determination means for determining the motion of the evaluation target based on a detection result by the sensor, a determination result by the motion determination means and the predetermined evaluation target And a motion evaluation means for evaluating the motion of the evaluation object by comparing with the above-mentioned exemplary motion.

  In this way, a sensor for detecting the motion of at least a part of the user's body as an evaluation target, a motion determination means for determining the motion of the evaluation target based on the detection result by the sensor, And a motion evaluation unit that evaluates the motion of the evaluation target by comparing the determination result by the motion determination unit and a predetermined model motion of the evaluation target. It is possible to evaluate the body movement and realize a new performance evaluation rich in entertainment. That is, it is possible to provide a music playback device having a new performance evaluation function that gives a user a pleasure to perform.

  Here, it preferably includes an exemplary action display means for displaying an image showing an exemplary action to be evaluated. In this way, there is an advantage that performance evaluation can be enjoyed while referring to an exemplary operation displayed as a video.

  Preferably, the model operation to be evaluated is individually determined for each performance piece. In this way, in addition to being able to realize a performance evaluation that is rich in entertainment with respect to a performance piece having a characteristic choreography, there is an advantage that the user can learn such a choreography by repeating the performance accompanied by the performance evaluation.

  Preferably, an evaluation result display means for displaying an evaluation result by the operation evaluation means is included. In this way, there is an advantage that the evaluation result can be visually confirmed.

  Preferably, the motion evaluation unit performs the evaluation at each predetermined timing, and the evaluation result display unit displays the evaluation result every time the evaluation by the motion evaluation unit is performed. It is something to be made. In this way, there is an advantage that the evaluation result updated from time to time can be visually confirmed and performance evaluation with higher entertainment can be realized.

  Preferably, the sensor is provided integrally with a microphone for inputting voice information. In this way, it is possible to suitably detect the operation of the user's hand holding the microphone as an evaluation target.

  Preferably, the sensor is used by being attached to a part of the body of the user to be evaluated. If it does in this way, the operation | movement can be suitably detected for the arbitrary site | parts of the said user's body as evaluation object.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram illustrating the configuration of a karaoke apparatus 10 which is an embodiment of a music playback apparatus of the present invention. As shown in FIG. 1, the karaoke device 10 includes a video display device 12 such as a CRT, a video information decoder 14, a video mixer 16, an amplifier mixer 18, a speaker 20, and a microphone 22 that is an audio information input device. Processing the input signals from the operation panel 24, the CPU 26 as the central processing unit, the ROM 28, the RAM 30, the hard disk 32 as the storage device, the modem 34, the CRT controller 36, the operation panel 24 and the like. An input / output interface 38, a synthesizer 40 as a sound source, a remote control receiving unit 42 for receiving a remote control signal from an input device such as a remote control device 48 or an electronic quick sample device 50, and the electronic quick sample device 50, etc. Wireless LAN communication unit 44 for performing wireless LAN communication between and the user's operation is detected And because of the sensor 46 is configured to include.

  The CPU 26 is a so-called computer that processes and controls electronic information based on a predetermined program stored in advance in the ROM 28 using the temporary storage function of the RAM 30, and includes the remote control device 48, the electronic sample device 50, and the like. When a predetermined karaoke performance song is selected by the above, the selected karaoke performance song is registered in the reserved song list provided in the RAM 30 or selected from the hard disk 32 in the RAM 30 according to the performance order of the reserved song list. The performance information and lyric information of the karaoke performance song read out, the performance information is transmitted from the RAM 30 to the synthesizer 40 as the performance of the karaoke performance song progresses, or the lyric character image based on the lyric information Is generated and sent to the CRT controller 36. In addition to basic control such as generating an image and sending it to the CRT controller 36, or controlling the video information decoder 14 to reproduce a predetermined background video, it will be described later based on the detection result of the sensor 46. Perform performance evaluation control (action scoring control).

  The operation panel 24 selects a karaoke performance song that the user of the karaoke apparatus 10 wants to sing, adjusts the pitch of the performance song, adjusts the volume balance between the performance and the song, and performs echo and volume. , An input device provided with operation buttons (switches) or knobs for performing various adjustments such as tone. Further, the karaoke apparatus 10 is provided with a remote control device 48 that functions as an input device for remotely executing a part of the function of the operation panel 24 and an electronic quick sample device 50, and the remote control receiving unit 42 includes The remote control signals transmitted from these input devices are received and supplied to the CPU 26. In addition, the wireless LAN communication unit 44 receives a music selection input from the electronic quick sample device 50 by performing wireless LAN communication with the electronic quick sample device 50, or receives the music selection input from the karaoke device 10. Information is exchanged between the karaoke apparatus 10 and the electronic sample apparatus 50 via radio waves, such as transmitting a command for executing predetermined processing to 50.

  The video information decoder 14 is a background video playback device that plays back (decodes) a predetermined background video based on background video information stored in the hard disk 32 when a user sings a song while referring to lyrics. The background video information is, for example, MPEG (Moving Picture Experts Group) format data, and the background video reproduced by the video information decoder 14 based on the MPEG data is sent to the video mixer. The CRT controller 36 is a character image output device that outputs a character image (telop) such as a lyric character image generated by the CPU 26, and the video mixer 16 is generated by the CPU 26 and the CRT controller 36. Is synthesized with the character video output from the video information decoder 14 and the background video reproduced by the video information decoder 14 and displayed on the video display device 12.

  The synthesizer 40 is a sound source that generates a music signal such as a musical instrument performance signal based on performance information of a karaoke performance song read from the hard disk 32 and sent. The performance information is, for example, data in MIDI (Musical Instrument Digital Interface) format, and the music signal generated by the synthesizer 40 based on the MIDI data is converted into an analog signal and sent to the amplifier mixer 18. In the amplifier mixer 18, the transmitted music signal and the user's singing voice input via the microphone 22 are mixed, and these signals are electrically amplified and output from the speaker 20.

  The modem 34 is a device for connecting the karaoke apparatus 10 to a communication line 52 such as a public telephone line. A plurality of karaoke devices 10 provided in a store such as a karaoke box are connected to a center device or the like of a karaoke service providing company (not shown) via the communication line 52, and the karaoke devices 10 always provide new songs. New karaoke information or the like is distributed from the center device through the communication line 52 and stored in a database or the like provided in the hard disk 32 as needed. That is, the karaoke apparatus 10 is a communication karaoke apparatus capable of transmitting and receiving various types of information through an electric communication line.

  FIG. 2 is a diagram showing a state in which a user (singer) 54 performs a karaoke performance by the karaoke apparatus 10. The sensor 46 is, for example, a gyro sensor or an angle sensor that detects an angle change with respect to a reference line, an acceleration sensor that detects a magnitude and change of acceleration, a vibration sensor that detects a magnitude and change of vibration, and the like. When the user 54 performs a karaoke performance, the motion is detected with at least a part of the body as an evaluation target. Preferably, as shown in FIG. 2, the microphone 22 is provided integrally with the microphone 22, and the movement of the user 54 (or arm) having the microphone 22 is detected as an evaluation target. To do. The motion of the evaluation target detected by the sensor 46 is, for example, the motion direction (angle), motion amount (displacement amount), motion timing, motion trajectory, etc. of the evaluation target, and a signal indicating the motion detected here. Is supplied to the CPU 26 and used for performance evaluation control (action scoring control) to be described later.

  FIG. 3 is a functional block diagram illustrating the main part of the control function provided in the CPU 26 of the karaoke apparatus 10. As shown in FIG. 3, the hard disk 32 is provided with an operation database 56 that stores information related to the operation to be evaluated by the sensor 46. The information related to the motion is a model operation (evaluation target) that is a reference for evaluation by the motion evaluation means 60, for example, a model value (reference value) such as a motion direction, a motion amount, a motion timing, and a motion trajectory of the evaluation target. The information related to the operation stored in the operation database 56 is preferably individually determined for each karaoke performance song corresponding to the characteristic choreography and the like, and the song selection number of the karaoke performance song is similarly identified. It is a sign. In this case, the model operation for each performance piece naturally reflects each performance piece (especially its tempo).

  The operation determination unit 58 determines the operation to be evaluated based on the detection result by the sensor 46. For example, the motion direction, motion amount, motion timing, motion trajectory, and the like to be evaluated are determined. Further, the motion evaluation means 60 evaluates the motion of the evaluation target by comparing the determination result by the motion determination means 58 with the model motion of the evaluation target stored in the motion database 56 in advance. This evaluation includes, for example, a shift of the determined motion direction with respect to the reference motion direction, a difference between the determined motion amount and the reference motion amount, a shift of the determined motion timing with respect to the reference operation timing, This is performed based on a deviation from the motion trajectory serving as a reference of the motion trajectory. In the present embodiment, the aspect of scoring numerically with a maximum score of 100 will be described, but the aspect of evaluation is not limited to scoring, such as performing any of a plurality of predetermined evaluations. .

  The evaluation result display means 62 causes the video display device 12 to display a video showing the evaluation result by the operation evaluation means 60. The exemplary action display unit 64 causes the video display device 12 to display an image indicating the exemplary action to be evaluated stored in the action database 56. FIG. 4 is a view showing a state in which an image 66 showing an evaluation result and an image 68 showing an exemplary operation of an evaluation target are displayed on the image display device 12. As shown in FIG. Reference numeral 62 denotes an image including character information such as “action scoring is 80 points” which is an evaluation result (scored score) by the operation evaluating means 60 by controlling operations of the CRT controller 36 and the video mixer 16. 66 is synthesized and displayed on an upper layer than the background video. The exemplary action display means 64 combines and displays a video 68 including a predetermined animation corresponding to the exemplary action to be evaluated, which is stored in advance in the action database 56, on a layer higher than the background video. .

  The motion evaluation means 60 preferably performs the evaluation at a predetermined timing, and the evaluation result display means 62 displays the evaluation result every time the evaluation by the motion evaluation means 60 is performed. The video 66 shown is updated. That is, as shown in FIG. 4, the video 66 indicating the evaluation result displayed on the video display device 12 is updated at every predetermined timing and is changed every moment. An image 68 showing an exemplary motion displayed by the exemplary motion display means 64 is intermittently or continuously changed, and the user 54 performs physical motion while referring to these temporally changing images. You can enjoy the performance evaluation to be evaluated.

  FIG. 5 is a flowchart for explaining performance evaluation control (action scoring control) by the CPU 26 of the karaoke apparatus 10, and is repeatedly executed at a predetermined cycle.

  First, in step (hereinafter, step is omitted) S1, it is determined whether or not the performance of a predetermined karaoke performance is started. If the determination in S1 is negative, the routine is terminated accordingly, but if the determination in S1 is affirmative, an action scoring mode in which the user's physical motion is evaluated is determined in S2. It is determined whether or not it is selected. If the determination in S2 is negative, the routine is terminated accordingly. If the determination in S2 is affirmative, the karaoke being played is performed in S3 corresponding to the exemplary action display means 64. Information indicating an exemplary operation corresponding to the performance music is read from the operation database 56, and an image 68 indicating the exemplary operation is displayed on the image display device 12. Next, in S4 corresponding to the motion determining means 58, the motion of the evaluation target is determined based on the detection result by the sensor 46. Next, in S5, it is determined whether or not it is a predetermined evaluation timing. If the determination in S5 is negative, the processing from S8 is executed, but if the determination in S5 is affirmative, it is determined in S4 in S6 corresponding to the motion evaluation means 60. The determination result is compared with the model operation to be evaluated read from the operation database 56, and the operation to be evaluated is evaluated (scored). Next, in S7 corresponding to the evaluation result display means 62, a video 66 indicating the evaluation result determined in S6 is displayed (updated) on the video display device 12. Next, in S8, it is determined whether or not the karaoke performance is over. If the determination in S8 is negative, the processing from S3 is executed again. If the determination in S8 is affirmative, this routine is terminated.

  Thus, according to the present embodiment, the sensor 46 for detecting the motion of at least a part of the body of the user 54 as the evaluation target, and the motion of the evaluation target based on the detection result by the sensor 46. The operation determining unit 58 (S6) for evaluating the evaluation target operation by comparing the determination result by the operation determining unit 58 (S4) with the determination result by the operation determining unit 58 and a predetermined model operation of the evaluation target. ), It is possible to evaluate body movements such as choreography in the performance of the performance music, and it is possible to realize new performance evaluation rich in entertainment. That is, it is possible to provide the karaoke apparatus 10 having a new performance evaluation function that gives the user pleasure to perform.

  In addition, since it includes the exemplary action display means 64 (S3) for displaying the video 68 indicating the exemplary action to be evaluated, there is an advantage that the performance evaluation can be enjoyed while referring to the exemplary action displayed as an image. .

  In addition, since the exemplary behaviors to be evaluated are individually determined for each performance piece, in addition to being able to realize a performance evaluation that is highly entertaining with respect to a performance piece having a characteristic choreography, a performance with performance evaluation is performed. By repeating the above, there is an advantage that the user 54 can learn such choreography.

  Moreover, since the evaluation result display means 62 (S7) for displaying the video 66 indicating the evaluation result by the operation evaluation means 60 is included, there is an advantage that the evaluation result can be visually confirmed.

  The motion evaluation means 60 performs the evaluation at a predetermined timing, and the evaluation result display means 62 displays the evaluation result every time the motion evaluation means 60 performs the evaluation. Therefore, the evaluation result updated from time to time can be visually confirmed, and there is an advantage that performance evaluation with higher entertainment can be realized.

  Further, since the sensor 46 is provided integrally with the microphone 22 for inputting voice information, the operation of the user 54 having the microphone 22 is preferably detected as an evaluation target. Can do.

  The preferred embodiments of the present invention have been described in detail with reference to the drawings. However, the present invention is not limited to these embodiments, and may be implemented in other modes.

  For example, in the above-described embodiment, the sensor 46 is provided integrally with the microphone 22 and detects the operation of the hand of the user 54 having the microphone 22 as an evaluation target. However, the present invention is not limited to this, and for example, it may be incorporated in a handy karaoke device for performing karaoke performance by connecting to a home CRT or the like. Further, as shown in FIG. 6, a wireless sensor 70 that is attached to a part of the body of the user 54 to be evaluated and detects its operation may be provided. If it does in this way, the operation | movement can be suitably detected for the arbitrary site | parts of the said user's 54 body as evaluation object. FIG. 6 shows an aspect in which both wrists of the user 54 are targeted for evaluation, and their actions are detected and evaluated in a composite manner. In this case, the video display device 12 is shown in FIG. As shown, an image 72 showing an exemplary operation of both wrists is displayed. Further, it may be one that optically detects the operation of the user 54 using a CCD image pickup device or the like, as long as it is a sensor that can detect the operation of at least a part of the body of the user 54 as an evaluation target. The aspect is not ask | required.

  Further, in the above-described embodiment, the model operation to be evaluated is individually determined for each performance piece. For example, one model operation is assigned to a plurality of pieces of performance piece. It may be determined in common for performance songs with similar tempos. In performances for children and the like, it is conceivable that moving the body in accordance with the music itself is a pleasure, so even in this aspect, the effects of the present invention can be obtained. Further, the operation as a reference for evaluation may be as simple as shaking the microphone 22 in small increments, swinging it, or setting an angle.

  In the above-described embodiment, the information indicating the model operation to be evaluated is stored in the operation database 56 provided in the hard disk 32. Such model operation is individually performed for each performance piece. In the defined mode, it may be stored in the karaoke database as part of the karaoke information of the performance music.

  Moreover, although the above-mentioned Example demonstrated the aspect which performs only the action scoring control which makes the said user's 54 body motion the evaluation object, the song evaluation based on the audio | voice information input from the said microphone 22 with such evaluation is carried out. It may be what performs. In this way, more various performance evaluations can be made, and the entertainment can be enhanced as much as possible.

  Although not particularly mentioned in the above-described embodiment, when the operation panel 24 or the like is used to change the tempo of the performance music, the action evaluation means 60 performs a reference action corresponding to the change. (Timing etc.) is corrected and evaluated. In this case, the evaluation timing by the motion evaluation means 60 and the update of the evaluation result by the evaluation result display means 64 following the evaluation timing also correspond to the changed tempo.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

It is a block diagram which illustrates the composition of the karaoke device which is one example of the music reproducing device of the present invention. It is a figure which shows a user (singer) performing a karaoke performance with the karaoke apparatus of FIG. It is a functional block diagram explaining the principal part of the control function with which CPU of the karaoke apparatus of FIG. 1 was equipped. It is a figure which shows a mode that the image | video which shows the evaluation result, and the image | video which shows model operation | movement of evaluation object were displayed on the video display apparatus of the karaoke apparatus of FIG. It is a flowchart explaining the performance evaluation control (action scoring control) by CPU of the karaoke apparatus of FIG. It is a figure which shows a mode that a user performs a karaoke performance with the karaoke apparatus which is another Example of this invention. It is a figure which shows a mode that the image | video which shows the evaluation result corresponding to the Example of FIG. 6, and the image | video which shows model operation | movement of evaluation object were displayed on the video display apparatus.

Explanation of symbols

10: Karaoke device (music playback device)
22: Microphone 46, 70: Sensor 54: User 58: Motion determination means 60: Motion evaluation means 62: Evaluation result display means 64: Model motion display means 68, 72: Video showing model motion

Claims (7)

A music playback device for outputting a predetermined performance song selected from a large number of performance songs,
A sensor for detecting the movement of at least a part of the user's body as an evaluation target;
Action determining means for determining the action of the evaluation object based on the detection result by the sensor;
And a motion evaluation unit that evaluates the motion of the evaluation target by comparing a determination result of the motion determination unit with a predetermined model motion of the evaluation target.   The music reproducing apparatus according to claim 1, further comprising exemplary operation display means for displaying an image showing an exemplary operation to be evaluated.   3. The music reproducing apparatus according to claim 1, wherein the model operation to be evaluated is determined individually for each performance piece.   4. The music reproducing apparatus according to claim 1, further comprising evaluation result display means for displaying an evaluation result by the motion evaluation means.   The operation evaluation means performs the evaluation at a predetermined timing, and the evaluation result display means displays the evaluation result every time the operation evaluation means performs an evaluation. 4. Music playback device.   6. The music playback device according to claim 1, wherein the sensor is provided integrally with a microphone for inputting voice information.   The music playback device according to claim 1, wherein the sensor is used by being attached to a part of the body of the user to be evaluated.

Images