JP2009157058A - Electronic musical instrument and scoring system for musical instrument karaoke - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic musical instrument etc. accurately scoring pressing action. <P>SOLUTION: Pressed timing and pressed duration are calculated. Based on the pressed duration, pressed strength is calculated. By comparing the pressed timing and pressed strength, and reference start time and reference duration time, the pressing action is accurately scored. By using a note-on signal of a MIDI data and velocity information, the reference start time and the reference duration time are set. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to scoring of electronic musical instruments.

  2. Description of the Related Art Conventionally, there is an apparatus using a display having a touch panel as a pseudo musical instrument. For example, Patent Document 1 below describes a device that detects a pressed position and generates a sound corresponding to the detected position. In such an apparatus, the scoring process for the pressing operation can be performed based on the pressing timing.

JP-A-5-153034

  In order to score with high accuracy, it is desirable to consider not only the timing of pressing but also the strength of pressing. However, the above Patent Document 1 does not disclose anything about this point.

  The present invention has been made to solve the above-described problems, and an object thereof is to provide an electronic musical instrument or the like that can detect the pressed strength and reflect the detected strength in the scoring result. .

  The invention according to claim 1, which is an aspect of the present invention, is an electronic musical instrument having a touch panel, wherein voltage output means for outputting a voltage corresponding to a pressed position and when a predetermined voltage is detected, Time acquisition means for acquiring the detected time, sound output instruction means for instructing output of a predetermined sound when the predetermined voltage is detected, and continuation for measuring a duration during which the predetermined voltage is detected During the performance of the music based on the instrument performance progress information and the time measurement means, the sound generation start timing of the predetermined instrument sound included in the instrument performance progress information is compared with the detected time, and the evaluation value regarding the pressing timing is calculated First calculating means for comparing the sound generation duration of the predetermined instrument sound with the measured duration, and calculating an evaluation value related to the pressing strength, the first calculating means and the first calculating means 2 Based on the evaluation value calculated by the detecting means, characterized in that it comprises a scoring means for performing scoring about the press.

  The electronic musical instrument has a touch panel (for example, a resistance 4-wire type), outputs a voltage corresponding to the pressed position, and detects a predetermined voltage (that is, detects pressing of the predetermined position). The time is acquired, and when the voltage is detected, the output of a predetermined sound is instructed (to a predetermined sound source), and the duration during which the voltage is detected is measured. Then, during the performance of the music based on the music performance progress information, the sound generation start timing of a predetermined instrument sound included in the instrument performance progress information is compared with the detected time to calculate an evaluation value related to the pressing timing, Then, the sound generation duration of the predetermined instrument sound is compared with the measured duration to calculate an evaluation value related to the pressing strength. Here, the music is played by a predetermined music playback device. Further, the predetermined music reproducing device may be provided in the electronic musical instrument or may be provided outside the electronic musical instrument. Based on the evaluation value, scoring for the pressing is performed. Thereby, scoring regarding the pressing operation on the touch panel can be performed with high accuracy.

  According to a second aspect of the present invention which is one aspect of the present invention, in the electronic musical instrument of the first aspect, the musical instrument performance signal information is MIDI data, and the sound generation start timing is the predetermined data included in the MIDI data. It is the detection timing of the note-on signal of the instrument sound track, and the sounding duration is a period from the detection timing of the note-on signal to the detection timing of the note-off signal of the instrument sound track included in the MIDI data, or It is a decay time of the musical instrument sound calculated based on velocity information corresponding to the note-on signal.

  According to the above electronic musical instrument, MIDI data is adopted as the musical instrument performance signal information, and it is possible to score the press using the note-on signal, note-off signal, and velocity information included in the MIDI data.

  According to a third aspect of the present invention, in the electronic musical instrument having a touch panel, the voltage output means for outputting a voltage corresponding to the pressed position and the predetermined voltage are detected. Time acquisition means for acquiring time, sound output instruction means for instructing output of a predetermined sound when the predetermined voltage is detected, and duration measurement for measuring the duration of detection of the predetermined voltage Means, strength calculation means for calculating the pressed intensity based on the duration time, and the start of pronunciation of a predetermined instrument sound included in the instrument performance progress information during the performance of the music based on the instrument performance progress information The first calculation means for comparing the timing with the detected time and calculating an evaluation value related to the pressing timing, and comparing the pronunciation strength corresponding to the pronunciation start timing with the calculated strength, A third calculating means for calculating an evaluation value based on the evaluation value calculated by the first calculation unit and the third calculation means, characterized in that it comprises a scoring means for performing scoring for the above pressing.

  According to the electronic musical instrument, the time when a touch panel (for example, a 4-wire type) is provided, a voltage corresponding to the pressed position is output, and a predetermined voltage is detected (that is, pressing of the predetermined position is detected). When the voltage is detected, the output of a predetermined sound is instructed (to a predetermined sound source), the duration during which the voltage is detected is measured, and the intensity pressed based on the duration Is detected. Then, during the performance of the music based on the music performance progress information, the sound generation start timing of a predetermined instrument sound included in the instrument performance progress information is compared with the detected time to calculate an evaluation value related to the pressing timing, Then, an evaluation value related to the pressing strength is calculated by comparing the sounding strength of the predetermined instrument sound with the detected pressing strength. Here, the music is played by a predetermined music playback device. Further, the predetermined music reproducing device may be provided in the electronic musical instrument or may be provided outside the electronic musical instrument. Based on the evaluation value, scoring for the pressing is performed. Thereby, scoring regarding the pressing operation on the touch panel can be performed with high accuracy.

  The invention according to claim 4 which is one aspect of the present invention is the electronic musical instrument according to claim 3, wherein the musical instrument performance signal information is MIDI data, and the sound generation start timing is included in the MIDI data. This is the detection timing of the note-on signal of the instrument sound track, and the sound intensity corresponding to the sound generation start timing is the intensity of playing the instrument sound calculated based on the velocity information corresponding to the note-on signal. It is characterized by that.

  According to the electronic musical instrument, MIDI data is used as the musical instrument performance signal information, and the scoring is performed using the note-on signal and velocity information included in the MIDI data, so the period from the note-on signal to the note-off signal It is possible to score a track of a specific percussion instrument in which the pronunciation period may not be specified.

  The invention according to claim 5 which is one aspect of the present invention is the electronic musical instrument according to any one of claims 1 to 4, wherein the predetermined musical instrument sound is a drum or a bass.

  According to the electronic musical instrument, since the musical instrument sound to be scored for the pressing operation can be a drum or bass that is a percussion instrument, the sound generation period may not be specified in the period from the note-on signal to the note-off signal. Drum track or bass track can be scored.

  The invention according to claim 6 which is one aspect of the present invention is the electronic musical instrument according to any one of claims 1 to 5, further comprising a music search means and a music request means, wherein the performance of the music is karaoke It is performed by the apparatus.

  According to the electronic musical instrument, it is possible to search and request a music piece in karaoke or the like, and to perform a scoring for pressing during music reproduction in the karaoke apparatus. Thereby, while having a function also as a remote controller for karaoke, scoring about a pushing operation can be performed with high accuracy during music reproduction.

  The invention according to claim 7 which is one aspect of the present invention is a karaoke instrument scoring system including a remote controller and a commander, and the remote controller has a touch panel and outputs a voltage corresponding to a pressed position. A voltage output means for performing the operation, a time acquisition means for acquiring the detected time when a predetermined voltage is detected, and a sound output instruction means for instructing output of a predetermined sound when the predetermined voltage is detected. The first calculation for calculating the evaluation value relating to the pressing timing by comparing the duration measurement means for measuring the duration during which the predetermined voltage is detected and the sound generation start timing of the predetermined instrument sound and the detected time. A second calculating means for calculating an evaluation value relating to pressing strength by comparing the sound generation duration of the predetermined instrument sound with the measured duration, and transmitting and receiving information to and from the command. Communication means, and the commander includes MIDI data storage means for storing MIDI data, music playback means for playing back music based on the MIDI data, and communication means for transmitting and receiving information to and from the remote control. The commander has scoring means for scoring the pressing, and the commander detects the note-on signal of the predetermined musical instrument sound during the music performance based on the MIDI data, the velocity signal corresponding to the note-on signal, the note Sending off signal detection timing, the remote control receives from the commander the detection timing of the note-on signal of the predetermined instrument sound, the velocity signal corresponding to the note-on signal, the detection timing of the note-off signal, The sound generation start timing is the detection timing of the received note-on signal. The duration is a period from the detection timing of the note-on signal to the detection timing of the note-off signal, or the decay time of the instrument sound calculated based on velocity information corresponding to the note-on signal, The evaluation value calculated by the first calculation means and the second calculation means is transmitted to the commander, and the commander performs scoring regarding the pressing based on the received evaluation value.

  According to the karaoke instrument scoring system, the commander transmits predetermined information (note-on signal, note-off signal, velocity information) to the remote control according to the performance of the music, and the remote control detects the detected pressing timing and the pressing continues. The pressing operation is evaluated by comparing the time, the sounding start timing specified based on the received predetermined information, and the sounding continuation time, and the evaluation result is transmitted to the commander. The commander presses based on the received evaluation result. Scoring the action. Thereby, the musical performance of karaoke can be associated with the scoring of the pressing operation, and the scoring of the pressing operation can be performed with high accuracy.

  ADVANTAGE OF THE INVENTION According to this invention, the electronic musical instrument etc. which detect the intensity | strength pressed and reflect the detected intensity on a scoring result are realizable.

[First Embodiment]
A first embodiment which is an embodiment of the present invention will be described.
FIG. 1 is a block diagram of the electronic musical instrument of the first embodiment.
The electronic musical instrument 1 basically includes a display unit 11, an operation unit 12, a CPU 13, a ROM 14, a RAM 15, an auxiliary storage unit 16, and a music reproduction unit 17.

Various information is displayed on the display unit 11. Further, when a pressing operation (music performance) is performed, a pressing area (tap area) is displayed in a predetermined area of the display unit 11.
The operation unit 12 is a touch panel provided on the surface of the display unit 11. In addition to the touch panel, a predetermined physical button may be provided.

  The CPU 13 executes various programs including programs necessary for realizing the present invention. The ROM 14 stores various data including information necessary for realizing the present invention. The RAM 15 temporarily stores various data including information necessary for realizing the present invention.

The auxiliary storage means 16 stores music data for playing back music. The music data is not necessarily required in the electronic musical instrument, and may be realized by a predetermined external means. Also, video data may be stored.
The music reproducing means 17 reproduces music data and outputs the sound from a speaker (not shown). Note that the music reproducing means 17 is not necessarily required, and may be realized by a predetermined external means.
In addition, information is transmitted / received to / from predetermined external means by communication means (not shown).

(About touch panel)
In the first embodiment, as described above, a touch panel is used as the operation unit 12. The touch panel according to the first embodiment is preferably an analog resistive film type so that it can be operated with either a finger or a pen. For example, a 4-wire resistive touch panel can be used.

The basic principle of the touch panel will be described below. The touch panel is composed of an upper film and a lower glass. The upper film is a flexible film (for example, a PET sheet).
A transparent conductive material (ITO, indium tin oxide) is formed on the opposing surfaces of the upper film and the lower glass. Further, the upper film and the lower glass are separated by a predetermined distance in normal times. A dot spacer is provided on the lower glass side. When the upper film is pressed, the film bends due to pressure, and the upper film and the lower glass conductive film come into contact with each other to generate two voltages (voltages corresponding to the X direction and the Y direction).

  Since the voltage generated at this time varies depending on the pressed coordinate value (X coordinate, Y coordinate), the pressed position can be recognized by the detected voltage. The voltage is detected at a predetermined sampling frequency.

  FIG. 2 shows the configuration of the touch panel and the CPU 13. The voltage signal output from the touch panel is output to the CPU 13 via the A / D converter for each of the X direction component and the Y direction component. The CPU 13 can recognize the pressed coordinate based on the acquired signal.

  In the first embodiment, when a predetermined area (tap area) is pressed, a signal indicating, for example, “1” is output to a predetermined process (or memory area). Further, when the outside of the predetermined area is pressed, a signal indicating, for example, “0” is output to a predetermined process (or memory area). The detection start time of the signal indicating “1” can be detected by a timer (not shown).

  FIG. 3 is a diagram showing the relationship between the pressed area and the output value. In FIG. 3, the shaded area is an area (tap area) to be tapped (pressed) in accordance with the timing. Here, it is assumed that voltages output when the tap region is pressed are “X direction: 3.5 to 4.0 V” and “Y direction: 1.0 to 1.5 V”. In this case, the CPU 13 indicates “1” only when “3.5 to 4.0 V is detected as the voltage in the X direction and 1.0 to 1.5 V is detected as the voltage in the Y direction”. Output a signal.

Next, the relationship between the pressed strength and how the film bends will be described. FIG. 4 is a diagram showing the relationship between the pressed strength and how the film bends.
As shown in FIG. 4, when the film is pressed down weakly, the film is not bent in a short time, so that the time in which the film and the glass are in contact is short. On the other hand, when the film is pressed down strongly, the area in which the film is bent is large, so that the time that the film and the glass are in contact with each other is long.

  Therefore, when the signal indicating “1” is output for a long period, it can be determined that the tap region is strongly pressed, and when the signal indicating “1” is output only for a short period. Therefore, it can be determined that the tap area is pressed down weakly.

  FIG. 5 is a diagram illustrating the relationship between the pressed strength and the output value. As shown in FIG. 5, when the tap area is pressed weakly, the number of samples of the signal indicating “1” is small, and when the tap area is pressed strongly, the number of samples of the signal indicating “1” is large. . Here, the sampling frequency can be set as appropriate, and the output duration time of the signal indicating “1” can be calculated by multiplying the sampling frequency by the number of detected samples. Then, the pressed strength can be calculated based on the output duration time.

  By the processing described above, information indicating the pressing timing and pressing strength can be detected. And the information which shows the detected pressing timing and pressing strength is compared with a reference value, and scoring of pressing operation is performed.

FIG. 6 to FIG. 8 are diagrams showing a scoring state of the pressing operation.
In FIG. 6, the pressing is started at the reference start time, and the pressing duration (voltage value output duration) coincides with the reference duration. As a result, the pressing operation in FIG. 6 is determined as “tap timing: appropriate” and “tap strength: appropriate”.

  In FIG. 7, pressing is started at a time before the reference start time, and the pressing duration is longer than the reference duration. As a result, the pressing operation in FIG. 7 is determined as “tap timing: early” and “tap strength: strong”.

  In FIG. 8, the pressing is started at a time later than the reference start time, and the pressing duration is shorter than the reference duration. As a result, the pressing operation in FIG. 8 is determined as “tap timing: late” and “tap strength: weak”.

(Relationship between music performance progress information, standard start time and standard duration)
The reference value for the pressing operation described above is obtained from the music performance progress information. In the following description, MIDI data is described as an example of music performance progress information, but the music performance progress information in the present invention is not limited to MIDI data.

In MIDI data, instrument sounds are defined for each of a plurality of tracks (channels). Various information (note-on signal, note-off signal, etc.) relating to the sound of the instrument sound is defined. Hereinafter, an instrument sound that serves as a comparison reference for the pressing operation is referred to as a “comparative instrument sound”.
In the first embodiment, the sound generation start timing of the comparative instrument sound is set as the “reference start time”. Therefore, the time when the note-on signal for the comparative instrument sound is detected can be set as the “reference start time”.

  In the first embodiment, the sound generation duration of the comparative instrument sound is set as the “reference duration”. Therefore, the time from when the note-on signal of the comparative instrument sound is detected to the time when the note-off signal of the instrument sound is detected can be set as the “reference duration”.

  After a normal sound source is sounded by a note-on signal, the sound continues until a note-off signal is detected. However, drums, basses, percussion sound sources, etc. (percussion sound sources) sound at the same time as the note-on signal is detected, and are muted when the end of the timbre is reached regardless of the presence or absence of the note-off signal. Therefore, for example, when a drum sound source is set as the comparative instrument sound, the time from when the note-on signal is output until the sound is muted is managed as a predetermined time, and the note-on signal is output. Then, the predetermined time can be specified as the section being pronounced. At this time, the period until the sound is muted can be calculated based on the velocity signal corresponding to the note-on signal. Thereby, it is possible to score a track of a specific percussion instrument in which the sound generation period may not be specified in the period from the note-on signal to the note-off signal. The relationship between the velocity signal and the period until the sound is muted (that is, the duration of sound generation) may be defined by a table, or may be formulated by a predetermined mathematical expression.

  Through the above processing, the reference start time and the reference duration can be set based on the musical performance progress information, and the pressing operation can be scored based on the set reference start time and the reference duration.

(About scoring process)
Next, specific contents of the scoring process will be described.
FIG. 9 is a flowchart of the scoring process. A program for executing this processing is executed by the CPU 13 of the electronic musical instrument 1. This process is executed when a predetermined operation (for example, a performance instruction operation) is performed.

  First, in S1, a song to be played is selected by the user. At this time, the display unit 11 and the operation unit 12 (touch panel) of the electronic musical instrument 1 are used. Further, the electronic musical instrument 1 may be configured to have a search function.

  In S2, the type of instrument (percussion instrument) to be used as a scoring standard is extracted based on the MIDI data of the selected song. Specifically, an instrument defined in each track (channel) of MIDI data is examined, and when it is determined that the instrument is a percussion instrument, the instrument is extracted as a selectable instrument.

  In S3, the type of percussion instrument extracted in S2 is displayed. Further, it is displayed that one can be selected from the displayed percussion instruments. The display form can be set as appropriate.

  In S4, it is determined whether or not a percussion instrument has been selected. When it is determined that the percussion instrument has not been selected (S4: NO), the process proceeds to S5. In S5, normal music performance processing is performed. Since normal music performance processing is a known technique, description thereof is omitted.

On the other hand, if it is determined that a percussion instrument has been selected (S4: YES), the process proceeds to S6.
In S6, the MIDI track of the selected percussion instrument is specified. The selected musical instrument sound becomes the above-described “comparative musical instrument sound”.

  In S7, it is determined whether or not there is a music performance instruction. The user can give a musical performance instruction by performing a predetermined operation. It waits in S7 until there is a music performance instruction. Note that the process of S7 can be omitted. In other words, after the percussion instrument is selected in S4, it may be configured to automatically start playing the music after a predetermined time.

If there is a music performance instruction (S7: YES), the process proceeds to S8.
In S8, the music performance is started. Thereafter, the process proceeds to S9.
In S9, detection processing is performed. Details of the detection process will be described later.

  In S10, it is determined whether or not the performance of the music has ended. Judgment as to whether or not the performance of a song has ended is made based on whether or not a predetermined signal has been received. If it is determined that the performance of the song has not ended (S10: NO), the process returns to S9. That is, the processing of S9 and S10 is repeated while the music is being played.

If it is determined that the performance of the song has ended (S10: YES), the process proceeds to S11.
In S11, the scoring value is displayed. The display form at this time can be set as appropriate.

Next, the detection process of S9 (FIG. 9) will be described in detail.
FIG. 10 is a flowchart of the detection process.
In S21, variables A, B, and C are cleared. The variables A, B, and C respectively indicate a period during which the comparison instrument sound is pressed, a period during which the comparison instrument sound is pressed, a period during which the comparison instrument sound is generated, and a period during which the comparison instrument sound is pressed. It is shown.

In S22, it is determined whether or not a note-on signal of the comparative instrument sound is detected. A note-on signal is detected at the start of the generation of the comparative instrument sound. If it is determined that a note-on signal is not detected (S22: NO), the process proceeds to S23.
In S23, it is determined whether or not the touch panel is pressed. If it is determined that the touch panel is pressed (S23: YES), A is incremented. That is, the period during which the comparison instrument sound is pressed before the start of sounding is measured. On the other hand, if it is determined that the touch panel is not pressed (S23: NO), the process proceeds to S22.

  On the other hand, if it is determined in S22 that a note-on signal has been detected (S22: YES), the process proceeds to S25. Note that the touch panel pressing start timing (that is, the timing determined as “YES” in the condition determination in S22) is stored in a predetermined storage unit (for example, the RAM 15).

In S25, it is determined whether or not the touch panel is pressed. If it is determined that the touch panel is pressed (S25: YES), the process proceeds to S26. In S26, B is incremented. That is, the period during which the comparative instrument sound is being pressed is measured.
On the other hand, if it is determined that the touch panel is not pressed (S25: NO), the process proceeds to S27.

In S27, it is determined whether or not the generation of the comparative instrument sound has been completed. When the note-off signal is detected or when the sound generation duration specified based on the velocity information corresponding to the note-on signal has elapsed, the condition determination in S27 is “YES”.
If it is determined that the pronunciation has not ended (S27: NO), the process proceeds to S25.
On the other hand, if it is determined that the sound generation has ended (S27: YES), the process proceeds to S28.

In S28, it is determined whether or not the touch panel is pressed. If it is determined that the touch panel is pressed (S28: YES), the process proceeds to S29. In S29, C is incremented. In other words, the period during which the comparison instrument sound is pressed after the end of sounding is measured.
On the other hand, if it is determined that the touch panel is not pressed (S28: NO), the process proceeds to S30.

  In S30, the pressing timing and the pressing duration are specified. The pressing timing is the timing stored in the RAM 15 described above. The pressing duration is calculated by adding the values of variables A, B, and C.

  In S31, scoring is performed on the pressing operation (pressing timing, pressing strength) based on the pressing timing and pressing duration.

  Further, in the processing shown in FIG. 10, the continuation time is compared with respect to the scoring of the pressing strength, and is performed based on the comparison result. However, the pressing strength and the pronunciation strength may be directly compared. At this time, the pressing strength is calculated based on the pressing duration time. At this time, a table may be used, or may be calculated by a predetermined relational expression. Further, the pronunciation strength (playing strength) of the comparative instrument sound is calculated from the velocity information. At this time, a table may be used, or may be calculated by a predetermined relational expression.

FIG. 11 is a diagram illustrating the evaluation value of the pressing operation for each note-on signal of the comparative instrument sound.
In FIG. 11, the note-on order is the order in which the note-on signals of predetermined instrument sounds included in the MIDI data appear. The sound generation start timing is the timing at which the note-on signal is detected. The sound generation duration is the sound generation duration of the comparative instrument sound calculated based on the velocity signal corresponding to the note-on signal. When a note-off signal corresponding to the note-on signal is detected, the time from the detection timing of the note-on signal to the detection timing of the note-off signal is a sound generation duration time. The unit of sound generation start timing can be set as appropriate. Note that the timing values shown in FIG. 11 are shown for convenience of explanation.

The pressing start timing is a pressing timing of the touch panel. The A value, the B value, and the C value are values of the variables A, B, and C calculated by the detection process described above. The pressing duration is a value obtained by adding the A value, the B value, and the C value.
The evaluation value of the pressing timing is “appropriate”, “early”, or “slow” based on the difference value between the sounding start timing and the pressing timing. In the case of “early” or “slow”, “−1” is assigned as a numerical value, and in the case of “appropriate”, “0” is assigned. In addition, the evaluation value of the pressing strength is any one of “appropriate”, “weak”, and “strong” based on the difference value between the pronunciation duration time and the pressing duration time. When “weak” or “strong” is obtained, “−1” is assigned as a numerical value. In calculating the evaluation value, if the difference value is within a predetermined range, it may be determined as “appropriate”.

The deduction point value is calculated as the sum of the evaluation values of the pressing timing and the pressing strength. That is, for example, if the evaluation values of the pressing timing and the pressing strength are both “appropriate (0)”, the deduction point value is “0”.
Then, at the end of the music performance, the initial value (100 points) and all the deduction points are integrated to calculate the score value of the music pressing operation. In the example shown in FIG. 11, the final scoring value is “88 points”. Note that the scoring method (subtraction method) shown in FIG. 11 is merely an example, and another scoring standard (addition method) may be used.

  According to the above-described first embodiment, the timing and strength at which the touch panel is pressed are calculated, and the calculated pressing timing and pressing strength are compared with the sounding start timing and sounding strength of a predetermined instrument sound during music performance. Thus, since the pressing operation is scored, a highly accurate scoring process can be performed.

[Second Embodiment]
Next, an embodiment in which the electronic musical instrument is applied to a karaoke musical instrument scoring system will be described.
FIG. 12 is a block diagram of a karaoke instrument scoring system.
As shown in FIG. 12, the karaoke instrument scoring system basically includes a remote controller 100 and a commander 200.

The remote controller 100 basically includes a display unit 111, an operation unit 112, a CPU 113, a ROM 114, a RAM 115, and a communication I / F 116.
The display unit 111, the operation unit 112, the CPU 113, the ROM 114, and the RAM 115 are basically the same as the display unit 11, the operation unit 12, the CPU 13, the ROM 14, and the RAM 15 of the electronic musical instrument 1 according to the first embodiment described above, respectively. Description is omitted.
The communication I / F 116 transmits and receives various information to and from the commander 200. At this time, a wireless LAN may be used. It can also communicate with a host (not shown).

  The remote controller 100 can be used for searching for music, presenting various information, ordering food and drink, and the like.

The commander 200 basically includes an auxiliary storage unit 211, a video / audio reproduction unit 212, a CPU 113, a ROM 114, a RAM 115, a communication I / F 216, and an audio input unit 217.
The auxiliary storage unit 211 stores MIDI data, video data such as background images and lyrics telops, etc. (data group). The video / audio reproduction means 212 performs a music performance as an electronic musical instrument (hereinafter referred to as “music performance”) based on the data group stored in the auxiliary storage means 211, and receives a signal from the audio input means 217. It reproduces and outputs, and also outputs the lyrics telop of the musical composition and character display signals such as numerical values.

  The CPU 213 executes various programs including programs necessary for realizing the present invention. The ROM 214 stores various data including information necessary for realizing the present invention. The RAM 215 temporarily stores various data including information necessary for realizing the present invention.

Communication I / F 216 transmits / receives various information to / from remote controller 100. At this time, a wireless LAN may be used. It can also communicate with a host (not shown).
In the commander 200, a monitor and a speaker (not shown) are connected to the video / audio reproduction means 212, and a microphone (not shown) is also connected to the audio input means 217. Accordingly, the commander 200 can communicate with the remote controller 100 and functions as a karaoke device that displays lyrics and reproduces microphone input sound in accordance with the music performance.

  FIG. 13 is a diagram illustrating a state in which the user operates the remote controller 100 and the remote controller 100 and the commander 200 communicate with each other. The user uses the remote controller 100 as a pseudo electronic musical instrument and presses a predetermined tap area while playing the music.

Next, information transmitted and received between the remote controller 100 and the commander 200 will be described. FIG. 14 is a diagram showing information transmitted and received between the remote controller 100 and the commander 200.
When receiving a music request from the user (1), the remote controller 100 transmits a request signal corresponding to the request to the commander 200 (2).

When the commander 200 receives the request signal from the remote controller 100, the commander 200 plays the music corresponding to the request signal (3).
The commander 200 transmits related information to the remote controller 100 during the performance of the music. Details of transmission of related information will be described later.

  The remote controller 100 evaluates the pressing operation during the performance of the music (5). For the evaluation of the pressing operation, related information received from the commander 200 is used. Details of the evaluation of the pressing operation will be described later.

The remote controller 100 transmits an evaluation result signal (for example, a numerical value as a deduction point value) indicating the evaluation result to the commander 200 (6).
The commander 200 updates the scoring result based on the received evaluation result signal (7).
The processes (3) to (7) described above are repeated during the performance of the music.
When the performance of the music is finished, the commander 200 updates the scoring result by subtracting the deducted value every time it is received from the scoring result obtained by the update (for example, from the initial scoring value of 100 points) The number is obtained every time reception is performed, and a numerical value obtained by a deduction method such as subtracting from the initial value of scoring at the end of performance is displayed (8).

Next, an evaluation process executed by the remote controller 100 will be described.
FIG. 15 is a flowchart of the evaluation process. A program for executing the evaluation process is executed by the CPU 113.

  The processing of S41, S42, S43, S44, and S46 is basically the same as S1, S2, S3, S4, and S6 of the scoring processing executed by the electronic musical instrument 1 of the first embodiment described above. Is omitted.

  After shifting to S45, a normal music performance instruction (request instruction) is issued to the commander 200. In addition, since the process regarding a normal music performance instruction is well-known, description is abbreviate | omitted.

  When the process proceeds to S47, a music performance instruction is given to the commander 200. That is, a signal indicating a music performance instruction is transmitted to the commander 200. At this time, information indicating the selected percussion instrument is also transmitted.

In S48, detection processing is performed. Details of the detection process will be described later.
In S49, it is determined whether or not the performance of the music is finished. When a predetermined signal is received from the commander 200, it is determined that the performance of the song has been completed. If it is determined that the performance of the song has not ended (S49: NO), the process proceeds to S48. On the other hand, if it is determined that the performance of the song has been completed (S49: YES), the evaluation process is terminated.

Next, the detection process (S48 in FIG. 15) will be described.
FIG. 16 is a flowchart of the detection process.
The processes of S51, S53, S54, S55, S56, S58, S59, and S60 are the detection processes S21, S23, S24, S25, S26, S28, S29 executed by the electronic musical instrument 1 of the first embodiment described above. Since the process is basically the same as S30, a description thereof will be omitted.

  In S52, it is determined whether or not a note-on signal has been received. When a note-on signal is received from the commander 200, the condition determination in S52 is “YES”. When it is determined that the note-on signal has been received (S52: YES), the process proceeds to S55. On the other hand, when it is determined that the note-on signal has not been received (S52: NO), the process proceeds to S53.

In S57, it is determined whether or not the generation of the comparative instrument sound has been completed. At this time, if the note-off signal is received from the commander 200 or the sounding duration specified based on the velocity information corresponding to the note-on signal has elapsed, the condition determination in S57 is “YES”. .
If it is determined that the pronunciation has not ended (S57: NO), the process proceeds to S55.
On the other hand, if it is determined that the sound generation has ended (S57: YES), the process proceeds to S58.

In S61, based on the pressing timing and the pressing duration time, evaluation regarding the pressing operation (pressing timing, pressing strength) is performed. That is, the evaluation value (see FIG. 11) of the pressing timing and the pressing strength is calculated.
In S62, the evaluation result in S61 is transmitted to the commander 200.

Next, performance processing executed by the commander 200 will be described.
FIG. 17 is a flowchart of the performance process. A program for executing the performance process is executed by the CPU 213 of the commander 200.

It waits in S71 until the instruction | indication of a music performance start is received. When the music performance start instruction signal is received from the remote controller 100, the condition determination in S71 is “YES”.
In S72, the music performance is started. At this time, it is assumed that information for indicating the comparative instrument sound is also received from the remote controller 100.

In S73, it is determined whether or not a note-on signal of the comparative instrument sound is detected. If it is determined that the note-on signal of the comparative instrument sound has been detected (S73: YES), the process proceeds to S74.
In S74, a note-on signal is transmitted to the remote controller 100. At this time, velocity information corresponding to the note-on signal is also transmitted. Thereafter, the process proceeds to S77.

On the other hand, if it is determined in S73 that no note-on signal has been detected (S73: NO), the process proceeds to S75.
In S75, it is determined whether or not a note-off signal of the comparative instrument sound is detected. If it is determined that the note-off signal of the comparative instrument sound has been detected (S75: YES), the process proceeds to S76.
In S76, a note-off signal is transmitted to the remote controller 100. Thereafter, the process proceeds to S77.

On the other hand, if it is determined in S75 that no note-off signal has been detected (S75: NO), the process proceeds to S77.
In S77, it is determined whether an evaluation result signal is received from remote controller 100 or not.
When it is determined that the evaluation result signal has been received (S77: YES), the process proceeds to S78.
In S78, the scoring result is updated. That is, the evaluation value (see FIG. 11) included in the received evaluation result signal is integrated with the current scoring value (see FIG. 11). Thereafter, the process proceeds to S79.

On the other hand, when it is determined in S77 that the evaluation result signal has not been received (S77: NO), the process proceeds to S79.
In S79, it is determined whether or not to end the music performance.
If it is determined not to end the performance of the music (S79: NO), the process proceeds to S73. On the other hand, when it is determined that the performance of the music is finished (S79: YES), the process proceeds to S80.
In S80, a signal for instructing the remote controller 100 to end the performance of the music is transmitted.
In S81, the score value is displayed on a monitor (not shown).

  According to the second embodiment described above, during the performance of the music by the commander 200, the pressing timing and the pressing strength are calculated, and the evaluation of the pressing timing and the pressing strength is evaluated based on the signal received from the commander 200. Can be done with precision.

  In the above-described processing, the commander 200 transmits the related information (note-on signal or the like) to the remote controller 100 every time it is detected. You may comprise so that it may transmit to the remote control 100. Further, regarding the display of the scoring result, the scoring result may be displayed on the display unit 11 of the remote controller 100 without being displayed on the commander 200 side.

  Moreover, each flowchart mentioned above is only an example, and as long as the result equivalent to each said process can be obtained, you may implement | achieve a process with another flowchart.

  According to the present invention, it is possible to detect the pressing timing and pressing strength of the touch panel, and perform the pressing operation with high accuracy based on the detected information.

The present invention is not limited to the above-described embodiments, and various improvements and modifications can be made without departing from the scope of the present invention. For example, the present invention can be applied to a portable game machine having one or a plurality of screens. Further, the present invention can also be applied to a game case installed in a home-use game machine or a game center.
The present invention can also be realized as a scoring method for executing the above-described processing. Furthermore, the present invention can also be realized as a program for causing the scoring method to be executed by a computer and a recording medium on which the program is recorded.

It is a block diagram of an electronic musical instrument. It is the figure which showed the structure of the touchscreen and CPU. It is the figure which showed the relationship between the area | region pressed and the value output. It is the figure which showed the relationship between the intensity | strength pressed and how to bend of a film. It is the figure which showed the relationship between the intensity | strength pressed and the output value. It is the figure which showed the mode of scoring of pushing operation | movement. It is the figure which showed the mode of scoring of pushing operation | movement. It is the figure which showed the mode of scoring of pushing operation | movement. It is a flowchart of a scoring process. It is a flowchart of a detection process. It is the figure which showed the evaluation value of pressing-down operation for every note-on signal of a comparative musical instrument sound. It is a block diagram of the musical instrument scoring system for karaoke. It is the figure which showed a mode that the user operated the remote control and the remote control and the commander are communicating. It is the figure shown about the information transmitted / received between a remote control and a commander. It is a flowchart of an evaluation process. It is a flowchart of a detection process. It is a flowchart of a performance process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Electronic musical instrument 11 Display part 12 Operation part 13 CPU

Claims (7)

In an electronic musical instrument having a touch panel,
Voltage output means for outputting a voltage corresponding to the pressed position;
Time detection means for acquiring the detected time when a predetermined voltage is detected;
Sound output instruction means for instructing output of a predetermined sound when the predetermined voltage is detected;
A duration measuring means for measuring a duration during which the predetermined voltage is detected;
First calculation means for comparing the detected sound generation start timing of the predetermined instrument sound included in the instrument performance progress information with the detected time during performance of the music based on the instrument performance progress information, and calculating an evaluation value related to the pressing timing. When,
A second calculating means for comparing the sound generation duration of the predetermined instrument sound with the measured duration and calculating an evaluation value relating to the pressing strength;
Scoring means for scoring the pressing based on the evaluation values calculated by the first calculation means and the second calculation means;
An electronic musical instrument characterized by comprising: The musical instrument performance signal information is MIDI data,
The sound generation start timing is a detection timing of a note-on signal of the predetermined instrument sound track included in the MIDI data,
The duration of sound generation is calculated based on a period from a detection timing of the note-on signal to a detection timing of a note-off signal of the instrument sound track included in the MIDI data, or based on velocity information corresponding to the note-on signal. A decay time of the predetermined instrument sound to be played,
The electronic musical instrument according to claim 1. In an electronic musical instrument having a touch panel,
Voltage output means for outputting a voltage corresponding to the pressed position;
Time detection means for acquiring the detected time when a predetermined voltage is detected;
Sound output instruction means for instructing output of a predetermined sound when the predetermined voltage is detected;
A duration measuring means for measuring a duration during which the predetermined voltage is detected;
Strength calculating means for calculating the pressed strength based on the duration;
First calculation means for comparing the detected sound generation start timing of the predetermined instrument sound included in the instrument performance progress information with the detected time during performance of the music based on the instrument performance progress information, and calculating an evaluation value related to the pressing timing. When,
A third calculating means for comparing the pronunciation intensity corresponding to the pronunciation start timing with the calculated intensity and calculating an evaluation value relating to the pressing intensity;
Scoring means for scoring the press based on the evaluation values calculated by the first calculation means and the third calculation means;
An electronic musical instrument characterized by comprising: The musical instrument performance signal information is MIDI data,
The sound generation start timing is a detection timing of a note-on signal of the predetermined instrument sound track included in the MIDI data,
The pronunciation intensity corresponding to the pronunciation start timing is the playing intensity of the instrument sound calculated based on velocity information corresponding to the note-on signal.
The electronic musical instrument according to claim 3. The predetermined musical instrument sound is a drum or a bass.
The electronic musical instrument according to any one of claims 1 to 4, wherein: It further has a music search means and a music request means,
The performance of the music is performed by a karaoke device.
An electronic musical instrument according to any one of claims 1 to 5, wherein A karaoke instrument scoring system consisting of a remote control and commander,
The remote control is
A touch panel;
Voltage output means for outputting a voltage corresponding to the pressed position on the touch panel;
Time detection means for acquiring the detected time when a predetermined voltage is detected;
Sound output instruction means for instructing output of a predetermined sound when the predetermined voltage is detected;
A duration measuring means for measuring a duration during which the predetermined voltage is detected;
A first calculation means for comparing a sound generation start timing of a predetermined instrument sound with the detected time and calculating an evaluation value relating to a pressing timing;
A second calculating means for comparing the sound generation duration of the predetermined instrument sound with the measured duration and calculating an evaluation value relating to the pressing strength;
Communication means for transmitting and receiving the command and information;
Have
The commander
MIDI data storage means for storing MIDI data;
Music playback means for playing back music based on the MIDI data;
Communication means for transmitting and receiving information to and from the remote control;
Having a scoring means for scoring regarding the pressing;
The commander transmits a detection timing of a note-on signal of the predetermined musical instrument sound, a velocity signal corresponding to the note-on signal, and a detection timing of a note-off signal during a music performance based on the MIDI data,
The remote control receives a detection timing of a note-on signal of the predetermined instrument sound from the commander, a velocity signal corresponding to the note-on signal, and a detection timing of a note-off signal,
The sound generation start timing is a detection timing of the received note-on signal,
The sound generation duration is a period from the detection timing of the note-on signal to the detection timing of the note-off signal, or the decay time of the instrument sound calculated based on velocity information corresponding to the note-on signal. ,
Transmitting the evaluation values calculated by the first calculation means and the second calculation means to the commander;
The commander performs scoring regarding the pressing based on the received evaluation value.
A musical instrument scoring system for karaoke.

Images