JP2009169011A - Apparatus for reporting transition of playing sound - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technique for easily understanding the current playing condition of an electronic instrument and changes in the playing condition. <P>SOLUTION: The sound volume value V of a currently struck note is calculated on the basis of a velocity, i.e., a value that represents the strength of sound, included in note stroke information (note information). The average value av of sound volume values at predetermined time intervals is calculated on the basis of the sound volume value V calculated. An image where the average values Av of the calculated sound volume values in predetermined units are arranged in time series is created. The image created is displayed in a panel display device of a panel SW/LCD. Transitions in the sound volume of musical play are reported in this way to allow easy understanding of the current playing condition and changes in the playing condition. This facilitates feedback to the next expression played. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a technique that makes it possible to easily grasp the current performance state and changes in the performance state and facilitate feedback to the next performance expression.

  Conventionally, electronic musical instruments, such as electronic organs, that output a digital musical sound signal corresponding to key depression on the keyboard and control panel settings from a sound source, convert it to an analog musical sound signal, and then generate sound from a speaker have been used. It was.

Some electronic musical instruments of this type include a display device that displays the volume of a performance sound. Specifically, in the model creation device in the musical instrument sound determination device described in Patent Document 1, when a piano performance sound is captured by a microphone and input to an A / D converter, a digital signal after A / D conversion is obtained. In order to prevent the noise from being buried or clipped by noise, a peak meter is displayed on the display device when the model is created. The peak meter displays the maximum value of the amplitude of the digital signal after A / D conversion by changing the lighting condition (color change), and when the maximum value is 0, none is displayed. become. Further, when the maximum value becomes the maximum value of the amplitude determined by the number of quantization bits of the digital signal or about half of the maximum value, the display is turned on.
JP-A-2005-241717 (9th page, FIGS. 6 and 7)

  However, in the electronic musical instrument as described above, when the performance volume is simply displayed as described above, the maximum value of the amplitude for each predetermined time is only displayed, and therefore the transition of the performance volume is not known. However, it is difficult to grasp the current performance state and changes in the performance state, and it is difficult to provide feedback to the next performance expression.

  The present invention has been made in view of such problems, and the object of the present invention is to make it easy to grasp the current performance state and changes in the performance state, and to facilitate feedback to the next performance expression. To provide technology.

  The performance sound transition notifying device according to claim 1 made to solve the above-mentioned problem is an input means for inputting a performance sound of a musical instrument by a performer, and every predetermined unit from the performance sound input from the input means. Calculating means for calculating the sound volume value, image generating means for generating an image in which the sound volume values for each predetermined unit calculated by the calculating means are arranged in time series, display means capable of displaying various information, Display control means for causing the display means to display the image generated by the image generation means.

  According to the performance sound transition notification device of the present invention configured as described above, the calculation means calculates the volume value for each predetermined unit from the performance sound input from the input means such as a microphone, and the image generation means calculates An image in which volume values for each predetermined unit calculated by the means are arranged in time series is generated. Then, the display control means displays the image generated by the image generation means on the display means capable of displaying various information. By notifying the transition of the volume of the performance in this way, it is possible to easily grasp the current performance state and the change in the performance state, and therefore it becomes easy to perform feedback to the next performance expression.

By the way, as a method for calculating the volume of the performance sound described above, the following methods (a) to (e) are conceivable.
(A) First, it is conceivable that the calculation means calculates a volume value per unit time as a volume value for each predetermined unit (claim 2). If comprised in this way, a player can grasp | ascertain the tendency of the performance of the latest himself / herself exactly.

  (B) It is also conceivable that the calculation means calculates a volume value per performance unit as a volume value for each predetermined unit. Specific examples of performance units include time signatures and measures. If comprised in this way, a player can grasp | ascertain the tendency of the performance of the latest himself / herself exactly.

  (C) It is also conceivable that the calculating means calculates an average value of the volume in a predetermined unit as a volume value for each predetermined unit. With this configuration, for example, in a performance state in which performance sound continues at a similar volume, such as a musical piece whose performance sound continues with a small tempo, the average value calculated as described above faithfully follows the volume value of a predetermined unit. Will be expressed. Therefore, the performer can accurately grasp the tendency of his / her latest performance in real time, and it is easy to perform feedback to the next performance expression.

  (D) It is also conceivable that the calculation means calculates the median value of the volume in a predetermined unit as the volume value for each predetermined unit. With this configuration, the median value calculated as described above faithfully represents the volume value of a predetermined unit in a performance state that includes performance sounds of various volumes such as a undulating music. . Therefore, the performer can grasp the tendency of his / her latest performance in real time, and can easily perform feedback to the next performance expression.

  (E) It is also conceivable that the calculating means calculates the mode value of the volume in a predetermined unit as the volume value for each predetermined unit. If configured in this way, for example, in a performance state in which a musical piece with lively feeling includes a lot of performance sounds with a high volume, the mode value calculated as described above faithfully represents the volume value of a predetermined unit, The performer can grasp in real time whether or not the performance sound can be expressed with a sufficiently large volume. Therefore, the performer can accurately grasp the tendency of his / her latest performance, and it is easy to perform feedback to the next performance expression.

Embodiments of the present invention will be described below with reference to the drawings.
[First embodiment]
FIG. 1 is a block diagram showing a schematic configuration of the electronic keyboard instrument 1.

[Description of the configuration of the electronic keyboard instrument 1]
As shown in FIG. 1, an electronic keyboard instrument 1 as a performance sound transition notification device includes a keyboard 10, a panel SW / LCD 11, a pedal 12, a MIDI 15 that receives and outputs MIDI signals based on the MIDI standard, a CPU 30, and program data and data. The program data memory (ROM) 31 storing the data, the work RAM 32 for the CPU 30 to temporarily store the data, the I / F 33, the waveform memory 42 storing the various waveform data, and reading the waveform data from the waveform memory 42, the musical tone waveform A tone generator circuit (TG) 40 that generates a signal, a DSP 50 that processes and outputs a musical sound waveform generated by the tone generator circuit 40, a DAC 60 (R, L) that converts a digital signal into an analog signal, and an amplifier 70 that amplifies the analog signal (R, L) and a speaker 80 (R, L) which is a sound emitting device. The keyboard 10, panel SW / LCD 11, pedal 12, and MIDI 15 are connected to the bus line 90 via the I / F 33, and the keyboard 10, panel SW / LCD 11, pedal 12, MIDI 15, CPU 30, program data memory 31, the work RAM 32, and the tone generator circuit 40 are connected by a bus line 90 so as to be able to transmit and receive data.

[Description of configuration of keyboard 10]
Of these, the keyboard 10 includes a plurality of keys (keys, 88 keys in the present embodiment) for selecting the pitch of the musical sound to be generated. A number (key code) is assigned to each musical tone of each pitch, and a musical tone having a desired pitch can be generated by designating a key code by pressing the key. Corresponding to each key, a key switch for detecting key press / release of the key is provided. This key switch has two contacts (a first contact and a second contact). The first contact is first turned on when the key is pressed, and the second contact is turned on when the key is further pressed. Has been. In the case of key release, the second contact and the first contact are turned off in the reverse order. Information indicating that these contacts are turned on or off is detected by the built-in scan circuit scanning each key switch, and is sent to the bus line 90 via the I / F 33 together with the key code. The key on / off information and the key code sent to the bus line are taken into the CPU 30 and the tone generator circuit 40, and stored in the work RAM 32 under the control of the CPU 30.

[Description of Configuration of Panel SW / LCD 11]
Further, the panel SW / LCD 11 is provided with a number of operators for inputting various information and commands to the panel display device 11a such as a liquid crystal display panel and LEDs and the electronic keyboard instrument 1. Among these, the panel display device 11a turns on / off an LED for displaying the state of the electronic keyboard instrument 1 and the like in response to an instruction from the CPU 30. The panel display device 11a includes a liquid crystal display for displaying an image. On the other hand, as an operator, for example, a mode selection switch for setting the electronic keyboard instrument 1 to AOC mode or AUTO mode (automatic accompaniment mode), or an automatic performance rhythm when the electronic keyboard instrument 1 is in the AUTO mode. START / STOP switch for starting and stopping accompaniment, tone switch for selecting tone, effect switch for selecting effect, reverb switch for selecting reverb, sound effect switch for selecting effect sound , A volume controller, etc. are provided. The various switches, volume controller on / off, position, and the like are detected by a built-in panel scan. The switch information is sent from the panel scan to the bus line 90 via the I / F 33 and stored in the work RAM 32 under the control of the CPU 30.

The panel display device 11a of the panel SW / LCD 11 corresponds to display means.
[Description of Configuration of CPU 30 and Program Data Memory 31]
Further, the CPU 30 operates according to the program data in the program / data memory 31 to control the operation of each part of the electronic keyboard instrument 1. The program / data memory 31 includes the above-mentioned program data and data in which the timbre type, reverb type, and sound effect group type are associated with each other (for example, “concert ground” as the timbre type, reverb type). "Hall Reverb" and "Stage" as the type of sound effect group are stored.

The CPU 30 corresponds to a calculation unit, an image generation unit, and a display control unit.
[Description of Configuration of Sound Source Circuit 40 and Waveform Memory 42]
The tone generator circuit 40 is a Wave Table Look Up PCM waveform readout type capable of simultaneously producing, for example, 192 sounds, and has a function of generating a musical sound waveform. It also functions as an effect sound waveform generating means for generating an effect sound waveform. Specifically, the tone generator circuit 40 generates a musical sound waveform and an effect sound waveform based on the waveform data read from the waveform ROM 42 storing various waveform data. The tone generator circuit 40 includes an assignment memory (not shown). The assignment memory includes key assignment information (key code, on / off information thereof, on / off information of various switches, effect data). Etc.) are stored.

[Description of Configuration of DSP 50]
The DSP 50 is a digital signal processing device programmed to perform an effect applying process on the musical tone waveform and the effect sound waveform generated by the tone generator circuit 40. Further, the DSP 50 stores therein programs, effect data, reverb data, and the like. The DSP 50 is connected to a delay memory 52 that can temporarily store a digital signal, and a delay effect can be applied using the delay memory 52.

  The DSP 50 configured as described above receives an effect corresponding to the tone selected and set by the tone switch of the panel SW / LCD 11 when the musical tone waveform or the effect waveform generated by the tone generator 40 is input. Is added to the musical sound waveform generated by. Subsequently, the musical sound waveform to which the effect is applied and the effect sound waveform are added (hereinafter referred to as a composite waveform), and the reverb selected and set by the reverb switch of the panel SW / LCD 11 is applied to the composite waveform. To the DAC 60. When only the effect sound waveform is input, the effect sound waveform is output with reverb.

[Description of other configurations]
The DSP 50 is connected to a right output system consisting of a DAC 60R, Amp 70R and SP80R as well as a left output system consisting of a digital / analog converter (DAC) 60L, an amplifier (Amp) 70L and a speaker (SP) 80L. The output system converts the combined waveform (digital signal) output from the DSP 50 into an analog signal, amplifies it, and outputs the sound.

Since the other structure of the electronic keyboard instrument 1 is in accordance with a known technique, detailed description thereof is omitted here.
[Description of main processing]
Next, main processing executed by the CPU 30 of the electronic keyboard instrument 1 will be described with reference to the flowchart of FIG.

  First, initialization is executed (S110). For example, each port of the CPU 30 is set, and a tone color in the RAM 32 is set. At this time, the variables N and T are also initialized. That is, the value is set to a numerical value “0”.

  Subsequently, it is determined whether there is an event such as a key operation or a switch operation (S120). If it is determined that there is an event (S120: YES), the event process (S130) is executed, the steady process (S140) is executed, and the process returns to S120. The event process and the steady process will be described later. On the other hand, when it is determined that there is no event (S120: NO), the steady process (S140) is executed without executing the event process (S130), and the process returns to S120. During execution of the main process, as shown in FIG. 2B, the value of the variable T is incremented as a timer interrupt process (S210), and the flag set process is performed as shown in FIG. Execute (S220). Specifically, the unit time is counted, and when the unit time value reaches a predetermined time, a process for setting a flag for determining whether or not to execute the graph display process is executed. Note that when the execution of the graph display is completed after executing the process of setting the flag, the flag is reset in S560 of the steady process described later.

[Explanation of event processing]
Next, event processing executed by the CPU 30 of the electronic keyboard instrument 1 will be described with reference to the flowchart of FIG. This event process is a subroutine of the main process described above, and is executed when the process proceeds to S130 of the main process.

  First, it is determined whether or not a key has been pressed (S310). If it is determined that the key is depressed (S310: YES), a key depression process is executed (S340), and this subroutine is terminated. The key pressing process will be described later.

  On the other hand, if it is determined that the key is not pressed (S310: NO), it is determined whether or not the key is released (S320). If it is determined that the key has been released (S320: YES), a key release process is executed (S350), and this subroutine is terminated. Note that the key release processing is in accordance with a known technique, and therefore detailed description thereof is omitted here.

  On the other hand, if it is determined that the key is not released (S320: NO), it is determined whether or not the switch of the panel SW / LCD 11 is operated (S330). If it is determined that a panel operation has been performed (S330: YES), panel processing is executed (S360), and this subroutine is terminated. The panel processing refers to processing for each panel event such as a timbre selection switch, sound effect selection switch, volume setting switch, and the like. On the other hand, if it is determined that no panel operation has been performed (S330: NO), other processing is executed (S370), and this subroutine is terminated. Since “other processing” is in accordance with a known technique, a detailed description thereof is omitted here.

[Explanation of key press processing]
Next, a key pressing process executed by the CPU 30 of the electronic keyboard instrument 1 will be described with reference to the flowchart of FIG. This key pressing process is the above-described event processing subroutine, and is executed when the process proceeds to S340 of the event processing.

First, a cumulative value S of Δt × ΔV is calculated (S410). Specifically, the volume value V of the currently pressed note is calculated from the velocity, which is a value representing the strength of the sound among the key pressing information (note information). Next, the velocity difference ΔV between the previously pressed note and the currently pressed note is calculated. Then, a cumulative value S of Δt × ΔV is calculated using the following equation (1). Note that the difference Δt in step time between the notes is calculated in S530 of the steady process described later.

S ← S + Δt × ΔV Expression (1)

Subsequently, the volume value V of the currently pressed note is substituted for V _OLD in preparation for the calculation of the velocity difference ΔV between the currently pressed note and the note pressed immediately thereafter (S420). .

Subsequently, Δt is initialized in preparation for the calculation of the difference Δt in the step time between the currently pressed note and the note pressed immediately thereafter (S430).
Subsequently, the variable N is incremented (S440). Further, a sound generation process is executed (S450). Note that the sound generation process is in accordance with a known technique, and therefore detailed description thereof is omitted here.

[Explanation of steady processing]
Next, steady processing executed by the CPU 30 of the electronic keyboard instrument 1 will be described with reference to the flowchart of FIG. This steady process is a subroutine of the main process described above, and is executed when the process proceeds to S140 of the main process.

First, the value of variable T is substituted for variable t (S510).
Subsequently, the variable T is initialized (S520).
Subsequently, the value of the variable t is added to Δt (S530).

Subsequently, it is determined whether there is a flag (S540). If it is determined that there is a flag (S540: YES), graph display processing is executed (S550). Specifically, by using the following equation (2), the cumulative value S of Δt × ΔV is divided by the cumulative number of notes N in the meantime for each unit time, thereby obtaining an average value of the volume values at predetermined time intervals. Av is calculated. Then, an image in which the calculated average values Av are arranged in time series is generated, and the generated image is displayed on the panel display device 11a of the panel SW / LCD 11 (see FIG. 6).

Av ← SUM (Δt × ΔV) / N (2)

Subsequently, the flag is reset (S560), other processing is executed (S570), and this subroutine is terminated. Since other processes follow a known technique, detailed description thereof will be omitted here.

On the other hand, if it is determined that there is no flag (S540: NO), other processing is executed without executing the graph display processing or the like (S570), and this subroutine is terminated.
[Effect of the first embodiment]
(1) As described above, according to the electronic keyboard instrument 1 of the first embodiment, the volume value V of the note currently pressed from the velocity, which is the value representing the intensity of the sound, among the key press information (note information). The average value Av of the volume value for each predetermined time is calculated from the calculated volume value V using the above formulas (1) and (2), and the calculated average value of the volume value for each predetermined unit Images arranged in the Av time series are generated, and the generated images are displayed on the panel display device 11 a of the panel SW / LCD 11. By notifying the transition of the volume of the performance in this way, it is possible to easily grasp the current performance state and the change in the performance state, and therefore it becomes easy to perform feedback to the next performance expression.

  Further, for example, in a performance state in which a performance sound continues at a similar volume, such as a musical piece in which the performance sound continues with a small tempo, the average value calculated as described above faithfully represents the volume value in a predetermined unit. . Therefore, the performer can accurately grasp the tendency of his / her latest performance in real time, and it is easy to perform feedback to the next performance expression.

  (2) Further, according to the electronic keyboard instrument 1 of the first embodiment, the cumulative value S of Δt × ΔV is calculated (S410), and the cumulative value S is divided by the cumulative number of notes N during each unit time. By doing this, the average value Av of the volume values for each predetermined time is calculated (S550). Thus, the average value Av of the volume values for each predetermined unit calculated as described above faithfully represents the volume value of the predetermined unit.

[Other Embodiments]
As mentioned above, although one Embodiment of this invention was described, this invention is not limited to the said embodiment, It is possible to implement in the following various aspects.

(1) In the above embodiment, the present invention is realized as an electronic keyboard instrument such as an electronic piano. However, the present invention is not limited to this, and the present invention may be realized as another electronic musical instrument.
(2) In the above embodiment, the average value Av of the volume value for each predetermined time is calculated from the performance sound using the formula (2). However, the present invention is not limited to this, and for example, the volume value for each performance unit from the performance sound. May be calculated. Specific examples of performance units include time signatures and measures. Even in this way, the performer can accurately grasp the tendency of his / her latest performance.

  (3) The median value of the volume value for each predetermined unit may be calculated from the performance sound. In this way, the median value calculated as described above faithfully represents the volume value in a predetermined unit in a performance state that includes performance sounds of various volumes such as a undulating tune. Therefore, the performer can grasp the tendency of his / her latest performance in real time, and can easily perform feedback to the next performance expression.

  (4) The mode value of the volume in a predetermined unit may be calculated from the performance sound. In this way, for example, in a performance state in which a musical piece with a sense of dynamism contains many performance sounds with a high volume, the mode value calculated as described above faithfully represents the volume value in a predetermined unit. The performer can grasp in real time whether or not the performance sound can be expressed at a high volume. Therefore, the performer can accurately grasp the tendency of his / her latest performance, and it is easy to perform feedback to the next performance expression.

  (5) In the above embodiment, the cumulative value S of Δt × ΔV is calculated in the key pressing process. However, the present invention is not limited to this, and Δt × V as in S412 of the key pressing process of FIG. The cumulative value S may be calculated. Even in this case, the average value Av of the volume values for each predetermined unit calculated as described above faithfully represents the volume value of the predetermined unit.

  (6) Further, as in S414 of the key pressing process in FIG. 8, a value obtained by multiplying the difference between the average value of the volume values V and the volume value V by the difference Δt of the step time is calculated as the accumulated value S. May be. Even in this case, the average value Av of the volume values for each predetermined unit calculated as described above faithfully represents the volume value of the predetermined unit.

  (7) Further, a performance sound may be input from the outside using a microphone. For example, picking up and inputting the sound of a natural musical instrument such as a live piano with a microphone, picking up the speaker output sound of an audio player with a microphone, and the like. Further, the line-out output of the audio player may be input using the line-in input of the electronic keyboard instrument 1. In this way, it is possible to know the transition of performance sounds such as musical instruments other than the electronic keyboard instrument 1 and performances of others.

It is a block diagram showing schematic structure of an electronic keyboard instrument. (A) is a flowchart of the main process, (b) is a timer interrupt process A, and (c) is a timer interrupt process B. It is a flowchart of an event process. It is a flowchart of a key pressing process. It is a flowchart of a steady process. It is explanatory drawing explaining a steady process. It is a flowchart of the key pressing process of other embodiment. It is a flowchart of the key pressing process of other embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Electronic keyboard instrument, 10 ... Keyboard, 11 ... Panel SW / LED, 12 ... Pedal, 15 ... MIDI, 30 ... CPU, 31 ... Program data memory, 32 ... Work RAM, 33 ... I / F, 40 ... Sound source Circuit, 42 ... Waveform memory, 50 ... DSP, 52 ... Delay memory, 60 ... DAC, 70 ... Amplifier, 80 ... Speaker, 90 ... Bus line

Claims (6)

Input means for inputting the performance sound of the instrument by the performer;
Calculating means for calculating a volume value for each predetermined unit from the performance sound input from the input means;
Image generating means for generating an image in which volume values for each predetermined unit calculated by the calculating means are arranged in time series;
Display means capable of displaying various information;
Display control means for causing the display means to display an image generated by the image generation means;
A performance sound transition notification device comprising: In the performance sound transition notification device according to claim 1,
The performance sound change notification device characterized in that the calculation means calculates a volume value per unit time as the volume value for each predetermined unit. In the performance sound transition notification device according to claim 1,
The performance sound change notification device characterized in that the calculation means calculates a volume value per performance unit as a volume value for each predetermined unit. In the performance sound transition notification device according to any one of claims 1 to 3,
The performance sound transition notification device characterized in that the calculating means calculates an average value of a volume in a predetermined unit as a volume value for each predetermined unit. In the performance sound transition notification device according to any one of claims 1 to 3,
The performance sound transition notification device according to claim 1, wherein the calculation means calculates a median value of a volume in a predetermined unit as a volume value for each predetermined unit. In the performance sound transition notification device according to any one of claims 1 to 3,
The performance sound transition notification device characterized in that the calculation means calculates a mode value of a volume in a predetermined unit as a volume value for each predetermined unit.