JP2004347703A - Music playing operation display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a music playing operation display device which displays, according to the playing operations, the marks of music playing operations applied to a keyboard in an easy-to-see state in a keyboard image. <P>SOLUTION: This music playing operation display device has: a keyboard (101) which outputs music playing information according to playing operations including key pressing operations and key releasing operations; a display (108) for displaying an image of the keyboard; and a display control means (107) which displays a mark on a key of a key-pressed pitch on the display when the keyboard is pressed and further displays a mark on a key having a key-released pitch so that the mark gradually becomes smaller on the display when the keyboard is released. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a performance operation display device, and more particularly, to a device for displaying a keyboard performance operation.
[0002]
[Prior art]
As a method of displaying performance information on a display, as shown in FIG. 14A, a keyboard image is displayed on a screen, and a mark 1401 is displayed at the position of a key corresponding to a key depression when a key is depressed. In some cases, the mark is erased when a key is released as shown in FIG. In this method, the key 1401 is instantaneously erased by key press and key release. Since the display and deletion of the mark 1401 are repeated in response to the key press and the key release, there is a problem that the screen flickers and is difficult to see. Further, since only the mark 1401 is displayed on the keyboard, performance information other than the pitch cannot be expressed.
[0003]
Patent Document 1 below discloses a method of painting out a key being pressed.
[0004]
[Patent Document 1]
JP-A-6-35456 [0005]
[Problems to be solved by the invention]
SUMMARY OF THE INVENTION It is an object of the present invention to provide a performance operation display device that can easily display a performance operation mark on a keyboard image in accordance with a performance operation of a keyboard.
It is another object of the present invention to provide a performance operation display device capable of displaying performance information other than pitches on a keyboard image.
[0006]
[Means for Solving the Problems]
According to one aspect of the present invention, a keyboard for outputting performance information in response to a performance operation including a key press and a key release, a display for displaying an image of the keyboard, and a key pressed on the display displays the keyboard. A mark is displayed on the key of the depressed pitch, and when the key is released, the size of the mark on the key of the released pitch is gradually reduced on the display. A performance operation display device having display control means is provided.
According to another aspect of the present invention, when a key is pressed, a keyboard that outputs a velocity corresponding to the key pressing speed, a display for displaying an image of the keyboard, and when the key is pressed, the key is pressed on the display. There is provided a performance operation display device having display control means for changing the size of a mark in accordance with the velocity when displaying a mark on a key of a keyed pitch.
According to still another aspect of the present invention, a keyboard that outputs performance information in response to a performance operation including a key press, and an envelope generator that generates a volume envelope of a musical sound to be generated in accordance with the performance information of the keyboard, A display for displaying an image of a keyboard, and when a key is pressed, a mark is displayed on a key of the pressed pitch on the display, the size of the mark according to the volume envelope. And a display control means for changing and displaying the performance.
According to still another aspect of the present invention, a keyboard that outputs performance information in response to a performance operation including a key press, a tone generation unit that generates a tone signal in accordance with the performance information of the keyboard, and an image of the keyboard. A display for displaying, when the key is depressed, when displaying a mark on the key of the depressed pitch on the display, the mark is displayed in a display form corresponding to the tone color of the tone signal And a performance operation display device having display control means for performing the operation.
According to still another aspect of the present invention, a keyboard for outputting performance information in response to a performance operation including a key press, and a musical tone having a predetermined cutoff frequency for generating a tone signal in accordance with the performance information of the keyboard. A filter for performing signal filtering, a display for displaying an image of a keyboard, and when a key is pressed, a mark is displayed on a key of the pressed pitch on the display. A performance operation display device having display control means for displaying the mark in a display form corresponding to a cutoff frequency is provided.
According to still another aspect of the present invention, a keyboard for outputting performance information in response to a performance operation including a key press, an operator for instructing vibrato, a display for displaying an image of the keyboard, When a key is pressed, a mark is displayed on a key of the pressed pitch on the display, and when vibrato is instructed by the operator, display control means for displaying the mark while shaking it is provided. A performance operation display device having the same is provided.
[0007]
According to the present invention, since the size of the mark is gradually reduced after the key is released, the mark is not erased instantaneously, and the mark of the performance operation can be easily seen. Further, performance information other than pitches is displayed on the keyboard image, and a highly expressive display can be performed.
[0008]
BEST MODE FOR CARRYING OUT THE INVENTION
(1st Embodiment)
FIG. 1 shows a configuration example of an electronic musical instrument including a performance operation display device according to a first embodiment of the present invention. The keyboard 101 outputs performance information in response to performance operations including key depression and key release. When the key is pressed, key press information (key-on event) is output, and when the key is released, key release information (key-off event) is output. The key-on event includes a velocity corresponding to a key pressing speed, key pressing pitch information, and a MIDI (Musical Instrument Digital Interface) channel number. The key-off event includes key release pitch information and a MIDI channel number. The operator 102 includes a tone color selection operator, a pitch bend, a modulation wheel, and the like, and outputs operator operation information by the player.
[0009]
The envelope generator 103 generates a volume envelope and a filter (cutoff frequency) envelope in accordance with the performance information of the keyboard 101 and the operation information of the operator 102. Details of these envelopes will be described later with reference to FIG.
[0010]
The musical tone control unit 104 generates musical tone parameters in accordance with the performance information generated by the keyboard 101, the operation information output by the operator 102, and the envelope generated by the envelope generator 103. The sound source 105 generates a tone signal according to the tone parameter. The sound system 106 includes an amplifier and a speaker, and amplifies and emits the tone signal.
[0011]
The display 108 displays an image of a keyboard, for example, as shown in FIG. The display control unit 107 displays the performance information mark 301 (see FIG. 3 (FIG. 3) on the display 108 in accordance with the performance information generated by the keyboard 101, the operation information output by the operator 102, and / or the envelope generated by the envelope generator 103. A)) and so on are displayed. These details will be described later with reference to FIG.
[0012]
FIG. 2 shows a configuration example of a tone generator for explaining the envelope generator 103 of FIG. A digitally controlled oscillator (DCO) 201 receives a key input and generates a tone signal at a predetermined frequency. The digital controlled filter (DCF) 202 is, for example, a low-pass filter, and filters a tone signal generated by the DCO 201 at a cutoff frequency 211. A digitally controlled amplifier (DCA) 203 amplifies the tone signal output by the DCF 202 according to the volume 212. As described above, a tone signal to be generated is generated.
[0013]
The sound volume 212 is generated by the velocity 208, the envelope generator 207, and the calculator 209. The velocity 208 is a velocity (key pressing speed) during a key-on event of the keyboard 101 in FIG. As the velocity 208 increases, the volume 212 increases. The envelope generator 207 generates, for example, a volume envelope shown in FIG.
[0014]
In FIG. 7, the horizontal axis indicates time, and the vertical axis indicates volume. This volume envelope is, for example, an envelope that is depressed at time t1 and released at time t4. From time t1 to t2, an attack portion, from time t2 to t3, a decay portion, from time t3 to t4, a sustain portion, and from time t4 to t5, a release portion.
[0015]
2, a calculator 209 performs a calculation based on a volume envelope (FIG. 7) generated by an envelope generator 207 and a velocity 208 to generate a volume 212. The DCA 203 amplifies the tone signal according to the volume 212. The display control unit 107 in FIG. 1 displays a mark of performance information according to the volume envelope, the velocity 208 or the volume 212 generated by the envelope generator 207. These details will be described later with reference to FIGS. 5A and 5B and FIGS. 6A to 6F.
[0016]
In FIG. 2, a cutoff frequency 211 is generated by a cutoff frequency 205, an envelope generator 204, and a calculator 206. The cutoff frequency 205 is a cutoff frequency corresponding to the tone selected by the tone selection operator 102 in FIG. The higher the cutoff frequency 205, the brighter the tone. The envelope generator 204 generates an envelope having a cutoff frequency that changes after a key is pressed. For example, the tone color of a piano differs from the other portions in an attack portion immediately after a key is pressed. As described above, the timbre changes over time after the key is pressed.
[0017]
The arithmetic unit 206 performs an arithmetic operation based on the cutoff frequency envelope generated by the envelope generator 204 and the cutoff frequency 205, and generates a cutoff frequency 211. The DCF 202 filters the tone signal according to the cutoff frequency 211. FIG. 9 shows an example of a filter characteristic of the DCF 202. The horizontal axis shows the frequency, and the vertical axis shows the passing level. The DCF 202 allows only a signal having a frequency equal to or lower than the cutoff frequency Fc to pass. The display control unit 107 of FIG. 1 displays a mark of performance information according to the cutoff frequency envelope generated by the envelope generator 204 and the cutoff frequency 205 or 211. These details will be described later with reference to FIGS.
[0018]
(Second embodiment)
FIGS. 3A to 3D show examples of performance operation displays according to the second embodiment of the present invention. FIG. 4 shows the display size of the performance information mark corresponding to FIGS. 3 (A) to 3 (D). The horizontal axis indicates time t, and the vertical axis indicates mark size.
[0019]
At time t1, when the player presses the keyboard 101, the display control unit 107 displays a mark 301 on the key of the pressed pitch on the display 108, as shown in FIG. . This mark 301 has a size S1. The size S1 of the mark 301 remains constant until the player releases the key.
[0020]
Next, at time t2, when the keyboard 101 is released, the display control unit 107 displays on the display 108 such that the size of the mark above the released key is gradually reduced. That is, the display shown in FIG. 3A when the key is pressed is changed to the display shown in FIG. 3B after the key is released. The mark 302 after the key release is smaller than the mark 301 when the key is pressed. Thereafter, as shown in FIG. 3C, the mark 303 on the released key is further reduced. Then, at time t3, the mark disappears as shown in FIG.
[0021]
In the present embodiment, the mark is not erased at the same time as the key is released, but is displayed so that the mark gradually becomes smaller after the key is released, so that flickering of the screen can be prevented and the mark can be erased naturally. In addition, since the reduction of the mark and the decrease of the volume of the musical tone after the key release are linked, it is easy to understand intuitively.
[0022]
(Third embodiment)
FIGS. 5A and 5B show examples of performance operation displays according to the third embodiment of the present invention. The display control unit 107 changes the size S1 (FIG. 4) of the key-pressed mark on the display 108 according to the velocity during the key-on event and displays it. As shown in FIG. 5A, when the velocity is high, the mark 501 on the depressed key is displayed in a large size. As shown in FIG. 5B, when the velocity is small, the mark 502 on the depressed key is displayed in a small size. After the key is released, it is the same as the second embodiment, as shown in FIG. Further, the mark may be deleted at the same time as the key is released.
[0023]
The magnitude of the velocity corresponds to the volume of the musical sound to be pronounced. Therefore, the mark 501 increases when the volume is high, and the mark 502 decreases when the volume is low. By changing the size of the mark in accordance with the magnitude of the velocity, a more natural performance state can be displayed.
[0024]
(Fourth embodiment)
6A to 6F show examples of performance operation displays according to the fourth embodiment of the present invention. When the keyboard 101 is depressed and released, the display control unit 107 displays a mark on the display 108 on the key of the depressed pitch. At this time, the display control unit 107 changes the size of the mark according to the volume envelope of FIG. 7 or the like generated by the envelope 103 and displays the mark. That is, the size of the mark corresponds to the size of the volume envelope.
[0025]
When the key is depressed at time t1 in FIG. 7, the mark 601 on the depressed key is displayed small as shown in FIG. 6 (A). Thereafter, when the volume increases, as shown in FIG. 6B, the mark 602 on the depressed key also increases. Thereafter, at time t2, the volume becomes maximum, and as shown in FIG. 6C, the size of the mark 603 on the depressed key also becomes maximum. Thereafter, when the volume decreases, as shown in FIG. 6D, the mark 604 on the depressed key also decreases. Next, at time t4, when the key is released, the volume is further reduced, and as shown in FIG. 6E, the mark 605 on the released key is also reduced. Thereafter, at time t5, the volume becomes 0, and the mark on the released key disappears as shown in FIG. 6 (F).
[0026]
In the present embodiment, not only after the key is released, but also by changing the size of the mark according to the time change of the volume envelope from the time of the key being pressed, a more natural playing state is displayed, and the expressive power can be further enhanced. it can.
[0027]
(Fifth embodiment)
FIGS. 8A and 8B show an example of a performance operation display according to the fifth embodiment of the present invention. When the keyboard 101 is depressed, the display control unit 107 displays a mark on the key of the depressed pitch on the display 108. At that time, the display control unit 107 displays the mark in a display form corresponding to the tone color of the tone signal. For example, as shown in FIG. 8A, when the tone is bright, the mark 801 on the depressed key is displayed bright. As shown in FIG. 8B, when the tone is dark, the mark 802 on the depressed key is displayed dark.
[0028]
If the cutoff frequency Fc of the DCF 202 shown in FIG. 9 is high, the tone becomes bright, and if the cutoff frequency Fc is low, the tone becomes dark. The display control unit 107 can display the mark in a display mode according to the cutoff frequency Fc. At that time, the display control unit 107 may display the mark in a display form according to the cutoff frequency (filter) envelope 211 (FIG. 2) that changes after the keyboard 101 is pressed. Further, since the cutoff frequency is determined according to the tone color selection of the operating element 102, the display control unit 107 may display a mark in a display form according to the tone color selection.
[0029]
According to the present embodiment, the brightness or the like of the mark is changed according to the tone color. Since the brightness of the mark corresponds to "bright" or "dark" of the timbre, the expression is easy to understand.
[0030]
(Sixth embodiment)
FIG. 10 shows a performance operation display example according to the sixth embodiment of the present invention. When the keyboard 101 is depressed, the display control unit 107 displays a mark 1001 on the key of the depressed pitch on the display 108. At this time, when the vibrato is instructed, the display control unit 107 displays the mark 1001 while swinging it left and right. Vibrato is a performance method in which a player can give an instruction with the operation element 102 (pitch bend or modulation wheel, etc.) and changes the pitch at a low frequency (for example, 4 to 8 Hz).
[0031]
In the present embodiment, the mark 1001 is swung right and left according to vibrato. Since the left-right direction of the keyboard corresponds to the pitch, it is easy to intuitively understand that the swing of the mark 1001 corresponds to the swing of the pitch.
[0032]
(Seventh embodiment)
FIG. 11 shows a performance operation display example according to the seventh embodiment of the present invention. The key-on event due to the depression of the keyboard 101 includes a MIDI channel number. In addition, performance information such as a key-on event can be externally input via a MIDI interface or a network interface. In that case, the display control unit 107 can display the marks 1101 to 1105 according to the performance information of a plurality of MIDI channels or parts. At this time, the display control unit 107 displays the marks 1101 to 1105 in a different display format for each MIDI channel or part. For example, the marks 1101 and 1103 are marks of performance information corresponding to a key-on event of the first MIDI channel, and are displayed, for example, in blue. The mark 1102 is a mark of performance information corresponding to a key-on event of the second MIDI channel, and is displayed, for example, in green. The marks 1104 and 1105 are marks of performance information corresponding to a key-on event of the third MIDI channel, and are displayed in red, for example. The size of the marks 1101 to 1105 corresponds to the volume as described in the fourth embodiment and the like.
[0033]
In this embodiment, the performance information of a plurality of MIDI channels or parts can be simultaneously expressed by color-coding the marks for each MIDI channel or part.
[0034]
(Eighth embodiment)
FIG. 12 shows a configuration example of an electronic musical instrument according to the eighth embodiment of the present invention. The above first to seventh embodiments can also be realized by a computer program in the memory 1207 of the electronic musical instrument 1200.
[0035]
In the electronic musical instrument 1200, a keyboard 1200, a display 1203, a sound source 1204, a network interface 1205, a CPU 1206, and a memory 1207 are connected to a bus 1201.
[0036]
When the performer presses or releases a key on the keyboard 1202, the CPU 1206 detects them and generates a key-on event or a key-off event. Further, the CPU 1206 can transmit / receive a key-on event to / from the outside via the network interface 1205. The sound source 1204 performs sound generation processing or silence processing based on the generated or received key-on event or key-off event, and is generated by the sound system 1208. The CPU 1206 displays an image of the keyboard on the display 1203, and controls the display of marks on the keys of the key-on event and the key-off event. The CPU 1206 performs the above processing according to the computer program in the memory 1207.
[0037]
The processing may be performed only by the electronic musical instrument 1200 or may be performed by combining a keyboard and a personal computer. In this case, an image of the keyboard is displayed on the display of the personal computer.
[0038]
(Ninth embodiment)
FIG. 13A shows a first system configuration example for connecting a plurality of electronic musical instruments according to the ninth embodiment of the present invention. The two electronic musical instruments 1301 and 1302 are connected to each other via a network. When the electronic musical instrument 1301 transmits performance data (MIDI data) and the like, the electronic musical instrument 1302 receives the performance data and the like. Conversely, when the electronic musical instrument 1302 transmits performance data and the like, the electronic musical instrument 1301 receives the performance data and the like. Electronic musical instruments 1301 and 1302 have a keyboard. When two performers play the electronic musical instruments 1301 and 1302, respectively, the own electronic musical instrument can generate musical tones and transmit the performance data to the other electronic musical instrument to generate the musical tones. The display of each of the electronic musical instruments 1301 and 1302 displays the keyboard image and the performance information mark shown in the first to seventh embodiments. At this time, since the own performance information and the performance information of another person have different MIDI channel numbers, marks are displayed in different colors or the like. By transmitting and receiving performance data and the like using a network, it is possible to perform a so-called net session in which players at remote locations perform ensemble.
[0039]
FIG. 13B shows a second system configuration example for connecting a plurality of electronic musical instruments according to the present embodiment. The three electronic musical instruments 1321 to 1323 are mutually connected via a network server 1320. The three electronic musical instruments 1321 to 1323 and the network server 1320 are connected via a network. The electronic musical instruments 1321 to 1323 can communicate performance data and the like via the network server 1320. In this case as well, players at remote locations can perform ensemble. The display of each of the electronic musical instruments 1321 to 1323 displays the keyboard image and the performance information mark shown in the first to seventh embodiments.
[0040]
According to the present embodiment, it is possible to simultaneously display the performance information of the player and the performance information of another person on the display. It is conceivable to take a scene of another person's performance with a camera, communicate the video data, and display the video data. However, in that case, the video data amount becomes large. In the present embodiment, since performance information such as MIDI data is communicated, the amount of communication data can be reduced and performance information of another person can be displayed on the display. The networks in FIGS. 13A and 13B are, for example, MIDI, the Internet, USB, or IEEE1394.
[0041]
As described above, according to the first to ninth embodiments, since the size of the mark is displayed so as to gradually decrease after the key is released, the mark is not erased instantaneously, and the performance operation is not performed. The mark can be easily seen. Further, as performance information other than pitches, performance information such as volume, velocity, cutoff frequency, tone, vibrato, MIDI channel number, etc. is displayed on a keyboard image, so that a highly expressive display can be performed.
[0042]
It should be noted that each of the above-described embodiments is merely an example of a concrete example in carrying out the present invention, and the technical scope of the present invention should not be interpreted in a limited manner. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features.
[0043]
【The invention's effect】
As described above, since the size of the mark is gradually reduced after the key is released, the mark is not erased instantaneously, and the mark of the performance operation can be easily seen. Further, performance information other than pitches is displayed on the keyboard image, and a highly expressive display can be performed.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a configuration example of an electronic musical instrument including a performance operation display device according to a first embodiment of the present invention.
FIG. 2 is a block diagram illustrating a configuration example of a tone generator for describing an envelope generator.
FIGS. 3A to 3D are views showing examples of performance operation displays according to a second embodiment of the present invention.
FIG. 4 is a diagram showing display sizes of performance information marks corresponding to FIGS. 3 (A) to 3 (D).
FIGS. 5A and 5B are views showing examples of performance operation displays according to a third embodiment of the present invention.
FIGS. 6A to 6F are views showing examples of performance operation displays according to a fourth embodiment of the present invention.
FIG. 7 is a diagram showing a volume envelope.
FIGS. 8A and 8B are views showing an example of a performance operation display according to a fifth embodiment of the present invention.
FIG. 9 is a diagram illustrating an example of a filter characteristic.
FIG. 10 is a diagram showing a performance operation display example according to a sixth embodiment of the present invention.
FIG. 11 is a diagram showing a performance operation display example according to a seventh embodiment of the present invention.
FIG. 12 is a diagram illustrating a configuration example of an electronic musical instrument according to an eighth embodiment of the present invention.
FIGS. 13A and 13B are diagrams illustrating an example of a system configuration for connecting a plurality of electronic musical instruments according to a ninth embodiment of the present invention.
FIGS. 14A and 14B are diagrams showing a conventional method of displaying performance information.
[Explanation of symbols]
101 Keyboard 102 Operator 103 Envelope Generator 104 Musical Sound Control Unit 105 Sound Source 106 Sound System 107 Display Control Unit 108 Display 201 DCO
202 DCF
203 DCA
204 Envelope generator 205 Cut-off frequency 206 Operation unit 207 Envelope generator 208 Velocity 209 Operation unit 1200 Electronic musical instrument 1201 Bus 1202 Keyboard 1203 Display 1204 Sound source 1205 Network interface 1206 CPU
1207 Memory 1208 Sound system 1301 and 1302 Electronic musical instrument 1320 Network server 1321 to 1323 Electronic musical instrument

Claims (11)

A keyboard for outputting performance information in response to performance operations including key presses and key release,
A display for displaying an image of the keyboard,
When the key is depressed, a mark is displayed on the display at the key of the depressed pitch, and when the key is released, the size of the mark above the key of the depressed pitch on the display is displayed. And a display control means for displaying the performance operation so as to gradually decrease. The keyboard outputs a velocity corresponding to a key pressing speed,
The performance operation display device according to claim 1, wherein the display control unit changes the size of the mark at the time of key depression in accordance with the velocity and displays the mark. A keyboard that outputs a velocity corresponding to the key pressing speed when the key is pressed;
A display for displaying an image of the keyboard,
A display control means for changing the size of the mark in accordance with the velocity when displaying a mark on the key of the pressed pitch on the display when the key is pressed. Operation display device. A keyboard for outputting performance information in response to a performance operation including key depression,
An envelope generator that generates a volume envelope of a musical sound to be generated according to the performance information of the keyboard;
A display for displaying an image of the keyboard,
Display control means for changing the size of the mark in accordance with the volume envelope when displaying a mark on the key of the pressed pitch on the display when the key is pressed, Performance operation display device having the same. A keyboard for outputting performance information in response to a performance operation including key depression,
Musical sound generating means for generating a musical sound signal according to the performance information of the keyboard;
A display for displaying an image of the keyboard,
Display control means for displaying the mark in a display form according to the tone color of the musical tone signal when a mark is displayed on a key of the pressed pitch on the display when the key is pressed. Performance operation display device. Furthermore, it has an operator for selecting a tone,
6. The performance operation display device according to claim 5, wherein the display control means displays the mark in a display form according to the selection of the operator. A keyboard for outputting performance information in response to a performance operation including key depression,
A filter for filtering a tone signal at a predetermined cutoff frequency to generate a tone signal in accordance with the performance information of the keyboard;
A display for displaying an image of the keyboard,
A display control means for displaying the mark in a display form corresponding to the cutoff frequency when displaying a mark on the key of the pressed pitch on the display when the key is pressed. Operation display device. 8. The performance operation display device according to claim 7, wherein the display control means displays the mark in a display form according to an envelope of the cutoff frequency that changes after a key is pressed. A keyboard for outputting performance information in response to a performance operation including key depression,
An operator for instructing vibrato,
A display for displaying an image of the keyboard,
When a key is pressed, a mark is displayed on a key of the pressed pitch on the display, and when vibrato is instructed by the operator, display control means for displaying the mark while shaking it. A performance operation display device having: The display control means displays the mark in a different display format for each MIDI channel or part when displaying the mark according to performance information of a plurality of MIDI channels or parts. 3. The performance operation display device according to 1. Furthermore, it has an interface for inputting performance information from outside,
11. The performance operation display device according to claim 10, wherein the display control means can display the mark in accordance with performance information input from outside.

Images