JP2003114674A - Playing information display device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a playing information display device which can present playing information other than the pitch and its sounding period of a musical sound to be generated. SOLUTION: The shape of a note object 320 representing the musical sound to be generated has its length in a scroll direction determined by the length of the sounding continuance of the musical sound and its pitch determined by the velocity value (sound volume) of he musical sound. The viewpoint for its display is so determined that while the object is looked down from above the front side of a display keyboard 301, the display keyboard 301 is obliquely viewed. Consequently, while a decrease in the visibility of the object 320 is evaded, the object is displayed in three dimensions and scrolled.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for presenting performance information such as the pitch of a musical tone to be sounded, the timing at which the musical tone at the pitch starts to be pronounced, or the duration of musical tone pronunciation to the user by scrolling.

[0002]

2. Description of the Related Art Nowadays, many keyboard musical instruments are sequentially informed of the keys to be pressed (operated) according to the progress of the performance. The function is installed. A performance information display device for scroll-displaying an object showing the pronunciation duration of a musical tone of each tone pitch is mounted on a keyboard instrument as its navigation function, for example.

In the performance information display device, the length of the object in the scrolling direction is changed according to the sounding duration. The edge of the object starts to be erased or reaches a predetermined position at the timing when it starts to generate a musical sound indicating the sounding duration. Thereby, through the scroll display of the object, the pitch of the musical sound to be generated, the timing of starting the generation of the musical sound, and the timing of muting the musical sound are expressed. Therefore, if a musical tone is sounded according to the scroll display, that is, if a key is pressed to which the pitch of the musical tone indicating the sounding duration of the object is assigned, and the key is released, the musical tone to be sounded is accurately generated. Can be pronounced. The tone generation period during which a tone is to be sounded is represented by the timing at which the tone is started to be sounded and the timing at which the tone is muted (sounding duration).

In the conventional performance information display device, the above-mentioned objects are scroll-displayed. However, many users who use the performance information display device are technically inexperienced. For such users,
The reality is that it is difficult to perform a performance according to the scroll display of objects. Even if the performance is correctly performed according to the scroll display, it is unlikely that the performance will be rich in musical expression. For this reason, it is considered necessary to provide the user with performance information other than the pitch of the musical sound to be sounded, the musical sound period (timing at which the sound is started, and the duration of sound generation (timing at which the sound is muted)).

Scrolling (moving) while displaying an object has been performed with the viewpoint in the vertical direction of a virtual plane on which the object is arranged. As a result, all the objects were displayed in the same way.

A user who is technically inexperienced usually cannot play with a margin. For such a user, if all objects are displayed in the same manner, it is not always necessary to quickly identify a musical note to be noticed, for example, a musical note to be sounded at the moment, or an object having a musical note having a similar timing. It is thought that I cannot find it. In other words, it is considered that the user cannot necessarily grasp the presented (displayed) performance information quickly. From this, it is considered that what kind of object is displayed and how is displayed so that the user can grasp the performance information more quickly.

An object of the present invention is to provide a performance information display device capable of presenting to the user performance information other than the pitch of a musical tone to be sounded and the duration of the sound generation, and further, performance information so that the user can grasp it more quickly and easily. It is to provide a performance information display device capable of presenting

[0008]

Means for Solving the Problems The first and second aspects of the present invention
Both of the performance information display devices of the above modes are provided with the following means on the premise that the performance information is presented to the user by scroll display.

In the performance information display device of the first aspect, the pitch of the musical sound to be generated, the sound generation start timing of the musical sound,
And a plurality of song data obtaining means for obtaining song data representing the tone duration of the tone in units of tone, and a tone duration of the tone related to the tone represented in the song data obtained by the song data obtaining means. Performance information display means for scroll-displaying an object having a shape based on each content of the performance information on the display device.

It is desirable that the performance information display means displays an object three-dimensionally and expresses a plurality of performance information in the shape of the object. In the object, it is desirable that the volume at which a musical sound is to be pronounced is expressed as one of a plurality of pieces of performance information in a length on the crossing direction of the direction in which the pronunciation duration is expressed by length. Also,
It is desirable to display the object in the direction of the intersection with respect to the perpendicular of the virtual plane on which the object is placed, and further, according to whether or not the pitch of the musical tone corresponds to the black key of the keyboard, It is desirable to change the display form.

In the performance information display device of the second aspect, the pitch of the musical sound to be generated, the sound generation start timing of the musical sound,
And a song data acquisition unit that obtains song data that represents the pronunciation duration of the tone in units of the tone, and an object that represents at least the pronunciation duration of the tone represented in the song data acquired by the song data acquisition unit. Performance information display means for three-dimensionally displaying and scrolling display on a display device.

Both the programs of the first and second aspects of the present invention are intended to be executed by a performance information display device for presenting performance information to a user by scroll display, and realize the following functions respectively.

The program of the first aspect has a function of acquiring the pitch of a musical tone to be generated, the timing at which the musical tone having the pitch is started, and the musical piece data representing the pronunciation duration of the musical tone in the musical tone unit. And a function of scroll-displaying an object having a shape based on each content of a plurality of performance information including a sounding duration of the musical sound represented by the music data acquired by the acquiring function, on the display device. .

The program of the second aspect has a function of acquiring the pitch of a musical tone to be generated, the timing at which the musical tone at the pitch is started, and the musical piece data representing the pronunciation duration of the musical tone in the musical tone unit. And a function of three-dimensionally displaying an object representing at least the pronunciation duration of a musical sound represented in the music data acquired by the acquiring function on the display device and scrolling the display.

According to the present invention, the shape of the object to be displayed is determined based on a plurality of performance information including the musical tone production duration, and the object is scroll-displayed in the determined shape. As a result, it becomes possible to present the user with the pitch of the musical sound to be generated and the performance information other than the sounding period through the object thus displayed. By presenting such performance information, the user can perform an easier performance, a more appropriate performance, or a performance with richer musical expression. As a result, the user can practice more efficiently and acquire musical expressive power more quickly.

In the present invention, an object that at least expresses the sounding duration of a musical sound is three-dimensionally (three-dimensionally) displayed and scrolled. Compared to an object displayed in a two-dimensional manner, an object displayed in a three-dimensional manner has a large amount of information that the object itself has, and becomes more noticeable. You will also be able to do it. From this, it becomes possible to improve the visibility and to emphasize the object that has a high degree of attention to the user. As a result, it is possible to present the performance information so that the user can grasp it more quickly and easily.

[0017]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a circuit configuration diagram of an electronic musical instrument equipped with a performance information display device according to this embodiment.

The performance information display device according to this embodiment is
It is installed to navigate the performance performed by the user of the electronic musical instrument. As shown in FIG. 1, an electronic musical instrument equipped with it has a CPU 101 for controlling the entire musical instrument, a program executed by the CPU 101, various music data, various control data (including various data for image display), and the like. A ROM 102 storing therein, a RAM 103 used by the CPU 101 for work, and a keyboard 1 having a large number of keys.
04, a display unit 105 for displaying data sent from the CPU 101 on the screen, an operation unit 106 to be operated by the user, a sound source 107 for generating waveform data of musical tones according to an instruction from the CPU 101, and the sound source 107. A sound system 108 that converts the waveform data output by the device into sound and outputs the sound, and a bus 109 that connects the CPU 101 to each of the units 102 to 107 are configured.

The display unit 105 is a display device such as a CRT or a liquid crystal display device. Operation unit 106
Is an input device including a plurality of operators such as various switches and keys, and a detection circuit for detecting an operation on the operators. The sound system 108 is a system including, for example, a D / A converter, an amplifier, and a speaker.

FIG. 2 is a diagram for explaining the structure of the music data. A plurality of pieces of music data are stored in the ROM 102, each of which is composed of a plurality of track data. Each track data is performance data for automatically reproducing a target performance, or setting data for automatically changing settings related to the performance. In the present embodiment, the objects are classified into one for playing a performance performed with the left hand, one for playing a performance with the right hand, one for playing accompaniment, one for playing accompaniment, and one for changing tempo, and for each classification. Track data is available.

Each track data is composed of one or more event data. The event data is composed of a plurality of parameter data representing the content of the event, and time data indicating the timing at which the data should be processed. As its parameter,
Although not shown in particular, there are parameters that indicate the type of event (hereinafter, the data will be referred to as type data), parameters prepared for each type, and the like.

The type of event represented by the type data includes a note event for instructing the pronunciation of a musical sound and a tempo event for instructing a change in tempo. These respective events are performance information to be displayed. In the note event, as parameters (data), pitch data indicating the pitch of a musical tone, velocity data indicating its volume,
The gate time data indicating the duration of sound generation, the finger number data indicating the finger that the user should use to pronounce the musical tone, and the note data indicating the notes corresponding to the musical tone are prepared. In the tempo event, data indicating a new tempo value to be set is prepared.

Note that, in the music data, finger number data and note data are prepared in advance as data (parameters) representing the contents of the note event, but these data do not necessarily have to be prepared. It may be acquired separately from the music data or by analyzing the content of the music data. The data format of them is also not particularly limited.

The operation of the above configuration will be described. When the power is turned on, the CPU 101 turns on the ROM 10
By reading out and executing the program stored in 2, the control of the entire musical instrument is started, and the initial screen is displayed on the display unit 105. After that, the user's keyboard 10
4 or control is performed according to an operation on the operation unit 106.

The CPU 101 generates image data for displaying the initial screen using a plurality of image data read from the ROM 102, using the RAM 103 for work, for example. The display unit 105, to which the image data of the initial screen generated in this way is sent, stores it in a memory (for example, a dual port RAM) not particularly shown. For the whole or partial change of the display content after that, for example, the CPU 101 reads from the ROM 102 the image data of the portion of the image data stored in the memory in which the data should be rewritten, or is generated using it. Then, the image data obtained in this way is
It is performed by overwriting the image data in the memory on the portion to be rewritten. In that way, the CPU 101
Causes the display unit 105 to display a screen or message to be displayed, or scroll performance information for display.

The scroll display of the performance information is performed when the user operates the operation unit 106 to select, for example, music data to be automatically reproduced and then instructs the automatic reproduction. In the present embodiment, the performance information represented in the event data indicating the contents of the note event is targeted for scroll display as follows. A specific description will be given with reference to FIGS.

FIG. 3 is a diagram for explaining the scroll display method. In the present embodiment, as shown in FIG. 3, a keyboard represented by a large number of white keys and black keys (hereinafter referred to as a display keyboard in order to avoid confusion with the keyboard 104 that is the target of the performance operation by the user) 301 , And the scroll object 310 arranged so as to be on the same plane as the keyboard 301, the note object 3 indicating the musical sound to be displayed at all times.
20 is displayed on the scroll surface 310 at a position corresponding to the pitch. The note object 320 displayed on the scroll surface 310 is moved in the scroll direction indicated by the arrow in the figure in accordance with the progress of the automatic performance of the music data, and the portion reaching the position at the tip of the display keyboard 301 is erased. There is. As a result, the note object 320 is scroll-displayed by displaying only the portion corresponding to the performance range corresponding to the scroll surface 310.
The scroll surface 310 is a plane that is at least parallel to the virtual plane described in the claims.

On the scroll surface 310, bar lines 311 indicating bar divisions and lines 312 for dividing the area according to the white keys of the display keyboard 301 are arranged. By arranging the point 311 ahead, the user can more easily understand the pitch of the musical sound indicated by the note object 320.

The viewpoint for displaying the scroll surface 310 and the display keyboard 301 is as shown in FIG.
The direction of intersection with the vertical line of 10 is set. More specifically, the keyboard 3 is displayed from the scroll direction side of the display keyboard 301 (the side on which the user is located when playing the keyboard).
The point of view is that the key on 01 is viewed from the low-pitched side to the high-pitched side obliquely, and the keyboard 301 is viewed obliquely from above.

From such a viewpoint, the note object 32
When 0 is displayed and scrolled, at each pitch, the note object 320 of the musical sound that should be pronounced earliest
Is placed at the beginning, and is emphasized more than other note objects 320. Even if the note object 320 has a three-dimensional shape, it is possible to prevent another note object 320 from hiding it in such a manner that the user cannot grasp the performance information represented by the note object 320. By having a large amount of information as compared with a two-dimensional shape, the advantage of being easily noticeable can be always taken advantage of. For this reason, the user can always find the note object 320, which has a high degree of attention when performing, extremely easily and quickly. That is, the performance information represented by the note object 320 can always be grasped extremely easily and quickly.

From such a point of view, the user is given the impression that the note object 320 scrolls (moves) toward itself. Since it is close to the viewpoint actually facing the keyboard 104, the sense of discomfort is suppressed, and various timings represented by the scroll display of the note object 320 can be more easily grasped. As a result, it becomes easier to understand the flow of the performance, and as a result, the user can more easily perform the performance in accordance with the scroll display.

The object 302 in FIG. 3 is the keyboard 10.
4 is displayed in order to confirm the pitch of the key that the user is currently pressing, in other words, the pitch of the musical tone that is actually sounded by the performance, and corresponds to that key on the display keyboard 301. The color of the key used is also different from that of other keys of the same type. As a result, the user can confirm the actual performance content in addition to the content to be played, simply by looking at the display unit 105. The object 302 will be referred to as a real note object hereinafter.

In the present embodiment, of the two conditions of whether the pitch of the musical tone indicated by the note object 320 is the pitch assigned to the white key and whether the musical tone should be pronounced with the left hand. The display form is changed according to the condition satisfied with. As shown in FIG. 4, the display mode is such that the note object 320 is divided into a hexahedron-shaped front portion 320a located at the beginning in the scroll direction and a rear portion 320b subsequent to the hexahedron shape, and the two portions 320 are separated.
It is made different by changing the display color of a and 320b.
Specifically, FIGS. 4A and 4B and FIGS. 4C and 4D
As is clear from the comparison between and, the display color of the front portion 320a is changed depending on whether the pitch of the musical tone corresponds to the white key, and FIGS. 4 (a), 4 (c) and 4 ( As is clear from comparison between (b) and (d), the display color of the rear portion 320b is changed depending on whether or not the musical sound should be generated with the left hand. In this manner, whether the musical tone to be sounded belongs to the left-hand part or the right-hand part, and the type of the key to be depressed in order to pronounce the musical sound, is represented by the note object 320, and those musical performances are performed. Information is presented to the user in a form that can be easily grasped.

FIG. 5 is a diagram for explaining the shape of the note object 320. The shape of the note object 320, its determination method, and its display position will be described in detail with reference to FIG. Its shape and display position are determined by the CPU 101.

The note object 320 has a three-dimensional shape. The three-dimensional coordinate axes are defined as shown in FIG. The X axis is parallel to the direction in which the keys of the display keyboard 301 are arranged, and the Z axis is parallel to the line 312 (scroll direction). The Y axis is perpendicular to the X and Z axes. Note that X
As for the axis, since the position on the axis represents the pitch of a musical tone, it will be referred to as a scale axis hereinafter. Since the position on the Z-axis represents time, it is also referred to as a time axis hereinafter.

As shown in FIG. 5, each note object 320 has points a (x0, y0, z0) and b (x1, y).
0, z0), c (x1, y1, z0), d (x0, y
1, z0), e (x0, y0, z1), f (x1, y
0, z1), g (x1, y1, z1), h (x0, y
1, z1), i (x0, y0, z2), and j (x1,
The shape is managed by a total of 10 points (y0, z2).

Symbol x0 representing the coordinate values of those points,
In x1, y0, y1, z0, z1, and z2, only the coordinate value on the Y axis represented by the symbol y0 is a fixed value.
The coordinate value on the Z axis represented by z1 is a value obtained by adding a constant value to the coordinate value represented by z0. x0 and x1 are values determined by the pitch of the musical tone (pitch data in the event data). These values are determined by referring to a table that defines the correspondence between the coordinate value represented by x0 or x1 and the pitch. The difference between them is a constant value, and the width of the note object 320 on the X-axis is not changed regardless of whether the type of the key to which the pitch of the musical tone is assigned is the white key. Note that x in the real note object 302
The coordinate values corresponding to 0 and x1 are similarly determined by the pitch data sent from the keyboard 104. The width on the Z axis is fixed.

Y1 is determined from the velocity value (velocity data in the event data) indicating the volume of the musical tone (the coordinate value of y0 is a fixed value). In the present embodiment, it is determined by referring to a table that defines the correspondence between the coordinate value represented by y1 and the velocity value. The larger the velocity value, the larger the coordinate value represented by y1. In other words, the width of the note object 320 on the Y axis is made larger as the volume at which the musical sound is to be pronounced is increased. Thereby, the note object 32
The width of 0 on the Y-axis allows the user to know the volume of the volume at which a musical sound should be generated. Here, if the velocity value range is 0 to 127, for example, 0, 1
~ 23, 24-47, 48-71, 72-95, 96-
119, 120 to 127, divided into seven value ranges, and the value is 0
The width on the Y-axis of the note object 320 is switched in 6 steps by targeting 6 non-value ranges. The coordinate value corresponding to y1 in the real note object 302 is similarly determined by the velocity value sent from the keyboard 104.

The width on the Y-axis is switched according to the velocity value of the musical sound in the front portion 320a, and the width thereof is maximized, and the width is gradually reduced in the rear portion 320b. This minimizes the portion of the front part 320a hidden by other note objects 320 as much as possible, and allows the user to reliably and easily grasp the velocity value of the musical sound represented by the front part 320a and the timing at which it should be pronounced. This is to allow it.

The difference between the coordinate value represented by z2 and the coordinate value represented by z0 is determined according to the tone generation duration of the musical tone (gate time data in the event data). The time represented by the width of the entire Z axis (hereinafter, referred to as display range time) is set to be changeable by the user. Therefore, the difference between them is a value obtained by dividing the sounding duration by the time represented by the unit length on the Z axis. In this way, the width of the note object 320 on the Z-axis is set to a size according to the sounding duration so that the user can grasp the sounding duration.

The coordinate value represented by z0 is changed according to the progress of the automatic performance of the music data. As a result, the note object 320 is scrolled according to the progress of the automatic performance.

In this way, the note object 32
The shape of 0 (actual note object 302) is determined. The display color of the front part 320a constituting it is assigned to a white key (black key) by referring to a table that defines the correspondence between the pitch of a musical tone and the type of key to which it is assigned. It is switched depending on whether or not Rear part 3
The display color of 20b is switched depending on whether the track data to which the event data belongs is for left-hand (right-hand) performance. As a result, the note object 320 is displayed as shown in FIG. 4 in accordance with the type of key to which the pitch is assigned and the part of the musical sound of that pitch.

The note object 320 whose shape is determined as described above is a three-dimensional figure. However, it must be displayed on the display unit 105 in two dimensions. That is, it is necessary to convert three-dimensional space data (data including at least the coordinate value of each point representing the shape and display position of an object to be displayed) into two-dimensional plane data. The conversion is, for example, one screen generated by determining the shape and display position of each object (here, it means a region of a portion to be scroll-displayed. Hereinafter, in order to avoid confusion, it is called a performance screen. If the target is spatial data of X minutes), X ,,
After the process of rotating around each of the Y and Z axes,
It is performed by projecting parallel to the XY plane.

After the plane data is obtained by performing such a conversion, a portion to be displayed on the surface represented by a plurality of points is specified, and for each of the specified portions, a pixel forming the portion is identified. As data, one screen of image data is generated by writing a value representing the display color of that portion. Since the note object 320 having a lower tone pitch is displayed closer to the front side, the portion to be displayed is specified from the note object 320 on the lower tone side. By sending the image data generated in this way to the display unit 105 and displaying it, the scroll display is performed by displaying various objects as shown in FIG. The image data is generated for the entire performance screen or a part thereof and sent to the display unit 105 depending on the situation.

In this embodiment, the projection from the three-dimensional space data to the two-dimensional plane data is performed in parallel. However, as shown in FIG. 6, for example, the projection is performed in the form of perspective. You may do it. However, in order to emphasize the musical sound to be pronounced to the user, it is desirable that the note object 320 of the musical sound to be pronounced earlier has a larger display. In FIG. 6, the viewpoint is also different from that in FIG. 3, the width of the note object 320 on the scale axis is different depending on whether the pitch corresponds to the white key, and the display color is one color. . The viewpoint may be different from those in FIGS. 3 and 6.

The shape of the note object 320 may be different from that shown in FIG. For example, any of Modifications 1 to 5 shown in FIGS. 7A to 7E may be adopted. Other shapes may be adopted. In the modified example 3 shown in FIG. 7 (c), a finger (“1” in the drawing) to be used for producing a musical tone of the pitch represented by the finger is arranged at the front part. Figure 7
In the modified example 4 shown in (d), a symbol indicating a note corresponding to the musical sound represented by the symbol is arranged in the front part. In the modified example 5 shown in FIG. 7E, a symbol (“c” in the figure) indicating the pitch (pitch name) of the musical tone represented by the symbol is arranged in the front part. As is clear from FIGS. 7C to 7E, since the note object 320 is displayed three-dimensionally (three-dimensionally), it is possible to arrange the symbol indicating some performance information so that it can be easily grasped.

Note object 320 as described above
By displaying and scrolling, the user can obtain more performance information more easily and quickly than the conventional performance information display device.
Therefore, it helps the user to perform in a more appropriate form. You will also be able to perform a richer musical expression in a shorter time.

Next, the operation of the CPU 101 for realizing the scroll display of performance information as described above will be described with reference to FIGS.
This will be described in detail with reference to various flowcharts shown in FIG.

FIG. 8 is a flowchart of the whole process. The overall process represents the overall flow of the process realized by the CPU 101 executing the program stored in the ROM 102 when the user turns on the power. First, the overall processing will be described in detail with reference to FIG.

First, in step 801, initialization processing for initializing the state of the musical instrument to a predetermined state is executed. In the next step 802, a process of fetching data indicating the states of various switches forming the operation unit 106 from the detection circuit of the operation unit 106 is executed. After that, the process proceeds to step 803.

In step 803, the data taken in from the detection circuit of the operation unit 106 is analyzed to determine whether any switch has been operated by the user. Operation unit 106
When a user operates any of the switches that make up
The determination is yes and the process moves to step 804. Otherwise, the determination is no and the process moves to step 812.

A power switch for instructing to turn on / off the power is provided as a switch constituting the operation unit 106. In step 804, it is determined whether the power switch has been operated. When the user operates the switch, the determination is YES, and the series of processes is ended here. Otherwise, the determination is no and the process moves to step 805.

In step 805, it is determined whether or not the start switch, which constitutes the operation unit 106, for instructing the start of the reproduction (automatic performance) of the music data is operated. When the user operates the switch, the determination is yes, the process proceeds to step 806, and the performance start process for starting the reproduction of the currently selected song data is executed, and then the process proceeds to step 812. Otherwise, the determination is no and the process moves to step 807. When the performance start process is executed, a variable Playflg prepared for managing the reproduction of the music data is substituted with a value 1 indicating that the reproduction is being performed.

In step 807, it is determined whether or not the stop switch, which constitutes the operation unit 106, for instructing the stop (end) of the reproduction (automatic performance) of the music data is operated. If the user operates the switch, the determination is Y.
When ES is reached, the process proceeds to step 808, and a performance stop process for stopping the reproduction of the music data currently being reproduced is executed, and then the process proceeds to step 812. Otherwise, the determination is no and the process moves to step 809.
When the performance stop processing is executed, the variable Playf
A value 0, which indicates that the music data is not being reproduced, is assigned to lg.

In the present embodiment, as described above, the user can change the unit of the time axis represented by the display unit 105, that is, the length of the display range time which is the performance time represented by one performance screen. . In step 809, the operation unit 106
It is determined whether or not the switch for instructing the change is operated. If the switch is operated by the user, the determination is yes and the process moves to step 810 to execute the display time process of changing the display range time according to the type of the switch operated by the user to display the changed display range. After substituting the value indicating the time into the variable tkDispRange, the process proceeds to step 812. Otherwise, the determination is no, the process moves to step 811, and another switch that constitutes the operation unit 106 or the keyboard 104.
After executing the process to respond to the user's operation to
Go to step 812. It should be noted that the CPU 101 sends out to the sound source 107, using the data received from the keyboard 104, to generate musical tones in response to the user's operation on the keyboard 104 (starting sound, muting, addition of various sound effects, etc.). It is realized by generating a power command and sending it to the sound source 107.

At step 812, it is determined whether or not the music data is currently being automatically played (reproduced). If 1 is assigned to the variable Playflg prepared for the automatic performance, the determination is yes and the process moves to step 813.
After performing the performance process for advancing the automatic performance of the music data, the process proceeds to step 814. Otherwise, the determination is no and the process moves to step 814.

At step 814, a musical tone display process for scroll-displaying the note object 320 (see FIG. 3 etc.) and further other objects in accordance with the progress of the automatic performance of the music data is executed. Continued Step 815
Then, other display processing for displaying other information to be notified to the user and various setting contents as necessary is executed. At step 816, which is performed next, other processing is executed to cope with the matters other than those described above.
After the execution, the process returns to step 802. Transmission / reception of MIDI data via a MIDI interface (not shown) is realized by executing the process of step 816.

Thus, while the power is on,
The processing loop formed in steps 802 to 816 is repeatedly executed. As a result, the user can operate the keyboard 104 or the operation unit 106, automatically play (play) music data, and scroll display in accordance with the progress of the automatic performance.

In the following, various subroutine processes executed in the above overall process will be described in detail. FIG. 9 is a flowchart of the performance process executed as step 813. In the subroutine processing executed in the overall processing, the performance processing will be described in detail first with reference to FIG.

As shown in FIG. 2, the music data to be automatically played by this performance processing is composed of a plurality of track data. From this, the performance process is designed to sequentially change the target track data for each track data, and extract and process the event data at the timing to be processed in the track data. In order to realize it, one-dimensional array variable pPl
Each element of ayEvent holds an address value indicating the event data to be processed next in the corresponding track data. At the start of automatic performance of music data, an address value designating the event data located at the head among the corresponding track data is held.

First, in step 901, 0 (the track number is 0 to 15) is assigned to a variable trk for managing the track data to be processed, and the current playing time (the automatic playing of the song data is started. The time that has elapsed since then) is calculated, and a value indicating it is substituted for the variable tkPlay. In the following step 902, it is determined whether or not the value of the variable trk is smaller than the maximum value of the track number held in the variable MAXTRK. In the present embodiment, the variable t
The 0 assigned to rk is used as an initial value, and the value assigned to it is incremented as needed to process the track data whose number matches the value of the variable trk. From this, if not all the track data are processed, the determination is YES and step 90
Move to 3. If not, the determination is no, and the series of processes ends here. The above variable tk
In Play, 0 is substituted at the start of automatic performance of music data.

As described above, in the note event data, there are pitch data, velocity data, gate time data, etc. as the parameter data representing the content of the event. The musical sound that has started to be sounded according to the time data must be muted after the sounding duration represented by the gate time data has elapsed. From this,
In the present embodiment, the two-dimensional array variable pPlayOff
Is prepared, and an address value indicating event data of a musical sound being generated is held for each track data. The subscript in parentheses located immediately after that is for specifying the track data (number). The work area provided by the array variable pPlayOff will be also referred to as an off-buffer hereinafter. NULL (which is a value indicating that an address value is not held) is assigned to each element of the array variable pPlayOff at the start of automatic performance of music data.

In step 903, an off-buffer performance process is executed in which the event data whose address value is held in the off-buffer is to be processed. In the next step 904, the element pPlayE specified by the value of the variable trk in the array variable pPlayEvent is transferred.
The value of vent [trk] is assigned to the variable pe. After that, the process proceeds to step 905.

At step 905, the time data (“pe” in the figure) in the event data designated by the value of the variable pe.
The time represented by "→ tktime" is represented by the variable tkPla.
It is determined whether or not the performance time is equal to or longer than the value of y. If the event data designated by the value of the variable pe has reached or has reached the timing to be processed, the determination is YES because the relationship is satisfied, and the process proceeds to step 907. Otherwise, the determination is no, the value of the variable trk is incremented in step 906, and the process returns to step 902. As a result, the target track data is replaced next, and the processing after step 902 is similarly executed.

In step 907, the event performance processing for advancing the automatic performance of the music data is executed by processing the event data at the timing to be processed. In the following step 908, the address value of the event data located next to the event data indicated by the previous value is substituted into the variable pe. In step 909, which moves to the next step, the element pPlayEve specified by the value of the variable trk in the array variable pPlayEvent.
The value of the variable pe is substituted into nt [trk]. Then, the process returns to step 905. As a result, steps 905 and 90 are performed until all the event data to be processed in the track data specified by the value of the variable trk is processed.
The processing loop formed by 7 to 909 is repeatedly executed.

Now, various subroutine processes executed in the performance process will be described in detail with reference to FIGS. 10 and 11. FIG. 10 is a flowchart of the off-buffer process executed as the above step 903. In the subroutine process executed in the performance process, the off-buffer process will be described in detail with reference to FIG. The values of various variables are passed from the performance processing.

First, in step 1001, the variable off
Substitute 0 for. The variable off is a variable prepared for processing the event data in which the address value is held in the element in the array variable pPlayOff designated by using the value, and the value is sequentially incremented.

Step 1002 following step 1001
Then, it is determined whether or not the value of the variable off is smaller than the maximum polyphony number for the track data held in the variable MAXOFF. When all the elements in the array variable pPlayOff that can be specified by changing the value of the variable off are not specified, the determination becomes YES and the process proceeds to step 1003, and the array variable specified by each value of the variable trk and off. Elements in pPlayOff pPlayOff
The address value held in [trk] [off] is set to the variable p.
After substituting for e, the process proceeds to step 1004. Otherwise, the determination is no and the array variable pPlay
It is assumed that all of the event data in which the address value is held in the element designated by the value of the variable off in Off are to be processed, and the series of processing is ended here.

At step 1004, the value of the variable pe is N
Whether it is ULL, that is, the element pPlayOff [trk]
It is determined whether the address value is not held in [off]. If the element does not hold the address value, the determination is yes and the process moves to step 1007. Otherwise, the determination is no and the process moves to step 1005.

In step 1005, the time indicated by the time data constituting the event data designated by the value of the variable pe (indicated as "pe → tktime" in the figure) is represented by the time indicated by the gate time data constituting it ( In the figure, the time obtained by adding “pe → tkoff”), that is, the time when the musical sound represented by the event data should be silenced,
It is determined whether the playing time is equal to or longer than the value indicated by the variable tkPlay. When it is time to mute the musical sound that started to be sounded by the event data, the determination is yes and the process moves to step 1006. Otherwise, the determination is no and the process moves to step 1007.

In step 1006, the sound source 107 is instructed to mute the musical sound generated by the event data designated by the value of the variable pe, and the element pPlayOf is set.
Substitute NULL for f [trk] [off]. In the following step 1007, the value of the variable Off is incremented. After that, the process returns to step 1002. Thereby, all the event data to be processed among the event data in which the address value is held in the element in the array variable pPlayOff designated by changing the value of the variable off is processed. The command for instructing the sound source 107 to mute a musical sound is generated using the pitch data that constitutes the event data.

Next, step 9 in the performance process shown in FIG.
The event performance process executed as 07 is shown in FIG.
This will be described in detail with reference to the flowchart shown in FIG. As described above, the event performance processing is processing for advancing the automatic performance of the music data by processing the event data at the timing to be processed,
From the performance process, the values of the variables pe and trk are passed.

First, in step 1101, it is determined whether the type of event indicated by the parameter data in the event data designated by the address value of the variable pe is a note event. If the event type is a note event, the determination is yes and the process moves to step 1102 to instruct the tone generator 107 to generate a musical tone whose pitch is specified by the pitch data in the event data. After the address value is held in the element in the array variable pPlayOff, a series of processing is ended. Otherwise, the determination is no and the process moves to step 1103.

The element that holds the address value holds NULL among the elements designated by the value of the variable trk, or the address value of the event data that started the sounding of the corresponding musical sound earliest. The retained element is extracted and determined. When the address value is overwritten on the element holding the address value, the musical tone being sounded is muted by the event data specified by the overwritten address value. As a result, while the element holding the NULL remains, the remaining element holds the address value, and if the element holding the NULL does not remain, it is specified by the overwritten address value. The tone data being sounded is muted by the event data, and an element for holding a new address value to be held is secured.

At step 1103, it is determined whether the type of event indicated by the parameter data in the event data designated by the address value of the variable pe is a tempo event. If the event type is a tempo event, the determination is yes and the process moves to step 1104,
The variable tkTempoChange is time data in the event data (indicated as “pe → tktime” in the figure), that is, a value indicating the playing time at the timing of changing the tempo value, and the variable dwTempoChange is a variable d.
After substituting the tempo value indicated by the data in the event data into the value of wClock and the variable doTempo,
A series of processing ends. Otherwise, the decision is N
When it becomes O, the process proceeds to step 1105, and after performing the process for responding to another event, the series of processes is ended.

The variable dwClock is a variable prepared to hold the counter value incremented by the timer interrupt process executed at regular intervals, for example. The time represented by the count value changes depending on the tempo value. The count value at the timing of changing the tempo value is set to the variable dwTempoCh.
The reason why the change is held is that the change can be dealt with. At the start of automatic performance of song data, the variable tkTempoChange is 0, the variable dw tempo Change is the value of the variable dwClock, and the variable doT.
A predetermined initial value is substituted into empo. From this, the playing time calculated when the performance process shown in FIG. 9 (more specifically, the process of step 901) is executed is tk if the value used for the calculation is represented by a variable symbol.
Play = tkTempoChange + (dwClo
ck-dwTempoChange) x doTempo
It is calculated by

Returning to the explanation of the subroutine processing executed in the overall processing shown in FIG. FIG. 12 is a flowchart of the musical sound display process executed as step 814 in the overall process. Next, the musical sound display processing will be described in detail with reference to FIG. The display and scrolling of various objects described with reference to FIGS. 3 to 5 are performed by executing the musical sound display process.

First, in step 1201, it is determined whether or not the music data (see FIG. 2) is currently being automatically played. The value 1 that indicates that it is playing automatically is the variable Playfl
If it is assigned to g, the determination is yes, and the value of the variable tkPlay is changed to the variable tkDisp in step 1202.
After substituting for, shifts to step 1203. If not, the determination is no, and the series of processes ends here.

The tkDisp holds the performance time at the beginning of the scroll display on the display unit 105. Variable tkPlay as the playing time
As is apparent from substituting the value held in, the present playing time (the time elapsed after the automatic performance of the song data is started) is set to the beginning of the scroll display range. There is. As a result, for example, at the timing of starting the sound generation of the musical sound represented by the note object 320, the tip of the object 320 is displayed on the keyboard 30.
It is expressed by moving to the end of 1, and the timing at which the musical sound should be muted is expressed by deleting all to the rear end of the object 320.
As a matter of course, the scroll display may be performed in a different form.

At step 1203, the variable tkDisp
Is smaller than the value of the variable tkDispOld. The value of the variable tkDisp is substituted into the variable tkDispOld in step 1208 described later, and the value is updated. 0 is assigned to the variable tkPlay that assigns a value to the variable tkDisp at the start of performance of the music data. From this, when the step 1203 is executed for the first time after the automatic performance of the music data is started, a value smaller than the value of the variable tkDispOld is assigned to the variable tkPlay, so that the determination is YES and the routine proceeds to step 1204. To do. Otherwise, the determination is no and the process moves to step 1205.

At step 1204, each element (track number is 0 to 1) of the one-dimensional array variable pDispEvent.
Since it is any one of 5, the number of elements is set to 16 according to that), and the array variable pTrk holds the address value of the event data located at the beginning of each track data forming the music data. Substitute the values of each element in Note object 32 being displayed
NULL is assigned to each element of the two-dimensional array variable pDispOff prepared for holding the address value of the event data represented by 0. After performing the initial setting for scroll display in this way, step 12
Move to 05. Regarding the work area provided by the array variable pDispOff, in the display off buffer and step 1205, each object not to be scroll-displayed, for example, the display keyboard 301 or the real note object 302 is displayed on the display unit 105. To execute. The display position of the object 302 (the key that makes the display color of the display keyboard 301 different from the others) and the width (height) on the Y-axis are obtained from the data received from the keyboard 104 when the process of step 811 shown in FIG. 8 is executed. decide.

Step 1206 following step 1205
Then, a note object 320 representing a note event
The event display process for displaying is executed. In the next step 1207, the array variable pDis
The address value of the event data to be stored in the display off buffer provided by pOff is managed, and the display off buffer process for scrolling the note object 320 indicating the event data that has already come to be processed is executed. . After executing it, the process proceeds to step 1208.

The three-dimensional space data necessary for displaying one performance screen (display area for scroll display) is generated by executing the processes of steps 1206 and 1207. From this, in step 1208, while substituting the value of the variable tkDisp into the variable tkDispOld, conversion is performed to generate two-dimensional plane data from the three-dimensional space data generated at that time, and one plane is displayed from the plane data. Minute or part of the image data is generated and sent to the display unit 105 to update the display content. The series of processing is ended thereafter.

By executing the tone display processing described above,
A scroll display as shown in FIG. 3 is realized. Hereinafter, various subroutine processes executed in the musical sound display process will be described in detail with reference to FIGS. 13 and 14.

FIG. 13 is a flow chart of the event display process executed as step 1206. In the subroutine process executed in the musical sound display process, the event display process will be described in detail with reference to FIG. In the present embodiment, the scroll display of the note object 320 is performed only for the event data that constitutes the track data for the left-hand performance and the right-hand performance whose track numbers are 0 and 1.

First, in step 1301, the variable trk
The track number (here, 0) held in the variable LEFTTRK is substituted into. Continued Step 130
In 2, it is determined whether or not the value of the variable trk is equal to or less than the track number (here, 1) held in the variable RIGHTTRK. The value of the variable trk is sequentially incremented to switch the track data to be processed. From this, if the processing for the right-handed track data has been completed, the determination is NO, and the series of processing is ended here. Otherwise, the determination is yes and step 1303.
Move to.

In step 1303, the address value of the element pDispEvent [trk] designated by the value of the variable trk in the array variable pDispEvent is substituted for the variable pe. At the next step 1304,
It is determined whether or not the length of time indicated by the time data in the event data designated by the value of the variable pe is less than or equal to the current length of playing time indicated by the value of the variable tkDisp. If it is time to process the event data specified by the value of the variable pe, the determination is yes and step 105
Move to. Otherwise, the determination is no and the process moves to step 1310.

In step 1305, it is determined whether the type of event indicated by the data in the event data designated by the value of the variable pe is a note event. If the event type is a note event, the determination is Y
It becomes ES and moves to step 1306. Otherwise, the determination is no and the process moves to step 1308.

In step 1306, the shape of the note object 320 representing the event data and its display position (each point) from the time data, pitch data, gate time data, and velocity data in the event data as described above. 3D space data of the note object 320 is generated by deciding each coordinate value on the XYZ axes of the. Also, the pitch data and the variable t
The display colors of the front part 320a and the rear part 320b of the object 320 are determined from the value of rk (see FIG. 4). After generating the data for displaying the note object 320 to be scrolled in this way, step 130 is performed.
7, the address value of the event data is changed to the element pDispOff [trk] [] (“[]” is a value that cannot be predicted in advance for the second subscript) specified by the variable trk of the array variable pDispOff. Hereinafter, unless otherwise specified, the same meaning is used).
Then, the process proceeds to step 1308. Here, the element for holding the address value is NU, as in the process of step 1102 executed in the event performance process shown in FIG.
Either LL is held, or the address value of the event data representing the musical sound having the earliest sounding start time is held.

At step 1308, the address value of the event data located next to the event data designated by the value so far is substituted into the variable pe. In the next step 1309, the element pDispEvent is entered.
The value of the variable pe is substituted into [trk]. Then, the process returns to step 1304.

At step 1310 when the determination at step 1304 is NO and the process shifts, the time indicated by the time data in the event data designated by the value of the variable pe (indicated as “pe → tktime” in the figure) is It is determined whether it is before (shorter than) the display end time (indicated as “tkDisp + tkDispRange” in the drawing). If the timing at which the event data should be processed is after the display end time, the determination becomes NO, and after incrementing the value of the variable trk in step 1311, the above step 1
Return to 302. As a result, if the track data of track number 0 is currently the processing target, the processing target is moved to the track data of track number 1. On the other hand, otherwise, the determination is yes and the process moves to step 1312.

In step 1312, it is determined whether the type of event represented by the data in the event data designated by the value of the variable pe is a note event. If the event type is a note event, the determination is yes and the process moves to step 1313. If not,
The determination is no and the process moves to step 1314.

At step 1313, at least the three-dimensional space data for displaying the note object 320 representing the event data is generated for the event data for which the processing timing has not come, in the same manner as the processing at step 1306. . If the timing for ending the sound generation is after the display end time, the three-dimensional space data has the front portion 32 at the position of the display end time.
0a, or the rear part 320b is cut in the XY plane,
Alternatively, the time represented by z1 or z2 in FIG. 5 (coordinate value on the Z-axis) is generated so as to match the display end time. In the next step 1314, the variable pe is set.
Substitute the address value of the event data located next to the event data specified by the value up to that point. Then, the process returns to step 1304.

In this way, in the event display processing,
Display and scroll the note object 320 of event data (only note events are targeted as event types) whose processing timing is between the current playing time and the display end time. I have to.

FIG. 14 is a flowchart of the display-off buffer process executed as step 1207 in the tone display process shown in FIG. Finally, referring to FIG.
The display off buffer process will be described in detail.

In this display off-buffer process, only the event data (the type of event is only a note event) whose address value is held in the element of the array variable pDispOff is targeted for processing. Thereby, the scroll display of the note object 320 of the event data when the timing to be processed comes to be dealt with by executing the display off buffer process.

First, in step 1401, the variable trk
The track number (here, 0) held in the variable LEFTTRK is substituted into. Continued Step 140
In 2, it is determined whether or not the value of the variable trk is equal to or less than the track number (here, 1) held in the variable RIGHTTRK. The value of the variable trk is sequentially incremented to switch the track data to be processed. From this, if the processing for the right-handed track data has been completed, the determination is NO, and the series of processing is ended here. Otherwise, the determination is yes and step 1403.
Move to.

At step 1403, 0 is substituted for the variable off. In the next step 1404, the variable t
Element pDispOff specified by each value of rk and off
The value held in [trk] [off] is substituted into the variable pe. In step 1405, which is the subsequent step, the variable p
It is determined whether or not the value of e is NULL (a value that is not an address value). N in the element pDispOff [trk] [off]
If the ULL is held, the determination is yes and the process moves to step 1410. Otherwise, the determination is no and the process moves to step 1406.

In step 1406, the time (sound generation end time) obtained by adding the sound generation duration indicated by the gate time data in the event data to the time indicated by the time data in the event data designated by the value of the variable pe is a variable. tkDi
It is determined whether it is before (shorter than) the current performance time indicated by the value of sp. If the pronunciation end time is before the current playing time, the determination is yes and step 1407
At element pDispOff [trk] [off]
After holding L, the process proceeds to step 1410. If not, that is, if it is not necessary to delete all the pronunciation objects 302 of the event data specified by the value of the variable pe, the determination becomes NO and step 140
Go to 8.

In step 1408, it is determined whether or not the time indicated by the time data in the event data designated by the value of the variable pe is before (shorter than) the display end time. If it is not time to start displaying the pronunciation object 302 of the event data, the condition is not satisfied, so the determination is NO and step 14
Go to 10. Otherwise, the determination is yes and the process moves to step 1409.

At step 1409, the time data, pitch data, gate time data in the event data,
From the velocity data, at least three-dimensional space data for displaying the note object 320 representing the event data is generated. At this time, if not all of the note objects 320 are displayed, the three-dimensional space data is generated by cutting the note objects 320 on the XY plane at the position of the current playing time. In the subsequent step 1410, the value of the variable off is incremented. After that, the processing shifts to step 1411.

In step 1411, it is determined whether or not the value of the variable off is smaller than the maximum polyphony number for the track data held in the variable MAXOFF. Variable o
The value of ff is sequentially incremented with 0 being the initial value.
From this, when all the address values indicating the event data in the track data in which the track number held in the element of the array variable pDisoffoff matches the value of the variable trk are read and processed, the determination becomes NO, and step 1412 After incrementing the value of the variable trk with
Returning to step 1402 above. Thereby, the track data to be processed is switched. On the other hand, otherwise, the determination is no and the process returns to step 1404. Thereby, the element whose value is to be read is changed, and the subsequent processing is similarly executed.

In this embodiment, the scroll surface 3
By setting the viewpoint as the direction intersecting with the 10 perpendiculars,
Although the discomfort given to the user is reduced, even if the visibility or the degree of emphasis is reduced, the effect of reducing it can be obtained without displaying the note object 320 three-dimensionally (stereoscopically). Therefore, the note object 320 may be displayed as a two-dimensional figure. In such a case, the velocity value of the musical tone may be represented by the width on the scale axis.

Regarding the event, only the one represented by one song data (see FIG. 2) is displayed, but the one represented by a plurality of song data is displayed simultaneously in parallel. It may be allowed to. For example, the performance performed by the user may be stored in the form of song data so that the events represented in the song data can be displayed alone or in combination with the events represented in other song data. good. Even if there are multiple song data to be processed,
Since the processing content itself for each piece of music data is basically the same as the case where there is one piece of music data to be processed, detailed description is omitted.

In the present embodiment, the present invention is applied to a performance information display device mounted on an electronic musical instrument.
However, the performance information display device to which the present invention can be applied is not limited to one mounted on an electronic musical instrument or the like.
INDUSTRIAL APPLICABILITY The present invention can be widely applied to a performance information display device for exclusive use which is not mounted on another device. The display unit 105 may also be omitted if it can be connected to an external display device.

The program for realizing the operation of the performance information display device may be recorded in a recording medium such as a CD-ROM, a DVD or a magneto-optical disk and distributed. Alternatively, via a transmission medium used in a public network or the like,
Part or all of the program may be delivered. In such a case, the user can obtain the program and load the program on an arbitrary performance information display device or a data processing device such as a computer to apply the present invention to the device. Therefore, the recording medium may be accessible by the device that distributes the program.

[0107]

As described above, according to the present invention, the shape of the object to be displayed is determined based on a plurality of performance information including the sounding duration of the musical sound, and the object is scroll-displayed in the determined shape. . Therefore, it is possible to present the user with the pitch of the musical sound to be generated and the performance information other than the sounding period through the object thus displayed.

According to the present invention, an object representing at least the sounding duration of a musical sound is three-dimensionally (three-dimensionally) displayed and scrolled. An object displayed three-dimensionally is compared with an object displayed two-dimensionally,
Not only will the amount of information that the object itself has become more noticeable, but it will also be possible to display the object using its shape. For this reason, it is possible to improve or emphasize the visibility of an object to which the user should pay attention. Thereby, the performance information can be presented so that the user can grasp the information more quickly and easily.

[Brief description of drawings]

FIG. 1 is a circuit configuration diagram of an electronic musical instrument equipped with a performance information display device according to an embodiment.

FIG. 2 is a diagram illustrating a structure of music data.

FIG. 3 is a diagram illustrating a scroll display method.

FIG. 4 is a diagram illustrating a display form of a note object.

FIG. 5 is a diagram illustrating a shape of a note object.

FIG. 6 is a diagram showing another scroll display method.

FIG. 7 is a diagram showing a modified example of a note object.

FIG. 8 is a flowchart of overall processing.

FIG. 9 is a flowchart of performance processing.

FIG. 10 is a flowchart of off-buffer performance processing.

FIG. 11 is a flowchart of an event performance process.

FIG. 12 is a flowchart of a musical sound display process.

FIG. 13 is a flowchart of event display processing.

FIG. 14 is a flowchart of a display off buffer process.

[Explanation of symbols]

101 CPU 102 ROM 103 RAM 104 keyboard 105 display 106 Operation part 107 sound source 108 sound system 301 display keyboard 302 Real note object 310 scroll surface 311 bar line 312 lines 320 Note object 320a front 320b rear

Claims (8)

[Claims] 1. A performance information display device for presenting performance information to a user by scroll display, wherein a pitch of a musical tone to be generated, a sounding start timing of the musical tone at the pitch, and a sounding duration of the musical tone are united by the musical tone unit. And a shape based on each content of a plurality of performance information including a sounding duration of the musical sound represented by the musical composition data acquired by the musical composition data acquisition means. A performance information display device, comprising: performance information display means for scroll-displaying an object on a display device. 2. The performance information display means according to claim 1, wherein the performance information display means displays the object three-dimensionally and expresses the plurality of performance information in the shape of the object. apparatus. 3. The performance information display means sets, in the object, a sound volume at which the musical sound is to be generated for a length on a crossing direction of the direction in which the sounding duration is expressed by one of the plurality of performance information. The performance information display device according to claim 2, wherein: 4. The performance information display means displays the object by viewing the object in a direction intersecting with a vertical line of a virtual plane on which the object is arranged. Performance information display device. 5. The performance information display means changes the display form of the object according to whether or not the pitch of the musical tone corresponds to a black key of a keyboard. 4. The performance information display device according to any one of 4 above. 6. A musical performance information display device for presenting musical performance information to a user by scroll display, wherein the pitch of a musical tone to be generated, the timing of starting the musical tone at the musical tone pitch, and the duration of the musical tone are generated in the musical tone unit. The three-dimensionally displayed on the display device, the music data acquisition means for acquiring the music data represented by, and the object for expressing at least the pronunciation duration of the musical sound represented in the music data acquired by the music data acquisition means. And a performance information display means for scroll-displaying the performance information display device. 7. A program to be executed by a performance information display device for presenting performance information to a user in a scroll display, the pitch of a musical tone to be sounded, the timing of starting the production of the musical tone at the pitch, and the pronunciation of the musical tone. A function for acquiring song data representing a duration in units of the musical tones and based on each content of a plurality of performance information including a pronunciation duration of the musical tone related to the musical tone represented in the song data acquired by the function for acquiring A program that realizes the function of scroll-displaying shaped objects on the display device. 8. A program to be executed by a performance information display device for presenting performance information to a user in a scroll display, the pitch of a musical tone to be sounded, the timing at which the musical tone at that pitch is started, and the pronunciation of the musical tone. A function for acquiring music data representing a duration in the musical tone unit, and an object representing at least the pronunciation duration of the musical sound represented in the music data acquired by the acquiring function are three-dimensionally displayed on the display device. A program that realizes the function of displaying and scrolling.