JP2006061560A - Matrix display device and control program for the device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make a two-dimensional display of visual interest by making a plotting display corresponding to the lapse of time and coordinates. <P>SOLUTION: In an automatic plotting mode, one predetermined track in performance data used as a performance object is divided every four measures to form one page, and assignment of assigned balls dp and formation of a moving route rt of moving balls mp are carried out on each page. When the moving balls mp coincide with the assigned balls dp, plotting route data drt corresponding to the assigned balls dp are generated, and a square plotting display is enlarged every time plotting update timing comes according to the plotting route data drt. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a matrix display device that performs matrix display and a control program for the device.

Conventionally, as shown in Non-Patent Documents 1 and 2 below, an application called Tenorion (registered trademark) is known. In a mobile phone or a game machine in which this application operates, the display unit or the like is used as a matrix display device, on a 16 × 16 grid arranged in a matrix with timing on the horizontal axis and pitch on the vertical axis. In response to timing, the designated point is input, and the designated point is lit and displayed in order from the left column, and the pitch corresponding to the designated point is pronounced, so even beginners can enjoy simple composition and performance. Yes.
“Keitai News”, [online], January 16, 2002, ASCII, [Search April 1, 2004], Internet <URL: http://k-tai.ascii24.com/k-tai/news /2002/01/16/632762-000.html?geta> “World of Digista Curator”, [online], Digital Stadium, Toshio Iwai, Exhibited work = Tenorion, [Search April 1, 2004], Internet <URL: http://www.nhk.or.jp /digista/lab/digista_ten/curator.html>

  However, in the matrix display device to which the applications shown in Non-Patent Documents 1 and 2 are applied, the display mode is limited and visually monotonous. Therefore, there is room for improvement in incorporating a temporal element and realizing a visually interesting display.

  The present invention has been made to solve the above-described problems of the prior art, and an object of the present invention is to provide a visually interesting two-dimensional display by drawing display according to the passage of time and coordinates. A matrix display device and a control program for the device are provided.

  In order to achieve the above object, a matrix display device according to claim 1 of the present invention is arranged in a matrix corresponding to each of coordinates in a two-dimensional region (mt) in which a timing element is assigned to one of a row or a column. A plurality of visible display units (mtLED), a visual display unit control unit (1) for controlling the plurality of visible display units, and a coordinate designating unit for designating a designated coordinate (dp) from the coordinates of the two-dimensional region. (MtSW, S704) and timing advance means (4) for defining the current position in the one of the rows or columns according to the passage of time, and the visible display control means is defined by the timing advance means When the specified coordinate specified by the coordinate specifying means exists at the one current position of the row or column, at least one of the plurality of visible display portions is allowed. By displaying, and performs a predetermined drawing display corresponding to the designated coordinate the present.

  Preferably, a pronunciation element corresponding to coordinates is assigned to the other of the row or column, and the coordinate designating unit designates the current position of the one of the row or column defined by the timing advancement unit. When there is a designated coordinate, a musical tone generation instructing means (1) for instructing the generation of a musical tone based on the sound generation element assigned to the existing designated coordinate is provided. According to this configuration, a new way of enjoying not only listening but also enjoying the sound by performing drawing display in conjunction with the generation of the musical sound is possible, and a healing effect can be obtained by the illumination effect display.

  Preferably, the coordinate designating unit designates the designated coordinate based on performance data, and the visual display unit control unit sets the predetermined drawing display mode to at least one parameter relating to a musical sound in the performance data. (Claim 3). According to this configuration, it is possible to enjoy a drawing mode that is linked to music by drawing according to parameters such as velocity.

  Preferably, the visual display unit control means temporally changes each of the drawing displays to be displayed corresponding to the designated coordinates. According to this configuration, a more interesting display can be performed by a temporal change in the drawing display.

  In order to achieve the above object, a control program for a matrix display device according to claim 5 of the present invention is arranged in a matrix corresponding to each of coordinates in a two-dimensional region in which a timing element is assigned to one of a row or a column. A control program for a matrix display device for controlling a matrix display device having a plurality of visible display portions, wherein a visible display portion control step for controlling the plurality of visible display portions, and coordinates of the two-dimensional region A program for causing a computer to execute a coordinate designating step for designating a designated coordinate from a timing advance step for defining a current position in the one of the rows or columns as time elapses, and the visual display unit control step includes the timing Specify the coordinates at the current position of the one of the rows or columns defined by the progress step. If the specified coordinates specified by step is present, said plurality of it to visible display at least one visual display unit, and performs a predetermined drawing display corresponding to the designated coordinate the present.

  In addition, the code | symbol in the said parenthesis is an illustration.

  A computer-readable storage medium storing the program according to claim 5 constitutes the present invention.

  According to the present invention, it is possible to perform a visually interesting two-dimensional display by drawing display according to time and coordinates.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing an overall configuration of a matrix display device according to an embodiment of the present invention. FIG. 2 is an external view of the matrix display device. The matrix display device of the present embodiment is configured as a performance device MC. By connecting two performance devices MC with a connection cable 30, a performance system is configured, and a battle-type game is also possible. When the two performance devices MC are particularly distinguished, they are referred to as the own device MC1 and the partner device MC2.

  As shown in FIG. 1, the performance device MC includes a ROM 2, a RAM 3, a timer 4, a storage input / output device 5, a storage device 6, a communication I / F 7, another device communication I / F 9, a matrix display input unit mt, and a panel switch 10. The display unit 11, the sound source 12, the off level detection unit 13, and the G sensor 24 are connected to the CPU 1 via the bus 16. A sound system 15 is connected to the sound source 12 via a D / A converter 14. A timer 4 is connected to the CPU 1.

  The CPU 1 controls the performance device MC. The ROM 2 stores a control program executed by the CPU 1 and various table data. The RAM 3 temporarily stores various input information such as performance data and text data, various flags, buffer data, and calculation results. The timer 4 measures the interrupt time and various times in the timer interrupt process. The storage input / output device 5 stores and reads data in and from a portable storage medium 17 such as a flash memory or a flexible disk. The panel switch 10 includes a plurality of switches for inputting various types of information. These include, for example, the operator group 19 and the encoder switch 18 shown in FIG. The display unit 11 is composed of an LCD or the like. In addition to storing performance data and the like, the storage device 6 can store various application programs including the control program, various data, and the like.

  The communication I / F 7 includes MIDI (Musical Instrument Digital Interface) signal transmission / reception with other MIDI devices via a USB (Universal Serial Bus) terminal, etc., as well as the USB, Internet, etc. A network I / F that performs data communication via a network, a wired or wireless LAN (local area network), and the like are included. The other-device communication I / F 9 realizes data communication with another performance device MC (partner device MC2).

  The sound source 12 converts performance data or sounding data that is input into a musical sound signal. The D / A converter 14 performs digital / analog conversion, and the sound system 15 includes an amplifier and a speaker (not shown), and converts a musical sound signal input from the D / A converter 14 into sound. Further, the off level detection unit 13 detects an off level signal from the musical tone signal output from the sound source 12 and supplies it to the CPU 1. Note that a part of the sound source 12 may be configured by software. Alternatively, a sound source provided separately may be connected to the performance device MC without sending the sound source 12 in the performance device MC, and a sound generation instruction may be sent from the performance device MC to the sound source.

  The G sensor 24 can be composed of, for example, a commercially available acceleration sensor, and detects acceleration applied to the performance device MC in a two-dimensional (X, Y axis) direction. To configure the G sensor 24, a biaxial acceleration sensor may be used, or two uniaxial acceleration sensors may be provided orthogonal to each other.

  As shown in FIG. 2, the performance device MC has a box-like appearance, and the matrix display input unit mt, the display unit 11, the operator group 19 and the encoder switch 18 are disposed on the upper surface thereof. The display unit 11 side is behind the matrix display input unit mt, and the user is behind the performance device MC and operates the performance device MC. Hereinafter, the front, rear, left and right of the performance device MC are referred to as viewed from the user.

  Further, as shown in FIG. 2, a connector 23 for connecting the connection cable 30 is provided at the front end of the performance device MC. By connecting the connection cable 30 to the connector 23, the performance device MC (own device MC1) can perform data communication with the counterpart device MC2 via the other-device communication I / F 9.

  FIG. 3 is a plan view of the matrix display input unit mt. As shown in FIG. 1, the matrix display input unit mt includes a matrix switch group mtSW (n, k) including a plurality of matrix switches mtSW and a matrix display unit group mtLED (n, k) including a plurality of matrix display units mtLED. ) Is included. As shown in FIG. 3, the matrix display input unit mt has a square area, and a total of 256 matrix switches mtSW are arranged in this area in a matrix of 16 × 16. Each matrix switch mtSW is a push-type switch, and a matrix display section mtLED is provided inside correspondingly. Each matrix switch mtSW may be a panel switch configured by a touch panel type transmissive organic EL (Electro Luminescence). Each matrix display unit mtLED is an LED (Light Emitting Diode) capable of emitting light with at least two levels of brightness. Each matrix switch mtSW has at least an upper portion made of a light-transmitting member so that light emission from the corresponding matrix display section mtLED can be visually recognized.

  The matrix display unit mtLED of each matrix switch mtSW is controlled not only to emit light and extinguish when the matrix switch mtSW is pressed, but also to light emission by processing according to various modes by the CPU 1 described later.

  Hereinafter, in the matrix display input unit mt, the column (left and right) direction is the X axis, the row (up and down) direction is the Y axis, and the vertical direction with respect to the matrix display input unit mt is the Z axis. There are 16 columns in the X-axis direction, and the coordinates are represented by “n”. There are 16 rows in the Y-axis direction, and the coordinates are represented by “k”. Each specification of each matrix switch mtSW and its matrix display unit mtLED can be expressed by X and Y coordinates, and are expressed by mtSW (n, k) and mtLED (n, k), respectively. For example, the lower left ones are mtSW (1, 1) and mtLED (1, 1).

  The CPU 1 can generate sound generation data KC corresponding to each of the matrix switches mtSW, and information for that is stored in the ROM 2 or the like. The tone generation data KC is a kind of performance data composed of, for example, MIDI signals, and includes musical tone parameters such as pitch, tone color, velocity, and effects. In the present embodiment, as an example, the tone generation data KC has a different pitch depending on the k value (Y coordinate), a tone color (corresponding to an instrument sound) depending on each column (n value), and other musical tone parameters are all. The same is set for the matrix switch mtSW. For example, when k = 1, the pitch is “C4” (C in the middle and corresponds to MIDI 60), when k = 2, the pitch is “D4”, and thereafter “E4”, “F4”,. At k = 16, a pitch corresponding to a white key on the keyboard is sequentially associated with each k value, such as a pitch “D5”. Note that the pitch associated with each k value is not limited to this, and may include, for example, the pitch of a black key (C4 #, etc.). Moreover, the timbres between the columns (n values) may be the same. In particular, in the automatic drawing mode, which will be described later, it is preferable that the timbres of all the columns n are the same when performing a melody performance.

  Each matrix switch mtSW is designated (on) / undesignated (off) each time it is pressed individually with a finger or the like. Note that the designation (on) state may be set only when the button is in the pressed state, and the designation cancellation (off) state may be set when the button is not pressed.

  Here, the operation of the well-known “sequential sounding mode” already realized by the present applicant will be described. With respect to the sequential sound generation mode, processing related to input reception is executed in “sequential sound generation mode input reception processing” in step S322 of FIG. 19 described later, and processing related to reproduction (light emission and sound generation) is performed in step S108 of FIG. 15 described later. The “sequential pronunciation mode process” is executed. In the sequential tone generation mode, each matrix switch mtSW emits light from the matrix display section mtLED of the specified matrix switch mtSW. The matrix display unit mtLED can emit light in two steps as described above, and emits light by either weak light emission or strong light emission having a higher luminance than the weak light emission. In this sequential sounding mode, the matrix display portion mtLED is extinguished in the non-designated state, emits weak light in the designated state, and emits strong light when coincident with a sounding string P described later.

  For example, in FIG. 3, “slashed circles” indicate weak light emission, and “●: (black paint circles)” indicates strong light emission. In the sequential sounding mode, the sounding string P is moved at a predetermined speed t sequentially from the (left) first line by a predetermined operation, and after the 16th line, it returns to the first line, and this is repeated thereafter. Then, in the process of moving the pronunciation string P, the matrix display section mtLED of the matrix switch mtSW in the designated state existing in the pronunciation string P emits strong light. In the example of the figure, the matrix display sections mtLED (7, 2), mtLED (7, 7), and mtLED (7, 10) in the seventh column emit strong light. At the same time, sound generation data KC corresponding to the matrix switch mtSW in the specified state existing in the sound generation string P is generated, and a musical sound is generated from the sound system 15 based on the sound generation data KC. In this sequential sounding mode, the timbre may be automatically set to be the same for all rows n.

  Therefore, the user can perform simple composition and reproduction by designating and inputting the matrix switch mtSW arranged in a matrix form with the horizontal direction as time and the vertical direction as pitch.

  Next, various operation modes are realized by the processes of FIGS. 15 to 26 described later. These processes will be described in detail later, and operations of the various operation modes will be described first. The operation modes can be broadly classified into five modes: “random loop mode”, “two-point loop mode”, “music box mode”, “sequential sounding mode”, and “automatic drawing mode”, and these are exclusive ones. One is set. In addition, there are a “bounce mode” and a “motion mode”, any of which can be set in addition to the “random loop mode” or the “two-point loop mode”.

  As another operation mode, there is a “real-time drawing performance mode”, which is “random loop mode”, “two-point loop mode”, “sequential sounding mode” or “automatic drawing mode”. It can be set with or without setting. The “movement mode” includes “rotation mode” and “G sensor mode”, and the “music box mode” includes “automatic scroll mode” and “manual scroll mode”. An example of specific operations in these various operation modes will be described with reference to FIGS.

  Among these, the operation mode representing the feature of the present invention is the “automatic drawing mode”, and an example of the operation is shown in FIGS. 12 and 13.

  In the present embodiment, when the matrix display unit mtLED is circular in plan view and emits light, it can be conceptually grasped as a light emitting ball. Henceforth, the matrix display unit mtLED of the matrix switch mtSW in the designated state is designated as “designated ball dp ( dp1, dp2, dp3, etc.) ”. In addition, when the matrix display unit mtLED that emits light is sequentially shifted, it can be grasped that the light emitting ball moves. Therefore, such a moving light emitting ball is hereinafter referred to as a “moving ball mp”. The “moving ball mp” is defined in the matrix display input unit mt by moving coordinates that are displaced in time while holding one of the matrix display units mtLED (usually the adjacent matrix display unit mtLED) at the current position. It is.

  Further, in FIGS. 4 to 11, the moving ball mp is indicated by “double circle ◎”, and the designated ball dp is indicated by “◯ with hatching” or “◯ with dotted line”. In particular, “dotted circles” indicate designated balls dp that are no longer in a light emitting state due to being undesignated, displaced, out of the matrix display input section mt, or due to the timing of sound generation and light emission. . Furthermore, “●: (black circles)” indicates a matrix display portion mtLED that emits strong light (the designated ball dp and the moving ball mp may be included). Further, in FIGS. 12 to 14, “O” with diagonal lines indicates weak light emission, and “●: (black paint ○)” indicates strong light emission.

  FIG. 4 is a transition diagram of the matrix display input unit mt schematically showing the operation in the “random loop mode”.

  In the random loop mode, normally, by first designating (turning on) one desired matrix switch mtSW with a finger or the like, a moving ball mp (initially stopped) is generated, and two or more are designated (turned on). Thus, the moving route rt (rt1, rt2, etc.) of the generated moving ball mp is generated. That is, as shown in FIG. 4 (a), when the first designated ball dp1 is designated, it emits light weakly and a musical tone corresponding to the coordinates is continuously generated (steps S303 → S304 → FIG. 18). S309) Next, when the second designated ball dp2 is designated, it similarly emits light weakly, a moving route rt1 is generated, and continuous tone generation of the above musical tone is stopped (FIG. 4 (b), Steps S309 → S310 → S311 in FIG. Here, the movement route rt1 is set to a route that reciprocates on the straight line connecting the designated balls dp1 and dp2 with the shortest distance, and the matrix display unit mtLED does not always exist on the straight line. Also, the matrix display section mtLED that is close to the straight line is selected, and a substantially linear route is obtained. In addition, a moving ball mp is generated simultaneously with the generation of the moving route rt1. In the present embodiment, the moving ball mp is generated at the same position as the latest designated ball dp2, but other designated balls dp (for example, the oldest designated ball dp, here the designated ball dp1). ) May occur at the position.

  As long as the new designated ball dp is not designated or cancelled, the moving ball mp simply reciprocates between the designated balls dp1 and dp2 (steps S109 to S113 in FIG. 15). However, as shown in FIG. 4 (c), when a new designated ball dp3 is designated, it emits light weakly, and the travel route is regenerated, the original travel route rt1 disappears and a new travel route is created. rt2 is generated (steps S309 → S310 → S311 in FIG. 18). The moving route rt2 is a triangular route that circulates the designated balls dp1, dp2, and dp3 in the designated order. In this case, the moving ball mp becomes the moving ball mp that moves on the moving route rt2 from the time when the direction coincides with the moving direction defined by the moving route rt2. Note that each time a new designated ball dp is designated, the original moving ball mp may be extinguished and the moving ball mp may be regenerated at the position of the new designated ball dp3.

  Even when four or more designated balls dp are designated, the travel route rt is circulated in the designated order, but is not limited to this, so that the travel route rt itself does not intersect in the middle. Alternatively, the route may be formed in a polygonal ring shape and turn in a predetermined direction.

  Thereafter, as shown in FIG. 4D, the moving ball mp moves on the moving route rt2 toward the designated ball dp2 (steps S109 to S113 in FIG. 15). On the way, the matrix display part mtLED that is not in the designated state where the moving ball mp is located emits weak light one by one (step S123 in FIG. 16), and the matrix display part mtLED after passing through is gradually extinguished (step S112 in FIG. 16). ).

  When the moving ball mp reaches the position of one of the designated balls dp, for example, as shown in FIG. 4 (e), when the moving ball mp matches the designated ball dp2, the designated ball dp2 emits strong light and the corresponding pronunciation (Steps S113 → S116 → S122 → S134 → S124 in FIGS. 15 and 16), and the moving ball mp changes its direction according to the moving route rt2 (Step S113). The pronunciation in this case is based on the pronunciation data KC corresponding to the coordinates of the designated ball dp2.

  When the moving ball mp leaves the designated ball dp2, the designated ball dp2 is returned to weak light emission (step S115 in FIG. 15). Thereafter, the moving ball mp goes to the designated ball dp3 (FIG. 4 (f)). Note that the designated ball dp once designated can be arbitrarily canceled, and the designated ball dp whose designation has been canceled is extinguished (steps S304 and S305 in FIG. 18).

  By the way, in the random loop mode, the moving ball mp moves between the plurality of designated balls dp. A group of the plurality of designated balls dp is referred to as a “group”. In the present embodiment, there is no limit on the number of designated balls dp in a group, but there is one moving ball mp for one group. A plurality of moving balls mp may be generated in one group. In addition, the number of groups that can be controlled simultaneously may be plural (for example, eight). In this case, the processing related to the random loop mode is performed for each group. In addition, parameters such as timbre, pitch, tempo, etc. may be set independently for each group.

  FIG. 5 is a transition diagram of the matrix display input unit mt schematically showing the operation of the “two-point loop mode”. In the figure, an example in which “bounce mode” and “motion mode” are not set is shown.

  The setting mode and operation of the two-point loop mode are the same as the setting and operation up to the stage of designating the second designated ball dp in the random loop mode, except for the operation related to the generation of musical sound. That is, as shown in FIG. 5A, when the first designated ball dp1 is designated, it emits weak light (steps S318 → S324 → S325 in FIG. 19), and then the second designated ball dp2 is set. When designated, the light is similarly weakly emitted, and a movement route rt1 is generated (FIG. 5B, steps S318 → S324 → S325 → S326 → S327 in FIG. 19). Unlike the random loop mode, in the two-point loop mode, no sound is produced only by pressing one matrix display input section mt. Here, the setting mode of the moving route rt1 and the generating mode of the moving ball mp that occurs simultaneously with the generation of the moving route rt1 are the same as those in the example of FIG.

  Further, as shown in FIGS. 5B to 5C, when the third designated ball dp3 is newly designated, the oldest designated ball dp1 is extinguished and the designation of the designated ball dp1 is canceled. The movement route rt is corrected. As a result, the travel route rt1 disappears and a travel route rt2 is newly generated between the designated balls dp2 and dp3 (step S327 in FIG. 19). In this case, the moving ball mp that has moved on the moving route rt1 eventually protrudes from the matrix display input unit mt and disappears, as in the examples of FIGS. On the other hand, the moving ball mp is newly regenerated at, for example, the position of the designated ball dp3 on the moving route rt2.

  In addition, when the two designated balls dp constituting the two-point loop are called one “two-point loop group”, in this embodiment, the “two-point loop group” that can be generated simultaneously is limited to one. However, the present invention is not limited to this, and a plurality of “two-point loop groups” may be generated simultaneously in the matrix display input unit mt. In the case of such a configuration, for example, even when the third designated ball dp3 is newly designated in the state of FIG. 5B, the already generated travel route rt1 does not disappear, and the oldest designated ball dp1 The designation is not canceled. That is, the new third designated ball dp3 is regarded as the first designated ball dp constituting the second “two-point loop group”, and the subsequent designation of the new fourth designated ball dp4 When there is, the designated ball dp3 and the designated ball dp4 form a second “two-point loop set”, and a new movement route rt separate from the movement route rt1 is generated between the designated balls dp3 and dp4. Will be.

  Thereafter, as shown in FIGS. 5D to 5F, the moving ball mp reciprocates between the designated balls dp2 and dp3 on the moving route rt2. At that time, the matrix display unit mtLED that is not in the designated state emits weak light on the way along the movement route rt2, and is immediately extinguished (steps S109 to S115 in FIG. 15), and has reached the position of one of the designated balls dp. At that time, the designated ball dp emits strong light and a corresponding pronunciation is made (steps S113 → S116 → S122 → S134 → S124 in FIGS. 15 and 16), and the moving ball mp changes its direction according to the moving route rt2. This (step S113 in FIG. 15) is the same as that described in the example of FIGS. 4D to 4F in the random loop mode.

  Next, when the designation of the designated ball dp2 is canceled as shown in FIG. 5G in the state where the moving ball mp is moving toward the designated ball dp2 on the moving route rt2, the designated ball dp2 is quenched. At the same time, the designation is canceled and the movement route rt is corrected. As a result, the travel route rt2 disappears, and a travel route rt3 is newly generated on the extension of the designated ball dp2 (steps S328 → S329 → S330 in FIG. 19). At this time, the moving ball mp does not disappear and moves on the moving route rt3. Further, here, since the rebound mode is not set, as shown in FIG. 5H, the moving route rt3 disappears, and the moving ball mp is also a matrix display input unit on the extension of the moving route rt3. It disappears from mt (steps S116 → S132 → S117 → S119 → S121 in FIG. 16).

  FIG. 6 is a transition diagram of the matrix display input unit mt schematically showing the operation of the “bounce mode”. As described above, the rebound mode can be set in the random loop mode or the two-point loop mode. In the figure, the state where the number of designated balls dp remaining is one is taken as an example. The rebound mode can be set independently of the random loop mode or the two-point loop mode. For example, a moving ball mp and its moving route rt can be generated even if there is no designated ball dp. The ball mp may be rebounded.

  First, as shown in FIG. 6A, when the moving ball mp moves and coincides with the outer edge position on the left side of the matrix display input unit mt, that is, the outer edge coordinates (column of n = 1) (FIG. 5H). In this case, since the rebound mode is set, the rebound movement route rt1 is generated within the “predetermined rebound condition” (steps S116 → S132 → FIG. 16). S117 → S119 → S120). As a result, the moving ball mp does not protrude from the matrix display input unit mt, but is reflected inward at the left edge of the matrix display input unit mt, for example, at the same angle as the incident angle (FIG. 6B). Here, the “predetermined rebound condition” is, for example, that the rebound mode is set and, for example, the number of times the same moving ball mp has rebounded is a predetermined number of times or less. It can be changed. Further, by setting a predetermined rebound condition, the rebound may be continued indefinitely until the user gives a stop instruction, or may be stopped when it matches the designated ball dp.

  Similarly, when the moving ball mp coincides with the lower outer edge coordinates (k = 1 row) of the matrix display input unit mt, a rebound moving route rt2 is generated (step S120 in FIG. 16), and the moving ball mp is reflected. Further, when it coincides with the right outer edge coordinates (column of n = 16), the moving route rt3 is generated and the moving ball mp is reflected. The original travel route rt disappears each time.

  FIG. 7 is a transition diagram of the matrix display input unit mt schematically showing an operation when “rotation mode” is set in “motion mode” in addition to “random loop mode”.

  In the random loop mode, as shown in FIG. 7 (a), the moving ball mp circulates between the designated balls dp1, dp2, and dp3 as shown in FIG. 7 (a). When the instruction Ron is made, as shown in FIG. 7 (b), the rotation center P0 is obtained by calculation, and the group figure (designated balls dp1, dp2, dp3 and moving ball mp around the rotation center P0) ( Here, the triangle is rotated in the direction (counterclockwise) indicated by the rotation instruction Ron (steps S401 → S402 → S405 → S406 → S407 in FIG. 20). That is, the designated balls dp1, dp2, dp3 and the moving ball mp rotate while maintaining their relative positional relationship. At that time, the movement route rt between the designated balls dp1, dp2, and dp3 also rotates in the same manner. Accordingly, the movement of the movement ball mp on the movement route rt is continued in parallel. Hereinafter, in the motion mode (including the G sensor mode), such a figure that rotates or displaces integrally is referred to as a “group figure”.

  Here, the rotation instruction such as the rotation instruction Ron can be performed by successively pressing any at least two matrix switches mtSW within a predetermined time. For example, the user may trace the matrix display input unit mt with his / her finger near the end of the matrix display input unit mt, and the rotation direction is clockwise or counterclockwise with the two matrix switches mtSW turned on last. It is determined in one of the clockwise directions. For example, in the example of FIG. 7A, the counterclockwise direction is designated at two points of the matrix switch mtSW, a1 turned on first and a2 turned on last (last). In addition, the rotational speed of the group graphic is defined by the time difference between the two ON points. The rotation speed may be constant. Further, the rotation instruction method is not limited to this, and an instruction may be given by the panel switch 10 or the like.

  The rotation center P0 does not have to be any coordinate of the matrix switch mtSW, and is a virtual point corresponding to the center of gravity of the group figure. Further, when the group figure rotates, the trajectory through which each designated ball dp passes is circular in terms of calculation, but the actual position is the matrix display portion mtLED close to the circle in calculation.

  On the other hand, when the rotation stop instruction Roff is given as shown in FIG. 7C in a state where the group figure is rotating counterclockwise as shown in FIG. 7B, the rotation of the group figure is performed. Is stopped (FIG. 7D, steps S401 → S402 → S403 → S404 in FIG. 20). Similarly, the movement route rt stops rotating, and the movement of the movement ball mp on the movement route rt is continued. Here, the rotation stop instruction method such as the rotation stop instruction Roff is the same as the rotation instruction method, and the finger is traced in the same direction as the rotation of the group graphic. For example, in the example of FIG. 7C, rotation stop is instructed at two points, a3 turned on first and a4 turned on later. Note that when an operation in the opposite direction to the rotation of the group graphic is performed, the group graphic may be configured to rotate in the reverse direction.

  FIG. 8 is a transition diagram of the matrix display input unit mt schematically showing an operation when “G sensor mode” is set in “motion mode” in addition to “random loop mode”.

  The control target relating to the G sensor mode can be set as desired in step S103 of FIG. 15, and for example, the tempo, the coordinates of the group figure, or other parameters can be set as the control target. For example, when the control target is coordinates, the designated ball dp to the moving ball mp are displaced based on the change in acceleration in each direction of the X axis and the Y axis. The acceleration in each direction of the X and Y axes is generated not only when the performance device MC is moved and stopped in each direction, but also when the performance device MC is tilted under gravity.

  In the present embodiment, when the performance device MC is tilted by a predetermined amount or more at a predetermined speed or more in the left-right direction when viewed from the user side (when rotated to the left or right about the Y axis), the group figure is When the performance device MC is moved (displaced) leftward or rightward and tilted by a predetermined amount at a predetermined speed or more in the front-rear direction when viewed from the user side (the direction in which the front portion of the performance device MC is lowered about the X axis Or the group graphic is controlled to move forward or backward.

  For example, when the control target is a coordinate, as shown in FIG. 8A, in the random loop mode, the moving ball mp circulates between the designated balls dp1, dp2, and dp3 (FIG. 4D). ) To (f)), the front portion of the performance device MC is tilted downward. If the acceleration change due to the inclination (acceleration change in the Y-axis direction) is equal to or greater than a predetermined value, as shown in FIG. 8B, the designated balls dp1 to dp3 and the moving ball mp (including the moving route rt) are included. The group graphic is displaced forward (steps S408 → S409 → S410 → S411 → S414 in FIG. 20). That is, the designated balls dp1 to dp3 and the moving ball mp are displaced forward while maintaining the relative positional relationship with each other. At that time, the movement route rt between the designated balls dp1 to dp3 is similarly displaced, and therefore the movement of the movement ball mp on the movement route rt after the displacement is continued in parallel. When the forward rotation of the performance device MC is stopped, the acceleration change in the Y-axis direction disappears, so that the group figure stops moving.

  The same applies when the performance device MC is tilted to the right as viewed from the user. If the acceleration change in the X-axis direction is greater than or equal to a predetermined value, the group figure is moved to the right as shown in FIG. Displacement (step S414). Furthermore, when the right part and the rear part of the performance device MC are tilted downward, if the acceleration change in the X-axis and Y-axis directions is greater than or equal to a predetermined value, the group figure is obliquely rearward as shown in FIG. Displace to the right (step S414).

  Even in the “movement mode”, the movement of the moving ball mp on the movement route rt is continued in the group figure after the rotation is stopped or after the displacement is completed (steps S109 to S115, S122, S123, and S124 in FIG. 15). .

  FIG. 9 is a conceptual diagram showing the relationship between the matrix display input unit mt and the entire matrix area in the “music box mode”. In the music box mode, the designation and storage of the designated ball dp is not limited to the coordinates in the matrix display input unit mt, and can be performed on the coordinates of the entire matrix area MT. The entire matrix area MT has 16 rows in the Y-axis direction that are the same as the matrix display input unit mt, but there are 48 columns in the X-axis direction, which is three times the matrix display input unit mt. Accordingly, the entire matrix area MT has an area for three pages of the matrix display input section mt in the left-right direction.

  In the music box mode, the entire matrix area MT can be manually scrolled in the X-axis direction by rotating the encoder switch 18 or the like, and is in the area that coincides with the matrix display input section mt in the entire matrix area MT. The designated ball dp and the moving ball mp can be visually recognized from the user. In the music box mode, the designation of the designated ball dp can be accepted only in the matrix display input unit mt as in the other operation modes, but the designated ball that has been removed from the matrix display input unit mt by scrolling. The coordinate information of dp is also stored and can appear again on the matrix display input section mt by scrolling. The designated ball dp can be designated and canceled when the “automatic scroll mode” is not set. In the music box mode, each process is performed for each row (k).

  For example, as shown in FIG. 9A, when the designated balls dp1, dp2, and dp3 are designated in the matrix display input unit mt, they emit light weakly while the designated balls dp whose designation has been canceled are quenched (FIG. 21). Steps S508 to S511). Thereafter, as shown in FIG. 9B, when the entire matrix area MT is scrolled to the left by the manual scroll operation, the entire matrix area MT is moved to the left relative to the matrix display input unit mt. . As a result, the positions of the designated balls dp2, dp3 in the matrix display input unit mt are displaced to the left, and the designated ball dp1 is removed from the matrix display input unit mt. At that time, if it is not “manual scroll mode”, no sound is generated (steps S512 → S513 → S514 in FIG. 21), but if it is “manual scroll mode”, the left and right edges (sound generation strings) are described as described later. P is pronounced (steps S512 → S513 → S515 in FIG. 21).

  Further, when the designated balls dp4 and dp5 are newly designated in the matrix display input unit mt, they emit light weakly (steps S508 → S509 → S511 in FIG. 21) and are stored as the designated balls dp in the entire matrix area MT.

  FIG. 10 is a transition diagram of the matrix display input unit mt schematically showing the operation in the “automatic scroll mode” of the “music box mode”.

  In the automatic scroll mode, by designating the left or right scroll direction, a movement route rt directed in the designated direction is generated for all the designated balls dp in the entire matrix area MT. The automatic scroll mode is set and the direction is instructed by, for example, the panel switch 10. For example, when a rightward scroll is instructed, as shown in FIG. 10A, moving routes rt1 to rt5 directed to the right starting from the positions of the designated balls dp1 to dp5 are generated (step S501 in FIG. 21 → As shown in S502) and FIG. 10B, the moving balls mp1 to mp5 corresponding to the designated balls dp1 to dp5 move to the right (steps S109 to S114 in FIG. 15). In this case, each moving ball mp moves with weak light emission (steps S116 → S122 → S123 in FIG. 16), but the designated ball dp is quenched (steps S114 and S112 in FIG. 15).

  When the scroll direction is rightward in the automatic scroll mode, the rightmost column of the matrix display input unit mt is the pronunciation column P. Therefore, for example, as shown in FIG. 10 (c), when the moving ball mp1 reaches the right edge (column of n = 16) of the matrix display input unit mt, the moving ball mp1 emits strong light and at that position. Corresponding pronunciation is made, and the moving route rt1 of the moving ball mp1 is cleared (steps S116 → S132 → S117 → S118 in FIG. 16). The moving ball mp1 also leaves the matrix display input unit mt.

  Similarly, for the moving balls mp4 and mp5 that next reach the sound generation row P, strong light emission and corresponding sound generation are performed, and the corresponding movement routes rt4 and rt5 are cleared (FIG. 10 (d)). When the direction of automatic scrolling is to the left, the leftmost column of the matrix display input unit mt is the pronunciation column P, and other operations are also symmetric with respect to the right scrolling.

  Note that the designated ball dp existing in the entire matrix region MT is a target for generating the movement route rt as described above even if it does not appear in the matrix display input unit mt. In some cases, the corresponding moving ball mp appears on the matrix display input unit mt from the left side of the matrix display input unit mt, emits strong light at the right edge of the matrix display input unit mt, and disappears to the right side. Each moving ball mp may once disappear to the right and then appear again in the matrix display input unit mt from the left, and may be configured to circulate the matrix display input unit mt any number of times.

  FIG. 11 is a transition diagram schematically illustrating the relationship between the matrix display input unit mt and the entire matrix area in the “manual scroll mode” of the “music box mode”.

  As shown in FIG. 11A, it is assumed that designated balls dp1 to dp4 are designated on the entire matrix region MT. In such a state, when manual scrolling to the right is instructed, the rightmost column of the matrix display input unit mt is set to the pronunciation column P, and the entire matrix area MT is relatively set to the matrix display input unit mt. Move to the right. In this case, the designated ball dp that moves together with the entire matrix area MT is recognized in the same way as the moving ball mp. However, unlike the other operation modes, the movement route rt is not generated, so dp (mp ). First, when the designated ball dp1 (mp1) reaches the sound generation string P, the designated ball dp1 emits strong light and a sound corresponding to the position is produced (steps S512 → S513 → S515 in FIG. 21). Similarly, for the designated ball dp2 (mp2) that reaches the sound generation string P next, strong light emission and corresponding sound generation are performed (FIG. 11 (c)).

  In the manual scroll mode, the scroll direction can be changed even during the completion of the scroll. When the direction is changed, the relative movement direction of the entire matrix area MT with respect to the matrix display input unit mt is switched and the sound is generated. The column P is also switched to the opposite side.

  FIG. 12 is a diagram schematically showing the relationship between the performance data and the matrix display input unit mt in the “automatic drawing mode”. FIG. 13 is a transition diagram of the matrix display input unit schematically showing the operation of the “automatic drawing mode”.

  As shown in FIG. 12, in the automatic drawing mode, a predetermined one track (for example, a melody part track) among a plurality of tracks in the performance data to be performed is every predetermined number of bars (for example, four bars). Each section is divided into one page (step S701 in FIG. 23). Then, as the performance progresses, the page to be sounded is subject to sound generation and light emission control in the matrix display input unit mt. In the example shown in the figure, the performance data is divided from the first page to the Wth page, and immediately after switching from the second page to the third page, the leftmost column of the matrix display input unit mt is the pronunciation column P. It has become.

  At the start of performance, a movement route rt of the movement ball mp is generated for all pages (step S602 in FIG. 22, FIG. 23). That is, for each page, designated balls dp (dp1 to dp13) are set on the matrix display input unit mt corresponding to the included pronunciation instruction data (sound generation event data), and this constitutes the movement route rt. Points (coordinates) are set (step S704 in FIG. 23). In this case, the movement route rt follows the designated ball dp existing in each column n, but the Y coordinate of the point of the column n where the designated ball dp does not exist exists before and after that column 2 It is set as an intermediate value between the two k values of the two designated balls dp. If the intermediate value is not an integer, the coordinate in the Y-axis direction is set to the integer value obtained by rounding off the first decimal place of the intermediate value (step S709 in FIG. 23).

  In the automatic drawing mode, the moving ball mp moves on the moving route rt in parallel with the pronunciation string P sequentially moving to the right (steps S110 to S113 in FIG. 15). At that time, when the moving ball mp advances the coordinates that do not coincide with the designated ball dp, weak light is emitted (steps S122 → S123 in FIG. 16). The moving ball mp may be controlled so as not to emit light. When the moving ball mp matches the designated ball dp, as shown in FIG. 13A, the designated ball dp (dp6) emits strong light and a sound corresponding to the position is generated (step in FIG. 16). S134 → S135 → S124). In parallel with this, drawing route data drt corresponding to the designated ball dp is generated and stored (step S804 in FIG. 24). Note that, along with the movement of the moving ball mp, the sound generation instruction data of other tracks in the performance data other than the track set as the performance target page is also generated (step S803 in FIG. 24). You may make it cancelable by selecting.

  The drawing route data drt includes elements such as a drawing display mode, that is, a drawing shape, a drawing change speed, a drawing maximum range, etc., which can be arbitrarily set by the user. Each can be set based on one or a plurality of parameters relating to musical tone such as tempo information and on-velocity of a sounding event. In the present embodiment, as an example, dynamic display (predetermined drawing display) is performed such that a square display expands with time. The speed of the drawing change is set based on tempo information in the performance data, and the maximum drawing range is not particularly limited and is within the displayable range of the matrix display input unit mt.

  The drawing route data drt is data for sequentially displaying different quadrangular drawing or the like at each drawing update timing, for example, as shown in FIG. 13 (b) → (c) → (d). That is, as shown in FIGS. 13A to 13D, the drawing display corresponding to the target designated ball dp is enlarged according to the drawing route data drt every time the drawing update timing comes. (Steps S901 → S902 → S903 → S904 → S905 in FIG. 25). The drawing update timing is defined by a timing signal transmitted in a timing signal transmission process of FIG. 17 described later, and is, for example, a drawing update timing every time a tem × 4/16 signal described later is transmitted. During the drawing, the designated ball dp is extinguished (step S904), but the light emission may be maintained.

  Then, when the moving ball mp moves on the moving route rt with the movement of the pronunciation string P and matches the next designated ball dp, as shown in FIG. 13 (e), the next designated ball dp (dp7) is obtained. Similarly, a strong light is emitted and a sound corresponding to the position is generated, and drawing corresponding to the next designated ball dp is similarly performed (steps S901 to S905 in FIG. 25). At this time, the drawing displayed so far (the one corresponding to the designated ball dp6) is deleted (step S903). In addition, although the designated ball dp that has already passed the pronunciation sequence P and the sound generation timing has passed is extinguished (step S112 in FIG. 15), weak light emission may be maintained.

  FIG. 14 is a transition diagram of the matrix display input section schematically showing the operation of the “real time drawing performance mode”.

  In the real-time drawing / playing mode, the same drawing display as that displayed in the automatic drawing mode is performed according to the user's operation, not along the automatic playing. That is, when a certain matrix display input section mt is turned on, the matrix display section mtLED corresponding to the matrix display input section mt emits weak light (FIG. 14A, steps S1002 to S1003 in FIG. 26), and the matrix display input is further performed. When the part mt is continuously turned on for a predetermined time TA (for example, 1 second), the matrix display part mtLED around the matrix display input part mt emits weak light, and the turned-on matrix display input part mt is designated. The ball dp (designated ball dp8) is set (FIG. 14B, steps S1005 to S1010 in FIG. 26).

  After that, when the designated ball dp8 is turned off, the drawing route data drt is generated and stored on the condition that the corresponding pronunciation or the like is not yet made, and each time the drawing update timing comes, a rectangle or the like is drawn according to the drawing route data drt. 14 is enlarged (FIGS. 14C and 14D, steps S1011 → S1012 → S1013 → S1014 → S1015 in FIG. 26, steps S901 to S905 in FIG. 25).

  Next, processing in various operation modes will be described based on the flowcharts of FIGS.

  15 and 16 are flowcharts of the main process in the present embodiment. In the present embodiment, the pronunciation of the pronunciation data KC corresponding to each matrix switch mtSW is the main performance object, but the combination of the coordinates of the designated ball dp, the movement route rt, and the operation mode that define the pronunciation operation. The sequence data for generating the pronunciation data KC is hereinafter referred to as “matrix performance data” in order to distinguish it from general automatic performance data such as the SMF (standard MIDI file) format. The matrix performance data may include information such as tempo values and instrument sounds corresponding to the matrix switches mtSW. The matrix performance data is stored in the storage device 6 or the like in steps S314 and S315 of FIG. 18 to be described later. In steps S316 and S317, the stored or received data is read out to the performance device MC. Set as playback target.

  First, initial setting is performed (step S101), and if there is an input from the panel switch 10, setting is performed according to the input (steps S102 and S103). For example, mode setting, instrument sound setting for each column n, setting of tem value for defining performance speed, and the like are performed. Here, it is also possible to set a mode for receiving performance data such as SMF from the outside and playing it. In this case, the tem value is automatically set according to the tempo signal of the performance data transmitted. You may do it. Alternatively, when matrix performance data is received from the outside, if a tempo value is set in the matrix performance data, the tem value may be set accordingly.

  Next, processing such as automatic performance input acceptance shown in FIGS. 18 and 19 described later is executed (step S104), and real-time drawing performance processing shown in FIG. 26 described later is executed (step S137), which is set as a reproduction target. It is determined whether or not there is other performance data (such as SMF other than matrix performance data) (step S105), and if there is other performance data, sound generation processing of the performance data is executed (step S106). This performance data is separate from the sound production data KC, and can be made independently or in parallel with the sound production in the various operation modes. In step S106, when matrix performance data is read and set in step S317, sound generation processing of performance data such as MIDI stored in advance in association with the matrix performance data is also performed. it can.

  Next, it is determined whether or not the operation mode is the “sequential sounding mode” described above (step S107). If the operation mode is not the “sequential sounding mode”, the process immediately proceeds to step S131. After the sequential sound generation mode processing is executed as described above (step S108), the process proceeds to step S131. In step S131, it is determined whether or not the automatic drawing mode stop flag dF is set to “1”. Here, the automatic drawing mode stop flag dF is a flag indicating “1” to stop the performance in the automatic drawing mode, and is set to “1” in step S604 of FIG. If dF = 1, the process immediately ends. If dF = 1 is not satisfied, the process proceeds to step S109.

  In step S109, it is determined whether or not the travel route rt has been generated. If it has not been generated, the process returns to step S102. If it has been generated, it is determined whether or not it is the step timing (T = 0). It discriminate | determines (step S110).

  FIG. 17 is a flowchart of timing signal transmission processing. This process is executed at regular time intervals by a timer process.

  In this process, the counter value T is incremented every time until T = tem (step S201). During T = tem, when T = tem × 1/16, a 1/16 signal is transmitted (steps S202 and S203). Thereafter, every time the counter value T increases by tem × 1/16. 2/16 signal, 3/16 signal, 4/16 signal... 15/16 signal are sequentially transmitted (steps S204 to S211). When T = tem is reached, a “0” signal is transmitted (steps S212 and S213), the counter value T is reset to “0” (step S214), and the process is terminated.

  Returning to FIG. 15, if it is the step timing in step S110, it is determined whether or not the position of the current moving ball mp matches the position of the designated ball dp (step S111). If there is not, the moving ball mp is moving on a position that is not the designated ball dp on the moving route rt. Therefore, after the matrix display part mtLED of the current coordinates of the moving ball mp is extinguished (step S112), the moving route The moving ball mp is incremented by one on rt (see step S113, FIGS. 4D to 4F, FIG. 5D, etc.). Thereby, the matrix display part mtLED immediately after the moving ball mp leaves is extinguished. On the other hand, if the two match in step S111, it is determined whether or not the operation mode is the automatic drawing mode or the music box mode (step S114). The matrix display unit mtLED at the current coordinates of the ball mp (which is also the designated ball dp) is caused to emit light weakly (step S115), and then the moving ball mp is advanced by one on the moving route rt (step S113). In other words, when neither the automatic drawing mode nor the music box mode is set, when the moving ball mp leaves the designated ball dp after the designated ball dp coincides with the designated ball dp, the designated ball dp is caused to emit weak light and this is continued.

  However, if the automatic drawing mode or the music box mode is set in the step S114, the moving ball mp is separated from the designated ball dp because the automatic drawing mode or the automatic scroll mode in which the moving route rt is generated. Thereafter, the process proceeds to step S112 in order to extinguish the designated ball dp (see FIG. 10B).

  Next, it is determined whether or not the moving ball mp matches the outer edge coordinates in the matrix display input unit mt (step S116). The outer edge coordinates are coordinates included in the upper and lower end portions or the left and right end portions, that is, in any of the first and 16th rows (k = 1, 16), the first, and 16th columns (n = 1, 16). . As a result of the determination, if the moving ball mp does not match the outer edge coordinates, it is determined whether or not the moving ball mp matches the designated ball dp (step S122), and if the moving ball mp does not match the designated ball dp Since the moving ball mp is moving on the moving route rt at a position that is not the designated ball dp, the moving ball mp emits light weakly (step S123, FIGS. 4D, 4F, and 5D). Etc.). Thereby, the moving ball mp moves while weakly emitting light. Thereafter, a drawing control process of FIG. 25 described later is executed (step S136), and the process returns to step S102.

  On the other hand, if the moving ball mp matches the designated ball dp, it is determined whether or not the operation mode is the automatic drawing mode (step S134). If it is not the automatic drawing mode, the process proceeds to step S124. If there is, a sound generation, light emission, and drawing route generation process shown in FIG. In step S124, the moving ball mp to the designated ball dp are made to emit strong light and sound is generated based on the corresponding sound data KC (see FIGS. 4 (e) and 5 (e)). Thereafter, the step S136 is executed, and the process returns to the step S102.

  On the other hand, if the result of the determination in step S116 is that the moving ball mp matches the outer edge coordinates, it is determined whether or not the operation mode is the automatic drawing mode (step S132). On the other hand, if the automatic drawing mode is selected, the page is switched to the next section (step S133) (see FIG. 12), and the process proceeds to step S117.

  In steps S117 to S121, sound generation of the moving ball mp, strong light emission processing, generation processing of the rebound movement route rt, clearing processing of the movement route rt, and the like in the automatic scroll mode of the music box mode are executed. Here, “F1” in step S117 is a flag indicating that the automatic scroll mode is set to “1”, and is set in steps S502, S504, and S506 in FIG.

  18 and 19 are flowcharts of processing such as automatic performance input acceptance executed in step S104 of FIG. First, it is determined whether or not the set operation mode is a rotation mode among the motion modes (step S301). Otherwise, it is determined whether or not the operation mode is a random loop mode (step S301). S302), in the case of the random loop mode, in steps S303 to S311, an on-event is received, the designated ball dp is designated and dedesignated, and they are weakly lit and extinguished, a moving route for the random loop mode Processing for generating rt, processing for correcting (reconnecting) or clearing the movement route, and the like are performed.

  If the operation mode is not the random loop mode as a result of the determination in step S302, it is determined whether or not the operation mode is the two-point loop mode (step S318). In the case of the two-point loop mode, in steps S324 to S330, an on event and an off event are received, the designated ball dp is designated and dedesignated, and the two designated balls are subjected to weak light emission and quenching. A process of generating a travel route rt between dp, a process of correcting the travel route rt, and the like are performed.

  If it is determined in step S318 that the operation mode is not the two-point loop mode, it is sequentially determined whether the operation mode is the music box mode or the sequential sound generation mode (steps S319 and S321). If the music box mode is selected, the music box mode process of FIG. 21 described later is executed (step S320). If the sound generation mode is the sequential sound generation mode, the above-described sequential sound generation mode input reception process is executed (step S322). Otherwise, it is determined whether or not the operation mode is the automatic drawing mode (step S331). If the automatic drawing mode is not set, the process proceeds to step S323. If the automatic drawing mode is set, the automatic drawing mode process of FIG. 22 described later is executed (step S332), and the process proceeds to step S323. In step S323, Other processing (processing in other modes, etc.) is executed. Thereafter, the process proceeds to step S312.

  If it is determined in step S301 that the rotation mode is set, the process proceeds to step S312. Also, if there is no ON event in step S303, the process proceeds to step S312.

  In step S312, it is determined whether or not the motion mode is set as the operation mode. Only when the motion mode is set, the motion mode process of FIG. 20 described later is executed (step S313). Next, it is determined whether or not there is a storage instruction (step S314), and only when there is a storage instruction, the designated ball dp and the movement route rt are stored as matrix performance data corresponding to the current operation mode (step S314). Step S315). Next, it is determined whether or not there is an instruction to read performance data (including matrix performance data) (step S316), and only when there is an instruction to read, the performance data indicated by the instruction is read out to the performance device MC. It is set for reproduction (step S317), and this process ends.

  FIG. 20 is a flowchart of the motion mode process. In this motion mode process, in the case of the rotation mode, the rotation center P0, the rotation direction, and the rotation speed are calculated according to the rotation instruction Ron, the group figure is rotated, and according to the rotation stop instruction Roff. Then, processing for stopping the rotation is performed (steps S402 to S407). In the G sensor mode, the tempo, coordinates, and the like are controlled, and processing such as changing the tem value and displacing the group figure is performed according to changes in acceleration (steps S409 to S414).

  FIG. 21 is a flowchart of the music box mode process executed in step S320.

  In steps S501 to S506, processing for setting and canceling the automatic scroll mode, reception of the setting instruction for the manual scroll mode, generation processing of the movement route rt in the automatic scroll mode, and the like are performed. In steps S507 to S515, an on event and a scroll instruction are received, and processing corresponding to them is performed. Here, in step S502, the flag F2 is a flag indicating "1" indicating that the manual scroll mode is set.

  FIG. 22 is a flowchart of the automatic drawing mode process executed in step S332 of FIG.

  First, it is determined whether or not there has been a start instruction or a stop instruction in the automatic drawing mode in which performance is performed while drawing (steps S601 and S603). If there is an instruction to start the automatic drawing mode, the movement shown in FIG. A route generation process is executed (step S602), and if there is a stop instruction, the process proceeds to step S604.

  FIG. 23 is a flowchart of the movement route generation process executed in step S602 of FIG. First, in order to obtain a new sound generation target page in the matrix display input unit mt from a predetermined track in the performance data to be played, performance data for a section of four bars is newly acquired ( Step S701), “1” is set to the register value N (Step S702).

  Next, it is determined whether or not the obtained performance data includes sound generation instruction data corresponding to the N column (step S703). If there is sound generation instruction data, the N value corresponds to the sound generation instruction data. From the Y coordinate (k value), the coordinate (N, k) is designated as the designated ball dp on the current page and also set as a point constituting the moving route rt (step S704), and the process proceeds to step S710.

  On the other hand, as a result of the determination in step S703, if there is no pronunciation instruction data corresponding to the N column, in step S705 to 709, an intermediate point group connecting the designated balls dp is set as a point constituting the moving route rt. Process. That is, the current N value is set in the register value m (step S705), and the m value is incremented by 1 until the m column becomes a column in which the sound generation instruction data exists (steps S706 and S707). That is, the next line in which the designated ball dp exists is searched. If there is pronunciation instruction data corresponding to the m column, Y (rt) that defines the Y coordinate of the intermediate point is obtained by the following mathematical formula 1.

[Equation 1]
_{Y (rt) = Y N-} 1 + (Y m -Y N-1) / (m- (N-1))
Then, from the m value and the Y (rt) value, an approximate point of (m, Y (rt)) is set as a point constituting the moving route rt (step S709). For example, in the example of FIG. 12, since there is no corresponding pronunciation instruction data (designated ball dp) in the n = 4th column, in calculating the Y (rt) value at m value = 4, the designated ball is used. The coordinates of the k = 6th row, which is the middle position in the Y direction, between dp3 and the designated ball dp4 are Y (rt) values. As an approximation point of (m, Y (rt)), for example, as described above, when the Y (rt) value is not an integer, an integer value obtained by rounding off the first decimal place of the Y (rt) value is represented by Y ( rt) The point specified by substituting the value. In place of rounding off, the first decimal place may be rounded up or rounded down.

  The processes in steps S701 to S709 are repeated until N reaches 16 (16 is the maximum value of n) (step S710), and the points set in steps S704 and S709 are connected to exemplify in FIG. Such a movement route rt for one page is generated.

  When N> 16, it is determined whether or not there is unprocessed data among the performance data to be played (step S711), and the processes of steps S701 to S710 are performed until there is no unprocessed data. By repeating, the designated balls dp for all pages, the setting and the generation of the moving route rt are performed, and all of these are stored in association with the performance data to be played (step S712). The process ends.

  The designation and movement route rt of the designated ball dp generated and stored in this process becomes a part of data used for control of movement light emission, sound generation processing, etc. of the movement ball mp in the processing after step S109 in FIG. .

  Returning to FIG. 22, in step S604, the current page movement route rt is maintained, the automatic drawing mode stop flag dF is set to “1”, and the process proceeds to step S605. If there is an instruction to create performance data in step S605, an on event is accepted in steps S606 to 609, and processing corresponding thereto is performed. That is, when a ball other than the designated ball dp is turned on, it is made to emit light weakly to be in a designated state. On the other hand, when the designated ball dp is turned on, it is extinguished and the designated state is released.

  Next, in step S610, if there is a page switching instruction, page switching is performed (step S611). Until there is a performance data completion instruction (step S612), the processes in steps S606 to S611 are repeated to provide the completion instruction. If this is the case, the process ends. The performance data completed here is stored in step S315 in FIG. 18, and can be read out in step S317 to be played back.

  FIG. 24 is a flowchart of the sound generation, light emission, and drawing route generation processing executed in step S135 of FIG.

  First, it is determined whether or not there is a drawing currently being displayed (step S801). If not, the process proceeds to step S803. If there is, the drawing currently being displayed is stopped and the current drawing route is cleared (drawing). The route data drt is cleared) (step S802), and the process proceeds to step S803. In the example of FIG. 13, as shown in FIG. 13 (e), when the moving ball mp matches the designated ball dp7, the drawing corresponding to the designated ball dp6 displayed until then (FIG. 13 (d)). (Reference) is deleted, and the drawing route data drt for that is also cleared. Note that the drawing currently being displayed may be continued until it is projected from the matrix display input unit mt without stopping.

  In step S803, sound generation control of sound generation instruction data of tracks other than the track set as the performance target page is executed according to the performance data. As described above, the sound generation and light emission control of the designated ball dp itself corresponding to the drawing display is performed in step S124 in FIG.

  Next, drawing route data drt corresponding to the new designated ball dp reached by the moving ball mp this time is generated and stored (step S804), and this processing is terminated. Here, in the present embodiment, as described above, for example, the drawing shape is a rectangle and the maximum drawing range is within the displayable range of the matrix display input unit mt according to the setting by the user in step S102 in FIG. It is said. The speed of the drawing change, that is, the speed at which the quadrangle expands is the transmission interval of the tem × 4/16 signal. It should be noted that the drawing change may be set so as to be faster as the on-velocity is larger, and by doing so, it is natural in terms of feeling. For that purpose, for example, as the timing signal used for the drawing update timing, a timing signal having a shorter generation interval may be adopted as the on-velocity value is larger.

  FIG. 25 is a flowchart of the drawing control process executed in step S136 of FIG. First, it is determined whether drawing route data drt has been generated (step S901). If it has been generated, it is determined whether it is a drawing update timing (whether a tem × 4/16 signal has been transmitted). If it is the drawing update timing (step S902), the current drawing display light emission is extinguished (step S903). This process is a process for changing the drawing display (here, the rectangle is enlarged). In the example of FIG. 13, when the drawing update timing comes in the state shown in FIG. In drawing and displaying the quadrangle shown in FIG. 13C, first, the quadrilateral drawing display shown in FIG. 13B is deleted.

  Next, in step S905, the next drawing display is performed according to the drawing route data drt corresponding to the designated ball dp, and this process is terminated. In this way, the drawing display changes sequentially at each drawing update timing (see FIGS. 13A to 13D).

  FIG. 26 is a flowchart of the real-time drawing performance process executed in step S137 of FIG.

  First, it is determined whether or not the operation mode is the real-time drawing performance mode (step S1001). If the operation mode is the real-time drawing performance mode, it is determined whether an on event, that is, whether any matrix display input unit mt has been pressed. If there is an ON event, the matrix display unit mtLED corresponding to the matrix display input unit mt emits light weakly (step S1003, FIG. 14A), and the time after the ON event has occurred. Measurement is started (step S1004), and it is determined whether or not the measured time has passed the predetermined time TA (step S1005). Here, when the plurality of matrix display input units mt are in the ON state, the time is measured for each matrix display input unit mt.

  As a result of the determination, when the measured time has passed the predetermined time TA, the measurement time is cleared (step S1006), the corresponding matrix display unit mtLED is extinguished (step S1007), and the matrix display unit mtLED The matrix display parts mtLED in the periphery (eight in this embodiment forming a square) are caused to emit light weakly (step S1008, FIG. 14B). Further, the real-time drawing start flag stF is set to “1” (step S1009), the matrix display input part mt is designated as the designated ball dp (step S1010), and this process is terminated.

  On the other hand, if there is no on event in step S1002, it is determined whether or not there is an off event (step S1011). The off event here means that the pressing of the matrix display input unit mt that has already been pressed in this process is released. If there is no off event, the process proceeds to step S1005. On the other hand, if there is an off event, it is determined whether or not a corresponding pronunciation is made with respect to the turned-off matrix display input unit mt (step S1012).

  As a result of the determination, if the corresponding pronunciation is made, the process proceeds to step S1005. If not, the matrix display part mtLED corresponding to the turned-off matrix display input part mt is made to emit light strongly. Sound generation is performed based on the corresponding sound generation data KC (step S1013). That is, if the turned-off matrix display input unit mt has already been designated as the designated ball dp and the sound generation processing has already been performed due to the coincidence with the moving ball mp in step S124 in FIG. The process proceeds to step S1005 without performing strong light emission processing.

  After the processing in step S1013, it is determined whether or not the real-time drawing start flag stF indicating “1” that drawing display can be started in the real-time drawing performance mode is set to “1” (step S1014). When stF = 1, the drawing route data drt corresponding to the designated ball dp turned off this time is generated and stored in the same manner as in step S804 in FIG. 24 (step S1015), and the process proceeds to step S1005. If not stF = 1, the process immediately proceeds to step S1005.

  Also in this real-time drawing performance mode, drawing display is performed based on the drawing route data drt by the drawing control process executed in step S136 (FIG. 25) of FIG. 16 as in the automatic drawing mode.

  According to this real-time drawing / playing mode, since the quadrangle is enlarged starting from the position operated by the user, a dynamic and visually interesting two-dimensional display can be performed in real time.

  In step S1012, the matrix display input unit mt that has been turned off is controlled so as not to produce a sound even if there is an off event, but the corresponding sound is being produced. Even if it exists, you may control to sound when there exists an off event.

  According to the present embodiment, when a timing element is assigned to the column n of the matrix-like matrix display input unit mt, and the designated ball dp exists in the pronunciation row P that moves as the performance progresses, it corresponds to the designated ball dp. Since the drawn display is performed, a two-dimensional display having visual interest can be performed by the drawn display corresponding to the passage of time and coordinates. In addition, a sound element corresponding to the coordinates is assigned to the row k, and a musical sound corresponding to the designated ball dp is generated, so that a drawing display is performed in conjunction with the sound of a melody or the like. Therefore, it is possible to perform a novel way of enjoying not only listening but also enjoying the sound by drawing and displaying in conjunction with the generation of the musical sound. For example, if an illumination-like display is performed while listening to music, a healing effect can be obtained. Furthermore, since the drawing display is a dynamic display that changes with time, a more interesting display can be performed.

  In the automatic drawing mode, among the rows and columns of the matrix display input unit mt, the timing elements are assigned to the columns and the sound generation elements are assigned to the rows. However, the assignment may be reversed.

  In the automatic drawing mode, the configuration in which only one designated ball dp exists in one column is illustrated. However, the configuration is such that two or more designated balls dp are allowed, and the two or more designated balls dp are included. You may comprise so that the drawing display corresponding to can be performed simultaneously. In that case, two or more tracks may be set as the target of drawing display. In such a case, the tracks are made different by changing the drawing display mode (emission color, shape, etc.) for each track. You may make it distinguishable.

  In the automatic drawing mode or the real-time drawing performance mode, examples of the drawing shape include triangles, circles, rhombuses, and x in addition to the above-described rectangles, but are not limited thereto. Further, what is drawn and displayed is not limited to a graphic one, and may be a character, a number, or the like, and their position may not be based on the position of the corresponding designated ball dp. In the drawing display, it is not essential to emit a plurality of light from the matrix display unit mtLED, and it may be performed by causing at least one to emit light. Furthermore, although the drawing display is dynamic, it may be static. The drawn display may be variously expressed not only by the presence / absence of light emission but also by light emission luminance, light emission color, or a combination thereof.

  Further, according to the present embodiment, in the random loop mode and the two-point loop mode, when a plurality of designated balls dp are designated in the matrix display input unit mt, a moving route rt is generated and a moving ball mp is generated, and a moving ball is generated. mp moves on the moving route rt with weak light emission, and when it matches the designated ball dp, it emits strong light and a corresponding pronunciation is made. In particular, the sound generation data KC is associated with each matrix switch mtSW, and different musical sounds can be generated according to the coordinates. Also, the movement of the moving ball mp can be recognized and enjoyed by the movement of light and the change of sound. Therefore, a novel way of playing with both visual and auditory elements becomes possible, and an interesting performance with game characteristics can be realized. Further, the designated ball dp can be added or removed, and the movement route rt is corrected accordingly, which is more interesting. In addition to the sequential sound generation mode, various operation modes including a bounce mode, a motion mode, etc. are provided.

  In the movement mode, it is possible to realize an interesting and dynamic game by rotating or displacing the designated ball dp or the like by changing the tempo or the like by rotating instructions or by tilting or moving the performance device MC itself. it can.

  Further, according to the present embodiment, in the music box mode, the designated ball dp can be designated and stored for the entire matrix area MT, and the moving ball mp is pronounced by the pronunciation string P, thereby interlocking with the movement of the coordinates. It is possible to produce sounds that can be played with fun. In particular, since the entire matrix area MT has a size that can encompass the area of the matrix display input section mt, the performance of one unit can be lengthened and a longer melody performance can be achieved.

  In each operation mode according to the present embodiment, it is possible to appropriately change the state in which sound generation and light emission are performed. For example, either the light emission or the sound generation of the matrix display unit mtLED may be completely excluded by the mode setting. Alternatively, if the pronunciation based on the pronunciation data KC corresponding to the current position of the moving ball mp is sequentially performed, for example, when the moving ball mp is rising, the pronunciation pitch is also increased, and only the sound is moving ball. Not only can the movement state of mp be recognized, but the presence is also interesting and interesting. Note that the musical sound generated in response to the matrix switch mtSW is not limited to a single sound, and may be a predetermined short melody or chord.

  Further, when a musical sound is generated during the movement process of the moving ball mp, the musical sound is not limited to that based on the sound generation data KC corresponding to the matrix switch mtSW. For example, a predetermined predetermined musical sound is input to the moving ball mp. You may sound uniformly regardless of the current position.

  When storing the designated ball dp, the moving ball mp, etc., the coordinates may be stored as absolute values, or may be stored as relative positions based on some coordinates.

  In the random loop mode or the two-point loop mode, when there are a plurality of groups, when the moving balls mp of different groups intersect in the moving process, the moving balls mp may emit or emit sound. .

  In the random loop mode or the two-point loop mode, the moving route rt generated between the designated balls dp may not be linear, and may be a curve or a predetermined meandering curve according to a predetermined rule.

  In the two-point loop mode, one group is configured with two specified balls dp. However, for example, one group may be configured with three or more specified balls dp. In this case, for example, when the designated balls dp1 to dp3 are designated as the same group, the moving route rt1 is moved between the designated balls dp1 and dp2, the moving route rt2 is moved between the designated balls dp1 and dp3, and the designated balls dp2 and dp2 are moved. A movement route rt may be generated between all designated balls dp, such as a route rt3.

  In the music box mode, the length of the entire matrix area MT is not limited to three pages of the matrix display input section mt, but may be longer. Further, the entire matrix region MT does not necessarily have to extend only in the lateral (X-axis) direction, and the shape is not limited. For example, the vertical (Y-axis) direction may be widened so that it can be scrolled vertically or obliquely. In the sequential sound generation mode, the designated ball dp can be designated within the entire matrix area MT so that a longer performance can be performed.

  The performance of the user may be recorded as an SMF file in real time using the matrix display input unit mt of the performance device MC. In this case, the length of the music is not limited to the number of columns of the matrix display input unit mt, and it is preferable that a sufficient length can be recorded. The recorded SMF file can be sent to the outside, and it is desirable that the recorded SMF file can be arbitrarily reproduced later using the performance device MC.

  In a battle-type game that is performed by connecting to another performance device MC with the connection cable 30, the moving ball mp may be configured to be able to exchange with the performance device MC on the other side. Further, group graphics may be exchanged together, and it is more interesting if the group graphics can be exchanged while maintaining operations such as rotation in the motion mode.

  Note that the matrix performance data stored in steps S314 and S315 in FIG. 18 can be transmitted / received to / from the opponent performance device MC in the battle-type game, and is temporarily stored in the storage medium 17 via the communication I / F 7. It can be stored and uploaded to a content server on the Internet via a personal computer, and vice versa.

  When the performance music is switched, for example, when two or more matrix performance data are instructed to be reproduced continuously, at the end of the first music, the plurality of designated balls dp designated in the first music are gradually increased. The specified time is extinguished in the oldest order (fade out). On the other hand, at the start of the second song, the plurality of designated balls dp specified in the second song are gradually emitted, for example, in the order of the oldest designated time. It may be configured to appear (fade in).

  In the motion mode, the G sensor 24 is configured to detect acceleration in the three-dimensional direction (X, Y, Z axis) direction, and some parameter, for example, a sound is generated even with respect to the acceleration change in the Z axis direction. The musical sound characteristics such as the cutoff frequency of the musical sound may be changed based on a change in acceleration in the Z-axis direction.

  Note that what is associated with each column (n value) or each row (k value) in the matrix display input unit mt is not limited to the timbre and pitch, and various musical sound parameters can be applied. Alternatively, only display parameters may be associated.

  In the present embodiment, the matrix display unit mtLED is integrated into the matrix switch mtSW so that both the designation of coordinates and the display of the designated coordinates are performed on the matrix display input unit mt. However, both may be provided separately. In that case, the matrix display input unit mt is provided only with a display function (for example, a matrix liquid crystal display unit) corresponding to the matrix display unit mtLED, and designation of the designated ball dp is accepted by a soft switch such as a touch panel or some other operator. May be. For example, when applied to a mobile phone, the liquid crystal display unit may display a matrix, and an operator provided on the mobile phone may be used for specifying a designated ball dp or the like.

  The display function corresponding to the matrix display unit mtLED may be provided not only on the top surface but also on the bottom surface of the performance device MC, and the same display may be performed simultaneously on both. By doing so, it is possible to show the contents of the performance state to a large number of people with the upper surface facing the user and the bottom surface facing the viewer, and the usage scene is expanded.

  In the present embodiment, the matrix display unit mtLED emits light in two stages. However, the present invention is not limited to this, and the light emission luminance is determined according to the state such as the positional relationship between the moving ball mp and the designated ball dp as three or more stages. May be different. Alternatively, it may be configured to emit light with a plurality of emission colors. The matrix display input unit mt only needs to be able to visually display the designated ball dp to the moving ball mp in a matrix state, and does not necessarily have to emit light. For example, the matrix display input unit mt may be configured by a liquid crystal screen, and a plurality of types of display patterns corresponding to each coordinate may be realized by changing the blinking speed. Note that the configuration of the matrix display input unit mt may not be 16 × 16, and the vertical and horizontal values may be different.

  In the present embodiment, the rebound mode can be set only in the random loop mode or the two-point loop mode. However, the present invention is not limited to this and may be configured to be set in other modes.

  In this embodiment, the “sequential sounding mode”, “random loop mode”, and “two-point loop mode” cannot be executed in parallel at the same time. Also good.

  In the rotation mode, light emission and / or sounding may be sequentially performed in real time corresponding to the matrix switch mtSW traced by the finger by the rotation instruction Ron or the rotation stop instruction Roff. Further, information indicating which matrix switch mtSW is traced at what speed may be output as data, and some light emission or sound generation processing may be performed according to the data. For example, the light emission corresponding to the turned on matrix switch mtSW may be controlled to remain for a short time after being turned off, and the light emission may be controlled so that the locus of the finger appears as an afterimage. At that time, the afterimage mode (brightness, speed of attenuation, etc.) may be variable according to the speed of finger movement, the time of pressing, and the like.

  An object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the embodiments to a system or apparatus, and the computer (or CPU or the like) of the system or apparatus is stored in the storage medium. It is also achieved by reading and executing the program code.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention. Further, when the program code is supplied via a transmission medium or the like, the program code itself constitutes the present invention. The storage media in these cases include ROM, floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R / RW, DVD-ROM, DVD-RAM, DVD- R / RW, DVD + RW, NV-RAM, magnetic tape, nonvolatile memory card, download via a network, or the like can be used.

  Further, by executing the program code read out by the computer, not only the functions of the above-described embodiments are realized, but also the OS running on the computer based on the instruction of the program code performs the actual processing. Needless to say, the present invention includes a case where the functions of the above-described embodiment are realized by performing part or all of the above-described processing. Further, after the program code read from the storage medium is written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. It goes without saying that the present invention includes a case where the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

1 is a block diagram illustrating an overall configuration of a matrix display device according to an embodiment of the present invention. 1 is an external view of the present matrix display device. It is a top view of a matrix display input part. It is a transition diagram of the matrix display input part which shows operation | movement of a random loop mode typically. It is a transition diagram of the matrix display input unit schematically showing the operation in the two-point loop mode. It is a transition diagram of the matrix display input unit schematically showing the operation in the rebound mode. It is a transition diagram of a matrix display input part which shows typically operation in case rotation mode is set among motion modes in addition to random loop mode. It is a transition diagram of the matrix display input part which shows typically operation in case G sensor mode is set among motion modes in addition to random loop mode. It is a conceptual diagram which shows the relationship between the matrix display input part and matrix whole area | region in a music box mode. It is a transition diagram of a matrix display input part which shows typically operation in automatic scroll mode of music box mode. It is a transition diagram showing typically the relation between the matrix display input unit and the entire matrix area in the manual scroll mode of the music box mode. It is a figure which shows typically the relationship between the performance data and matrix display input part in automatic drawing mode. It is a transition diagram of the matrix display input part which shows operation | movement of automatic drawing mode typically. It is a transition diagram of the matrix display input unit schematically showing the operation in the real-time drawing performance mode. It is a flowchart of the main process in this Embodiment. FIG. 16 is a flowchart continued from FIG. 15 of the main processing in the present embodiment. It is a flowchart of a timing signal transmission process. FIG. 16 is a flowchart of an automatic performance input reception process and the like executed in step S <b> 104 of FIG. 15. FIG. It is a flowchart following FIG. 18 of processes, such as automatic performance input reception. It is a flowchart of a movement mode process. It is a flowchart of a music box mode process. It is a flowchart of the automatic drawing mode process performed by step S332 of FIG. It is a flowchart of the movement route production | generation process performed by FIG.22 S602. 17 is a flowchart of sound generation, light emission, and drawing route generation processing executed in step S135 of FIG. It is a flowchart of the drawing control process performed by step S136 of FIG. It is a flowchart of the real-time drawing performance process performed by step S137 of FIG.

Explanation of symbols

  1 CPU (visible display control means, musical sound generation instruction means), 4 timer (timing progress means), MC performance device, mt matrix display input section (two-dimensional area), mtLED matrix display section (visible display section), mtSW matrix Switch (coordinate designation means), dp designated ball (designated coordinates), mp moving ball, KC pronunciation data (sounding element), rt moving route

Claims (5)

A plurality of visible display portions arranged in a matrix corresponding to each of coordinates in a two-dimensional region in which a timing element is assigned to one of a row or a column;
Visible display unit control means for controlling the plurality of visible display units;
Coordinate designating means for designating designated coordinates from the coordinates of the two-dimensional region;
Timing advance means for defining a current position in the one of the rows or columns over time;
The visual display unit control means, when the designated coordinates designated by the coordinate designation means exist at the one current position of the row or column defined by the timing advance means, the plurality of visible display parts A matrix display device characterized in that a predetermined drawing display corresponding to the existing designated coordinates is performed by visual display of at least one of the matrix display device.   A pronunciation element corresponding to a coordinate is assigned to the other of the row or column, and the designated coordinate designated by the coordinate designating means is present at the one current position of the row or column defined by the timing progression means. 2. The matrix display device according to claim 1, further comprising a musical tone generation instruction means for instructing generation of a musical tone based on the sound generation element assigned to the specified coordinates that exist.   The coordinate designating unit designates the designated coordinate based on performance data, and the visual display unit control unit determines the predetermined drawing display mode based on at least one parameter related to a musical sound in the performance data. The matrix display device according to claim 1, wherein:   The matrix display device according to any one of claims 1 to 3, wherein the visible display control unit changes each drawing display to be displayed corresponding to the designated coordinates in terms of time. Control program for a matrix display device for controlling a matrix display device having a plurality of visible display portions arranged in a matrix corresponding to coordinates in a two-dimensional region in which timing elements are assigned to one of rows or columns Because
A visible display unit control step for controlling the plurality of visible display units;
A coordinate designating step of designating designated coordinates from the coordinates of the two-dimensional region;
A program that causes a computer to execute a timing advance step that defines a current position in the one of the rows or columns over time;
The visual display unit control step includes the plurality of visible display units when the designated coordinates designated by the coordinate designation step exist at the one current position of the row or column defined by the timing advancement step. A control program for a matrix display device, wherein a predetermined drawing display corresponding to the existing designated coordinates is performed by displaying at least one of them visually.

Images