JP3760940B2 - Automatic performance device - Google Patents

Description

  The present invention relates to an improvement in the display mode of an automatic performance apparatus that automatically synthesizes musical sounds of a plurality of types of tones.

  An automatic performance apparatus that performs automatic performance based on music data that is automatic performance data has been put into practical use. Many automatic performance devices are equipped with a display, and during the automatic performance operation, the musical score of the song being played, the operation panel of the mixer, etc. were displayed on this display.

  In addition, some automatic performance devices have a so-called mute function that does not output the musical sound of any channel among the parts of multiple channels. In order to execute this mute function, you are responsible for the part of the tone you want to mute. It was necessary to know the current channel number in some way, and to mute by specifying that channel number.

  However, the conventional note display and mixer display have a drawback that it is not possible to know sensuously what the organization of the musical instrument that plays the song is. Also, when designating mute, it is necessary to check the channel of the tone first, which is troublesome.

  SUMMARY OF THE INVENTION An object of the present invention is to provide an automatic performance device that can visually represent the musical composition of a song and that can perform a mute instruction on the display.

According to the present invention, musical tone synthesizing means capable of synthesizing a plurality of kinds of timbres, automatic performance data storage means for storing automatic performance data including timbre designation data for designating a plurality of timbres, and stored in the automatic performance data storage means. In the automatic performance apparatus comprising the automatic performance means for reading the automatic performance data and driving the musical tone synthesis means with the tone specified by the tone specification data, the display means and the musical instruments of the plurality of types are supported. Character storing means for storing a character, timbre designation data is read out from the automatic performance data, a determination is made as to whether a combination of a plurality of timbres designated by the timbre designation data forms a predetermined ensemble, and a predetermined ensemble If it is organized, the character placement corresponding to the instrument of each tone is changed to the placement in that ensemble. Constant and, if not have been to organize the predetermined ensemble, in accordance with the number of events of each tone in the automatic performance data to determine the placement of the corresponding character to the musical instrument of the respective tone in predetermined order ensemble And a character display control means for displaying characters corresponding to the plurality of timbre musical instruments on the display means in an arrangement determined by the ensemble determination means.

  In the automatic performance apparatus according to the present invention, the musical tone synthesizing means is driven based on the automatic performance data, and the automatic performance is performed with a predetermined tone color. In this case, the character corresponding to the timbre designated by the timbre designation data is read from the character storage means and displayed on the display means. Thereby, the structure of the timbre (musical instrument) of the music played automatically can be visually recognized.

  As described above, according to the present invention, the player character is displayed on the screen during the automatic performance, so that the organization of the musical instrument can be visually grasped, and the automatic performance can be heard more realistically. Further, by determining the composition based on the combination of timbres of the music data, this character display can be performed no matter what music data is read.

  FIG. 1 is a block diagram of an automatic performance apparatus according to an embodiment of the present invention. FIG. 2 is a memory configuration diagram of the automatic performance device. This apparatus is an apparatus for automatically performing performance by the CPU 10 reading out the music data stored in the HDD 13 and inputting it to the musical tone synthesizer 15. The musical sound is emitted from the speaker 16, and at the same time, an image corresponding to this performance is displayed on the monitor 18. Here, the image corresponding to the performance is an image of a character (performer) corresponding to the part organization of the song.

  In the figure, the CPU 10, HDD 13, and musical tone synthesizer 15 are connected to a bus. In addition, a ROM 11, a RAM 12, a mouse 14, and an image processing device 17 are connected to the bus. The CPU 10 controls the operation of the entire automatic performance device. The HDD 13 stores music data of a plurality of songs, character data displayed on the monitor 18, and the like. The ROM 11 stores a control program, tone color data for the tone synthesizer 15 to synthesize a tone signal, various table data, and the like. A part control table for automatic performance control of a plurality of parts is set in the RAM 12. The mouse 14 is a device for moving a cursor displayed on the monitor 18 to indicate a point on the screen. The mouse 14 indicates a song name displayed on the screen and selects a song, or indicates a character displayed on the screen. Used when muting. The musical tone synthesizer 15 is a device that synthesizes musical tone signals based on music data input from the CPU 10. A speaker 16 is connected to the music synthesizer 15, and the speaker 16 emits a music signal synthesized by the music synthesizer 15. The image processing device 17 displays a character image on the monitor 18 based on an instruction from the CPU 10.

FIG. 3 is a diagram showing a configuration example of music data stored in the HDD 13. The music data consists of a header part and a data body part. This music data is automatic performance data composed of a plurality of parts played with different timbres. The data body stores event data and duration data of all parts. In this embodiment, data of all parts is stored in one track, but a track may be provided for each part. The header part stores tone color information of each part and localization information of each part. Tone color information is stored as the control change information MIDI format, tone number 00 _H ~8F _H written as a control channel number is assigned as shown in FIG. This timbre number assignment is based on a standard unified as a general MIDI format. The localization information is stored as PAN information in MIDI format. The PAN information is information for controlling the left and right localization, but may further store information for controlling the top and bottom localization. Some music data does not store this localization information. In this case, the localization of each part is determined by a method described later.

  FIG. 4 is a diagram showing the configuration of the character data file stored in the HDD 13. In the character data file, a plurality (2n) of character data is stored for each tone color (instrument) that can be synthesized by the tone synthesizer 15 as shown in FIG. The character data is a figure that schematically represents the performer who plays the instrument. It should be noted that different character data may be stored for each 128 timbres that can be synthesized by the musical tone synthesizer 15, but in order to save memory, for example, piano and keyboard, tenor saxophone and alto saxophone are similar in performance posture The musical instrument characters may be shared. In addition, the keyboard player character is used for all timbres unique to electronic musical instruments that are not found in natural musical instruments.

  FIG. 2B shows an example of a character expressing a guitar player. As shown in the upper part of the figure, n normal motion characters are stored and identified by motion numbers 1 to n. Further, n bold motion characters are stored as shown in the lower part of the figure, and are identified by motion numbers n + 1 to 2n. A normal motion character is displayed when the tone level of this tone is below a certain value, and a bold motion character is displayed when the tone level of this tone exceeds a certain value. The read character data is sequentially switched as 1, 2, 3,... Or n + 1, n + 2, n + 3,... According to the progress of the music, and the monitor 18 has a character that moves as if it is actually playing. Is displayed.

  FIG. 5 is a diagram showing an ensemble determination table stored in the ROM 11. The ensemble determination table is a table for determining what ensemble or band the combination of timbres (musical instrument organization) corresponds to when the timbre number is read from the header portion of the music data.

  In this ensemble determination table, the name of the ensemble (band) and the part organization of this ensemble are stored as tone numbers. As small-scale ensembles, quartet, jazz band, rock band, etc. are memorized, and as medium- and large-scale ensembles, baroque orchestra, classical orchestra, 19th century orchestra, big band, etc. are memorized. Has been. In the determination of the ensemble, a plurality of timbre numbers read from the music data (header part) are compared with the part organization of the ensemble determination table, and when they match, the ensemble is determined to be the ensemble. If a plurality of timbre numbers do not completely match any ensemble part organization, the ensemble is determined to be the closest ensemble. The determination of the ensemble with the closest composition is performed, for example, by determining the ensemble with the least number of parts in the composition based on a plurality of timbre numbers of the music data.

  Further, the ensemble determination table stores a standard arrangement of a plurality of parts constituting the ensemble for each ensemble. The arrangement is stored as a combination of (tone color number, x coordinate, y coordinate) data for each part. The x coordinate and the y coordinate are coordinates set on the screen of the monitor 18, and the x coordinate is in the range of 0 to 127, and the y coordinate is in the range of 0 to 127. When arrangement information is not stored in the music data, a character is displayed based on the arrangement data. The character is displayed around the specified x and y coordinates.

  In addition, when arrangement information is not stored in the music data and an appropriate arrangement corresponding to this ensemble determination table is not stored, the number of events of each channel is counted before playing the music, and the number of events The part with the largest number is displayed in the center of the front row, and is displayed sequentially in the left, right, and back rows. An example of the arrangement order in such an arrangement method is shown in FIG. In this figure, the parts with the first to fifth ranks are arranged from the center of the front row to the left and right, and those with the ranks of 6th to 9th are arranged in the back row. In addition, it may be arranged so as to gradually become a back row according to the frequency ranking of the parts.

  In the case of a small ensemble of about 5 to 6 people, all the characters of each part can be displayed (see FIG. 10), but in the case of a big band or large orchestra, all characters are displayed. Is impossible to do. In such a case, only the part arrangement may be displayed based on the instrument arrangement data without displaying the character (see FIG. 11), or a simplified and reduced character may be displayed. Good. Furthermore, only the arrangement of each part is displayed, and the saturation and brightness of the display color of each part is changed according to the sound level of that part so that it can be understood which part is currently louder. Good.

  In this embodiment, it is determined what type of ensemble is based on the timbre information stored in the music data. However, in the header part of the music data, this music is a music of which form of ensemble. You may make it write beforehand whether there is.

  FIG. 6 shows a part management table set in the RAM 12. The music data is automatic performance data of 16 parts of CH1 to CH16. The part management table is provided with an area for storing a timbre number, a mute flag, display coordinates, and a designated character number designated for each part. The mute flag is a flag for instructing whether or not the musical sound of this part is to be generated. This flag is inverted when the user clicks the displayed character using the mouse 14 during automatic performance. When this flag is set (when “1”), the musical tone of this part is controlled so as not to sound. The display coordinates are coordinates on the screen for displaying the character of this part. As described above, the coordinates are determined based on the ensemble determination table, the arrangement data stored in the header portion of the music data, or the number of events of each part. The designated character number is a number that designates a character in the character data file, and is determined based on the timbre number.

  7 and 8 are flowcharts showing the operation of the automatic performance device. When the automatic performance operation is not performed, the music list is displayed on the monitor 18 (n1). This music list is created based on the music data file directory stored in the HDD 13. Wait until there is a song selection by the user at n2. The music selection is performed by clicking one of the music titles in the music list displayed on the monitor 18 with the mouse 14. When music selection is performed, the storage area for the music data of this music is searched from the HDD 13 (n3). When the music data storage area is searched, first, timbre information in the header portion is read (n4). The ensemble determination table (FIG. 5) is searched with a plurality of timbre numbers determined from the timbre information to determine the ensemble of this song (n5). The knitting indexing method is as described above. Next, the character and display position of each part are determined (n6, n7). At the same time, the display mode is determined. The display mode is such that a character is displayed in full scale in the case of a small-scale ensemble, and only a part display or a reduced character is displayed in the case of a large-scale ensemble. The content determined by the above operation is stored in the part management table (n8).

  Since the automatic performance pre-setting operation is completed by the above operation, the automatic performance operation is started. First, various registers used for automatic performance are reset (n9). The registers include a DUR register for counting down the duration time and moCNT (i) for counting the motion number of each part. and so on. Next, the character designation data is read from the part management table and this character is read from the HDD 13 (n10). The read character is displayed on the monitor 18 by writing it into the VRAM based on the display position data stored in the part management table. Since the motion register is reset at n9, this display is for the motion number 1. Next, the value of DUR is determined. If DUR = 0, it is the automatic performance data read timing, so a read processing operation (n13: FIG. 8) is executed. Since the DUR is reset at the beginning of the automatic performance operation, this operation is always performed. Next, it is determined whether the character displayed on the monitor 18 has been clicked with the mouse 14 (n14). When clicked, it is an instruction to mute or unmute (unmute) the part displayed by the character, so the mute flag MUTE (i) of the corresponding part in the part management table is inverted (n15). ). Next, other processing (n16) is executed, it is determined that a fixed time has elapsed, DUR is decremented by 1, and the process returns to n12.

  FIG. 8 is a flowchart showing the read processing operation. This operation is performed at n13 when DUR = 0. First, music data is read (n20). It is determined by n21, n22, and n23 what kind of data the read music data is. If the read music data is event data, the part number where the event occurred is set to i (n24). The mute flag MUTE (i) of this part is determined (n25). If MUTE = 0, the part is not muted, and the event is executed as usual (n26). The execution of an event is, for example, a process of assigning a sound generation channel for generating a musical sound and transmitting a key code and velocity data to the sound generation channel (musical sound synthesizing device 15) in the case of a note-on event. Next, 1 is added to the motion counter moCNT (i) of this part. This motion counter is a counter for designating the motion number of the character to be displayed. When moCNT becomes n as a result of addition, moCNT is set to 0 (n28, n29). This is because a basic motion is formed from n frames and is repeatedly displayed. Next, it is determined whether the sound level of this part is a certain level (n30). This determination may be made based on velocity data at the time of a note-on event, or may be determined based on some feedback data obtained from the musical tone synthesizer 15. If it is below a certain level, the base character b is set to 1 (n31). If it is above a certain level, the base character number b is set to n + 1 (n32). Next, the motion number MO is calculated (n33). MO is calculated by moCNT (i) + b. As a result, when the sound level of this part is above a certain level, the characters after motion number n + 1 are read out, and a large action character is displayed. In addition, the display color is designated dark because it is not muted (n34). Based on these data, the character of the motion number MO is read out from the character table specified for part i and the character display is updated (n35, n36). Thereafter, the process returns to n20 to read the next music data. Also, if MUTE = 1 at n25, this part is muted and does not sound, so the event is not executed and the motion is fixed at MO = 1 (n37). Then, the display color is designated as a light color indicating mute (n38), and the process proceeds to n35.

  On the other hand, if the read data is duration data, this data is set in DUR (n40). Returning to the operation of FIG. If it is end data, since the performance is finished, all musical tones that are currently sounding are erased (n41), and the operation returns to the first operation n1. If the data is other than these, the corresponding operation (n42) is executed and then the process returns to n20.

By doing in this way, according to music, the image | video suitable for the music can be displayed, and it can be made the display of the realistic feeling which is actually performing. Also, the mute instruction is simple because it is only necessary to specify the performer of the part.

  In this embodiment, the timbre information is obtained from the header portion of the music data. However, all the timbres used in the music may be extracted from the entire music prior to the performance as with the number of events.

Block diagram of an automatic performance apparatus according to an embodiment of the present invention Memory configuration diagram of the automatic performance device Composition of music data Character data file configuration diagram Configuration diagram of ensemble determination table Part management table configuration diagram Flow chart showing the operation of the automatic performance device Flow chart showing the operation of the automatic performance device Figure showing the tone number list Figure showing a display example of the rock band Figure showing an example of orchestra display A figure showing an example of the arrangement order of characters

Claims (1)

Musical sound synthesizing means capable of synthesizing a plurality of types of timbres, automatic performance data storage means for storing automatic performance data including timbre designation data for designating a plurality of timbres, and automatic performance data stored in the automatic performance data storage means In an automatic performance apparatus comprising an automatic performance means for reading data and driving the musical tone synthesis means with a timbre designated by the timbre designation data,
Display means;
Character storage means for storing characters corresponding to the musical instruments of the plurality of types;
When the timbre designation data is read from the automatic performance data, it is determined whether a combination of a plurality of timbres designated by the timbre designation data has a predetermined ensemble organization. If the arrangement of the character corresponding to each musical instrument is determined to be the arrangement in the ensemble, and if the predetermined ensemble is not organized, a predetermined order is set according to the number of events of each timbre in the automatic performance data. Ensemble determining means for determining the arrangement of characters corresponding to the musical instruments of each timbre ,
Character display control means for causing the display means to display characters corresponding to the plurality of timbre musical instruments in an arrangement determined by the ensemble determination means;
An automatic performance device characterized by the provision of

Images