JP3770293B2 - Visual display method of performance state and recording medium recorded with visual display program of performance state - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a technique for visually displaying a performance state.
[0002]
[Prior art]
In desktop music (DTM) using a dedicated sequencer or personal computer, step recording by note specification using a mouse or the like, real-time recording by actual performance using a MIDI keyboard, etc., reading of a song data file, etc. Thus, the musical tone of the tone assigned to each performance part is reproduced and played. At this time, an apparatus that can be easily familiar to beginners can be considered by displaying a concrete character on the display screen of the display in correspondence with the tone color of the performance part described above. However, simply displaying the character does not change the display screen, and there is no connection with the performance image. Therefore, there has been a problem that it becomes monotonous.
In addition, there is one that notifies the tempo by sound or visual display. However, this only informs the tempo in a monotonous manner during the playback of the song.
[0003]
[Problems to be solved by the invention]
The present invention has been made to solve the above-described problems, and can visually display the performance state or performance period of each performance part by a change of an icon representing the tone color of the performance part. An object of the present invention is to provide a visual display method of a performance state that can be performed and a recording medium in which a visual display program of a performance state is stored.
[0004]
[Means for Solving the Problems]
The present inventionA performance state visual display method for visually displaying a performance state when playing and playing musical tones assigned to one or a plurality of performance parts,The step of identifying the timbre of each of the one or more performance parts, the step of setting the time signature of the performance, and the icon expressing the timbre of each performance part according to the identified timbre of each performance part are output. And outputting an icon representing the conductor to create an image in which an icon representing the tone color of each performance part and an icon representing the conductor are arranged, and during the performance period, the conductor A step of changing the icon image representing the movement to give movement to the icon representing the conductor, and determining the number of images to determine the number of icon images representing the conductor according to a set time signature Step.
The present invention is also a recording medium on which a visual display program of a performance state for causing a computer to execute the above steps is recorded.
Therefore, that the performance period,It can be displayed visually by changing the icon representing the conductor.
Further, since the icon image representing the conductor is switched according to the time signature of the performance, the time signature of the performance can also be displayed visually.
[0005]
The present invention also providesA performance state visual display method for visually displaying a performance state when playing and playing musical tones assigned to one or a plurality of performance parts,The step of identifying the timbre of each of the one or more performance parts, the step of setting the time signature of the performance, and the icon expressing the timbre of each performance part according to the identified timbre of each performance part are output. And outputting an icon representing the conductor, creating an icon representing the tone color of each performance part, and an image in which the icon representing the conductor is arranged, and during the performance period,in frontOf the icons that represent the tone of each performance part, the icon that represents the performance part that is generating the musical soundSwitch to the set of icon images representing the conductor, and the icon images representing the conductor that make up the switched setA step of switching to give movement to an icon representing the conductor, and a step of determining the number of images to determine the number of images of the icon representing the conductor according to a set time signature of the performance. is there.
The present invention is also a recording medium on which a visual display program of a performance state for causing a computer to execute the above steps is recorded.
Therefore, it can be visually displayed by the change of the icon expressing the conductor that the performance period is in progress.
Also,Since the icon image representing the conductor is switched according to the time signature of the performance, the time signature of the performance can also be visually displayed.The performance part during the musical sound generation period by the movement of the icon representing the conductor can also be visually represented by the change of the icon representing the conductor.
[0006]
MaIn addition, if the step of giving movement to the icon representing the conductor is configured to give movement only during any musical sound generation period of each performance part, any musical sound generation period of each performance part is conducted. Can be displayed visually by the movement of the icon representing the person.
[0007]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 1 is a functional block configuration diagram of a performance state visual display device for explaining an embodiment of the performance state visual display method of the present invention. In the figure, 1 is a performance part memory, 2 is a conductor icon image data memory, 3 is a player icon image data memory, 4 is a performance place image data memory, 5 is an image data composition unit, 6 is an icon position setting unit, and 7 is a pan. It is a setting part.
FIG. 2 is an explanatory diagram of a display screen for explaining an embodiment of the visual display method of the performance state of the present invention. A player icon A13, a player icon B14, a player icon C15, a mouse pointer 16, and a conductor icon 17 are displayed on the image 11 representing the performance place.
FIG. 3 is an explanatory diagram showing a specific example of a player icon. FIG. 3A and FIG. 3B are images that concretely represent the player who is playing the electric guitar. It is an image created by taking out two types (two frames) from a series of movements of the character being played. In the illustrated example, a silhouette is shown, but a two-dimensional image or a three-dimensional image that looks three-dimensional may be used. The performance part number is displayed in the spotlight portion.
FIG. 4 is an explanatory diagram showing a specific example of a conductor icon. 4 (a), 4 (b), and 4 (c) are images that concretely represent a conductor in a state of conducting. It is an image created by taking out three types (three frames) from a series of movements of the character being conducted. Similar to the player icon, a two-dimensional image or a three-dimensional image may be used instead of the silhouette.
[0008]
A performance system is constructed by one or a plurality of performance parts. The performance part memory 1 stores timbre information indicating the timbre of each performance part and pan information of each performance part. When the user designates the performance part and reads the timbre information from the performance part memory 1, the timbre of each performance part is identified. The image data of the conductor icon is read from the conductor image data memory 2, and the image data of the player icon corresponding to the tone color of each performance part is read from the icon image data memory 3 according to the tone color information. Further, image data representing a virtual performance place of the performance system is read from the performance place image data memory 4. In accordance with the read conductor icon image data, icon image data of each performance part and image data representing the performance place, the image data synthesis unit 5 includes the conductor icon and each performance part in the image representing the performance place. Is generated and output to the display unit.
[0009]
As shown in FIG. 3A and FIG. 3B, the icons such as the player icon A13 shown in FIG. 2 are images that concretely represent the players who are playing the timbre instruments of each performance part. is there. This player icon has the following functions in the processing of the performance system.
First, a function for displaying the tone and operation state of each performance part. Second, a function for designating a performance part corresponding to the icon by placing the mouse pointer on the icon and left-clicking. Depending on the position of the icon, the sound image localization position of the performance part corresponding to the icon in the performance system is displayed.
[0010]
The conductor icon 17 shown in FIG. 2 corresponds to the icon in the performance system processing by firstly displaying the tempo and time signature, and secondly by placing the mouse pointer on the icon and left-clicking. It has a function to specify tempo and time signature. Since pan control is not performed, the image 11 representing the performance place may be displayed at a position off the screen.
[0011]
Next, the pan control of the musical tone of each performance part will be described. In FIG. 2, the left and right positions of the player icon A13, the player icon B14, and the player icon C15 on the image 11 representing the performance place visually represent the sound image localization position of the performance part corresponding to each icon.
As shown in FIG. 1, pan information indicating the sound image localization position of each performance part is stored in the performance part memory 1. By reading the pan information, the sound image localization position of each performance part is identified, and the icon position setting unit 6 controls the image data synthesis unit 5. The image data composition unit 5 creates an image in which each icon is arranged at a position corresponding to the pan information in the image representing the performance place.
[0012]
In the specific example shown in FIG. 2, the display position of the icon such as the player icon A13 in the left-right direction is determined according to the sound image localization position of each musical sound part in the virtual sound field of the performance system. As a result, the musical sound of the performance part whose icon is located on the left side has a higher volume output from the left speaker than that of the right speaker, and conversely, the musical sound of the performance part whose icon is located on the right side. It is visually displayed that the pan control is performed so that the volume output from the right speaker is larger than the volume output from the left speaker.
[0013]
Conversely, pan information can be set by the display position of the player icon on the image 11 representing the performance place.
In FIG. 1, the icon position setting unit 6 controls the image data composition unit 5 by inputting the position setting data of each icon by the user using an input device such as a keyboard or a mouse, and determines the position of each icon. Move it up / down / left / right to place it in a new position. Then, the pan setting unit 7 outputs pan information for controlling pan of each performance part in the virtual sound field of the performance system to the pan control unit according to the new position in the left-right direction of each icon. In this way, the sound image localization of each performance part can be visually expressed and the sound image localization can be set visually. Note that the pan information of each performance part in the performance part memory 1 may be updated with the pan information output from the pan setting unit 7.
[0014]
In FIG. 2, when the user moves the mouse, moves the mouse pointer 16 to the player icon A13 and presses the left button of the mouse, the player icon A13 is selected, and when the user drags the mouse as it is, the position setting data of the player icon A13 is displayed. Is updated. As a result, the player icon A13 moves together with the mouse pointer 16. When the left button is released, the player icon A13 stops at that position and a new position is set. As a result, the position setting data of the player icon A13 is fixed.
In FIG. 1, the functional blocks for synthesizing the image data of the mouse pointer 16, inputting the position setting data of the mouse pointer 16, and outputting the position setting data of the player icon A 13 using the mouse are not shown.
[0015]
The pan setting unit 7 outputs pan information of the performance part corresponding to the player icon A13 according to the position setting data including the period in which the position setting data of the player icon A13 is updated. Alternatively, the pan setting unit 7 may output pan information corresponding to the fixed position setting data when the position setting data of the player icon A13 is fixed.
As described above, when the pan information is set according to the arrangement of the player icon A13 on the screen, more specifically, the position of the abscissa, the setting operation can be performed intuitively and intuitively.
[0016]
As a specific example of the method of first arranging the player icon A13 or the like on the image 11 representing the performance place, the player icon A13 is arranged at the initial position by assigning the tone color to the performance part on the menu screen at the time of editing. Alternatively, at the time of editing, an image area representing a dressing room is displayed next to the image 11 representing the performance place, a plurality of player icons prepared in advance are displayed, and one is displayed using a mouse. Each player icon is placed on an image 11 representing a performance place.
[0017]
The sound image of the performance part tends to be localized at the center. At this time, if the sound image localization position and the icon display position are simply in a proportional relationship, the icon is displayed overlapping the center position, making it difficult to see the screen. There is also a problem that the display screen is unbalanced and feels unnatural. In order to avoid this, the panning information is displayed at the position of the icon after widening the central area 12 indicating the central panning level. Conversely, when pan control is performed by changing the icon setting position, the central area 12 is set as a central dead zone for control.
[0018]
That is, for the central region 12, a wide range is assigned to the abscissa on the screen. Accordingly, it is assumed that the player icon A13 and the player icon B14 arranged in a central area having a predetermined width in the horizontal direction of the screen are at the same central pan level for sound image localization of each performance part. If another player icon is brought to the position where the player icon is already placed, the position adjustment is made so that each player icon does not overlap completely so that other player icons will be placed avoiding that position. You may go.
[0019]
In addition to the central area 12, the player icon is divided into a plurality of small areas with respect to the abscissa on the screen, and the player icons in the same small area have the same pan information and set the same pan information. As an example, the display position may be adjusted so that the player icons do not overlap.
[0020]
Next, an animation (moving image) display of the player icon and the conductor icon will be described.
In FIG. 1, the image switching unit 8 inputs the tempo, time signature, and note-on of the musical tone of each performance part, thereby identifying the musical tone tempo and time signature and identifying the musical tone generation period. 2. Control to select an image to be read from the player icon image data memory 3. The conductor icon image data memory 2 and the player icon image data memory 3 each store a plurality of still images representing a series of movements of the character being played.
During the musical sound generation period of each performance part, the image representing the player icon is switched from the player icon image data memory 3 by reading out the image representing the player icon of the performance part as shown in FIG. Add movement to the player icon. The musical sound generation period of each performance part is started by detecting a musical sound generation instruction (corresponding to “Note On” in the MIDI information) of each performance part.
[0021]
There are several detection methods for the end of the musical tone generation period of each performance part.
As a first detection method, the time point at which the musical sound of each performance part is muted is detected and the process ends. Specifically, the time point at which the envelope of the musical tone of each performance part becomes zero or smaller than a predetermined threshold is detected.
As a second detection method, the end of the musical sound generation period is detected by not detecting the note-on of each performance part for a predetermined time.
[0022]
At that time, in either of the first detection method and the second detection method, when a musical tone generation instruction is issued again during such musical tone generation period, the image representing the player icon of the performance part is switched. A method of returning to the first image showing a series of operations may be adopted. In this way, the operation of the player icon can be started from the image at the start of the operation for each musical sound generation instruction of each performance part. Then, it is assumed that the same image is not repeatedly used as an image representing the player icon of the performance part according to one musical sound generation instruction. Even in the case of an instrument, such as a guitar, where the difference in performance operation is visually noticeable between the start of tone generation and the subsequent tone generation period, the movement of the player icon does not become unnatural.
[0023]
Furthermore, if the player icon increases or decreases the operation of the player icon depending on the level of the musical sound during the musical sound generation period, for example, the size of the musical sound envelope, a more effective visual display is possible. For this purpose, the player icon image data memory 3 stores a plurality of images having different movements in each of the series of operations. By reading an image representing a player icon in accordance with the tempo and the tone level, the image representing the player icon is switched to give the player icon a motion corresponding to the tone level.
[0024]
Note that there are multiple performance parts in the song data, but when “mute” is specified for the performance part of one track using the mouse in the track view window, a musical sound is generated in the performance part assigned to this track. Even if there is an instruction, the musical sound generation instruction is ignored and the musical sound generation period is not started. As a result, the player icon of the performance part for which “mute” is designated is prevented from moving. Also, when “Solo Performance” is specified for the performance part of a track, even if there is a musical sound generation instruction for the performance part other than the performance part assigned to this track, this musical sound generation instruction is ignored. Do not start the tone generation period. As a result, only the player icon designated as “solo performance” is moved, and the operation of each performance part is visually displayed.
[0025]
In addition, the player icon is always moved from the conductor icon image data memory 2 to FIG. 4 during the performance period, such as when one song is automatically played, and when no performance part is during the musical tone generation period. The image of the conductor icon shown in FIG. 5 is read out in accordance with the tempo and time signature, so that the image representing the conductor icon is switched to give movement to the conductor icon.
The number of conductor icon images used for switching is determined according to the time signature. For example, in the case of 2 beats, the number of operation frames is set to 2, and two different images are periodically read out and switched. Uses three frames as an operation frame and periodically reads out and switches a series of images according to the time signature. That is, the image of the conductor icon is switched at intervals that match the tempo, and the same image is repeated according to the time signature.
[0026]
In the above description, the conductor icon is always moved during the performance period. As another example, the conductor icon may be moved only during the performance period and when any performance part is in the musical sound generation period.
[0027]
Furthermore, it is more effective if the conductor icon is directed to the player icon of the performance part during the musical sound generation period. The conductor icon image data memory 2 stores a set of a plurality of images showing the commanding operation according to the time signature, and a plurality of sets with different conductor orientations. The position of the player icon and the conductor icon of the performance part in which the musical sound is generated is extracted from the icon position setting unit 6, and the angle of the position of the player icon during the musical sound generation period is calculated from the position of the conductor icon from the relative positional relationship between the two. Then, the image is switched to the conductor icon image facing the player icon of the performance part in which the musical sound is generated.
[0028]
If a plurality of performance parts are producing musical sounds at the same time, the direction may be determined in the center of those performance parts. During the period when no musical sound is generated in any of the performance parts, the conductor icon may be stopped as it is without changing the direction or may be returned to the front. When the performance starts and when the performance ends, the conductor icon faces the front.
[0029]
In the above description, as a player icon and a conductor icon image, a plurality of still images representing a series of actions are stored in the image data memory, and by switching the still images, a series of movements are made to each icon. Giving.
When the number of still images is reduced, the amount of image data to be stored is reduced, and the processing load for image switching is reduced. On the other hand, if the number of still images is increased to, for example, 30 frames (frames) per second and the switching time interval is shortened, the movement becomes smoother, the display quality is improved, and it is easy for the user to see. .
In addition, in a series of operation intervals represented by still images, these still images are used as key frames, and still image data is interpolated to generate intermediate still images, thereby reducing the number of original still images. Smooth motion can be given to player icons and conductor icons. Such a technique is known as an animation (moving image) creation technique in 3D computer graphics technology or the like.
[0030]
FIG. 5 is a hardware configuration diagram for explaining an embodiment of the visual display method of the performance state of the present invention. This is a hardware configuration of a sequencer device or a personal computer in which a sound board is incorporated. The functional block configuration shown in FIG. 1 is realized by executing an operating system and application software on this hardware.
[0031]
A CPU 22, a ROM 23, a RAM 24, an external storage device 25, an interface 27, a display unit 29, an input unit 30, and a sound source unit 31 are connected to the bus 21 by a bus. The external storage device 25 is one or a plurality of recording / reproducing devices such as an FDD (flexible magnetic disk drive), a hard magnetic disk drive (HDD), and a CD-ROM drive, and a recording medium 26 corresponding to each is loaded. The An external performance device 28 such as a MIDI keyboard is connected to the interface 27. The musical tone output from the sound source unit 31 is output to the DSP 32, converted into an analog signal by the D / A converter 33, amplified by the stereo two-channel amplifier 34, and the musical tone signal is output from the right speaker 35 and the left speaker 36. Is done.
[0032]
Operating system software and sequence software are recorded on a hard disk, which is one of the recording media 26. The CPU 22 executes various processes by loading necessary programs and data from the ROM 23 and the hard disk into the RAM 24. The sequence software is recorded and distributed on a CD-ROM, which is one of the recording media 26, and this software is installed on a hard disk for use. Alternatively, it is downloaded from an external server to the hard disk via a communication interface (not shown).
[0033]
The CPU 22 performs real-time recording based on input information from the external performance device 28 as a sequencer function. Alternatively, a staff window, a piano roll window, or the like is displayed on the display unit 29 such as an LCD display or a CRT display, and step recording is performed using the input unit 30 such as a keyboard or a mouse. Alternatively, the music data file stored in the recording medium 26 is loaded into the RAM 24 to reproduce the music.
[0034]
The sound source unit 31 can simultaneously sound a plurality of performance parts. The tone generator 31 generates a musical tone having a timbre assigned to each performance part and outputs it to the DSP 32. The DSP 32 adds effects such as reverberation and chorus to the musical tone. In addition, in order to perform sound image localization in the virtual sound field, the volume ratio of the right channel and the left channel is set by the pan information of the musical sound of each musical sound part and output to the A / D converter 33. The A / D converted musical sound signal is output to the stereo amplifier 34 and amplified, and the musical sound signal is output from the right speaker 35 and the left speaker 36.
[0035]
The CPU 22 also executes a function of visually displaying the performance system by displaying virtual positions of a plurality of sound sources when a musical sound is generated. The amplifier 34 and later can be external devices. The sound source unit 31 and the DSP 32 may also be external sound source devices, and MIDI data may be output to the external sound source device via a MIDI interface (not shown). In some cases, a MIDI keyboard is provided in the input unit 30. In the case of a device that does not have a hard magnetic disk drive, software may be installed in the ROM 23.
In the above description, the DTM program such as sequence software has been described on the assumption that the personal computer is installed in the recording medium 26 of the external storage device 25. However, a DTM-dedicated device may also be used. May be a combination of at least a part of hardware logic.
[0036]
6 to 11 are flowcharts for explaining an embodiment of the visual display method of the performance state of the present invention.
FIG. 6 is a main flowchart. FIG. 7 is a flowchart of the function selection step of S42 shown in FIG. FIG. 8 is a first flowchart of the edit menu processing step of S52 shown in FIG. FIG. 9 is a second flowchart of the edit menu processing step of S52 shown in FIG. FIG. 10 is a flowchart of the operation instruction step of S43 shown in FIG. FIG. 11 is a flowchart of the performance step of S44 shown in FIG.
[0037]
As shown in FIG. 6, in the main flowchart of the embodiment of the visual display method of the performance state of the present invention, the registers and the like are initialized in S41. Next, a function selection process is performed in S42, an operation instruction process is performed in S43, and a performance process is performed in S44. When the process of S44 is completed, the process returns to S42, and the processes of S42 to S44 are repeated. Hereinafter, although the flowchart of each step is demonstrated, description which a step which is not directly related to this invention is abbreviate | omitted.
[0038]
In the function selection flowchart shown in FIG. 7, in S51, it is determined whether or not an edit menu has been selected. If so, the process proceeds to an edit menu process in S52, and if not, the process proceeds to S53. The edit menu is selected by left-clicking on “Edit” in the menu bar of the application window with the mouse.
[0039]
First, the edit menu process in S52 will be described.
In S71 shown in FIG. 8, a drop-down menu is displayed, and the process proceeds to S72. In S72, it is determined whether or not “Create automatic accompaniment style” in the drop-down menu has been selected by left clicking the mouse. If selected, the process proceeds to S74, and if not selected, the process proceeds to S73. In S74, an automatic accompaniment style dialog box is displayed. In S75, one is selected from the list of automatic accompaniment styles, the automatic accompaniment style is set, and the process returns to S58 in FIG. In the automatic accompaniment style, a music genre, a file of a plurality of automatic accompaniment data belonging to this music genre and its section, a disclosure time and an end time of a period in which this automatic accompaniment is included in a song, and the like are set.
[0040]
In S73, it is determined whether or not “edit player” is selected. If it is selected, the process proceeds to S77, and if it is not selected, the process proceeds to S76. In S77, it is determined whether there is a selected player. This determination is made based on whether or not a player icon has already been selected in step S54 in FIG. If it is selected, the process proceeds to S78, and if it is not selected, the process returns to the main flowchart. In S78, a sub-menu for selecting volume adjustment, timbre change, pan adjustment, etc. for the performance part corresponding to the selected player icon is opened. When one of them is further selected, a dedicated dialog is displayed for each. The box opens and the process proceeds to S79. In S79, parameter values are input and set in any of the dialog boxes for volume, tone color, pan, etc., and the process returns to S58 in FIG.
[0041]
In S76, it is determined whether or not “stage effect” has been selected. If it is selected, the process proceeds to S81, and if it is not selected, the process proceeds to S80. In S81, a “Stage Effect” dialog box is opened, a list of stage effect names is displayed, and the process proceeds to S82. This stage effect is a kind of effect imparted to the performance system, and is the reverberation effect described with reference to FIG. In S82, the reverberation type described with reference to FIG. 1 is selected and set, and the process returns to the main flowchart.
[0042]
In S80, it is determined whether or not “tone / time signature” has been selected. If it is selected, the process proceeds to S83, and if it is not selected, the process proceeds to S85 in FIG. In S83, a key / time signature selection dialog box is opened, and the process proceeds to S84. In S84, the key setting and the time signature are input and designated in addition to the beginning of the song, and any bar start position in the song is designated, and the process returns to S58 in FIG.
[0043]
In S85 shown in FIG. 9, it is determined whether or not “player” has been selected. When it is selected, the process proceeds to S87, and when it is not selected, the process proceeds to S86. In S87, all player names, specifically timbres (usually indicated by instrument names) are displayed in the dialog box, and the process proceeds to S88. In S88, when recording or editing, an arbitrary player (tone color) is set for each of an arbitrary number of performance parts, and the process returns to S58 of FIG. When playing song data, the player is automatically selected according to the tone number (program number) specified in the song data file. However, the selected player can be changed here. .
[0044]
In S86, it is determined whether or not “Song” has been selected. When it is selected, the process proceeds to S89, and when it is not selected, the process returns to S58 of FIG. In S89, a song selection dialog box is opened, and the songs divided by music genre are displayed, and the process proceeds to S90. In S90, the program or music genre is selected and set.
FIG. 12 is an explanatory diagram of program selection. Tracks are organized by song genre. In addition to selecting a song, the music genre of the song itself can be selected. In this case, a representative song of the selected music genre is automatically selected.
[0045]
When the edit menu process shown in FIGS. 8 and 9 is completed, the process returns to S58 of FIG. In S58, it is determined whether or not the setting has been changed in the course of the edit menu process. If there has been a change, the process proceeds to S59, and if not, the process returns to the main flowchart. In S59, the screen design of the performance place is changed according to the automatic accompaniment style set in S75 of FIG. 8 and the stage effect set in S81. In S60, the player icon selected in S88 of FIG. Is displayed on the image of the performance place. When the pan setting is reset in the pan adjustment dialog box in S78 of FIG. 8, the arrangement of the player icons is changed according to the pan information.
[0046]
FIG. 13 is an explanatory diagram of the relationship between the automatic accompaniment style and stage effect and the performance place image. The automatic accompaniment styles are classified by music genre, and the figure illustrates dancing, classical music, jazz, and ethnicity. Here, reverberation is illustrated as the stage effect, and examples of reverberation type, no reverberation effect, hall, and stage are shown. And the image of the performance place is made different depending on the combination condition of the automatic accompaniment style and reverberation type. The method of creating an image of the performance place is arbitrary. To give a simple example, depending on the automatic accompaniment style, the color and pattern of the curtain at the performance place are different, and props such as speaker boxes are different. Depending on the type of reverberation, an image of a hall or stage is used, or an image without a curtain is used in some cases. You may make it use the image from which the intensity | strength of a reverberation is identified, and the depth or width of a performance place differs.
[0047]
16 to 18 are explanatory diagrams of specific examples of performance place images where player icons are arranged. However, it is not particularly associated with FIG.
In FIG. 16, a stage 122 is three-dimensionally drawn between opened curtains 121. On the stage 122, a guitar player icon 123, an electronic piano player icon 124, a human voice sound player icon 125, a grand piano player icon 126, and a violin player icon 127 are arranged. A killing scene image is used as the performance place image, and is used when there is no stage effect setting.
[0048]
The human voice player icon 125 is an icon of a performance part in which a human voice is treated as a timbre of a musical instrument. Sometimes the lyrics are pronounced. A character in which three women are arranged is used. If a chorus effect is applied to this performance part, and if no chorus effect is applied, a single character is used. May be. Moreover, you may use the icon which changed the character with the male voice and the female voice.
[0049]
The violin player icon 127 is also lined up with three persons, but this means that an ensemble effect is applied to this performance part. If the ensemble effect is not applied, a single character is used. May be.
As shown in the figure, the performance part number may be displayed in an ellipse that looks like a spotlight on the floor of the player icon.
[0050]
In FIG. 17, a stage 132 is three-dimensionally drawn between open curtains 131 having a different color and pattern from the curtain of FIG. The stage 132 is an image of a concert hall whose floor and wall are wooden.
In FIG. 18, a stage 142 is three-dimensionally drawn between open curtains 141 having different colors and patterns from the curtains of FIGS. The stage 142 is an image of a live stage that emerges with a spotlight.
Thus, the presence of the performance place such as the automatic accompaniment style and stage effect, in other words, the presence of the performance place can be increased by changing the image of the performance place according to the environment setting of the performance system.
[0051]
Returning to the function selection flowchart of FIG. If no edit menu is selected in S51, the process proceeds to S53. In S53, it is determined whether or not a player icon arranged on the image of the performance place is selected. When the player icon is selected, the process proceeds to S54, and when it is not selected, the main flowchart is displayed. Return to. When the mouse pointer is placed on one player icon and left-clicked, it is determined that the player icon is selected.
[0052]
In S54, in order to visually display that the player has been selected, a square frame surrounding the selected player icon is displayed, and the process proceeds to S55. In S55, it is determined whether or not there is an instruction to move the player icon. If there is a movement instruction, the process proceeds to S56, and if there is no movement instruction, the process returns to the main flowchart. It is determined that there is a movement instruction by placing the mouse pointer on the player icon and dragging the mouse while left-clicking the mouse. In S56, the display position of the player icon is changed, and the process proceeds to S57. In S57, the performance part pan control corresponding to the player icon is set according to the position of the player icon, and the process returns to the main flowchart. Details are as described above with reference to FIGS.
[0053]
Therefore, when the song data is selected and the file data of the song to be played is captured, the player icon corresponding to the performance part used for this song is displayed at the position corresponding to the pan information. You can change the pan setting by moving the icon position. Even after a song is selected or in a song edited by the user, the pan setting can be changed by moving the position of the player icon.
[0054]
With reference to FIG. 10, the flowchart of an operation | movement instruction | indication is demonstrated.
In S101, it is determined whether or not there is a reproduction instruction. When there is a reproduction instruction, the process proceeds to S103, and when there is no reproduction instruction, the process proceeds to S102. In this embodiment, when a mouse pointer is placed on the playback button on the control panel of the virtual recording / playback apparatus displayed on the screen and left-clicked, it is determined that there is a playback instruction.
In S103, it is determined whether or not any one of the player icons arranged on the performance place image is selected. If it is selected, the process proceeds to S105, and if it is not selected. The process proceeds to S104. Note that the player icon is selected in S53 of FIG. 7, and when selected, the frame added in S54 is displayed on the screen.
[0055]
In S105, the music data for audition corresponding to the tone color of the selected player icon is selected and the performance is started.
The sample music data includes, for example, information on individual notes and timbres, as well as duration information that indicates the time intervals of musical tone generation events, and is a file format sequence that can be converted into musical sound waveform data in the sound source section. There is data. A specific example is data in a standard MIDI file (SMF) format. This sample music data for trial listening constitutes a piece of music that is organized to some extent. As a specific example, it is phrase data for one or several measures, but the whole piece of music may be used. Note that the music data for trial listening may be a wave format file, and it is only necessary to have a D / A conversion function for converting the waveform data into an analog waveform, but the capacity to be stored is greatly increased. .
[0056]
For the trial music data, an appropriate phrase is selected from the music suitable for viewing the tone of the performance part. By viewing this sample music data for audition, it is checked whether or not the tone of this performance part is suitable for the music to be played or edited. Therefore, the music genre, the style of the music, and the performance part for melody or the performance part for backing (accompaniment) are designated. Then, from the songs belonging to the specified music genre, the one that matches the style of the song is selected in advance, and from that song, a sequence suitable for viewing the tone is used for melody and backing. Remember in advance.
[0057]
FIG. 14 is a first explanatory diagram of a method for setting music data for trial listening. Since the music data for trial listening is selected for each timbre, it has a selection table for each timbre. In the example shown in the figure, pre-stored music data for trial listening is selected according to the combination of the music genre, the speed (tempo) of the music, the melody / backing (accompaniment) type of the performance part, and the like.
[0058]
In the selection described above, for example, in S105, a pop-up menu is displayed, and the user designates the selected performance part.
In this selection condition, if the music genre is in a state where a song or an automatic accompaniment style has already been set, if the user matches the music genre of the song or the automatic accompaniment style, the user can perform music in step S105. There is no need to set the genre.
Similarly for song speed, if the song or auto accompaniment style is already set, the user can set the song style at this step if the tempo of the song or auto accompaniment style is set. You don't have to.
In addition, the melody / backing (accompaniment) type of the performance part can be set in conjunction with the arrangement of the player icon. In this case, the user particularly selects the melody / backing (accompaniment) type in this step. It is not necessary to set.
In the above description, in addition to the timbre, the music data for trial listening is changed according to various conditions such as the music genre. However, it is easy to grasp the characteristics of the timbre just by setting the music data for trial listening only by the timbre. Can do.
[0059]
FIG. 15 is a second explanatory diagram of the method for setting the music data for trial listening. In the figure, parts similar to those in FIG.
The image 11 representing the performance place is three-dimensionally shown as a line drawing 11a representing the stage. As a result, the player icon B14 at the top of the screen is displayed as if it is at the back of the stage. Unlike the example of FIG. 3, in this display screen, the screen area above the boundary indicated by the broken line (1)-(1) in the figure is used as the backing area, and the player icon arranged in this area is displayed. The corresponding performance part is set for backing (accompaniment). On the other hand, the area of the screen below the boundary indicated by the broken line (1)-(1) is a melody area, and the performance parts corresponding to the player icon B13 and player icon C15 arranged in this area are melody. Set for.
[0060]
As a modification, in the figure, an area closer to the center than the boundary lines indicated by the broken lines (1)-(1), (2)-(2), and (3)-(3) is shown. The melody area may be used, and the peripheral area may be a backing area. In this case, only the performance part corresponding to the player icon B13 is set for the melody.
By selecting the music data for trial listening as described above, in selecting a timbre, the image of the timbre becomes easy to understand, and the quality and efficiency of the timbre selection are improved. In particular, the sample music data suitable for the user's usage environment can be provided by replacing the sample music data according to the music genre and the song style.
[0061]
In S105 of FIG. 10, when the trial music data corresponding to the tone of the player icon is selected, the trial music data is taken into the performance data buffer, the performance starts, and the process returns to the main flowchart.
In S104, it is determined whether or not a song is designated. If designated, the process proceeds to S107, and if not designated, the process proceeds to S106. The music setting was performed in S90 in FIG. In S107, the music data of the designated music is fetched into the performance data buffer, the performance starts, and the process returns to the main flowchart.
[0062]
In S106, it is determined whether or not the automatic accompaniment style is selected. If it is selected, the process proceeds to S108, and if it is not selected, the process returns to the main flowchart.
In S108, the accompaniment data of the selected automatic accompaniment style is taken into the performance buffer and the performance starts, and the process returns to the main flowchart.
[0063]
In S102, it is determined whether there are other instructions. When there are other instructions, the process proceeds to S109, and when there is no other instruction, the main flow S109 executes other processes instructed, such as rewinding, fast-forwarding, pausing, and stopping. . In the same way as the playback instruction, the above-described processing instruction is when the mouse pointer is placed on the rewind, fast forward, pause, stop, etc. buttons of the virtual recording / playback device displayed on the screen and left click is performed. It is determined that there is an instruction.
[0064]
In the performance flowchart shown in FIG. 11, in S111, it is determined whether or not there is performance data in the performance data buffer. If there is performance data, the process proceeds to S112. If not, the process returns to the main flowchart. In S112, a musical tone reproduction process is performed based on note-on data or the like sequentially extracted from the performance data buffer, and the process proceeds to S113. In S113, the musical sound level of the performance part during the musical sound generation period is detected, and an image of a player icon that moves according to the detected level is selected. In this way, the movement of the player icon corresponding to the sound generation level is increased or decreased. At the same time, a process of switching the player icon image according to the tempo is performed, and the process proceeds to S114.
[0065]
During the musical sound generation period of each performance part, the player icon is moved by switching an image as shown in FIG. 17 representing the player icon of the performance part in accordance with the tempo. The start of musical tone generation is detected by detecting note-on of each performance part, and the end of musical tone generation is detected when note-on is not detected for a predetermined time.
[0066]
In S114, it is determined whether or not the mode is the first mode. When the mode is the first mode, the process proceeds to S115, and when the mode is the second mode, the process proceeds to S116.
In S115, the image of the conductor icon is always switched according to the tempo and the time signature, including when no musical tone is generated during the performance period, and the process returns to the main flowchart.
[0067]
The number of conductor icon images used for switching is determined according to the time signature. For example, in the case of 2 beats, the number of operation frames is set to 2, and two different images are periodically switched. The number of operation frames is three, and three different images are periodically switched. That is, the image of the conductor icon is switched at intervals that match the tempo, and the same image is repeated according to the time signature.
[0068]
In the second mode in S116, during the musical sound generation period of any one performance part, an image in which the conductor icon conductor direction changes in the direction of the player icon of the performance part during the musical sound generation period is displayed. Repeat the set of images to switch the images according to the tempo. For this purpose, multiple images showing the conduct of the conductor and multiple images with different conductor orientations are prepared, and the angle of the player icon position during the musical sound generation period is calculated from the conductor icon position. To select a set of images.
[0069]
As described above, since the pan setting state is known at the position of the player icon and the performance state is known from the movement of the player icon and the conductor icon, the state of the performance system can be visually recognized at a glance.
[0070]
Note that a spectator seat may be provided on the image representing the performance place to display the audience. A plurality of pieces of image data representing how the audience is making noise are prepared and stored in the performance place image data memory 4. When the frequency of occurrence of performance data such as key-on events is high, it is estimated that the performance is exciting. Thus, when a series of images in a state where the audience is noisy is sequentially switched to make the audience appear to be noisy, the sense of presence is further increased. In addition, when outputting sound effects such as applause sounds, it is possible to make the audience seem to make noise in the same manner.
[0071]
In the above description, the automatic accompaniment style setting, stage effect setting, key and time signature setting, and player (tone color) setting are set using the edit menu process. However, each icon may be displayed on the screen of the application window, and this icon may be selected with a mouse to display a pop-up menu for setting.
[0072]
In the above description, the performance of the music data for trial listening and the performance of the automatic accompaniment style are performed by the mouse operation of the play button in the same manner as normal music reproduction. However, when the automatic accompaniment style is set in the automatic accompaniment style dialog box in the edit menu, the automatic accompaniment style performance may be performed by clicking a viewing check button with a mouse. Similarly, when setting a timbre in the timbre change dialog box in the edit menu, the timbre may be viewed by clicking a viewing check button with a mouse.
[0073]
【The invention's effect】
As apparent from the above description, the present invention has an effect that the performance state and performance period of each performance part can be visually displayed by the change of the icon representing the tone color of the performance part. As a result, the user can visually grasp the performance part in which the musical sound is generated and the performance period while enjoying the flow of the music.
[Brief description of the drawings]
FIG. 1 is a functional block configuration diagram of a performance state visual display device for explaining an embodiment of a performance state visual display method of the present invention.
FIG. 2 is an explanatory diagram of a display screen for explaining an embodiment of the visual display method of the performance state of the present invention.
FIG. 3 is an explanatory diagram showing a specific example of a player icon.
FIG. 4 is an explanatory diagram showing a specific example of a conductor icon.
FIG. 5 is a hardware configuration diagram for explaining an embodiment of a visual display method of a performance state according to the present invention.
FIG. 6 is a main flowchart for explaining an embodiment of the visual display method of the performance state of the present invention.
FIG. 7 is a flowchart of a function selection step in S42 shown in FIG.
FIG. 8 is a first flowchart of an edit menu processing step of S52 shown in FIG.
FIG. 9 is a second flowchart of the edit menu processing step of S52 shown in FIG.
FIG. 10 is a flowchart of an operation instruction step in S43 shown in FIG.
FIG. 11 is a flowchart of a performance step of S44 shown in FIG.
FIG. 12 is an explanatory diagram of program selection.
FIG. 13 is an explanatory diagram of a relationship between an automatic accompaniment style and stage effect and an image of a performance place.
FIG. 14 is a first explanatory diagram of a method for setting music data for trial listening.
FIG. 15 is a second explanatory diagram of a method for setting trial music data.
FIG. 16 is an explanatory diagram of a first specific example of an image of a performance place where a player icon is arranged.
FIG. 17 is an explanatory diagram of a second specific example of an image of a performance place where a player icon is arranged.
FIG. 18 is an explanatory diagram of a third specific example of an image of a performance place where a player icon is arranged.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Performance part memory, 2 Conductor icon image data memory, 3 Player icon image data memory, 4 Performance place image data memory, 5 Image data synthetic | combination part, 6 Icon position setting part, 7 Pan setting part, 11 Image expressing a performance place , 13 Player icon A, 14 Player icon B, 15 Player icon C, 16 Mouse pointer, 17 Conductor icon

Claims (4)

A visual display method of a performance state for visually displaying a performance state when playing a musical tone of a tone assigned to one or a plurality of performance parts,
Identifying the tone of each of the one or more performance parts,
A step to set the time signature of the performance,
An icon representing the tone color of each performance part according to the identified tone color of each performance part, an icon representing the conductor, and an icon representing the tone color of each performance part, and Creating an image in which an icon representing the conductor is arranged;
During the performance period, switching the icon image representing the conductor to give movement to the icon representing the conductor;
Determining the number of images of the icon representing the conductor according to the set time signature of the performance;
A visual display method of a performance state characterized by comprising: A visual display method of a performance state for visually displaying a performance state when playing a musical tone of a tone assigned to one or a plurality of performance parts,
Identifying the tone of each of the one or more performance parts,
A step to set the time signature of the performance,
An icon representing the tone color of each performance part according to the identified tone color of each performance part, an icon representing the conductor, and an icon representing the tone color of each performance part, and Creating an image in which an icon representing the conductor is arranged;
During the performing period, among the icons representing the tone of the previous SL each playing part, together with the switch to set the icon image representing the conductor facing the direction of the icon representing the performance part in tone generation, switching sets Switching the image of the icon representing the conductor to give movement to the icon representing the conductor;
Determining the number of images of the icon representing the conductor according to the set time signature of the performance;
A visual display method of a performance state characterized by comprising: A recording medium storing a performance state visual display program for visually displaying a performance state when playing a musical tone assigned to one or a plurality of performance parts.
Identifying the tone of each of the one or more performance parts,
A step to set the time signature of the performance,
An icon representing the tone color of each performance part according to the identified tone color of each performance part, an icon representing the conductor, and an icon representing the tone color of each performance part, and Creating an image in which an icon representing the conductor is arranged;
During the performance period, switching the icon image representing the conductor to give movement to the icon representing the conductor;
Determining the number of images of the icon representing the conductor according to the set time signature of the performance;
A recording medium in which a visual display program of a performance state for causing a computer to execute is stored. A recording medium storing a performance state visual display program for visually displaying a performance state when playing a musical tone assigned to one or a plurality of performance parts.
Identifying the tone of each of the one or more performance parts,
A step to set the time signature of the performance,
An icon representing the tone color of each performance part according to the identified tone color of each performance part, an icon representing the conductor, and an icon representing the tone color of each performance part, and Creating an image in which an icon representing the conductor is arranged;
During the performing period, among the icons representing the tone of the previous SL each playing part, together with the switch to set the images of icons to represent the conductor facing the direction of the icon representing the performance part in tone generation, switching Switching the image of the icon representing the conductor constituting the set to give movement to the icon representing the conductor;
Determining the number of images of the icon representing the conductor according to the set time signature of the performance;
A recording medium in which a visual display program of a performance state for causing a computer to execute is stored.

Images