JP2010139946A - Electronic musical instrument - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To verify a state of variation of stage illumination in accordance with musical performance through simulation in advance. <P>SOLUTION: A memory 6 is stored with musical information and corresponding illumination information for controlling an illumination device in chronological order. A CPU 2 retrieves the musical information from the memory 6, generates musical information display data for visualizing the retrieved musical information, and supplies them to a display controller 14. The CPU 2 also retrieves the illumination information from the memory 6, generates illumination information display data for visualizing the information, and supplies them to the display controller 14. The display controller 14 displays musical information indication and illumination information indication on the basis of the musical information display data and the illumination information display data on a display 34. The musical information indication and the illumination information indication are visualized on the same time axis by markers 44 and 46. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an electronic musical instrument, and more particularly, to an electronic musical instrument that can also produce effects using light.

  Conventionally, there is an apparatus disclosed in Patent Document 1 as an automatic performance apparatus capable of producing effects by light. In the technique of Patent Literature 1, when a performance is automatically performed based on automatic performance data, a light emitting element provided in the performance device emits light each time a sound is generated. A plurality of light emitting elements, R, G, and B, are provided, and the amount of light emitted by any of those colors is determined based on pitch information and tone color data of performance data. It is done.

Japanese Patent No. 3388530

  By applying the technique disclosed in Patent Document 1, it is also conceivable to perform an automatic performance with the stage illuminated by a lighting device, for example. Before actually performing on the stage or the like, there are times when it is desired to try a simulation of how the lighting is performed according to the performance. However, such a simulation cannot be performed by applying the technique of Patent Document 1.

  An object of the present invention is to provide an electronic musical instrument that can perform a simulation in advance when the lighting for production is changed according to performance.

  In the electronic musical instrument of one aspect of the present invention, music information is stored in the music information storage means in time series. The music information reading means reads the music information from the music information storage means. Music information visualization means generates music information display data for visualizing the read music information based on the music information. Illumination information for controlling the illumination means for effect used together with music is stored in the illumination information storage means in time series. The illumination information reading unit reads the illumination information from the illumination information storage unit. Illumination information visualization means generates illumination information display data for visualizing the read illumination information based on the illumination information. Based on the music information display data and the illumination information display data, the music information display and the illumination information display are displayed on one display means. The marker display means indicates the predetermined performance position on the music information display and the illumination information display.

  In the electronic musical instrument configured as described above, the music information display is visually displayed in time series on the display means, and the illumination information display is visually displayed in time series. Moreover, since the marker display means allows the user to visually recognize the correspondence between the music information display at the predetermined performance position and the lighting information display, it is possible to determine what type of music information is illuminated. It can be confirmed visually, for example, it can be simulated in advance how it is illuminated before performing a stage performance.

  The music information may be an automatic accompaniment pattern or automatic performance data. In this case, the music information visualization means generates score display data as the music information display data, and the score is displayed on the display means. As a musical score to be displayed, for example, a note or a piano roll can be used. Since the automatic accompaniment pattern and automatic performance data are displayed as musical scores, it is possible to easily visually confirm what kind of performance is being performed.

  The music information can be audio data. In this case, the music information visualization means generates waveform diagram display data as the music information display data, and the waveform diagram is displayed on the display means. By displaying the waveform diagram, the relationship between the accompaniment or performance volume and the lighting state can be easily confirmed.

  The illumination information visualization means can generate chart display data as the illumination information display data, and the display means can display a chart. With this configuration, it is possible to easily understand the relationship between the timing of sound generation of music information such as automatic accompaniment and automatic performance and the timing of change in lighting, and how the status of music information and lighting changes. It is possible to grasp what kind of music information and lighting are in a predetermined performance position after showing how to proceed.

  Similarly to the electronic musical instrument of the above aspect, the electronic musical instrument of another aspect of the present invention is a music information storage unit, a music information reading unit, a music information visualization unit, a lighting information storage unit, and a lighting information reading unit. Lighting information visualization means, and music information display and lighting information display based on the music information display data and the lighting information display data are displayed on one display means. A marker display means indicates a predetermined performance position on the music information display data. The illumination information visualization means generates graphic display data that simulates lighting and extinction modes of various illumination means controlled by the illumination information as the illumination information display data. With this configuration, when the music information is in a certain playing state, the actual lighting state is displayed in a simulated manner, so that the actual lighting state can be confirmed. The state can be understood intuitively.

  As described above, according to the present invention, it is possible to confirm beforehand by simulation that the lighting for production changes according to the performance.

  An automatic accompaniment apparatus according to an embodiment of the present invention is used in a stage performance, for example, and has a control means, for example, a CPU 2 as shown in FIG. The CPU 2 is connected to the memory 6, the keyboard 8, the user interface 10, the sound source 12, and the display controller 14 via the bus 4.

  The memory 6 stores an automatic accompaniment pattern database and an illumination pattern database, and functions as an automatic accompaniment pattern storage means and an illumination control pattern storage means.

  Various automatic accompaniment patterns are stored in the automatic accompaniment pattern database. Each automatic accompaniment pattern is provided for each of a plurality of basic styles, for example, Rock 1, Rock 2, Pop 1, Pop 2, Samba, Rumba, and in each style, a division such as intro, main, fill-in, ending, etc. Variations called arrangements are provided for each division, and patterns for the division * arrangement are stored in the automatic accompaniment pattern database for one style. Each of these division * arrangement patterns changes in time series.

  The user interface 10 includes, for example, a plurality of selection switches, the above-described style selection switch, intro, main, fill-in, and ending division selection switches, and a plurality of, for example, two arrangement Arrange A and Arrange B selection switches. have. By selecting these switches, the CPU 2 reads out the corresponding automatic performance pattern from the memory 6 and supplies it to the sound source 12. As the sound source 12, a PCM sound source that reads out, processes, and outputs waveform data, a DSP sound source that simulates a physical phenomenon, or the like can be used. The sound source 12 supplies sound generation data based on the automatic performance pattern supplied thereto to the D / A converter 16. The D / A converter 16 generates an analog automatic accompaniment signal from this data. The analog automatic accompaniment signal is amplified by an amplifier 18 provided outside the automatic accompaniment apparatus and supplied to the speaker 20. The user interface 10 functions as automatic accompaniment pattern instruction means, and the CPU 2 functions as automatic accompaniment pattern reading means and automatic accompaniment pattern output means. The sound source 12 and the D / A converter 16 function as automatic accompaniment means, for example, musical tone generation means.

  Specifically, before starting the performance, select the style you want to play with the style selection switch, and then operate the intro division selection switch to start the intro pattern of the specified measure, and then the corresponding main division Migrate to If the division selection switch is operated during automatic accompaniment, the automatic accompaniment pattern is switched. Alternatively, when the selection switches of the arrangements A and B are operated, the arrangement is changed to another arrangement of the current division.

  When a predetermined area of the keyboard 8, for example, the left hand operation area is operated while the automatic accompaniment is being performed in this way, the CPU 2 detects a chord and changes it in real time with respect to the accompaniment being performed. I do. For example, the pattern can be transposed according to the chord root based on the chord information, or various changes can be made based on the chord type (major, minor, seventh, etc.). Alternatively, the read pattern may be changed based on the code base or the inverted form. Thus, the keyboard 8 functions as chord information input means, and the CPU 2 also functions as automatic accompaniment pattern changing means.

  The illumination pattern database stored in the memory 6 stores illumination patterns corresponding to each automatic accompaniment pattern. The illumination pattern controls illumination means, for example, the projector 22, the smoke generator 24, and the plurality of lights 26. These are arranged in advance at different positions on the stage. The projector 22 is controlled by a GPU (graphics processing unit) 28, and the GPU 28 controls the projector 22 according to the illumination pattern read by the CPU 2. The smoke generator 24 and the plurality of lights 26 are controlled by the CPU 2 in the form of a DMX signal for illumination control. The plurality of lights 26 are arranged at different positions on the stage and emit light in various colors. The light 26 emits light, and the light emitted from the light 26 is controlled. The CPU 2 also functions as an illumination control pattern reading unit and an illumination control pattern output unit.

  FIG. 4 shows a part of an illumination pattern for controlling one of the plurality of lights 26. This pattern is the part that controls the change in the emission color during one measure. The light to be controlled here includes a large number of red, green and blue LEDs, and the brightness is controlled by the numerical value of the DMX signal from 0 to 255 for each LED group of the same color, and as a whole emits light in various colors. It is possible. In the DMX512 standard, a total of 512 channels can be controlled. If 3 of these channels are used, for example, red 255, green 255, and blue 255 are given, bright white light is obtained, and red 128, green 128, and blue 0 are given. Gives a slightly dark yellow light emission. TPQN (the length of one quarter note) is 96 Tick.

  Since each illumination pattern corresponds to an automatic accompaniment pattern, it is provided for each style described above, as in the case of the automatic accompaniment pattern. Have. The number of division * variation illumination patterns is based on the premise that the projector 22, smoke generator 24, and each light 26 described above are arranged at predetermined positions. In the pattern for each light, the light 26 at any position. Which sound of the automatic accompaniment pattern corresponding to the sound is emitted in what color with what light amount, and what image is generated at which sound of the automatic accompaniment pattern corresponding to the projector 22 is generated. And the sound generation timing of the automatic accompaniment pattern corresponding to the smoke generation device 24, the smoke generation device 24 generates the smoke, and the sound generation timing stops the smoke. . That is, the illumination pattern is also stored in time series. When an automatic accompaniment style is selected by the style selection switch, an illumination pattern corresponding to the selected style is selected. Next, when the division selection switch of the intro is operated, the illumination for the intro of the selected style is selected. Lighting is controlled according to the pattern, and then the main division lighting pattern of the selected style is executed.

  Note that the automatic accompaniment pattern for each division * variation number has the same length of time as the illumination pattern for each division * variation number corresponding thereto, and the lighting control mode is as described above according to the progress of the automatic accompaniment. Be changed.

  For example, FIG. 4 described above is a part of the illumination pattern, and is a part that controls the change in emission color during one measure, but the illumination is controlled over four measures, that is, 96 × 4 × 4 = 1536Tick as a whole. The automatic accompaniment pattern to which this illumination pattern corresponds is also configured to control automatic accompaniment over 1536Tick. FIG. 6 is a part of the automatic accompaniment pattern to which the illumination pattern of FIG. 4 corresponds, and is a part for instructing the pronunciation of the bass drum and the snare drum in the drum part of one measure. The numerical value represents the size of the sound (note-on-velocity value in MIDI signal, 0 to 127), and the sound generation time is predetermined as a predetermined value regardless of the tempo.

  When the division selection switch is operated during automatic accompaniment, the accompaniment pattern corresponding to the operated division selection switch is changed. At the same time, the illumination pattern is switched to one corresponding to the changed accompaniment pattern.

  As described above, when the CPU 2 detects a chord, the CPU 2 changes the illumination pattern in real time according to the detected chord. For example, the color generated by each light 26 is changed or the amount of light is changed. Therefore, the CPU 2 also functions as an illumination control pattern changing unit. The user interface 10 also includes an operator for adjusting the tempo, and by adjusting this, the tempo of the automatic accompaniment pattern being played at that time is changed and simultaneously executed at that time. The lighting pattern is also changed in synchronization with the tempo change. In addition, the lighting pattern is changed so that the most appropriate effect can be obtained by thinning out the number of lightings when the tempo is fast, or increasing the number of lightings when the tempo is slow.

  FIG. 5 shows the result of changing the illumination pattern shown in FIG. 4 by the illumination control pattern changing means. This is a process in the case where it is detected that a major chord is changed to a minor chord by the chord detection even with the same illumination pattern. In this case, with respect to the illumination pattern read by the illumination control pattern reading means, the illumination control pattern changing means subtracts the numerical value of the DMX signal for controlling the red LED group by 128 (however, the lower limit value is 0) to control the green LED group. The numerical value is increased by 128 (however, the upper limit value is 255), and the illumination control pattern output means outputs the changed pattern. The change of the illumination pattern may be performed by numerical calculation as described above, or may be converted by referring to a table. By comprising in this way, the illumination pattern which respond | corresponds to an automatic accompaniment and changes more complicated can be obtained.

  FIG. 2 is a flowchart showing processing performed by the CPU 2 of the automatic accompaniment apparatus. The CPU 2 executes an automatic accompaniment task shown on the left side of FIG. 2 and a lighting control task shown on the right side. When a style is selected by operating a style selection switch or the like of the user interface 10 (step S2) and an accompaniment configuration is selected, for example, a division or a variation is selected (step S8), the automatic accompaniment task automatically selects the memory 6 automatically. A corresponding automatic accompaniment pattern is selected from the accompaniment pattern database (step S4). Similarly, in the lighting control task, a corresponding lighting pattern is selected from the lighting pattern database (step S6).

  Next, when the tempo is adjusted (step S10) or the chord analysis (step S14) based on the performance input from the keyboard 8 (step S12) is performed, the accompaniment pattern is changed in the automatic accompaniment task. (Step S16) In the lighting control task, the lighting pattern is changed (Step S18).

  In the automatic accompaniment task, the accompaniment pattern is reproduced according to the automatic accompaniment clock (step S20), and in the illumination control task, the illumination pattern is reproduced according to the automatic accompaniment clock (step S22). Next, in the automatic accompaniment task, it is determined whether or not the performance information or the accompaniment configuration has been updated (step S24), and if not updated, the process is executed again from step S20, and if updated, the process is executed again from step S4. As a result, the accompaniment pattern is changed or a new accompaniment pattern is selected. Similarly, in the illumination control pattern, it is determined whether or not the performance information or the accompaniment configuration has been updated (step S26). If not updated, the process is executed again from step S22, and if updated, the process is executed again from step S6. Thereby, an illumination pattern is changed or a new illumination pattern is selected.

  As described above, the display controller 14 is connected to the bus 4, and the display controller 14 displays an image as shown in FIG. 3 on the display 34 provided in the automatic accompaniment apparatus according to an instruction from the CPU 2.

  In this image, a musical score display window 36 for displaying a musical score of an automatic accompaniment pattern to be automatically accompanied, an illumination pattern display window 38 for displaying an illumination pattern performed in accordance with the automatic accompaniment pattern, and an automatic accompaniment automatically performed. An accompaniment sound waveform display window 40 and an illumination simulation window 42 that displays how the illumination is changed according to the selected illumination pattern are displayed.

  In the illumination simulation window 42, a stage is schematically shown. In FIG. 3, a total of six lights 26 are shown at 1 to 6 at different positions on the stage. In this example, the lights 26 labeled 1 to 3 on the ceiling side of the stage are arranged so as to illuminate the stage with an interval, and the lights 4 to 6 are attached facing the ceiling side to the stage side. It is shown that the lights 26 arranged are arranged side by side. The lighting simulation window 42 also displays how lighting is performed in a state where these lights 26 emit light. In the example of FIG. 3, the lights 26 with the ceiling side codes 2 and 3 illuminate the stage side with different colors, and the lights 26 with the stage side codes 4 and 6 illuminate the ceiling side. It is shown that. That is, the illumination state is displayed graphically.

  How the lights 26 of the reference numerals 1 to 6 perform illumination is displayed in a graphic display, specifically in a tabular form, corresponding to the lights 26 of the reference numerals 1 to 6 in the illumination pattern display window 38. Has been. The automatic accompaniment score display window 36 displays, for example, a chord, bass and drum score used in automatic accompaniment. Each element of the illumination pattern in the illumination pattern display window 38 corresponds to each note in the score of the automatic accompaniment score display window. For example, the lights 26 denoted by reference numerals 1 and 2 are respectively a bass drum and a snare drum. The lighting state changes in synchronization with the sounding timing, for example, light is emitted only during the hatched period, and the light 26 with the reference numeral 3 changes its lighting state in synchronization with the base sounding timing, for example, the hatched line. Lights only for a period. Further, the illumination state of the lights 26 denoted by reference numerals 4, 5, and 6 changes depending on the code. For example, the amount of light changes as shown by the change in the density of the vertical lines. In addition, in the light 26 to which the code | symbol 1, 2, and 3 were attached | subjected, although the light emission period was shown with the oblique line, you may show these light emission colors with the light 26 corresponding. In addition, the change in the light amount of the light 26 denoted by reference numerals 4, 5, and 6 is indicated by the change in the density of the vertical lines, but the lightness of the corresponding light is changed in accordance with the change in the light amount of the corresponding light. You may let them.

  In the illumination pattern display window 38, the automatic accompaniment score display window 36, and the waveform display window 40, execution position display means, for example, markers 44, 46, and 48, are displayed. The marker 44 is changed in conjunction with each other, and the marker 44 indicates the lighting state of the light 26 denoted by reference numerals 1 to 6, and the marker 46 indicates which position on the score the automatic accompaniment is currently playing. The marker 48 indicates which part of the automatic accompaniment waveform is being played. These markers 44, 46, and 48 move in synchronization with time. Further, according to the movement of the marker 44, the illumination state in the illumination simulation window 42 changes so as to correspond to the illumination pattern at the position of the marker 44. For example, in FIG. 3, the marker 44 indicates that the light 26 denoted by reference numerals 2, 3, 4, and 6 is illuminated, but the illumination simulation window 42 is also denoted by reference numerals 2, 3, 4, and 6. This represents a state where the light 26 attached with is illuminated.

  Although not shown, when the automatic accompaniment sound and the illumination pattern are changed by changing the chord information, tempo or variation, the illumination pattern display window 38, the automatic accompaniment score display window 36, the waveform display window 40, and the illumination simulation window are displayed. The display at 42 is also corrected to the changed one. Therefore, before actually performing on the stage, it is possible to simulate the lighting state before and after changing the tempo and variation, and to check in advance the lighting state change due to the presence or absence of chord information. When the simulation is performed before the performance is actually performed, it is not necessary to supply the DMX signal from the CPU 2 to the smoke generator 24 and the light 26.

  In such a display, when the CPU 2 reads the automatic accompaniment pattern and the illumination pattern from the memory 6, a process that can be visualized from the automatic accompaniment pattern and the illumination pattern is performed, and the processed data is given to the display controller 14. By doing that. That is, the CPU 2 functions as a means for visualizing performance information and lighting information and a marker display means.

  In the above embodiment, the smoke generator 24 and the light 26 are controlled from the CPU 2 in the form of a DMX signal for illumination control. However, the smoke generator and the illumination drive power source are connected via a power switch, and the CPU 2 follows the illumination pattern. The power switch may be controlled, or the light and the illumination drive power supply may be connected via a voltage regulator, and the CPU 2 may control the voltage regulator according to the illumination pattern. It is also possible to control at least one of the projector 22, the smoke generator 24, and the light 26. In the above-described embodiment 26, an example in which the illumination range of the light 26 is not changed is shown. However, for example, the illumination range can be changed by providing the light 26 with pan and tilt functions. . Furthermore, in the above-described embodiment, an example in which the illumination control is changed at each sound generation timing based on the automatic accompaniment pattern is shown. However, during a certain automatic accompaniment pattern, a specific light 26 is kept on, During the next automatic accompaniment pattern to be played, the illumination can be controlled regardless of the generation of a sound that keeps another light 26 lit. In the above embodiment, the automatic accompaniment pattern and the illumination pattern are changed according to the input of the chord information. However, it is possible to change only the automatic accompaniment pattern and not change the illumination pattern.

  In the above embodiment, the score display window 36, the illumination pattern display window 38, the waveform display window 40, and the illumination simulation window 42 are displayed, but either the score display window 36 or the waveform display window 40, Only one of the illumination pattern display window 38 and the illumination simulation window 42 may be displayed. Further, a piano roll display window can be displayed instead of the score display window 36. In the above embodiment, the illumination control pattern and the automatic accompaniment pattern have been created and stored in advance. However, the user can add an appropriate user interface (input means) and storage means, You may make it the structure which can create or edit an automatic accompaniment.

  In the above embodiment, when the CPU 2 detects a chord, the automatic accompaniment pattern and the lighting pattern are changed in real time according to the detected chord information. The automatic accompaniment pattern or the illumination pattern can be changed according to the information obtained by detecting the progression pattern. By configuring in this way, there is an effect that the performance expression of the performer can be reflected in a complicated lighting effect.

  In the above embodiment, the number of lights to be controlled by the illumination control pattern output means and the number of the plurality of lights actually provided outside match, but not limited to this, the number of lights is reduced. You can also. In this case, the signal output in the DMX format includes a signal that is not received by any light. Conversely, the number of lights can be increased. In this case, there are a plurality of lights having the same reception channel setting, and if they are lights of the same specification, the light is controlled to be emitted in the same manner.

  The automatic accompaniment device is provided with a plurality of output modes to cope with cases where the number of illumination means set outside, for example, the number of lights is different, and is configured so that these can be switched according to the set light configuration. May be. For example, two lights are controlled in the first output mode, four lights are controlled in the second output mode, and eight lights are controlled in the third output mode. Different illumination patterns are stored in advance depending on the output mode. In addition, an illumination pattern corresponding to the output mode can be read out. Alternatively, only the illumination pattern of one output mode, for example, the illumination pattern for the third output mode is stored, and after reading, the change is made for the second output mode or the first output mode according to a predetermined rule. You may output after adding. This change may be performed by the illumination pattern reading unit, or may be performed by the illumination pattern changing unit. When configured in this way, not only is it synchronized with automatic accompaniment, but also lighting effects optimized for each stage, from a small stage with only a washer light to a large stage with a moving head and laser. Can be easily obtained.

  In the above embodiment, the illumination control pattern corresponding to the automatic accompaniment pattern on a one-to-one basis is stored. However, the present invention is not limited to this, and the number of illumination patterns is less than the number of divisions * variations, and a plurality of automatic accompaniment patterns is stored. May be associated with the same illumination pattern. If comprised in this way, there exists an effect that it can respond even when the memory capacity of an illumination pattern is not large.

  In the above embodiment, the present invention is implemented in an automatic accompaniment apparatus, but the present invention is not limited to this. For example, the present invention can also be implemented in an electronic musical instrument such as an automatic performance apparatus.

It is a block diagram of the automatic accompaniment apparatus of one Embodiment of this invention. It is a flowchart of the automatic accompaniment apparatus of FIG. It is a figure which shows the display of the display with which the automatic accompaniment apparatus of FIG. 1 is provided. It is a figure which shows a part of illumination pattern used in the automatic accompaniment apparatus of FIG. It is a figure which shows the state from which the illumination pattern of FIG. 4 was changed based on the chord detection. It is a figure which shows a part of automatic accompaniment pattern with which the illumination pattern of FIG. 4 respond | corresponds.

Explanation of symbols

2 CPU (music information readout means, illumination information readout means, music information visualization means, illumination information visualization means, marker display means)
6 Memory (music information storage means, lighting information storage means)
34 Display (display means)

Claims (5)

Music information storage means for storing music information in time series;
Music information reading means for reading the music information from the music information storage means;
Music information visualization means for generating music information display data for visualizing the read music information based on the music information;
Illumination information storage means for storing illumination information for controlling the illumination means for production used with music in time series;
Illumination information readout means for reading out the illumination information from the illumination information storage means;
Illumination information visualization means for generating illumination information display data for visualizing the read illumination information based on the illumination information;
With
Based on the music information display data and the lighting information display data, the music information display and the lighting information display are displayed on one display means, and a predetermined performance position is displayed on the music information display and the lighting information display. An electronic musical instrument comprising marker display means for indicating. The electronic musical instrument according to claim 1,
The music information is an automatic accompaniment pattern or automatic performance data, and the music information visualization means generates score display data as the music information display data, and the display means generates a score based on the score display data. An electronic musical instrument characterized by display. The electronic musical instrument according to claim 1,
The music information is audio data, the music information visualization means generates waveform diagram display data as the music information display data, and the display means displays a waveform diagram based on the waveform diagram display data. An electronic musical instrument characterized by   4. The electronic musical instrument according to claim 1, wherein the illumination information visualization means generates chart display data as the illumination information display data, and the display means displays a chart based on the chart display data. An electronic musical instrument characterized by that. Music information storage means for storing music information in time series;
Music information reading means for reading the music information from the music information storage means;
Music information visualization means for generating music information display data for visualizing the read music information based on the music information;
Illumination information storage means for storing illumination information for controlling the illumination means for production used with music in time series;
Illumination information readout means for reading out the illumination information from the illumination information storage means;
Illumination information visualization means for generating illumination information display data for visualizing the read illumination information based on the illumination information;
With
Marker display means for displaying the music information display and the lighting information display on one display means based on the music information display data and the lighting information display data, and indicating a predetermined performance position on the music information display data With
The illumination information visualization means generates, as the illumination information display data, graphic display data that simulates lighting and extinguishing modes at the predetermined performance position of the illumination means controlled by the illumination information. Electronic musical instrument.

Images