JP7404737B2 - Automatic performance device, electronic musical instrument, method and program - Google Patents

Description

The present invention relates to an automatic performance device, an electronic musical instrument, a method, and a program.

Automatic performance devices (sequencers) are widely used as one function of electronic keyboard instruments, as dedicated built-in equipment, or in the form of computer software. This type of device plays music by passing performance information recorded in, for example, a data file (Standard MIDI File: SMF) based on the MIDI (Musical Instruments Digital Interface) standard to a sound source module and generating sound. In particular, it is increasingly being used in dance music such as EDM (Electronic Dance Music).

Sidechaining, or ducking, is a method of processing sound, often used in EDM. This mainly works in conjunction with the sound of the kick (bass drum) and lowers the volume of other parts, thereby emphasizing the sound of the kick and making the beat stand out.

Patent Document 1 discloses metadata for ducking control. This document describes the inclusion of ducking values within audio assets representing pieces of sound program content.

Special table 2017-509932 publication

Sidechaining or ducking (hereinafter collectively referred to as sidechaining) is said to be effective when applied to relatively long sounds (long note values), such as pads and strings. This is because when a side chain is applied to a note with a short note value, the duration of the sound itself is short, so the pronunciation ends while the volume is decreasing, resulting in an incomplete phrase.

However, it is difficult for beginners of music production to judge which part should be effectively sidechained. Additionally, music creators often do not want the sidechain effect to lower the volume of all parts other than the kick. In order to improve the quality of music, it is necessary to specify whether the side chain is on or off for each note, but this places a heavy burden on creators. This is particularly noticeable when there is a phrase that includes a mixture of long and short sounds in one part, and is a factor that discourages creators.

The present invention was made against the above background, and an object thereof is to provide an automatic performance device, an electronic musical instrument, a method, and a program that can easily realize an effective side chain.

The automatic performance device according to the embodiment includes a sound source and a processor. The processor generates a sound of a second sound included in a part other than the first part, which is sounded superimposed on the sound of the first sound included in the first part of the song data having multiple parts including the first part. It is determined whether the value is longer than a preset threshold. Further, if the processor determines that the second sound is long, the second sound is outputted at the same time as the first sound during at least a part of the period corresponding to the sound value of the second sound. The sound source is made to produce sound at a lower volume than the volume set in the song data as the sound volume of the two sounds, and if it is not determined to be long, at least one of the periods corresponding to the note value of the second sound. In the period of 1, the second sound is caused to be emitted by the sound source at the sound volume set in the song data at the sound generation timing of the first sound .

According to this invention, an effective side chain can be easily realized.

FIG. 1 is an external view showing an example of an electronic musical instrument according to an embodiment. FIG. 2 is a block diagram illustrating an example of a control system for an electronic keyboard instrument according to an embodiment. FIG. 3 is a functional block diagram showing an example of processing functions of the CPU 111 and contents stored in the ROM 106 according to the embodiment. FIG. 4A is a schematic diagram showing the waveforms of the kick and other parts when the side chain is disabled. FIG. 4B is a schematic diagram showing the waveforms of the kick and other parts when the side chain is enabled. FIG. 5 is a diagram for explaining the relationship between Duration and Threshold in the embodiment. FIG. 6 is a flowchart illustrating an example of a procedure related to threshold setting in the embodiment. FIG. 7 is a flowchart showing the procedure for acquiring the duration of the reproduced sound of a part that is not a key part. FIG. 8 is a flowchart illustrating an example of a processing procedure when reproducing an automatic performance. FIG. 9 is a flowchart illustrating an example of a processing procedure related to changing the volume using SideExp. FIG. 10 is a schematic diagram for explaining that the volume of the ducking target part changes over time. FIG. 11 is a flowchart for explaining the sound volume changing process in step S15 of FIGS. 8 and 9. FIG. 12 is a flowchart for explaining the effects of the first embodiment. FIG. 13 is an external view showing an example of an information device equipped with sequencer software. FIG. 14 is a functional block diagram showing an example of the information device 200. FIG. 15 is a diagram for explaining icons and operations displayed on the display panel 204 of the information device 200. FIG. 16 is a diagram illustrating an example of a settings window displayed as a pop-up on the information device 200.

Embodiments according to one aspect of the present invention will be described below with reference to the drawings. The embodiments described below are merely illustrative of the present invention in all respects, and various improvements and modifications can be made without departing from the scope of the present invention. That is, when implementing the present invention, specific configurations depending on the embodiments may be adopted as appropriate.

[First embodiment]
<Appearance and keyboard>
FIG. 1 is an external view showing an example of an electronic musical instrument according to the first embodiment. In the first embodiment, a digital keyboard 100 is assumed as an electronic musical instrument. The digital keyboard 100 includes a keyboard 101, a first switch panel 102, a second switch panel 103, and an LCD (Liquid Crystal Display) 104.

Keyboard 101 is a collection of multiple keys. Each key is an operator for specifying pitch. By embedding a light-emitting diode in each key and lighting it up, it can also serve as a performance guide.

The keyboard 101 includes a chord input keyboard 101a and a melody input keyboard 101b provided on the treble side of the chord input keyboard 101a. The chord input keyboard 101a is pressed with the left hand to specify a bass note or chord in automatic accompaniment. The melody input keyboard 101b is played with the right hand to play the melody. The split point, which is the boundary between the chord input keyboard 101a and the melody input keyboard 101b, is preset to the key of pitch F3, for example. Some models allow you to change the split point.

The first switch panel 102 is a user interface for instructing various settings such as specifying the volume, setting the tempo of automatic performance, and starting automatic performance. The second switch panel 103 is used to select various modes, select automatic performance music, select tone colors, and the like. The LCD 104 functions as a display unit that displays automatic accompaniment, lyrics during automatic performance, and various setting information. Further, the digital keyboard 100 may be provided with a speaker (sounding section) on the back, side, or rear surface of the keyboard 100 for producing musical tones generated by performance.

<Configuration>
FIG. 2 is a block diagram showing an example of the digital keyboard 100 according to the first embodiment. The digital keyboard 100 includes a RAM (Random Access Memory) 105, a ROM (Read Only Memory) 106, an LCD 104, an LCD controller 107, an LED (Light Emitting Diode) controller 108, a keyboard 101, a first switch panel 102, and a second switch. It includes a panel 103, a key scanner 109, a MIDI interface (I/F) 110, a system bus 117, a CPU (Central Processing Unit) 111, a timer 112, a sound source system 300, and a sound system 400.
The sound source system 300 includes a sound source 113 implemented as, for example, a DSP (Digital Signal Processor) and an effector 115. Sound system 400 includes a digital-to-analog converter 114 and an amplifier 116.

The CPU 111, ROM 106, RAM 105, sound source 113, digital-to-analog converter 114, effector 115, key scanner 109, LED controller 108, LCD controller 107, and MIDI interface 110 are each connected to a system bus 117.

CPU 111 is a processor that controls digital keyboard 100. That is, the CPU 111 reads out the program stored in the ROM 106 into the RAM 105 as a working memory and executes it to realize various functions of the digital keyboard 100. The CPU 111 operates according to the clock supplied from the timer 112. The clock is used, for example, to control automatic performance and automatic accompaniment sequences.

The ROM 106 stores programs that implement the processing according to the first embodiment, various setting data, automatic accompaniment data, and the like. The automatic accompaniment data may include preset rhythm patterns, chord progressions, bass patterns, melody data such as obbligado, and the like. The melody data may include pitch information of each note, pronunciation timing information of each note, and the like.

The sound generation timing of each sound may be the interval time between each sound, or may be the elapsed time from the start of the automatically played music. A tick is often used as a unit of time. A tick is a unit used in general sequencers and is based on the tempo of a song. For example, if the resolution of the sequencer is 480, 1/480 of the time of a quarter note is one tick.

The automatic accompaniment data is not limited to the ROM 106, and may be stored in an information storage device or an information storage medium (not shown). The format of the automatic accompaniment data may be based on a MIDI file format.

The sound source 113 is a so-called GM sound source that complies with, for example, the GM (General MIDI) standard. With this type of sound source, you can change the tone by sending a program change as a MIDI message, and you can control a predetermined effect by sending a control change.

The sound source 113 has the ability to generate up to 256 voices at the same time, for example. The sound source 113 reads musical tone waveform data from, for example, a waveform ROM (not shown) and outputs it to the effector 115 as digital musical tone waveform data. The effector 115 processes the digital musical tone waveform data and adds various effects. Typical examples include equalizers that emphasize specific bands, choruses that layer slightly shifted sounds, and delays that create echo effects. The effected wet sound or the no-effect dry sound is output to the digital-to-analog converter 114 as digital music waveform data.

The digital-to-analog converter 114 converts digital tone waveform data into an analog tone waveform signal. The analog musical waveform signal is amplified by the amplifier 116 and output from a speaker or an output terminal (not shown).

In the first embodiment, a compressor is assumed as the effector 115. A compressor is a typical type of model called a dynamics type, and has the effect of making the sound more uniform by suppressing the amplification factor of sounds that exceed a certain level.

Note that, instead of using the effector 115, effects can also be obtained by controlling the sound source 113 using MIDI messages. For example, portamento can be turned on/off by a control change as a MIDI message, and the degree of application (portamento time) can be specified in increments of 0 to 127. Various effects such as reverb, tremolo, chorus, and celeste are also defined in MIDI. Effects such as brightness and modulation can also be controlled with control changes. Furthermore, the effects obtained by operating the pitch bender and modulation wheel can also be controlled with control changes.

The key scanner 109 regularly monitors the pressed/released states of the keyboard 101 and the switch operation states of the first switch panel 102 and the second switch panel 103. The key scanner 109 then informs the CPU 111 of the states of the keyboard 101, first switch panel 102, and second switch panel 103.

The LED controller 108 is, for example, an IC (Integrated Circuit). The LED controller 108 illuminates the keys of the keyboard 101 according to instructions from the CPU 111 to guide the performer's performance. The LCD controller 107 is an IC that controls the display state of the LCD 104.

The MIDI interface 110 inputs MIDI messages (performance data, etc.) from an external device such as the MIDI device 4, and outputs MIDI messages to the external device. The digital keyboard 100 can exchange MIDI messages and MIDI data files with an external device using an interface such as a USB (Universal Serial Bus). The received MIDI message is passed to the sound source 113 via the CPU 111. The sound source 113 produces sounds according to the tone, volume, timing, etc. specified by the MIDI message.

A storage device 3 as a removable medium may be connected to the system bus 117 via, for example, a USB. Examples of the storage device 3 include a USB memory, a flexible disk drive (FDD), a hard disk drive (HDD), a CD-ROM drive, and a magneto-optical disk (MO) drive. When the program is not stored in the ROM 106, the program is stored in the storage device 3 and read into the RAM 105, thereby causing the CPU 111 to perform the same operation as when the program is stored in the ROM 106. I can do it.

In the above configuration, the RAM 105, ROM 106, system bus 117, CPU 111, timer 112, sound source system 300, and sound system 400 realize the function of an automatic performance device. The digital keyboard 100 is an electronic musical instrument that includes this automatic performance device and a keyboard 101 as an operator.

FIG. 3 is a functional block diagram showing an example of processing functions of the CPU 111 and contents stored in the ROM 106 according to the first embodiment.
In addition to the program 106a that realizes the processing functions of the CPU 111, the ROM 106 stores preset music data a1 to an set in advance at the time of factory shipment, user music data b1 to bm composed by the user, and a threshold value (Threshold). 106b. The preset music data and user music data are, for example, a collection of MIDI data created for each of a plurality of parts. The plurality of parts includes at least a first part and a second part.

In the embodiment, [part] and [track] will be explained as follows. Under the MIDI standard, a [track] is often associated with one musical instrument. However, regarding the drum track, multiple percussion instruments are associated with one track. For example, kick, tom-tom, snare, ride cymbal, hi-hat, crash cymbal, etc. are all different parts of one drum track. In consideration of such standard conventions, in the embodiment, for drum tracks, individual musical instruments are referred to as "parts", and for other tracks, "parts" and "tracks" are synonymous.

In the embodiment, the first part is assumed to be a kick part of a drum track. By the way, in the GM sound source, the kick part corresponds to note number 35 (Acoustic Bass Drum) or 36 (Bass Drum) in the drum set. The second part is, for example, strings, pads, organ, or bass part (track).

The threshold value 106b is set in advance by a user operation using, for example, the first switch panel 102 or the second switch panel 103. The threshold value 106b is compared with the length of each musical note produced by the sound source 113. In the embodiment, when the kick part is produced, at least part of the period of the sound produced for a period longer than the threshold value 106b is muted. In other words, it gives a side chain effect. As a unit for the length of a sound, a note value expressed by notation on a musical note, an absolute value of a sounding period (milliseconds, etc.), a tick, or the like can be adopted.

<About the functions of CPU111>
The CPU 111 includes a reproduction control section 111a, a threshold setting section 111b, and a side chain control section 111c as processing functions related to the first embodiment. These functions are realized by the program 500.

The playback control unit 111a instructs the sound source 113 to start playing a song specified by a user operation using, for example, the first switch panel 102 or the second switch panel 103. That is, the playback control unit 111a reads the selected preset music data or user music data from the ROM 106. Furthermore, the playback control unit 111a passes the MIDI message included in the read song data to the sound source system 300 at a specified timing. The sound source system 300 converts the acquired MIDI data into audio data for each part and outputs it to the sound system 400.

The threshold setting unit 111b accepts threshold setting by the user, and stores the input value in the ROM 106 as the threshold 106b. The threshold value may be set automatically by the CPU 111 by analyzing the song data (for example, obtaining each note value from the interval between each note in the kick part included in the song data). good.

When the playback control unit 111a starts playing the song data, the side chain control unit 111c controls the side chain control unit 111c to generate other parts that are sounded superimposed on the first note included in the first part (kick) of the song data. The magnitude relationship between the sound value of the sound (second sound) included in the second sound and the threshold value 106b is compared. Then, if the sound value of the second sound is longer than the threshold value 106b, the second sound is weakened.

In order to weaken the sound, a method of suppressing the volume by giving an instruction to the sound source system 300 and, for example, momentarily lowering the limit level of a compressor (effector 115) can be considered. In addition, the velocity values of the song data may be directly rewritten. In other words, muting can be said to be reproducing a musical tone at a volume lower than the intensity (velocity) originally given in MIDI data.

The period of attenuation is at least a portion of the sounding period given to the second sound, that is, the period corresponding to the sound value of the second sound. Through the above processing, ducking, that is, a side chain effect can be applied to the second sound.

FIGS. 4A and 4B are schematic diagrams for explaining the side chain effect in detail. To obtain a sidechain effect, specify the first part/track whose sound you want to emphasize (the key part/track of the sidechain) and the second part/track you want to duck, and use an effect similar to a compressor to create a second part/track. It is common to control the volume of a part.

Here, the first part/track whose sound is to be emphasized (the part/track that is the key of the side chain) is referred to as a key part in the embodiment.

As shown in FIG. 4A, when the side chain is disabled, the volumes of other parts do not change regardless of changes in the volume (waveform diagram) of the kick part. On the other hand, as shown in FIG. 4B, if the side chain is enabled, the volumes of parts other than the kick part are muted in synchronization with the maximum volume (attack) of the kick part. In the weakened waveform diagram (other parts), the volume becomes zero (muted) at the moment of the kick attack, and then the volume gradually recovers and reaches the normal level near the point where the kick volume reaches zero. By changing the waveform in this way, you can make the outline of the kick attack sound stand out, creating a typical sidechain effect.

<About the relationship between Duration and Threshold>
FIG. 5 is a diagram for explaining the relationship between Duration and Threshold in the embodiment. Threshold means a threshold value, whereas Duration means a pronunciation period. The musical score in FIG. 5(a) can be represented by a piano roll shown in FIG. 5(b). The note value of each note, such as a quarter note, an eighth note, and a half note, is expressed by the length of the horizontal axis on the piano roll.

Here, it is assumed that an eighth note is set as the Threshold. If the song data in FIG. 5(a) is played back under these settings, the side chain control unit 111c controls each sound of C3, D3, E3, F3, G3, A3, B3, and C4. Then, compare its Duration and Threshold. This can be done, for example, by reading the Duration written in the MIDI message of each sound and comparing that value with the Threshold value. Then, the side chain control unit 111c applies ducking to a sound for which Duration≧Threshold holds true. In FIG. 5, ducking is applied only to C3 and C4. Next, the operation of the above configuration will be explained.

<Effect>
FIG. 6 is a flowchart illustrating an example of a procedure related to threshold setting in the embodiment. In FIG. 6, the threshold setting unit 111b waits for a user to input a Threshold (step S1). When it is detected that the Threshold has been input by the user (Yes in step S1), the threshold setting unit 111b sets the given Threshold value in a specific storage area of the ROM 106 (Step S2).

On the other hand, regarding Duration, the values in parts other than the key part, that is, the Nth part (N≠1) have meaning. In the embodiment, each part other than the key part is assigned a buffer (Duration) that holds the length of the currently sounding note. The actual state of this buffer is, for example, a predetermined storage area of the RAM 105, and the duration is acquired and set in the buffer when each part is sounded.

As shown in FIG. 7, when the performance data of the Nth part (N≠1) is played back after the performance playback is started (step S3), the Duration of this Nth part is acquired from the performance data. , is set in the buffer (step S4).

FIG. 8 is a flowchart illustrating an example of a processing procedure when reproducing an automatic performance. In FIG. 8, when the performance data of the first part, that is, the kick that is the key part, is played back (step S10), the side chain control unit 111c assigns 2 to N (N=2), and starts the volume from the second part. Processing related to control is started (step S11). If the Nth part is not being sounded (No in step S12), the side chain control unit 111c increments N (step S17), and the processing procedure returns to step S12.

If the Nth part is being sounded (Yes in step S12), the side chain control unit 111c compares the buffered Duration of the Nth part with the set threshold (step S13).

If Duration<Threshold (No in step S13), the side chain control unit 111c excludes the Nth part from being side chained, and increments N without changing the volume (normal sounding) (step S17). ), the processing procedure returns to step S12.

On the other hand, if Duration≧Threshold (Yes in step S13), the side chain control unit 111c assigns 0 to SideExp, which is a parameter related to volume setting (SideExp=0) (step S14), and then performs sound volume change processing. (Step S15). Note that the process in step S15 will be explained with reference to FIG. 11. The above procedure is then repeated until the processing is completed for all parts of the reproduced music (Yes in step S16).

In the description of the embodiment, [SideExp] will be introduced as an index indicating the expression value related to the side chain. These parameters are defined for each part and are temporarily stored in a predetermined storage area of the RAM 105, for example. The volume of each part increases or decreases depending on the value of SideExp. If SideExp=0, the volume is zero, and as the value of SideExp increases in the positive direction, the volume of the part concerned increases. The maximum value of SideExp is, for example, 100.

FIG. 9 is a diagram illustrating an example of a processing procedure related to changing the volume using SideExp. The flowchart shown in FIG. 9 is called at regular intervals by a trigger such as a hardware interrupt during performance playback. In FIG. 9, it is determined whether the value of SideExp is a normal value (default) (step S20). Here, SideExp=100 is set as default. If SideExp=100, the process exits, and if SideExp≠100 (No in step S20), the side chain control unit 111c determines the elapsed time since the value of SideExp was changed (step S21). For example, by defining SideExp as a structure containing its value and change time (time stamp), and referring to this structure in step S21, the change time of the value of SideExp can be obtained.

If, for example, 5 milliseconds (ms) have elapsed in step S21 (Yes), the side chain control unit 111c adds a certain value (for example, 1) to SideExp (step S22), and the processing procedure is to change the sound volume. The process proceeds to step S15.

As shown in FIG. 10, the volume (SideExp=0) that once became zero according to the processing procedure in FIG. Return to 0). To the listener's ears, the kick attack is emphasized while the volume of the other parts linearly returns to the original volume.

Of course, the amount of step-up and return time can be arbitrarily determined by the user. When the volume return time is set by the user, the increment X of the step-up period of SideExp can be determined by dividing the value by 100, for example.
X=(Volume return time/100) ... (1)
FIG. 11 is a flowchart for explaining the sound volume changing process in step S15. In FIG. 11, the side chain control unit 111c multiplies the set volume value of the ducking target part by the value of SideExp at that time to calculate the sound volume value (step S151). Next, the side chain control unit 111c sets the sound volume of the part concerned to the magnitude of the sound sound volume value calculated above (step S11).

Specifically, the volume of the ducking target part can be controlled by changing the gain of the compressor of the effector 115 (FIG. 2) according to the sound volume value. Alternatively, the volume of the part can be similarly controlled by giving the sound source 204 a MIDI control change that includes a velocity changed according to the sound volume value.

<Effect>
FIG. 12 is a flowchart for explaining the effects of the first embodiment. In FIG. 12, the passage of time is indicated by rightward arrows, and the volume of each part is schematically indicated vertically. In FIG. 12, the key part, the kick (□), beats regularly over time at a constant tempo (for example, a 4-minute beat).

Assume that strings (part 2), organ (part 3), and bass (part 4) are recorded as parts other than the kick. In (1), third chain processing is started at the timing of a key part (kick). Strings have long note values as shown in (2), and Duration≧Threshold holds true, so a side chain occurs. In other words, the sound is weakened at the timing of the kick, and after being muted, the volume gradually recovers.

Since the organ is played with short note values as shown in (3), Duration<Threshold, and no side chain occurs.

The bass part plays a mixture of short notes and long notes. Conventionally, in such cases, it was necessary to enable/disable the side chain for each note and to set the volume return time in detail, which required a lot of effort and burden on the user.

On the other hand, in the embodiment, a side chain effect is automatically applied as shown in the strings and bass parts of FIG. That is, it is possible to automatically apply a side chain effect according to the duration of the produced sound. Users can make their composed songs sound like dance music with simple operations.

As described above, in the first embodiment, a threshold for setting the enable/disable of the side chain is set in advance, and when a key part (for example, a kick part) is produced, other parts are The magnitude of the sounding length (Duration) and the threshold value is determined. Then, a side chain effect is applied to the pronunciation of the part whose pronunciation length is equal to or greater than the threshold value, and no side chain effect is applied to the pronunciation of the part whose pronunciation length is shorter than the threshold value.

With this arrangement, it is automatically determined whether or not to apply the side chain effect, depending on the length of the sound. Therefore, the burden on the user is dramatically reduced, and even a beginner in music production can easily create a side chain effect that suits the performance of the track. In other words, regardless of the user's music production skills, it becomes possible to produce music using an effective side chain. Also, even if you are not a beginner, you can apply side chain effects to tracks with mixed long and short sounds without having to manually set them.

For these reasons, according to the first embodiment, it is possible to provide an automatic performance device, an electronic musical instrument, a method, and a program that can easily realize an effective side chain.

[Second embodiment]
In the first embodiment, an example has been described in which the digital keyboard 100 is equipped with a side chain function and is combined with an automatic accompaniment function. In the second embodiment, an example will be described in which a side chain function is implemented in a music production application (sequencer software) installed on a computer, for example, in the form of a plug-in.

FIG. 13 is an external view showing an example of an information device equipped with sequencer software. In the second embodiment, a portable information device such as a smartphone or a tablet is assumed as the information device. Information device 200 includes a display panel 204 as an interactive user interface. In FIG. 13, an example of a GUI (Graphical User Interface) screen of the sequencer software is shown on the display panel 204. The GUI screen includes clickable buttons and a part information display area similar to a piano roll that displays information for each part.

FIG. 14 is a functional block diagram showing an example of the information device 200. The information device 200 includes a CPU 111, a ROM 106, a RAM 218, a display section 220, an operation section 222, a communication interface (communication I/F) section 224, a digital/analog converter (DAC) 228, and a speaker 230. These are connected to system bus 232. That is, the information device 200 is a computer that includes a CPU 111 as a processor, and a ROM 106 and a RAM 218 as memories. Note that a portion of the memory including the ROM 106 and the RAM 218 may be removable from the information device 200.

The display unit 220 displays various types of information on the display panel 204, and the operation unit 222 passes various types of operation information given from the display panel 204 to the CPU 111. The processing functions of the CPU 111 and the contents stored in the ROM 106 are the same as those shown in FIG.

The display panel 204 of the display unit 220 is a liquid crystal display, an organic EL display, or the like that can display characters, numbers, images, and the like. The display panel 204 displays various information based on input operations on the operation unit 222, processing executed inside the information device 200, and the like.

The operation unit 222 has a touch panel that is integrally provided with the operation switch 202 and the display panel 204, and converts operations such as touch, click, and swipe by the user into data and passes it to the CPU 111.

The communication I/F section 224 transmits and receives various data stored in the ROM 106 and the RAM 218 between the information device 200 and other communication devices. Here, the communication performed via the communication I/F unit 224 is performed by directly connecting the information device 200 and an external communication device to send and receive data by applying various wired or wireless communication methods, for example. It may be a device that sends and receives data via a network such as the Internet. Further, data may be exchanged using a storage medium such as a memory card.
The DAC 228 converts digital audio data into an analog signal and outputs the amplified sound from the speaker 132 when playing music on the information device 200 or making a phone call.

FIG. 15 is a diagram for explaining icons and operations displayed on the display panel 204 of the information device 200. In FIG. 15, when button (a) is tapped, a menu screen for specifying music data, etc. is opened. When a song is selected by the user on the menu screen, the title of the selected song is displayed in area (b). Moreover, the music data of the selected music is displayed in area (c).

Area (c) includes, for example, four small areas c1 to c4. In each of the small areas c1 to c4, performance data of parts 1 to 4 are displayed, for example, like a piano roll. For example, at the top of area (c), a number indicating the bar number is displayed. The performance starts, and as the bar progresses, area (c) scrolls to the left.
Note that for song data that includes only three parts or less, three small areas c1 to c3 are displayed. When song data including four or more parts is selected, for example, a vertical scroll button may be displayed to enable vertical scrolling.

For example, a button (d) and a button (e) are displayed on the left side of area (c), that is, in the scrolling direction. Button (d) is a button for specifying a key part (key part selection button), and is indicated by, for example, a key mark icon. The user taps the button (d) of the part that he/she wishes to designate as a key part. Then, the color of the tapped button (d) changes (indicated by hatching) and is set to be a key part.

Button (e) is a button (side chain part selection button) for specifying a part to which a side chain effect is to be applied, and is indicated by, for example, a chain mark icon. The user taps the button (e) of the part to which the side chain effect is to be applied. Then, the color of the tapped button (e) changes, and it is set to be the part to which a side chain will be applied. Note that due to exclusive control, side chain effects cannot be applied to key parts.
In the settings shown in FIG. 15, it can be seen that part 1 is a key part, and settings are made to impart a side chain effect to parts 2 and 3.

Button (f) is a button (Auto Side-Chain Execute) for specifying whether or not to apply a side-chain effect. When button (f) is tapped, new song data is automatically generated by applying a side chain effect to the currently selected song data. The part settings at that time follow the states of button (d) and button (e).

Button (g) is a button (Threshold Setting) for setting a threshold (Threshold) of the side chain effect. When button (g) is tapped, a pop-up window as shown in FIG. 16, for example, is opened.

FIG. 16 is a diagram illustrating an example of a settings window displayed as a pop-up on the information device 200. In FIG. 16, the side chain can be turned on or off using a slide button on the GUI. Further, the value of Threshold can be set as a note value such as a sixteenth note, an eighth note, or a quarter note. Of course, the Threshold may be set using a numerical value in units of ticks, for example. For example, when the length of a quarter note is 96 ticks, it can be seen in FIG. 16 that a slightly shorter length is set as the Threshold.

As described above, in the second embodiment, functions related to automatic sidechain can be implemented in the form of a plug-in of music production software, for example. As a result, the second embodiment can also provide an automatic performance device, an electronic musical instrument, a method, and a program that can easily implement an effective side chain.

Note that this invention is not limited to the above embodiments.
For example, the functions of the sound source 113 can be implemented as software that utilizes the computational resources of the CPU 111. Furthermore, it is of course possible to control the sound source 113 using a control message based on an original standard instead of a MIDI message, and it is not essential that the sound source 113 conform to the MIDI standard.
Furthermore, in the embodiment, a mode has been described in which instructions are given to the sound source 113 to change musical tones. The musical tone is not limited to this, and can also be changed by controlling the effector 115.
Further, although the key part is the kick, the key part is not limited to this, and for example, a snare drum may be used as the key part. At present, it is common to use the beat instrument located on the strong beat as the key part, but this is not the only option; any part may be made the key part according to the creativity of the creator. Furthermore, both the kick and snare drum may be used as key parts.

Furthermore, the present invention is applicable not only to the information equipment of the form shown in the second embodiment but also to music production environments known as so-called DTM (Desk Top Music) and DAW (Digital Audio Workstation). Is possible.

As described above, the present invention is not limited to specific embodiments, and the technical scope of the present invention includes various modifications and improvements within the scope of achieving the objectives of the present invention. This will be clear to a person skilled in the art from the description of the claims.

Below, the invention described in the claims first attached to the application of this application will be added. The claim numbers stated in the supplementary notes are as in the claims originally attached to the request for this application.
<Claim 1>
sound source and
a processor, the processor comprising:
The sound value of a second sound included in a part other than the first part that is pronounced superimposed on the first sound included in the first part of the song data having multiple parts including the first part, Determine whether it is longer than a preset threshold,
If it is determined that the second sound is long, the second sound is set in the song data as the pronunciation volume of the second sound for at least part of the period corresponding to the note value of the second sound. causing the sound source to produce sound at a lower volume than the volume;
Automatic performance device.
<Claim 2>
The processor includes:
If it is determined that the second sound is long, instructing the sound source to apply a side chain effect to the pronunciation of the second sound;
The automatic performance device according to claim 1.
<Claim 3>
The processor includes:
instructing the sound source to produce the second sound at a volume set in the song data if the second sound is not determined to be long;
The automatic performance device according to claim 1 or 2.
<Claim 4>
The plurality of parts include a second part for which the processor determines that the sound value of the second sound is longer than the threshold, and a second part for which the processor determines that the sound value of the second sound is not longer than the threshold. The automatic performance device according to any one of claims 1 to 3, further comprising a third part to be determined.
<Claim 5>
The first part is a kick part,
5. The automatic performance device according to claim 1, wherein the other part includes a string part.
<Claim 6>
The automatic performance device according to any one of claims 1 to 5,
The operator and
including;
The processor includes:
instructing the sound source to start playing the song data in response to a user operation on the operator;
instructing the sound source to produce pronunciation at a specified pitch;
electronic musical instrument.
<Claim 7>
In the computer of the automatic performance device,
The sound value of a second sound included in a part other than the first part that is pronounced superimposed on the first sound included in the first part of the song data having multiple parts including the first part, determine whether the length is longer than a preset threshold,
If it is determined that the second sound is long, the second sound is set in the song data as the pronunciation volume of the second sound for at least part of the period corresponding to the note value of the second sound. Make the sound softer than the volume,
Method.
<Claim 8>
In the computer of the music generation device,
The sound value of the second sound included in a part other than the first part, which is pronounced superimposed on the pronunciation of the first sound included in the first part of the first song data having multiple parts including the first part. is longer than a preset threshold,
If it is determined that the second sound is long, the second sound is set in the first music data as the sounding volume of the second sound for at least part of the period corresponding to the note value of the second sound. Generates second song data that makes the sound softer than the current volume,
program.

3...Storage device 4...MIDI device 100...Digital keyboard 101...Keyboard 101a...Code input keyboard 101b...Melody input keyboard 102...Switch panel 103...Switch panel 105...RAM
106...ROM
106a...Program 106b...Threshold
107...LCD controller 108...LED controller 109...key scanner 110...MIDI interface 111...CPU
111a... Playback control section 111b... Value setting section 111c... Side chain control section 112... Timer 113... Sound source 114... Digital analog converter 115... Effector 116... Amplifier 117... System bus 132... Speaker 200... Information equipment 202... Operation switch 204... Display panel 218...RAM
220...Display unit 222...Operation unit 224...Communication interface unit 228...Digital/analog converter 230...Speaker 232...System bus 300...Sound source system 400...Sound system 500...Program a1-an...Preset song data b1-bm...User song data.

Claims (7)

sound source and
a processor, the processor comprising:
The sound value of a second sound included in a part other than the first part that is pronounced superimposed on the first sound included in the first part of the song data having multiple parts including the first part, Determine whether it is longer than a preset threshold,
If it is determined that the second sound is long, the second sound is sounded at the same time as the first sound, and the sound volume of the second sound is changed for at least part of the period corresponding to the sound value of the second sound. causing the sound source to produce sound at a lower volume than the volume set in the song data ,
If it is determined that the second sound is not long, the second sound is set in the song data at the timing of the first sound in at least part of the period corresponding to the note value of the second sound. cause the sound source to produce sound at a certain volume;
Automatic performance device. The processor includes:
If it is determined that the second sound is long, instructing the sound source to apply a side chain effect to the pronunciation of the second sound;
The automatic performance device according to claim 1. The plurality of parts include a second part for which the processor determines that the sound value of the second sound is longer than the threshold, and a second part for which the processor determines that the sound value of the second sound is not longer than the threshold. The automatic performance device according to claim 1 or 2 , further comprising a third part to be determined . The first part is a kick part,
4. The automatic performance device according to claim 1 , wherein the other part includes a string part . The automatic performance device according to any one of claims 1 to 4,
The operator and
including;
The processor includes:
instructing the sound source to start playing the song data in response to a user operation on the operator;
instructing the sound source to produce pronunciation at a specified pitch;
electronic musical instrument. In the computer of the automatic performance device,
The sound value of a second sound included in a part other than the first part that is pronounced superimposed on the pronunciation of the first sound included in the first part of the song data having multiple parts including the first part, determine whether the length is longer than a preset threshold,
If it is determined that the second sound is long, the second sound is sounded at the same sounding timing as the first sound, and the sounding volume of the second sound is increased during at least part of the period corresponding to the sound value of the second sound. , the volume is made weaker than the volume set in the song data,
If it is determined that the second sound is not long, the second sound is set in the song data at the timing of the first sound in at least part of the period corresponding to the note value of the second sound. to produce sound at the same volume,
Method. In the computer of the music generation device,
The sound value of the second sound included in a part other than the first part, which is pronounced superimposed on the pronunciation of the first sound included in the first part of the first song data having multiple parts including the first part. is longer than a preset threshold,
If it is determined that the second sound is long, the second sound is sounded at the same time as the first sound, and the sound volume of the second sound is changed for at least part of the period corresponding to the sound value of the second sound. generating second song data that makes the volume weaker than the volume set in the first song data,
If it is determined that the second sound is not long, the second sound is set in the first music data at the sounding timing of the first sound for at least a part of the period corresponding to the note value of the second sound. Generate the second song data to be played at the specified volume,
program.