JP4514055B2 - Musical sound control device and musical sound control program - Google Patents

Description

  The present invention relates to a musical tone control device and a musical tone control program, and more particularly to a musical tone control device and a musical tone control program that can clearly hear a voice generated simultaneously with a musical tone.

  2. Description of the Related Art Conventionally, a musical sound control apparatus that generates a musical sound with a sound source simultaneously with singing in an electronic musical instrument or karaoke is known. In these musical tone control devices, various controls are performed so that a better performance can be performed.

  In Japanese Patent Laid-Open No. 8-69296 (Patent Document 1), singing voice and accompaniment sound are stored in a recording medium, and the level of singing voice input through a microphone is stored in the recording medium. A karaoke device is disclosed that performs control so as to increase when the voice of the singer is small.

Japanese Patent Laid-Open No. 2004-287171 discloses a formant characteristic in which a formant characteristic (frequency characteristic) of a musical tone signal such as an input voice is detected and a frequency characteristic of a musical tone generated by a performance operation such as a keyboard is detected. A vocoder device is disclosed that modulates in response.
JP-A-8-69296. JP 2004-287171 A

  However, in the above-described musical sound control device, when the voice level of the singer is low, it is automatically adjusted to an appropriate volume by being increased. However, after the voice level is detected, the volume adjustment is performed. Therefore, there is a problem that the sound volume is low and unclear when the sound rises, that is, when the utterance is started.

  In particular, when utterance of a sound starting from a consonant is started, there is a problem that the consonant part is not heard and lacks in clarity.

  In addition, when a voice is input and another musical tone is generated simultaneously with the musical tone modulated by the vocoder device, the musical tone modulated by the consonant portion of the voice is masked by the other musical tone and cannot be heard clearly. There was also a point.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a musical sound control device and a musical sound control program capable of clearly listening to utterances.

  In order to solve the above-mentioned problem, a musical tone control apparatus according to claim 1 is a voice input means for inputting voice, a musical sound generating means for generating a musical sound in accordance with performance information, and a voice input by the voice input means. And a musical sound generated by the musical sound generating means, a detection means for detecting the start of voice input to the voice input means, and a predetermined time from when the voice input start is detected by the detection means. Level control means for suppressing the level of the musical sound generated by the time and the musical sound generating means.

  3. A musical tone control apparatus according to claim 2, wherein a voice input means for inputting voice, and a vocoder for detecting a frequency characteristic of the voice inputted by the voice input means and modulating the musical tone in accordance with the detected frequency characteristic. Means for generating a musical sound in accordance with performance information, a musical sound output by the vocoder means and a musical sound generated by the musical sound generating means, and a voice to the voice input means Detecting means for detecting the input start of the sound, and level control means for suppressing the level of the musical sound generated by the musical sound generating means for a predetermined time from when the input start of the voice is detected by the detecting means.

  The musical tone control apparatus according to claim 3 is inputted by the voice input means for inputting voice, the musical sound generating means for generating the first musical sound and the second musical sound in accordance with the performance information, and the voice input means. The vocoder means for detecting the frequency characteristic of the voice and modulating the first musical sound generated by the musical sound generation means according to the detected frequency characteristic; the musical sound output by the vocoder means; and the musical sound generation means The generated second musical sound is output, a level detection means for detecting the level of the voice input by the voice input means, and a predetermined time after the level is detected by the level detection means, Level control means for controlling the level of the second musical sound based on the level.

  The musical tone control apparatus according to claim 4 is inputted by the voice input means for inputting voice, the musical sound generating means for generating the first musical sound and the second musical sound according to the performance information, and the voice input means. The vocoder means for detecting the frequency characteristic of the voice and modulating the first musical sound generated by the musical sound generation means according to the detected frequency characteristic; the musical sound output by the vocoder means; and the musical sound generation means The generated second musical sound, level detecting means for detecting the level of the musical sound output by the vocoder means, and a predetermined time after the level is detected by the level detecting means, Level control means for controlling the level of the second musical sound based on the level.

  The musical tone control program according to claim 5 is generated by a voice input means for inputting a voice, a musical sound generating means for generating a musical sound according to performance information, a voice inputted by the input means and the musical tone generating means. The voice control step is executed by a control means for controlling a musical sound control device that outputs a musical sound. The voice detection step for detecting the input start of the voice input by the input means, and the voice input start by the voice detection step. And a level control step for suppressing the level of the musical sound generated by the musical sound generating means for a predetermined time from the time of detection.

  According to the musical sound control apparatus according to claim 1 and 2, the detecting means for detecting the start of voice input to the voice input means, and the musical tone generating means for a predetermined time from when the voice input start is detected by the detecting means. Level control means for suppressing the level of the musical sound generated by the sound is prevented, so that the sound can be prevented from being masked by the musical sound generated by the musical sound generating means and can be heard clearly. In particular, the consonant at the start of utterance can be heard clearly.

  According to the musical tone control apparatus of the third aspect, the level detection means for detecting the level of the voice input by the voice input means, and a predetermined time after the level detection by the level detection means, based on the level. And a level control means for controlling the level of the second musical tone. Therefore, the level of the second musical tone is suppressed immediately after the voice is started, and the level of the second musical tone depends on the level of the voice after a predetermined time. Therefore, there is an effect that the voice immediately after the start of utterance can be heard clearly. In particular, the consonant at the start of utterance can be heard clearly.

  According to the musical tone control apparatus of the fourth aspect, the level detecting means for detecting the level of the musical sound output by the vocoder means, and the predetermined time after the level detecting means detects the level based on the level. 2 is provided with level control means for controlling the level of the second musical sound, so that when the musical sound is modulated by the vocoder means, it is possible to clearly hear the modulated musical sound immediately after the start of utterance. . In particular, the musical sound modulated by the consonant at the start of utterance can be heard clearly.

  According to the musical tone control program according to claim 5, a voice detecting step for detecting the input start of the voice input by the input means, and generation of a musical tone for a predetermined time from when the voice input start is detected by the voice detecting step. And a level control step for suppressing the level of the musical sound generated by the means. Therefore, there is an effect that the voice is prevented from being masked by the musical sound generated by the musical sound generating means and can be heard clearly. In particular, the consonant at the start of utterance can be heard clearly.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a block diagram showing an electrical configuration of an electronic musical instrument 1 having a musical tone control apparatus according to an embodiment of the present invention. The electronic musical instrument 1 includes a CPU 2, a ROM 3, a RAM 4, a controller 5, a keyboard 6, a sound source 7, a DSP 8, an A / D converter 9, a microphone 10, a D / A converter 11, An amplifier 12 and a speaker 13 are mainly provided. The CPU 2, the ROM 3, the RAM 4, the operator 5, the keyboard 6, the sound source 7, and the DSP 8 are connected to each other by a bus line.

  The CPU 2 is an arithmetic processing unit and performs various processes according to a control program stored in the ROM 3. The CPU 2 includes a timer 2a, and is configured to generate an interrupt to the CPU 2 when the time set by the CPU 2 is counted.

  The ROM 3 stores various control programs executed by the CPU 2 and fixed value data referred to during the execution. The RAM 4 is a memory for temporarily storing various data and the like when executing a control program stored in the ROM 3 or the like, and is configured to be rewritable.

  The operation element 5 includes switches for selecting various volumes, timbres, and the like, and a performance mode, parameters, timbres, and the like are set by being operated by a user. The performance mode includes a normal mode in which the sound source 7 generates a musical sound based on performance information performed by the keyboard 6, and a sound frequency generated by the sound source 7 based on the performance information performed by the keyboard 6, and the frequency of the sound input by the microphone 10. There are a vocoder mode for modulating the musical sound generated by the sound source 7 according to the characteristics, a karaoke mode for generating the accompaniment and inputting the singing voice from the microphone 10 by the automatic performance.

  When the vocoder mode is selected, a musical tone signal of a desired tone color is generated from the sound source 7 by playing the keyboard, and the musical tone signal is input to the vocoder unit 8a provided in the DSP 8. In the vocoder unit 8a, the voice input from the microphone 10 is converted into a digital signal by the A / D converter 9, the frequency characteristic of the voice is detected, and the musical sound signal input from the sound source 7 is converted into the voice signal. Is modulated on the basis of the frequency characteristics.

  Further, in this electronic musical instrument 1, when a keyboard is played, two kinds of musical tones are generated for one key signal, and one musical tone is subjected to vocoder processing by the vocoder unit 8a, and the other musical tone is obtained. It can be output as it is, or can be output to the D / A converter 11 by being synthesized with the musical sound that is effected by the effect imparting unit and processed by the vocoder unit 8a. In the present embodiment, this performance mode is referred to as a vocoder mode.

  The keyboard 6 has a plurality of white keys and black keys, and a performance operation is performed. A pitch for each semitone is assigned to each key. The sound source 7 has a waveform memory (not shown) that stores amplitude values for each sampling period representing a plurality of musical sound waveforms, and when one of the musical sound waveforms is selected by a tone color selection switch (not shown), the CPU 2 displays the waveform. Address is indicated. Further, the musical tone generated by the CPU 2 is instructed to specify the pitch and level, and the amplitude value is sequentially read from the selected waveform memory to generate a digital musical tone signal, which is supplied to the DSP 8.

  The DSP 8 is a digital signal processor, and as described above, the vocoder unit 8a that performs vocoder processing, the level detection unit 8b that detects the level (envelope) of sound input by the microphone 10, and the reverb. The effect provision part 8c which provides effects, such as these, is provided.

  The vocoder unit 8a mainly includes an analysis filter bank and a synthesis filter bank. The analysis filter bank divides a voice band into a plurality of bands, and a level is detected by a band pass filter for each band. The level for each frequency band detected by the filter bank is supplied as a modulation signal to the synthesis filter bank, and the synthesis filter bank divides the musical sound signal input from the sound source 7 into a plurality of frequency bands in the same manner as the analysis filter bank. Then, amplitude modulation is performed for each frequency band based on the level value supplied from the analysis filter bank. Therefore, the musical sound generated by the sound source 7 is modulated into a musical sound having frequency characteristics as if it were a voice.

  The A / D converter 9 samples an analog electric signal input from the microphone 10 connected to the input terminal 10 at a predetermined sampling frequency (for example, 44.1 kHz), and makes a predetermined number of bits (for example, 16 bits). Quantize.

  The D / A converter 11 converts the digital signal processed by the DSP 8 into an analog electric signal. The converted analog signal is amplified by the amplifier 12 and emitted from the speaker 13.

  Next, processing executed by the CPU 2 will be described with reference to FIGS. FIG. 2 is a flowchart showing the main process, which is started when the electronic musical instrument 1 is turned on and is repeatedly performed until the power is turned off. In this main process, first, an initialization process is performed (S1). As this initialization processing, processing such as setting of the timbre generated by the sound source 7 to the default timbre, initialization of the DSP 8, initial setting of the timer 2 a and interrupt provided in the CPU 2, and the like are performed.

  After the initialization process, it is determined whether or not an operation for selecting a performance mode has been performed by the operator 5 (S2). When the performance mode is selected (S2: Yes), a performance mode change process is performed (S3). In the performance mode changing process, for example, when the normal mode is selected, the tone color of the sound source 7 is set, and the musical sound generated by the sound source 7 is set to the DSP 8 so that a predetermined effect is applied by the effect applying unit 8c.

  When the vocoder mode is selected, the tone color of the sound source 7 is set, and the musical sound generated by the sound source 7 in the DSP 8 is modulated according to the frequency characteristics of the sound input from the microphone 10 in the vocoder unit 8a. Set. In addition, in order to control the volume level of the musical sound generated by the sound source 7 in accordance with the level of the sound input from the microphone 10 at a predetermined time interval, the timer 2a is set to generate a timer interrupt every predetermined time. To do.

  In addition, when the karaoke mode is selected, any one of the stored songs is selected, and the selected song is automatically played. Just make settings to control to suppress the automatic performance volume level.

  If the performance mode is not set in the process of S2 (S2: No), or if the performance mode change process of S3 is performed, whether or not any key on the keyboard 6 is pressed next. (S4). If any key is pressed (S4: Yes), note-on is transmitted to the sound source 7 (S5). Note-on is a message defined by the MIDI standard, and has information on a note number indicating a pressed key and a velocity indicating a key pressing speed. When the sound source 7 receives this message, the sound source 7 starts to generate a musical tone designated by the note number in a manner of rising according to the velocity value.

  In the process of S4, when no key is pressed (S4: No), or when the key press process of S5 is performed, it is determined whether or not any key on the keyboard 6 is released. Judgment is made (S6). If any key is released (S6: Yes), note-off is transmitted to the sound source 7 (S7). Note-off is a message defined by the MIDI standard in the same way as Note-on, and has information on the note number indicating the key released and the velocity indicating the key release speed. When the sound source 7 receives this message, it stops the tone generation specified by the note number that is being sounded in a manner of attenuation according to the velocity value.

  If none of the keys are released in the process of S6 (S6: No), or if the key release process of S7 is performed, other processes are performed next, and the process returns to S2. Other processing includes processing that is performed in response to an operation of an operation device other than the above-described operation device (for example, volume or timbre selection).

  Next, processing executed when the vocoder mode is selected will be described with reference to FIG. In this vocoder mode, when the key of the keyboard 6 is pressed, the sound source 7 generates a first musical tone and a second musical tone. The first musical tone is input to the vocoder unit 8a, and the second musical tone is , Input to the effect applying unit 8c.

  In this process, the value of the level of the sound input to the microphone 10 is temporarily stored, and after a predetermined time (for example, 150 msec), the level value is read out, and a musical sound (vocoder) generated by the sound source 7 according to the level value is read. Is a process for controlling the level of the sound (which is different from the tone input to the sound).

  FIG. 3 shows timer interrupt processing, which is executed every 1 msec, for example. The level detector 8b provided in the DSP 8 detects the envelope level of the sound input by the microphone 10, and the CPU 2 inputs the envelope level and sequentially stores it in a predetermined area of the RAM 4 (S11). ). This storage area only needs to have a storage capacity corresponding to the delay time, and a new level value can be written in the already read area.

  Next, the level value written in the storage area before a predetermined time is read (S12), and it is determined whether or not the control level has changed (S13). This control level controls the volume of the second musical sound. For example, a value that defines the volume of the control change defined by the MIDI standard can be used. When this control level value is transmitted to the sound source 7, it is stored in a predetermined area of the RAM 4, and compared with the level value of a predetermined time before read from the RAM 4 this time, it is judged whether there has been a change. is there.

  If there is a change in the control level value (S13: Yes), it is next determined whether or not the new control level value has decreased from the previous control level value (S14). When the control level value decreases, the control level value is changed based on the release coefficient (S15). The release coefficient is a release value set in the synthesis filter bank of the vocoder unit 8a. In the normal vocoder, the input voice is divided into a plurality of frequency bands, and the level for each band is detected. Amplitude modulation is performed for each band divided for each frequency on the synthesizing side according to the level, but when the level of the input voice is suddenly decreased, the amplitude modulated is gradually decreased. Can be set. This decreasing rate is the release factor. By setting this release coefficient, even when the sound level suddenly decreases, the volume of the output musical sound gradually decreases, so that the sound can be easily input and played easily.

  On the other hand, in this embodiment, since the level of the second musical sound is controlled in accordance with the input level of the microphone 10, the level of the second musical sound is reduced at the part where the output of the vocoder is released. In order to prevent this, the value of the control level is changed according to the release coefficient in the vocoder, and the release of the second musical sound is controlled in accordance with the release of the vocoder.

  When the control level is increased rather than decreased in the determination process of S14, or when the control level is changed in the process of S15, the control level is transmitted to the sound source 7, and the control level is stored in a predetermined area of the RAM 4. Remember.

  As described above, in the vocoder mode, the sound level is detected, the level value is delayed for a predetermined time, and the level of the musical sound generated simultaneously is adjusted based on the level. Therefore, the output of the vocoder immediately after the start of speech is clearly heard. In particular, the output of the vocoder formed by the first consonant of the voice can be prevented from being masked by the simultaneously generated musical sound, and is clearly heard.

  This process can be performed by delaying the level of the input voice for a predetermined time and changing the level of the musical sound according to the delayed level. This has the effect that the process is easy.

  Next, processing in the karaoke mode will be described. In the karaoke mode, automatic performance data for performing accompaniment is stored, and this automatic performance data is read out over time and transmitted to the sound source 7 to generate an accompaniment sound. In the automatic performance data, a section in which singing is performed (a section other than a section where only accompaniment such as an intro or an interlude is performed) is recorded, and the volume is controlled in the same section as in the vocoder mode. Is set to

  The level of the sound input by the microphone 10 is detected, the start of utterance is detected, and the volume is suppressed after a predetermined time (about 150 msec as in the vocoder mode) after the start of utterance is detected. If the utterance is stopped and the utterance is stopped, control is performed to suppress it again.

Therefore, the volume of the musical sound generated by the sound source 7 is not controlled in the section where the singing such as intro or interlude is not performed, and the volume of the musical sound generated by the sound source 7 is controlled only in the section where the singing is performed. Is done.

  Here, suppressing the volume means, for example, setting the position of the volume operator for setting the volume of the automatic performance to a volume corresponding to a half position when the volume is not suppressed.

  As described above, in the present embodiment, when sound and music, or vocoder sound and music are generated at the same time, control is performed so as to suppress the volume level of the music for a predetermined time from the start of the voice. This makes it possible to clearly hear the voice or vocoder sound at the start of utterance.

  The level control means and the level control step described in the claims correspond to the process of S16 in the flowchart described in FIG.

  As described above, the present invention has been described based on the embodiments, but the present invention is not limited to the above-described embodiments, and various improvements and modifications can be easily made without departing from the spirit of the present invention. It can be guessed.

  For example, in the above embodiment, the keyboard 6, the operator 7 and the sound source 9 are connected to each other by the CPU 2 and the bus, but may be connected via an interface such as MIDI.

  In the above embodiment, in the vocoder mode, the level of the voice input by the microphone 10 is delayed to control the level of the second musical sound. However, as in the karaoke mode, the utterance is started. This may be detected, and the volume may be suppressed for a predetermined time after the start of utterance is detected, and the suppression of the volume may be stopped after the predetermined time.

  In the above embodiment, in the vocoder mode, the level of the microphone 10 is detected, and the level of the second musical tone is controlled according to the level. However, the level of the musical tone output by the vocoder unit 8a is detected. Then, the level of the second musical sound may be controlled according to the level.

  In the above embodiment, the musical tone control apparatus is incorporated in the musical tone electronic musical instrument 1, but a musical tone control program may be executed by a personal computer to control musical sounds.

It is a block diagram which shows the electric constitution of the electronic musical instrument carrying the musical tone control apparatus by this invention. It is a flowchart which shows a main process. It is a flowchart which shows an interruption process.

Explanation of symbols

1 Electronic musical instrument 2 CPU
3 ROM
4 RAM
7 Sound source (musical sound generation means)
8 DSP
8a Vocoder part (vocoder means)
8b Level detection unit (level detection means)
10 Microphone (voice input means)

Claims (5)

In a sound input device for inputting a sound, a music sound generating device for generating a musical sound according to performance information, and a musical sound control device for outputting a sound input by the sound input device and a musical sound generated by the music sound generating device. Detecting means for detecting the start of voice input to the voice input means;
A musical tone control apparatus comprising: a level control unit that suppresses a level of a musical tone generated by the musical tone generating unit for a predetermined time after the start of voice input is detected by the detecting unit. Voice input means for inputting voice, vocoder means for detecting the frequency characteristic of the voice input by the voice input means, and modulating the musical sound according to the detected frequency characteristic, and playing the musical sound according to the performance information In a musical sound control device that outputs a musical sound generating means that generates, a musical sound output by the vocoder means and a musical sound generated by the musical sound generating means,
Detecting means for detecting the start of voice input to the voice input means;
A musical tone control apparatus comprising: a level control unit that suppresses a level of a musical tone generated by the musical tone generating unit for a predetermined time after the start of voice input is detected by the detecting unit. A voice input means for inputting voice; a musical tone generating means for generating a first musical tone and a second musical tone in accordance with performance information; and a frequency characteristic of the voice inputted by the voice input means, and detection thereof Vocoder means for modulating the first musical sound generated by the musical sound generating means in accordance with the frequency characteristics thus generated, the musical sound output by the vocoder means and the second musical sound generated by the musical sound generating means. In the musical sound control device to
Level detection means for detecting the level of the voice input by the voice input means;
A musical tone control apparatus comprising level control means for controlling the level of the second musical tone based on the level after a predetermined time from when the level is detected by the level detecting means. A voice input means for inputting voice; a musical tone generating means for generating a first musical tone and a second musical tone in accordance with performance information; and a frequency characteristic of the voice inputted by the voice input means, and detection thereof Vocoder means for modulating the first musical sound generated by the musical sound generating means in accordance with the frequency characteristics thus generated, the musical sound output by the vocoder means and the second musical sound generated by the musical sound generating means. In the musical sound control device to
Level detection means for detecting the level of the musical sound output by the vocoder means;
A musical tone control apparatus comprising: level control means for controlling the level of the second musical tone based on the level after a predetermined time from when the level is detected by the level detection means. Controls a sound input means for inputting sound, a music sound generating means for generating a musical sound in accordance with performance information, and a musical sound control device for outputting the sound input by the input means and the music sound generated by the music sound generating means. A sound detection step of detecting a start of input of the sound input by the input means in a musical sound control program executed by the control means;
A musical tone control program comprising: a level control step for suppressing a level of a musical tone generated by the musical tone generating means for a predetermined time from the start of voice input detected by the voice detecting step.

Images