JP2018054859A - Musical tone generation apparatus, musical tone generation method, electronic musical instrument, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic musical instrument capable of simultaneously producing effects of a breath sound and a growl sound as a wind instrument with one type of sensor, eliminating barriers in psychological aspect and hygienic aspect, and easily realizing a blowing effect even in an electronic keyboard instrument or the like.SOLUTION: By attaching an obstacle composed of a metal net 113 and a laminated fiber 114 to a voice sensor main body 112, information when a performer performs a breath rendition style by blowing breath to a voice sensor 101 can be efficiently input as a voice and responsiveness and stability in detection of signal intensity can be improved. When the performer executes performance operations by blowing breath to the voice sensor and by uttering a special rendition style sound, a normal sound and a growl sound can be produced simultaneously while being mixed seamlessly on the basis of an autocorrelation value calculated from a voice value output by the voice sensor, its deviation and the signal intensity. The blowing effect can be realized easily by only connecting a unit of the voice sensor even in an electronic keyboard instrument or the like.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a musical sound generation technique for an electronic musical instrument.

  As an electronic musical instrument that realizes a wind instrument using electronic technology, a technique of an electronic musical instrument that detects the strength of a player's playing and the voice that is uttered and seamlessly changes a musical sound signal that is generated from both detection results is disclosed (for example, Patent Document 1).

  According to such conventional technology, in traditional wind instruments, not only blowing and hanging, but also a special performance method that makes the sound turbid while performing the wind while actually speaking out "Woooooo" A “growl sound” can be realized.

Japanese Patent Laying-Open No. 2015-225271

  However, in the above-described conventional technology, it is necessary to mount two types of sensors, that is, a breath (atmospheric pressure) sensor for detecting the strength of playing and a voice sensor for detecting sound.

In addition, since the breath (barometric pressure) sensor can perform correct detection in a state where the air pressure is more than a certain level, the breath sensor and the voice sensor are mounted in a mouthpiece having the same structure as that of a wind instrument. There are many cases. Therefore, since the performer needs to hold the mouthpiece with his mouth, there is a problem that there are psychological and hygienic barriers for a plurality of performers to share one electronic musical instrument.

  Furthermore, since a mouthpiece is necessary, an electronic musical instrument must have a structure having a wind instrument-shaped body connected to the mouthpiece. Conventionally, for example, an electronic keyboard instrument is used to obtain a wind instrument wind effect. There was a problem that was difficult.

  The present invention makes it possible to simultaneously produce a breath sound and a glow sound effect as a wind instrument with a single type of sensor, removes psychological and hygiene barriers, and makes it easy to perform wind effects even with electronic keyboard instruments, etc. It aims to be feasible.

  In an example, a breath sound and a utterance sound are input from a voice sensor through a member that generates a Karman vortex, and a plurality of self values calculated based on output values that are continuously output from the voice sensor according to the input Deviation calculation means for calculating a deviation from the correlation value, and musical tone generation means for generating a musical sound to be generated by the sound generation unit based on the deviation of the autocorrelation value.

  According to the present invention, it is possible to simultaneously detect the effect of breath sound and growl sound as a wind instrument with one type of sensor, and it is possible to remove psychological and hygiene barriers, as well as electronic keyboard instruments, etc. However, it is possible to easily achieve the blowing effect.

It is the external view of one Embodiment of an electronic keyboard instrument, and the block diagram of a voice sensor. It is a characteristic view explaining the characteristic of the voice sensor by this embodiment. It is a block diagram of one Embodiment of the control system of an electronic keyboard instrument. It is a block diagram which shows the structural example of a synthetic | combination ratio determination means. It is a block diagram which shows the hardware structural example of this embodiment. It is a flowchart which shows the example of the main process of 2nd Embodiment. It is a flowchart which shows the detailed example of an initialization process. It is a flowchart which shows the example of a voice signal process. It is a flowchart which shows the detailed example of an autocorrelation + deviation detection process. It is a flowchart which shows the detailed example of a signal strength detection process. It is a flowchart which shows the detailed example of a pitch determination process. It is a flowchart which shows the detailed example of a musical tone control process. It is a flowchart which shows the detailed example of a pronunciation process.

  Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings.

  FIG. 1 is an external view of an embodiment of an electronic keyboard instrument 100 which is an electronic musical instrument according to the present invention.

  A voice sensor 101 (voice sensor) is attached to a voice input terminal 104 of a musical instrument main body 108 of an electronic keyboard instrument 100 having a keyboard 102 via a connection cable 105 and a microphone arm 107 attached to a headband 106. . Further, a line cable 110 may be connected to the line output terminal 109 of the musical instrument main body 108.

  As shown in the enlarged left side view of the voice sensor 101, a voice sensor main body 112, for example, a voice microphone, is attached to a sensor base 111 to which a microphone arm 107 is coupled and connected, and further on the opening side of the voice sensor main body 112. A metal net 113 is attached, and a laminated fiber 114 is filled between the metal net 113 and the opening of the voice sensor main body 112. The laminated fiber 114 and the metal net 113 can be detached from the voice sensor main body 112 and can be washed with a neutral detergent or the like. A portion composed of the metal net 113 and the laminated fiber 114 is disposed as an obstacle in the opening of the voice sensor 101.

  In this embodiment, in order to enable the electronic keyboard instrument 100 to be used as an electronic musical instrument that simulates a wind instrument, a performer can connect a voice input terminal 104 to a headband 106, a microphone arm 107, a voice sensor 101, and A wind instrument input device composed of the connection cable 105 can be connected. The performer can perform a wind performance using the voice sensor 101 while wearing the headband 106 on his / her head so that the voice sensor 101 is at the mouth and performing key operations on the keyboard 102. Then, the player can make the voice sensor 101 function as a breath sensor and generate a breath sound from the electronic keyboard instrument 100 by blowing a breath toward the voice sensor 101 with a feeling of “foo”. In addition, the performer utters a glow sound with a feeling of “U” toward the voice sensor 101, thereby causing the voice sensor 101 to function as an original voice sensor and causing the electronic keyboard instrument 100 to generate the growl sound. be able to. In addition, by controlling the sound that the performer utters, the performer can produce a musical sound that is a mixture of breath sound and growl sound, and it can be seamlessly produced by mixing the breath sound and growl sound with a wind instrument. You can perform like this.

  In the present embodiment, in order to give the voice sensor 101 the functions of both the breath sensor and the original voice sensor as described above, as shown in FIG. An obstacle composed of 113 and laminated fiber 114 is attached. In this embodiment, breath noise is generated by Karman vortex turbulence generated when the air current blown toward the voice sensor 101 passes or reflects an obstacle composed of the metal net 113 and the laminated fiber 114. , And the intensity of the breath noise is acquired by the voice sensor 101, thereby making it possible to detect the strength of playing. Furthermore, the obstacle is configured so that the breath noise generated by the turbulence described above becomes white noise, so that the player can easily discriminate between the case where the performer performs only the blowing and the case where the special performance method is performed by voice. Is. More specifically, when the performer performs only the wind performance, a breath performance is detected by obtaining a voice signal of white noise from the voice sensor 101, and at the same time, the performer performs a special performance method by speaking. Is detected from the deviation of the autocorrelation value of the voice signal, and the synthesis ratio of the normal sound and the growl sound is adjusted and output.

  FIG. 2A shows the output of the voice sensor 101 when the air is blown without using the laminated fiber 114 as the obstacle attached to the opening of the voice sensor main body 112 and using the metal mesh 113 of FIG. It is a graph which shows the example of the frequency distribution in a voice signal. It shows a characteristic that many signal components in the low frequency range are included and the signal components gradually decrease as the frequency becomes higher.

  FIG. 2B shows a voice sensor when a plurality of fiber sheets (hereinafter referred to as “laminated fibers 114”) covered with a metal net 113 are attached to the voice sensor main body 112 and blown. 10 is a graph showing an example of a frequency distribution in a voice signal output from 101. The distribution is almost uniform from the low frequency range to the vicinity of 4 kHz (kilohertz), and shows characteristics close to white noise as compared with FIG. Thus, by changing the obstacle, it is possible to adjust the frequency distribution characteristics of the voice signal output from the voice sensor 101. In particular, it is known that the frequency of Karman vortices generated when an air current passes through a cylindrical obstacle is inversely proportional to the diameter of the cylinder, and the frequency distribution characteristics are determined from the diameters of the metal mesh 113 and the laminated fiber 114 of the obstacle. Can be adjusted.

  FIG. 2C shows the frequency distribution of the voice signal output from the voice sensor 101 when uttering at the same time when blowing on the obstacle made of the same metal mesh 113 and laminated fiber 114 as in FIG. 2B. It is a graph which shows the example of. The uttered sound includes many fundamental frequencies (pitch frequencies) and multiples thereof, and its characteristics appear in the frequency range from 70 Hz to 1000 Hz as compared with FIG. A comb-like maximum peak appears at the frequency position. Due to the difference in frequency characteristics between FIG. 2 (b) and FIG. 2 (c), when using the voice sensor 101 having the structure shown in FIG. It can be seen that it is possible to distinguish between a uniform case and a case where a lot of specific frequency components are included.

  As a technique for detecting a state containing a lot of specific frequency components, a technique for determining an autocorrelation value calculated from calculating an autocorrelation function is known. Now, it is known that the autocorrelation function G (τ) is expressed by the following equation when the voice value at time t is V (t). Here, τ is a delay time, which is 1 / f (second) when the frequency is f (Hz). T is an integration interval.

  When the frequency component f included in the voice value signal is small, the value is low, and when the frequency component f is large, the value is high. However, as can be seen from Equation 1, G (τ) is strongly influenced by the signal level of the voice value. For this reason, it is known that if the following equation (2) is used for the autocorrelation function G (τ), it is difficult to be influenced by the signal level.

  When the frequency component f included in the voice value signal is small, the value is high, and when the frequency component f is large, the value is low.

  Here, when the performer inputs a special performance sound by voice utterance, the autocorrelation value is the lowest value in the corresponding fundamental frequency due to the presence of the fundamental frequency and its harmonic frequency by utterance, By detecting the pitch at which the autocorrelation value is minimized, it is possible to detect the pitch of the special performance sound. Then, a value (hereinafter referred to as “autocorrelation value”) obtained from the autocorrelation function G (τ) calculated by the calculation of Equation 2 is calculated in the frequency range of the fundamental sound that can be uttered, and the deviation is obtained. Thus, it is possible to detect the special performance method by the utterance and its strength. Note that it is sufficient to calculate the delay time τ (= 1 / f) when calculating the autocorrelation value only for the discrete time corresponding to the frequency of, for example, the 49th fundamental tone that can be specified as a key of the electronic musical instrument, It is possible to calculate the autocorrelation value with a small amount of calculation.

  Note that the pitch can be detected from the autocorrelation value only when the performer utters, but whether the utterance is uttered can be determined from the deviation of the autocorrelation value. That is, the deviation of the autocorrelation value becomes white noise when the player blows, and the value is low. Even when the performer does nothing, the voice signals are all near 0, so the deviation of the autocorrelation value is also extremely low. Therefore, only when the performer utters, the deviation of the autocorrelation value becomes a high value, and when the deviation value is higher than a predetermined deviation threshold value, it can be determined that the pitch can be determined.

  On the other hand, when the deviation value of the autocorrelation value is equal to or less than the deviation threshold value, it can be determined that the performer simply blows toward the voice sensor 101 and a breath sound is input. In this case, the strength of the breath sound can be determined by detecting the signal strength of the voice value. In detecting the signal intensity, how to detect a stable signal intensity is a problem. FIGS. 2D and 2E are input waveform diagrams of voice values, comparing the cases where the voice sensor 101 has no obstacle / is present. 2D shows a case where no obstacle is attached to the voice sensor main body 112, and FIG. 2E shows a case where an obstacle made of a metal net 113 and a laminated fiber 114 is attached to the voice sensor main body 112. The input waveforms when each breath is blown three times are shown. In FIGS. 2D and 2E, the dark portion is the input waveform (its peak portion), and the thin portion is its effective value (≈detection level). As can be understood by comparing FIGS. 2 (d) and 2 (e), when an obstacle is installed (FIG. 2 (e)), more high-frequency components closer to white noise are included, and as a result, an effective value ( It can be seen that (≈detection level) is detected stably. As described above, in this embodiment, when the performer performs a breath performance by blowing the breath on the voice sensor 101 by attaching the obstacle made of the metal net 113 and the laminated fiber 114 to the voice sensor main body 112 of FIG. This information can be efficiently input as voice, and the response and stability in signal intensity detection can be improved.

  FIG. 3 is a block diagram of an embodiment of a control system for the electronic keyboard instrument 100 of FIG. This control system includes a voice input unit 301, an autocorrelation value / deviation detection unit 302, a signal strength determination unit 303, an envelope determination unit 304, a key detection unit 305, a pitch control unit 306, a sound generation instruction unit 307, a wave generator (wave generator). Generator 308 (sound source), normal sound waveform data 309, growl sound waveform data 310, synthesis ratio determining means 311, multipliers 312, 313, 315 (sound source), adder 314 (sound source), and DAC (digital analog converter) ) / Amplifier 316.

  The voice input unit 301 (speech input unit) sequentially acquires voice values (speech values) output from the voice sensor 101 as voice input information at predetermined discrete time intervals.

  The autocorrelation value / deviation detecting means 302 performs voice processing for a voice value of a predetermined number of voice signal processing units (number of voice signal processing units) (= T) obtained as the voice input information according to the above equation (2). The autocorrelation value of each wavelength included in the signal is calculated, and the deviation of the autocorrelation value of the entire voice signal is calculated.

  The signal strength determining means 303 detects the signal strength based on the magnitude of the amplitude change of the voice value of the number of voice signal processing units. The signal strength determination unit 303 is obtained by integrating the amplitude values of the voice values of a predetermined number of voice signal processing units sequentially obtained by the voice input unit 301 and executing a low-pass filter process on the integration result. Output the value as signal strength information,

  The key detection unit 305 detects, for example, a key operation (key pressing operation or key release operation) on the keyboard unit 102 of FIG. 1 by the performer as key detection information. The key operation does not necessarily have to be performed by the performer on the keyboard unit 102. The key device may be, for example, another external musical instrument or an external musical instrument via a MIDI (Musical Instrument Digital Interface) terminal (not shown). It may be input from a sequencer (automatic performance device) or the like.

  When there is a change in the pitch specified by the performance key operation detected by the key detection unit 305 as the key detection information, the pitch control unit 306 changes the pitch obtained from the key detection information to the new pitch information. Is determined and output.

  This pitch control means 306 is further indicated by a broken line from the autocorrelation value / deviation detection means 302 when there is no change in the pitch designated by the performance key operation detected by the key detection means 305 as the key detection information. It is determined whether or not the deviation of the autocorrelation value input from the autocorrelation value / deviation detection means 302 is higher than a predetermined deviation threshold via the indicated control line. When the pitch control means 306 determines that the deviation of the autocorrelation value is higher than the predetermined deviation threshold, the pitch control means 306 inputs the self input from the autocorrelation value / deviation detection means 302 via the dashed control line in FIG. Pitch information indicating pitch change or pitch bend is output according to the frequency corresponding to the lowest correlation value.

  The synthesis ratio determination unit 311 outputs synthesis ratio (ratio) information determined based on the deviation of the autocorrelation value detected by the autocorrelation value / deviation detection unit 302 and the signal strength information output by the signal strength determination unit 303. To do. The synthesis ratio information determines a synthesis ratio (ratio) between a normal sound, which is a normal musical tone of a wind instrument output from the Wave Generator 308, and a glow sound, which is a musical sound generated by the groling technique of the wind instrument, as will be described later. Multiplication values are given to the multipliers 312 and 313, respectively.

  The envelope determination unit 304 determines envelope information based on the signal strength information obtained by the signal strength determination unit 303. The envelope information is a final gain that is multiplied by the multiplier 315 after the normal sound and the growl sound are synthesized by the adder 314.

  The sound generation instruction unit 307 is configured to generate a wave generator 308 when the value of the signal strength information output from the signal strength determination unit 303 changes from less than a predetermined sound generation start threshold value to a sound generation start threshold value or more in a state where the Wave Generator 308 is not sounding. Sound generation instruction information for instructing the start of sound generation by the pitch indicated by the pitch information output by the pitch control means 306 is output. At this time, the sound generation instruction unit 307 sets the value of the signal strength information output from the signal strength determination unit 303 as the velocity information at the start of sound generation. In addition, the sound generation instruction unit 307 generates a sound that instructs the Wave Generator 308 to change the pitch or pitch bend when the pitch indicated by the pitch information output from the pitch control unit 306 is changed while the Wave Generator 308 is sounding. Output instruction information. Further, the sound generation instruction unit 307 is in a state where the Wave Generator 308 is sounding and the value of the signal intensity information output from the signal strength determination unit 303 changes from a state equal to or higher than the sound generation stop threshold to a state lower than the sound generation stop threshold. Sound generation instruction information for instructing to stop sound generation by the pitch indicated by the pitch information output from the pitch control means 306 is output to the Wave Generator 308.

  The Wave Generator 308 reads and outputs the normal sound waveform data 309 and the glow sound waveform data 310 stored in the ROM incorporated therein in parallel at the pitches based on the sound generation instruction by the sound generation instruction means 307. The normal sound waveform data 309 is, for example, waveform data obtained by sampling musical tones during normal performance of a wind instrument. The growl sound waveform data 310 is, for example, waveform data obtained by sampling musical tones during a performance by a wind instrument's glowing technique.

  The multipliers 312 and 313 multiply the normal sound and the glow sound output from the Wave Generator 308 by each multiplication value given from the synthesis ratio determining unit 311.

  The adder 314 mixes the normal sound and the growl sound by adding the outputs of the multipliers 312 and 313.

  Multiplier 315 multiplies the output of adder 314 by the multiplication value given from envelope determination means 304.

  The DAC / amplifier 316 converts the musical tone signal output from the multiplier 315 from a digital signal to an analog signal, and then amplifies it.

  The speaker 103 in FIG. 1 emits the amplified tone signal output from the DAC / amplifier 316. Alternatively, the musical sound signal may be output from the line output terminal 109 of FIG. 1 to an external audio device via the line cable 110.

  Here, the normal sound waveform data 309 and the growl sound waveform data 310 output from the Wave Generator 308 are signal-processed so as to sound in the same phase (hereinafter referred to as “synchronous start”), and are mixed by the adder 314. But the volume doesn't cancel out unnaturally.

  FIG. 4 is a diagram illustrating a configuration example of the synthesis ratio determining unit 311 and the envelope determining unit 304 of FIG.

  The combination ratio determining unit 311 increases the output value as the deviation of the autocorrelation value output from the autocorrelation value / deviation detection unit 302 increases and the value of the signal strength information output from the signal strength determination unit 303 decreases. In addition, a growl value is generated such that the output value decreases as the deviation of the autocorrelation value decreases and the value of the signal strength information increases. The composition ratio determining unit 311 generates a growl value having such characteristics according to, for example, the following equation (3). Here, Gr is the Grow value, Dv is the deviation of the autocorrelation value, Dg is the gain for adjusting the deviation (fixed value), Lv is the value of the signal intensity information, Lg is the gain for adjusting the intensity (fixed value), and La is This is an offset (fixed value) for strength adjustment.

  The synthesis ratio determining means 311 includes a normal sound table 401 having a characteristic that the output multiplication value (vertical axis) decreases from 1 to 0 as the growl value (horizontal axis) increases, and the grow value (horizontal axis). A growl sound table 402 having a characteristic that the output multiplication value (vertical axis) increases from 0 to 1 as the axis increases. The synthesis ratio determining means 311 determines each multiplication value for the multipliers 312 and 313 by referring to the normal sound table 401 and the glow sound table 402 with respect to the input value of the voice level.

  By the synthesis ratio determining means 311, the multipliers 312, 313 and the adder 314, the output level of the glow sound (second musical sound signal) increases as the deviation of the autocorrelation value increases and the signal intensity decreases. A musical sound signal in which a normal sound and a growl sound are mixed is obtained so that the output level of the first musical sound signal (normal sound) increases as the value deviation decreases and the signal strength increases.

  The envelope determining means 304 is such that the gain output is zero until the value of the signal intensity information output from the signal intensity determining means 303 reaches a predetermined sounding start threshold, and the gain increases as the signal intensity increases when the signal intensity exceeds the sounding start threshold. An envelope table 403 having a characteristic of increasing output is provided. The envelope determination unit 304 determines envelope information which is a multiplication value for the multiplier 315 by referring to the envelope table 403 with respect to the value of the signal strength information.

  By the envelope determining means 304 and the multiplier 315, the mixed output of the normal sound and the growl sound is zero until the value of the signal intensity information reaches the sounding start threshold, and when the signal intensity exceeds the sounding start threshold, the signal intensity increases. Control that increases the mixed output is realized. As a result, the performer can freely change the output of the normal sound and the glow sound by controlling the strength of the playing with respect to the voice sensor 101.

  As described above, according to the embodiment of the control system for the electronic keyboard instrument 100 having the configuration of FIGS. 3 and 4, the breath sound (normal sound) and the glow sound as the wind instrument are generated by one type of voice sensor 101. It is possible to produce sound simultaneously while mixing seamlessly. In this embodiment, since the performer does not need to hold the voice sensor 101 with his mouth, even if a plurality of performers share one electronic musical instrument, the psychological and hygienic barriers can be removed. Even with the electronic keyboard instrument 100 or the like, it is possible to easily realize the wind effect simply by connecting the headset unit of the voice sensor 101.

  FIG. 5 is a block diagram illustrating a hardware configuration example of the second embodiment of the electronic musical instrument capable of realizing the functions of the control system for the electronic keyboard musical instrument 100 illustrated in FIGS. 3 and 4 by software processing. .

  In the hardware configuration example shown in FIG. 5, a CPU (central processing unit: central processing unit) 501, ROM (read only memory) 502, RAM (random access memory) 503, and the output of the voice sensor 101 in FIG. 1 are connected. ADC (analog / digital converter) 504, GPIO (general purpose input output) 505 to which the output of the keyboard unit 102 in FIG. 1 is connected, Wave Generator 506, and the output is connected to the speaker 103 in FIG. These DAC / amplifiers 316 are connected to each other by a bus 507. The configuration shown in the figure is an example of a hardware configuration capable of realizing the control system of the electronic keyboard instrument 100, and such a hardware configuration is not limited to this configuration.

  The CPU 501 controls the electronic keyboard instrument 100. The ROM 502 stores a sound generation control program. The RAM 503 temporarily stores the above-described voice input information, signal strength information, key detection information, pitch information, synthesis ratio information, envelope information data, sound generation instruction information, and the like when the sound generation control program is executed.

  The output of the voice sensor 101 is converted from analog signal to digital voice input information by the ADC 504 having the same function as the voice input unit 301 in FIG.

  Each operation state of the keyboard unit 102 in FIG. 1 is read into the CPU 101 via the GPIO 107 having the same function as the key detection unit 305 in FIG.

  The Wave Generator 506 is, for example, a digital signal processor (DSP) that realizes the functions of the Wave Generator 308, the multipliers 312, 313, the adder 314, and the multiplier 315 of FIG.

  The musical tone signal output from the wave generator 506 is converted from a digital signal to an analog signal by the DAC / amplifier 316 via the CPU 501 and amplified, and then emitted through the speaker 103.

  FIG. 6 is a flowchart illustrating an example of a main process of the second embodiment having the hardware configuration example of FIG. This processing is realized as an operation in which the CPU 501 in FIG. 5 executes the sound generation control processing program stored in the ROM 502. This processing includes voice input means 301, autocorrelation value / deviation detection means 302, signal strength determination means 303, envelope determination means 304, key detection means 305, pitch control means 306, sound generation instruction means 307, and synthesis in FIG. Each function of the ratio determining unit 311 is realized. Hereinafter, the configuration of FIG. 5 will be referred to as needed.

  First, the CPU 501 executes an initialization process (step S601). FIG. 7 is a flowchart showing a detailed example of the initialization process in step S601. In the initialization process, a process of storing an initial value in each related variable in the RAM 503 is executed. In step S701 in FIG. 7, first, as a wave generator initialization, a constant value GENERATOR_DEAD stored in the ROM 502 is stored in a variable GeneratorStatus in the RAM 503. Further, 0 (zero) is stored in a variable Envelope in the RAM 503 as initialization of the value of the envelope information. In addition, as an initialization of the synthesis ratio, an initial gain value 0 (zero) of normal sound is stored in a variable NormalRatio in the RAM 503. In addition, an initial gain value 0 (zero) of the glow sound is stored in a variable GrowlRatio in the RAM 503. Then, as initialization of the sound generation start threshold, the constant value THRESHOLD_NOTEON stored in the ROM 502 is stored in the variable ThreshNoteOn in the RAM 503.

  Returning to the processing of FIG. 6, the CPU 501 repeatedly executes the voice signal processing (step S602) and the musical tone control processing (step S603).

  FIG. 8 is a flowchart showing a detailed example of the voice signal processing in step S602 of FIG. The voice input unit 301, autocorrelation value / deviation detection unit 302, signal strength determination unit 303, key detection unit 305, and pitch control unit 306 in FIG.

  First, the CPU 501 executes a voice input process indicated by a series of processes in steps S801 to S804. This process realizes the function of the voice input means 301 of FIG.

  First, the CPU 501 waits for a certain short time (step S801).

  Next, the CPU 501 acquires a voice value from the voice sensor 101 of FIG. 1 via the ADC 504 (step S802).

  The CPU 501 stores the acquired voice value in the RAM 103 as voice input information (step S803).

  The CPU 501 determines whether or not voice values for a predetermined number of voice signal processing units have been acquired (step S804).

  If the determination in step S804 is NO, the CPU 501 ends the voice signal processing in step S602 of FIG. 6 shown in the flowchart of FIG.

  If the determination in step S804 is YES, the CPU 501 sequentially executes an autocorrelation value / deviation detection process (step S805), a signal strength determination process (step S806), and a pitch control process (step S807). These realize the functions of the autocorrelation value / deviation detection means 302, the signal intensity determination means 303, and the pitch control means 306 in FIG. When these processes are completed, the CPU 501 ends the voice signal process in step S602 of FIG. 6 shown in the flowchart of FIG. Note that when the processing in step S807 ends, the CPU 501 clears the voice value of the number of voice signal processing units as it is stored in the RAM 103.

  FIG. 9 is a flowchart showing a detailed example of the autocorrelation value / deviation detection process in step S805 of FIG. The CPU 501 initializes the scale N to the scale C2 (about 65.4 Hz) in step S901 with respect to the delay time τ of the autocorrelation function shown in Equation 2, and then increments the scale N by +1 in step S904. Until it is determined in step S903 that the scale N has exceeded the scale C6 (about 1046.5 Hz), the autocorrelation value is calculated for the 49 basic scales that can be uttered by the above-described equation (step S902).

  If the determination in step S903 is YES, the CPU 501 calculates the deviation of all autocorrelation values from the scales C2 to C6 calculated in step S902 (step S905).

  The CPU 501 stores the total autocorrelation value from the scales C2 to C6 calculated in step S902 and the deviation of the autocorrelation value calculated in step S905 in the RAM 103 as autocorrelation value / deviation information.

  FIG. 10 is a flowchart showing a detailed example of the signal strength determination process in step S806 of FIG. The CPU 501 integrates each amplitude value of the voice value of the number of voice signal processing units acquired as the voice input information in the RAM 103 by the repetition processing of steps S801 to S804 in FIG. 8 (step S1001).

  Next, the CPU 501 executes low-pass filter processing on the result of integration in step S1001 (step S1002).

  Then, the CPU 501 stores the result of the low-pass filter processing in step S1002 in the variable SignalStrength in the RAM 103 as signal strength information (step S1003).

  FIG. 11 is a flowchart showing a detailed example of the pitch control process in step S807 of FIG. First, the CPU 501 detects the pitch of the detected key from the key detection information of the keyboard unit 102 output from the GPIO 505 (step S1101).

  Next, the CPU 501 determines whether or not there is a change in the pitch by the key compared to the previous key detection result (step S1102).

  If the determination in step S1102 is YES, the CPU 501 stores the pitch by the key detected in step S1101 in the RAM 103 as a variable NoteNumber indicating pitch information (step S1103). Thereafter, the CPU 501 ends the pitch control process of step S807 of FIG. 8 illustrated by the flowchart of FIG.

  When the determination in step S1102 is NO, the CPU 501 determines whether or not the deviation value of the autocorrelation value of the autocorrelation value / deviation information obtained in the RAM 103 in step S805 of FIG. 8 is higher than a predetermined deviation threshold value. Thus, it is determined whether or not the pitch can be detected from the autocorrelation value (step S1104). This operation has been described above in the description of the pitch control means 306 in FIG.

  If the determination in step S1104 is NO, it can be determined that the performer has not made a special performance sound, so the CPU 501 performs the pitch control process in step S807 of FIG. 8 illustrated in the flowchart of FIG. finish.

  If the determination in step S1104 is YES, it can be determined that the performer is uttering a special performance sound. Therefore, the CPU 501 determines the reciprocal 1 / τ from the delay time τ corresponding to the autocorrelation value that is the minimum value among the autocorrelation values of the autocorrelation value / deviation information obtained in the RAM 103 in step S805 of FIG. As a result, the pitch is detected (step S1105).

  The CPU 501 stores the pitch based on the autocorrelation value calculated in step S1105 in the variable NoteNumber in the RAM 103 as new pitch information.

  After the voice signal processing in step S602 of FIG. 6 shown in FIGS. 8 to 11 described above, the CPU 501 executes the musical tone control process of step S603 in FIG. FIG. 12 is a flowchart showing a detailed example of the musical tone control process in step S603.

  First, the CPU 501 determines whether or not the value of the variable GeneratorStatus in the RAM 503 indicating the sound generation state is a constant value GENERATOR_DEAD in the ROM 502 indicating the sound generation state (step S1201).

  If the determination in step S1201 is YES (non-sounding state), the CPU 501 proceeds to the process in step S1202. Here, the CPU 501 determines that the value of the signal strength information obtained in the variable SignalStrength in the RAM 503 in the signal strength determination process in step S806 in FIG. 8 is the sound generation start threshold value described above in the description of the sound generation instruction unit 307 in FIG. It is determined whether or not the constant value ThreshNoteOn in the indicated ROM 502 has been exceeded.

  If the determination in step S1202 is NO, sound generation is not started, and thus the CPU 501 ends the musical tone control process in step S603 of FIG. 6 illustrated in the flowchart of FIG.

  If the determination in step S1202 is YES, the CPU 501 determines the value of the signal strength information obtained in the variable NoteNumber in the RAM 503 for storing the pitch information and the variable SignalStrength in the RAM 503 in the signal strength determination process in step S806 in FIG. Is input, and the sound generation process is executed (step S1203). Details of this processing will be described later in the description of the flowchart of FIG.

  Next, as post-sound generation processing, the CPU 501 stores a constant value GENERATOR_ALIVE in the ROM 502 indicating the sound generation state in a variable GeneratorStatus in the RAM 503 indicating whether or not the sound generation state is present (step S1204). Thereafter, the CPU 501 ends the process of the flowchart of FIG. 12, and ends the musical tone control process of step S605 of FIG.

  If the determination in step S1201 is NO (sound generation state), the CPU 501 proceeds to the process in step S1205. Here, the CPU 501 executes envelope determination processing for determining the value of envelope information based on the value of the signal strength information obtained in the variable SignalStrength in the RAM 503 in the signal strength determination processing in step S806 of FIG. The value of the envelope information obtained as a result of this processing is stored in a variable Envelope in the RAM 103. Details of this processing have been described above in the description of the envelope determining means 304 in FIG. The value of the envelope information obtained as a result is given to the Wave Generator 506. The Wave Generator 506 executes a function corresponding to the multiplier 315 in FIG. 3 or FIG. 4 based on this gain value.

  Next, the CPU 501 converts the autocorrelation value / deviation information value obtained in the RAM 103 in step S805 in FIG. 8 and the signal strength information value obtained in the variable SignalStrength in the RAM 103 in step S806 in FIG. Based on this, a composition ratio determination process is executed (step S1206). Details of this processing have been described above in the description of the synthesis ratio determining means 311 in FIG. The synthesis ratios determined by accessing the normal sound table 401 and the glow sound table 402 in FIG. 4 are stored in a variable NormalRatio and a variable GrowlRatio in the RAM 503, respectively. The variable NormalRatio indicates the synthesis ratio of normal sounds, and corresponds to the multiplication value given to the multiplier 312 in FIG. 3 or FIG. The variable GrowlRatio indicates the synthesis ratio of the growl sound, and corresponds to the multiplication value given to the multiplier 313 in FIG. 3 or FIG. These variable values are provided to Wave Generator 506. The Wave Generator 506 performs a function corresponding to the multipliers 312 and 313 in FIG. 3 or FIG. 4 based on these variable values.

  Thereafter, the CPU 501 indicates the sounding start threshold value described above in the description of the sounding instruction means 307 in FIG. 3 by the value of the signal strength information obtained in the variable SignalStrength in the RAM 503 in the signal strength determining process in step S806 of FIG. It is determined whether or not the constant value ThreshNoteOn in the ROM 502 has become equal to or less (step S1207). If the determination in step S1207 is YES, the CPU 501 stores the constant value GENERATOR_DEAD in the ROM 502 indicating the non-sounding state in the variable GeneratorStatus in the RAM 503 indicating whether or not the sounding state as post-sounding processing (step S1208).

  When the determination in step S1207 is NO or after the process in step S1208, the CPU 501 ends the musical tone control process in step S605 of FIG. 6 illustrated in the flowchart of FIG.

  FIG. 13 is a flowchart showing a detailed example of the sound generation process in step S1203 of FIG.

  First, the CPU 501 receives the pitch information obtained in the variable NoteNumber in the RAM 503 in the pitch control process of step S807 in FIG. 8 and executes initialization processing for normal sound in the Wave Generator 506 (step S1301). . Here, the CPU 501 sets the start address of the normal sound waveform data 309 (see FIG. 3) to the Wave Generator 506, and sets the reading speed of the normal sound waveform data 309 corresponding to the pitch indicated by the variable NoteNumber. .

  Next, the CPU 501 receives the variable NoteNumber in the RAM 503 for storing the pitch, and executes the initialization process for the glow sound in the Wave Generator 506 (step S1302). Here, the CPU 501 sets the start address of the glow sound waveform data 310 (see FIG. 3) to the Wave Generator 506, and sets the reading speed of the grow sound waveform data 310 corresponding to the pitch indicated by the variable NoteNumber. .

  Next, the CPU 501 executes a composition ratio determination process (step S1303). This process is the same as the process of step S1206 in FIG. 12 executed in the sound generation state, and realizes the function of the composition ratio determining means 311 in FIG. 3 or FIG. The synthesis ratios determined by accessing the normal sound table 401 and the glow sound table 402 in FIG. 4 are stored in a variable NormalRatio and a variable GrowlRatio in the RAM 503, respectively, and are given to the wave generator 506. The Wave Generator 506 performs a function corresponding to the multipliers 312 and 313 in FIG. 3 or FIG. 4 based on these variable values.

  Next, the CPU 501 executes an envelope determination process (step S1304). This process is the same as the process in step S1205 of FIG. The value of the envelope information obtained by this processing is given to the Wave Generator 506. The Wave Generator 506 executes a function corresponding to the multiplier 315 in FIG. 3 or FIG. 4 based on this gain value.

  Finally, the CPU 501 executes generator / synchronization / start processing (step S1305). In this process, the CPU 501 issues a sound generation start instruction to synchronize the normal sound waveform data 309 and the glow sound waveform data 310 to the Wave Generator 506 for output processing.

  By the operation of the second embodiment described above, the function of the electronic musical instrument of FIG. 3 or 4 in the first embodiment is realized as software processing.

  As described above, in the first and second embodiments, the performer breathes into the voice sensor 101 by attaching the obstacle made of the metal net 113 and the laminated fiber 114 to the voice sensor main body 112 of FIG. It is possible to efficiently input the information when the breath performance is performed by blowing, and to improve the responsiveness and stability in detecting the signal intensity. The obstacle to cover the voice sensor main body 112 is not limited to the combination of the metal net 113 and the laminated fiber 114 as long as the frequency characteristic when blowing is close to white noise, and various objects can be used. Applicable.

Regarding the above embodiment, the following additional notes are disclosed.
(Appendix 1)
From a plurality of autocorrelation values calculated based on output values that are continuously output from the voice sensor in response to the input, breath sounds and utterance sounds are input from the voice sensor through a member that generates a Karman vortex Deviation calculating means for calculating the deviation;
Based on the deviation of the autocorrelation value, a musical sound generating means for generating a musical sound to be generated by the sound generation unit;
A musical sound generating device having
(Appendix 2)
The musical sound generating means includes
When the deviation of the autocorrelation value is larger than a threshold value, the first musical tone signal is increased by making the synthesis ratio of the second musical signal of the glow sound larger than the synthetic ratio of the first musical signal of the normal sound. The musical tone generation apparatus according to appendix 1, wherein the musical tone is generated by combining the second musical tone signal with the second musical tone signal.
(Appendix 3)
The musical sound generating means includes
When the deviation of the autocorrelation value is smaller than a threshold value, the first musical sound signal is reduced by making the synthesis ratio of the second musical signal of the glow sound smaller than the synthetic ratio of the first musical signal of the normal sound. The musical tone generation apparatus according to appendix 1 or 2, wherein the musical tone is generated by combining the second musical tone signal with the second musical tone signal.
(Appendix 4)
Signal strength determining means for acquiring breath signal strength information from the output value of the voice sensor;
Further comprising
The musical sound generating means includes
The musical tone is generated by synthesizing the first musical tone signal of the normal tone and the second musical tone signal of the glow tone based on the sexuality ratio determined based on the deviation of the autocorrelation value and the signal strength information. The musical sound generating device according to any one of appendices 1 to 3.
(Appendix 5)
A musical sound generating device according to any one of appendices 1 to 4,
A sound generation unit for generating a musical sound generated by the musical sound generation device;
Electronic musical instrument with
(Appendix 6)
From a plurality of autocorrelation values calculated based on output values that are continuously output from the voice sensor in response to the input, breath sounds and utterance sounds are input from the voice sensor through a member that generates a Karman vortex Calculate the deviation,
A musical sound generation method for generating a musical sound to be generated by the sound generation unit based on the deviation of the autocorrelation value.
(Appendix 7)
On the computer,
From a plurality of autocorrelation values calculated based on output values that are continuously output from the voice sensor in response to the input, breath sounds and utterance sounds are input from the voice sensor through a member that generates a Karman vortex Calculating a deviation;
Based on the deviation of the autocorrelation value, generating a musical sound to be generated by the sound generation unit;
A program for running

DESCRIPTION OF SYMBOLS 100 Electronic keyboard 101 Voice sensor 102 Keyboard part 103 Speaker 104 Voice input terminal 105 Connection cable 106 Headband 107 Microphone arm 108 Musical instrument main body 109 Line output terminal 110 Line cable 111 Sensor base 112 Voice sensor main body 113 Metal net 114 Laminated fiber 301 Voice input Means 302 Autocorrelation value / deviation detection means 303 Signal strength determination means 304 Envelope determination means 305 Key detection means 306 Pitch control means 307 Sound generation instruction means 308, 506 Wave Generator
309 Normal sound waveform data 310 Growl sound waveform data 311 Synthesis ratio determining means 312, 313, 315 Multiplier 314 Adder 316 DAC / amplifier 401 Normal sound table 402 Growl sound table 501 CPU (Central processing unit: Central processing unit) )
502 ROM (Read Only Memory)
503 RAM (Random Access Memory)
504 ADC (analog / digital converter)
505 GPIO (General Purpose Input Output)
507 bus

Claims (7)

From a plurality of autocorrelation values calculated based on output values that are continuously output from the voice sensor in response to the input, breath sounds and utterance sounds are input from the voice sensor through a member that generates a Karman vortex Deviation calculating means for calculating the deviation;
Based on the deviation of the autocorrelation value, a musical sound generating means for generating a musical sound to be generated by the sound generation unit;
A musical sound generating device having The musical sound generating means includes
When the deviation of the autocorrelation value is larger than a threshold value, the first musical tone signal is increased by making the synthesis ratio of the second musical signal of the glow sound larger than the synthetic ratio of the first musical signal of the normal sound. The musical tone generation apparatus according to claim 1, wherein the musical tone is generated by combining the second musical tone signal with the second musical tone signal. The musical sound generating means includes
When the deviation of the autocorrelation value is smaller than a threshold value, the first musical sound signal is reduced by making the synthesis ratio of the second musical signal of the glow sound smaller than the synthetic ratio of the first musical signal of the normal sound. The musical sound generating apparatus according to claim 1, wherein the musical sound is generated by combining the second musical sound signal with the second musical sound signal. Signal strength determining means for acquiring breath signal strength information from the output value of the voice sensor;
Further comprising
The musical sound generating means includes
The musical tone is generated by synthesizing the first musical tone signal of the normal tone and the second musical tone signal of the glow tone based on the sexuality ratio determined based on the deviation of the autocorrelation value and the signal strength information. The musical tone generating device according to any one of claims 1 to 3. A musical sound generating device according to any one of claims 1 to 4,
A sound generation unit for generating a musical sound generated by the musical sound generation device;
Electronic musical instrument with From a plurality of autocorrelation values calculated based on output values that are continuously output from the voice sensor in response to the input, breath sounds and utterance sounds are input from the voice sensor through a member that generates a Karman vortex Calculate the deviation,
A musical sound generation method for generating a musical sound to be generated by the sound generation unit based on the deviation of the autocorrelation value. On the computer,
From a plurality of autocorrelation values calculated based on output values that are continuously output from the voice sensor in response to the input, breath sounds and utterance sounds are input from the voice sensor through a member that generates a Karman vortex Calculating a deviation;
Based on the deviation of the autocorrelation value, generating a musical sound to be generated by the sound generation unit;
A program for running